00000001:00080000:2.0F:1784188947.738996:0:75588:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 81604378730 is committed 00000100:00100000:1.0F:1784188947.739684:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf43f58000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:83237:x1870854457998720:12345-0@lo:1000:osp_up1-0.0 Request processed in 13898us (16389us total) trans 81604378730 rc 0/0 00000100:00100000:1.0:1784188947.739705:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3665 00000004:00080000:1.0:1784188947.739767:0:83237:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 81604378730 committed transno 81604378730 00000100:00100000:1.0:1784188947.739772:0:83237:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 81604378730 gen 2 00000100:00100000:1.0:1784188947.739792:0:83237:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc06bbf0700 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:83237:1870854457998720:0@lo:1000:osp_up1-0.0 00000400:00080000:1.0:1784188947.814163:0:83665:0:(debug.c:457:libcfs_run_debug_log_upcall()) Invoked LNET debug log upcall /usr/lib/lustre/lnet_debug_log_upcall /tmp/lustre-log.1784188947.83254 00010000:02000000:3.0F:1784188947.814290:0:83254:0:(ldlm_lib.c:1868:target_finish_recovery()) lustre-MDT0000: Recovery over after 3:04, of 2 clients 1 recovered and 1 was evicted. 00000004:00000080:0.0F:1784188947.850008:0:83254:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffae0987a0fe10 00100000:10000000:0.0:1784188947.850036:0:83254:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000004:00080000:2.0:1784188947.851902:0:83240:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x280000401:0x45c:0x0] 00000100:00100000:2.0:1784188947.851959:0:83240:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc075aa2300 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:83240:1870854457998848:0@lo:5:osp-pre-0-0.0 00000100:00100000:2.0:1784188947.852025:0:83240:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784188947.852060:0:83240:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dc0754d6240 going to sleep for 20 seconds 00000100:00100000:0.0:1784188947.852168:0:26171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854457998848 00000100:00100000:0.0:1784188947.852176:0:26171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854457998848 00000100:00100000:0.0:1784188947.852228:0:26171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4908 00000100:00100000:0.0:1784188947.852238:0:26171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc075aa2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+5:83240:x1870854457998848:12345-0@lo:5:osp-pre-0-0.0 00000020:02000000:0.0:1784188947.852245:0:26171:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00002000:00080000:0.0:1784188947.852270:0:26171:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 1697 -> diff = -581 00002000:02000040:0.0:1784188947.852275:0:26171:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:1117 to 0x280000401:1697) 00000004:00080000:1.0:1784188947.856125:0:83242:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x2c0000401:0x682:0x0] 00000100:00100000:1.0:1784188947.856189:0:83242:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc06bbf0700 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:83242:1870854457998976:0@lo:5:osp-pre-1-0.0 00000100:00100000:1.0:1784188947.856259:0:83242:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784188947.856299:0:83242:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dc0757706c0 going to sleep for 20 seconds 00000100:00100000:3.0:1784188947.856394:0:26162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854457998976 00000100:00100000:3.0:1784188947.856401:0:26162:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854457998976 00000100:00100000:3.0:1784188947.856462:0:26162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4909 00000100:00100000:3.0:1784188947.856472:0:26162:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc050543800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+5:83242:x1870854457998976:12345-0@lo:5:osp-pre-1-0.0 00000020:02000000:3.0:1784188947.856479:0:26162:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00002000:00080000:3.0:1784188947.856507:0:26162:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 1697 -> diff = -31 00002000:02000040:3.0:1784188947.856513:0:26162:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000401:1667 to 0x2c0000401:1697) 00002000:00010000:0.0:1784188947.860808:0:26171:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6a1:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784188947.860833:0:26171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f2600df0/0xcc1762b626f8a249 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6a1:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784188947.860853:0:26171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6a1:0x0].0x0 since=3190s v=(0 0) 00010000:00010000:0.0:1784188947.860859:0:26171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6a1:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784188947.860865:0:26171:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f2600df0/0xcc1762b626f8a249 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6a1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784188947.860882:0:26171:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f2600df0/0xcc1762b626f8a249 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6a1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784188947.860894:0:26171:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f2600df0/0xcc1762b626f8a249 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6a1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784188947.860902:0:26171:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f2600df0/0xcc1762b626f8a249 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6a1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784188947.860926:0:26171:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1784188947.861050:0:26171:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6a0:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784188947.861055:0:26171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004acab531/0xcc1762b626f8a250 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6a0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784188947.861063:0:26171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6a0:0x0].0x0 since=3190s v=(0 0) 00010000:00010000:0.0:1784188947.861067:0:26171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6a0:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784188947.861070:0:26171:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004acab531/0xcc1762b626f8a250 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784188947.861080:0:26171:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004acab531/0xcc1762b626f8a250 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784188947.861088:0:26171:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004acab531/0xcc1762b626f8a250 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784188947.861095:0:26171:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004acab531/0xcc1762b626f8a250 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784188947.861108:0:26171:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:0.0:1784188947.861143:0:26171:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x69f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784188947.861148:0:26171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005168a0f1/0xcc1762b626f8a257 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x69f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784188947.861155:0:26171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x69f:0x0].0x0 since=3190s v=(0 0) 00010000:00010000:0.0:1784188947.861158:0:26171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x69f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784188947.861162:0:26171:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005168a0f1/0xcc1762b626f8a257 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x69f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784188947.861182:0:26171:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005168a0f1/0xcc1762b626f8a257 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x69f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784188947.861190:0:26171:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005168a0f1/0xcc1762b626f8a257 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x69f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784188947.861197:0:26171:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005168a0f1/0xcc1762b626f8a257 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x69f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784188947.861210:0:26171:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:0.0:1784188947.861253:0:26171:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x69e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784188947.861258:0:26171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000012da23a3/0xcc1762b626f8a25e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x69e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784188947.861267:0:26171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x69e:0x0].0x0 since=3190s v=(0 0) 00010000:00010000:0.0:1784188947.861270:0:26171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x69e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784188947.861274:0:26171:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000012da23a3/0xcc1762b626f8a25e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x69e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784188947.861284:0:26171:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000012da23a3/0xcc1762b626f8a25e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x69e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784188947.861291:0:26171:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000012da23a3/0xcc1762b626f8a25e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x69e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784188947.861309:0:26171:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000012da23a3/0xcc1762b626f8a25e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x69e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784188947.861351:0:26171:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00010000:00010000:0.0:1784188947.861576:0:6502:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1784188947.861583:0:6502:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f2600df0/0xcc1762b626f8a249 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6a1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784188947.861591:0:6502:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc070147e00 already unused, calling callback (ffffffffc0b2e230) 00010000:00010000:0.0:1784188947.861596:0:6502:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f2600df0/0xcc1762b626f8a249 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6a1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784188947.861605:0:6502:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f2600df0/0xcc1762b626f8a249 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6a1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784188947.861623:0:6502:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f2600df0/0xcc1762b626f8a249 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6a1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784188947.861631:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f2600df0/0xcc1762b626f8a249 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6a1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784188947.861649:0:6502:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1784188947.861653:0:6502:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004acab531/0xcc1762b626f8a250 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784188947.861906:0:26173:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1784188947.861912:0:26173:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005168a0f1/0xcc1762b626f8a257 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x69f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784188947.861920:0:26173:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc070146400 already unused, calling callback (ffffffffc0b2e230) 00010000:00010000:2.0:1784188947.861924:0:26173:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005168a0f1/0xcc1762b626f8a257 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x69f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784188947.861932:0:26173:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005168a0f1/0xcc1762b626f8a257 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x69f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784188947.861944:0:26173:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005168a0f1/0xcc1762b626f8a257 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x69f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784188947.861952:0:26173:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005168a0f1/0xcc1762b626f8a257 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x69f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784188947.861967:0:26173:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784188947.861970:0:26173:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000012da23a3/0xcc1762b626f8a25e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x69e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784188947.861977:0:26173:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc070147800 already unused, calling callback (ffffffffc0b2e230) 00010000:00010000:2.0:1784188947.861980:0:26173:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000012da23a3/0xcc1762b626f8a25e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x69e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784188947.861995:0:26173:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000012da23a3/0xcc1762b626f8a25e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x69e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784188947.862005:0:26173:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000012da23a3/0xcc1762b626f8a25e lrc: 1/0,0 mode: --/PW res: [0x280000401:0x69e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784188947.862012:0:26173:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000012da23a3/0xcc1762b626f8a25e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x69e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784188947.862025:0:26173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784188947.862027:0:26173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784188947.862029:0:26173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784188947.862069:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784188947.863041:0:7454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1784188947.863234:0:26171:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x69d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784188947.863242:0:26171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003b91f60d/0xcc1762b626f8a265 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x69d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784188947.863257:0:26171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x69d:0x0].0x0 since=3190s v=(0 0) 00010000:00010000:1.0:1784188947.863260:0:26171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x69d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784188947.863267:0:26171:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003b91f60d/0xcc1762b626f8a265 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x69d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784188947.863279:0:26171:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003b91f60d/0xcc1762b626f8a265 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x69d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784188947.863288:0:26171:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003b91f60d/0xcc1762b626f8a265 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x69d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784188947.863311:0:26171:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003b91f60d/0xcc1762b626f8a265 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x69d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784188947.863351:0:26171:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1784188947.863393:0:26171:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x69c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784188947.863398:0:26171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000a795375/0xcc1762b626f8a26c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x69c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784188947.863406:0:26171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x69c:0x0].0x0 since=3190s v=(0 0) 00010000:00010000:1.0:1784188947.863409:0:26171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x69c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784188947.863413:0:26171:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000a795375/0xcc1762b626f8a26c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x69c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784188947.863422:0:26171:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000a795375/0xcc1762b626f8a26c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x69c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784188947.863430:0:26171:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000a795375/0xcc1762b626f8a26c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x69c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784188947.863437:0:26171:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000a795375/0xcc1762b626f8a26c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x69c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784188947.863449:0:26171:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:1.0:1784188947.863483:0:26171:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x69b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784188947.863489:0:26171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000434d0145/0xcc1762b626f8a273 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x69b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784188947.863502:0:26171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x69b:0x0].0x0 since=3190s v=(0 0) 00010000:00010000:1.0:1784188947.863505:0:26171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x69b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784188947.863510:0:26171:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000434d0145/0xcc1762b626f8a273 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x69b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784188947.863518:0:26171:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000434d0145/0xcc1762b626f8a273 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x69b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784188947.863525:0:26171:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000434d0145/0xcc1762b626f8a273 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x69b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784188947.863532:0:26171:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000434d0145/0xcc1762b626f8a273 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x69b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784188947.863546:0:26171:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:1.0:1784188947.863554:0:7454:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1784188947.863559:0:7454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003b91f60d/0xcc1762b626f8a265 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x69d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784188947.863566:0:7454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc0565e7200 already unused, calling callback (ffffffffc0b2e230) 00010000:00010000:1.0:1784188947.863570:0:7454:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003b91f60d/0xcc1762b626f8a265 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x69d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784188947.863578:0:7454:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003b91f60d/0xcc1762b626f8a265 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x69d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784188947.863605:0:7454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003b91f60d/0xcc1762b626f8a265 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x69d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784188947.863613:0:7454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003b91f60d/0xcc1762b626f8a265 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x69d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784188947.863630:0:7454:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1784188947.863633:0:7454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000a795375/0xcc1762b626f8a26c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x69c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784188947.863639:0:7454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc0565e7000 already unused, calling callback (ffffffffc0b2e230) 00010000:00010000:1.0:1784188947.863642:0:7454:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000a795375/0xcc1762b626f8a26c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x69c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784188947.863648:0:7454:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000a795375/0xcc1762b626f8a26c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x69c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784188947.863656:0:7454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000a795375/0xcc1762b626f8a26c lrc: 1/0,0 mode: --/PW res: [0x280000401:0x69c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784188947.863662:0:7454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000a795375/0xcc1762b626f8a26c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x69c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784188947.863670:0:7454:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784188947.863673:0:7454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000434d0145/0xcc1762b626f8a273 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x69b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784188947.863685:0:7454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc0565e6c00 already unused, calling callback (ffffffffc0b2e230) 00010000:00010000:1.0:1784188947.863689:0:7454:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000434d0145/0xcc1762b626f8a273 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x69b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784188947.863695:0:7454:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000434d0145/0xcc1762b626f8a273 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x69b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784188947.863705:0:7454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000434d0145/0xcc1762b626f8a273 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x69b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784188947.863712:0:7454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000434d0145/0xcc1762b626f8a273 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x69b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784188947.863723:0:7454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784188947.863725:0:7454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784188947.863727:0:7454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1784188947.863765:0:26171:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x69a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784188947.863771:0:26171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000afbbf3fa/0xcc1762b626f8a27a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x69a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784188947.863778:0:26171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x69a:0x0].0x0 since=3190s v=(0 0) 00010000:00010000:1.0:1784188947.863781:0:26171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x69a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784188947.863784:0:26171:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000afbbf3fa/0xcc1762b626f8a27a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x69a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784188947.863792:0:26171:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000afbbf3fa/0xcc1762b626f8a27a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x69a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784188947.863806:0:26171:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000afbbf3fa/0xcc1762b626f8a27a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x69a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784188947.863813:0:26171:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000afbbf3fa/0xcc1762b626f8a27a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x69a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784188947.863844:0:26171:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1784188947.863851:0:7454:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784188947.863854:0:7454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000afbbf3fa/0xcc1762b626f8a27a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x69a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784188947.863860:0:7454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc0565e7e00 already unused, calling callback (ffffffffc0b2e230) 00010000:00010000:1.0:1784188947.863862:0:7454:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000afbbf3fa/0xcc1762b626f8a27a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x69a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784188947.863869:0:7454:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000afbbf3fa/0xcc1762b626f8a27a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x69a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784188947.863880:0:7454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000afbbf3fa/0xcc1762b626f8a27a lrc: 1/0,0 mode: --/PW res: [0x280000401:0x69a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784188947.863887:0:7454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000afbbf3fa/0xcc1762b626f8a27a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x69a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784188947.863899:0:7454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784188947.863906:0:7454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784188947.863917:0:7454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1784188947.863954:0:26171:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x699:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784188947.863959:0:26171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fefded14/0xcc1762b626f8a281 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x699:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784188947.863967:0:26171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x699:0x0].0x0 since=3190s v=(0 0) 00010000:00010000:1.0:1784188947.863970:0:26171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x699:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784188947.863974:0:26171:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fefded14/0xcc1762b626f8a281 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x699:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784188947.863983:0:26171:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fefded14/0xcc1762b626f8a281 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x699:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784188947.863991:0:26171:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fefded14/0xcc1762b626f8a281 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x699:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784188947.863997:0:26171:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fefded14/0xcc1762b626f8a281 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x699:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784188947.864008:0:26171:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1784188947.864013:0:7454:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784188947.864016:0:7454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fefded14/0xcc1762b626f8a281 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x699:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784188947.864022:0:7454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc0565e7800 already unused, calling callback (ffffffffc0b2e230) 00010000:00010000:1.0:1784188947.864025:0:7454:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fefded14/0xcc1762b626f8a281 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x699:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784188947.864045:0:7454:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fefded14/0xcc1762b626f8a281 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x699:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784188947.864057:0:7454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fefded14/0xcc1762b626f8a281 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x699:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784188947.864065:0:7454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fefded14/0xcc1762b626f8a281 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x699:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784188947.864077:0:7454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784188947.864079:0:7454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784188947.864081:0:7454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1784188947.864121:0:26171:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x698:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784188947.864127:0:26171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000afb0ab48/0xcc1762b626f8a288 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x698:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784188947.864135:0:26171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x698:0x0].0x0 since=3190s v=(0 0) 00010000:00010000:1.0:1784188947.864138:0:26171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x698:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784188947.864142:0:26171:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000afb0ab48/0xcc1762b626f8a288 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x698:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784188947.864151:0:26171:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000afb0ab48/0xcc1762b626f8a288 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x698:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784188947.864159:0:26171:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000afb0ab48/0xcc1762b626f8a288 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x698:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784188947.864171:0:26171:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000afb0ab48/0xcc1762b626f8a288 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x698:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784188947.864184:0:26171:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1784188947.864191:0:7454:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784188947.864195:0:7454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000afb0ab48/0xcc1762b626f8a288 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x698:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784188947.864202:0:7454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc0565e7a00 already unused, calling callback (ffffffffc0b2e230) 00010000:00010000:1.0:1784188947.864205:0:7454:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000afb0ab48/0xcc1762b626f8a288 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x698:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784188947.864215:0:7454:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000afb0ab48/0xcc1762b626f8a288 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x698:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784188947.864226:0:7454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000afb0ab48/0xcc1762b626f8a288 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x698:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784188947.864233:0:7454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000afb0ab48/0xcc1762b626f8a288 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x698:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784188947.864245:0:7454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784188947.864246:0:7454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784188947.864248:0:7454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1784188947.864286:0:26171:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x697:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784188947.864298:0:26171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000c462bc2/0xcc1762b626f8a28f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x697:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784188947.864306:0:26171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x697:0x0].0x0 since=3190s v=(0 0) 00010000:00010000:1.0:1784188947.864310:0:26171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x697:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784188947.864314:0:26171:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000c462bc2/0xcc1762b626f8a28f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x697:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784188947.864345:0:26171:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000c462bc2/0xcc1762b626f8a28f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x697:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784188947.864354:0:26171:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000c462bc2/0xcc1762b626f8a28f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x697:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784188947.864361:0:26171:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000c462bc2/0xcc1762b626f8a28f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x697:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784188947.864381:0:26171:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1784188947.864389:0:7454:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784188947.864394:0:7454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000c462bc2/0xcc1762b626f8a28f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x697:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784188947.864403:0:7454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc0565e6000 already unused, calling callback (ffffffffc0b2e230) 00010000:00010000:1.0:1784188947.864406:0:7454:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000c462bc2/0xcc1762b626f8a28f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x697:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784188947.864414:0:7454:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000c462bc2/0xcc1762b626f8a28f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x697:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784188947.864431:0:7454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000c462bc2/0xcc1762b626f8a28f lrc: 1/0,0 mode: --/PW res: [0x280000401:0x697:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784188947.864439:0:7454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000c462bc2/0xcc1762b626f8a28f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x697:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784188947.864452:0:7454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784188947.864453:0:7454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784188947.864455:0:7454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1784188947.864498:0:26171:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x696:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784188947.864503:0:26171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a7eb9d01/0xcc1762b626f8a296 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x696:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784188947.864511:0:26171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x696:0x0].0x0 since=3190s v=(0 0) 00010000:00010000:1.0:1784188947.864514:0:26171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x696:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784188947.864517:0:26171:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a7eb9d01/0xcc1762b626f8a296 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x696:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784188947.864525:0:26171:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a7eb9d01/0xcc1762b626f8a296 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x696:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784188947.864532:0:26171:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a7eb9d01/0xcc1762b626f8a296 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x696:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784188947.864538:0:26171:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a7eb9d01/0xcc1762b626f8a296 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x696:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784188947.864559:0:26171:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1784188947.864566:0:7454:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784188947.864569:0:7454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a7eb9d01/0xcc1762b626f8a296 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x696:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784188947.864576:0:7454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc0565e6800 already unused, calling callback (ffffffffc0b2e230) 00010000:00010000:1.0:1784188947.864579:0:7454:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a7eb9d01/0xcc1762b626f8a296 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x696:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784188947.864586:0:7454:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a7eb9d01/0xcc1762b626f8a296 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x696:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784188947.864596:0:7454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a7eb9d01/0xcc1762b626f8a296 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x696:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784188947.864603:0:7454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a7eb9d01/0xcc1762b626f8a296 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x696:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784188947.864614:0:7454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784188947.864616:0:7454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784188947.864618:0:7454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1784188947.864658:0:26171:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x695:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784188947.864663:0:26171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d1a99062/0xcc1762b626f8a29d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x695:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784188947.864671:0:26171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x695:0x0].0x0 since=3190s v=(0 0) 00010000:00010000:1.0:1784188947.864680:0:26171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x695:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784188947.864684:0:26171:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d1a99062/0xcc1762b626f8a29d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x695:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784188947.864693:0:26171:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d1a99062/0xcc1762b626f8a29d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x695:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784188947.864700:0:26171:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d1a99062/0xcc1762b626f8a29d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x695:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784188947.864708:0:26171:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d1a99062/0xcc1762b626f8a29d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x695:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784188947.864720:0:26171:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1784188947.864727:0:7454:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784188947.864730:0:7454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d1a99062/0xcc1762b626f8a29d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x695:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784188947.864737:0:7454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc0565e6a00 already unused, calling callback (ffffffffc0b2e230) 00010000:00010000:1.0:1784188947.864740:0:7454:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d1a99062/0xcc1762b626f8a29d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x695:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784188947.864748:0:7454:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d1a99062/0xcc1762b626f8a29d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x695:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784188947.864757:0:7454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d1a99062/0xcc1762b626f8a29d lrc: 1/0,0 mode: --/PW res: [0x280000401:0x695:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784188947.864774:0:7454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d1a99062/0xcc1762b626f8a29d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x695:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784188947.864787:0:7454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784188947.864789:0:7454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784188947.864791:0:7454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1784188947.864842:0:26171:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x694:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784188947.864847:0:26171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006826d44b/0xcc1762b626f8a2a4 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x694:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784188947.864854:0:26171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x694:0x0].0x0 since=3190s v=(0 0) 00010000:00010000:1.0:1784188947.864857:0:26171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x694:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784188947.864861:0:26171:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006826d44b/0xcc1762b626f8a2a4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x694:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784188947.864871:0:26171:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006826d44b/0xcc1762b626f8a2a4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x694:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784188947.864878:0:26171:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006826d44b/0xcc1762b626f8a2a4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x694:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784188947.864886:0:26171:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006826d44b/0xcc1762b626f8a2a4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x694:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784188947.864898:0:26171:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1784188947.864910:0:7454:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784188947.864914:0:7454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006826d44b/0xcc1762b626f8a2a4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x694:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784188947.864921:0:7454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dbf47d93c00 already unused, calling callback (ffffffffc0b2e230) 00010000:00010000:1.0:1784188947.864925:0:7454:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006826d44b/0xcc1762b626f8a2a4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x694:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784188947.864932:0:7454:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006826d44b/0xcc1762b626f8a2a4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x694:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784188947.864942:0:7454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006826d44b/0xcc1762b626f8a2a4 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x694:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784188947.864949:0:7454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006826d44b/0xcc1762b626f8a2a4 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x694:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784188947.864962:0:7454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784188947.864964:0:7454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784188947.864965:0:7454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1784188947.865003:0:26171:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x693:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784188947.865008:0:26171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000076fb3687/0xcc1762b626f8a2ab lrc: 3/0,1 mode: --/PW res: [0x280000401:0x693:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784188947.865015:0:26171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x693:0x0].0x0 since=3190s v=(0 0) 00010000:00010000:1.0:1784188947.865018:0:26171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x693:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784188947.865023:0:26171:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000076fb3687/0xcc1762b626f8a2ab lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x693:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784188947.865041:0:26171:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000076fb3687/0xcc1762b626f8a2ab lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x693:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784188947.865050:0:26171:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000076fb3687/0xcc1762b626f8a2ab lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x693:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784188947.865058:0:26171:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000076fb3687/0xcc1762b626f8a2ab lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x693:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784188947.865070:0:26171:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1784188947.865077:0:7454:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784188947.865081:0:7454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000076fb3687/0xcc1762b626f8a2ab lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x693:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784188947.865087:0:7454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dbf47d92800 already unused, calling callback (ffffffffc0b2e230) 00010000:00010000:1.0:1784188947.865090:0:7454:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000076fb3687/0xcc1762b626f8a2ab lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x693:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784188947.865098:0:7454:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000076fb3687/0xcc1762b626f8a2ab lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x693:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784188947.865107:0:7454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000076fb3687/0xcc1762b626f8a2ab lrc: 1/0,0 mode: --/PW res: [0x280000401:0x693:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784188947.865114:0:7454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000076fb3687/0xcc1762b626f8a2ab lrc: 0/0,0 mode: --/PW res: [0x280000401:0x693:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784188947.865134:0:7454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784188947.865135:0:7454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784188947.865137:0:7454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1784188947.865175:0:26171:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x692:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784188947.865179:0:26171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f3b8e104/0xcc1762b626f8a2b2 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x692:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784188947.865186:0:26171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x692:0x0].0x0 since=3190s v=(0 0) 00010000:00010000:1.0:1784188947.865188:0:26171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x692:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784188947.865192:0:26171:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f3b8e104/0xcc1762b626f8a2b2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x692:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784188947.865201:0:26171:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f3b8e104/0xcc1762b626f8a2b2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x692:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784188947.865208:0:26171:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f3b8e104/0xcc1762b626f8a2b2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x692:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784188947.865215:0:26171:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f3b8e104/0xcc1762b626f8a2b2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x692:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784188947.865227:0:26171:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1784188947.865233:0:7454:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784188947.865237:0:7454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f3b8e104/0xcc1762b626f8a2b2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x692:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784188947.865254:0:7454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dbf47d93e00 already unused, calling callback (ffffffffc0b2e230) 00010000:00010000:1.0:1784188947.865258:0:7454:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f3b8e104/0xcc1762b626f8a2b2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x692:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784188947.865266:0:7454:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f3b8e104/0xcc1762b626f8a2b2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x692:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784188947.865276:0:7454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f3b8e104/0xcc1762b626f8a2b2 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x692:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784188947.865283:0:7454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f3b8e104/0xcc1762b626f8a2b2 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x692:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784188947.865295:0:7454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784188947.865297:0:7454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784188947.865299:0:7454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1784188947.865358:0:26171:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x691:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784188947.865364:0:26171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000016844140/0xcc1762b626f8a2b9 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x691:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784188947.865371:0:26171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x691:0x0].0x0 since=3190s v=(0 0) 00010000:00010000:1.0:1784188947.865374:0:26171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x691:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784188947.865378:0:26171:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000016844140/0xcc1762b626f8a2b9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x691:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784188947.865386:0:26171:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000016844140/0xcc1762b626f8a2b9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x691:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784188947.865399:0:26171:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000016844140/0xcc1762b626f8a2b9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x691:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784188947.865404:0:26171:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000016844140/0xcc1762b626f8a2b9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x691:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784188947.865415:0:26171:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1784188947.865422:0:7454:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784188947.865426:0:7454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000016844140/0xcc1762b626f8a2b9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x691:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784188947.865431:0:7454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dbf47d92c00 already unused, calling callback (ffffffffc0b2e230) 00010000:00010000:1.0:1784188947.865434:0:7454:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000016844140/0xcc1762b626f8a2b9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x691:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784188947.865441:0:7454:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000016844140/0xcc1762b626f8a2b9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x691:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784188947.865451:0:7454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000016844140/0xcc1762b626f8a2b9 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x691:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784188947.865457:0:7454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000016844140/0xcc1762b626f8a2b9 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x691:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784188947.865470:0:7454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784188947.865477:0:7454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784188947.865479:0:7454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1784188947.865519:0:26171:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x690:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784188947.865523:0:26171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d758cbb5/0xcc1762b626f8a2c0 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x690:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784188947.865531:0:26171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x690:0x0].0x0 since=3190s v=(0 0) 00010000:00010000:1.0:1784188947.865534:0:26171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x690:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784188947.865538:0:26171:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d758cbb5/0xcc1762b626f8a2c0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x690:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784188947.865548:0:26171:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d758cbb5/0xcc1762b626f8a2c0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x690:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784188947.865556:0:26171:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d758cbb5/0xcc1762b626f8a2c0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x690:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784188947.865563:0:26171:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d758cbb5/0xcc1762b626f8a2c0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x690:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784188947.865576:0:26171:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1784188947.865582:0:7454:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784188947.865585:0:7454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d758cbb5/0xcc1762b626f8a2c0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x690:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784188947.865592:0:7454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dbf47d93800 already unused, calling callback (ffffffffc0b2e230) 00010000:00010000:1.0:1784188947.865595:0:7454:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d758cbb5/0xcc1762b626f8a2c0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x690:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784188947.865612:0:7454:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d758cbb5/0xcc1762b626f8a2c0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x690:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784188947.865624:0:7454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d758cbb5/0xcc1762b626f8a2c0 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x690:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784188947.865631:0:7454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d758cbb5/0xcc1762b626f8a2c0 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x690:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784188947.865643:0:7454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784188947.865645:0:7454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784188947.865646:0:7454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1784188947.865693:0:26171:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x68f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784188947.865698:0:26171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000058e57339/0xcc1762b626f8a2c7 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x68f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784188947.865705:0:26171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x68f:0x0].0x0 since=3190s v=(0 0) 00010000:00010000:1.0:1784188947.865707:0:26171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x68f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784188947.865711:0:26171:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000058e57339/0xcc1762b626f8a2c7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x68f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784188947.865719:0:26171:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000058e57339/0xcc1762b626f8a2c7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x68f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784188947.865725:0:26171:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000058e57339/0xcc1762b626f8a2c7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x68f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784188947.865737:0:26171:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000058e57339/0xcc1762b626f8a2c7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x68f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784188947.865749:0:26171:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1784188947.865755:0:7454:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784188947.865758:0:7454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000058e57339/0xcc1762b626f8a2c7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x68f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784188947.865765:0:7454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dbf47d92400 already unused, calling callback (ffffffffc0b2e230) 00010000:00010000:1.0:1784188947.865768:0:7454:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000058e57339/0xcc1762b626f8a2c7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x68f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784188947.865776:0:7454:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000058e57339/0xcc1762b626f8a2c7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x68f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784188947.865786:0:7454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000058e57339/0xcc1762b626f8a2c7 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x68f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784188947.865794:0:7454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000058e57339/0xcc1762b626f8a2c7 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x68f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784188947.865806:0:7454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784188947.865808:0:7454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784188947.865810:0:7454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784188947.865936:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784188947.865943:0:26173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784188947.869549:0:6502:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc070146200 already unused, calling callback (ffffffffc0b2e230) 00010000:00010000:0.0:1784188947.869566:0:6502:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004acab531/0xcc1762b626f8a250 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784188947.869583:0:6502:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004acab531/0xcc1762b626f8a250 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784188947.869606:0:6502:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004acab531/0xcc1762b626f8a250 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784188947.869614:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004acab531/0xcc1762b626f8a250 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784188947.869640:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784188947.869642:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784188947.869646:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1784188947.870010:0:26171:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x68e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784188947.870031:0:26171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000093cce575/0xcc1762b626f8a2ce lrc: 3/0,1 mode: --/PW res: [0x280000401:0x68e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784188947.870044:0:26171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x68e:0x0].0x0 since=3190s v=(0 0) 00010000:00010000:1.0:1784188947.870048:0:26171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x68e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784188947.870055:0:26171:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000093cce575/0xcc1762b626f8a2ce lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x68e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784188947.870069:0:26171:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000093cce575/0xcc1762b626f8a2ce lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x68e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784188947.870077:0:26171:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000093cce575/0xcc1762b626f8a2ce lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x68e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784188947.870085:0:26171:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000093cce575/0xcc1762b626f8a2ce lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x68e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784188947.870111:0:26171:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1784188947.870155:0:26171:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x68d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784188947.870160:0:26171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bcbdd0aa/0xcc1762b626f8a2d5 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x68d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784188947.870169:0:26171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x68d:0x0].0x0 since=3190s v=(0 0) 00010000:00010000:1.0:1784188947.870172:0:26171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x68d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784188947.870176:0:26171:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bcbdd0aa/0xcc1762b626f8a2d5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x68d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784188947.870184:0:26171:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bcbdd0aa/0xcc1762b626f8a2d5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x68d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784188947.870198:0:26171:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bcbdd0aa/0xcc1762b626f8a2d5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x68d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784188947.870205:0:26171:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bcbdd0aa/0xcc1762b626f8a2d5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x68d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784188947.870267:0:26171:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:1.0:1784188947.870308:0:26171:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x68c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784188947.870313:0:26171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006d142cd5/0xcc1762b626f8a2dc lrc: 3/0,1 mode: --/PW res: [0x280000401:0x68c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784188947.870344:0:26171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x68c:0x0].0x0 since=3190s v=(0 0) 00010000:00010000:1.0:1784188947.870346:0:26171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x68c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784188947.870350:0:26171:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006d142cd5/0xcc1762b626f8a2dc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x68c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784188947.870359:0:26171:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006d142cd5/0xcc1762b626f8a2dc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x68c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784188947.870366:0:26171:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006d142cd5/0xcc1762b626f8a2dc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x68c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784188947.870372:0:26171:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006d142cd5/0xcc1762b626f8a2dc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x68c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784188947.870466:0:6501:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1784188947.870474:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000093cce575/0xcc1762b626f8a2ce lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x68e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784188947.870482:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dbf47d92e00 already unused, calling callback (ffffffffc0b2e230) 00010000:00010000:2.0:1784188947.870487:0:6501:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000093cce575/0xcc1762b626f8a2ce lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x68e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784188947.870496:0:6501:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000093cce575/0xcc1762b626f8a2ce lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x68e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784188947.870521:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000093cce575/0xcc1762b626f8a2ce lrc: 1/0,0 mode: --/PW res: [0x280000401:0x68e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784188947.870527:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000093cce575/0xcc1762b626f8a2ce lrc: 0/0,0 mode: --/PW res: [0x280000401:0x68e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784188947.870547:0:6501:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1784188947.870550:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bcbdd0aa/0xcc1762b626f8a2d5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x68d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784188947.870557:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dbf47d92200 already unused, calling callback (ffffffffc0b2e230) 00010000:00010000:2.0:1784188947.870560:0:6501:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bcbdd0aa/0xcc1762b626f8a2d5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x68d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784188947.870568:0:6501:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bcbdd0aa/0xcc1762b626f8a2d5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x68d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784188947.870577:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bcbdd0aa/0xcc1762b626f8a2d5 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x68d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784188947.870583:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bcbdd0aa/0xcc1762b626f8a2d5 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x68d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784188947.870594:0:6501:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784188947.870598:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006d142cd5/0xcc1762b626f8a2dc lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x68c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784188947.870610:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dbf47d93a00 already unused, calling callback (ffffffffc0b2e230) 00010000:00010000:2.0:1784188947.870614:0:6501:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006d142cd5/0xcc1762b626f8a2dc lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x68c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784188947.870622:0:6501:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006d142cd5/0xcc1762b626f8a2dc lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x68c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784188947.870632:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006d142cd5/0xcc1762b626f8a2dc lrc: 2/0,0 mode: --/PW res: [0x280000401:0x68c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784188947.870640:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784188947.870641:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784188947.870643:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1784188947.873586:0:26162:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6a1:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1784188947.873601:0:26162:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ed5d4194/0xcc1762b626f8a2e3 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6a1:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784188947.873620:0:26162:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6a1:0x0].0x0 since=3190s v=(0 0) 00010000:00010000:2.0:1784188947.873625:0:26162:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6a1:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784188947.873631:0:26162:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ed5d4194/0xcc1762b626f8a2e3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6a1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784188947.873648:0:26162:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ed5d4194/0xcc1762b626f8a2e3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6a1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784188947.873690:0:26162:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ed5d4194/0xcc1762b626f8a2e3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6a1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784188947.873699:0:26162:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ed5d4194/0xcc1762b626f8a2e3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6a1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784188947.873728:0:26162:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1784188947.874698:0:26162:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6a0:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1784188947.874706:0:26162:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ed60d82c/0xcc1762b626f8a2ea lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6a0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784188947.874718:0:26162:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6a0:0x0].0x0 since=3190s v=(0 0) 00010000:00010000:2.0:1784188947.874722:0:26162:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6a0:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784188947.874728:0:26162:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ed60d82c/0xcc1762b626f8a2ea lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784188947.874740:0:26162:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ed60d82c/0xcc1762b626f8a2ea lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784188947.874748:0:26162:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ed60d82c/0xcc1762b626f8a2ea lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784188947.874755:0:26162:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ed60d82c/0xcc1762b626f8a2ea lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784188947.874918:0:26162:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:2.0:1784188947.874970:0:26162:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x69f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1784188947.874976:0:26162:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000097dfa651/0xcc1762b626f8a2f1 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x69f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784188947.874985:0:26162:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x69f:0x0].0x0 since=3190s v=(0 0) 00010000:00010000:2.0:1784188947.874988:0:26162:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x69f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784188947.874992:0:26162:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000097dfa651/0xcc1762b626f8a2f1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x69f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784188947.875001:0:26162:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000097dfa651/0xcc1762b626f8a2f1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x69f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784188947.875008:0:26162:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000097dfa651/0xcc1762b626f8a2f1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x69f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784188947.875016:0:26162:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000097dfa651/0xcc1762b626f8a2f1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x69f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784188947.875029:0:26162:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:2.0:1784188947.875043:0:6501:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1784188947.875048:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ed5d4194/0xcc1762b626f8a2e3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6a1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784188947.875056:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc080f04a00 already unused, calling callback (ffffffffc0b2e230) 00010000:00010000:2.0:1784188947.875067:0:6501:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ed5d4194/0xcc1762b626f8a2e3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6a1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784188947.875076:0:6501:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ed5d4194/0xcc1762b626f8a2e3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6a1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784188947.875092:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ed5d4194/0xcc1762b626f8a2e3 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6a1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784188947.875100:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ed5d4194/0xcc1762b626f8a2e3 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6a1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784188947.875117:0:6501:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1784188947.875120:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ed60d82c/0xcc1762b626f8a2ea lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784188947.875127:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc080f04000 already unused, calling callback (ffffffffc0b2e230) 00010000:00010000:2.0:1784188947.875130:0:6501:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ed60d82c/0xcc1762b626f8a2ea lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784188947.875137:0:6501:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ed60d82c/0xcc1762b626f8a2ea lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784188947.875146:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ed60d82c/0xcc1762b626f8a2ea lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784188947.875153:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ed60d82c/0xcc1762b626f8a2ea lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784188947.875170:0:6501:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784188947.875173:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000097dfa651/0xcc1762b626f8a2f1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x69f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784188947.875179:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc080f05400 already unused, calling callback (ffffffffc0b2e230) 00010000:00010000:2.0:1784188947.875183:0:6501:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000097dfa651/0xcc1762b626f8a2f1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x69f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784188947.875190:0:6501:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000097dfa651/0xcc1762b626f8a2f1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x69f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784188947.875200:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000097dfa651/0xcc1762b626f8a2f1 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x69f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784188947.875207:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000097dfa651/0xcc1762b626f8a2f1 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x69f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784188947.875216:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784188947.875217:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784188947.875220:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1784188947.875270:0:26162:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x69e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1784188947.875276:0:26162:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c4592e3f/0xcc1762b626f8a2f8 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x69e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784188947.875284:0:26162:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x69e:0x0].0x0 since=3190s v=(0 0) 00010000:00010000:2.0:1784188947.875292:0:26162:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x69e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784188947.875297:0:26162:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c4592e3f/0xcc1762b626f8a2f8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x69e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784188947.875307:0:26162:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c4592e3f/0xcc1762b626f8a2f8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x69e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784188947.875316:0:26162:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c4592e3f/0xcc1762b626f8a2f8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x69e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784188947.875347:0:26162:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c4592e3f/0xcc1762b626f8a2f8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x69e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784188947.875360:0:26162:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1784188947.875367:0:6501:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784188947.875371:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c4592e3f/0xcc1762b626f8a2f8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x69e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784188947.875378:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc080f05c00 already unused, calling callback (ffffffffc0b2e230) 00010000:00010000:2.0:1784188947.875382:0:6501:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c4592e3f/0xcc1762b626f8a2f8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x69e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784188947.875389:0:6501:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c4592e3f/0xcc1762b626f8a2f8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x69e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784188947.875399:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c4592e3f/0xcc1762b626f8a2f8 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x69e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784188947.875418:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c4592e3f/0xcc1762b626f8a2f8 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x69e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784188947.875431:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784188947.875433:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784188947.875435:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1784188947.875474:0:26162:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x69d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1784188947.875479:0:26162:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f0d46982/0xcc1762b626f8a2ff lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x69d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784188947.875487:0:26162:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x69d:0x0].0x0 since=3190s v=(0 0) 00010000:00010000:2.0:1784188947.875489:0:26162:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x69d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784188947.875494:0:26162:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f0d46982/0xcc1762b626f8a2ff lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x69d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784188947.875502:0:26162:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f0d46982/0xcc1762b626f8a2ff lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x69d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784188947.875510:0:26162:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f0d46982/0xcc1762b626f8a2ff lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x69d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784188947.875518:0:26162:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f0d46982/0xcc1762b626f8a2ff lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x69d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784188947.875531:0:26162:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1784188947.875543:0:6501:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784188947.875546:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f0d46982/0xcc1762b626f8a2ff lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x69d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784188947.875553:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc080f05000 already unused, calling callback (ffffffffc0b2e230) 00010000:00010000:2.0:1784188947.875557:0:6501:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f0d46982/0xcc1762b626f8a2ff lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x69d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784188947.875565:0:6501:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f0d46982/0xcc1762b626f8a2ff lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x69d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784188947.875576:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f0d46982/0xcc1762b626f8a2ff lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x69d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784188947.875583:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f0d46982/0xcc1762b626f8a2ff lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x69d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784188947.875594:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784188947.875596:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784188947.875597:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1784188947.875638:0:26162:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x69c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1784188947.875643:0:26162:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007e037eaa/0xcc1762b626f8a306 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x69c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784188947.875650:0:26162:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x69c:0x0].0x0 since=3190s v=(0 0) 00010000:00010000:2.0:1784188947.875653:0:26162:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x69c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784188947.875657:0:26162:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007e037eaa/0xcc1762b626f8a306 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x69c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784188947.875677:0:26162:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007e037eaa/0xcc1762b626f8a306 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x69c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784188947.875685:0:26162:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007e037eaa/0xcc1762b626f8a306 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x69c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784188947.875692:0:26162:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007e037eaa/0xcc1762b626f8a306 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x69c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784188947.875705:0:26162:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1784188947.875714:0:6501:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784188947.875717:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007e037eaa/0xcc1762b626f8a306 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x69c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784188947.875725:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc080f05600 already unused, calling callback (ffffffffc0b2e230) 00010000:00010000:2.0:1784188947.875728:0:6501:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007e037eaa/0xcc1762b626f8a306 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x69c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784188947.875737:0:6501:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007e037eaa/0xcc1762b626f8a306 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x69c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784188947.875748:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007e037eaa/0xcc1762b626f8a306 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x69c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784188947.875755:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007e037eaa/0xcc1762b626f8a306 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x69c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784188947.877784:0:26171:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1784188947.877799:0:26171:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006d142cd5/0xcc1762b626f8a2dc lrc: 0/0,0 mode: --/PW res: [0x280000401:0x68c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1784188947.877936:0:26171:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x68b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784188947.877944:0:26171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d5e2eae0/0xcc1762b626f8a30d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x68b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784188947.877958:0:26171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x68b:0x0].0x0 since=3190s v=(0 0) 00010000:00010000:1.0:1784188947.877963:0:26171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x68b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784188947.877969:0:26171:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d5e2eae0/0xcc1762b626f8a30d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x68b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784188947.877981:0:26171:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d5e2eae0/0xcc1762b626f8a30d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x68b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784188947.877991:0:26171:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d5e2eae0/0xcc1762b626f8a30d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x68b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784188947.877999:0:26171:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d5e2eae0/0xcc1762b626f8a30d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x68b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784188947.878010:0:26171:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1784188947.878049:0:26171:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x68a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784188947.878054:0:26171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f17848b0/0xcc1762b626f8a314 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x68a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784188947.878074:0:26171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x68a:0x0].0x0 since=3190s v=(0 0) 00010000:00010000:1.0:1784188947.878078:0:26171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x68a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784188947.878082:0:26171:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f17848b0/0xcc1762b626f8a314 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x68a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784188947.878301:0:26171:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f17848b0/0xcc1762b626f8a314 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x68a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784188947.878309:0:26171:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f17848b0/0xcc1762b626f8a314 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x68a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784188947.878316:0:26171:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f17848b0/0xcc1762b626f8a314 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x68a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784188947.878344:0:26171:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:1.0:1784188947.878388:0:26171:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x689:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784188947.878393:0:26171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000d329514/0xcc1762b626f8a31b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x689:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784188947.878401:0:26171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x689:0x0].0x0 since=3190s v=(0 0) 00010000:00010000:1.0:1784188947.878404:0:26171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x689:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784188947.878408:0:26171:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000d329514/0xcc1762b626f8a31b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x689:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784188947.878417:0:26171:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000d329514/0xcc1762b626f8a31b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x689:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784188947.878436:0:26171:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000d329514/0xcc1762b626f8a31b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x689:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784188947.878443:0:26171:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000d329514/0xcc1762b626f8a31b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x689:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784188947.878453:0:26171:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:1.0:1784188947.878492:0:26171:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x688:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784188947.878497:0:26171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c2b99c7d/0xcc1762b626f8a322 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x688:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784188947.878505:0:26171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x688:0x0].0x0 since=3190s v=(0 0) 00010000:00010000:1.0:1784188947.878508:0:26171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x688:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784188947.878512:0:26171:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c2b99c7d/0xcc1762b626f8a322 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x688:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784188947.878521:0:26171:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c2b99c7d/0xcc1762b626f8a322 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x688:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784188947.878530:0:26171:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c2b99c7d/0xcc1762b626f8a322 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x688:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784188947.878538:0:26171:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c2b99c7d/0xcc1762b626f8a322 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x688:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784188947.878559:0:26171:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00002000:00010000:1.0:1784188947.878596:0:26171:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x687:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784188947.878601:0:26171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002494b82d/0xcc1762b626f8a329 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x687:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784188947.878609:0:26171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x687:0x0].0x0 since=3190s v=(0 0) 00010000:00010000:1.0:1784188947.878612:0:26171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x687:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784188947.878616:0:26171:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002494b82d/0xcc1762b626f8a329 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x687:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784188947.878625:0:26171:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002494b82d/0xcc1762b626f8a329 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x687:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784188947.878634:0:26171:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002494b82d/0xcc1762b626f8a329 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x687:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784188947.878641:0:26171:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002494b82d/0xcc1762b626f8a329 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x687:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784188947.878649:0:26171:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00002000:00010000:1.0:1784188947.878684:0:26171:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x686:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784188947.878689:0:26171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000082ff1ebf/0xcc1762b626f8a330 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x686:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784188947.878748:0:6501:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:2.0:1784188947.878754:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d5e2eae0/0xcc1762b626f8a30d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x68b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784188947.878766:0:26171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x686:0x0].0x0 since=3190s v=(0 0) 00010000:00010000:2.0:1784188947.878769:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dbf47d92a00 already unused, calling callback (ffffffffc0b2e230) 00010000:00010000:2.0:1784188947.878774:0:6501:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d5e2eae0/0xcc1762b626f8a30d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x68b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784188947.878777:0:26171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x686:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784188947.878787:0:26171:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000082ff1ebf/0xcc1762b626f8a330 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x686:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784188947.878790:0:6501:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d5e2eae0/0xcc1762b626f8a30d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x68b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784188947.878805:0:26171:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000082ff1ebf/0xcc1762b626f8a330 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x686:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784188947.878813:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d5e2eae0/0xcc1762b626f8a30d lrc: 1/0,0 mode: --/PW res: [0x280000401:0x68b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784188947.878815:0:26171:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000082ff1ebf/0xcc1762b626f8a330 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x686:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784188947.878848:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d5e2eae0/0xcc1762b626f8a30d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x68b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784188947.878849:0:26171:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000082ff1ebf/0xcc1762b626f8a330 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x686:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784188947.878874:0:26171:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00010000:00010000:2.0:1784188947.878880:0:6501:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:2.0:1784188947.878885:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f17848b0/0xcc1762b626f8a314 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x68a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784188947.878893:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dbf47d93000 already unused, calling callback (ffffffffc0b2e230) 00010000:00010000:2.0:1784188947.878897:0:6501:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f17848b0/0xcc1762b626f8a314 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x68a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1784188947.878915:0:26171:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x685:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1784188947.878917:0:6501:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f17848b0/0xcc1762b626f8a314 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x68a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784188947.878923:0:26171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000018d61e3/0xcc1762b626f8a337 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x685:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784188947.878932:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f17848b0/0xcc1762b626f8a314 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x68a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784188947.878934:0:26171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x685:0x0].0x0 since=3190s v=(0 0) 00010000:00010000:1.0:1784188947.878942:0:26171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x685:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784188947.878949:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f17848b0/0xcc1762b626f8a314 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x68a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784188947.878951:0:26171:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000018d61e3/0xcc1762b626f8a337 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x685:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784188947.878973:0:26171:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000018d61e3/0xcc1762b626f8a337 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x685:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784188947.878975:0:6501:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1784188947.878981:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000d329514/0xcc1762b626f8a31b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x689:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784188947.878986:0:26171:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000018d61e3/0xcc1762b626f8a337 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x685:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784188947.878990:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dbf47d93200 already unused, calling callback (ffffffffc0b2e230) 00010000:00010000:2.0:1784188947.878996:0:6501:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000d329514/0xcc1762b626f8a31b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x689:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784188947.879011:0:26171:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000018d61e3/0xcc1762b626f8a337 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x685:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784188947.879014:0:6501:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000d329514/0xcc1762b626f8a31b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x689:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784188947.879032:0:26171:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00010000:00010000:2.0:1784188947.879035:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000d329514/0xcc1762b626f8a31b lrc: 1/0,0 mode: --/PW res: [0x280000401:0x689:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784188947.879044:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000d329514/0xcc1762b626f8a31b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x689:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784188947.879071:0:6501:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1784188947.879075:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c2b99c7d/0xcc1762b626f8a322 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x688:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1784188947.879077:0:26171:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x684:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784188947.879087:0:26171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000011321ff9/0xcc1762b626f8a33e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x684:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784188947.879088:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dbf47d93600 already unused, calling callback (ffffffffc0b2e230) 00010000:00010000:2.0:1784188947.879093:0:6501:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c2b99c7d/0xcc1762b626f8a322 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x688:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784188947.879103:0:26171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x684:0x0].0x0 since=3190s v=(0 0) 00010000:00010000:2.0:1784188947.879107:0:6501:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c2b99c7d/0xcc1762b626f8a322 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x688:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784188947.879108:0:26171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x684:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784188947.879115:0:26171:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000011321ff9/0xcc1762b626f8a33e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x684:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784188947.879124:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c2b99c7d/0xcc1762b626f8a322 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x688:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784188947.879128:0:26171:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000011321ff9/0xcc1762b626f8a33e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x684:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784188947.879140:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c2b99c7d/0xcc1762b626f8a322 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x688:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784188947.879146:0:26171:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000011321ff9/0xcc1762b626f8a33e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x684:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784188947.879156:0:6501:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1784188947.879157:0:26171:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000011321ff9/0xcc1762b626f8a33e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x684:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784188947.879163:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002494b82d/0xcc1762b626f8a329 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x687:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784188947.879173:0:26171:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:2.0:1784188947.879174:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dbf47d92000 already unused, calling callback (ffffffffc0b2e230) 00010000:00010000:2.0:1784188947.879179:0:6501:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002494b82d/0xcc1762b626f8a329 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x687:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784188947.879201:0:6501:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002494b82d/0xcc1762b626f8a329 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x687:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1784188947.879213:0:26171:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x683:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1784188947.879214:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002494b82d/0xcc1762b626f8a329 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x687:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784188947.879224:0:26171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008f2946f7/0xcc1762b626f8a345 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x683:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784188947.879227:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002494b82d/0xcc1762b626f8a329 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x687:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784188947.879242:0:6501:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1784188947.879242:0:26171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x683:0x0].0x0 since=3190s v=(0 0) 00010000:00010000:2.0:1784188947.879248:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000082ff1ebf/0xcc1762b626f8a330 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x686:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784188947.879248:0:26171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x683:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784188947.879259:0:26171:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008f2946f7/0xcc1762b626f8a345 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x683:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784188947.879261:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dbf47d93400 already unused, calling callback (ffffffffc0b2e230) 00010000:00010000:2.0:1784188947.879266:0:6501:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000082ff1ebf/0xcc1762b626f8a330 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x686:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784188947.879277:0:26171:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008f2946f7/0xcc1762b626f8a345 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x683:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784188947.879279:0:6501:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000082ff1ebf/0xcc1762b626f8a330 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x686:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784188947.879299:0:26171:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008f2946f7/0xcc1762b626f8a345 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x683:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784188947.879303:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000082ff1ebf/0xcc1762b626f8a330 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x686:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784188947.879315:0:26171:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008f2946f7/0xcc1762b626f8a345 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x683:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784188947.879343:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000082ff1ebf/0xcc1762b626f8a330 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x686:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784188947.879348:0:26171:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:2.0:1784188947.879372:0:6501:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1784188947.879377:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000018d61e3/0xcc1762b626f8a337 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x685:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784188947.879384:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dbf47d92600 already unused, calling callback (ffffffffc0b2e230) 00010000:00010000:2.0:1784188947.879387:0:6501:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000018d61e3/0xcc1762b626f8a337 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x685:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1784188947.879391:0:26171:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x682:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1784188947.879396:0:6501:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000018d61e3/0xcc1762b626f8a337 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x685:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784188947.879398:0:26171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d9badbf5/0xcc1762b626f8a34c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x682:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784188947.879418:0:26171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x682:0x0].0x0 since=3190s v=(0 0) 00010000:00010000:1.0:1784188947.879421:0:26171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x682:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784188947.879422:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000018d61e3/0xcc1762b626f8a337 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x685:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784188947.879427:0:26171:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d9badbf5/0xcc1762b626f8a34c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x682:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784188947.879435:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000018d61e3/0xcc1762b626f8a337 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x685:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784188947.879443:0:26171:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d9badbf5/0xcc1762b626f8a34c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x682:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784188947.879453:0:6501:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1784188947.879459:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000011321ff9/0xcc1762b626f8a33e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x684:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784188947.879473:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc042d67e00 already unused, calling callback (ffffffffc0b2e230) 00010000:00010000:1.0:1784188947.879473:0:26171:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d9badbf5/0xcc1762b626f8a34c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x682:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784188947.879479:0:6501:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000011321ff9/0xcc1762b626f8a33e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x684:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784188947.879490:0:26171:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d9badbf5/0xcc1762b626f8a34c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x682:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784188947.879501:0:26171:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1784188947.879512:0:6501:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000011321ff9/0xcc1762b626f8a33e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x684:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784188947.879524:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000011321ff9/0xcc1762b626f8a33e lrc: 1/0,0 mode: --/PW res: [0x280000401:0x684:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784188947.879531:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000011321ff9/0xcc1762b626f8a33e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x684:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784188947.879545:0:6501:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1784188947.879549:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008f2946f7/0xcc1762b626f8a345 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x683:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784188947.879555:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc042d66400 already unused, calling callback (ffffffffc0b2e230) 00010000:00010000:2.0:1784188947.879559:0:6501:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008f2946f7/0xcc1762b626f8a345 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x683:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784188947.879568:0:6501:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008f2946f7/0xcc1762b626f8a345 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x683:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784188947.879579:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008f2946f7/0xcc1762b626f8a345 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x683:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784188947.879587:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008f2946f7/0xcc1762b626f8a345 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x683:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784188947.879614:0:6501:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784188947.879618:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d9badbf5/0xcc1762b626f8a34c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x682:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784188947.879626:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc042d66200 already unused, calling callback (ffffffffc0b2e230) 00010000:00010000:2.0:1784188947.879629:0:6501:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d9badbf5/0xcc1762b626f8a34c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x682:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784188947.879638:0:6501:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d9badbf5/0xcc1762b626f8a34c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x682:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784188947.879651:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d9badbf5/0xcc1762b626f8a34c lrc: 1/0,0 mode: --/PW res: [0x280000401:0x682:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784188947.879658:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d9badbf5/0xcc1762b626f8a34c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x682:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784188947.879672:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784188947.879674:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784188947.879677:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1784188947.879747:0:26162:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x69b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1784188947.879753:0:26162:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000566e7bea/0xcc1762b626f8a353 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x69b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784188947.879761:0:26162:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x69b:0x0].0x0 since=3190s v=(0 0) 00010000:00010000:2.0:1784188947.879771:0:26162:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x69b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784188947.879776:0:26162:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000566e7bea/0xcc1762b626f8a353 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x69b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784188947.879789:0:26162:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000566e7bea/0xcc1762b626f8a353 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x69b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784188947.879799:0:26162:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000566e7bea/0xcc1762b626f8a353 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x69b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784188947.879808:0:26162:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000566e7bea/0xcc1762b626f8a353 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x69b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784188947.879844:0:26162:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1784188947.879854:0:6501:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784188947.879858:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000566e7bea/0xcc1762b626f8a353 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x69b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784188947.879868:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc080f04e00 already unused, calling callback (ffffffffc0b2e230) 00010000:00010000:2.0:1784188947.879872:0:6501:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000566e7bea/0xcc1762b626f8a353 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x69b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784188947.879881:0:6501:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000566e7bea/0xcc1762b626f8a353 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x69b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784188947.879893:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000566e7bea/0xcc1762b626f8a353 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x69b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784188947.879915:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000566e7bea/0xcc1762b626f8a353 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x69b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784188947.879933:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784188947.879936:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784188947.879939:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1784188947.879996:0:26162:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x69a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1784188947.880004:0:26162:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000043a4eaa4/0xcc1762b626f8a35a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x69a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784188947.880014:0:26162:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x69a:0x0].0x0 since=3190s v=(0 0) 00010000:00010000:2.0:1784188947.880019:0:26162:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x69a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784188947.880024:0:26162:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000043a4eaa4/0xcc1762b626f8a35a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x69a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784188947.880036:0:26162:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000043a4eaa4/0xcc1762b626f8a35a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x69a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784188947.880045:0:26162:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000043a4eaa4/0xcc1762b626f8a35a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x69a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784188947.880054:0:26162:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000043a4eaa4/0xcc1762b626f8a35a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x69a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784188947.880070:0:26162:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1784188947.880085:0:6501:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784188947.880090:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000043a4eaa4/0xcc1762b626f8a35a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x69a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784188947.880098:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc0755a4000 already unused, calling callback (ffffffffc0b2e230) 00010000:00010000:2.0:1784188947.880103:0:6501:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000043a4eaa4/0xcc1762b626f8a35a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x69a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784188947.880112:0:6501:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000043a4eaa4/0xcc1762b626f8a35a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x69a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784188947.880126:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000043a4eaa4/0xcc1762b626f8a35a lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x69a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784188947.880134:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000043a4eaa4/0xcc1762b626f8a35a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x69a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784188947.880150:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784188947.880153:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784188947.880155:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1784188947.880209:0:26162:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x699:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1784188947.880215:0:26162:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004cf1f60e/0xcc1762b626f8a361 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x699:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784188947.880224:0:26162:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x699:0x0].0x0 since=3190s v=(0 0) 00010000:00010000:2.0:1784188947.880227:0:26162:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x699:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784188947.880232:0:26162:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004cf1f60e/0xcc1762b626f8a361 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x699:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784188947.880254:0:26162:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004cf1f60e/0xcc1762b626f8a361 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x699:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784188947.880265:0:26162:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004cf1f60e/0xcc1762b626f8a361 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x699:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784188947.880274:0:26162:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004cf1f60e/0xcc1762b626f8a361 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x699:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784188947.880289:0:26162:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1784188947.880298:0:6501:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784188947.880302:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004cf1f60e/0xcc1762b626f8a361 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x699:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784188947.880310:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc0755a4400 already unused, calling callback (ffffffffc0b2e230) 00010000:00010000:2.0:1784188947.880315:0:6501:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004cf1f60e/0xcc1762b626f8a361 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x699:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784188947.880347:0:6501:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004cf1f60e/0xcc1762b626f8a361 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x699:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784188947.880360:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004cf1f60e/0xcc1762b626f8a361 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x699:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784188947.880369:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004cf1f60e/0xcc1762b626f8a361 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x699:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784188947.880391:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784188947.880394:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784188947.880396:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1784188947.880447:0:26162:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x698:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1784188947.880454:0:26162:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004e27f8fd/0xcc1762b626f8a368 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x698:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784188947.880463:0:26162:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x698:0x0].0x0 since=3190s v=(0 0) 00010000:00010000:2.0:1784188947.880467:0:26162:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x698:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784188947.880472:0:26162:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004e27f8fd/0xcc1762b626f8a368 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x698:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784188947.880484:0:26162:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004e27f8fd/0xcc1762b626f8a368 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x698:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784188947.880493:0:26162:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004e27f8fd/0xcc1762b626f8a368 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x698:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784188947.880501:0:26162:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004e27f8fd/0xcc1762b626f8a368 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x698:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784188947.880517:0:26162:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1784188947.880524:0:6501:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784188947.880529:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004e27f8fd/0xcc1762b626f8a368 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x698:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784188947.880549:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc0755a5e00 already unused, calling callback (ffffffffc0b2e230) 00010000:00010000:2.0:1784188947.880553:0:6501:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004e27f8fd/0xcc1762b626f8a368 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x698:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784188947.880563:0:6501:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004e27f8fd/0xcc1762b626f8a368 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x698:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784188947.880576:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004e27f8fd/0xcc1762b626f8a368 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x698:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784188947.880585:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004e27f8fd/0xcc1762b626f8a368 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x698:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784188947.880601:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784188947.880604:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784188947.880606:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1784188947.880663:0:26162:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x697:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1784188947.880669:0:26162:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000090923e4f/0xcc1762b626f8a36f lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x697:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784188947.880679:0:26162:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x697:0x0].0x0 since=3190s v=(0 0) 00010000:00010000:2.0:1784188947.880683:0:26162:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x697:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784188947.880687:0:26162:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000090923e4f/0xcc1762b626f8a36f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x697:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784188947.880696:0:26162:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000090923e4f/0xcc1762b626f8a36f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x697:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784188947.880709:0:26162:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000090923e4f/0xcc1762b626f8a36f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x697:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784188947.880715:0:26162:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000090923e4f/0xcc1762b626f8a36f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x697:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784188947.880725:0:26162:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1784188947.880731:0:6501:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784188947.880734:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000090923e4f/0xcc1762b626f8a36f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x697:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784188947.880740:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc0755a5c00 already unused, calling callback (ffffffffc0b2e230) 00010000:00010000:2.0:1784188947.880743:0:6501:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000090923e4f/0xcc1762b626f8a36f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x697:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784188947.880749:0:6501:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000090923e4f/0xcc1762b626f8a36f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x697:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784188947.880758:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000090923e4f/0xcc1762b626f8a36f lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x697:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784188947.880765:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000090923e4f/0xcc1762b626f8a36f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x697:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784188947.880778:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784188947.880784:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784188947.880786:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784188947.881175:0:7454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784188947.881185:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784188947.884208:0:26173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:1.0:1784188947.887341:0:26171:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x280000401:1116 00002000:00010000:2.0:1784188947.887366:0:26162:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x696:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1784188947.887378:0:26162:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000090219bd6/0xcc1762b626f8a376 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x696:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784188947.887398:0:26162:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x696:0x0].0x0 since=3190s v=(0 0) 00010000:00010000:2.0:1784188947.887404:0:26162:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x696:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784188947.887411:0:26162:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000090219bd6/0xcc1762b626f8a376 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x696:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784188947.887428:0:26162:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000090219bd6/0xcc1762b626f8a376 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x696:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784188947.887439:0:26162:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000090219bd6/0xcc1762b626f8a376 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x696:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784188947.887447:0:26162:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000090219bd6/0xcc1762b626f8a376 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x696:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784188947.887467:0:26171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc075aa2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+5:83240:x1870854457998848:12345-0@lo:5:osp-pre-0-0.0 Request processed in 35223us (35433us total) trans 0 rc 0/0 00010000:00010000:2.0:1784188947.887471:0:26162:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1784188947.887481:0:26171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4908 00010000:00010000:2.0:1784188947.887492:0:6501:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784188947.887499:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000090219bd6/0xcc1762b626f8a376 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x696:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784188947.887508:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc0755a5800 already unused, calling callback (ffffffffc0b2e230) 00010000:00010000:2.0:1784188947.887513:0:6501:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000090219bd6/0xcc1762b626f8a376 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x696:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784188947.887536:0:6501:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000090219bd6/0xcc1762b626f8a376 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x696:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784188947.887552:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000090219bd6/0xcc1762b626f8a376 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x696:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784188947.887560:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000090219bd6/0xcc1762b626f8a376 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x696:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784188947.887581:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784188947.887583:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784188947.887584:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784188947.889421:0:83240:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc075aa2300 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:83240:1870854457998848:0@lo:5:osp-pre-0-0.0 00000004:00080000:3.0:1784188947.889441:0:83240:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x280000401:0x6a1:0x0] from OST, last_created [0x280000401:0x6a1:0x0]last_used is [0x280000401:0x45c:0x0] 00000100:00100000:3.0:1784188947.889516:0:83240:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc07b5b3800 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:83240:1870854457999232:0@lo:5:osp-pre-0-0.0 00000100:00100000:3.0:1784188947.889573:0:83240:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784188947.889601:0:83240:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dc071b6ab40 going to sleep for 20 seconds 00000100:00100000:3.0:1784188947.889620:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc07ab98380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1870854457999104:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1784188947.889645:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784188947.889698:0:26160:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854457999232 00000100:00100000:3.0:1784188947.889704:0:26160:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854457999232 00000100:00100000:3.0:1784188947.889750:0:26160:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4910 00000100:00100000:3.0:1784188947.889767:0:26160:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc07b5b3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+5:83240:x1870854457999232:12345-0@lo:5:osp-pre-0-0.0 00000020:02000000:3.0:1784188947.889775:0:26160:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00002000:00080000:3.0:1784188947.889829:0:26160:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000401 at 1698 00000100:00100000:3.0:1784188947.891239:0:26160:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc07b5b3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+6:83240:x1870854457999232:12345-0@lo:5:osp-pre-0-0.0 Request processed in 1475us (1661us total) trans 4294968947 rc 0/0 00000100:00100000:3.0:1784188947.891249:0:26160:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4910 00000100:00100000:3.0:1784188947.891284:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854457999104 00000100:00100000:3.0:1784188947.891290:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854457999104 00000100:00100000:0.0:1784188947.891292:0:83240:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc07b5b3800 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:83240:1870854457999232:0@lo:5:osp-pre-0-0.0 00000004:00080000:0.0:1784188947.891306:0:83240:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x280000401:0x6a1:0x0]-[0x280000401:0x6c1:0x0] 00000100:00100000:3.0:1784188947.891354:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1800 00000100:00100000:3.0:1784188947.891363:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc07b5b0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3641:x1870854457999104:12345-0@lo:13:osp-pre-0-0.0 00000020:02000000:3.0:1784188947.891368:0:8432:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00002000:00000024:3.0:1784188947.891385:0:8432:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 214592 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1784188947.891429:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc07b5b0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3641:x1870854457999104:12345-0@lo:13:osp-pre-0-0.0 Request processed in 68us (1783us total) trans 0 rc 0/0 00000100:00100000:3.0:1784188947.891435:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1800 00000100:00100000:0.0:1784188947.891638:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc07ab98380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1870854457999104:0@lo:13:osp-pre-0-0.0 00002000:00010000:2.0:1784188947.894273:0:26162:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x695:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1784188947.894288:0:26162:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000b6eacba/0xcc1762b626f8a37d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x695:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784188947.894306:0:26162:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x695:0x0].0x0 since=3190s v=(0 0) 00010000:00010000:2.0:1784188947.894310:0:26162:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x695:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784188947.894331:0:26162:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000b6eacba/0xcc1762b626f8a37d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x695:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784188947.894347:0:26162:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000b6eacba/0xcc1762b626f8a37d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x695:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784188947.894357:0:26162:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000b6eacba/0xcc1762b626f8a37d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x695:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784188947.894382:0:26162:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000b6eacba/0xcc1762b626f8a37d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x695:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784188947.894408:0:26162:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1784188947.894515:0:26162:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x694:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1784188947.894521:0:26162:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000062d13dad/0xcc1762b626f8a384 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x694:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784188947.894529:0:26162:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x694:0x0].0x0 since=3190s v=(0 0) 00010000:00010000:2.0:1784188947.894532:0:26162:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x694:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784188947.894535:0:26162:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000062d13dad/0xcc1762b626f8a384 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x694:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784188947.894544:0:26162:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000062d13dad/0xcc1762b626f8a384 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x694:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784188947.894552:0:26162:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000062d13dad/0xcc1762b626f8a384 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x694:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784188947.894558:0:26162:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000062d13dad/0xcc1762b626f8a384 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x694:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784188947.894579:0:26162:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:2.0:1784188947.894613:0:26162:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x693:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1784188947.894618:0:26162:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e88c95bf/0xcc1762b626f8a38b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x693:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784188947.894629:0:26162:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x693:0x0].0x0 since=3190s v=(0 0) 00010000:00010000:2.0:1784188947.894632:0:26162:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x693:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784188947.894636:0:26162:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e88c95bf/0xcc1762b626f8a38b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x693:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784188947.894646:0:26162:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e88c95bf/0xcc1762b626f8a38b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x693:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784188947.894647:0:6502:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1784188947.894660:0:26162:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e88c95bf/0xcc1762b626f8a38b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x693:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784188947.894661:0:6502:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000b6eacba/0xcc1762b626f8a37d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x695:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784188947.894677:0:6502:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc0755a4e00 already unused, calling callback (ffffffffc0b2e230) 00010000:00010000:1.0:1784188947.894682:0:6502:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000b6eacba/0xcc1762b626f8a37d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x695:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784188947.894688:0:26162:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e88c95bf/0xcc1762b626f8a38b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x693:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784188947.894707:0:26162:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1784188947.894707:0:6502:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000b6eacba/0xcc1762b626f8a37d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x695:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784188947.894730:0:6502:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000b6eacba/0xcc1762b626f8a37d lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x695:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1784188947.894749:0:26162:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x692:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784188947.894754:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000b6eacba/0xcc1762b626f8a37d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x695:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784188947.894756:0:26162:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000283735d0/0xcc1762b626f8a392 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x692:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784188947.894787:0:6502:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1784188947.894792:0:6502:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000062d13dad/0xcc1762b626f8a384 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x694:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784188947.894799:0:6502:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc0755a5000 already unused, calling callback (ffffffffc0b2e230) 00010000:00010000:1.0:1784188947.894803:0:6502:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000062d13dad/0xcc1762b626f8a384 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x694:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784188947.894810:0:6502:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000062d13dad/0xcc1762b626f8a384 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x694:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784188947.894834:0:6502:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000062d13dad/0xcc1762b626f8a384 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x694:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784188947.894842:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000062d13dad/0xcc1762b626f8a384 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x694:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784188947.894856:0:6502:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784188947.894859:0:6502:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e88c95bf/0xcc1762b626f8a38b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x693:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784188947.894866:0:6502:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc0755a5600 already unused, calling callback (ffffffffc0b2e230) 00010000:00010000:1.0:1784188947.894875:0:6502:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e88c95bf/0xcc1762b626f8a38b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x693:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784188947.894884:0:6502:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e88c95bf/0xcc1762b626f8a38b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x693:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784188947.894895:0:6502:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e88c95bf/0xcc1762b626f8a38b lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x693:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784188947.894902:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e88c95bf/0xcc1762b626f8a38b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x693:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784188947.894914:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784188947.894916:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784188947.894918:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784188947.894934:0:26162:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x692:0x0].0x0 since=3190s v=(0 0) 00010000:00010000:2.0:1784188947.894940:0:26162:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x692:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784188947.894944:0:26162:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000283735d0/0xcc1762b626f8a392 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x692:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784188947.894953:0:26162:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000283735d0/0xcc1762b626f8a392 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x692:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784188947.894973:0:26162:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000283735d0/0xcc1762b626f8a392 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x692:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784188947.894980:0:26162:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000283735d0/0xcc1762b626f8a392 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x692:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784188947.895003:0:26162:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1784188947.895051:0:26162:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x691:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1784188947.895056:0:26162:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000067521a5b/0xcc1762b626f8a399 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x691:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784188947.895065:0:26162:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x691:0x0].0x0 since=3190s v=(0 0) 00010000:00010000:1.0:1784188947.895067:0:6501:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784188947.895069:0:26162:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x691:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784188947.895075:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000283735d0/0xcc1762b626f8a392 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x692:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784188947.895076:0:26162:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000067521a5b/0xcc1762b626f8a399 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x691:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784188947.895100:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc0755a4200 already unused, calling callback (ffffffffc0b2e230) 00010000:00010000:2.0:1784188947.895102:0:26162:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000067521a5b/0xcc1762b626f8a399 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x691:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784188947.895105:0:6501:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000283735d0/0xcc1762b626f8a392 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x692:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784188947.895119:0:26162:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000067521a5b/0xcc1762b626f8a399 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x691:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784188947.895122:0:6501:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000283735d0/0xcc1762b626f8a392 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x692:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784188947.895137:0:26162:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000067521a5b/0xcc1762b626f8a399 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x691:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784188947.895153:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000283735d0/0xcc1762b626f8a392 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x692:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784188947.895166:0:26162:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1784188947.895171:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000283735d0/0xcc1762b626f8a392 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x692:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784188947.895177:0:6502:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784188947.895183:0:6502:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000067521a5b/0xcc1762b626f8a399 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x691:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784188947.895187:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784188947.895191:0:6502:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc0755a5a00 already unused, calling callback (ffffffffc0b2e230) 00010000:00010000:1.0:1784188947.895192:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784188947.895195:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784188947.895197:0:6502:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000067521a5b/0xcc1762b626f8a399 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x691:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784188947.895206:0:6502:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000067521a5b/0xcc1762b626f8a399 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x691:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784188947.895217:0:6502:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000067521a5b/0xcc1762b626f8a399 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x691:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784188947.895224:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000067521a5b/0xcc1762b626f8a399 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x691:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784188947.895240:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784188947.895242:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784188947.895244:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1784188947.895287:0:26162:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x690:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1784188947.895292:0:26162:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000cc621f7/0xcc1762b626f8a3a0 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x690:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784188947.895300:0:26162:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x690:0x0].0x0 since=3190s v=(0 0) 00010000:00010000:2.0:1784188947.895308:0:26162:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x690:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784188947.895313:0:26162:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000cc621f7/0xcc1762b626f8a3a0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x690:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784188947.895933:0:26162:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000cc621f7/0xcc1762b626f8a3a0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x690:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784188947.895943:0:26162:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000cc621f7/0xcc1762b626f8a3a0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x690:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784188947.895950:0:26162:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000cc621f7/0xcc1762b626f8a3a0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x690:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784188947.895968:0:26162:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1784188947.895978:0:6501:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784188947.895983:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000cc621f7/0xcc1762b626f8a3a0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x690:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784188947.895990:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc0755a4a00 already unused, calling callback (ffffffffc0b2e230) 00010000:00010000:2.0:1784188947.895993:0:6501:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000cc621f7/0xcc1762b626f8a3a0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x690:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784188947.896001:0:6501:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000cc621f7/0xcc1762b626f8a3a0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x690:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784188947.896012:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000cc621f7/0xcc1762b626f8a3a0 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x690:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784188947.896032:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000cc621f7/0xcc1762b626f8a3a0 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x690:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784188947.896049:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784188947.896051:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784188947.896053:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1784188947.896117:0:26162:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x68f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1784188947.896122:0:26162:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000097385c8a/0xcc1762b626f8a3a7 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x68f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784188947.896131:0:26162:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x68f:0x0].0x0 since=3190s v=(0 0) 00010000:00010000:2.0:1784188947.896135:0:26162:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x68f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784188947.896140:0:26162:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000097385c8a/0xcc1762b626f8a3a7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x68f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784188947.896150:0:26162:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000097385c8a/0xcc1762b626f8a3a7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x68f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784188947.896158:0:26162:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000097385c8a/0xcc1762b626f8a3a7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x68f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784188947.896166:0:26162:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000097385c8a/0xcc1762b626f8a3a7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x68f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784188947.896181:0:26162:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1784188947.896199:0:6502:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784188947.896203:0:6502:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000097385c8a/0xcc1762b626f8a3a7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x68f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784188947.896211:0:6502:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc0755a5400 already unused, calling callback (ffffffffc0b2e230) 00010000:00010000:2.0:1784188947.896214:0:6502:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000097385c8a/0xcc1762b626f8a3a7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x68f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784188947.896222:0:6502:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000097385c8a/0xcc1762b626f8a3a7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x68f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784188947.896233:0:6502:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000097385c8a/0xcc1762b626f8a3a7 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x68f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784188947.896240:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000097385c8a/0xcc1762b626f8a3a7 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x68f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784188947.896253:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784188947.896255:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784188947.896256:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1784188947.896298:0:26162:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x68e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1784188947.896303:0:26162:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005a83b75c/0xcc1762b626f8a3ae lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x68e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784188947.896310:0:26162:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x68e:0x0].0x0 since=3190s v=(0 0) 00010000:00010000:2.0:1784188947.896313:0:26162:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x68e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784188947.896356:0:26162:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005a83b75c/0xcc1762b626f8a3ae lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x68e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784188947.896379:0:26162:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005a83b75c/0xcc1762b626f8a3ae lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x68e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784188947.896388:0:26162:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005a83b75c/0xcc1762b626f8a3ae lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x68e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784188947.896395:0:26162:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005a83b75c/0xcc1762b626f8a3ae lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x68e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784188947.896422:0:26162:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1784188947.896434:0:6501:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784188947.896441:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005a83b75c/0xcc1762b626f8a3ae lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x68e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784188947.896450:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc0755a5200 already unused, calling callback (ffffffffc0b2e230) 00010000:00010000:1.0:1784188947.896454:0:6501:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005a83b75c/0xcc1762b626f8a3ae lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x68e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784188947.896463:0:6501:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005a83b75c/0xcc1762b626f8a3ae lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x68e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1784188947.896465:0:26162:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x68d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1784188947.896475:0:26162:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007391f9a3/0xcc1762b626f8a3b5 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x68d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784188947.896481:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005a83b75c/0xcc1762b626f8a3ae lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x68e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784188947.896486:0:26162:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x68d:0x0].0x0 since=3190s v=(0 0) 00010000:00010000:2.0:1784188947.896494:0:26162:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x68d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784188947.896494:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005a83b75c/0xcc1762b626f8a3ae lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x68e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784188947.896503:0:26162:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007391f9a3/0xcc1762b626f8a3b5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x68d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784188947.896516:0:26162:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007391f9a3/0xcc1762b626f8a3b5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x68d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784188947.896517:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784188947.896521:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784188947.896527:0:26162:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007391f9a3/0xcc1762b626f8a3b5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x68d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784188947.896531:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784188947.896550:0:26162:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007391f9a3/0xcc1762b626f8a3b5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x68d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784188947.896572:0:26162:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1784188947.896610:0:26162:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x68c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1784188947.896616:0:26162:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c9d589c0/0xcc1762b626f8a3bc lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x68c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784188947.896623:0:26162:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x68c:0x0].0x0 since=3190s v=(0 0) 00010000:00010000:2.0:1784188947.896626:0:26162:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x68c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784188947.896631:0:26162:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c9d589c0/0xcc1762b626f8a3bc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x68c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784188947.896632:0:6502:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784188947.896640:0:6502:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007391f9a3/0xcc1762b626f8a3b5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x68d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784188947.896645:0:26162:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c9d589c0/0xcc1762b626f8a3bc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x68c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784188947.896653:0:6502:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc0755a4800 already unused, calling callback (ffffffffc0b2e230) 00010000:00010000:1.0:1784188947.896659:0:6502:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007391f9a3/0xcc1762b626f8a3b5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x68d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784188947.896661:0:26162:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c9d589c0/0xcc1762b626f8a3bc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x68c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784188947.896676:0:6502:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007391f9a3/0xcc1762b626f8a3b5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x68d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784188947.896691:0:26162:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c9d589c0/0xcc1762b626f8a3bc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x68c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784188947.896707:0:26162:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1784188947.896713:0:6501:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784188947.896717:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c9d589c0/0xcc1762b626f8a3bc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x68c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784188947.896730:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc0755a4c00 already unused, calling callback (ffffffffc0b2e230) 00010000:00010000:2.0:1784188947.896734:0:6501:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c9d589c0/0xcc1762b626f8a3bc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x68c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784188947.896741:0:6501:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c9d589c0/0xcc1762b626f8a3bc lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x68c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784188947.896752:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c9d589c0/0xcc1762b626f8a3bc lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x68c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784188947.896759:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c9d589c0/0xcc1762b626f8a3bc lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x68c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784188947.896771:0:6502:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007391f9a3/0xcc1762b626f8a3b5 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x68d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784188947.896779:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007391f9a3/0xcc1762b626f8a3b5 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x68d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784188947.896793:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784188947.896795:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784188947.896796:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1784188947.898279:0:26162:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x68b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784188947.898289:0:26162:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004acab531/0xcc1762b626f8a3c3 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x68b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784188947.898339:0:26162:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x68b:0x0].0x0 since=3190s v=(0 0) 00010000:00010000:0.0:1784188947.898344:0:26162:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x68b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784188947.898349:0:26162:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004acab531/0xcc1762b626f8a3c3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x68b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784188947.898362:0:26162:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004acab531/0xcc1762b626f8a3c3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x68b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784188947.898372:0:26162:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004acab531/0xcc1762b626f8a3c3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x68b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784188947.898381:0:26162:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004acab531/0xcc1762b626f8a3c3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x68b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784188947.898401:0:26162:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1784188947.898444:0:26162:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x68a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784188947.898449:0:26162:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f2600df0/0xcc1762b626f8a3ca lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x68a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784188947.898457:0:26162:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x68a:0x0].0x0 since=3190s v=(0 0) 00010000:00010000:0.0:1784188947.898460:0:26162:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x68a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784188947.898463:0:26162:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f2600df0/0xcc1762b626f8a3ca lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x68a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784188947.898471:0:26162:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f2600df0/0xcc1762b626f8a3ca lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x68a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784188947.898490:0:26162:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f2600df0/0xcc1762b626f8a3ca lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x68a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784188947.898497:0:26162:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f2600df0/0xcc1762b626f8a3ca lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x68a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784188947.898505:0:26162:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:0.0:1784188947.898547:0:26162:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x689:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784188947.898553:0:26162:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000012da23a3/0xcc1762b626f8a3d1 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x689:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784188947.898561:0:26162:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x689:0x0].0x0 since=3190s v=(0 0) 00010000:00010000:0.0:1784188947.898564:0:26162:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x689:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784188947.898568:0:26162:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000012da23a3/0xcc1762b626f8a3d1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x689:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784188947.898576:0:26162:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000012da23a3/0xcc1762b626f8a3d1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x689:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784188947.898583:0:26162:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000012da23a3/0xcc1762b626f8a3d1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x689:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784188947.898590:0:26162:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000012da23a3/0xcc1762b626f8a3d1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x689:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784188947.898608:0:26162:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:1.0:1784188947.898634:0:6502:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1784188947.898643:0:6502:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004acab531/0xcc1762b626f8a3c3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x68b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1784188947.898647:0:26162:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x688:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784188947.898657:0:26162:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005168a0f1/0xcc1762b626f8a3d8 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x688:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784188947.898658:0:6502:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc070146200 already unused, calling callback (ffffffffc0b2e230) 00010000:00010000:1.0:1784188947.898664:0:6502:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004acab531/0xcc1762b626f8a3c3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x68b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784188947.898671:0:26162:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x688:0x0].0x0 since=3190s v=(0 0) 00010000:00010000:0.0:1784188947.898676:0:26162:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x688:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784188947.898680:0:26162:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005168a0f1/0xcc1762b626f8a3d8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x688:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784188947.898693:0:26162:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005168a0f1/0xcc1762b626f8a3d8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x688:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784188947.898705:0:6502:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004acab531/0xcc1762b626f8a3c3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x68b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784188947.898707:0:26162:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005168a0f1/0xcc1762b626f8a3d8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x688:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784188947.898727:0:26162:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005168a0f1/0xcc1762b626f8a3d8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x688:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784188947.898734:0:6502:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004acab531/0xcc1762b626f8a3c3 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x68b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784188947.898736:0:26162:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:1.0:1784188947.898748:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004acab531/0xcc1762b626f8a3c3 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x68b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784188947.898765:0:6502:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1784188947.898769:0:6502:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f2600df0/0xcc1762b626f8a3ca lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x68a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784188947.898775:0:6502:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc070147e00 already unused, calling callback (ffffffffc0b2e230) 00010000:00010000:1.0:1784188947.898778:0:6502:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f2600df0/0xcc1762b626f8a3ca lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x68a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784188947.898785:0:6502:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f2600df0/0xcc1762b626f8a3ca lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x68a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784188947.898794:0:6502:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f2600df0/0xcc1762b626f8a3ca lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x68a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784188947.898801:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f2600df0/0xcc1762b626f8a3ca lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x68a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784188947.898834:0:6502:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1784188947.898838:0:6502:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000012da23a3/0xcc1762b626f8a3d1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x689:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784188947.898844:0:6502:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc070147800 already unused, calling callback (ffffffffc0b2e230) 00010000:00010000:1.0:1784188947.898847:0:6502:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000012da23a3/0xcc1762b626f8a3d1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x689:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784188947.898854:0:6502:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000012da23a3/0xcc1762b626f8a3d1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x689:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784188947.898864:0:6502:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000012da23a3/0xcc1762b626f8a3d1 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x689:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784188947.898871:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000012da23a3/0xcc1762b626f8a3d1 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x689:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784188947.898884:0:6502:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784188947.898888:0:6502:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005168a0f1/0xcc1762b626f8a3d8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x688:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784188947.898892:0:26173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784188947.898895:0:6502:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc070146400 already unused, calling callback (ffffffffc0b2e230) 00010000:00010000:1.0:1784188947.898900:0:6502:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005168a0f1/0xcc1762b626f8a3d8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x688:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784188947.898902:0:7454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784188947.898922:0:6502:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005168a0f1/0xcc1762b626f8a3d8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x688:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784188947.898934:0:6502:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005168a0f1/0xcc1762b626f8a3d8 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x688:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784188947.898940:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005168a0f1/0xcc1762b626f8a3d8 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x688:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784188947.898953:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784188947.898955:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784188947.898957:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1784188947.898960:0:26162:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x687:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784188947.898967:0:26162:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006dde6b82/0xcc1762b626f8a3df lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x687:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784188947.898975:0:26162:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x687:0x0].0x0 since=3190s v=(0 0) 00010000:00010000:0.0:1784188947.898982:0:26162:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x687:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784188947.898986:0:26162:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006dde6b82/0xcc1762b626f8a3df lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x687:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784188947.898995:0:26162:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006dde6b82/0xcc1762b626f8a3df lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x687:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784188947.899004:0:26162:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006dde6b82/0xcc1762b626f8a3df lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x687:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784188947.899011:0:26162:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006dde6b82/0xcc1762b626f8a3df lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x687:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784188947.899253:0:26162:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1784188947.899295:0:26162:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x686:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784188947.899300:0:26162:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006c2923fb/0xcc1762b626f8a3e6 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x686:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784188947.899308:0:26162:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x686:0x0].0x0 since=3190s v=(0 0) 00010000:00010000:0.0:1784188947.899311:0:26162:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x686:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784188947.899315:0:26162:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006c2923fb/0xcc1762b626f8a3e6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x686:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784188947.899339:0:26162:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006c2923fb/0xcc1762b626f8a3e6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x686:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784188947.899346:0:26162:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006c2923fb/0xcc1762b626f8a3e6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x686:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784188947.899358:0:26162:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006c2923fb/0xcc1762b626f8a3e6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x686:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784188947.899550:0:26173:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1784188947.899557:0:26173:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006dde6b82/0xcc1762b626f8a3df lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x687:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784188947.899564:0:26173:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc070147200 already unused, calling callback (ffffffffc0b2e230) 00010000:00010000:3.0:1784188947.899568:0:26173:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006dde6b82/0xcc1762b626f8a3df lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x687:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784188947.899575:0:26173:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006dde6b82/0xcc1762b626f8a3df lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x687:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784188947.899587:0:26173:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006dde6b82/0xcc1762b626f8a3df lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x687:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784188947.899595:0:26173:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006dde6b82/0xcc1762b626f8a3df lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x687:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784188947.899609:0:26173:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784188947.899619:0:26173:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006c2923fb/0xcc1762b626f8a3e6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x686:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784188947.899626:0:26173:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc070147600 already unused, calling callback (ffffffffc0b2e230) 00010000:00010000:3.0:1784188947.899629:0:26173:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006c2923fb/0xcc1762b626f8a3e6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x686:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784188947.899636:0:26173:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006c2923fb/0xcc1762b626f8a3e6 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x686:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784188947.899647:0:26173:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006c2923fb/0xcc1762b626f8a3e6 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x686:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784188947.899654:0:26173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784188947.899656:0:26173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784188947.899658:0:26173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784188947.900198:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784188947.900199:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784188947.900202:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784188947.900480:0:26162:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1784188947.900496:0:26162:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006c2923fb/0xcc1762b626f8a3e6 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x686:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1784188947.900578:0:26162:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x685:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784188947.900583:0:26162:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000240d7435/0xcc1762b626f8a3ed lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x685:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784188947.900594:0:26162:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x685:0x0].0x0 since=3190s v=(0 0) 00010000:00010000:0.0:1784188947.900597:0:26162:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x685:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784188947.900602:0:26162:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000240d7435/0xcc1762b626f8a3ed lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x685:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784188947.900614:0:26162:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000240d7435/0xcc1762b626f8a3ed lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x685:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784188947.900623:0:26162:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000240d7435/0xcc1762b626f8a3ed lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x685:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784188947.900630:0:26162:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000240d7435/0xcc1762b626f8a3ed lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x685:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784188947.900666:0:26162:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1784188947.900716:0:26162:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x684:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784188947.900721:0:26162:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000eab8efbc/0xcc1762b626f8a3f4 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x684:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784188947.900729:0:26162:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x684:0x0].0x0 since=3190s v=(0 0) 00010000:00010000:0.0:1784188947.900732:0:26162:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x684:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784188947.900736:0:26162:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000eab8efbc/0xcc1762b626f8a3f4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x684:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784188947.900745:0:26162:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000eab8efbc/0xcc1762b626f8a3f4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x684:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784188947.900752:0:26162:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000eab8efbc/0xcc1762b626f8a3f4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x684:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784188947.900759:0:26162:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000eab8efbc/0xcc1762b626f8a3f4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x684:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784188947.900919:0:26162:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1784188947.900927:0:26173:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1784188947.900931:0:26173:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000240d7435/0xcc1762b626f8a3ed lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x685:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784188947.900939:0:26173:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc070147a00 already unused, calling callback (ffffffffc0b2e230) 00010000:00010000:0.0:1784188947.900948:0:26173:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000240d7435/0xcc1762b626f8a3ed lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x685:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784188947.900956:0:26173:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000240d7435/0xcc1762b626f8a3ed lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x685:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784188947.900968:0:26173:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000240d7435/0xcc1762b626f8a3ed lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x685:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784188947.900974:0:26173:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000240d7435/0xcc1762b626f8a3ed lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x685:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784188947.900988:0:26173:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784188947.900991:0:26173:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000eab8efbc/0xcc1762b626f8a3f4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x684:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784188947.900997:0:26173:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc070147000 already unused, calling callback (ffffffffc0b2e230) 00010000:00010000:0.0:1784188947.901001:0:26173:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000eab8efbc/0xcc1762b626f8a3f4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x684:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784188947.901008:0:26173:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000eab8efbc/0xcc1762b626f8a3f4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x684:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784188947.901016:0:26173:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000eab8efbc/0xcc1762b626f8a3f4 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x684:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784188947.901024:0:26173:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000eab8efbc/0xcc1762b626f8a3f4 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x684:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784188947.901042:0:26173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784188947.901044:0:26173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784188947.901046:0:26173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1784188947.901091:0:26162:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x683:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784188947.901096:0:26162:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000034a0fccf/0xcc1762b626f8a3fb lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x683:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784188947.901103:0:26162:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x683:0x0].0x0 since=3190s v=(0 0) 00010000:00010000:0.0:1784188947.901106:0:26162:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x683:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784188947.901110:0:26162:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000034a0fccf/0xcc1762b626f8a3fb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x683:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784188947.901119:0:26162:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000034a0fccf/0xcc1762b626f8a3fb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x683:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784188947.901126:0:26162:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000034a0fccf/0xcc1762b626f8a3fb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x683:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784188947.901133:0:26162:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000034a0fccf/0xcc1762b626f8a3fb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x683:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784188947.901145:0:26162:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00080000:0.0:1784188947.901171:0:26162:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x2c0000401:1666 00000100:00100000:0.0:1784188947.901268:0:26162:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc050543800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+5:83242:x1870854457998976:12345-0@lo:5:osp-pre-1-0.0 Request processed in 44794us (45005us total) trans 0 rc 0/0 00000100:00100000:0.0:1784188947.901280:0:26162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4909 00000100:00100000:0.0:1784188947.901367:0:83242:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc06bbf0700 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:83242:1870854457998976:0@lo:5:osp-pre-1-0.0 00000004:00080000:0.0:1784188947.901383:0:83242:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x2c0000401:0x6a1:0x0] from OST, last_created [0x2c0000401:0x6a1:0x0]last_used is [0x2c0000401:0x682:0x0] 00000100:00100000:0.0:1784188947.901448:0:83242:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc07ab98380 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:83242:1870854457999488:0@lo:5:osp-pre-1-0.0 00000100:00100000:0.0:1784188947.901483:0:83242:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784188947.901505:0:83242:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dc07638f480 going to sleep for 20 seconds 00000100:00100000:0.0:1784188947.901522:0:26169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854457999488 00000100:00100000:0.0:1784188947.901529:0:26169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854457999488 00000100:00100000:0.0:1784188947.901563:0:26169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4911 00000100:00100000:0.0:1784188947.901571:0:26169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc07faaad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+5:83242:x1870854457999488:12345-0@lo:5:osp-pre-1-0.0 00000020:02000000:0.0:1784188947.901577:0:26169:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00002000:00080000:0.0:1784188947.901608:0:26169:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000401 at 1698 00000100:00100000:2.0:1784188947.901946:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc06bbf0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1870854457999360:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1784188947.901982:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784188947.902022:0:9466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854457999360 00000100:00100000:2.0:1784188947.902026:0:9466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854457999360 00000100:00100000:2.0:1784188947.902053:0:9466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1801 00000100:00100000:2.0:1784188947.902061:0:9466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc075aa0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3642:x1870854457999360:12345-0@lo:13:osp-pre-1-0.0 00000020:02000000:2.0:1784188947.902065:0:9466:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00002000:00000024:2.0:1784188947.902076:0:9466:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8653248 pending 896 free 3923529728 avail 3692007424 00000100:00100000:2.0:1784188947.902108:0:9466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc075aa0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3642:x1870854457999360:12345-0@lo:13:osp-pre-1-0.0 Request processed in 49us (126us total) trans 0 rc 0/0 00000100:00100000:2.0:1784188947.902121:0:9466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1801 00000100:00100000:2.0:1784188947.902156:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc06bbf0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1870854457999360:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1784188947.902173:0:6502:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784188947.902179:0:6502:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000034a0fccf/0xcc1762b626f8a3fb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x683:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784188947.902188:0:6502:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc070146800 already unused, calling callback (ffffffffc0b2e230) 00010000:00010000:2.0:1784188947.902192:0:6502:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000034a0fccf/0xcc1762b626f8a3fb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x683:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784188947.902201:0:6502:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000034a0fccf/0xcc1762b626f8a3fb lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x683:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784188947.902216:0:6502:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000034a0fccf/0xcc1762b626f8a3fb lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x683:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784188947.902223:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000034a0fccf/0xcc1762b626f8a3fb lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x683:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784188947.902239:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784188947.902240:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784188947.902242:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784188947.902247:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784188947.902408:0:7454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784188947.910430:0:26169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc07faaad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+6:83242:x1870854457999488:12345-0@lo:5:osp-pre-1-0.0 Request processed in 8852us (8939us total) trans 4294968950 rc 0/0 00000100:00100000:1.0:1784188947.910443:0:26169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4911 00000100:00100000:0.0:1784188947.910502:0:83242:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc07ab98380 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:83242:1870854457999488:0@lo:5:osp-pre-1-0.0 00000004:00080000:0.0:1784188947.910518:0:83242:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x2c0000401:0x6a1:0x0]-[0x2c0000401:0x6c1:0x0] 00010000:00010000:0.0:1784188948.207487:0:26173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00080000:1.0:1784188948.527468:0:23826:0:(ldlm_lib.c:3137:target_queue_recovery_request()) @@@ queue final req req@ffff9dbf469b5880 x1870854457997568/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:0/0 lens 224/0 e 0 to 0 dl 1784188957 ref 2 fl Interpret:/2c0/ffffffff rc 0/-1 job:'ptlrpcd_rcv.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784188948.527597:0:23826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf469b5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3639:x1870854457997568:12345-0@lo:400:ptlrpcd_rcv.0 Request processed in 1004034us (1004699us total) trans 0 rc 0/0 00000100:00100000:1.0:1784188948.527609:0:23826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3660 00000100:00080000:2.0:1784188948.528287:0:3639:0:(import.c:65:import_set_state_nolock()) ffff9dbf436c4000 lustre-MDT0000_UUID: changing import state from REPLAY_WAIT to RECOVER 00000100:00080000:2.0:1784188948.528298:0:3639:0:(client.c:3234:ptlrpc_resend_req()) @@@ going to resend req@ffff9dbf425fb100 x1870854457997568/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1784188977 ref 1 fl Interpret:RQU/2c0/0 rc 0/0 job:'ptlrpcd_rcv.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1784188948.528398:0:3639:0:(client.c:3243:ptlrpc_resend_req()) @@@ it has reply, so skip it req@ffff9dbf425fb100 x1870854457997568/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1784188977 ref 1 fl Interpret:RQU/2c0/0 rc 0/0 job:'ptlrpcd_rcv.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1784188948.528405:0:3639:0:(import.c:65:import_set_state_nolock()) ffff9dbf436c4000 lustre-MDT0000_UUID: changing import state from RECOVER to FULL 00000100:02000000:2.0:1784188948.528421:0:3639:0:(import.c:1743:ptlrpc_import_recovery_state_machine()) lustre-MDT0000-osp-MDT0001: Connection restored to 0@lo (at 0@lo) 00000100:00080000:2.0:1784188948.528427:0:3639:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 000000008bfb1a5a): req@ffff9dc071536d80 x1870854457912320/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1784188768 ref 1 fl Rpc:RSQU/200/0 rc -107/-107 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784188948.528450:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf425fb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3639:1870854457997568:0@lo:400:ptlrpcd_rcv.0 00000100:00100000:3.0:1784188948.528542:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784188948.528809:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854457912320 00000100:00100000:0.0:1784188948.528827:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854457912320 00000100:00100000:1.0:1784188948.528858:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1784188948.528873:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf44c8aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1870854457999616:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1784188948.528880:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3666 00000100:00100000:0.0:1784188948.528892:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc07b5b3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3641:x1870854457912320:12345-0@lo:41:osp-pre-0-1.0 00000020:02000000:0.0:1784188948.528899:0:8438:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00000100:00100000:1.0:1784188948.528911:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00000024:0.0:1784188948.528930:0:8438:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1445289984 avail 1299050496 00000100:00100000:1.0:1784188948.528940:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854457999616 00000100:00100000:1.0:1784188948.528945:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854457999616 00000100:00100000:0.0:1784188948.528984:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc07b5b3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3641:x1870854457912320:12345-0@lo:41:osp-pre-0-1.0 Request processed in 94us (442us total) trans 0 rc 0/0 00000100:00100000:1.0:1784188948.528987:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3667 00000100:00100000:1.0:1784188948.528998:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc050541880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3642:x1870854457999616:12345-0@lo:41:osp-pre-0-1.0 00000020:02000000:1.0:1784188948.529004:0:8439:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00000100:00100000:0.0:1784188948.529009:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3666 00000004:00000024:1.0:1784188948.529016:0:8439:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1445289984 avail 1299050496 00000100:00100000:1.0:1784188948.529058:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc050541880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3642:x1870854457999616:12345-0@lo:41:osp-pre-0-1.0 Request processed in 62us (147us total) trans 0 rc 0/0 00000100:00100000:1.0:1784188948.529066:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3667 00000100:00100000:0.0:1784188948.529081:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf44c8aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1870854457999616:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1784188948.529291:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc071536d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1870854457912320:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1784188949.235766:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784188950.255498:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784188950.576964:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1784188950.577002:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc050543b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1870854457999744:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1784188950.577070:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784188950.577961:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854457999744 00000100:00100000:1.0:1784188950.577972:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854457999744 00000100:00100000:1.0:1784188950.578027:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3668 00000100:00100000:1.0:1784188950.578036:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf44c8aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3641:x1870854457999744:12345-0@lo:41:osp-pre-1-0.0 00000020:02000000:1.0:1784188950.578043:0:8438:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00000004:00000024:1.0:1784188950.578077:0:8438:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445576704 avail 1299337216 00000100:00100000:1.0:1784188950.578155:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf44c8aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3641:x1870854457999744:12345-0@lo:41:osp-pre-1-0.0 Request processed in 119us (1084us total) trans 0 rc 0/0 00000100:00100000:1.0:1784188950.578163:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3668 00000100:00100000:3.0:1784188950.578296:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc050543b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1870854457999744:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1784188951.282849:0:7454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784188951.599563:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc07b5b1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1870854457999872:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1784188951.599641:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784188951.599891:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc050540700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1870854458000000:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1784188951.599925:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784188951.600068:0:9466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854457999872 00000100:00100000:0.0:1784188951.600076:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458000000 00000100:00100000:1.0:1784188951.600077:0:9466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854457999872 00000100:00100000:0.0:1784188951.600079:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458000000 00000100:00100000:1.0:1784188951.600273:0:9466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1802 00000100:00100000:1.0:1784188951.600283:0:9466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc07b5b1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1870854457999872:12345-0@lo:13:osp-pre-0-1.0 00000020:02000000:1.0:1784188951.600290:0:9466:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00002000:00000024:1.0:1784188951.600338:0:9466:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 214592 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1784188951.600385:0:9466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc07b5b1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1870854457999872:12345-0@lo:13:osp-pre-0-1.0 Request processed in 104us (745us total) trans 0 rc 0/0 00000100:00100000:1.0:1784188951.600393:0:9466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1802 00000100:00100000:1.0:1784188951.600440:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc07b5b1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1870854457999872:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1784188951.601813:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1803 00000100:00100000:0.0:1784188951.601825:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc075aa1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1870854458000000:12345-0@lo:13:osp-pre-1-1.0 00000020:02000000:0.0:1784188951.601831:0:8431:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00002000:00000024:0.0:1784188951.601853:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8652352 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1784188951.601923:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc075aa1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1870854458000000:12345-0@lo:13:osp-pre-1-1.0 Request processed in 101us (1997us total) trans 0 rc 0/0 00000100:00100000:0.0:1784188951.601930:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1803 00000100:00100000:3.0:1784188951.602822:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc050540700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1870854458000000:0@lo:13:osp-pre-1-1.0 00000100:00080000:2.0:1784188951.602901:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1784188951.602907:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1784188952.306236:0:26173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784188952.623749:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc07b5b0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3640:1870854458000256:0@lo:400:kworker.0 00000100:00100000:1.0:1784188952.623842:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784188952.623881:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc05ed98000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1870854458000768:0@lo:400:kworker.0 00000100:00100000:1.0:1784188952.623906:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784188952.623922:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc0477c3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1870854458001280:0@lo:400:kworker.0 00000100:00100000:1.0:1784188952.623951:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784188952.623980:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1784188952.623986:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc07b5b1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3640:1870854458000384:0@lo:400:kworker.0 00000100:00100000:1.0:1784188952.624004:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784188952.624015:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc06b98d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1870854458000896:0@lo:400:kworker.0 00000100:00100000:1.0:1784188952.624032:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784188952.624042:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc0477c3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1870854458001408:0@lo:400:kworker.0 00000100:00100000:1.0:1784188952.624057:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784188952.624082:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458000768 00000100:00100000:1.0:1784188952.624088:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458000768 00000100:00100000:1.0:1784188952.624123:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458001280 00000100:00100000:1.0:1784188952.624126:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458001280 00000100:00100000:1.0:1784188952.624160:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3669 00000100:00100000:1.0:1784188952.624168:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc050540700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3640:x1870854458000768:12345-0@lo:400:kworker.0 00000020:02000000:1.0:1784188952.624175:0:8439:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00000100:00100000:1.0:1784188952.624222:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc050540700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3640:x1870854458000768:12345-0@lo:400:kworker.0 Request processed in 55us (315us total) trans 0 rc 0/0 00000100:00100000:1.0:1784188952.624229:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3669 00000100:00100000:1.0:1784188952.624247:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3670 00000100:00100000:1.0:1784188952.624253:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc050543b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3640:x1870854458001280:12345-0@lo:400:kworker.0 00000020:02000000:1.0:1784188952.624257:0:8439:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00000100:00100000:1.0:1784188952.624281:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc050543b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3640:x1870854458001280:12345-0@lo:400:kworker.0 Request processed in 29us (340us total) trans 0 rc 0/0 00000100:00100000:1.0:1784188952.624294:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3670 00000100:00100000:1.0:1784188952.624359:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc05ed98000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1870854458000768:0@lo:400:kworker.0 00000100:00100000:1.0:1784188952.624372:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc0477c3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1870854458001280:0@lo:400:kworker.0 00000100:00100000:0.0:1784188952.624633:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc071536d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3642:1870854458000512:0@lo:400:kworker.0 00000100:00100000:0.0:1784188952.624665:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784188952.624684:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc06b98fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1870854458001024:0@lo:400:kworker.0 00000100:00100000:0.0:1784188952.624706:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784188952.624721:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf444e1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1870854458001536:0@lo:400:kworker.0 00000100:00100000:0.0:1784188952.624741:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784188952.624759:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [3->2] 00000100:00100000:0.0:1784188952.624765:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc07b5b2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bd553d0d-03e2-4233-b06b-b55bbfa2b954:3642:1870854458000128:0@lo:400:kworker.0 00000100:00100000:0.0:1784188952.624801:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784188952.624825:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc05ed9b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3642:1870854458000640:0@lo:400:kworker.0 00000100:00100000:0.0:1784188952.624847:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784188952.624861:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc06b98c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3642:1870854458001152:0@lo:400:kworker.0 00000100:00100000:0.0:1784188952.624882:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784188952.624898:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf444e0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3642:1870854458001664:0@lo:400:kworker.0 00000100:00100000:0.0:1784188952.624929:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784188952.624949:0:68287:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458000256 00000100:00100000:0.0:1784188952.624954:0:68287:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458000256 00000100:00100000:0.0:1784188952.624996:0:68287:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458000384 00000100:00100000:0.0:1784188952.625000:0:68287:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458000384 00000100:00100000:0.0:1784188952.625013:0:68287:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458000512 00000100:00100000:0.0:1784188952.625015:0:68287:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458000512 00000100:00100000:0.0:1784188952.625027:0:68287:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458000640 00000100:00100000:0.0:1784188952.625029:0:68287:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458000640 00000100:00100000:0.0:1784188952.625039:0:68287:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458001152 00000100:00100000:0.0:1784188952.625041:0:68287:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458001152 00000100:00100000:0.0:1784188952.625049:0:68287:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458001664 00000100:00100000:0.0:1784188952.625051:0:68287:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458001664 00000100:00100000:0.0:1784188952.625062:0:68287:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 941 00000100:00100000:0.0:1784188952.625067:0:68287:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc050542a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1870854458000256:12345-0@lo:400:kworker.0 00000020:02000000:0.0:1784188952.625071:0:68287:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00000100:00100000:0.0:1784188952.625101:0:68287:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc050542a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1870854458000256:12345-0@lo:400:kworker.0 Request processed in 34us (1259us total) trans 0 rc 0/0 00000100:00100000:0.0:1784188952.625107:0:68287:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 941 00000100:00100000:0.0:1784188952.625120:0:68287:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 942 00000100:00100000:0.0:1784188952.625126:0:68287:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc075661500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1870854458000384:12345-0@lo:400:kworker.0 00000020:02000000:0.0:1784188952.625129:0:68287:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00000100:00100000:0.0:1784188952.625151:0:68287:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc075661500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1870854458000384:12345-0@lo:400:kworker.0 Request processed in 26us (1146us total) trans 0 rc 0/0 00000100:00100000:0.0:1784188952.625157:0:68287:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 942 00000100:00100000:0.0:1784188952.625165:0:68287:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 943 00000100:00100000:0.0:1784188952.625171:0:68287:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf43c5c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3642:x1870854458000512:12345-0@lo:400:kworker.0 00000020:02000000:0.0:1784188952.625175:0:68287:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00000100:00100000:0.0:1784188952.625203:0:68287:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf43c5c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3642:x1870854458000512:12345-0@lo:400:kworker.0 Request processed in 33us (537us total) trans 0 rc 0/0 00000100:00100000:0.0:1784188952.625215:0:68287:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 943 00000100:00100000:0.0:1784188952.625227:0:68287:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 944 00000100:00100000:0.0:1784188952.625233:0:68287:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc0505be680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1870854458000640:12345-0@lo:400:kworker.0 00000020:02000000:0.0:1784188952.625236:0:68287:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00000100:00100000:0.0:1784188952.625262:0:68287:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc0505be680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1870854458000640:12345-0@lo:400:kworker.0 Request processed in 29us (414us total) trans 0 rc 0/0 00000100:00100000:0.0:1784188952.625267:0:68287:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 944 00000100:00100000:0.0:1784188952.625278:0:68287:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 945 00000100:00100000:0.0:1784188952.625282:0:68287:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc0505bdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1870854458001152:12345-0@lo:400:kworker.0 00000020:02000000:0.0:1784188952.625286:0:68287:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00000100:00100000:0.0:1784188952.625305:0:68287:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc0505bdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1870854458001152:12345-0@lo:400:kworker.0 Request processed in 23us (423us total) trans 0 rc 0/0 00000100:00100000:0.0:1784188952.625310:0:68287:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 945 00000100:00100000:0.0:1784188952.625341:0:68287:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 946 00000100:00100000:0.0:1784188952.625347:0:68287:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc0505be300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1870854458001664:12345-0@lo:400:kworker.0 00000020:02000000:0.0:1784188952.625350:0:68287:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00000100:00100000:0.0:1784188952.625370:0:68287:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc0505be300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1870854458001664:12345-0@lo:400:kworker.0 Request processed in 24us (440us total) trans 0 rc 0/0 00000100:00100000:0.0:1784188952.625375:0:68287:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 946 00000100:00100000:0.0:1784188952.625402:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc05ed9b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3642:1870854458000640:0@lo:400:kworker.0 00000100:00100000:0.0:1784188952.625410:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc06b98c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3642:1870854458001152:0@lo:400:kworker.0 00000100:00100000:0.0:1784188952.625430:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf444e0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3642:1870854458001664:0@lo:400:kworker.0 00000100:00100000:0.0:1784188952.625438:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc071536d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3642:1870854458000512:0@lo:400:kworker.0 00000100:00100000:3.0:1784188952.625970:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458000896 00000100:00100000:3.0:1784188952.625983:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458000896 00000100:00100000:3.0:1784188952.626021:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458001408 00000100:00100000:3.0:1784188952.626025:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458001408 00000100:00100000:3.0:1784188952.626045:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458001024 00000100:00100000:3.0:1784188952.626047:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458001024 00000100:00100000:3.0:1784188952.626062:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458001536 00000100:00100000:3.0:1784188952.626064:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458001536 00000100:00100000:3.0:1784188952.626082:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2260 00000100:00100000:3.0:1784188952.626090:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc075660380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1870854458000896:12345-0@lo:400:kworker.0 00000020:02000000:3.0:1784188952.626094:0:8428:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00000100:00100000:3.0:1784188952.626134:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc075660380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1870854458000896:12345-0@lo:400:kworker.0 Request processed in 46us (2100us total) trans 0 rc 0/0 00000100:00100000:3.0:1784188952.626154:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2260 00000100:00100000:3.0:1784188952.626169:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2261 00000100:00100000:3.0:1784188952.626175:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc075660700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3640:x1870854458001408:12345-0@lo:400:kworker.0 00000020:02000000:3.0:1784188952.626179:0:8428:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00000100:00100000:3.0:1784188952.626206:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc075660700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3640:x1870854458001408:12345-0@lo:400:kworker.0 Request processed in 31us (2147us total) trans 0 rc 0/0 00000100:00100000:3.0:1784188952.626212:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2261 00000100:00100000:3.0:1784188952.626225:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2262 00000100:00100000:3.0:1784188952.626231:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf43c5c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1870854458001024:12345-0@lo:400:kworker.0 00000020:02000000:3.0:1784188952.626235:0:8428:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00000100:00100000:3.0:1784188952.626271:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf43c5c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1870854458001024:12345-0@lo:400:kworker.0 Request processed in 33us (1557us total) trans 0 rc 0/0 00000100:00100000:3.0:1784188952.626277:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2262 00000100:00100000:3.0:1784188952.626288:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2263 00000100:00100000:3.0:1784188952.626294:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf43c5fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3642:x1870854458001536:12345-0@lo:400:kworker.0 00000020:02000000:3.0:1784188952.626297:0:8428:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00000100:00100000:3.0:1784188952.626355:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf43c5fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3642:x1870854458001536:12345-0@lo:400:kworker.0 Request processed in 61us (1612us total) trans 0 rc 0/0 00000100:00100000:3.0:1784188952.626362:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2263 00000100:00100000:3.0:1784188952.626382:0:83227:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458000128 00000100:00100000:3.0:1784188952.626385:0:83227:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458000128 00000100:00100000:3.0:1784188952.626406:0:83227:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:3.0:1784188952.626422:0:83227:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc05f1db450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd553d0d-03e2-4233-b06b-b55bbfa2b954+24:3642:x1870854458000128:12345-0@lo:400:kworker.0 00000020:02000000:3.0:1784188952.626428:0:83227:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00000100:00100000:3.0:1784188952.626457:0:83227:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc05f1db450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd553d0d-03e2-4233-b06b-b55bbfa2b954+24:3642:x1870854458000128:12345-0@lo:400:kworker.0 Request processed in 44us (1654us total) trans 0 rc 0/0 00000100:00100000:3.0:1784188952.626462:0:83227:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00080000:2.0:1784188952.626824:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1784188952.626828:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1784188952.626831:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1784188952.626833:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1784188952.627116:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc07b5b1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3640:1870854458000384:0@lo:400:kworker.0 00000100:00100000:1.0:1784188952.627128:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc06b98d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1870854458000896:0@lo:400:kworker.0 00000100:00100000:1.0:1784188952.627138:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc0477c3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1870854458001408:0@lo:400:kworker.0 00000100:00100000:1.0:1784188952.627158:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc07b5b0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3640:1870854458000256:0@lo:400:kworker.0 00000100:00100000:0.0:1784188952.627519:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc07b5b2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bd553d0d-03e2-4233-b06b-b55bbfa2b954:3642:1870854458000128:0@lo:400:kworker.0 00000100:00100000:0.0:1784188952.627544:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc06b98fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1870854458001024:0@lo:400:kworker.0 00000100:00100000:0.0:1784188952.627556:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf444e1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1870854458001536:0@lo:400:kworker.0 00000100:00100000:2.0:1784188952.875623:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1784188952.875672:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1784188952.875712:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1784188952.875837:0:66170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436220416 00000100:00100000:1.0:1784188952.875852:0:66170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436220416 00000100:00100000:1.0:1784188952.875919:0:66170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436220544 00000100:00100000:1.0:1784188952.875922:0:66170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436220544 00000100:00100000:1.0:1784188952.875969:0:66170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 947 00000100:00100000:1.0:1784188952.875983:0:66170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc075aa2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+6:2398:x1870854436220544:12345-192.168.203.12@tcp:400:kworker.0 00000020:02000000:1.0:1784188952.875993:0:66170:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00000100:00100000:1.0:1784188952.876096:0:66170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc075aa2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+6:2398:x1870854436220544:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 116us (382us total) trans 0 rc 0/0 00000100:00100000:1.0:1784188952.876106:0:66170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 947 00000100:00100000:1.0:1784188952.876127:0:66170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1002 00000100:00100000:1.0:1784188952.876132:0:66170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc075aa1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2395:x1870854436220416:12345-192.168.203.12@tcp:38:kworker.0 00000020:02000000:1.0:1784188952.876136:0:66170:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00010000:00080000:1.0:1784188952.876166:0:66170:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from b90fcc1c-0e69-42a4-a116-a71fec7aeb78@192.168.203.12@tcp t90194313217 exp 0000000000000000 cur 3195 last 0 00000020:00000080:1.0:1784188952.876223:0:66170:0:(genops.c:1406:class_connect()) connect: client b90fcc1c-0e69-42a4-a116-a71fec7aeb78, cookie 0xcc1762b626f8a402 00000004:00100000:1.0:1784188952.876255:0:66170:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:1.0:1784188952.876446:0:66170:0:(import.c:65:import_set_state_nolock()) ffff9dbf436c6800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1784188952.876485:0:66170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc075aa1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+6:2395:x1870854436220416:12345-192.168.203.12@tcp:38:kworker.0 Request processed in 351us (812us total) trans 0 rc 0/0 00000100:00100000:1.0:1784188952.876494:0:66170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1002 00000100:00080000:2.0:1784188952.876721:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1784188952.878411:0:83228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436220288 00000100:00100000:3.0:1784188952.878431:0:83228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436220288 00000100:00100000:3.0:1784188952.878518:0:83228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 151 00000100:00100000:3.0:1784188952.878532:0:83228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc05f1d9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9957a2dc-fd88-4a91-bca3-e2b7f365ab0c+10:2398:x1870854436220288:12345-192.168.203.12@tcp:400:kworker.0 00000020:02000000:3.0:1784188952.878541:0:83228:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00000100:00100000:3.0:1784188952.878636:0:83228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc05f1d9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9957a2dc-fd88-4a91-bca3-e2b7f365ab0c+10:2398:x1870854436220288:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 107us (3027us total) trans 0 rc 0/0 00000100:00100000:3.0:1784188952.878645:0:83228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 151 00000100:00100000:3.0:1784188952.879238:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1784188952.886908:0:26164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436220672 00000100:00100000:2.0:1784188952.886931:0:26164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436220672 00000100:00100000:2.0:1784188952.887134:0:26164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 2264 00000100:00100000:2.0:1784188952.887149:0:26164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf444e1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+6:2399:x1870854436220672:12345-192.168.203.12@tcp:400:kworker.0 00000020:02000000:2.0:1784188952.887159:0:26164:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00000100:00100000:2.0:1784188952.887289:0:26164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf444e1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+6:2399:x1870854436220672:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 143us (8052us total) trans 0 rc 0/0 00000100:00100000:2.0:1784188952.887298:0:26164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 2264 00000100:00080000:0.0:1784188952.889103:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00100000:3.0:1784188952.889997:0:83222:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of b90fcc1c-0e69-42a4-a116-a71fec7aeb78 00000100:00100000:3.0:1784188952.912218:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1784188952.912497:0:66945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436220800 00000100:00100000:2.0:1784188952.912513:0:66945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436220800 00000100:00100000:2.0:1784188952.912660:0:66945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1003 00000100:00100000:2.0:1784188952.912675:0:66945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf444e0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+6:64014:x1870854436220800:12345-192.168.203.12@tcp:41:lfs.0 00000020:02000000:2.0:1784188952.912685:0:66945:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00000004:00000024:2.0:1784188952.912737:0:66945:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445576704 avail 1299337216 00000100:00100000:2.0:1784188952.912863:0:66945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf444e0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+6:64014:x1870854436220800:12345-192.168.203.12@tcp:41:lfs.0 Request processed in 183us (646us total) trans 0 rc 0/0 00000100:00100000:2.0:1784188952.912872:0:66945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1003 00000100:00100000:2.0:1784188952.920698:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1784188952.924302:0:26159:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436220928 00000100:00100000:0.0:1784188952.924380:0:26159:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436220928 00000100:00100000:0.0:1784188952.924518:0:26159:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 4912 00000100:00100000:0.0:1784188952.924529:0:26159:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf425fb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0+-99:2395:x1870854436220928:12345-192.168.203.12@tcp:8:lfs.0 00000020:02000000:0.0:1784188952.924537:0:26159:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00010000:00080000:0.0:1784188952.924575:0:26159:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0000: connection from b90fcc1c-0e69-42a4-a116-a71fec7aeb78@192.168.203.12@tcp t0 exp 0000000000000000 cur 3195 last 0 00000020:00000080:0.0:1784188952.924610:0:26159:0:(genops.c:1406:class_connect()) connect: client b90fcc1c-0e69-42a4-a116-a71fec7aeb78, cookie 0xcc1762b626f8a409 00002000:00100000:0.0:1784188952.924623:0:26159:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli b90fcc1c-0e69-42a4-a116-a71fec7aeb78/ffff9dc05ed26800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 21136a2 ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1784188952.924646:0:26159:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:0.0:1784188952.924746:0:26159:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1784188952.924793:0:26159:0:(import.c:65:import_set_state_nolock()) ffff9dc05ed22000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1784188952.924894:0:26159:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf425fb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+6:2395:x1870854436220928:12345-192.168.203.12@tcp:8:lfs.0 Request processed in 365us (4211us total) trans 0 rc 0/0 00000100:00100000:0.0:1784188952.924910:0:26159:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 4912 00000100:00100000:1.0:1784188952.930174:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1784188952.931574:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436221056 00000100:00100000:3.0:1784188952.931588:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436221056 00000100:00100000:3.0:1784188952.931656:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1804 00000100:00100000:3.0:1784188952.931667:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc075663100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+6:64014:x1870854436221056:12345-192.168.203.12@tcp:13:lfs.0 00000020:02000000:3.0:1784188952.931675:0:8432:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00002000:00000024:3.0:1784188952.931711:0:8432:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8652352 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1784188952.931796:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc075663100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+6:64014:x1870854436221056:12345-192.168.203.12@tcp:13:lfs.0 Request processed in 129us (1635us total) trans 0 rc 0/0 00000100:00100000:3.0:1784188952.931804:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1804 00000100:00100000:1.0:1784188952.936126:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1784188952.938525:0:9466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436221184 00000100:00100000:0.0:1784188952.938546:0:9466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436221184 00000100:00100000:0.0:1784188952.938643:0:9466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1805 00000100:00100000:0.0:1784188952.938658:0:9466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc07b5b2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+6:64014:x1870854436221184:12345-192.168.203.12@tcp:13:lfs.0 00000020:02000000:0.0:1784188952.938668:0:9466:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00002000:00000024:0.0:1784188952.938712:0:9466:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8652352 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1784188952.938836:0:9466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc07b5b2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+6:64014:x1870854436221184:12345-192.168.203.12@tcp:13:lfs.0 Request processed in 180us (2718us total) trans 0 rc 0/0 00000001:00100000:2.0:1784188952.938865:0:8423:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of b90fcc1c-0e69-42a4-a116-a71fec7aeb78 00000100:00100000:0.0:1784188952.938868:0:9466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1805 00000001:00080000:2.0:1784188952.938895:0:8423:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294968947 is committed 00000100:00100000:2.0:1784188953.135966:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc071536d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1870854458001792:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1784188953.136070:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784188953.136188:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458001792 00000100:00100000:0.0:1784188953.136199:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458001792 00000100:00100000:0.0:1784188953.136263:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1806 00000100:00100000:0.0:1784188953.136281:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc06bbf0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3640:x1870854458001792:12345-0@lo:13:osp-pre-1-0.0 00000020:02000000:0.0:1784188953.136291:0:8431:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00002000:00000024:0.0:1784188953.136349:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8652352 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1784188953.136405:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc06bbf0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3640:x1870854458001792:12345-0@lo:13:osp-pre-1-0.0 Request processed in 125us (334us total) trans 0 rc 0/0 00000100:00100000:0.0:1784188953.136414:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1806 00000100:00100000:2.0:1784188953.136771:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc071536d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1870854458001792:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1784188953.137027:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc07b5b0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1870854458001920:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1784188953.137075:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784188953.137510:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458001920 00000100:00100000:0.0:1784188953.137525:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458001920 00000100:00100000:0.0:1784188953.137715:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1807 00000100:00100000:0.0:1784188953.137732:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc07b5b1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1870854458001920:12345-0@lo:13:osp-pre-0-0.0 00000020:02000000:0.0:1784188953.137739:0:8432:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00002000:00000024:0.0:1784188953.138654:0:8432:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8652352 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1784188953.138736:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc07b5b1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1870854458001920:12345-0@lo:13:osp-pre-0-0.0 Request processed in 1010us (1659us total) trans 0 rc 0/0 00000100:00100000:0.0:1784188953.138744:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1807 00000100:00100000:1.0:1784188953.139840:0:3641:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294968947 gen 2 00000100:00100000:1.0:1784188953.139901:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc07b5b0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1870854458001920:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1784188953.327553:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784188953.647607:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc071536d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1870854458002048:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1784188953.647687:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784188953.647743:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458002048 00000100:00100000:0.0:1784188953.647751:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458002048 00000100:00100000:0.0:1784188953.647808:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3671 00000100:00100000:0.0:1784188953.647818:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc044c14000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3642:x1870854458002048:12345-0@lo:41:osp-pre-0-1.0 00000020:02000000:0.0:1784188953.647833:0:8439:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00000004:00000024:0.0:1784188953.647866:0:8439:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445289984 avail 1299050496 00000100:00100000:0.0:1784188953.647918:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc044c14000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3642:x1870854458002048:12345-0@lo:41:osp-pre-0-1.0 Request processed in 102us (232us total) trans 0 rc 0/0 00000100:00100000:0.0:1784188953.647938:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3671 00000100:00100000:2.0:1784188953.648012:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc071536d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1870854458002048:0@lo:41:osp-pre-0-1.0 00000001:00080000:1.0:1784188953.651488:0:9506:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294968950 is committed 00010000:00010000:2.0:1784188954.352984:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784188954.674229:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1784188954.674406:0:66169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436221312 00000100:00100000:3.0:1784188954.674424:0:66169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436221312 00000100:00100000:3.0:1784188954.674502:0:66169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1004 00000100:00100000:3.0:1784188954.674515:0:66169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc044c17800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+5:64120:x1870854436221312:12345-192.168.203.12@tcp:101:lfs.0 00000020:02000000:3.0:1784188954.674524:0:66169:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00010000:00010000:3.0:1784188954.674551:0:66169:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784188954.674584:0:66169:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc05ec0ca00/0xcc1762b626f8a410 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbfc5de7fe6c3c88 expref: -99 pid: 66169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1784188954.679998:0:66169:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 5345us 00010000:00010000:0.0:1784188954.696398:0:66169:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc070147000/0xcc1762b626f8a417 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784188954.696421:0:66169:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc070147000/0xcc1762b626f8a417 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784188954.696434:0:66169:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc070147000/0xcc1762b626f8a417 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784188954.696486:0:66169:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1784188954.696490:0:66169:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 8 00000004:00010000:0.0:1784188954.696525:0:66169:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9dc070147000/0xcc1762b626f8a417 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784188954.696560:0:66169:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc05ec0ca00/0xcc1762b626f8a410 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c3c88 expref: 7 pid: 66169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784188954.696578:0:66169:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc070147000/0xcc1762b626f8a417 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c3c88 expref: 6 pid: 66169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784188954.696587:0:66169:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9dc051574700) 00010000:00010000:0.0:1784188954.696589:0:66169:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1784188954.696593:0:66169:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc070147000, rc 0) 00000100:00100000:0.0:1784188954.696661:0:66169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc044c17800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+6:64120:x1870854436221312:12345-192.168.203.12@tcp:101:lfs.0 Request processed in 22147us (22439us total) trans 0 rc 0/0 00000100:00100000:0.0:1784188954.696669:0:66169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1004 00000100:00100000:2.0:1784188954.705756:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1784188954.705845:0:68287:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436221440 00000100:00100000:0.0:1784188954.705855:0:68287:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436221440 00000100:00100000:0.0:1784188954.705924:0:68287:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1005 00000100:00100000:0.0:1784188954.705934:0:68287:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc044c15500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+6:64120:x1870854436221440:12345-192.168.203.12@tcp:41:lfs.0 00000020:02000000:0.0:1784188954.705942:0:68287:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00000004:00000024:0.0:1784188954.705976:0:68287:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445289984 avail 1299050496 00000100:00100000:0.0:1784188954.706045:0:68287:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc044c15500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+6:64120:x1870854436221440:12345-192.168.203.12@tcp:41:lfs.0 Request processed in 112us (297us total) trans 0 rc 0/0 00000100:00100000:0.0:1784188954.706053:0:68287:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1005 00000100:00100000:3.0:1784188954.708695:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1784188954.708816:0:66945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436221568 00000100:00100000:2.0:1784188954.708834:0:66945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436221568 00000100:00100000:2.0:1784188954.708901:0:66945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1006 00000100:00100000:2.0:1784188954.708911:0:66945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc07173b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+6:64120:x1870854436221568:12345-192.168.203.12@tcp:41:lfs.0 00000020:02000000:2.0:1784188954.708918:0:66945:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00000004:00000024:2.0:1784188954.708955:0:66945:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445576704 avail 1299337216 00000100:00080000:0.0:1784188954.709091:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1784188954.709124:0:66945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc07173b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+6:64120:x1870854436221568:12345-192.168.203.12@tcp:41:lfs.0 Request processed in 213us (434us total) trans 0 rc 0/0 00000100:00100000:2.0:1784188954.709133:0:66945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1006 00000100:00100000:2.0:1784188954.721518:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1784188954.723563:0:9466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436221696 00000100:00100000:3.0:1784188954.723577:0:9466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436221696 00000100:00100000:3.0:1784188954.723647:0:9466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1808 00000100:00100000:3.0:1784188954.723659:0:9466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc044c16d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+5:64120:x1870854436221696:12345-192.168.203.12@tcp:13:lfs.0 00000020:02000000:3.0:1784188954.723666:0:9466:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00002000:00000024:3.0:1784188954.723690:0:9466:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8652352 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1784188954.723776:0:9466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc044c16d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+5:64120:x1870854436221696:12345-192.168.203.12@tcp:13:lfs.0 Request processed in 109us (2258us total) trans 0 rc 0/0 00000100:00100000:3.0:1784188954.723785:0:9466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1808 00000100:00100000:1.0:1784188954.725785:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1784188954.726357:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436221824 00000100:00100000:0.0:1784188954.726366:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436221824 00000100:00100000:0.0:1784188954.726431:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1809 00000100:00100000:0.0:1784188954.726442:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc07b5b0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+6:64120:x1870854436221824:12345-192.168.203.12@tcp:13:lfs.0 00000020:02000000:0.0:1784188954.726449:0:8432:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00002000:00000024:0.0:1784188954.726474:0:8432:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8652352 pending 0 free 3923529728 avail 3692007424 00000100:00080000:2.0:1784188954.726649:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1784188954.727233:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc07b5b0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+6:64120:x1870854436221824:12345-192.168.203.12@tcp:13:lfs.0 Request processed in 788us (1463us total) trans 0 rc 0/0 00000100:00100000:0.0:1784188954.727243:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1809 00000100:00100000:2.0:1784188954.766111:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1784188954.766273:0:66169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436221952 00000100:00100000:0.0:1784188954.766282:0:66169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436221952 00000100:00100000:0.0:1784188954.766372:0:66169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1007 00000100:00100000:0.0:1784188954.766384:0:66169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc043591f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+6:63622:x1870854436221952:12345-192.168.203.12@tcp:101:multiop.0 00000020:02000000:0.0:1784188954.766391:0:66169:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00010000:00010000:0.0:1784188954.766410:0:66169:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784188954.766430:0:66169:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc070146600/0xcc1762b626f8a41e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbfc5de7fe6c3c8f expref: -99 pid: 66169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784188954.766493:0:66169:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc070147600/0xcc1762b626f8a425 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784188954.766518:0:66169:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc070147600/0xcc1762b626f8a425 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784188954.766529:0:66169:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc070147600/0xcc1762b626f8a425 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784188954.766544:0:66169:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc070147a00/0xcc1762b626f8a42c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x8d5cb397 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784188954.766553:0:66169:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc070147a00/0xcc1762b626f8a42c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8d5cb397 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784188954.766559:0:66169:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc070147a00/0xcc1762b626f8a42c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8d5cb397 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784188954.766701:0:66169:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc070147200/0xcc1762b626f8a433 lrc: 3/1,0 mode: --/PR res: [0x20000a041:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784188954.766710:0:66169:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc070147200/0xcc1762b626f8a433 lrc: 3/1,0 mode: PR/PR res: [0x20000a041:0x1:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784188954.766718:0:66169:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc070147200/0xcc1762b626f8a433 lrc: 3/1,0 mode: PR/PR res: [0x20000a041:0x1:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784188954.766747:0:66169:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000a041:0x1:0x0]: returning size 0 00000004:00200000:0.0:1784188954.766751:0:66169:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 8 00000004:00010000:0.0:1784188954.766795:0:66169:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9dc070147200/0xcc1762b626f8a433 lrc: 3/1,0 mode: PR/PR res: [0x20000a041:0x1:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784188954.766808:0:66169:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc070147200/0xcc1762b626f8a433 lrc: 3/1,0 mode: PR/PR res: [0x20000a041:0x1:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784188954.766828:0:66169:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc070147600/0xcc1762b626f8a425 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784188954.766834:0:66169:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc070147600/0xcc1762b626f8a425 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784188954.766840:0:66169:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc070147600/0xcc1762b626f8a425 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784188954.766848:0:66169:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dc070147600/0xcc1762b626f8a425 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784188954.766854:0:66169:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc070147600 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:0.0:1784188954.766858:0:66169:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc070147600/0xcc1762b626f8a425 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784188954.766866:0:66169:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc070147600/0xcc1762b626f8a425 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784188954.766878:0:66169:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9dc051574700) 00010000:00010000:0.0:1784188954.766881:0:66169:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784188954.766886:0:66169:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dc070147600/0xcc1762b626f8a425 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784188954.766893:0:66169:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc070147600/0xcc1762b626f8a425 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784188954.766906:0:66169:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc070147a00/0xcc1762b626f8a42c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8d5cb397 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784188954.766912:0:66169:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc070147a00/0xcc1762b626f8a42c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8d5cb397 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784188954.766924:0:66169:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dc070147a00/0xcc1762b626f8a42c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8d5cb397 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784188954.766930:0:66169:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc070147a00 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:0.0:1784188954.766933:0:66169:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc070147a00/0xcc1762b626f8a42c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8d5cb397 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784188954.766939:0:66169:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc070147a00/0xcc1762b626f8a42c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8d5cb397 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784188954.766947:0:66169:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x8d5cb397 (ffff9dc07b032f00) 00010000:00010000:0.0:1784188954.766949:0:66169:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784188954.766951:0:66169:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dc070147a00/0xcc1762b626f8a42c lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x8d5cb397 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784188954.766957:0:66169:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc070147a00/0xcc1762b626f8a42c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x8d5cb397 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784188954.766988:0:66169:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc070146600/0xcc1762b626f8a41e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c3c8f expref: 8 pid: 66169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784188954.767002:0:66169:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc070147200/0xcc1762b626f8a433 lrc: 3/0,0 mode: PR/PR res: [0x20000a041:0x1:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c3c8f expref: 7 pid: 66169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784188954.767009:0:66169:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a041:0x1:0x0].0x0 (ffff9dc07b032900) 00010000:00010000:0.0:1784188954.767011:0:66169:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1784188954.767013:0:66169:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc070147200, rc 0) 00000100:00100000:0.0:1784188954.767067:0:66169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc043591f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+7:63622:x1870854436221952:12345-192.168.203.12@tcp:101:multiop.0 Request processed in 685us (963us total) trans 0 rc 0/0 00000100:00100000:0.0:1784188954.767084:0:66169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1007 00010000:00010000:3.0:1784188955.375792:0:7454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784188955.698173:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1784188955.698196:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc071536d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1870854458002176:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1784188955.698263:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784188955.704698:0:23826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458002176 00000100:00100000:0.0:1784188955.704711:0:23826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458002176 00000100:00100000:0.0:1784188955.704785:0:23826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3672 00000100:00100000:0.0:1784188955.704795:0:23826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc06b98fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3642:x1870854458002176:12345-0@lo:41:osp-pre-1-0.0 00000020:02000000:0.0:1784188955.704803:0:23826:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00000004:00000024:0.0:1784188955.704833:0:23826:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445576704 avail 1299337216 00000100:00100000:0.0:1784188955.705061:0:23826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc06b98fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3642:x1870854458002176:12345-0@lo:41:osp-pre-1-0.0 Request processed in 267us (6797us total) trans 0 rc 0/0 00000100:00100000:0.0:1784188955.705069:0:23826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3672 00000100:00100000:0.0:1784188955.705130:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc071536d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1870854458002176:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1784188956.403639:0:26173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784188956.719853:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc07b5b3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1870854458002304:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1784188956.719934:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784188956.720297:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458002304 00000100:00100000:1.0:1784188956.720306:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458002304 00000100:00100000:1.0:1784188956.720436:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1810 00000100:00100000:1.0:1784188956.720446:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc043590380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1870854458002304:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1784188956.720473:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8652352 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1784188956.720525:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc043590380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1870854458002304:12345-0@lo:13:osp-pre-1-1.0 Request processed in 80us (590us total) trans 0 rc 0/0 00000100:00100000:1.0:1784188956.720532:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1810 00000100:00100000:1.0:1784188956.720599:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc07b5b3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1870854458002304:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1784188956.720948:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc071739f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1870854458002432:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1784188956.720981:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784188956.721118:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458002432 00000100:00100000:3.0:1784188956.721123:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458002432 00000100:00080000:2.0:1784188956.724110:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1784188956.724121:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1784188956.726658:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1811 00000100:00100000:3.0:1784188956.726676:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc06b98d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1870854458002432:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1784188956.726713:0:8432:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8652352 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1784188956.726810:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc06b98d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1870854458002432:12345-0@lo:13:osp-pre-0-1.0 Request processed in 141us (5827us total) trans 0 rc 0/0 00000100:00100000:3.0:1784188956.726819:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1811 00000100:00100000:3.0:1784188956.726875:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc071739f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1870854458002432:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1784188957.431533:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784188957.743950:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc0477c3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3640:1870854458002816:0@lo:400:kworker.0 00000100:00100000:1.0:1784188957.744018:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784188957.744047:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc080e7c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1870854458003328:0@lo:400:kworker.0 00000100:00100000:1.0:1784188957.744074:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784188957.744104:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc080e7c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1870854458003840:0@lo:400:kworker.0 00000100:00100000:1.0:1784188957.744127:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784188957.744150:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1784188957.744157:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc05ed9b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3640:1870854458002944:0@lo:400:kworker.0 00000100:00100000:1.0:1784188957.744179:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784188957.744196:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc080e7df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1870854458003456:0@lo:400:kworker.0 00000100:00100000:1.0:1784188957.744219:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784188957.744234:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf4a130a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1870854458003968:0@lo:400:kworker.0 00000100:00100000:1.0:1784188957.744253:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784188957.744294:0:26163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458003328 00000100:00100000:1.0:1784188957.744302:0:26163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458003328 00000100:00100000:1.0:1784188957.744365:0:26163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458003840 00000100:00100000:1.0:1784188957.744369:0:26163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458003840 00000100:00100000:1.0:1784188957.744405:0:26163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458003456 00000100:00100000:1.0:1784188957.744408:0:26163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458003456 00000100:00100000:1.0:1784188957.744426:0:26163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458003968 00000100:00100000:1.0:1784188957.744430:0:26163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458003968 00000100:00100000:1.0:1784188957.744450:0:26163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2265 00000100:00100000:1.0:1784188957.744458:0:26163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf4a130e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:3640:x1870854458003328:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784188957.744507:0:26163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf4a130e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:3640:x1870854458003328:12345-0@lo:400:kworker.0 Request processed in 50us (432us total) trans 0 rc 0/0 00000100:00100000:1.0:1784188957.744514:0:26163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2265 00000100:00100000:1.0:1784188957.744544:0:26163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2266 00000100:00100000:1.0:1784188957.744550:0:26163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf4a133100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+5:3640:x1870854458003840:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784188957.744587:0:26163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf4a133100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+5:3640:x1870854458003840:12345-0@lo:400:kworker.0 Request processed in 28us (450us total) trans 0 rc 0/0 00000100:00100000:1.0:1784188957.744594:0:26163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2266 00000100:00100000:1.0:1784188957.744626:0:26163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2267 00000100:00100000:1.0:1784188957.744632:0:26163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc0565a3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:3640:x1870854458003456:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784188957.744660:0:26163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc0565a3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:3640:x1870854458003456:12345-0@lo:400:kworker.0 Request processed in 29us (441us total) trans 0 rc 0/0 00000100:00100000:1.0:1784188957.744666:0:26163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2267 00000100:00100000:1.0:1784188957.744678:0:26163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2268 00000100:00100000:1.0:1784188957.744684:0:26163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc075a97480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+5:3640:x1870854458003968:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784188957.744709:0:26163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc075a97480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+5:3640:x1870854458003968:12345-0@lo:400:kworker.0 Request processed in 25us (455us total) trans 0 rc 0/0 00000100:00100000:1.0:1784188957.744716:0:26163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2268 00000100:00080000:1.0:1784188957.744739:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1784188957.744743:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1784188957.744782:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc080e7df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1870854458003456:0@lo:400:kworker.0 00000100:00100000:1.0:1784188957.744792:0:3640:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294968950 gen 2 00000100:00100000:1.0:1784188957.744806:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf4a130a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1870854458003968:0@lo:400:kworker.0 00000100:00100000:1.0:1784188957.744817:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc080e7c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1870854458003328:0@lo:400:kworker.0 00000100:00100000:1.0:1784188957.744825:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc080e7c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1870854458003840:0@lo:400:kworker.0 00000100:00100000:0.0:1784188957.744974:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc07b5b3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bd553d0d-03e2-4233-b06b-b55bbfa2b954:3642:1870854458002560:0@lo:400:kworker.0 00000100:00100000:0.0:1784188957.745009:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784188957.745046:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc05ed98000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3642:1870854458003072:0@lo:400:kworker.0 00000100:00100000:0.0:1784188957.745070:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784188957.745091:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc080e7f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3642:1870854458003584:0@lo:400:kworker.0 00000100:00100000:0.0:1784188957.745114:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784188957.745131:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf4a131180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3642:1870854458004096:0@lo:400:kworker.0 00000100:00100000:0.0:1784188957.745152:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784188957.745183:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1784188957.745189:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc0477c3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3642:1870854458002688:0@lo:400:kworker.0 00000100:00100000:0.0:1784188957.745211:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784188957.745223:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf46903100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1870854458003200:0@lo:400:kworker.0 00000100:00100000:0.0:1784188957.745246:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784188957.745263:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc080e7f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1870854458003712:0@lo:400:kworker.0 00000100:00100000:0.0:1784188957.745299:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784188957.745349:0:66945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458002816 00000100:00100000:0.0:1784188957.745353:0:66945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458002816 00000100:00100000:0.0:1784188957.745379:0:66945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458002944 00000100:00100000:0.0:1784188957.745383:0:66945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458002944 00000100:00100000:0.0:1784188957.745394:0:66945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458003072 00000100:00100000:0.0:1784188957.745396:0:66945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458003072 00000100:00100000:0.0:1784188957.745407:0:66945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458003584 00000100:00100000:0.0:1784188957.745409:0:66945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458003584 00000100:00100000:0.0:1784188957.745418:0:66945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458004096 00000100:00100000:0.0:1784188957.745420:0:66945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458004096 00000100:00100000:0.0:1784188957.745430:0:66945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458002688 00000100:00100000:0.0:1784188957.745433:0:66945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458002688 00000100:00100000:0.0:1784188957.745446:0:66945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 948 00000100:00100000:0.0:1784188957.745453:0:66945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf4a132a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1870854458002816:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784188957.745489:0:66945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf4a132a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1870854458002816:12345-0@lo:400:kworker.0 Request processed in 36us (1471us total) trans 0 rc 0/0 00000100:00100000:0.0:1784188957.745495:0:66945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 948 00000100:00100000:0.0:1784188957.745508:0:66945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 949 00000100:00100000:0.0:1784188957.745514:0:66945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf4a130000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3640:x1870854458002944:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784188957.745540:0:66945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf4a130000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3640:x1870854458002944:12345-0@lo:400:kworker.0 Request processed in 26us (1360us total) trans 0 rc 0/0 00000100:00100000:0.0:1784188957.745546:0:66945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 949 00000100:00100000:0.0:1784188957.745567:0:66945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 950 00000100:00100000:0.0:1784188957.745572:0:66945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc06b98c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1870854458003072:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784188957.745605:0:66945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc06b98c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1870854458003072:12345-0@lo:400:kworker.0 Request processed in 32us (533us total) trans 0 rc 0/0 00000100:00100000:0.0:1784188957.745611:0:66945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 950 00000100:00100000:0.0:1784188957.745621:0:66945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 951 00000100:00100000:0.0:1784188957.745627:0:66945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc071536d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1870854458003584:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784188957.745650:0:66945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc071536d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1870854458003584:12345-0@lo:400:kworker.0 Request processed in 24us (535us total) trans 0 rc 0/0 00000100:00100000:0.0:1784188957.745656:0:66945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 951 00000100:00100000:0.0:1784188957.745666:0:66945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 952 00000100:00100000:0.0:1784188957.745671:0:66945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc070204a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1870854458004096:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784188957.745695:0:66945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc070204a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1870854458004096:12345-0@lo:400:kworker.0 Request processed in 24us (542us total) trans 0 rc 0/0 00000100:00100000:0.0:1784188957.745700:0:66945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 952 00000100:00100000:0.0:1784188957.745711:0:66945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 953 00000100:00100000:0.0:1784188957.745716:0:66945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc070204700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3642:x1870854458002688:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784188957.745739:0:66945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc070204700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3642:x1870854458002688:12345-0@lo:400:kworker.0 Request processed in 23us (528us total) trans 0 rc 0/0 00000100:00100000:0.0:1784188957.745757:0:66945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 953 00000100:00100000:0.0:1784188957.745782:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458003200 00000100:00100000:0.0:1784188957.745787:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458003200 00000100:00100000:0.0:1784188957.745805:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458003712 00000100:00100000:0.0:1784188957.745807:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458003712 00000100:00100000:0.0:1784188957.745824:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3673 00000100:00100000:0.0:1784188957.745829:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc070205180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3642:x1870854458003200:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784188957.745871:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc070205180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3642:x1870854458003200:12345-0@lo:400:kworker.0 Request processed in 42us (624us total) trans 0 rc 0/0 00000100:00100000:0.0:1784188957.745879:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3673 00000100:00100000:0.0:1784188957.745892:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3674 00000100:00100000:0.0:1784188957.745898:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc070204380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3642:x1870854458003712:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784188957.745923:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc070204380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3642:x1870854458003712:12345-0@lo:400:kworker.0 Request processed in 25us (624us total) trans 0 rc 0/0 00000100:00100000:0.0:1784188957.745929:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3674 00000100:00080000:0.0:1784188957.745952:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1784188957.745956:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1784188957.745980:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc0477c3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3642:1870854458002688:0@lo:400:kworker.0 00000100:00100000:0.0:1784188957.745991:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf46903100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1870854458003200:0@lo:400:kworker.0 00000100:00100000:0.0:1784188957.746001:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc080e7f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1870854458003712:0@lo:400:kworker.0 00000100:00100000:0.0:1784188957.746010:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc05ed98000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3642:1870854458003072:0@lo:400:kworker.0 00000100:00100000:0.0:1784188957.746018:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc080e7f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3642:1870854458003584:0@lo:400:kworker.0 00000100:00100000:0.0:1784188957.746026:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf4a131180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3642:1870854458004096:0@lo:400:kworker.0 00000100:00100000:0.0:1784188957.746061:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc05ed9b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3640:1870854458002944:0@lo:400:kworker.0 00000100:00100000:0.0:1784188957.746071:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc0477c3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3640:1870854458002816:0@lo:400:kworker.0 00000100:00100000:1.0:1784188957.746809:0:83227:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458002560 00000100:00100000:1.0:1784188957.746817:0:83227:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458002560 00000100:00100000:1.0:1784188957.746869:0:83227:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:1.0:1784188957.746877:0:83227:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf43e6a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd553d0d-03e2-4233-b06b-b55bbfa2b954+24:3642:x1870854458002560:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784188957.746927:0:83227:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf43e6a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd553d0d-03e2-4233-b06b-b55bbfa2b954+24:3642:x1870854458002560:12345-0@lo:400:kworker.0 Request processed in 50us (1917us total) trans 0 rc 0/0 00000100:00100000:1.0:1784188957.746934:0:83227:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:0.0:1784188957.751020:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc07b5b3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bd553d0d-03e2-4233-b06b-b55bbfa2b954:3642:1870854458002560:0@lo:400:kworker.0 00000100:00100000:0.0:1784188957.952314:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1784188957.952568:0:66945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436222208 00000100:00100000:2.0:1784188957.952578:0:66945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436222208 00000100:00080000:0.0:1784188957.952795:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1784188957.953364:0:66945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1008 00000100:00100000:2.0:1784188957.953378:0:66945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc070204e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+7:64238:x1870854436222208:12345-192.168.203.12@tcp:36:rm.0 00010000:00010000:2.0:1784188957.953430:0:66945:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1784188957.953461:0:66945:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc070147200/0xcc1762b626f8a433 lrc: 0/0,0 mode: --/PR res: [0x20000a041:0x1:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c3c8f expref: 7 pid: 66169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784188957.953480:0:66945:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a041:0x1:0x0].0x0 (ffff9dc07b032900) 00010000:00010000:2.0:1784188957.953497:0:66945:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc070147000/0xcc1762b626f8a417 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c3c88 expref: 6 pid: 66169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784188957.953513:0:66945:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9dc051574700) 00010000:00010000:2.0:1784188957.953520:0:66945:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1784188957.953544:0:66945:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0755a5a00/0xcc1762b626f8a43a lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784188957.953556:0:66945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0755a5a00/0xcc1762b626f8a43a lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784188957.953566:0:66945:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0755a5a00/0xcc1762b626f8a43a lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784188957.953580:0:66945:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0755a4a00/0xcc1762b626f8a441 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x8d5cb397 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784188957.953587:0:66945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0755a4a00/0xcc1762b626f8a441 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x8d5cb397 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784188957.953594:0:66945:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0755a4a00/0xcc1762b626f8a441 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x8d5cb397 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784188957.953680:0:66945:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0755a5400/0xcc1762b626f8a448 lrc: 3/0,1 mode: --/EX res: [0x20000a041:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784188957.953689:0:66945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0755a5400/0xcc1762b626f8a448 lrc: 3/0,1 mode: EX/EX res: [0x20000a041:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784188957.953697:0:66945:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0755a5400/0xcc1762b626f8a448 lrc: 3/0,1 mode: EX/EX res: [0x20000a041:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1784188957.953945:0:66945:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5a:0x0].2, 64 off8320 00000004:00080000:2.0:1784188957.953955:0:66945:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 3200177635576ns, next at 3201177633166ns, rc = 0 00010000:00010000:2.0:1784188957.954015:0:66945:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0755a4c00/0xcc1762b626f8a44f lrc: 3/0,1 mode: --/PW res: [0x20000a041:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784188957.954025:0:66945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0755a4c00/0xcc1762b626f8a44f lrc: 3/0,1 mode: PW/PW res: [0x20000a041:0x1:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784188957.954033:0:66945:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0755a4c00/0xcc1762b626f8a44f lrc: 3/0,1 mode: PW/PW res: [0x20000a041:0x1:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784188957.954041:0:66945:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0755a4c00/0xcc1762b626f8a44f lrc: 4/0,1 mode: PW/PW res: [0x20000a041:0x1:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784188957.954047:0:66945:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0755a4c00/0xcc1762b626f8a44f lrc: 4/0,1 mode: PW/PW res: [0x20000a041:0x1:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784188957.954054:0:66945:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0755a4c00/0xcc1762b626f8a44f lrc: 3/0,0 mode: PW/PW res: [0x20000a041:0x1:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784188957.954076:0:66945:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1784188957.954108:0:66945:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0755a5400/0xcc1762b626f8a448 lrc: 3/0,1 mode: EX/EX res: [0x20000a041:0x1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784188957.954116:0:66945:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0755a5400/0xcc1762b626f8a448 lrc: 2/0,0 mode: EX/EX res: [0x20000a041:0x1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784188957.954122:0:66945:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0755a5400/0xcc1762b626f8a448 lrc: 3/0,0 mode: EX/EX res: [0x20000a041:0x1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784188957.954129:0:66945:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc0755a5400 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:2.0:1784188957.954133:0:66945:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0755a5400/0xcc1762b626f8a448 lrc: 3/0,0 mode: EX/EX res: [0x20000a041:0x1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784188957.954141:0:66945:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0755a5400/0xcc1762b626f8a448 lrc: 4/0,0 mode: EX/EX res: [0x20000a041:0x1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784188957.954157:0:66945:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a041:0x1:0x0].0x0 (ffff9dbf47406000) 00010000:00010000:2.0:1784188957.954160:0:66945:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1784188957.954164:0:66945:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0755a5400/0xcc1762b626f8a448 lrc: 2/0,0 mode: --/EX res: [0x20000a041:0x1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784188957.954170:0:66945:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0755a5400/0xcc1762b626f8a448 lrc: 0/0,0 mode: --/EX res: [0x20000a041:0x1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784188957.954187:0:66945:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0755a5a00/0xcc1762b626f8a43a lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784188957.954194:0:66945:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0755a5a00/0xcc1762b626f8a43a lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784188957.954201:0:66945:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0755a5a00/0xcc1762b626f8a43a lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784188957.954207:0:66945:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0755a5a00/0xcc1762b626f8a43a lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784188957.954213:0:66945:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc0755a5a00 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:2.0:1784188957.954216:0:66945:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0755a5a00/0xcc1762b626f8a43a lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784188957.954223:0:66945:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0755a5a00/0xcc1762b626f8a43a lrc: 5/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784188957.954231:0:66945:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9dbf47406500) 00010000:00010000:2.0:1784188957.954233:0:66945:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784188957.954236:0:66945:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0755a5a00/0xcc1762b626f8a43a lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784188957.954267:0:66945:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0755a5a00/0xcc1762b626f8a43a lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1784188957.954283:0:66945:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000000457c2d0 reply state 00000000a41541f0 transno 94489280513 ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0755a4a00/0xcc1762b626f8a441 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x8d5cb397 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784188957.954295:0:66945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0755a4a00/0xcc1762b626f8a441 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x8d5cb397 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784188957.954301:0:66945:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x8d5cb397 (ffff9dbf47406f00) 00010000:00010000:2.0:1784188957.954304:0:66945:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1784188957.954306:0:66945:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1784188957.954401:0:66945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc070204e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+7:64238:x1870854436222208:12345-192.168.203.12@tcp:36:rm.0 Request processed in 1025us (2093us total) trans 94489280513 rc 0/0 00000100:00100000:2.0:1784188957.954409:0:66945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1008 00010000:00010000:0.0:1784188957.954492:0:6501:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784188957.954504:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0755a4c00/0xcc1762b626f8a44f lrc: 2/0,0 mode: PW/PW res: [0x20000a041:0x1:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784188957.954511:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc0755a4c00 already unused, calling callback (ffffffffc0b2e230) 00010000:00010000:0.0:1784188957.954515:0:6501:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0755a4c00/0xcc1762b626f8a44f lrc: 2/0,0 mode: PW/PW res: [0x20000a041:0x1:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784188957.954522:0:6501:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0755a4c00/0xcc1762b626f8a44f lrc: 3/0,0 mode: PW/PW res: [0x20000a041:0x1:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784188957.954532:0:6501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a041:0x1:0x0].0x0 (ffff9dbf47406000) 00010000:00010000:0.0:1784188957.954535:0:6501:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1784188957.954538:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0755a4c00/0xcc1762b626f8a44f lrc: 1/0,0 mode: --/PW res: [0x20000a041:0x1:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784188957.954543:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0755a4c00/0xcc1762b626f8a44f lrc: 0/0,0 mode: --/PW res: [0x20000a041:0x1:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784188957.954560:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784188957.954562:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784188957.954564:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784188958.012470:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1784188958.012517:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1784188958.012658:0:83228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436222336 00000100:00100000:1.0:1784188958.012667:0:83228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436222336 00000100:00100000:1.0:1784188958.012715:0:83228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 153 00000100:00100000:1.0:1784188958.012725:0:83228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf43e6a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9957a2dc-fd88-4a91-bca3-e2b7f365ab0c+10:2399:x1870854436222336:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:1.0:1784188958.012806:0:83228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf43e6a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9957a2dc-fd88-4a91-bca3-e2b7f365ab0c+10:2399:x1870854436222336:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 81us (344us total) trans 0 rc 0/0 00000100:00100000:1.0:1784188958.012815:0:83228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 153 00000100:00100000:1.0:1784188958.012863:0:26161:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436222592 00000100:00100000:1.0:1784188958.012868:0:26161:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436222592 00000100:00100000:1.0:1784188958.012904:0:26161:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 2269 00000100:00100000:1.0:1784188958.012911:0:26161:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc070205880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+5:2399:x1870854436222592:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:1.0:1784188958.012939:0:26161:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc070205880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+5:2399:x1870854436222592:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 29us (422us total) trans 0 rc 0/0 00000100:00100000:1.0:1784188958.012946:0:26161:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 2269 00000100:00080000:1.0:1784188958.013095:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1784188958.013646:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1784188958.013691:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1784188958.013716:0:26165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436222720 00000100:00100000:0.0:1784188958.013721:0:26165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436222720 00000100:00100000:0.0:1784188958.013773:0:26165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 2270 00000100:00100000:0.0:1784188958.013782:0:26165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc070204000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+6:2399:x1870854436222720:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:0.0:1784188958.013823:0:26165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc070204000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+6:2399:x1870854436222720:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 42us (132us total) trans 0 rc 0/0 00000100:00100000:0.0:1784188958.013842:0:26165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 2270 00000100:00080000:0.0:1784188958.013863:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1784188958.014349:0:68287:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436222464 00000100:00100000:1.0:1784188958.014355:0:68287:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436222464 00000100:00100000:1.0:1784188958.014402:0:68287:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 954 00000100:00100000:1.0:1784188958.014411:0:68287:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc070205c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+6:2399:x1870854436222464:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:1.0:1784188958.014451:0:68287:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc070205c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+6:2399:x1870854436222464:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 41us (1904us total) trans 0 rc 0/0 00000100:00100000:1.0:1784188958.014458:0:68287:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 954 00000100:00080000:0.0:1784188958.015343:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1784188958.255587:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc075a95f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1870854458004224:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1784188958.255670:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784188958.256377:0:9466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458004224 00000100:00100000:2.0:1784188958.256385:0:9466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458004224 00000100:00100000:2.0:1784188958.256444:0:9466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1812 00000100:00100000:2.0:1784188958.256453:0:9466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc071739f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1870854458004224:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1784188958.256480:0:9466:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8652352 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1784188958.256533:0:9466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc071739f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1870854458004224:12345-0@lo:13:osp-pre-0-0.0 Request processed in 80us (863us total) trans 0 rc 0/0 00000100:00100000:2.0:1784188958.256539:0:9466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1812 00000100:00080000:2.0:1784188958.256570:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1784188958.256845:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc075a95f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1870854458004224:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1784188958.264669:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1784188958.264691:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc043592680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1870854458004352:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1784188958.264787:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784188958.264849:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458004352 00000100:00100000:2.0:1784188958.264871:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458004352 00000100:00080000:0.0:1784188958.264925:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1784188958.264935:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1813 00000100:00100000:2.0:1784188958.264945:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc043593b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1870854458004352:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1784188958.264971:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8652352 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1784188958.265023:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc043593b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1870854458004352:12345-0@lo:13:osp-pre-1-0.0 Request processed in 80us (236us total) trans 0 rc 0/0 00000100:00100000:2.0:1784188958.265031:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1813 00000100:00100000:0.0:1784188958.267000:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc043592680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1870854458004352:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1784188958.447565:0:7454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784188958.767973:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc070205f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1870854458004480:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1784188958.768044:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784188958.768130:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458004480 00000100:00100000:0.0:1784188958.768138:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458004480 00000100:00100000:0.0:1784188958.768209:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3675 00000100:00100000:0.0:1784188958.768219:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc043591c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3641:x1870854458004480:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1784188958.768254:0:8439:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445289984 avail 1299050496 00000100:00100000:0.0:1784188958.768314:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc043591c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3641:x1870854458004480:12345-0@lo:41:osp-pre-0-1.0 Request processed in 95us (269us total) trans 0 rc 0/0 00000100:00100000:0.0:1784188958.768345:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3675 00000100:00100000:3.0:1784188958.768381:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc070205f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1870854458004480:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1784188959.471525:0:26173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784188960.496402:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784188960.815934:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1784188960.815955:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc075a95500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1870854458004608:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1784188960.816019:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784188960.816067:0:23826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458004608 00000100:00100000:1.0:1784188960.816083:0:23826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458004608 00000100:00100000:1.0:1784188960.816131:0:23826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3676 00000100:00100000:1.0:1784188960.816140:0:23826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc075a95f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3643:x1870854458004608:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1784188960.816172:0:23826:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445576704 avail 1299337216 00000100:00100000:1.0:1784188960.816216:0:23826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc075a95f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3643:x1870854458004608:12345-0@lo:41:osp-pre-1-0.0 Request processed in 77us (196us total) trans 0 rc 0/0 00000100:00100000:1.0:1784188960.816224:0:23826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3676 00000100:00100000:1.0:1784188960.816267:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc075a95500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1870854458004608:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1784188961.519927:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784188961.839981:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc07173ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1870854458004736:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1784188961.840055:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784188961.840208:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458004736 00000100:00100000:3.0:1784188961.840217:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458004736 00000100:00100000:3.0:1784188961.840279:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1814 00000100:00100000:3.0:1784188961.840290:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc070206a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1870854458004736:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1784188961.840342:0:8432:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8652352 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1784188961.840390:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc070206a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1870854458004736:12345-0@lo:13:osp-pre-0-1.0 Request processed in 102us (335us total) trans 0 rc 0/0 00000100:00100000:3.0:1784188961.840397:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1814 00000100:00100000:3.0:1784188961.840440:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc07173ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1870854458004736:0@lo:13:osp-pre-0-1.0 00000100:00080000:0.0:1784188961.840570:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1784188961.844158:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1784188961.844179:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc07173ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1870854458004864:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1784188961.844244:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784188961.844421:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458004864 00000100:00100000:3.0:1784188961.844428:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458004864 00000100:00100000:3.0:1784188961.844490:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1815 00000100:00100000:3.0:1784188961.844508:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc043592680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1870854458004864:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1784188961.844550:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8652352 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1784188961.844597:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc043592680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1870854458004864:12345-0@lo:13:osp-pre-1-1.0 Request processed in 91us (351us total) trans 0 rc 0/0 00000100:00100000:3.0:1784188961.844604:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1815 00000100:00100000:3.0:1784188961.844649:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc07173ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1870854458004864:0@lo:13:osp-pre-1-1.0 00000100:00080000:0.0:1784188961.844798:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1784188962.544719:0:7454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784188962.863878:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc075a95500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:bd553d0d-03e2-4233-b06b-b55bbfa2b954:3641:1870854458004992:0@lo:400:kworker.0 00000100:00100000:3.0:1784188962.864006:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784188962.864066:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc080e7f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3641:1870854458005504:0@lo:400:kworker.0 00000100:00100000:3.0:1784188962.864231:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784188962.864254:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc07ab98380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3641:1870854458006016:0@lo:400:kworker.0 00000100:00100000:3.0:1784188962.864278:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784188962.864411:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1784188962.864420:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc080e7f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3641:1870854458005376:0@lo:400:kworker.0 00000100:00100000:3.0:1784188962.864448:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784188962.864466:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc080e7df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1870854458005888:0@lo:400:kworker.0 00000100:00100000:3.0:1784188962.864491:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784188962.864529:0:66171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458005504 00000100:00100000:3.0:1784188962.864538:0:66171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458005504 00000100:00100000:1.0:1784188962.864765:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf4a130a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3643:1870854458005248:0@lo:400:kworker.0 00000100:00100000:1.0:1784188962.864813:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784188962.864834:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc080e7c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1870854458005760:0@lo:400:kworker.0 00000100:00100000:1.0:1784188962.864860:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784188962.864875:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf4262e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1870854458006272:0@lo:400:kworker.0 00000100:00100000:0.0:1784188962.865173:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf4262e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1870854458006400:0@lo:400:kworker.0 00000100:00100000:0.0:1784188962.865210:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784188962.865247:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1784188962.865253:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf4262fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3640:1870854458006528:0@lo:400:kworker.0 00000100:00100000:0.0:1784188962.865277:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784188962.865314:0:26168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458005888 00000100:00100000:0.0:1784188962.865345:0:26168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458005888 00000100:00100000:0.0:1784188962.865391:0:26168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458005760 00000100:00100000:0.0:1784188962.865412:0:26168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458005760 00000100:00100000:0.0:1784188962.865438:0:26168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458006400 00000100:00100000:0.0:1784188962.865441:0:26168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458006400 00000100:00100000:0.0:1784188962.865466:0:26168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2271 00000100:00100000:0.0:1784188962.865474:0:26168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc05f02d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0001-mdtlov_UUID+5:3641:x1870854458005888:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784188962.865527:0:26168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc05f02d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0001-mdtlov_UUID+5:3641:x1870854458005888:12345-0@lo:400:kworker.0 Request processed in 53us (1034us total) trans 0 rc 0/0 00000100:00100000:0.0:1784188962.865534:0:26168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2271 00000100:00100000:0.0:1784188962.865552:0:26168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2272 00000100:00100000:0.0:1784188962.865557:0:26168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc07b6e5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0001-mdtlov_UUID+5:3643:x1870854458005760:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784188962.865594:0:26168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc07b6e5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0001-mdtlov_UUID+5:3643:x1870854458005760:12345-0@lo:400:kworker.0 Request processed in 37us (733us total) trans 0 rc 0/0 00000100:00100000:0.0:1784188962.865599:0:26168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2272 00000100:00100000:0.0:1784188962.865609:0:26168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2273 00000100:00100000:0.0:1784188962.865614:0:26168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc070205500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+5:3640:x1870854458006400:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784188962.865641:0:26168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc070205500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+5:3640:x1870854458006400:12345-0@lo:400:kworker.0 Request processed in 27us (431us total) trans 0 rc 0/0 00000100:00100000:0.0:1784188962.865646:0:26168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2273 00000100:00100000:0.0:1784188962.865688:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf4262e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1870854458006400:0@lo:400:kworker.0 00000100:00100000:0.0:1784188962.865742:0:68287:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458006016 00000100:00100000:0.0:1784188962.865746:0:68287:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458006016 00000100:00100000:0.0:1784188962.865769:0:68287:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458005376 00000100:00100000:0.0:1784188962.865772:0:68287:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458005376 00000100:00100000:0.0:1784188962.865784:0:68287:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458005248 00000100:00100000:0.0:1784188962.865787:0:68287:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458005248 00000100:00100000:0.0:1784188962.865799:0:68287:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458006528 00000100:00100000:0.0:1784188962.865802:0:68287:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458006528 00000100:00100000:0.0:1784188962.865813:0:68287:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 955 00000100:00100000:0.0:1784188962.865827:0:68287:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc071738700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1870854458006016:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784188962.865861:0:68287:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc071738700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1870854458006016:12345-0@lo:400:kworker.0 Request processed in 34us (1582us total) trans 0 rc 0/0 00000100:00100000:0.0:1784188962.865868:0:68287:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 955 00000100:00100000:0.0:1784188962.865881:0:68287:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 956 00000100:00100000:0.0:1784188962.865887:0:68287:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc05f02dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1870854458005376:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784188962.865914:0:68287:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc05f02dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1870854458005376:12345-0@lo:400:kworker.0 Request processed in 29us (1466us total) trans 0 rc 0/0 00000100:00100000:0.0:1784188962.865920:0:68287:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 956 00000100:00100000:0.0:1784188962.865932:0:68287:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 957 00000100:00100000:0.0:1784188962.865937:0:68287:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf4262d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1870854458005248:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784188962.865966:0:68287:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf4262d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1870854458005248:12345-0@lo:400:kworker.0 Request processed in 28us (1152us total) trans 0 rc 0/0 00000100:00100000:0.0:1784188962.865972:0:68287:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 957 00000100:00100000:0.0:1784188962.865995:0:68287:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 958 00000100:00100000:0.0:1784188962.866001:0:68287:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc070207b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1870854458006528:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784188962.866030:0:68287:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc070207b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1870854458006528:12345-0@lo:400:kworker.0 Request processed in 30us (752us total) trans 0 rc 0/0 00000100:00100000:0.0:1784188962.866036:0:68287:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 958 00000100:00100000:0.0:1784188962.866055:0:83227:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458004992 00000100:00100000:0.0:1784188962.866059:0:83227:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458004992 00000100:00100000:0.0:1784188962.866084:0:83227:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1784188962.866373:0:66171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 959 00000100:00100000:3.0:1784188962.866383:0:66171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc07173ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1870854458005504:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784188962.866421:0:66171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc07173ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1870854458005504:12345-0@lo:400:kworker.0 Request processed in 42us (2190us total) trans 0 rc 0/0 00000100:00100000:3.0:1784188962.866427:0:66171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 959 00000100:00080000:3.0:1784188962.866459:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1784188962.866465:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1784188962.866468:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1784188962.866494:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc080e7f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3641:1870854458005376:0@lo:400:kworker.0 00000100:00100000:3.0:1784188962.866507:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc080e7df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1870854458005888:0@lo:400:kworker.0 00000100:00100000:3.0:1784188962.866517:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc080e7f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3641:1870854458005504:0@lo:400:kworker.0 00000100:00100000:3.0:1784188962.866528:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc07ab98380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3641:1870854458006016:0@lo:400:kworker.0 00000100:00100000:2.0:1784188962.866762:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf4a131180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3642:1870854458005120:0@lo:400:kworker.0 00000100:00100000:2.0:1784188962.867068:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784188962.867101:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc080e7c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1870854458005632:0@lo:400:kworker.0 00000100:00100000:2.0:1784188962.867130:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784188962.867152:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf4262f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1870854458006144:0@lo:400:kworker.0 00000100:00100000:2.0:1784188962.867194:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784188962.867236:0:66945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458005120 00000100:00100000:2.0:1784188962.867242:0:66945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458005120 00000100:00100000:2.0:1784188962.867608:0:66945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 960 00000100:00100000:2.0:1784188962.867617:0:66945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc05ed3b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3642:x1870854458005120:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784188962.867668:0:66945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc05ed3b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3642:x1870854458005120:12345-0@lo:400:kworker.0 Request processed in 52us (601us total) trans 0 rc 0/0 00000100:00100000:2.0:1784188962.867675:0:66945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 960 00000100:00100000:2.0:1784188962.867990:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458005632 00000100:00100000:2.0:1784188962.867996:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458005632 00000100:00100000:2.0:1784188962.868032:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458006144 00000100:00100000:2.0:1784188962.868036:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458006144 00000100:00100000:2.0:1784188962.868057:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3677 00000100:00100000:2.0:1784188962.868063:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc05ed3ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3642:x1870854458005632:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784188962.868101:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc05ed3ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3642:x1870854458005632:12345-0@lo:400:kworker.0 Request processed in 38us (970us total) trans 0 rc 0/0 00000100:00100000:2.0:1784188962.868108:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3677 00000100:00100000:2.0:1784188962.868121:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3678 00000100:00100000:2.0:1784188962.868126:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc080f69880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3642:x1870854458006144:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784188962.868159:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc080f69880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3642:x1870854458006144:12345-0@lo:400:kworker.0 Request processed in 33us (965us total) trans 0 rc 0/0 00000100:00100000:2.0:1784188962.868164:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3678 00000100:00080000:2.0:1784188962.868184:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1784188962.868391:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784188962.868455:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf4a130a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3643:1870854458005248:0@lo:400:kworker.0 00000100:00100000:1.0:1784188962.868483:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc080e7c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1870854458005760:0@lo:400:kworker.0 00000100:00100000:1.0:1784188962.868530:0:26159:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458006272 00000100:00100000:1.0:1784188962.868535:0:26159:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458006272 00000100:00100000:1.0:1784188962.868570:0:26159:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2274 00000100:00100000:1.0:1784188962.868590:0:26159:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc07b6e6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3643:x1870854458006272:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784188962.869086:0:26159:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc07b6e6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3643:x1870854458006272:12345-0@lo:400:kworker.0 Request processed in 507us (694us total) trans 0 rc 0/0 00000100:00100000:1.0:1784188962.869094:0:26159:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2274 00000100:00100000:1.0:1784188962.869146:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf4262e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1870854458006272:0@lo:400:kworker.0 00000100:00080000:1.0:1784188962.869524:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1784188962.869555:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf4a131180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3642:1870854458005120:0@lo:400:kworker.0 00000100:00100000:1.0:1784188962.869570:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc080e7c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1870854458005632:0@lo:400:kworker.0 00000100:00100000:3.0:1784188962.869595:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf4262fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3640:1870854458006528:0@lo:400:kworker.0 00000100:00100000:1.0:1784188962.869606:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf4262f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1870854458006144:0@lo:400:kworker.0 00000100:00100000:0.0:1784188962.870926:0:83227:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf43e6b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd553d0d-03e2-4233-b06b-b55bbfa2b954+24:3641:x1870854458004992:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784188962.871175:0:83227:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf43e6b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd553d0d-03e2-4233-b06b-b55bbfa2b954+24:3641:x1870854458004992:12345-0@lo:400:kworker.0 Request processed in 5082us (7170us total) trans 0 rc 0/0 00000100:00100000:0.0:1784188962.871200:0:83227:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1784188962.872297:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc075a95500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:bd553d0d-03e2-4233-b06b-b55bbfa2b954:3641:1870854458004992:0@lo:400:kworker.0 00000100:00100000:0.0:1784188963.117106:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1784188963.117172:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1784188963.117209:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1784188963.117245:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1784188963.117271:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1784188963.117275:0:66170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436223104 00000100:00100000:2.0:1784188963.117287:0:66170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436223104 00000100:00100000:0.0:1784188963.117347:0:66945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436222976 00000100:00100000:1.0:1784188963.117353:0:83228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436222848 00000100:00100000:0.0:1784188963.117353:0:66945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436222976 00000100:00100000:1.0:1784188963.117361:0:83228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436222848 00000100:00100000:2.0:1784188963.117396:0:66170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 961 00000100:00100000:2.0:1784188963.117409:0:66170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc070205f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+6:2396:x1870854436223104:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:1.0:1784188963.117412:0:83228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 155 00000100:00100000:3.0:1784188963.117423:0:26171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436223360 00000100:00100000:1.0:1784188963.117428:0:83228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf43e6a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9957a2dc-fd88-4a91-bca3-e2b7f365ab0c+10:2396:x1870854436222848:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:3.0:1784188963.117430:0:26171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436223360 00000100:00100000:3.0:1784188963.117470:0:26171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436223232 00000100:00100000:3.0:1784188963.117474:0:26171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436223232 00000100:00100000:3.0:1784188963.117504:0:26171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 2275 00000100:00100000:2.0:1784188963.117506:0:66170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc070205f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+6:2396:x1870854436223104:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 101us (333us total) trans 0 rc 0/0 00000100:00100000:3.0:1784188963.117511:0:26171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf4262f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+6:2396:x1870854436223360:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:2.0:1784188963.117515:0:66170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 961 00000100:00100000:2.0:1784188963.117533:0:66170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 962 00000100:00100000:2.0:1784188963.117539:0:66170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf4262fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+7:2396:x1870854436222976:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:0.0:1784188963.117577:0:26162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 2276 00000100:00100000:0.0:1784188963.117586:0:26162:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf4262e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+5:2396:x1870854436223232:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:1.0:1784188963.120048:0:83228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf43e6a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9957a2dc-fd88-4a91-bca3-e2b7f365ab0c+10:2396:x1870854436222848:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 2607us (2941us total) trans 0 rc 0/0 00000100:00100000:1.0:1784188963.120068:0:83228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 155 00000100:00080000:1.0:1784188963.120261:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1784188963.120269:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1784188963.120338:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1784188963.120343:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1784188963.123766:0:26171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf4262f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+6:2396:x1870854436223360:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 6236us (6536us total) trans 0 rc 0/0 00000100:00100000:3.0:1784188963.123789:0:26171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 2275 00000100:00100000:2.0:1784188963.124285:0:66170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf4262fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+7:2396:x1870854436222976:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 6740us (7033us total) trans 0 rc 0/0 00000100:00100000:2.0:1784188963.124339:0:66170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 962 00000100:00100000:0.0:1784188963.126683:0:26162:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf4262e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+5:2396:x1870854436223232:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 9080us (9391us total) trans 0 rc 0/0 00000100:00100000:0.0:1784188963.126704:0:26162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 2276 00000100:00100000:3.0:1784188963.375598:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1784188963.375644:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc07b6e5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1870854458006656:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1784188963.375765:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784188963.375806:0:9466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458006656 00000100:00100000:0.0:1784188963.375818:0:9466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458006656 00000100:00100000:0.0:1784188963.375898:0:9466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1816 00000100:00100000:0.0:1784188963.375910:0:9466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc05f02df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1870854458006656:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1784188963.375940:0:9466:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8652352 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1784188963.376015:0:9466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc05f02df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1870854458006656:12345-0@lo:13:osp-pre-0-0.0 Request processed in 108us (252us total) trans 0 rc 0/0 00000100:00100000:0.0:1784188963.376023:0:9466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1816 00000004:00080000:2.0:1784188963.376140:0:83242:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 3205599819981ns, next at 3206599816925ns, rc = 0 00000100:00100000:1.0:1784188963.376776:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc080f69c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1870854458006784:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1784188963.376827:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784188963.376903:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc07b6e5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1870854458006656:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1784188963.376987:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458006784 00000100:00100000:2.0:1784188963.376993:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458006784 00000100:00100000:2.0:1784188963.377039:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1817 00000100:00100000:2.0:1784188963.377047:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc07b6e6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1870854458006784:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1784188963.377066:0:8432:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8652352 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1784188963.377121:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc07b6e6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1870854458006784:12345-0@lo:13:osp-pre-1-0.0 Request processed in 75us (294us total) trans 0 rc 0/0 00000100:00100000:2.0:1784188963.377129:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1817 00000100:00100000:1.0:1784188963.377862:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc080f69c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1870854458006784:0@lo:13:osp-pre-1-0.0 00000004:00080000:3.0:1784188963.378969:0:83222:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3 committed 00000001:00080000:3.0:1784188963.379119:0:83222:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 94489280513 is committed 00000004:00080000:3.0:1784188963.379125:0:83222:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00010000:00010000:0.0:1784188963.379183:0:3627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0755a4a00/0xcc1762b626f8a441 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x8d5cb397 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784188963.379197:0:3627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0755a4a00/0xcc1762b626f8a441 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x8d5cb397 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784188963.379225:0:3627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0755a4a00/0xcc1762b626f8a441 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x8d5cb397 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784188963.379233:0:3627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc0755a4a00 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:0.0:1784188963.379239:0:3627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0755a4a00/0xcc1762b626f8a441 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x8d5cb397 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784188963.379248:0:3627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0755a4a00/0xcc1762b626f8a441 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x8d5cb397 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784188963.379289:0:3627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x8d5cb397 (ffff9dbf47406f00) 00010000:00010000:0.0:1784188963.379293:0:3627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784188963.379300:0:3627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0755a4a00/0xcc1762b626f8a441 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x8d5cb397 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784188963.379307:0:3627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0755a4a00/0xcc1762b626f8a441 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x8d5cb397 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784188963.379879:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc07b6e5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1870854458006912:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1784188963.380152:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784188963.380470:0:26160:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458006912 00000100:00100000:2.0:1784188963.380481:0:26160:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458006912 00000100:00100000:2.0:1784188963.380587:0:26160:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4913 00000100:00100000:2.0:1784188963.380598:0:26160:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc05f02f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+5:3640:x1870854458006912:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1784188963.380633:0:26160:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:1666 count 1 00010000:00010000:2.0:1784188963.380666:0:26160:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000097385c8a/0xcc1762b626f8a456 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x682:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784188963.380694:0:26160:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000456ffdbd/0xcc1762b626f89ff6 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x682:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c3c65 expref: 5 pid: 14684 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784188963.380714:0:26160:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x682:0x0].0x0 since=217s v=(0 0) 00010000:00010000:2.0:1784188963.380720:0:26160:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x682:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784188963.380725:0:26160:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000097385c8a/0xcc1762b626f8a456 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x682:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784188963.380775:0:26160:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000456ffdbd/0xcc1762b626f89ff6 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x682:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c3c65 expref: 5 pid: 14684 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784188963.380791:0:26160:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000456ffdbd/0xcc1762b626f89ff6 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x682:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c3c65 expref: 5 pid: 14684 timeout: 3305 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784188963.380816:0:26160:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc080f6b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:26160:1870854458007040:192.168.203.12@tcp:104: 00000100:00100000:2.0:1784188963.380912:0:26160:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dc071388900 going to sleep for 11 seconds 00000100:00100000:2.0:1784188963.389924:0:26160:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc080f6b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:26160:1870854458007040:192.168.203.12@tcp:104: 00010000:00010000:2.0:1784188963.389980:0:26160:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000097385c8a/0xcc1762b626f8a456 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x682:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784188963.390312:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1784188963.390988:0:7455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436223488 00000100:00100000:2.0:1784188963.391001:0:7455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436223488 00010000:00010000:2.0:1784188963.391042:0:7455:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000456ffdbd/0xcc1762b626f89ff6 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x682:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c3c65 expref: 6 pid: 14684 timeout: 3305 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784188963.391127:0:7455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 2536 00000100:00100000:2.0:1784188963.391138:0:7455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc07b6e4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+6:2399:x1870854436223488:12345-192.168.203.12@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1784188963.391158:0:7455:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784188963.391165:0:7455:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000456ffdbd/0xcc1762b626f89ff6 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x682:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c3c65 expref: 6 pid: 14684 timeout: 3305 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784188963.391204:0:7455:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000456ffdbd/0xcc1762b626f89ff6 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x682:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c3c65 expref: 6 pid: 14684 timeout: 3305 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784188963.391237:0:7455:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000456ffdbd/0xcc1762b626f89ff6 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x682:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c3c65 expref: 6 pid: 14684 timeout: 3305 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784188963.391260:0:7455:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x682:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784188963.391266:0:7455:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x682:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784188963.391384:0:7455:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000097385c8a/0xcc1762b626f8a456 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x682:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784188963.391397:0:7455:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000097385c8a/0xcc1762b626f8a456 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x682:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784188963.391431:0:7455:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1784188963.391451:0:26160:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000097385c8a/0xcc1762b626f8a456 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x682:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784188963.391461:0:26160:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000097385c8a/0xcc1762b626f8a456 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x682:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784188963.391479:0:26160:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000097385c8a/0xcc1762b626f8a456 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x682:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784188963.391487:0:26160:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000097385c8a/0xcc1762b626f8a456 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x682:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784188963.391502:0:7455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc07b6e4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+5:2399:x1870854436223488:12345-192.168.203.12@tcp:103:ldlm_bl.0 Request processed in 366us (1192us total) trans 0 rc 0/0 00010000:00010000:1.0:1784188963.391504:0:26160:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1784188963.391510:0:7455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 2536 00000100:00100000:1.0:1784188963.391844:0:26160:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc05f02f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+6:3640:x1870854458006912:12345-0@lo:6:osp-syn-1-0.0 Request processed in 11246us (11690us total) trans 4294968951 rc 0/0 00000100:00100000:1.0:1784188963.391854:0:26160:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4913 00000004:00080000:0.0:1784188963.392007:0:3640:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9dc07b6e5c00/2, rc 0, transno 4294968951 00000100:00100000:0.0:1784188963.392015:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc07b6e5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1870854458006912:0@lo:6:osp-syn-1-0.0 00010000:00010000:3.0:1784188963.394698:0:26173:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784188963.394724:0:26173:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000097385c8a/0xcc1762b626f8a456 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x682:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784188963.394743:0:26173:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc0755a5400 already unused, calling callback (ffffffffc0b2e230) 00010000:00010000:3.0:1784188963.394749:0:26173:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000097385c8a/0xcc1762b626f8a456 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x682:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784188963.394762:0:26173:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000097385c8a/0xcc1762b626f8a456 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x682:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784188963.394807:0:26173:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000097385c8a/0xcc1762b626f8a456 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x682:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784188963.394817:0:26173:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000097385c8a/0xcc1762b626f8a456 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x682:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784188963.394847:0:26173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784188963.394849:0:26173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784188963.394852:0:26173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784188963.570085:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784188963.893543:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1784188963.893588:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf4262e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1870854458007168:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1784188963.893832:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784188963.893912:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458007168 00000100:00100000:3.0:1784188963.893923:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458007168 00000100:00100000:3.0:1784188963.893992:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3679 00000100:00100000:3.0:1784188963.894003:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc080f6b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3640:x1870854458007168:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1784188963.894050:0:8439:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445289984 avail 1299050496 00000100:00100000:3.0:1784188963.894118:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc080f6b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3640:x1870854458007168:12345-0@lo:41:osp-pre-0-1.0 Request processed in 116us (286us total) trans 0 rc 0/0 00000100:00100000:3.0:1784188963.894137:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3679 00000100:00100000:2.0:1784188963.894383:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf4262e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1870854458007168:0@lo:41:osp-pre-0-1.0 00000001:02000400:2.0:1784188964.147202:0:83965:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == replay-single test 130a: DoM file create (setstripe) replay ========================================================== 04:02:42 (1784188962) 00010000:00010000:0.0:1784188964.592107:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1784188965.062455:0:9506:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294968951 is committed 00000100:00100000:1.0:1784188965.164490:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1784188965.164618:0:68287:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436223616 00000100:00100000:2.0:1784188965.164628:0:68287:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436223616 00000100:00100000:2.0:1784188965.164716:0:68287:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1009 00000100:00100000:2.0:1784188965.164728:0:68287:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc07b6e7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+5:64827:x1870854436223616:12345-192.168.203.12@tcp:101:lfs.0 00010000:00010000:2.0:1784188965.164749:0:68287:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784188965.164772:0:68287:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0755a5e00/0xcc1762b626f8a45d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbfc5de7fe6c3c96 expref: -99 pid: 68287 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784188965.164839:0:68287:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0755a4400/0xcc1762b626f8a464 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784188965.164852:0:68287:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0755a4400/0xcc1762b626f8a464 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784188965.164866:0:68287:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0755a4400/0xcc1762b626f8a464 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784188965.164912:0:68287:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1784188965.164917:0:68287:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 8 00000004:00010000:2.0:1784188965.164939:0:68287:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0755a4400/0xcc1762b626f8a464 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784188965.164964:0:68287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0755a5e00/0xcc1762b626f8a45d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c3c96 expref: 7 pid: 68287 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784188965.164979:0:68287:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0755a4400/0xcc1762b626f8a464 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c3c96 expref: 6 pid: 68287 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784188965.164987:0:68287:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9dbf47406700) 00010000:00010000:2.0:1784188965.164990:0:68287:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1784188965.164993:0:68287:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc0755a4400, rc 0) 00000100:00100000:2.0:1784188965.165049:0:68287:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc07b6e7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+6:64827:x1870854436223616:12345-192.168.203.12@tcp:101:lfs.0 Request processed in 324us (569us total) trans 0 rc 0/0 00000100:00100000:2.0:1784188965.165062:0:68287:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1009 00000100:00080000:1.0:1784188965.165474:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1784188965.170505:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1784188965.170582:0:66169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436223744 00000100:00100000:2.0:1784188965.170592:0:66169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436223744 00000100:00100000:2.0:1784188965.170647:0:66169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1010 00000100:00100000:2.0:1784188965.170656:0:66169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf4a131180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+6:64827:x1870854436223744:12345-192.168.203.12@tcp:41:lfs.0 00000004:00000024:2.0:1784188965.170700:0:66169:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445289984 avail 1299050496 00000100:00100000:2.0:1784188965.170765:0:66169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf4a131180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+6:64827:x1870854436223744:12345-192.168.203.12@tcp:41:lfs.0 Request processed in 109us (268us total) trans 0 rc 0/0 00000100:00100000:2.0:1784188965.170773:0:66169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1010 00000100:00100000:1.0:1784188965.178151:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1784188965.178230:0:66170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436223872 00000100:00100000:3.0:1784188965.178239:0:66170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436223872 00000100:00100000:3.0:1784188965.178314:0:66170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1011 00000100:00100000:3.0:1784188965.178364:0:66170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf4a130a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+6:64827:x1870854436223872:12345-192.168.203.12@tcp:41:lfs.0 00000004:00000024:3.0:1784188965.178400:0:66170:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445576704 avail 1299337216 00000100:00100000:3.0:1784188965.178475:0:66170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf4a130a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+6:64827:x1870854436223872:12345-192.168.203.12@tcp:41:lfs.0 Request processed in 112us (334us total) trans 0 rc 0/0 00000100:00100000:3.0:1784188965.178483:0:66170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1011 00000100:00080000:1.0:1784188965.178748:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1784188965.182380:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1784188965.182474:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436224000 00000100:00100000:3.0:1784188965.182483:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436224000 00000100:00100000:3.0:1784188965.182545:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1818 00000100:00100000:3.0:1784188965.182554:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc080f69180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+5:64827:x1870854436224000:12345-192.168.203.12@tcp:13:lfs.0 00002000:00000024:3.0:1784188965.182585:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8652352 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1784188965.182649:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc080f69180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+5:64827:x1870854436224000:12345-192.168.203.12@tcp:13:lfs.0 Request processed in 95us (277us total) trans 0 rc 0/0 00000100:00100000:3.0:1784188965.182657:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1818 00000100:00080000:1.0:1784188965.183088:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1784188965.184925:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1784188965.185051:0:9466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436224128 00000100:00100000:1.0:1784188965.185061:0:9466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436224128 00000100:00100000:1.0:1784188965.185126:0:9466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1819 00000100:00100000:1.0:1784188965.185136:0:9466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc05f02ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+5:64827:x1870854436224128:12345-192.168.203.12@tcp:13:lfs.0 00002000:00000024:1.0:1784188965.185166:0:9466:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8652352 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1784188965.185222:0:9466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc05f02ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+5:64827:x1870854436224128:12345-192.168.203.12@tcp:13:lfs.0 Request processed in 88us (305us total) trans 0 rc 0/0 00000100:00100000:1.0:1784188965.185243:0:9466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1819 00000100:00080000:2.0:1784188965.185300:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1784188965.263809:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1784188965.264065:0:66178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436224256 00000100:00100000:3.0:1784188965.264075:0:66178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436224256 00000100:00100000:3.0:1784188965.264129:0:66178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 12 00000100:00100000:3.0:1784188965.264139:0:66178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf48599180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+6:64835:x1870854436224256:12345-192.168.203.12@tcp:700:mcreate.0 00000100:00100000:3.0:1784188965.264214:0:66178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf48599180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+6:64835:x1870854436224256:12345-192.168.203.12@tcp:700:mcreate.0 Request processed in 76us (410us total) trans 0 rc 0/0 00000100:00100000:3.0:1784188965.264221:0:66178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 12 00000100:00100000:2.0:1784188965.269063:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1784188965.269137:0:66945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436224512 00000100:00100000:3.0:1784188965.269147:0:66945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436224512 00000100:00100000:3.0:1784188965.269206:0:66945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1012 00000100:00100000:3.0:1784188965.269215:0:66945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc080f6ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+6:64835:x1870854436224512:12345-192.168.203.12@tcp:36:mcreate.0 00010000:00010000:3.0:1784188965.269273:0:66945:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784188965.269302:0:66945:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0755a4400/0xcc1762b626f8a464 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c3c96 expref: 6 pid: 68287 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784188965.269343:0:66945:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9dbf47406700) 00010000:00010000:3.0:1784188965.269354:0:66945:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1784188965.269417:0:66945:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc05ec0c600/0xcc1762b626f8a46b lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784188965.269430:0:66945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc05ec0c600/0xcc1762b626f8a46b lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784188965.269440:0:66945:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc05ec0c600/0xcc1762b626f8a46b lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784188965.269452:0:66945:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc05ec0de00/0xcc1762b626f8a472 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x21e7de2f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784188965.269459:0:66945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc05ec0de00/0xcc1762b626f8a472 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x21e7de2f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784188965.269465:0:66945:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc05ec0de00/0xcc1762b626f8a472 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x21e7de2f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784188965.269847:0:66945:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc05ec0c600/0xcc1762b626f8a46b lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784188965.269865:0:66945:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc05ec0c600/0xcc1762b626f8a46b lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784188965.269871:0:66945:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc05ec0c600/0xcc1762b626f8a46b lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784188965.269877:0:66945:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dc05ec0c600/0xcc1762b626f8a46b lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784188965.269883:0:66945:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc05ec0c600 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:3.0:1784188965.269887:0:66945:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc05ec0c600/0xcc1762b626f8a46b lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784188965.269895:0:66945:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc05ec0c600/0xcc1762b626f8a46b lrc: 5/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784188965.269903:0:66945:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9dc047db8100) 00010000:00010000:3.0:1784188965.269906:0:66945:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784188965.269909:0:66945:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dc05ec0c600/0xcc1762b626f8a46b lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784188965.269915:0:66945:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc05ec0c600/0xcc1762b626f8a46b lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1784188965.269928:0:66945:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000014f94a6b reply state 000000002c590e27 transno 94489280514 ns: mdt-lustre-MDT0000_UUID lock: ffff9dc05ec0de00/0xcc1762b626f8a472 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x21e7de2f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784188965.269937:0:66945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc05ec0de00/0xcc1762b626f8a472 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x21e7de2f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784188965.269944:0:66945:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x21e7de2f (ffff9dc047db8700) 00010000:00010000:3.0:1784188965.269950:0:66945:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1784188965.269953:0:66945:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1784188965.270043:0:66945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc080f6ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+7:64835:x1870854436224512:12345-192.168.203.12@tcp:36:mcreate.0 Request processed in 827us (987us total) trans 94489280514 rc 0/0 00000100:00100000:3.0:1784188965.270050:0:66945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1012 00000100:00100000:2.0:1784188965.302426:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1784188965.302933:0:66171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436224640 00000100:00100000:0.0:1784188965.302943:0:66171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436224640 00000100:00100000:0.0:1784188965.302999:0:66171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1013 00000100:00100000:0.0:1784188965.303009:0:66171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc080f6aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+7:64838:x1870854436224640:12345-192.168.203.12@tcp:101:rm.0 00010000:00010000:0.0:1784188965.303033:0:66171:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784188965.303060:0:66171:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc070147600/0xcc1762b626f8a479 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbfc5de7fe6c3c9d expref: -99 pid: 66171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784188965.303147:0:66171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc070146800/0xcc1762b626f8a480 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784188965.303160:0:66171:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc070146800/0xcc1762b626f8a480 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784188965.303171:0:66171:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc070146800/0xcc1762b626f8a480 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784188965.303212:0:66171:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1784188965.303216:0:66171:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 8 00000004:00010000:0.0:1784188965.303238:0:66171:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9dc070146800/0xcc1762b626f8a480 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784188965.303266:0:66171:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc070147600/0xcc1762b626f8a479 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c3c9d expref: 9 pid: 66171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784188965.303285:0:66171:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc070146800/0xcc1762b626f8a480 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c3c9d expref: 8 pid: 66171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784188965.303293:0:66171:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9dc07b032e00) 00010000:00010000:0.0:1784188965.303296:0:66171:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1784188965.303303:0:66171:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc070146800, rc 0) 00000100:00100000:0.0:1784188965.303372:0:66171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc080f6aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+8:64838:x1870854436224640:12345-192.168.203.12@tcp:101:rm.0 Request processed in 364us (955us total) trans 0 rc 0/0 00000100:00100000:0.0:1784188965.303380:0:66171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1013 00000100:00100000:1.0:1784188965.323012:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1784188965.323087:0:68287:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436224768 00000100:00100000:0.0:1784188965.323097:0:68287:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436224768 00000100:00100000:0.0:1784188965.323165:0:68287:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1014 00000100:00100000:0.0:1784188965.323174:0:68287:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf4859ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+8:64838:x1870854436224768:12345-192.168.203.12@tcp:101:rm.0 00010000:00010000:0.0:1784188965.323192:0:68287:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784188965.323211:0:68287:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc070147600/0xcc1762b626f8a487 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbfc5de7fe6c3ca4 expref: -99 pid: 68287 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784188965.323274:0:68287:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc070147800/0xcc1762b626f8a48e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784188965.323287:0:68287:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc070147800/0xcc1762b626f8a48e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784188965.323299:0:68287:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc070147800/0xcc1762b626f8a48e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784188965.323310:0:68287:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc070147e00/0xcc1762b626f8a495 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x21e7de2f bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784188965.323522:0:68287:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc070147e00/0xcc1762b626f8a495 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x21e7de2f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784188965.323533:0:68287:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc070147e00/0xcc1762b626f8a495 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x21e7de2f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784188965.323607:0:68287:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc070147000/0xcc1762b626f8a49c lrc: 3/1,0 mode: --/PR res: [0x20000a811:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784188965.323616:0:68287:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc070147000/0xcc1762b626f8a49c lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0x1:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784188965.323623:0:68287:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc070147000/0xcc1762b626f8a49c lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0x1:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784188965.323673:0:68287:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000a811:0x1:0x0]: returning size 0 00000004:00200000:0.0:1784188965.323677:0:68287:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 8 00000004:00010000:0.0:1784188965.323706:0:68287:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9dc070147000/0xcc1762b626f8a49c lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0x1:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784188965.323718:0:68287:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc070147000/0xcc1762b626f8a49c lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0x1:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784188965.323728:0:68287:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc070147800/0xcc1762b626f8a48e lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784188965.323734:0:68287:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc070147800/0xcc1762b626f8a48e lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784188965.323740:0:68287:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc070147800/0xcc1762b626f8a48e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784188965.323745:0:68287:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dc070147800/0xcc1762b626f8a48e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784188965.323751:0:68287:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc070147800 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:0.0:1784188965.323755:0:68287:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc070147800/0xcc1762b626f8a48e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784188965.323762:0:68287:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc070147800/0xcc1762b626f8a48e lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784188965.323773:0:68287:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9dc07b032e00) 00010000:00010000:0.0:1784188965.323776:0:68287:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784188965.323780:0:68287:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dc070147800/0xcc1762b626f8a48e lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784188965.323798:0:68287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc070147800/0xcc1762b626f8a48e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784188965.323809:0:68287:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc070147e00/0xcc1762b626f8a495 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x21e7de2f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784188965.323815:0:68287:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc070147e00/0xcc1762b626f8a495 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x21e7de2f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784188965.323819:0:68287:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dc070147e00/0xcc1762b626f8a495 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x21e7de2f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784188965.323824:0:68287:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc070147e00 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:0.0:1784188965.323827:0:68287:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc070147e00/0xcc1762b626f8a495 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x21e7de2f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784188965.323832:0:68287:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc070147e00/0xcc1762b626f8a495 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x21e7de2f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784188965.323840:0:68287:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x21e7de2f (ffff9dc047db8700) 00010000:00010000:0.0:1784188965.323843:0:68287:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784188965.323845:0:68287:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dc070147e00/0xcc1762b626f8a495 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x21e7de2f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784188965.323851:0:68287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc070147e00/0xcc1762b626f8a495 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x21e7de2f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784188965.323876:0:68287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc070147600/0xcc1762b626f8a487 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c3ca4 expref: 10 pid: 68287 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784188965.323901:0:68287:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc070147000/0xcc1762b626f8a49c lrc: 3/0,0 mode: PR/PR res: [0x20000a811:0x1:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c3ca4 expref: 9 pid: 68287 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784188965.323908:0:68287:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x1:0x0].0x0 (ffff9dc07b032400) 00010000:00010000:0.0:1784188965.323910:0:68287:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1784188965.323912:0:68287:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc070147000, rc 0) 00000100:00100000:0.0:1784188965.323974:0:68287:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf4859ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+9:64838:x1870854436224768:12345-192.168.203.12@tcp:101:rm.0 Request processed in 800us (968us total) trans 0 rc 0/0 00000100:00100000:0.0:1784188965.323981:0:68287:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1014 00000100:00100000:0.0:1784188965.327303:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1784188965.327497:0:66169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436225024 00000100:00100000:2.0:1784188965.327506:0:66169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436225024 00000100:00100000:2.0:1784188965.327564:0:66169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1015 00000100:00100000:2.0:1784188965.327574:0:66169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf4262e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+9:64838:x1870854436225024:12345-192.168.203.12@tcp:36:rm.0 00010000:00010000:2.0:1784188965.327626:0:66169:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1784188965.327651:0:66169:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc070147000/0xcc1762b626f8a49c lrc: 0/0,0 mode: --/PR res: [0x20000a811:0x1:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c3ca4 expref: 9 pid: 68287 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784188965.327670:0:66169:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x1:0x0].0x0 (ffff9dc07b032400) 00010000:00010000:2.0:1784188965.327686:0:66169:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc070146800/0xcc1762b626f8a480 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c3c9d expref: 8 pid: 66171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784188965.327706:0:66169:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9dc07b032e00) 00010000:00010000:2.0:1784188965.327726:0:66169:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1784188965.327750:0:66169:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0755a4000/0xcc1762b626f8a4a3 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784188965.327763:0:66169:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0755a4000/0xcc1762b626f8a4a3 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784188965.327775:0:66169:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0755a4000/0xcc1762b626f8a4a3 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784188965.327797:0:66169:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0755a5c00/0xcc1762b626f8a4aa lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x21e7de2f bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784188965.327804:0:66169:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0755a5c00/0xcc1762b626f8a4aa lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x21e7de2f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784188965.327958:0:66169:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0755a5c00/0xcc1762b626f8a4aa lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x21e7de2f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784188965.328039:0:66169:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0755a5800/0xcc1762b626f8a4b1 lrc: 3/0,1 mode: --/EX res: [0x20000a811:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784188965.328048:0:66169:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0755a5800/0xcc1762b626f8a4b1 lrc: 3/0,1 mode: EX/EX res: [0x20000a811:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784188965.328055:0:66169:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0755a5800/0xcc1762b626f8a4b1 lrc: 3/0,1 mode: EX/EX res: [0x20000a811:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784188965.328240:0:66169:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0755a4c00/0xcc1762b626f8a4b8 lrc: 3/0,1 mode: --/PW res: [0x20000a811:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784188965.328249:0:66169:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0755a4c00/0xcc1762b626f8a4b8 lrc: 3/0,1 mode: PW/PW res: [0x20000a811:0x1:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784188965.328269:0:66169:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0755a4c00/0xcc1762b626f8a4b8 lrc: 3/0,1 mode: PW/PW res: [0x20000a811:0x1:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784188965.328276:0:66169:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0755a4c00/0xcc1762b626f8a4b8 lrc: 4/0,1 mode: PW/PW res: [0x20000a811:0x1:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784188965.328282:0:66169:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0755a4c00/0xcc1762b626f8a4b8 lrc: 4/0,1 mode: PW/PW res: [0x20000a811:0x1:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784188965.328288:0:66169:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0755a4c00/0xcc1762b626f8a4b8 lrc: 3/0,0 mode: PW/PW res: [0x20000a811:0x1:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784188965.328389:0:66169:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1784188965.328411:0:66169:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0755a5800/0xcc1762b626f8a4b1 lrc: 3/0,1 mode: EX/EX res: [0x20000a811:0x1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784188965.328417:0:66169:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0755a5800/0xcc1762b626f8a4b1 lrc: 2/0,0 mode: EX/EX res: [0x20000a811:0x1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784188965.328423:0:66169:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0755a5800/0xcc1762b626f8a4b1 lrc: 3/0,0 mode: EX/EX res: [0x20000a811:0x1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784188965.328428:0:66169:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc0755a5800 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:2.0:1784188965.328431:0:66169:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0755a5800/0xcc1762b626f8a4b1 lrc: 3/0,0 mode: EX/EX res: [0x20000a811:0x1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784188965.328439:0:66169:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0755a5800/0xcc1762b626f8a4b1 lrc: 4/0,0 mode: EX/EX res: [0x20000a811:0x1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784188965.328447:0:66169:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x1:0x0].0x0 (ffff9dbf47406a00) 00010000:00010000:2.0:1784188965.328450:0:66169:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1784188965.328462:0:66169:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0755a5800/0xcc1762b626f8a4b1 lrc: 2/0,0 mode: --/EX res: [0x20000a811:0x1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784188965.328467:0:66169:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0755a5800/0xcc1762b626f8a4b1 lrc: 0/0,0 mode: --/EX res: [0x20000a811:0x1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784188965.328484:0:66169:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0755a4000/0xcc1762b626f8a4a3 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784188965.328490:0:66169:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0755a4000/0xcc1762b626f8a4a3 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784188965.328496:0:66169:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0755a4000/0xcc1762b626f8a4a3 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784188965.328502:0:66169:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0755a4000/0xcc1762b626f8a4a3 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784188965.328507:0:66169:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc0755a4000 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:2.0:1784188965.328509:0:66169:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0755a4000/0xcc1762b626f8a4a3 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784188965.328515:0:66169:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0755a4000/0xcc1762b626f8a4a3 lrc: 5/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784188965.328522:0:66169:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9dbf47406400) 00010000:00010000:2.0:1784188965.328524:0:66169:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784188965.328526:0:66169:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0755a4000/0xcc1762b626f8a4a3 lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784188965.328532:0:66169:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0755a4000/0xcc1762b626f8a4a3 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1784188965.328546:0:66169:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000004a1898b1 reply state 00000000a3f9f0cf transno 94489280515 ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0755a5c00/0xcc1762b626f8a4aa lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x21e7de2f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784188965.328562:0:66169:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0755a5c00/0xcc1762b626f8a4aa lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x21e7de2f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784188965.328568:0:66169:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x21e7de2f (ffff9dc047db8700) 00010000:00010000:2.0:1784188965.328570:0:66169:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1784188965.328573:0:66169:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1784188965.328644:0:66169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf4262e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+9:64838:x1870854436225024:12345-192.168.203.12@tcp:36:rm.0 Request processed in 1071us (1348us total) trans 94489280515 rc 0/0 00000100:00100000:2.0:1784188965.328653:0:66169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1015 00010000:00010000:3.0:1784188965.330072:0:7454:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784188965.330084:0:7454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0755a4c00/0xcc1762b626f8a4b8 lrc: 2/0,0 mode: PW/PW res: [0x20000a811:0x1:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784188965.330094:0:7454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc0755a4c00 already unused, calling callback (ffffffffc0b2e230) 00010000:00010000:3.0:1784188965.330098:0:7454:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0755a4c00/0xcc1762b626f8a4b8 lrc: 2/0,0 mode: PW/PW res: [0x20000a811:0x1:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784188965.330105:0:7454:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0755a4c00/0xcc1762b626f8a4b8 lrc: 3/0,0 mode: PW/PW res: [0x20000a811:0x1:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784188965.330118:0:7454:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x1:0x0].0x0 (ffff9dbf47406a00) 00010000:00010000:3.0:1784188965.330120:0:7454:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1784188965.330124:0:7454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0755a4c00/0xcc1762b626f8a4b8 lrc: 1/0,0 mode: --/PW res: [0x20000a811:0x1:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784188965.330128:0:7454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0755a4c00/0xcc1762b626f8a4b8 lrc: 0/0,0 mode: --/PW res: [0x20000a811:0x1:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784188965.330145:0:7454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784188965.330147:0:7454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784188965.330148:0:7454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784188965.615509:0:26173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784188965.940535:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc07b5b3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1870854458007296:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1784188965.940617:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784188965.940817:0:23826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458007296 00000100:00100000:3.0:1784188965.940826:0:23826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458007296 00000100:00100000:3.0:1784188965.940885:0:23826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3680 00000100:00100000:3.0:1784188965.940893:0:23826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf4859aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3642:x1870854458007296:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1784188965.940946:0:23826:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445576704 avail 1299337216 00000100:00100000:3.0:1784188965.943240:0:23826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf4859aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3642:x1870854458007296:12345-0@lo:41:osp-pre-1-0.0 Request processed in 2338us (2613us total) trans 0 rc 0/0 00000100:00100000:3.0:1784188965.943255:0:23826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3680 00000100:00100000:1.0:1784188965.944915:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc07b5b3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1870854458007296:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1784188966.641247:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784188966.959673:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc05f02fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1870854458007424:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1784188966.960162:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1784188966.960183:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc07b5b3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1870854458007552:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1784188966.961096:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784188966.961179:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784188966.961225:0:9466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458007552 00000100:00100000:3.0:1784188966.961630:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458007424 00000100:00100000:3.0:1784188966.961642:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458007424 00000100:00100000:3.0:1784188966.961729:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1820 00000100:00100000:3.0:1784188966.961740:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc05ed98000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1870854458007424:12345-0@lo:13:osp-pre-1-1.0 00000100:00080000:1.0:1784188966.961850:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1784188966.962014:0:9466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458007552 00000100:00100000:0.0:1784188966.962086:0:9466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1821 00000100:00100000:0.0:1784188966.962094:0:9466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc05ed9b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1870854458007552:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1784188966.962122:0:9466:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8652352 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1784188966.962207:0:9466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc05ed9b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1870854458007552:12345-0@lo:13:osp-pre-0-1.0 Request processed in 114us (1115us total) trans 0 rc 0/0 00000100:00100000:0.0:1784188966.962215:0:9466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1821 00000100:00100000:0.0:1784188966.962285:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc07b5b3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1870854458007552:0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1784188966.964366:0:8432:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8652352 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1784188966.964654:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc05ed98000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1870854458007424:12345-0@lo:13:osp-pre-1-1.0 Request processed in 2909us (3468us total) trans 0 rc 0/0 00000100:00100000:3.0:1784188966.964668:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1820 00000100:00080000:1.0:1784188966.964900:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1784188966.965658:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc05f02fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1870854458007424:0@lo:13:osp-pre-1-1.0 00010000:00010000:0.0:1784188967.665735:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784188967.984592:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf4859b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3640:1870854458008064:0@lo:400:kworker.0 00000100:00100000:1.0:1784188967.984698:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784188967.984741:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf48598e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1870854458008576:0@lo:400:kworker.0 00000100:00100000:1.0:1784188967.984768:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784188967.984788:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf48598380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1870854458009088:0@lo:400:kworker.0 00000100:00100000:1.0:1784188967.984833:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784188967.984865:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [1->0] 00000100:00100000:1.0:1784188967.984871:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf48598a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bd553d0d-03e2-4233-b06b-b55bbfa2b954:3640:1870854458007680:0@lo:400:kworker.0 00000100:00100000:1.0:1784188967.984904:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784188967.984935:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf4859b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3640:1870854458008192:0@lo:400:kworker.0 00000100:00100000:1.0:1784188967.984958:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784188967.984977:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf48599f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3640:1870854458008704:0@lo:400:kworker.0 00000100:00100000:1.0:1784188967.985000:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784188967.985017:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf48599880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3640:1870854458009216:0@lo:400:kworker.0 00000100:00100000:1.0:1784188967.985039:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784188967.985084:0:66170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458008064 00000100:00100000:1.0:1784188967.985092:0:66170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458008064 00000100:00100000:1.0:1784188967.985153:0:66170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458008192 00000100:00100000:1.0:1784188967.985157:0:66170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458008192 00000100:00100000:1.0:1784188967.985171:0:66170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458008704 00000100:00100000:1.0:1784188967.985174:0:66170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458008704 00000100:00100000:1.0:1784188967.985186:0:66170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458009216 00000100:00100000:1.0:1784188967.985188:0:66170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458009216 00000100:00100000:1.0:1784188967.985203:0:66170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 963 00000100:00100000:1.0:1784188967.985212:0:66170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf48599c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3640:x1870854458008064:12345-0@lo:400:kworker.0 00010000:00000080:1.0:1784188967.985241:0:66170:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9dbf48599c00 x1870854458008064/t0(0) o400->lustre-MDT0000-lwp-OST0001_UUID@0@lo:158/0 lens 224/224 e 0 to 0 dl 1784188978 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784188967.985282:0:66170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf48599c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3640:x1870854458008064:12345-0@lo:400:kworker.0 Request processed in 70us (585us total) trans 0 rc 0/0 00000100:00100000:1.0:1784188967.985290:0:66170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 963 00000100:00100000:1.0:1784188967.985309:0:66170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 964 00000100:00100000:1.0:1784188967.985314:0:66170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf45124380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1870854458008192:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784188967.985367:0:66170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf45124380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1870854458008192:12345-0@lo:400:kworker.0 Request processed in 52us (407us total) trans 0 rc 0/0 00000100:00100000:1.0:1784188967.985373:0:66170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 964 00000100:00100000:1.0:1784188967.985384:0:66170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 965 00000100:00100000:1.0:1784188967.985390:0:66170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf45125880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1870854458008704:12345-0@lo:400:kworker.0 00010000:00000080:1.0:1784188967.985400:0:66170:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9dbf45125880 x1870854458008704/t0(0) o400->lustre-MDT0000-lwp-MDT0001_UUID@0@lo:158/0 lens 224/224 e 0 to 0 dl 1784188978 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784188967.985423:0:66170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf45125880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1870854458008704:12345-0@lo:400:kworker.0 Request processed in 33us (422us total) trans 0 rc 0/0 00000100:00100000:1.0:1784188967.985428:0:66170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 965 00000100:00100000:1.0:1784188967.985447:0:66170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 966 00000100:00100000:1.0:1784188967.985453:0:66170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf45125c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1870854458009216:12345-0@lo:400:kworker.0 00010000:00000080:1.0:1784188967.985465:0:66170:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9dbf45125c00 x1870854458009216/t0(0) o400->lustre-MDT0000-lwp-MDT0000_UUID@0@lo:158/0 lens 224/224 e 0 to 0 dl 1784188978 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784188967.985490:0:66170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf45125c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1870854458009216:12345-0@lo:400:kworker.0 Request processed in 37us (450us total) trans 0 rc 0/0 00000100:00100000:1.0:1784188967.985496:0:66170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 966 00000100:00100000:1.0:1784188967.985525:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458008576 00000100:00100000:1.0:1784188967.985529:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458008576 00000100:00100000:1.0:1784188967.985557:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458009088 00000100:00100000:1.0:1784188967.985560:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458009088 00000100:00100000:1.0:1784188967.985586:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2277 00000100:00100000:1.0:1784188967.985593:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf4859b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1870854458008576:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784188967.985625:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf4859b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1870854458008576:12345-0@lo:400:kworker.0 Request processed in 33us (856us total) trans 0 rc 0/0 00000100:00100000:1.0:1784188967.985632:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2277 00000100:00100000:1.0:1784188967.985644:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2278 00000100:00100000:1.0:1784188967.985650:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf45125500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1870854458009088:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784188967.987442:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf45125500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1870854458009088:12345-0@lo:400:kworker.0 Request processed in 1776us (2594us total) trans 0 rc 0/0 00000100:00100000:1.0:1784188967.987461:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2278 00000100:00100000:1.0:1784188967.987519:0:83231:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458007680 00000100:00100000:1.0:1784188967.987528:0:83231:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458007680 00000100:00100000:1.0:1784188967.987597:0:83231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1784188967.987606:0:83231:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc075109c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:bd553d0d-03e2-4233-b06b-b55bbfa2b954+24:3640:x1870854458007680:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784188967.987698:0:83231:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc075109c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:bd553d0d-03e2-4233-b06b-b55bbfa2b954+24:3640:x1870854458007680:12345-0@lo:400:kworker.0 Request processed in 93us (2793us total) trans 0 rc 0/0 00000100:00100000:1.0:1784188967.987718:0:83231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00080000:1.0:1784188967.987769:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1784188967.987777:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1784188967.987780:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1784188967.987830:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf48598a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bd553d0d-03e2-4233-b06b-b55bbfa2b954:3640:1870854458007680:0@lo:400:kworker.0 00000100:00100000:1.0:1784188967.987850:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf4859b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3640:1870854458008192:0@lo:400:kworker.0 00000100:00100000:1.0:1784188967.987863:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf48599f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3640:1870854458008704:0@lo:400:kworker.0 00000100:00100000:1.0:1784188967.987876:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf48599880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3640:1870854458009216:0@lo:400:kworker.0 00000100:00100000:1.0:1784188967.987888:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf4859b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3640:1870854458008064:0@lo:400:kworker.0 00000100:00100000:1.0:1784188967.987901:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf48598e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1870854458008576:0@lo:400:kworker.0 00000100:00100000:1.0:1784188967.987912:0:3640:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294968951 gen 2 00000004:00080000:1.0:1784188967.987919:0:3640:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9dc07b6e5c00, transno 4294968951 00000100:00100000:1.0:1784188967.987933:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf48598380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1870854458009088:0@lo:400:kworker.0 00000100:00100000:1.0:1784188967.988452:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf4859a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3643:1870854458007936:0@lo:400:kworker.0 00000100:00100000:1.0:1784188967.988510:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784188967.991803:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf4859bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1870854458008448:0@lo:400:kworker.0 00000100:00100000:1.0:1784188967.991894:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784188967.991931:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf48599500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1870854458008960:0@lo:400:kworker.0 00000100:00100000:1.0:1784188967.991957:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784188967.991990:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:1.0:1784188967.991997:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf48598700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3643:1870854458007808:0@lo:400:kworker.0 00000100:00100000:1.0:1784188967.992024:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784188967.994656:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf4859a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1870854458008320:0@lo:400:kworker.0 00000100:00100000:1.0:1784188967.994751:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784188967.994783:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf48598000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1870854458008832:0@lo:400:kworker.0 00000100:00100000:1.0:1784188967.994806:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784188967.994864:0:26166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458008448 00000100:00100000:1.0:1784188967.994874:0:26166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458008448 00000100:00100000:1.0:1784188967.994940:0:26166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458008960 00000100:00100000:1.0:1784188967.994944:0:26166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458008960 00000100:00100000:1.0:1784188967.994982:0:26166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2279 00000100:00100000:1.0:1784188967.994991:0:26166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf45125180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+5:3643:x1870854458008448:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784188967.995059:0:26166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf45125180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+5:3643:x1870854458008448:12345-0@lo:400:kworker.0 Request processed in 69us (3166us total) trans 0 rc 0/0 00000100:00100000:1.0:1784188967.995067:0:26166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2279 00000100:00100000:1.0:1784188967.995086:0:26166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2280 00000100:00100000:1.0:1784188967.995092:0:26166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf45126d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+5:3643:x1870854458008960:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784188967.995122:0:26166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf45126d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+5:3643:x1870854458008960:12345-0@lo:400:kworker.0 Request processed in 29us (3162us total) trans 0 rc 0/0 00000100:00100000:1.0:1784188967.995128:0:26166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2280 00000100:00100000:1.0:1784188967.995153:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458008320 00000100:00100000:1.0:1784188967.995156:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458008320 00000100:00100000:1.0:1784188967.995185:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458008832 00000100:00100000:1.0:1784188967.995188:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458008832 00000100:00100000:1.0:1784188967.995206:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3681 00000100:00100000:1.0:1784188967.995215:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf45124a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3643:x1870854458008320:12345-0@lo:400:kworker.0 00010000:00000080:1.0:1784188967.995233:0:8439:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9dbf45124a80 x1870854458008320/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:158/0 lens 224/224 e 0 to 0 dl 1784188978 ref 1 fl Interpret:/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784188967.995262:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf45124a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3643:x1870854458008320:12345-0@lo:400:kworker.0 Request processed in 50us (512us total) trans 0 rc 0/0 00000100:00100000:1.0:1784188967.995280:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3681 00000100:00100000:1.0:1784188967.995294:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3682 00000100:00100000:1.0:1784188967.995299:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf45124700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3643:x1870854458008832:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784188967.995360:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf45124700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3643:x1870854458008832:12345-0@lo:400:kworker.0 Request processed in 60us (552us total) trans 0 rc 0/0 00000100:00100000:1.0:1784188967.995365:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3682 00000100:00080000:1.0:1784188967.995393:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1784188967.995431:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf4859a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1870854458008320:0@lo:400:kworker.0 00000100:00100000:1.0:1784188967.995443:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf48598000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1870854458008832:0@lo:400:kworker.0 00000100:00100000:1.0:1784188967.995456:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf4859bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1870854458008448:0@lo:400:kworker.0 00000100:00100000:1.0:1784188967.995467:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf48599500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1870854458008960:0@lo:400:kworker.0 00000100:00100000:2.0:1784188967.996564:0:66170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458007936 00000100:00100000:2.0:1784188967.996579:0:66170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458007936 00000100:00100000:2.0:1784188967.996659:0:66170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458007808 00000100:00100000:2.0:1784188967.996663:0:66170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458007808 00000100:00100000:2.0:1784188967.996706:0:66170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 967 00000100:00100000:2.0:1784188967.996716:0:66170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf45127480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1870854458007936:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784188967.996936:0:66170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf45127480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1870854458007936:12345-0@lo:400:kworker.0 Request processed in 221us (8425us total) trans 0 rc 0/0 00000100:00100000:2.0:1784188967.996945:0:66170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 967 00000100:00100000:2.0:1784188967.996965:0:66170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 968 00000100:00100000:2.0:1784188967.996972:0:66170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf45126a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1870854458007808:12345-0@lo:400:kworker.0 00010000:00000080:2.0:1784188967.996987:0:66170:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9dbf45126a00 x1870854458007808/t0(0) o400->lustre-MDT0000-lwp-OST0000_UUID@0@lo:158/0 lens 224/224 e 0 to 0 dl 1784188978 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784188967.997018:0:66170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf45126a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1870854458007808:12345-0@lo:400:kworker.0 Request processed in 47us (4993us total) trans 0 rc 0/0 00000100:00100000:2.0:1784188967.997025:0:66170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 968 00000100:00100000:2.0:1784188967.997097:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf48598700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3643:1870854458007808:0@lo:400:kworker.0 00000100:00100000:2.0:1784188967.997123:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf4859a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3643:1870854458007936:0@lo:400:kworker.0 00000100:00080000:1.0:1784188967.997357:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1784188967.997361:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1784188968.231871:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1784188968.231911:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1784188968.231979:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1784188968.231997:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1784188968.232049:0:83228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436225152 00000100:00100000:0.0:1784188968.232059:0:83228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436225152 00000100:00100000:0.0:1784188968.232126:0:83228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 157 00000100:00100000:0.0:1784188968.232136:0:83228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc075109450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9957a2dc-fd88-4a91-bca3-e2b7f365ab0c+10:2397:x1870854436225152:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:0.0:1784188968.232203:0:83228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc075109450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9957a2dc-fd88-4a91-bca3-e2b7f365ab0c+10:2397:x1870854436225152:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 69us (341us total) trans 0 rc 0/0 00000100:00100000:0.0:1784188968.232212:0:83228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 157 00000100:00100000:3.0:1784188968.235506:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1784188968.236748:0:26223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436225664 00000100:00100000:3.0:1784188968.236761:0:26223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436225664 00000100:00100000:2.0:1784188968.237153:0:66169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436225408 00000100:00100000:2.0:1784188968.237160:0:66169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436225408 00000100:00100000:3.0:1784188968.237226:0:26223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436225536 00000100:00100000:3.0:1784188968.237232:0:26223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436225536 00000100:00100000:3.0:1784188968.237263:0:26223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 2281 00000100:00100000:3.0:1784188968.237273:0:26223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc075a95500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+5:2397:x1870854436225664:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:2.0:1784188968.237440:0:66169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436225280 00000100:00100000:2.0:1784188968.237445:0:66169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436225280 00000100:00100000:2.0:1784188968.237475:0:66169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 969 00000100:00100000:3.0:1784188968.237487:0:26223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc075a95500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+5:2397:x1870854436225664:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 211us (5503us total) trans 0 rc 0/0 00000100:00100000:2.0:1784188968.237487:0:66169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc05f02fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+6:2397:x1870854436225408:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:3.0:1784188968.237515:0:26223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 2281 00000100:00100000:2.0:1784188968.237525:0:66169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc05f02fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+6:2397:x1870854436225408:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 41us (5611us total) trans 0 rc 0/0 00000100:00100000:2.0:1784188968.237534:0:66169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 969 00000100:00100000:3.0:1784188968.237538:0:26223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 2282 00000100:00100000:3.0:1784188968.237554:0:26223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc080e7c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+5:2397:x1870854436225536:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:2.0:1784188968.237560:0:66169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 970 00000100:00100000:2.0:1784188968.237569:0:66169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc07ab98380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+9:2397:x1870854436225280:12345-192.168.203.12@tcp:400:kworker.0 00010000:00000080:2.0:1784188968.237589:0:66169:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9dc07ab98380 x1870854436225280/t0(0) o400->b90fcc1c-0e69-42a4-a116-a71fec7aeb78@192.168.203.12@tcp:159/0 lens 224/224 e 0 to 0 dl 1784188979 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784188968.237598:0:26223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc080e7c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+5:2397:x1870854436225536:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 45us (2099us total) trans 0 rc 0/0 00000100:00100000:3.0:1784188968.237608:0:26223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 2282 00000100:00100000:2.0:1784188968.237626:0:66169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc07ab98380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+9:2397:x1870854436225280:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 57us (5626us total) trans 0 rc 0/0 00000100:00100000:2.0:1784188968.237634:0:66169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 970 00000100:00080000:3.0:1784188968.237639:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1784188968.237645:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1784188968.237648:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1784188968.237650:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1784188968.495445:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1784188968.495465:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf45126300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1870854458009344:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1784188968.495529:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784188968.495636:0:9466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458009344 00000100:00100000:0.0:1784188968.495642:0:9466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458009344 00000100:00100000:0.0:1784188968.495710:0:9466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1822 00000100:00100000:0.0:1784188968.495720:0:9466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf45127800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1870854458009344:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1784188968.495744:0:9466:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8652352 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1784188968.495757:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1784188968.495770:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc080f68a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1870854458009472:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1784188968.495793:0:9466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf45127800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1870854458009344:12345-0@lo:13:osp-pre-0-0.0 Request processed in 73us (263us total) trans 0 rc 0/0 00000100:00100000:0.0:1784188968.495801:0:9466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1822 00000100:00100000:2.0:1784188968.495807:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784188968.496709:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf45126300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1870854458009344:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1784188968.496784:0:9466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458009472 00000100:00100000:0.0:1784188968.496789:0:9466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458009472 00000100:00100000:0.0:1784188968.496812:0:9466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1823 00000100:00100000:0.0:1784188968.496818:0:9466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc080f68700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1870854458009472:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1784188968.496835:0:9466:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8652352 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1784188968.496990:0:9466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc080f68700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1870854458009472:12345-0@lo:13:osp-pre-1-0.0 Request processed in 170us (1182us total) trans 0 rc 0/0 00000100:00100000:0.0:1784188968.496998:0:9466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1823 00000100:00100000:3.0:1784188968.497204:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc080f68a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1870854458009472:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1784188968.688220:0:7454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784188969.009221:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc07b5b3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1870854458009600:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1784188969.009349:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784188969.009575:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458009600 00000100:00100000:2.0:1784188969.009585:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458009600 00000100:00100000:2.0:1784188969.009741:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3683 00000100:00100000:2.0:1784188969.009776:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc080f6a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3640:x1870854458009600:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1784188969.009826:0:8439:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445289984 avail 1299050496 00010000:00000080:2.0:1784188969.009847:0:8439:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9dc080f6a300 x1870854458009600/t0(0) o41->lustre-MDT0001-mdtlov_UUID@0@lo:160/0 lens 224/368 e 0 to 0 dl 1784188980 ref 1 fl Interpret:/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784188969.009903:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc080f6a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3640:x1870854458009600:12345-0@lo:41:osp-pre-0-1.0 Request processed in 129us (555us total) trans 0 rc 0/0 00000100:00100000:2.0:1784188969.009911:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3683 00000100:00100000:2.0:1784188969.009968:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc07b5b3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1870854458009600:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1784188969.714401:0:26173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1784188970.543689:0:83222:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 94489280515 is committed 00010000:00010000:0.0:1784188970.544396:0:3626:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc05ec0de00/0xcc1762b626f8a472 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x21e7de2f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784188970.544410:0:3626:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc05ec0de00/0xcc1762b626f8a472 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x21e7de2f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784188970.544426:0:3626:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dc05ec0de00/0xcc1762b626f8a472 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x21e7de2f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784188970.544433:0:3626:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc05ec0de00 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:0.0:1784188970.544438:0:3626:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc05ec0de00/0xcc1762b626f8a472 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x21e7de2f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784188970.544446:0:3626:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc05ec0de00/0xcc1762b626f8a472 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x21e7de2f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784188970.544464:0:3626:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x21e7de2f (ffff9dc047db8700) 00010000:00010000:0.0:1784188970.544467:0:3626:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784188970.544471:0:3626:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dc05ec0de00/0xcc1762b626f8a472 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x21e7de2f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784188970.544478:0:3626:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc05ec0de00/0xcc1762b626f8a472 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x21e7de2f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784188970.544496:0:3626:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0755a5c00/0xcc1762b626f8a4aa lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x21e7de2f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784188970.544503:0:3626:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0755a5c00/0xcc1762b626f8a4aa lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x21e7de2f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784188970.544509:0:3626:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0755a5c00/0xcc1762b626f8a4aa lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x21e7de2f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784188970.544514:0:3626:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc0755a5c00 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:0.0:1784188970.544517:0:3626:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0755a5c00/0xcc1762b626f8a4aa lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x21e7de2f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784188970.544535:0:3626:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0755a5c00/0xcc1762b626f8a4aa lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x21e7de2f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784188970.544544:0:3626:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x21e7de2f (ffff9dc047db8700) 00010000:00010000:0.0:1784188970.544546:0:3626:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784188970.544549:0:3626:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0755a5c00/0xcc1762b626f8a4aa lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x21e7de2f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784188970.544554:0:3626:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0755a5c00/0xcc1762b626f8a4aa lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x21e7de2f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784188970.736797:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1784188971.029729:0:84361:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: mds1 REPLAY BARRIER on lustre-MDT0000 00000100:00100000:2.0:1784188971.056510:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1784188971.056534:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc07b5b3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1870854458009728:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1784188971.056601:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784188971.057185:0:23826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458009728 00000100:00100000:3.0:1784188971.057194:0:23826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458009728 00000100:00100000:3.0:1784188971.057360:0:23826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3684 00000100:00100000:3.0:1784188971.057369:0:23826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc080f6b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3640:x1870854458009728:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1784188971.057400:0:23826:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445576704 avail 1299337216 00000100:00100000:3.0:1784188971.057459:0:23826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc080f6b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3640:x1870854458009728:12345-0@lo:41:osp-pre-1-0.0 Request processed in 90us (857us total) trans 0 rc 0/0 00000100:00100000:3.0:1784188971.057465:0:23826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3684 00000100:00100000:1.0:1784188971.057521:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc07b5b3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1870854458009728:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1784188971.109536:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1784188971.109619:0:66945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436225792 00000100:00100000:3.0:1784188971.109629:0:66945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436225792 00000100:00100000:3.0:1784188971.109755:0:66945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1016 00000100:00100000:3.0:1784188971.109766:0:66945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf45127100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+5:64905:x1870854436225792:12345-192.168.203.12@tcp:101:lfs.0 00010000:00010000:3.0:1784188971.109787:0:66945:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784188971.109809:0:66945:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc05ec0c000/0xcc1762b626f8a4bf lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbfc5de7fe6c3cab expref: -99 pid: 66945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784188971.109871:0:66945:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc05ec0c600/0xcc1762b626f8a4c6 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784188971.109884:0:66945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc05ec0c600/0xcc1762b626f8a4c6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784188971.109897:0:66945:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc05ec0c600/0xcc1762b626f8a4c6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784188971.109940:0:66945:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1784188971.109944:0:66945:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 8 00000004:00010000:3.0:1784188971.109965:0:66945:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9dc05ec0c600/0xcc1762b626f8a4c6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784188971.109988:0:66945:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc05ec0c000/0xcc1762b626f8a4bf lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c3cab expref: 7 pid: 66945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784188971.110005:0:66945:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc05ec0c600/0xcc1762b626f8a4c6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c3cab expref: 6 pid: 66945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784188971.110013:0:66945:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9dc051574c00) 00010000:00010000:3.0:1784188971.110016:0:66945:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1784188971.110020:0:66945:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc05ec0c600, rc 0) 00010000:00000080:3.0:1784188971.110027:0:66945:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9dbf45127100 x1870854436225792/t0(0) o101->b90fcc1c-0e69-42a4-a116-a71fec7aeb78@192.168.203.12@tcp:162/0 lens 576/688 e 0 to 0 dl 1784188982 ref 1 fl Interpret:/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1784188971.110084:0:66945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf45127100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+6:64905:x1870854436225792:12345-192.168.203.12@tcp:101:lfs.0 Request processed in 321us (558us total) trans 0 rc 0/0 00000100:00100000:3.0:1784188971.110091:0:66945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1016 00000100:00080000:1.0:1784188971.112307:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1784188971.118072:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1784188971.118142:0:66171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436225920 00000100:00100000:3.0:1784188971.118151:0:66171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436225920 00000100:00100000:3.0:1784188971.118221:0:66171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1017 00000100:00100000:3.0:1784188971.118231:0:66171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc080f6b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+6:64905:x1870854436225920:12345-192.168.203.12@tcp:101:lfs.0 00010000:00010000:3.0:1784188971.118253:0:66171:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784188971.118275:0:66171:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc05ec0dc00/0xcc1762b626f8a4cd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbfc5de7fe6c3cb2 expref: -99 pid: 66171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784188971.118577:0:66171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc05ec0d600/0xcc1762b626f8a4d4 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784188971.118593:0:66171:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc05ec0d600/0xcc1762b626f8a4d4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784188971.118604:0:66171:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc05ec0d600/0xcc1762b626f8a4d4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784188971.118617:0:66171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc05ec0c200/0xcc1762b626f8a4db lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784188971.118624:0:66171:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc05ec0c200/0xcc1762b626f8a4db lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784188971.118629:0:66171:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc05ec0c200/0xcc1762b626f8a4db lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784188971.118687:0:66171:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc05ec0d600/0xcc1762b626f8a4d4 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784188971.118694:0:66171:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc05ec0d600/0xcc1762b626f8a4d4 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784188971.118700:0:66171:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc05ec0d600/0xcc1762b626f8a4d4 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784188971.118706:0:66171:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dc05ec0d600/0xcc1762b626f8a4d4 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784188971.118712:0:66171:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc05ec0d600 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:3.0:1784188971.118716:0:66171:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc05ec0d600/0xcc1762b626f8a4d4 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784188971.118723:0:66171:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc05ec0d600/0xcc1762b626f8a4d4 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784188971.118735:0:66171:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9dc051574c00) 00010000:00010000:3.0:1784188971.118738:0:66171:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784188971.118752:0:66171:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dc05ec0d600/0xcc1762b626f8a4d4 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784188971.118758:0:66171:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc05ec0d600/0xcc1762b626f8a4d4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784188971.118770:0:66171:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc05ec0c200/0xcc1762b626f8a4db lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784188971.118776:0:66171:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc05ec0c200/0xcc1762b626f8a4db lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784188971.118788:0:66171:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dc05ec0c200/0xcc1762b626f8a4db lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784188971.118793:0:66171:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc05ec0c200 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:3.0:1784188971.118795:0:66171:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc05ec0c200/0xcc1762b626f8a4db lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784188971.118801:0:66171:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc05ec0c200/0xcc1762b626f8a4db lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784188971.118809:0:66171:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xed1d29cb (ffff9dc051574f00) 00010000:00010000:3.0:1784188971.118811:0:66171:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784188971.118814:0:66171:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dc05ec0c200/0xcc1762b626f8a4db lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784188971.118819:0:66171:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc05ec0c200/0xcc1762b626f8a4db lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784188971.118849:0:66171:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc05ec0dc00/0xcc1762b626f8a4cd lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c3cb2 expref: 7 pid: 66171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784188971.118858:0:66171:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9dc051574c00) 00010000:00010000:3.0:1784188971.118860:0:66171:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784188971.118863:0:66171:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc05ec0dc00/0xcc1762b626f8a4cd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c3cb2 expref: 7 pid: 66171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784188971.118871:0:66171:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc05ec0dc00, rc 0) 00010000:00000080:3.0:1784188971.118878:0:66171:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9dc080f6b100 x1870854436225920/t0(0) o101->b90fcc1c-0e69-42a4-a116-a71fec7aeb78@192.168.203.12@tcp:162/0 lens 592/584 e 0 to 0 dl 1784188982 ref 1 fl Interpret:/600/0 rc 301/0 job:'lfs.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1784188971.118957:0:66171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc080f6b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+6:64905:x1870854436225920:12345-192.168.203.12@tcp:101:lfs.0 Request processed in 726us (889us total) trans 0 rc 301/301 00000100:00100000:3.0:1784188971.118965:0:66171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1017 00000100:00100000:3.0:1784188971.121659:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1784188971.121725:0:66170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436226176 00000100:00100000:2.0:1784188971.121734:0:66170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436226176 00000100:00100000:2.0:1784188971.121787:0:66170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1018 00000100:00100000:2.0:1784188971.121797:0:66170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc080e7c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+6:64905:x1870854436226176:12345-192.168.203.12@tcp:101:lfs.0 00010000:00010000:2.0:1784188971.121814:0:66170:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784188971.121818:0:66170:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1784188971.121841:0:66170:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc05ec0c600/0xcc1762b626f8a4c6 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c3cab expref: 6 pid: 66945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784188971.121857:0:66170:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9dc051574c00) 00010000:00010000:2.0:1784188971.121868:0:66170:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1784188971.121882:0:66170:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0755a4c00/0xcc1762b626f8a4e2 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbfc5de7fe6c3cb9 expref: -99 pid: 66170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784188971.121980:0:66170:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0755a5e00/0xcc1762b626f8a4e9 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784188971.121993:0:66170:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0755a5e00/0xcc1762b626f8a4e9 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784188971.122003:0:66170:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0755a5e00/0xcc1762b626f8a4e9 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784188971.122014:0:66170:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0755a4400/0xcc1762b626f8a4f0 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784188971.122021:0:66170:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0755a4400/0xcc1762b626f8a4f0 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784188971.122027:0:66170:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0755a4400/0xcc1762b626f8a4f0 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784188971.122590:0:66170:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0755a4600/0xcc1762b626f8a4f7 lrc: 3/1,0 mode: --/PR res: [0x20000a811:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784188971.122600:0:66170:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0755a4600/0xcc1762b626f8a4f7 lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784188971.122609:0:66170:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0755a4600/0xcc1762b626f8a4f7 lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784188971.122619:0:66170:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000a811:0x2:0x0]: returning size 0 00010000:00010000:2.0:1784188971.122640:0:66170:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0755a5e00/0xcc1762b626f8a4e9 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784188971.122658:0:66170:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0755a5e00/0xcc1762b626f8a4e9 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784188971.122673:0:66170:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0755a5e00/0xcc1762b626f8a4e9 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784188971.122681:0:66170:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0755a5e00/0xcc1762b626f8a4e9 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784188971.122688:0:66170:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc0755a5e00 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:2.0:1784188971.122692:0:66170:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0755a5e00/0xcc1762b626f8a4e9 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784188971.122699:0:66170:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0755a5e00/0xcc1762b626f8a4e9 lrc: 5/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784188971.122708:0:66170:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9dbf47406400) 00010000:00010000:2.0:1784188971.122712:0:66170:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784188971.122716:0:66170:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0755a5e00/0xcc1762b626f8a4e9 lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784188971.122723:0:66170:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0755a5e00/0xcc1762b626f8a4e9 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1784188971.122734:0:66170:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000003a39bf86 reply state 00000000ca6670d8 transno 94489280516 ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0755a4400/0xcc1762b626f8a4f0 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784188971.122745:0:66170:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0755a4400/0xcc1762b626f8a4f0 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784188971.122751:0:66170:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xed1d29cb (ffff9dbf47406200) 00010000:00010000:2.0:1784188971.122753:0:66170:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1784188971.122756:0:66170:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1784188971.122779:0:66170:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0755a4c00/0xcc1762b626f8a4e2 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c3cb9 expref: 8 pid: 66170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784188971.122804:0:66170:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0755a4600/0xcc1762b626f8a4f7 lrc: 3/0,0 mode: PR/PR res: [0x20000a811:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c3cb9 expref: 7 pid: 66170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784188971.122812:0:66170:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x2:0x0].0x0 (ffff9dbf47406900) 00010000:00010000:2.0:1784188971.122815:0:66170:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784188971.122817:0:66170:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc0755a4600, rc 0) 00010000:00000080:2.0:1784188971.122825:0:66170:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9dc080e7c700 x1870854436226176/t94489280516(0) o101->b90fcc1c-0e69-42a4-a116-a71fec7aeb78@192.168.203.12@tcp:162/0 lens 536/608 e 0 to 0 dl 1784188982 ref 1 fl Interpret:/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1784188971.122894:0:66170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc080e7c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+8:64905:x1870854436226176:12345-192.168.203.12@tcp:101:lfs.0 Request processed in 1098us (1252us total) trans 94489280516 rc 0/0 00000100:00100000:2.0:1784188971.122903:0:66170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1018 00000100:00100000:1.0:1784188971.132302:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1784188971.132534:0:66169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436226432 00000100:00100000:3.0:1784188971.132544:0:66169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436226432 00000100:00100000:3.0:1784188971.132601:0:66169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1019 00000100:00100000:3.0:1784188971.132611:0:66169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf45126680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+8:64905:x1870854436226432:12345-192.168.203.12@tcp:101:lfs.0 00010000:00010000:3.0:1784188971.132635:0:66169:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784188971.132669:0:66169:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc05ec0c000/0xcc1762b626f8a505 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbfc5de7fe6c3cc0 expref: -99 pid: 66169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784188971.132771:0:66169:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc05ec0cc00/0xcc1762b626f8a50c lrc: 3/0,1 mode: --/EX res: [0x20000a811:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784188971.132784:0:66169:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0755a4600/0xcc1762b626f8a4f7 lrc: 2/0,0 mode: PR/PR res: [0x20000a811:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c3cb9 expref: 9 pid: 66170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784188971.132793:0:66169:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc05ec0cc00/0xcc1762b626f8a50c lrc: 4/0,1 mode: --/EX res: [0x20000a811:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784188971.132825:0:66169:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0755a4600/0xcc1762b626f8a4f7 lrc: 3/0,0 mode: PR/PR res: [0x20000a811:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c3cb9 expref: 9 pid: 66170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784188971.132837:0:66169:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0755a4600/0xcc1762b626f8a4f7 lrc: 4/0,0 mode: PR/PR res: [0x20000a811:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c3cb9 expref: 9 pid: 66170 timeout: 3313 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784188971.132867:0:66169:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc080e7f800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:66169:1870854458009856:192.168.203.12@tcp:104: 00000100:00100000:3.0:1784188971.132980:0:66169:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dc06bb569c0 going to sleep for 11 seconds 00000100:00100000:3.0:1784188971.136864:0:66169:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc080e7f800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:66169:1870854458009856:192.168.203.12@tcp:104: 00010000:00010000:3.0:1784188971.136892:0:66169:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9dc05ec0cc00/0xcc1762b626f8a50c lrc: 3/0,1 mode: --/EX res: [0x20000a811:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784188971.137463:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1784188971.137532:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436226560 00000100:00100000:2.0:1784188971.137540:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436226560 00010000:00010000:2.0:1784188971.137573:0:6499:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0755a4600/0xcc1762b626f8a4f7 lrc: 4/0,0 mode: PR/PR res: [0x20000a811:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c3cb9 expref: 10 pid: 66170 timeout: 3313 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784188971.137610:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 2537 00000100:00100000:2.0:1784188971.137619:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf45127b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+10:2396:x1870854436226560:12345-192.168.203.12@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1784188971.137632:0:6499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784188971.137639:0:6499:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0755a4600/0xcc1762b626f8a4f7 lrc: 4/0,0 mode: PR/PR res: [0x20000a811:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c3cb9 expref: 10 pid: 66170 timeout: 3313 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784188971.137664:0:6499:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0755a4600/0xcc1762b626f8a4f7 lrc: 3/0,0 mode: PR/PR res: [0x20000a811:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c3cb9 expref: 10 pid: 66170 timeout: 3313 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784188971.137703:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0755a4600/0xcc1762b626f8a4f7 lrc: 0/0,0 mode: --/PR res: [0x20000a811:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c3cb9 expref: 10 pid: 66170 timeout: 3313 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784188971.137719:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x2:0x0].0x0 (ffff9dbf47406900) 00010000:00010000:2.0:1784188971.137723:0:6499:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9dc05ec0cc00/0xcc1762b626f8a50c lrc: 3/0,1 mode: --/EX res: [0x20000a811:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784188971.137739:0:6499:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc05ec0cc00/0xcc1762b626f8a50c lrc: 3/0,1 mode: EX/EX res: [0x20000a811:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784188971.137747:0:6499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc05ec0cc00/0xcc1762b626f8a50c lrc: 4/0,1 mode: EX/EX res: [0x20000a811:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784188971.137776:0:6499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784188971.137819:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf45127b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+9:2396:x1870854436226560:12345-192.168.203.12@tcp:103:ldlm_bl.0 Request processed in 200us (357us total) trans 0 rc 0/0 00000100:00100000:2.0:1784188971.137827:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 2537 00010000:00010000:1.0:1784188971.138190:0:66169:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9dc05ec0cc00/0xcc1762b626f8a50c lrc: 3/0,1 mode: EX/EX res: [0x20000a811:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784188971.138207:0:66169:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc05ec0cc00/0xcc1762b626f8a50c lrc: 3/0,1 mode: EX/EX res: [0x20000a811:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784188971.138226:0:66169:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000a811:0x2:0x0]: returning size 0 00010000:00010000:1.0:1784188971.138624:0:66169:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc05ec0cc00/0xcc1762b626f8a50c lrc: 3/0,1 mode: EX/EX res: [0x20000a811:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784188971.138633:0:66169:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc05ec0cc00/0xcc1762b626f8a50c lrc: 2/0,0 mode: EX/EX res: [0x20000a811:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784188971.138639:0:66169:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dc05ec0cc00/0xcc1762b626f8a50c lrc: 3/0,0 mode: EX/EX res: [0x20000a811:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784188971.138655:0:66169:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc05ec0cc00 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:1.0:1784188971.138660:0:66169:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc05ec0cc00/0xcc1762b626f8a50c lrc: 3/0,0 mode: EX/EX res: [0x20000a811:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784188971.138667:0:66169:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc05ec0cc00/0xcc1762b626f8a50c lrc: 4/0,0 mode: EX/EX res: [0x20000a811:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784188971.138680:0:66169:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x2:0x0].0x0 (ffff9dbf47406900) 00010000:00010000:1.0:1784188971.138683:0:66169:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1784188971.138687:0:66169:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dc05ec0cc00/0xcc1762b626f8a50c lrc: 2/0,0 mode: --/EX res: [0x20000a811:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784188971.138693:0:66169:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc05ec0cc00/0xcc1762b626f8a50c lrc: 0/0,0 mode: --/EX res: [0x20000a811:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784188971.138759:0:66169:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc05ec0c000/0xcc1762b626f8a505 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c3cc0 expref: 9 pid: 66169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784188971.138849:0:66169:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9dc051574900) 00010000:00010000:1.0:1784188971.138851:0:66169:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1784188971.138855:0:66169:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc05ec0c000/0xcc1762b626f8a505 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c3cc0 expref: 9 pid: 66169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784188971.138868:0:66169:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc05ec0c000, rc 0) 00010000:00000080:1.0:1784188971.138876:0:66169:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9dbf45126680 x1870854436226432/t94489280517(0) o101->b90fcc1c-0e69-42a4-a116-a71fec7aeb78@192.168.203.12@tcp:162/0 lens 712/824 e 0 to 0 dl 1784188982 ref 1 fl Interpret:/600/0 rc 301/0 job:'lfs.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1784188971.138918:0:66169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf45126680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+8:64905:x1870854436226432:12345-192.168.203.12@tcp:101:lfs.0 Request processed in 6308us (6624us total) trans 94489280517 rc 301/301 00000100:00100000:1.0:1784188971.138926:0:66169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1019 00000100:00100000:2.0:1784188971.141874:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1784188971.141943:0:66172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436226816 00000100:00100000:3.0:1784188971.141952:0:66172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436226816 00000100:00100000:3.0:1784188971.141999:0:66172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 213 00000100:00100000:3.0:1784188971.142008:0:66172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc080f6a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+8:64905:x1870854436226816:12345-192.168.203.12@tcp:35:lfs.0 00010000:00000080:3.0:1784188971.142194:0:66172:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9dc080f6a680 x1870854436226816/t94489280518(0) o35->b90fcc1c-0e69-42a4-a116-a71fec7aeb78@192.168.203.12@tcp:162/0 lens 392/456 e 0 to 0 dl 1784188982 ref 1 fl Interpret:/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1784188971.142502:0:66172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc080f6a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+9:64905:x1870854436226816:12345-192.168.203.12@tcp:35:lfs.0 Request processed in 493us (636us total) trans 94489280518 rc 0/0 00000100:00100000:3.0:1784188971.142510:0:66172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 213 00000100:00100000:2.0:1784188971.145716:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1784188971.145805:0:66173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436227072 00000100:00100000:0.0:1784188971.145814:0:66173:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436227072 00000100:00100000:0.0:1784188971.145866:0:66173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 214 00000100:00100000:0.0:1784188971.145876:0:66173:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc080f6bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+9:64905:x1870854436227072:12345-192.168.203.12@tcp:35:lfs.0 00010000:00000080:0.0:1784188971.146048:0:66173:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9dc080f6bb80 x1870854436227072/t94489280519(0) o35->b90fcc1c-0e69-42a4-a116-a71fec7aeb78@192.168.203.12@tcp:162/0 lens 392/456 e 0 to 0 dl 1784188982 ref 1 fl Interpret:/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1784188971.146098:0:66173:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc080f6bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+10:64905:x1870854436227072:12345-192.168.203.12@tcp:35:lfs.0 Request processed in 224us (391us total) trans 94489280519 rc 0/0 00000100:00100000:0.0:1784188971.146106:0:66173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 214 00010000:00010000:0.0:1784188971.759416:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784188972.080906:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf45124e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1870854458009984:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1784188972.080984:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784188972.081028:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1784188972.081035:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc080e7f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1870854458010112:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1784188972.081060:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784188972.081252:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458009984 00000100:00100000:2.0:1784188972.081259:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458009984 00000100:00100000:2.0:1784188972.081342:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458010112 00000100:00100000:2.0:1784188972.081346:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458010112 00000100:00100000:2.0:1784188972.081365:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1824 00000100:00100000:2.0:1784188972.081374:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc080e7df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1870854458009984:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1784188972.081400:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8652352 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1784188972.081458:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc080e7df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1870854458009984:12345-0@lo:13:osp-pre-0-1.0 Request processed in 84us (473us total) trans 0 rc 0/0 00000100:00100000:2.0:1784188972.081478:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1824 00000100:00100000:2.0:1784188972.081496:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1825 00000100:00100000:2.0:1784188972.081503:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc080e7f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1870854458010112:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1784188972.081518:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8652352 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1784188972.081543:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc080e7f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1870854458010112:12345-0@lo:13:osp-pre-1-1.0 Request processed in 41us (482us total) trans 0 rc 0/0 00000100:00100000:2.0:1784188972.081549:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1825 00000100:00080000:3.0:1784188972.081702:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1784188972.081707:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1784188972.081750:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc080e7f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1870854458010112:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1784188972.081878:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf45124e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1870854458009984:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1784188972.800712:0:7454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1784188972.803101:0:84459:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:2.0:1784188972.803151:0:84459:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff9dc0565e6e00/0xcc1762b626f8a115 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc1762b626f8a11c expref: -99 pid: 83221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784188972.803167:0:84459:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff9dc0565e6e00/0xcc1762b626f8a115 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0xcc1762b626f8a11c expref: -99 pid: 83221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784188972.803175:0:84459:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff9dc0565e6e00/0xcc1762b626f8a115 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0xcc1762b626f8a11c expref: -99 pid: 83221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784188972.803181:0:84459:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.112@tcp lock: ffff9dc0565e6e00/0xcc1762b626f8a115 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0xcc1762b626f8a11c expref: -99 pid: 83221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784188972.803240:0:84459:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1784188972.803246:0:84459:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:2.0:1784188972.803272:0:84459:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00010000:00010000:3.0:1784188972.803480:0:26173:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784188972.803487:0:26173:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.112@tcp lock: ffff9dc0565e6e00/0xcc1762b626f8a115 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0xcc1762b626f8a11c expref: -99 pid: 83221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784188972.803495:0:26173:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc0565e6e00 already unused, calling callback (ffffffffc114ac20) 10000000:00010000:3.0:1784188972.803499:0:26173:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.112@tcp lock: ffff9dc0565e6e00/0xcc1762b626f8a115 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0xcc1762b626f8a11c expref: -99 pid: 83221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784188972.803508:0:26173:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.112@tcp lock: ffff9dc0565e6e00/0xcc1762b626f8a115 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1008400000000 nid: local remote: 0xcc1762b626f8a11c expref: -99 pid: 83221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1784188972.803515:0:26173:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.112@tcp lock: ffff9dc0565e6e00/0xcc1762b626f8a115 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1009400000000 nid: local remote: 0xcc1762b626f8a11c expref: -99 pid: 83221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784188972.803520:0:26173:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1784188972.803523:0:26173:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:3.0:1784188972.803525:0:26173:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00000100:00100000:2.0:1784188972.803616:0:84459:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:2.0:1784188972.803624:0:84459:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1784188972.803658:0:84459:0:(import.c:65:import_set_state_nolock()) ffff9dc075651000 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:0.0:1784188972.803711:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc080f68e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3639:1870854458010240:0@lo:39:umount.0 00000100:00100000:0.0:1784188972.803787:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784188972.803906:0:66171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458010240 00000100:00100000:1.0:1784188972.803914:0:66171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458010240 00000100:00100000:1.0:1784188972.803962:0:66171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1020 00000100:00100000:1.0:1784188972.803969:0:66171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc07b5b3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1870854458010240:12345-0@lo:39:umount.0 00000020:00000080:1.0:1784188972.803993:0:66171:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xcc1762b626f8a234 00000100:00080000:1.0:1784188972.804000:0:66171:0:(import.c:65:import_set_state_nolock()) ffff9dc06b3ed800 : changing import state from FULL to CLOSED 00010000:00000080:1.0:1784188972.804029:0:66171:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9dc07b5b3800 x1870854458010240/t0(0) o39->lustre-MDT0000-lwp-MDT0000_UUID@0@lo:163/0 lens 224/224 e 0 to 0 dl 1784188983 ref 1 fl Interpret:/200/0 rc 0/0 job:'umount.0' uid:0 gid:0 projid:4294967295 00010000:00010000:3.0:1784188972.804106:0:26173:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.112@tcp lock: ffff9dc0565e6e00/0xcc1762b626f8a115 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0xcc1762b626f8a11c expref: -99 pid: 83221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784188972.804113:0:26173:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1784188972.804132:0:26173:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.112@tcp lock: ffff9dc0565e6e00/0xcc1762b626f8a115 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0xcc1762b626f8a11c expref: -99 pid: 83221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784188972.804140:0:26173:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.112@tcp lock: ffff9dc0565e6e00/0xcc1762b626f8a115 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0xcc1762b626f8a11c expref: -99 pid: 83221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784188972.804153:0:26173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784188972.804154:0:26173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784188972.804156:0:26173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784188972.804168:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc080e7f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bd553d0d-03e2-4233-b06b-b55bbfa2b954:3640:1870854458010368:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1784188972.804223:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784188972.804264:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458010368 00000100:00100000:3.0:1784188972.804268:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458010368 00000100:00100000:3.0:1784188972.804302:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 679 00000100:00100000:3.0:1784188972.804309:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf44bc2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bd553d0d-03e2-4233-b06b-b55bbfa2b954+24:3640:x1870854458010368:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1784188972.804340:0:6500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784188972.804356:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dc070147400/0xcc1762b626f8a11c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xcc1762b626f8a115 expref: 24 pid: 83228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784188972.804368:0:6500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784188972.804396:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf44bc2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bd553d0d-03e2-4233-b06b-b55bbfa2b954+23:3640:x1870854458010368:12345-0@lo:103:ldlm_bl.0 Request processed in 88us (173us total) trans 0 rc 0/0 00000100:00100000:3.0:1784188972.804403:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 679 00000100:00100000:3.0:1784188972.804443:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc080e7f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bd553d0d-03e2-4233-b06b-b55bbfa2b954:3640:1870854458010368:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1784188972.804670:0:66171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc07b5b3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+1:3639:x1870854458010240:12345-0@lo:39:umount.0 Request processed in 700us (882us total) trans 0 rc 0/0 00000100:00100000:1.0:1784188972.804677:0:66171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1020 00000020:00000080:1.0:1784188972.804685:0:66171:0:(genops.c:906:class_export_put()) final put ffff9dc06b3ea800/lustre-MDT0000-lwp-MDT0000_UUID 00010000:00010000:1.0:1784188972.804716:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1784188972.804814:0:63468:0:(genops.c:865:class_export_destroy()) destroying export ffff9dc06b3ea800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000020:00000080:2.0:1784188972.804872:0:63468:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9dc06b3ed800 for lustre-MDT0000 00000100:00080000:0.0:1784188972.804939:0:3639:0:(import.c:65:import_set_state_nolock()) ffff9dc075651000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:0.0:1784188972.804986:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc080f68e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3639:1870854458010240:0@lo:39:umount.0 00000100:00080000:2.0:1784188972.805024:0:84459:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1784188972.805027:0:84459:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:2.0:1784188972.805031:0:84459:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:3.0:1784188972.806291:0:84459:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff9dc0565e7600/0xcc1762b626f8a03c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc1762b626f8a043 expref: -99 pid: 83221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784188972.806306:0:84459:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff9dc0565e7600/0xcc1762b626f8a03c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0xcc1762b626f8a043 expref: -99 pid: 83221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784188972.806312:0:84459:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff9dc0565e7600/0xcc1762b626f8a03c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0xcc1762b626f8a043 expref: -99 pid: 83221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784188972.807021:0:84459:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.112@tcp lock: ffff9dc0565e7600/0xcc1762b626f8a03c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0xcc1762b626f8a043 expref: -99 pid: 83221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784188972.807088:0:84459:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1784188972.807096:0:84459:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff9dc080f05200/0xcc1762b626f8a138 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc1762b626f8a13f expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784188972.807118:0:84459:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff9dc080f05200/0xcc1762b626f8a138 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xcc1762b626f8a13f expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784188972.807124:0:84459:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff9dc080f05200/0xcc1762b626f8a138 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xcc1762b626f8a13f expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784188972.807130:0:84459:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.112@tcp lock: ffff9dc080f05200/0xcc1762b626f8a138 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xcc1762b626f8a13f expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784188972.807160:0:6501:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1784188972.807173:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.112@tcp lock: ffff9dc0565e7600/0xcc1762b626f8a03c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0xcc1762b626f8a043 expref: -99 pid: 83221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784188972.807180:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc0565e7600 already unused, calling callback (ffffffffc114ac20) 10000000:00010000:0.0:1784188972.807184:0:6501:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.112@tcp lock: ffff9dc0565e7600/0xcc1762b626f8a03c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0xcc1762b626f8a043 expref: -99 pid: 83221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784188972.807193:0:6501:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.112@tcp lock: ffff9dc0565e7600/0xcc1762b626f8a03c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1008400000000 nid: local remote: 0xcc1762b626f8a043 expref: -99 pid: 83221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1784188972.807200:0:6501:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.112@tcp lock: ffff9dc0565e7600/0xcc1762b626f8a03c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1009400000000 nid: local remote: 0xcc1762b626f8a043 expref: -99 pid: 83221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784188972.807205:0:6501:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1784188972.807208:0:6501:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 00010000:00010000:0.0:1784188972.807240:0:6501:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.112@tcp lock: ffff9dc0565e7600/0xcc1762b626f8a03c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0xcc1762b626f8a043 expref: -99 pid: 83221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784188972.807247:0:6501:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1784188972.807284:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.112@tcp lock: ffff9dc0565e7600/0xcc1762b626f8a03c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0xcc1762b626f8a043 expref: -99 pid: 83221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784188972.807290:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.112@tcp lock: ffff9dc0565e7600/0xcc1762b626f8a03c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0xcc1762b626f8a043 expref: -99 pid: 83221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784188972.807303:0:6501:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784188972.807306:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.112@tcp lock: ffff9dc080f05200/0xcc1762b626f8a138 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xcc1762b626f8a13f expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784188972.807312:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc080f05200 already unused, calling callback (ffffffffc114ac20) 10000000:00010000:0.0:1784188972.807339:0:6501:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.112@tcp lock: ffff9dc080f05200/0xcc1762b626f8a138 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xcc1762b626f8a13f expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784188972.807353:0:6501:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.112@tcp lock: ffff9dc080f05200/0xcc1762b626f8a138 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xcc1762b626f8a13f expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1784188972.807359:0:6501:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.112@tcp lock: ffff9dc080f05200/0xcc1762b626f8a138 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xcc1762b626f8a13f expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784188972.807365:0:6501:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:0.0:1784188972.807367:0:6501:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 00010000:00010000:0.0:1784188972.807381:0:6501:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.112@tcp lock: ffff9dc080f05200/0xcc1762b626f8a138 lrc: 3/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xcc1762b626f8a13f expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784188972.807386:0:6501:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1784188972.807403:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.112@tcp lock: ffff9dc080f05200/0xcc1762b626f8a138 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xcc1762b626f8a13f expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784188972.807410:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784188972.807412:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784188972.807414:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784188972.807431:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc0477c3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bd553d0d-03e2-4233-b06b-b55bbfa2b954:3642:1870854458010624:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1784188972.807491:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784188972.807630:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf46903100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:bd553d0d-03e2-4233-b06b-b55bbfa2b954:3641:1870854458010496:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1784188972.807678:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784188972.807715:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458010624 00000100:00100000:1.0:1784188972.807791:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458010624 00000100:00100000:1.0:1784188972.807832:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458010496 00000100:00100000:1.0:1784188972.807836:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458010496 00000100:00100000:1.0:1784188972.807858:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 680 00000100:00100000:1.0:1784188972.807866:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc0711a4c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bd553d0d-03e2-4233-b06b-b55bbfa2b954+24:3642:x1870854458010624:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1784188972.807878:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784188972.807892:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dc04a20b800/0xcc1762b626f8a13f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xcc1762b626f8a138 expref: 24 pid: 83231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784188972.807904:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784188972.807933:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc0711a4c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bd553d0d-03e2-4233-b06b-b55bbfa2b954+23:3642:x1870854458010624:12345-0@lo:103:ldlm_bl.0 Request processed in 68us (441us total) trans 0 rc 0/0 00000100:00100000:1.0:1784188972.807939:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 680 00000100:00100000:1.0:1784188972.807986:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 681 00000100:00100000:1.0:1784188972.807992:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf45125f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bd553d0d-03e2-4233-b06b-b55bbfa2b954+22:3641:x1870854458010496:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1784188972.807999:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784188972.808008:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dc04a20be00/0xcc1762b626f8a043 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xcc1762b626f8a03c expref: 22 pid: 83226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784188972.808016:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784188972.808041:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf45125f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bd553d0d-03e2-4233-b06b-b55bbfa2b954+21:3641:x1870854458010496:12345-0@lo:103:ldlm_bl.0 Request processed in 49us (363us total) trans 0 rc 0/0 00000100:00100000:1.0:1784188972.808048:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 681 00000100:00100000:1.0:1784188972.808082:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf46903100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:bd553d0d-03e2-4233-b06b-b55bbfa2b954:3641:1870854458010496:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1784188972.808135:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc0477c3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bd553d0d-03e2-4233-b06b-b55bbfa2b954:3642:1870854458010624:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1784188972.808362:0:84459:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1784188972.808369:0:84459:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.112@tcp lock: ffff9dc080f05200/0xcc1762b626f8a138 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xcc1762b626f8a13f expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784188972.808380:0:84459:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:3.0:1784188972.808389:0:84459:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff9dc0565e7c00/0xcc1762b626f8a107 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc1762b626f8a10e expref: -99 pid: 83221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784188972.808395:0:84459:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff9dc0565e7c00/0xcc1762b626f8a107 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xcc1762b626f8a10e expref: -99 pid: 83221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784188972.808401:0:84459:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff9dc0565e7c00/0xcc1762b626f8a107 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xcc1762b626f8a10e expref: -99 pid: 83221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784188972.808408:0:84459:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.112@tcp lock: ffff9dc0565e7c00/0xcc1762b626f8a107 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xcc1762b626f8a10e expref: -99 pid: 83221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784188972.809503:0:7454:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784188972.809514:0:7454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.112@tcp lock: ffff9dc0565e7c00/0xcc1762b626f8a107 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xcc1762b626f8a10e expref: -99 pid: 83221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784188972.809584:0:7454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc0565e7c00 already unused, calling callback (ffffffffc114ac20) 10000000:00010000:2.0:1784188972.809589:0:7454:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.112@tcp lock: ffff9dc0565e7c00/0xcc1762b626f8a107 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xcc1762b626f8a10e expref: -99 pid: 83221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784188972.809599:0:7454:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.112@tcp lock: ffff9dc0565e7c00/0xcc1762b626f8a107 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0xcc1762b626f8a10e expref: -99 pid: 83221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1784188972.809606:0:7454:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.112@tcp lock: ffff9dc0565e7c00/0xcc1762b626f8a107 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0xcc1762b626f8a10e expref: -99 pid: 83221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784188972.809612:0:7454:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:2.0:1784188972.809614:0:7454:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 00010000:00010000:2.0:1784188972.809658:0:7454:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.112@tcp lock: ffff9dc0565e7c00/0xcc1762b626f8a107 lrc: 3/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xcc1762b626f8a10e expref: -99 pid: 83221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784188972.809665:0:7454:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1784188972.809729:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc080f69f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:bd553d0d-03e2-4233-b06b-b55bbfa2b954:3643:1870854458010752:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1784188972.809787:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784188972.809865:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458010752 00000100:00100000:1.0:1784188972.809884:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458010752 00000100:00100000:1.0:1784188972.809928:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 682 00000100:00100000:1.0:1784188972.809937:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc0477c3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bd553d0d-03e2-4233-b06b-b55bbfa2b954+21:3643:x1870854458010752:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1784188972.809948:0:6500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784188972.809962:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dc080f04800/0xcc1762b626f8a10e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xcc1762b626f8a107 expref: 21 pid: 83231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784188972.809977:0:6500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1784188972.810079:0:7454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.112@tcp lock: ffff9dc0565e7c00/0xcc1762b626f8a107 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xcc1762b626f8a10e expref: -99 pid: 83221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784188972.810089:0:7454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784188972.810091:0:7454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784188972.810093:0:7454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784188972.810203:0:84459:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1784188972.810210:0:84459:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.112@tcp lock: ffff9dc0565e7c00/0xcc1762b626f8a107 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xcc1762b626f8a10e expref: -99 pid: 83221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784188972.810233:0:84459:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:3.0:1784188972.810240:0:84459:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff9dc0565e7400/0xcc1762b626f8a027 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc1762b626f8a02e expref: -99 pid: 83221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784188972.810248:0:84459:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff9dc0565e7400/0xcc1762b626f8a027 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xcc1762b626f8a02e expref: -99 pid: 83221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784188972.810255:0:84459:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff9dc0565e7400/0xcc1762b626f8a027 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xcc1762b626f8a02e expref: -99 pid: 83221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784188972.810262:0:84459:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.112@tcp lock: ffff9dc0565e7400/0xcc1762b626f8a027 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xcc1762b626f8a02e expref: -99 pid: 83221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784188972.810277:0:84459:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1784188972.810280:0:84459:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 10000000:01000000:3.0:1784188972.810283:0:84459:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00000020:01000004:3.0:1784188972.810338:0:84459:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-MDT0000 00000020:01000000:3.0:1784188972.810343:0:84459:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='FA') 00000020:00000080:3.0:1784188972.810348:0:84459:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:02000400:3.0:1784188972.810355:0:84459:0:(obd_config.c:932:class_cleanup()) Failing over lustre-MDT0000 00000004:00000080:3.0:1784188972.812269:0:84459:0:(mdt_handler.c:8168:mdt_iocontrol()) lustre-MDT0000: cmd=40086672 len=0 karg=0000000000000000 uarg=0000000000000000 00000001:00080000:3.0:1784188972.812839:0:83222:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 94489280519 is committed 00010000:00010000:3.0:1784188972.812871:0:3627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0755a4400/0xcc1762b626f8a4f0 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784188972.812881:0:3627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0755a4400/0xcc1762b626f8a4f0 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784188972.812888:0:3627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0755a4400/0xcc1762b626f8a4f0 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784188972.812905:0:3627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc0755a4400 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:3.0:1784188972.812910:0:3627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0755a4400/0xcc1762b626f8a4f0 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784188972.812918:0:3627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0755a4400/0xcc1762b626f8a4f0 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784188972.812934:0:3627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xed1d29cb (ffff9dbf47406200) 00010000:00010000:3.0:1784188972.812937:0:3627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784188972.812941:0:3627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0755a4400/0xcc1762b626f8a4f0 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784188972.812947:0:3627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0755a4400/0xcc1762b626f8a4f0 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00000080:3.0:1784188972.813009:0:84459:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 5/11 00000020:00080000:3.0:1784188972.813019:0:84459:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff9dbf430fc800 b90fcc1c-0e69-42a4-a116-a71fec7aeb78 192.168.203.12@tcp 4 (0 0 0) 0 0 0 0: 0000000000000000 94489280519 stale:0 00000020:00080000:3.0:1784188972.813026:0:84459:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff9dbf41bfc000 lustre-MDT0000-lwp-MDT0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1784188972.813030:0:84459:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff9dbf434ae000 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1784188972.813035:0:84459:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff9dc04ffb5800 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1784188972.813038:0:84459:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff9dbf46b0b800 lustre-MDT0001-mdtlov_UUID 0@lo 5 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1784188972.813043:0:84459:0:(genops.c:1574:class_disconnect_exports()) OBD device 13 (ffff9dc049be19c0) has exports, disconnecting them 00000020:00080000:3.0:1784188972.813049:0:84459:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 192.168.203.12@tcp (ffff9dbf430fc800), last request at 1784188971 00000020:00000080:3.0:1784188972.813055:0:84459:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xcc1762b626f8a402 00000100:00080000:3.0:1784188972.813065:0:84459:0:(import.c:65:import_set_state_nolock()) ffff9dbf436c6800 : changing import state from FULL to CLOSED 00000020:00080000:3.0:1784188972.813086:0:84459:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 192.168.203.12@tcp (ffff9dbf430fc800): rc 0 00000020:00000080:3.0:1784188972.813094:0:84459:0:(genops.c:906:class_export_put()) final put ffff9dbf430fc800/b90fcc1c-0e69-42a4-a116-a71fec7aeb78 00000020:00080000:3.0:1784188972.813113:0:84459:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9dbf41bfc000), last request at 1784188766 00000020:00000080:3.0:1784188972.813117:0:84459:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xcc1762b626f8a22d 00000100:00080000:3.0:1784188972.813121:0:84459:0:(import.c:65:import_set_state_nolock()) ffff9dc06b3ec000 : changing import state from FULL to CLOSED 00000020:00080000:3.0:1784188972.813131:0:84459:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9dbf41bfc000): rc 0 00000020:00000080:3.0:1784188972.813133:0:84459:0:(genops.c:906:class_export_put()) final put ffff9dbf41bfc000/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00080000:3.0:1784188972.813136:0:84459:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9dbf434ae000), last request at 1784188967 00000020:00000080:3.0:1784188972.813138:0:84459:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xcc1762b626f8a226 00000100:00080000:3.0:1784188972.813142:0:84459:0:(import.c:65:import_set_state_nolock()) ffff9dbf4512f800 : changing import state from FULL to CLOSED 00000020:00080000:3.0:1784188972.813145:0:84459:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9dbf434ae000): rc 0 00000020:00000080:3.0:1784188972.813147:0:84459:0:(genops.c:906:class_export_put()) final put ffff9dbf434ae000/lustre-MDT0000-lwp-OST0001_UUID 00000020:00080000:3.0:1784188972.813150:0:84459:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9dc04ffb5800), last request at 1784188967 00000020:00000080:3.0:1784188972.813153:0:84459:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xcc1762b626f8a21f 00000100:00080000:3.0:1784188972.813161:0:84459:0:(import.c:65:import_set_state_nolock()) ffff9dbf434ac000 : changing import state from FULL to CLOSED 00000020:00080000:3.0:1784188972.813185:0:84459:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9dc04ffb5800): rc 0 00000020:00000080:3.0:1784188972.813188:0:84459:0:(genops.c:906:class_export_put()) final put ffff9dc04ffb5800/lustre-MDT0000-lwp-OST0000_UUID 00000020:00080000:3.0:1784188972.813192:0:84459:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9dbf46b0b800), last request at 1784188761 00000020:00000080:3.0:1784188972.813194:0:84459:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xcc1762b626f8a089 00000100:00080000:3.0:1784188972.813202:0:84459:0:(import.c:65:import_set_state_nolock()) ffff9dc06bb60800 : changing import state from FULL to CLOSED 00000020:00080000:3.0:1784188972.813206:0:84459:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9dbf46b0b800): rc 0 00000020:00000080:3.0:1784188972.813208:0:84459:0:(genops.c:906:class_export_put()) final put ffff9dbf46b0b800/lustre-MDT0001-mdtlov_UUID 00000004:00000080:3.0:1784188972.813214:0:84459:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffae0981b3bae0 00000100:00080000:3.0:1784188972.813229:0:84459:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1784188972.813232:0:84459:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 81604378730 gen 3 00010000:00010000:2.0:1784188972.813878:0:26173:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784188972.813899:0:26173:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.112@tcp lock: ffff9dc0565e7400/0xcc1762b626f8a027 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xcc1762b626f8a02e expref: -99 pid: 83221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784188972.813909:0:26173:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc0565e7400 already unused, calling callback (ffffffffc114ac20) 10000000:00010000:2.0:1784188972.813913:0:26173:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.112@tcp lock: ffff9dc0565e7400/0xcc1762b626f8a027 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xcc1762b626f8a02e expref: -99 pid: 83221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784188972.813920:0:26173:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.112@tcp lock: ffff9dc0565e7400/0xcc1762b626f8a027 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xcc1762b626f8a02e expref: -99 pid: 83221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1784188972.813927:0:26173:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.112@tcp lock: ffff9dc0565e7400/0xcc1762b626f8a027 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xcc1762b626f8a02e expref: -99 pid: 83221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784188972.813932:0:26173:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:2.0:1784188972.813934:0:26173:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:2.0:1784188972.813937:0:26173:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:2.0:1784188972.813968:0:26173:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.112@tcp lock: ffff9dc0565e7400/0xcc1762b626f8a027 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xcc1762b626f8a02e expref: -99 pid: 83221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784188972.813973:0:26173:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1784188972.814000:0:26173:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.112@tcp lock: ffff9dc0565e7400/0xcc1762b626f8a027 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xcc1762b626f8a02e expref: -99 pid: 83221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784188972.814007:0:26173:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.112@tcp lock: ffff9dc0565e7400/0xcc1762b626f8a027 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xcc1762b626f8a02e expref: -99 pid: 83221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784188972.814019:0:26173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784188972.814021:0:26173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784188972.814022:0:26173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784188972.814030:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1784188972.814047:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc080f68000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:bd553d0d-03e2-4233-b06b-b55bbfa2b954:3641:1870854458010880:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1784188972.814119:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784188972.814172:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458010880 00000100:00100000:2.0:1784188972.814178:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458010880 00000100:00100000:2.0:1784188972.814220:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 683 00000100:00100000:2.0:1784188972.814227:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc080f69500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bd553d0d-03e2-4233-b06b-b55bbfa2b954+21:3641:x1870854458010880:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1784188972.814239:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784188972.814250:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dc04a20ae00/0xcc1762b626f8a02e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xcc1762b626f8a027 expref: 21 pid: 83228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784188972.814262:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784188972.814293:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc080f69500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bd553d0d-03e2-4233-b06b-b55bbfa2b954+20:3641:x1870854458010880:12345-0@lo:103:ldlm_bl.0 Request processed in 66us (174us total) trans 0 rc 0/0 00000100:00100000:2.0:1784188972.814299:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 683 00000100:00100000:2.0:1784188972.814369:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc080f68000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:bd553d0d-03e2-4233-b06b-b55bbfa2b954:3641:1870854458010880:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1784188972.814385:0:7454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784188972.814473:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc0477c3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bd553d0d-03e2-4233-b06b-b55bbfa2b954+19:3643:x1870854458010752:12345-0@lo:103:ldlm_bl.0 Request processed in 4536us (4685us total) trans 0 rc 0/0 00000100:00100000:1.0:1784188972.814481:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 682 00000020:00000080:1.0:1784188972.814501:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9dbf430fc800/b90fcc1c-0e69-42a4-a116-a71fec7aeb78 for lustre-MDT0000 00000020:00000080:1.0:1784188972.814662:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9dbf41bfc000/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000 00000020:00000080:1.0:1784188972.814699:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9dbf434ae000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000020:00000080:1.0:1784188972.814714:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9dc04ffb5800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00000080:1.0:1784188972.814831:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9dbf46b0b800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000 00000020:00000080:1.0:1784188972.814865:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9dbf436c6800 for lustre-MDT0000 00000020:00000080:1.0:1784188972.814870:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9dc06b3ec000 for lustre-MDT0000 00000020:00000080:1.0:1784188972.814873:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9dbf4512f800 for lustre-MDT0000 00000020:00000080:1.0:1784188972.814876:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9dbf434ac000 for lustre-MDT0000 00000020:00000080:1.0:1784188972.814878:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9dc06bb60800 for lustre-MDT0000 00010000:00010000:1.0:1784188972.814890:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784188972.814998:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc080f69f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:bd553d0d-03e2-4233-b06b-b55bbfa2b954:3643:1870854458010752:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1784188972.815018:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1784188972.815797:0:84459:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000100:00080000:3.0:1784188972.815821:0:84459:0:(import.c:65:import_set_state_nolock()) ffff9dc0477b4000 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:0.0:1784188972.815873:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf44bc2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3639:1870854458011008:0@lo:39:umount.0 00000100:00100000:0.0:1784188972.815935:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1784188972.816198:0:84459:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1784188972.816202:0:84459:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294968947 gen 3 00000004:00080000:3.0:1784188972.816226:0:84459:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:3.0:1784188972.816281:0:84459:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:3.0:1784188972.816293:0:84459:0:(import.c:65:import_set_state_nolock()) ffff9dbf4845f000 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:2.0:1784188972.816381:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458011008 00000100:00100000:2.0:1784188972.816389:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458011008 00000100:00100000:2.0:1784188972.816439:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3685 00000100:00100000:2.0:1784188972.816448:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc0477c3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3639:x1870854458011008:12345-0@lo:39:umount.0 00000020:00000080:2.0:1784188972.816471:0:8439:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xcc1762b626f8a0c8 00000100:00080000:2.0:1784188972.816479:0:8439:0:(import.c:65:import_set_state_nolock()) ffff9dbf43fcc000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1784188972.816499:0:8439:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 19, last_transno is 81604378730 00000100:00100000:0.0:1784188972.816872:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf44bc0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3639:1870854458011136:0@lo:9:umount.0 00000100:00100000:0.0:1784188972.816907:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784188972.816968:0:26163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458011136 00000100:00100000:1.0:1784188972.816973:0:26163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458011136 00000100:00100000:1.0:1784188972.817015:0:26163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4914 00000100:00100000:1.0:1784188972.817022:0:26163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc07b223800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+5:3639:x1870854458011136:12345-0@lo:9:umount.0 00000020:00000080:1.0:1784188972.817037:0:26163:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xcc1762b626f8a0e4 00000100:00080000:1.0:1784188972.817042:0:26163:0:(import.c:65:import_set_state_nolock()) ffff9dbf42276800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1784188972.817086:0:26163:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294968947 00000100:00100000:1.0:1784188972.817177:0:26163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc07b223800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+2:3639:x1870854458011136:12345-0@lo:9:umount.0 Request processed in 155us (268us total) trans 0 rc 0/0 00000100:00100000:1.0:1784188972.817185:0:26163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4914 00000100:00080000:1.0:1784188972.817205:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1784188972.817282:0:84459:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1784188972.817285:0:84459:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294968951 gen 3 00000004:00080000:3.0:1784188972.817295:0:84459:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:3.0:1784188972.817378:0:84459:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:3.0:1784188972.817392:0:84459:0:(import.c:65:import_set_state_nolock()) ffff9dc05f22b000 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:3.0:1784188972.817432:0:84459:0:(genops.c:1579:class_disconnect_exports()) OBD device 13 (ffff9dc049be19c0) has no exports 00000100:00100000:2.0:1784188972.817840:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc0477c3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+3:3639:x1870854458011008:12345-0@lo:39:umount.0 Request processed in 1392us (1902us total) trans 81604378731 rc 0/0 00000100:00100000:2.0:1784188972.817848:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3685 00010000:00010000:2.0:1784188972.817914:0:7454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784188972.817920:0:26173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:3.0:1784188972.818005:0:84459:0:(genops.c:1579:class_disconnect_exports()) OBD device 13 (ffff9dc049be19c0) has no exports 00000100:00080000:0.0:1784188972.818842:0:3639:0:(import.c:65:import_set_state_nolock()) ffff9dc0477b4000 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:0.0:1784188972.818850:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf44bc2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3639:1870854458011008:0@lo:39:umount.0 00000100:00100000:0.0:1784188972.818867:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf44bc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3639:1870854458011264:0@lo:9:umount.0 00000100:00100000:0.0:1784188972.818912:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1784188972.819658:0:3639:0:(import.c:65:import_set_state_nolock()) ffff9dbf4845f000 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:0.0:1784188972.819675:0:3639:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:0.0:1784188972.819677:0:3639:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1784188972.819681:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf44bc0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3639:1870854458011136:0@lo:9:umount.0 00000100:00100000:1.0:1784188972.820396:0:26169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458011264 00000100:00100000:1.0:1784188972.820404:0:26169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458011264 00000100:00100000:1.0:1784188972.820471:0:26169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4915 00000100:00100000:1.0:1784188972.820480:0:26169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc07b222d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+5:3639:x1870854458011264:12345-0@lo:9:umount.0 00000020:00000080:1.0:1784188972.820504:0:26169:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xcc1762b626f8a0f2 00000100:00080000:1.0:1784188972.820511:0:26169:0:(import.c:65:import_set_state_nolock()) ffff9dc07a884000 : changing import state from FULL to CLOSED 00000100:00080000:0.0:1784188972.820618:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00000004:1.0:1784188972.820708:0:26169:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294968951 00000100:00100000:1.0:1784188972.820976:0:26169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc07b222d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+2:3639:x1870854458011264:12345-0@lo:9:umount.0 Request processed in 496us (2062us total) trans 0 rc 0/0 00000100:00100000:1.0:1784188972.820984:0:26169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4915 00010000:00010000:1.0:1784188972.821004:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1784188972.824474:0:3639:0:(import.c:65:import_set_state_nolock()) ffff9dc05f22b000 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:0.0:1784188972.825627:0:3639:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:0.0:1784188972.828453:0:3639:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1784188972.828471:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf44bc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3639:1870854458011264:0@lo:9:umount.0 00000020:00000080:3.0:1784188972.876034:0:84459:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xcc1762b626f8a09e 00000020:00000080:3.0:1784188972.876051:0:84459:0:(genops.c:906:class_export_put()) final put ffff9dc075485800/lustre-QMT0000_UUID 00000020:01000000:3.0:1784188972.876116:0:84459:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:3.0:1784188972.876820:0:84459:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1784188972.876833:0:84459:0:(obd_config.c:955:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1784188972.876838:0:84459:0:(genops.c:1579:class_disconnect_exports()) OBD device 15 (ffff9dc06bb33380) has no exports 00000020:00000080:3.0:1784188972.877144:0:84459:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xcc1762b626f8a097 00000020:00000080:3.0:1784188972.877151:0:84459:0:(genops.c:906:class_export_put()) final put ffff9dc05106f000/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1784188972.877207:0:63468:0:(genops.c:865:class_export_destroy()) destroying export ffff9dc075485800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:2.0:1784188972.877717:0:63468:0:(genops.c:865:class_export_destroy()) destroying export ffff9dc05106f000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1784188972.877864:0:84459:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1784188972.877876:0:84459:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:1.0:1784188972.877880:0:84459:0:(genops.c:906:class_export_put()) final put ffff9dc071555000/lustre-QMT0000_UUID 00000020:00000080:1.0:1784188972.877882:0:84459:0:(genops.c:865:class_export_destroy()) destroying export ffff9dc071555000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:1.0:1784188972.877891:0:84459:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00000020:01000000:1.0:1784188972.878038:0:84459:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9dbf45b1d1e0 - data ffff9dc06be86000/ffff9dc0564cdc00 00000020:01000000:1.0:1784188972.878171:0:84459:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9dc081c45780 - data ffff9dc06bfcb6c0/ffff9dc075a93c00 00000100:00080000:2.0:1784188972.915955:0:84459:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1784188972.915964:0:84459:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 81604378730 gen 4 00000100:00100000:2.0:1784188972.915979:0:84459:0:(client.c:3150:ptlrpc_free_committed()) @@@ free request with old gen req@ffff9dbf44bc2a00 x1870854458011008/t81604378731(81604378731) o39->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1784188982 ref 1 fl Complete:RNQU/204/0 rc 0/0 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784188972.916003:0:84459:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:2.0:1784188972.917757:0:84459:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1784188972.917774:0:84459:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294968947 gen 4 00000004:00080000:2.0:1784188972.917793:0:84459:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1784188972.917796:0:84459:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:1.0:1784188972.918258:0:83239:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:1.0:1784188972.918263:0:83239:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x58:0x0] index 1 count 1 00000040:00080000:1.0:1784188972.918274:0:83239:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 22 count 2 00000100:00080000:2.0:1784188972.919124:0:84459:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1784188972.919129:0:84459:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294968951 gen 4 00000004:00080000:2.0:1784188972.919149:0:84459:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1784188972.919151:0:84459:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:1.0:1784188972.919537:0:83241:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:1.0:1784188972.919541:0:83241:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x5a:0x0] index 2 count 1 00000040:00080000:1.0:1784188972.919550:0:83241:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 22 count 2 00000020:00000080:2.0:1784188972.921012:0:84459:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xcc1762b626f8a058 00000020:00000080:2.0:1784188972.921022:0:84459:0:(genops.c:906:class_export_put()) final put ffff9dc050ae5000/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1784188972.922153:0:84459:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xcc1762b626f8a06d 00000020:00000080:2.0:1784188972.922162:0:84459:0:(genops.c:906:class_export_put()) final put ffff9dbf46b08800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1784188972.922688:0:63468:0:(genops.c:865:class_export_destroy()) destroying export ffff9dc050ae5000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:2.0:1784188972.922790:0:84459:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:2.0:1784188972.922797:0:84459:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1784188972.922808:0:84459:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1784188972.922812:0:84459:0:(genops.c:1579:class_disconnect_exports()) OBD device 12 (ffff9dc049be3380) has no exports 00000020:00000080:1.0:1784188972.923028:0:63468:0:(genops.c:865:class_export_destroy()) destroying export ffff9dbf46b08800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000004:01000000:2.0:1784188972.923189:0:84459:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:2.0:1784188972.923200:0:84459:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xcc1762b626f8a0eb 00000020:00000080:2.0:1784188972.923206:0:84459:0:(genops.c:906:class_export_put()) final put ffff9dbf48458000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:2.0:1784188972.923221:0:84459:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:2.0:1784188972.923225:0:84459:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1784188972.923233:0:84459:0:(obd_config.c:955:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1784188972.923236:0:84459:0:(genops.c:1579:class_disconnect_exports()) OBD device 27 (ffff9dc0762999c0) has no exports 00000020:00000080:2.0:1784188972.923242:0:84459:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xcc1762b626f8a0dd 00000020:00000080:2.0:1784188972.923256:0:84459:0:(genops.c:906:class_export_put()) final put ffff9dc058018000/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1784188972.923393:0:63468:0:(genops.c:865:class_export_destroy()) destroying export ffff9dbf48458000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:00000080:1.0:1784188972.923399:0:63468:0:(genops.c:865:class_export_destroy()) destroying export ffff9dc058018000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:2.0:1784188972.923758:0:84459:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:2.0:1784188972.923821:0:84459:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1784188972.923826:0:84459:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294968951 gen 5 00000004:00080000:2.0:1784188972.923831:0:84459:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1784188972.923833:0:84459:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1784188972.923879:0:84459:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1784188972.923888:0:84459:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1784188972.923894:0:84459:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xcc1762b626f8a0cf 00000020:00000080:2.0:1784188972.923899:0:84459:0:(genops.c:906:class_export_put()) final put ffff9dbf43fcb000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:2.0:1784188972.923902:0:84459:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:2.0:1784188972.923977:0:84459:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1784188972.923984:0:84459:0:(obd_config.c:955:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1784188972.923986:0:84459:0:(genops.c:1579:class_disconnect_exports()) OBD device 22 (ffff9dc07547cd40) has no exports 00000020:00000080:2.0:1784188972.923991:0:84459:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xcc1762b626f8a0c1 00000020:00000080:2.0:1784188972.923995:0:84459:0:(genops.c:906:class_export_put()) final put ffff9dbf4845a000/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1784188972.924401:0:63468:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9dc05f22b000 for lustre-OST0001-osc-MDT0000 00000020:00000080:1.0:1784188972.924407:0:63468:0:(genops.c:906:class_export_put()) final put ffff9dbf4845b800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1784188972.924410:0:63468:0:(genops.c:865:class_export_destroy()) destroying export ffff9dbf4845b800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:1.0:1784188972.924415:0:63468:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1784188972.924493:0:63468:0:(genops.c:865:class_export_destroy()) destroying export ffff9dbf43fcb000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:00000080:1.0:1784188972.924498:0:63468:0:(genops.c:865:class_export_destroy()) destroying export ffff9dbf4845a000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:2.0:1784188972.924661:0:84459:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:2.0:1784188972.924665:0:84459:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1784188972.924667:0:84459:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294968947 gen 5 00000004:00080000:2.0:1784188972.924670:0:84459:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1784188972.924672:0:84459:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1784188972.924709:0:84459:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1784188972.924716:0:84459:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000004:01000000:2.0:1784188972.924728:0:84459:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:2.0:1784188972.924733:0:84459:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xcc1762b626f8a0b3 00000020:00000080:2.0:1784188972.924737:0:84459:0:(genops.c:906:class_export_put()) final put ffff9dc0477b2800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:2.0:1784188972.924741:0:84459:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osp-MDT0000 (flags='') 00000020:00000080:2.0:1784188972.924745:0:84459:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1784188972.924749:0:84459:0:(obd_config.c:955:class_cleanup()) lustre-MDT0001-osp-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1784188972.924752:0:84459:0:(genops.c:1579:class_disconnect_exports()) OBD device 21 (ffff9dc06bb34d40) has no exports 00000020:00000080:2.0:1784188972.924757:0:84459:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xcc1762b626f8a0ac 00000020:00000080:2.0:1784188972.924759:0:84459:0:(genops.c:906:class_export_put()) final put ffff9dc0477b5000/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1784188972.924988:0:63468:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9dbf4845f000 for lustre-OST0000-osc-MDT0000 00000020:00000080:1.0:1784188972.924994:0:63468:0:(genops.c:906:class_export_put()) final put ffff9dc047a87000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1784188972.924996:0:63468:0:(genops.c:865:class_export_destroy()) destroying export ffff9dc047a87000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:1.0:1784188972.925000:0:63468:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1784188972.925036:0:63468:0:(genops.c:865:class_export_destroy()) destroying export ffff9dc0477b2800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:00000080:1.0:1784188972.925040:0:63468:0:(genops.c:865:class_export_destroy()) destroying export ffff9dc0477b5000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:2.0:1784188972.959845:0:84459:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0001-osp-MDT0000: client import never connected 00000100:00080000:2.0:1784188972.959854:0:84459:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1784188972.959860:0:84459:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 81604378730 gen 5 00000100:00100000:2.0:1784188972.959869:0:84459:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1784188972.959958:0:84459:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1784188972.959972:0:84459:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1784188972.960002:0:84459:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1784188972.960007:0:84459:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1784188972.960012:0:84459:0:(genops.c:906:class_export_put()) final put ffff9dbf4512e000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1784188972.960018:0:84459:0:(genops.c:865:class_export_destroy()) destroying export ffff9dbf4512e000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:2.0:1784188972.960026:0:84459:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1784188972.960256:0:84459:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xcc1762b626f8a074 00000020:00000080:2.0:1784188972.960264:0:84459:0:(genops.c:906:class_export_put()) final put ffff9dbf46b0a000/lustre-MDD0000_UUID 00000020:01000000:2.0:1784188972.963882:0:84459:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:2.0:1784188972.963893:0:84459:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1784188972.963979:0:84459:0:(obd_config.c:955:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1784188972.963990:0:84459:0:(genops.c:1579:class_disconnect_exports()) OBD device 14 (ffff9dc06bb319c0) has no exports 00000020:00000080:2.0:1784188972.964023:0:84459:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1784188972.964031:0:84459:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:2.0:1784188972.964038:0:84459:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xcc1762b626f8a07b 00000020:00000080:2.0:1784188972.964105:0:84459:0:(genops.c:906:class_export_put()) final put ffff9dbf46b09000/lustre-MDT0000-osd_UUID 00000020:01000004:2.0:1784188972.964115:0:84459:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9dc047a81000 from lustre-MDT0000, refs=3 00000020:01000004:2.0:1784188972.964118:0:84459:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9dc047a81000 3 00000020:01000004:2.0:1784188972.964122:0:84459:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9dc047a81000 from lustre-MDT0000 00000020:00000080:2.0:1784188972.964143:0:84459:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1784188972.964148:0:84459:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:2.0:1784188972.964151:0:84459:0:(genops.c:906:class_export_put()) final put ffff9dc050ae7800/lustre-MDT0000_UUID 00000020:00000080:2.0:1784188972.964153:0:84459:0:(genops.c:865:class_export_destroy()) destroying export ffff9dc050ae7800/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:2.0:1784188972.964161:0:84459:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:2.0:1784188972.964228:0:84459:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 3 references. 00000020:01000004:2.0:1784188972.964231:0:84459:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:2.0:1784188972.964235:0:84459:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:2.0:1784188972.964247:0:84459:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1784188972.964250:0:84459:0:(obd_config.c:955:class_cleanup()) MGS: forcing exports to disconnect: 2/5 00000020:00080000:2.0:1784188972.964258:0:84459:0:(genops.c:1840:print_export_data()) MGS: ACTIVE ffff9dbf43d8d800 9957a2dc-fd88-4a91-bca3-e2b7f365ab0c 192.168.203.12@tcp 9 (0 0 4) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1784188972.964264:0:84459:0:(genops.c:1840:print_export_data()) MGS: ACTIVE ffff9dc071188000 bd553d0d-03e2-4233-b06b-b55bbfa2b954 0@lo 18 (0 0 13) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1784188972.964269:0:84459:0:(genops.c:1574:class_disconnect_exports()) OBD device 3 (ffff9dc049be0000) has exports, disconnecting them 00000020:00080000:2.0:1784188972.964273:0:84459:0:(genops.c:1549:class_disconnect_export_list()) MGS: disconnecting export at 192.168.203.12@tcp (ffff9dbf43d8d800), last request at 1784188763 00000020:00000080:2.0:1784188972.964296:0:84459:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xcc1762b626f8a1fc 00000020:00010000:2.0:1784188972.964342:0:84459:0:(genops.c:1942:obd_stale_export_put()) Put export ffff9dbf43d8d800: total 2 00000100:00080000:2.0:1784188972.964347:0:84459:0:(import.c:65:import_set_state_nolock()) ffff9dbf43d8e800 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1784188972.964434:0:84459:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 192.168.203.12@tcp (ffff9dbf43d8d800): rc 0 00000020:00080000:2.0:1784188972.964438:0:84459:0:(genops.c:1549:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff9dc071188000), last request at 1784188760 00000020:00000080:2.0:1784188972.964501:0:84459:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xcc1762b626f8a019 00000020:00010000:2.0:1784188972.964505:0:84459:0:(genops.c:1942:obd_stale_export_put()) Put export ffff9dc071188000: total 2 00000100:00080000:2.0:1784188972.964507:0:84459:0:(import.c:65:import_set_state_nolock()) ffff9dc07118d800 : changing import state from FULL to CLOSED 00000020:00000080:1.0:1784188972.964549:0:63468:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9dc0477b4000 for lustre-MDT0001-osp-MDT0000 00000020:00000080:1.0:1784188972.964556:0:63468:0:(genops.c:906:class_export_put()) final put ffff9dc0477b1000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1784188972.964558:0:63468:0:(genops.c:865:class_export_destroy()) destroying export ffff9dc0477b1000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:01000000:1.0:1784188972.964568:0:63468:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osp-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1784188972.964624:0:63468:0:(genops.c:865:class_export_destroy()) destroying export ffff9dbf46b0a000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:1.0:1784188972.964628:0:63468:0:(genops.c:906:class_export_put()) final put ffff9dbf46b0a800/lustre-MDD0000_UUID 00000020:00000080:1.0:1784188972.964630:0:63468:0:(genops.c:865:class_export_destroy()) destroying export ffff9dbf46b0a800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:1.0:1784188972.964641:0:63468:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:00000080:1.0:1784188972.964668:0:63468:0:(genops.c:865:class_export_destroy()) destroying export ffff9dbf46b09000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00010000:1.0:1784188972.964697:0:6501:0:(genops.c:1928:obd_stale_export_get()) Get export ffff9dbf43d8d800: total 0 00010000:00010000:1.0:1784188972.964725:0:6501:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff9dbf43d8d800, canceled 0 locks, left on hash table 4. 00010000:00010000:1.0:1784188972.964753:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dc05ec0ce00/0xcc1762b626f8a218 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c3c81 expref: 5 pid: 83228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:2.0:1784188972.964809:0:84459:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9dc071188000): rc 0 00000020:00080000:2.0:1784188972.964814:0:84459:0:(genops.c:1579:class_disconnect_exports()) OBD device 3 (ffff9dc049be0000) has no exports 00000020:00010000:2.0:1784188972.964822:0:7454:0:(genops.c:1928:obd_stale_export_get()) Get export ffff9dc071188000: total 0 00010000:00010000:2.0:1784188972.964849:0:7454:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff9dc071188000, canceled 0 locks, left on hash table 13. 00010000:00010000:2.0:1784188972.964868:0:7454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dc080f04c00/0xcc1762b626f8a1bd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xcc1762b626f8a1b6 expref: 14 pid: 83231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784188972.964882:0:7454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dc04a20bc00/0xcc1762b626f8a14d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xcc1762b626f8a146 expref: 13 pid: 83231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784188972.964891:0:7454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dc04a20b000/0xcc1762b626f8a1cb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xcc1762b626f8a1c4 expref: 12 pid: 83226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784188972.964900:0:7454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dc04a20a800/0xcc1762b626f8a15b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xcc1762b626f8a154 expref: 11 pid: 83226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784188972.965117:0:7454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dc070146e00/0xcc1762b626f8a169 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xcc1762b626f8a162 expref: 10 pid: 83228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784188972.965132:0:7454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dc070146000/0xcc1762b626f8a1e7 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xcc1762b626f8a1e0 expref: 9 pid: 83227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784188972.965146:0:7454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dc04a20aa00/0xcc1762b626f8a177 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xcc1762b626f8a170 expref: 8 pid: 83228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784188972.965157:0:7454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dc05ec0c800/0xcc1762b626f8a1f5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xcc1762b626f8a1ee expref: 7 pid: 83226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784188972.965167:0:7454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dc070146c00/0xcc1762b626f8a1d9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xcc1762b626f8a1d2 expref: 6 pid: 83226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784188972.965175:0:7454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dc04a20ac00/0xcc1762b626f8a193 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xcc1762b626f8a18c expref: 5 pid: 83226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784188972.965185:0:7454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dc04a20b600/0xcc1762b626f8a185 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xcc1762b626f8a17e expref: 4 pid: 83227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784188972.965195:0:7454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dc080f05800/0xcc1762b626f8a1a1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xcc1762b626f8a19a expref: 3 pid: 83228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784188972.965204:0:7454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dc04a20a400/0xcc1762b626f8a1af lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xcc1762b626f8a1a8 expref: 2 pid: 83226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784188972.965212:0:7454:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff9dc071188000, canceled 13 locks, left on hash table 0. 00000020:00000080:2.0:1784188972.965230:0:7454:0:(genops.c:906:class_export_put()) final put ffff9dc071188000/bd553d0d-03e2-4233-b06b-b55bbfa2b954 00010000:00010000:2.0:1784188972.965242:0:7454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784188972.965250:0:7454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784188972.965252:0:7454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784188972.965311:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dc05ec0da00/0xcc1762b626f8a203 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c3c6c expref: 4 pid: 83228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784188972.965353:0:83227:0:(service.c:3183:ptlrpc_main()) ll_mgs_0001: service thread [ffff9dc0761c3800:83227] 1 exiting: rc = 0 00010000:00010000:1.0:1784188972.965579:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dc05ec0d800/0xcc1762b626f8a211 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c3c7a expref: 3 pid: 83231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784188972.965591:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dc05ec0c400/0xcc1762b626f8a20a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c3c73 expref: 2 pid: 83226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784188972.965600:0:6501:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff9dbf43d8d800, canceled 4 locks, left on hash table 0. 00000020:00000080:1.0:1784188972.965616:0:6501:0:(genops.c:906:class_export_put()) final put ffff9dbf43d8d800/9957a2dc-fd88-4a91-bca3-e2b7f365ab0c 00010000:00010000:1.0:1784188972.965622:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784188972.965623:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784188972.965625:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1784188972.965659:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9dc071188000/bd553d0d-03e2-4233-b06b-b55bbfa2b954 for MGS 00000020:00000080:1.0:1784188972.965690:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9dbf43d8d800/9957a2dc-fd88-4a91-bca3-e2b7f365ab0c for MGS 00000020:00000080:1.0:1784188972.965703:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9dc07118d800 for MGS 00000020:00000080:1.0:1784188972.965706:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9dbf43d8e800 for MGS 00000100:00100000:1.0:1784188972.965734:0:83231:0:(service.c:3183:ptlrpc_main()) ll_mgs_0003: service thread [ffff9dc056591400:83231] 3 exiting: rc = 0 00000100:00100000:1.0:1784188972.965884:0:83228:0:(service.c:3183:ptlrpc_main()) ll_mgs_0002: service thread [ffff9dc07609dc00:83228] 2 exiting: rc = 0 00000100:00100000:1.0:1784188972.966016:0:83226:0:(service.c:3183:ptlrpc_main()) ll_mgs_0000: service thread [ffff9dc07609de00:83226] 0 exiting: rc = 1 00000100:00100000:2.0:1784188972.966176:0:84459:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784188972.966184:0:84459:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784188972.966191:0:84459:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784188972.966197:0:84459:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784188972.966203:0:84459:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784188972.966209:0:84459:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784188972.966216:0:84459:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784188972.966221:0:84459:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784188972.966228:0:84459:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784188972.966234:0:84459:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784188972.966241:0:84459:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784188972.966246:0:84459:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784188972.966252:0:84459:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784188972.966257:0:84459:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784188972.966262:0:84459:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784188972.966268:0:84459:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784188972.966274:0:84459:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784188972.966281:0:84459:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784188972.966286:0:84459:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784188972.966291:0:84459:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784188972.966296:0:84459:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784188972.966302:0:84459:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784188972.966309:0:84459:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784188972.966315:0:84459:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784188972.966352:0:84459:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784188972.966358:0:84459:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784188972.966435:0:84459:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784188972.966442:0:84459:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784188972.966448:0:84459:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784188972.966453:0:84459:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784188972.966459:0:84459:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784188972.966465:0:84459:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784188972.966484:0:84459:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784188972.966490:0:84459:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784188972.966498:0:84459:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784188972.966504:0:84459:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784188972.966510:0:84459:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784188972.966515:0:84459:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784188972.966521:0:84459:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784188972.966527:0:84459:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784188972.966532:0:84459:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784188972.966537:0:84459:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784188972.966543:0:84459:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784188972.966548:0:84459:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784188972.966554:0:84459:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784188972.966559:0:84459:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784188972.966565:0:84459:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784188972.966571:0:84459:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784188972.966577:0:84459:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784188972.966582:0:84459:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784188972.966588:0:84459:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784188972.966593:0:84459:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784188972.966599:0:84459:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784188972.966605:0:84459:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784188972.966611:0:84459:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784188972.966617:0:84459:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784188972.966623:0:84459:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784188972.966629:0:84459:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784188972.966645:0:84459:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784188972.966651:0:84459:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784188972.966657:0:84459:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784188972.966662:0:84459:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784188972.966670:0:84459:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784188972.966678:0:84459:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:01000000:2.0:1784188972.968517:0:84459:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9dc081c34120 - data ffff9dc06bd0c000/ffff9dc044986c00 00000020:01000000:2.0:1784188972.968697:0:84459:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9dbf447df180 - data ffff9dc06bcef000/ffff9dc0762d8000 00000020:00000080:2.0:1784188972.969479:0:84459:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xcc1762b626f8a012 00000020:00000080:2.0:1784188972.969501:0:84459:0:(genops.c:906:class_export_put()) final put ffff9dbf45128800/lustre-MDT0000-osd_UUID 00000020:01000004:2.0:1784188972.969547:0:84459:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9dc047a81000 from MGS, refs=2 00000020:01000004:2.0:1784188972.969551:0:84459:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9dc047a81000 2 00000020:01000004:2.0:1784188972.969562:0:84459:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9dc047a81000 from MGS 00000020:00000080:2.0:1784188972.969584:0:84459:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1784188972.969591:0:84459:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:2.0:1784188972.969594:0:84459:0:(genops.c:906:class_export_put()) final put ffff9dbf4512b800/MGS 00000020:00000080:2.0:1784188972.969596:0:84459:0:(genops.c:865:class_export_destroy()) destroying export ffff9dbf4512b800/MGS for MGS 00000020:01000000:2.0:1784188972.969603:0:84459:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:2.0:1784188972.969675:0:84459:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:2.0:1784188972.969679:0:84459:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1784188972.969689:0:84459:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1784188972.969696:0:84459:0:(genops.c:1840:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff9dc075656800 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1784188972.969702:0:84459:0:(genops.c:1574:class_disconnect_exports()) OBD device 28 (ffff9dbf44d78000) has exports, disconnecting them 00000020:00080000:2.0:1784188972.969707:0:84459:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff9dc075656800), last request at 1784188761 00000020:00000080:2.0:1784188972.969711:0:84459:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xcc1762b626f8a12a 00000020:00080000:2.0:1784188972.969720:0:84459:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9dc075656800): rc 0 00000020:00000080:2.0:1784188972.969724:0:84459:0:(genops.c:906:class_export_put()) final put ffff9dc075656800/lustre-MDT0000-lwp-MDT0000 00000020:00000080:1.0:1784188972.969894:0:63468:0:(genops.c:865:class_export_destroy()) destroying export ffff9dbf45128800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1784188972.975523:0:63468:0:(genops.c:865:class_export_destroy()) destroying export ffff9dc075656800/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:3.0:1784188972.986401:0:84459:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:3.0:1784188972.986409:0:84459:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1784188972.986413:0:84459:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:3.0:1784188972.986420:0:84459:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1784188972.986580:0:84459:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1784188972.986595:0:84459:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:3.0:1784188972.986602:0:84459:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9dc047a81000 1 00000020:00000080:3.0:1784188972.986608:0:84459:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xcc1762b626f8a004 00000020:00000080:3.0:1784188972.986616:0:84459:0:(genops.c:906:class_export_put()) final put ffff9dbf45129000/lustre-MDT0000-osd_UUID 00000020:01000000:3.0:1784188972.986621:0:84459:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:3.0:1784188972.986629:0:84459:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1784188972.986643:0:84459:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1784188972.986646:0:84459:0:(genops.c:1579:class_disconnect_exports()) OBD device 0 (ffff9dc075478000) has no exports 00000020:00000080:1.0:1784188972.987857:0:63468:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9dc075651000 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:1.0:1784188972.987870:0:63468:0:(genops.c:906:class_export_put()) final put ffff9dc042e36000/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:1.0:1784188972.987884:0:63468:0:(genops.c:865:class_export_destroy()) destroying export ffff9dc042e36000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:1.0:1784188972.987895:0:63468:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:1.0:1784188972.987990:0:63468:0:(genops.c:865:class_export_destroy()) destroying export ffff9dbf45129000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1784188973.078992:0:84459:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1784188973.079004:0:84459:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:2.0:1784188973.079010:0:84459:0:(genops.c:906:class_export_put()) final put ffff9dc047a83800/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1784188973.079015:0:84459:0:(genops.c:865:class_export_destroy()) destroying export ffff9dc047a83800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:2.0:1784188973.079026:0:84459:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:2.0:1784188973.079154:0:84459:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9dc047a80000 00000020:02000400:2.0:1784188973.079216:0:84459:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-MDT0000 complete 00000100:00100000:2.0:1784188973.104492:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc080f68000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3641:1870854458011392:0@lo:400:kworker.0 00000100:00100000:2.0:1784188973.104557:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784188973.104585:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc080f68a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1870854458011904:0@lo:400:kworker.0 00000100:00100000:2.0:1784188973.104608:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784188973.104640:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1784188973.104655:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc080f68e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3641:1870854458011776:0@lo:400:kworker.0 00000100:00100000:2.0:1784188973.104680:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784188973.104901:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc074ad0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3641:1870854458012288:0@lo:400:kworker.0 00000100:00100000:2.0:1784188973.104932:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784188973.104968:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc080f68380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3642:1870854458011520:0@lo:400:kworker.0 00000100:00100000:2.0:1784188973.104994:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784188973.105016:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc080f69c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1870854458012032:0@lo:400:kworker.0 00000100:00100000:2.0:1784188973.105039:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784188973.105080:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1784188973.105088:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc080f69f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3642:1870854458011648:0@lo:400:kworker.0 00000100:00100000:2.0:1784188973.105113:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784188973.105132:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc074ad1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1870854458012160:0@lo:400:kworker.0 00000100:00100000:2.0:1784188973.105155:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784188973.105187:0:68287:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458011392 00000100:00100000:2.0:1784188973.105193:0:68287:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458011392 00000100:00100000:2.0:1784188973.105344:0:68287:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458011776 00000100:00100000:2.0:1784188973.105348:0:68287:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458011776 00000100:00100000:2.0:1784188973.105379:0:68287:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458012288 00000100:00100000:2.0:1784188973.105382:0:68287:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458012288 00000100:00100000:2.0:1784188973.105392:0:68287:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458011520 00000100:00100000:2.0:1784188973.105395:0:68287:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458011520 00000100:00100000:2.0:1784188973.105412:0:68287:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458011648 00000100:00100000:2.0:1784188973.105414:0:68287:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458011648 00000100:00100000:2.0:1784188973.105430:0:68287:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 971 00000100:00100000:2.0:1784188973.105440:0:68287:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc074ad1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1870854458011776:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784188973.105493:0:68287:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc074ad1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1870854458011776:12345-0@lo:400:kworker.0 Request processed in 54us (811us total) trans 0 rc 0/0 00000100:00100000:2.0:1784188973.105501:0:68287:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 971 00000100:00100000:2.0:1784188973.105529:0:68287:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 972 00000100:00100000:2.0:1784188973.105536:0:68287:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc074ad3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1870854458011520:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784188973.105570:0:68287:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc074ad3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1870854458011520:12345-0@lo:400:kworker.0 Request processed in 35us (577us total) trans 0 rc 0/0 00000100:00100000:2.0:1784188973.105576:0:68287:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 972 00000100:00100000:2.0:1784188973.105589:0:68287:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1021 00000100:00100000:2.0:1784188973.105593:0:68287:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc074ad1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3641:x1870854458011392:12345-0@lo:400:kworker.0 00000020:00080000:2.0:1784188973.105598:0:68287:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:2.0:1784188973.105621:0:68287:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc074ad1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3641:x1870854458011392:12345-0@lo:400:kworker.0 Request processed in 27us (1064us total) trans 0 rc -107/-107 00000100:00100000:2.0:1784188973.105627:0:68287:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1021 00000100:00100000:2.0:1784188973.105648:0:68287:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1022 00000100:00100000:2.0:1784188973.105652:0:68287:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc074ad1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3641:x1870854458012288:12345-0@lo:400:kworker.0 00000020:00080000:2.0:1784188973.105656:0:68287:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:2.0:1784188973.105677:0:68287:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc074ad1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3641:x1870854458012288:12345-0@lo:400:kworker.0 Request processed in 23us (744us total) trans 0 rc -107/-107 00000100:00100000:2.0:1784188973.105682:0:68287:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1022 00000100:00100000:2.0:1784188973.105692:0:68287:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1023 00000100:00100000:2.0:1784188973.105814:0:68287:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc074ad2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3642:x1870854458011648:12345-0@lo:400:kworker.0 00000020:00080000:2.0:1784188973.105822:0:68287:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:2.0:1784188973.105846:0:68287:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc074ad2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3642:x1870854458011648:12345-0@lo:400:kworker.0 Request processed in 148us (733us total) trans 0 rc -107/-107 00000100:00100000:2.0:1784188973.105853:0:68287:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1023 00000100:00100000:2.0:1784188973.105872:0:26162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458012032 00000100:00100000:2.0:1784188973.105876:0:26162:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458012032 00000100:00100000:2.0:1784188973.105899:0:26162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458012160 00000100:00100000:2.0:1784188973.105902:0:26162:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458012160 00000100:00100000:2.0:1784188973.105929:0:26162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2283 00000100:00100000:2.0:1784188973.105935:0:26162:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc074ad1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:3642:x1870854458012032:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784188973.105965:0:26162:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc074ad1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:3642:x1870854458012032:12345-0@lo:400:kworker.0 Request processed in 31us (925us total) trans 0 rc 0/0 00000100:00100000:2.0:1784188973.105971:0:26162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2283 00000100:00100000:2.0:1784188973.105982:0:26162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2284 00000100:00100000:2.0:1784188973.105988:0:26162:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc074ad2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:3642:x1870854458012160:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784188973.106013:0:26162:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc074ad2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:3642:x1870854458012160:12345-0@lo:400:kworker.0 Request processed in 25us (858us total) trans 0 rc 0/0 00000100:00100000:2.0:1784188973.106019:0:26162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2284 00000100:00080000:2.0:1784188973.106040:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1784188973.106185:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc080f68e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3641:1870854458011776:0@lo:400:kworker.0 00000100:00080000:2.0:1784188973.106612:0:3641:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1784188973.106617:0:3641:0:(import.c:65:import_set_state_nolock()) ffff9dbf43690800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:2.0:1784188973.106621:0:3641:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00100000:3.0:1784188973.106708:0:23826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458011904 00000100:00100000:3.0:1784188973.106714:0:23826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458011904 00000100:00100000:3.0:1784188973.106744:0:23826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3686 00000100:00100000:3.0:1784188973.106751:0:23826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc074ad0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3641:x1870854458011904:12345-0@lo:400:kworker.0 00000020:00080000:3.0:1784188973.106758:0:23826:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:3.0:1784188973.106796:0:23826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc074ad0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3641:x1870854458011904:12345-0@lo:400:kworker.0 Request processed in 45us (2187us total) trans 0 rc -107/-107 00000100:00100000:3.0:1784188973.106803:0:23826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3686 00000100:00080000:2.0:1784188973.129346:0:3641:0:(import.c:65:import_set_state_nolock()) ffff9dbf43690800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1784188973.129357:0:3641:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3008 00000100:00080000:2.0:1784188973.129367:0:3641:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff9dbf43690800 using connection 192.168.203.112@tcp/0@lo 00000100:00100000:2.0:1784188973.129404:0:3641:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9dc074ad0a80 x1870854458012416/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1784188973.129436:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc074ad0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3641:1870854458012288:0@lo:400:kworker.0 00000100:00080000:2.0:1784188973.129469:0:3641:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0000 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1784188973.129473:0:3641:0:(import.c:65:import_set_state_nolock()) ffff9dbf42271800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:2.0:1784188973.129476:0:3641:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:2.0:1784188973.129495:0:3641:0:(import.c:65:import_set_state_nolock()) ffff9dbf42271800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1784188973.129499:0:3641:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3008 00000100:00080000:2.0:1784188973.129503:0:3641:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9dbf42271800 using connection 192.168.203.112@tcp/0@lo 00000100:00100000:2.0:1784188973.129519:0:3641:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9dc074ad0700 x1870854458012544/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1784188973.129532:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc080f68000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3641:1870854458011392:0@lo:400:kworker.0 00000100:00080000:2.0:1784188973.129550:0:3641:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-osp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1784188973.129553:0:3641:0:(import.c:65:import_set_state_nolock()) ffff9dbf436c4000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:2.0:1784188973.129556:0:3641:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:2.0:1784188973.129560:0:3641:0:(import.c:65:import_set_state_nolock()) ffff9dbf436c4000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1784188973.129564:0:3641:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3189 00000100:00080000:2.0:1784188973.129568:0:3641:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9dbf436c4000 using connection 192.168.203.112@tcp/0@lo 00000100:00100000:2.0:1784188973.129581:0:3641:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9dc074ad2300 x1870854458012672/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1784188973.129592:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc080f68a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1870854458011904:0@lo:400:kworker.0 00000100:00080000:2.0:1784188973.129659:0:3642:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1784188973.129662:0:3642:0:(import.c:65:import_set_state_nolock()) ffff9dbf425f4800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:2.0:1784188973.129665:0:3642:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:2.0:1784188973.129668:0:3642:0:(import.c:65:import_set_state_nolock()) ffff9dbf425f4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1784188973.129671:0:3642:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3008 00000100:00080000:2.0:1784188973.129676:0:3642:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9dbf425f4800 using connection 192.168.203.112@tcp/0@lo 00000100:00100000:2.0:1784188973.129690:0:3642:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9dc074ad0000 x1870854458012800/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1784188973.129720:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc080f69f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3642:1870854458011648:0@lo:400:kworker.0 00000100:00100000:2.0:1784188973.129739:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc074ad1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1870854458012160:0@lo:400:kworker.0 00000100:00100000:2.0:1784188973.129751:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc080f68380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3642:1870854458011520:0@lo:400:kworker.0 00000100:00100000:2.0:1784188973.129763:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc080f69c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1870854458012032:0@lo:400:kworker.0 00000100:00100000:0.0:1784188973.131356:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc074ad0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3639:1870854458012416:0@lo:38:ptlrpcd_00_01.0 00000100:00100000:0.0:1784188973.131426:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784188973.131463:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc074ad0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3639:1870854458012544:0@lo:38:ptlrpcd_00_01.0 00000100:00100000:0.0:1784188973.131485:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784188973.131507:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc074ad2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3639:1870854458012672:0@lo:38:ptlrpcd_00_01.0 00000100:00100000:0.0:1784188973.131530:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784188973.131547:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc074ad0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3639:1870854458012800:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:0.0:1784188973.131567:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784188973.131604:0:66945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458012416 00000100:00100000:0.0:1784188973.131618:0:66945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458012416 00000100:00100000:2.0:1784188973.131664:0:68287:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458012544 00000100:00100000:0.0:1784188973.131667:0:66945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458012800 00000100:00100000:2.0:1784188973.131670:0:68287:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458012544 00000100:00100000:0.0:1784188973.131672:0:66945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458012800 00000100:00100000:0.0:1784188973.131703:0:66945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1024 00000100:00100000:0.0:1784188973.131711:0:66945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc07b221c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3639:x1870854458012416:12345-0@lo:38:ptlrpcd_00_01.0 00000100:00100000:2.0:1784188973.131717:0:68287:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1025 00000100:00100000:2.0:1784188973.131724:0:68287:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc07b223100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3639:x1870854458012544:12345-0@lo:38:ptlrpcd_00_01.0 00010000:00020000:0.0:1784188973.131733:0:66945:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00010000:00020000:2.0:1784188973.131737:0:68287:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1784188973.131791:0:66945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc07b221c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3639:x1870854458012416:12345-0@lo:38:ptlrpcd_00_01.0 Request processed in 79us (364us total) trans 0 rc -19/-19 00000100:00100000:2.0:1784188973.131793:0:68287:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc07b223100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3639:x1870854458012544:12345-0@lo:38:ptlrpcd_00_01.0 Request processed in 68us (306us total) trans 0 rc -19/-19 00000100:00100000:0.0:1784188973.131806:0:66945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1024 00000100:00100000:2.0:1784188973.132435:0:68287:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1025 00000100:00100000:2.0:1784188973.132453:0:68287:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1026 00000100:00100000:2.0:1784188973.132459:0:68287:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc07b221180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3639:x1870854458012800:12345-0@lo:38:ptlrpcd_00_02.0 00010000:00020000:2.0:1784188973.132471:0:68287:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1784188973.132504:0:68287:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc07b221180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3639:x1870854458012800:12345-0@lo:38:ptlrpcd_00_02.0 Request processed in 44us (936us total) trans 0 rc -19/-19 00000100:00100000:2.0:1784188973.132511:0:68287:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1026 00000100:00080000:0.0:1784188973.135873:0:3639:0:(import.c:65:import_set_state_nolock()) ffff9dbf43690800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1784188973.135886:0:3639:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1784188973.135891:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc074ad0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3639:1870854458012416:0@lo:38:ptlrpcd_00_01.0 00000100:00080000:0.0:1784188973.135907:0:3639:0:(import.c:65:import_set_state_nolock()) ffff9dbf42271800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1784188973.135911:0:3639:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1784188973.135914:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc074ad0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3639:1870854458012544:0@lo:38:ptlrpcd_00_01.0 00000100:00080000:0.0:1784188973.135924:0:3639:0:(import.c:65:import_set_state_nolock()) ffff9dbf425f4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1784188973.135928:0:3639:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1784188973.135931:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc074ad0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3639:1870854458012800:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:0.0:1784188973.139406:0:26492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458012672 00000100:00100000:0.0:1784188973.139421:0:26492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458012672 00000100:00100000:0.0:1784188973.139507:0:26492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3687 00000100:00100000:0.0:1784188973.139516:0:26492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc07b221500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3639:x1870854458012672:12345-0@lo:38:ptlrpcd_00_01.0 00010000:00020000:0.0:1784188973.139537:0:26492:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1784188973.139642:0:26492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc07b221500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3639:x1870854458012672:12345-0@lo:38:ptlrpcd_00_01.0 Request processed in 114us (8099us total) trans 0 rc -19/-19 00000100:00100000:0.0:1784188973.139660:0:26492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3687 00000100:00080000:1.0:1784188973.140021:0:3639:0:(import.c:65:import_set_state_nolock()) ffff9dbf436c4000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1784188973.140028:0:3639:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1784188973.140032:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc074ad2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3639:1870854458012672:0@lo:38:ptlrpcd_00_01.0 00000100:00100000:1.0:1784188973.362992:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1784188973.363024:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000400:00000100:1.0:1784188973.363045:0:3634:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-192.168.203.12@tcp portal 26 match 1870854436227200 offset 0 length 224: 4 00000100:00100000:1.0:1784188973.363066:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1784188973.363110:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1784188973.363140:0:26161:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436227584 00000100:00100000:1.0:1784188973.363150:0:26161:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436227584 00000100:00100000:1.0:1784188973.363208:0:26161:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436227712 00000100:00100000:1.0:1784188973.363212:0:26161:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436227712 00000100:00100000:1.0:1784188973.363237:0:26161:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 2285 00000100:00100000:1.0:1784188973.363247:0:26161:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf45124000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+5:2396:x1870854436227584:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:1.0:1784188973.363336:0:26161:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf45124000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+5:2396:x1870854436227584:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 72us (292us total) trans 0 rc 0/0 00000100:00100000:1.0:1784188973.363344:0:26161:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 2285 00000100:00100000:1.0:1784188973.363364:0:26161:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 2286 00000100:00100000:1.0:1784188973.363370:0:26161:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf45126300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+5:2396:x1870854436227712:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:1.0:1784188973.363395:0:26161:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf45126300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+5:2396:x1870854436227712:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 25us (284us total) trans 0 rc 0/0 00000100:00100000:1.0:1784188973.363402:0:26161:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 2286 00000100:00100000:1.0:1784188973.363432:0:66169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436227328 00000100:00100000:1.0:1784188973.363437:0:66169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436227328 00000100:00100000:1.0:1784188973.363460:0:66169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436227456 00000100:00100000:1.0:1784188973.363463:0:66169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436227456 00000100:00100000:1.0:1784188973.363489:0:66169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 973 00000100:00100000:1.0:1784188973.363495:0:66169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf45124e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+6:2396:x1870854436227456:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:1.0:1784188973.363524:0:66169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf45124e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+6:2396:x1870854436227456:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 29us (458us total) trans 0 rc 0/0 00000100:00100000:1.0:1784188973.363530:0:66169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 973 00000100:00100000:1.0:1784188973.363544:0:66169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1027 00000100:00100000:1.0:1784188973.363547:0:66169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf45127b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2396:x1870854436227328:12345-192.168.203.12@tcp:400:kworker.0 00000020:00080000:1.0:1784188973.363553:0:66169:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-192.168.203.12@tcp 00000100:00100000:1.0:1784188973.363573:0:66169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf45127b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2396:x1870854436227328:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 24us (592us total) trans 0 rc -107/-107 00000100:00100000:1.0:1784188973.363579:0:66169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1027 00000100:00080000:1.0:1784188973.363596:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1784188973.363600:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1784188973.363602:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1784188973.369453:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1784188973.369625:0:66171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436227840 00000100:00100000:3.0:1784188973.369643:0:66171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436227840 00000100:00100000:3.0:1784188973.369731:0:66171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1028 00000100:00100000:3.0:1784188973.369739:0:66171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc07b221f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2395:x1870854436227840:12345-192.168.203.12@tcp:38:ptlrpcd_00_00.0 00010000:00020000:3.0:1784188973.369873:0:66171:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.203.12@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1784188973.369934:0:66171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc07b221f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2395:x1870854436227840:12345-192.168.203.12@tcp:38:ptlrpcd_00_00.0 Request processed in 194us (490us total) trans 0 rc -19/-19 00000100:00100000:3.0:1784188973.369942:0:66171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1028 00010000:00010000:2.0:1784188973.813471:0:26173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784188974.836688:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784188975.856019:0:7454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784188976.880836:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784188977.199641:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf44bc2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1870854458012928:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1784188977.199720:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784188977.199838:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458012928 00000100:00100000:3.0:1784188977.199848:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458012928 00000100:00100000:3.0:1784188977.199914:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1826 00000100:00100000:3.0:1784188977.199924:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc074ad1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1870854458012928:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1784188977.199956:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8652352 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1784188977.200001:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc074ad1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1870854458012928:12345-0@lo:13:osp-pre-1-1.0 Request processed in 79us (281us total) trans 0 rc 0/0 00000100:00100000:3.0:1784188977.200007:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1826 00000100:00100000:3.0:1784188977.200053:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf44bc2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1870854458012928:0@lo:13:osp-pre-1-1.0 00000100:00080000:2.0:1784188977.200122:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1784188977.200691:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1784188977.200703:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf46903100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1870854458013056:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1784188977.200751:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784188977.200850:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458013056 00000100:00100000:1.0:1784188977.200854:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458013056 00000100:00100000:1.0:1784188977.200898:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1827 00000100:00100000:1.0:1784188977.200905:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc081f81880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1870854458013056:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1784188977.200922:0:8432:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8652352 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1784188977.200998:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc081f81880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1870854458013056:12345-0@lo:13:osp-pre-0-1.0 Request processed in 93us (246us total) trans 0 rc 0/0 00000100:00100000:1.0:1784188977.201004:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1827 00000100:00080000:2.0:1784188977.201061:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1784188977.203679:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf46903100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1870854458013056:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1784188977.906342:0:26173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1784188978.224677:0:63468:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1784188978.224684:0:63468:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1784188978.224687:0:63468:0:(import.c:65:import_set_state_nolock()) ffff9dbf42271800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1784188978.224695:0:63468:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3215 00000100:00080000:0.0:1784188978.224700:0:63468:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1784188978.224707:0:63468:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9dbf42271800 using connection 192.168.203.112@tcp/0@lo 00000100:00100000:0.0:1784188978.224729:0:63468:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9dc081f83480 x1870854458013312/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1784188978.224758:0:63468:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1784188978.224761:0:63468:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1784188978.224763:0:63468:0:(import.c:65:import_set_state_nolock()) ffff9dbf425f4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1784188978.224766:0:63468:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3215 00000100:00080000:0.0:1784188978.224769:0:63468:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1784188978.224772:0:63468:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9dbf425f4800 using connection 192.168.203.112@tcp/0@lo 00000100:00100000:0.0:1784188978.224783:0:63468:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9dc081f82d80 x1870854458013568/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1784188978.224798:0:63468:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1784188978.224801:0:63468:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1784188978.224816:0:63468:0:(import.c:65:import_set_state_nolock()) ffff9dbf436c4000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1784188978.224819:0:63468:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3215 00000100:00080000:0.0:1784188978.224822:0:63468:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1784188978.224826:0:63468:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9dbf436c4000 using connection 192.168.203.112@tcp/0@lo 00000100:00100000:0.0:1784188978.224840:0:63468:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9dc081f80a80 x1870854458013824/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1784188978.224849:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc081f83480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3639:1870854458013312:0@lo:38:kworker.0 00000100:00080000:0.0:1784188978.224865:0:63468:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1784188978.224867:0:63468:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1784188978.224869:0:63468:0:(import.c:65:import_set_state_nolock()) ffff9dbf43690800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1784188978.224872:0:63468:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3215 00000100:00080000:0.0:1784188978.224874:0:63468:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1784188978.224877:0:63468:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff9dbf43690800 using connection 192.168.203.112@tcp/0@lo 00000100:00100000:0.0:1784188978.224886:0:63468:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9dc081f83800 x1870854458014208/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1784188978.224928:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784188978.224933:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc081f80700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1870854458013952:0@lo:400:kworker.0 00000100:00100000:1.0:1784188978.224959:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc081f82d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3639:1870854458013568:0@lo:38:kworker.0 00000100:00100000:0.0:1784188978.224966:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784188978.224989:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784188978.224993:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1784188978.224998:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc081f81c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bd553d0d-03e2-4233-b06b-b55bbfa2b954:3642:1870854458013184:0@lo:400:kworker.0 00000100:00100000:1.0:1784188978.225006:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc081f80a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3639:1870854458013824:0@lo:38:kworker.0 00000400:00000100:0.0:1784188978.225017:0:3642:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1870854458013184 offset 0 length 224: 4 00000100:00100000:1.0:1784188978.225026:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784188978.225035:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc081f82300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1870854458014080:0@lo:400:kworker.0 00000100:00100000:1.0:1784188978.225038:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc081f83800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3639:1870854458014208:0@lo:38:kworker.0 00000100:00100000:0.0:1784188978.225053:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784188978.225054:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784188978.225081:0:66945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458013312 00000100:00100000:0.0:1784188978.225081:0:26168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458013952 00000100:00100000:1.0:1784188978.225087:0:66945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458013312 00000100:00100000:0.0:1784188978.225087:0:26168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458013952 00000100:00100000:1.0:1784188978.225114:0:66945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458013568 00000100:00100000:0.0:1784188978.225114:0:26168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458014080 00000100:00100000:1.0:1784188978.225117:0:66945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458013568 00000100:00100000:0.0:1784188978.225117:0:26168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458014080 00000100:00100000:1.0:1784188978.225127:0:66945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458014208 00000100:00100000:1.0:1784188978.225129:0:66945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458014208 00000100:00100000:1.0:1784188978.225140:0:66945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1029 00000100:00100000:0.0:1784188978.225140:0:26168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2287 00000100:00100000:1.0:1784188978.225146:0:66945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf46903100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3639:x1870854458013312:12345-0@lo:38:kworker.0 00000100:00100000:0.0:1784188978.225146:0:26168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc081f83100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0001-mdtlov_UUID+5:3642:x1870854458013952:12345-0@lo:400:kworker.0 00010000:00020000:1.0:1784188978.225165:0:66945:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1784188978.225193:0:26168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc081f83100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0001-mdtlov_UUID+5:3642:x1870854458013952:12345-0@lo:400:kworker.0 Request processed in 46us (225us total) trans 0 rc 0/0 00000100:00100000:0.0:1784188978.225200:0:26168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2287 00000100:00100000:1.0:1784188978.225206:0:66945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf46903100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3639:x1870854458013312:12345-0@lo:38:kworker.0 Request processed in 60us (277us total) trans 0 rc -19/-19 00000100:00100000:1.0:1784188978.225211:0:66945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1029 00000100:00100000:0.0:1784188978.225216:0:26168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2288 00000100:00100000:0.0:1784188978.225221:0:26168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc081f82680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0001-mdtlov_UUID+5:3642:x1870854458014080:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784188978.225222:0:66945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1030 00000100:00100000:1.0:1784188978.225225:0:66945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc071536a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3639:x1870854458013568:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1784188978.225234:0:66945:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1784188978.225247:0:26168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc081f82680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0001-mdtlov_UUID+5:3642:x1870854458014080:12345-0@lo:400:kworker.0 Request processed in 26us (192us total) trans 0 rc 0/0 00000100:00100000:1.0:1784188978.225252:0:66945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc071536a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3639:x1870854458013568:12345-0@lo:38:kworker.0 Request processed in 26us (263us total) trans 0 rc -19/-19 00000100:00100000:0.0:1784188978.225253:0:26168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2288 00000100:00100000:1.0:1784188978.225257:0:66945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1030 00000100:00100000:1.0:1784188978.225273:0:66945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1031 00000100:00100000:1.0:1784188978.225277:0:66945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf4262c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3639:x1870854458014208:12345-0@lo:38:kworker.0 00000100:00100000:0.0:1784188978.225283:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc081f82300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1870854458014080:0@lo:400:kworker.0 00010000:00020000:1.0:1784188978.225285:0:66945:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1784188978.225292:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc081f80700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1870854458013952:0@lo:400:kworker.0 00000100:00100000:1.0:1784188978.225307:0:66945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf4262c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3639:x1870854458014208:12345-0@lo:38:kworker.0 Request processed in 29us (252us total) trans 0 rc -19/-19 00000100:00100000:1.0:1784188978.225313:0:66945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1031 00000100:00080000:0.0:1784188978.225356:0:3639:0:(import.c:65:import_set_state_nolock()) ffff9dbf43690800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1784188978.225361:0:3639:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1784188978.225364:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc081f83800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3639:1870854458014208:0@lo:38:kworker.0 00000100:00080000:0.0:1784188978.225372:0:3639:0:(import.c:65:import_set_state_nolock()) ffff9dbf42271800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1784188978.225375:0:3639:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1784188978.225377:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc081f83480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3639:1870854458013312:0@lo:38:kworker.0 00000100:00080000:0.0:1784188978.225384:0:3639:0:(import.c:65:import_set_state_nolock()) ffff9dbf425f4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1784188978.225387:0:3639:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1784188978.225389:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc081f82d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3639:1870854458013568:0@lo:38:kworker.0 00000100:00100000:2.0:1784188978.225476:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc081f81180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3640:1870854458013440:0@lo:400:kworker.0 00000100:00100000:2.0:1784188978.225506:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784188978.225531:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1784188978.225537:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc081f82a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3640:1870854458013696:0@lo:400:kworker.0 00000100:00100000:2.0:1784188978.225558:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784188978.225736:0:66170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458013440 00000100:00100000:0.0:1784188978.225740:0:66170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458013440 00000100:00100000:3.0:1784188978.225834:0:23826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458013824 00000100:00100000:3.0:1784188978.225845:0:23826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458013824 00000100:00100000:1.0:1784188978.225864:0:66945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458013696 00000100:00100000:1.0:1784188978.225868:0:66945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458013696 00000100:00100000:3.0:1784188978.225869:0:23826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3688 00000100:00100000:3.0:1784188978.225874:0:23826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf4262dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3639:x1870854458013824:12345-0@lo:38:kworker.0 00000100:00100000:0.0:1784188978.225918:0:66170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 974 00000100:00100000:0.0:1784188978.225932:0:66170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc074ad3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1870854458013440:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784188978.225970:0:66170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc074ad3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1870854458013440:12345-0@lo:400:kworker.0 Request processed in 39us (463us total) trans 0 rc 0/0 00000100:00100000:0.0:1784188978.225976:0:66170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 974 00010000:00020000:3.0:1784188978.227421:0:23826:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1784188978.227498:0:23826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf4262dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3639:x1870854458013824:12345-0@lo:38:kworker.0 Request processed in 1620us (2467us total) trans 0 rc -19/-19 00000100:00100000:3.0:1784188978.227510:0:23826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3688 00000100:00100000:3.0:1784188978.227602:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc081f81180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3640:1870854458013440:0@lo:400:kworker.0 00000100:00100000:1.0:1784188978.229044:0:66945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 975 00000100:00100000:1.0:1784188978.229057:0:66945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc074ad3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1870854458013696:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784188978.229188:0:66945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc074ad3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1870854458013696:12345-0@lo:400:kworker.0 Request processed in 134us (3629us total) trans 0 rc 0/0 00000100:00100000:1.0:1784188978.229195:0:66945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 975 00000100:00080000:0.0:1784188978.229281:0:3639:0:(import.c:65:import_set_state_nolock()) ffff9dbf436c4000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1784188978.229288:0:3639:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1784188978.229292:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc081f80a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3639:1870854458013824:0@lo:38:kworker.0 00000100:00100000:3.0:1784188978.229391:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc081f82a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3640:1870854458013696:0@lo:400:kworker.0 00000100:00080000:2.0:1784188978.231116:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000400:00000100:1.0:1784188978.481308:0:3635:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-192.168.203.12@tcp portal 26 match 1870854436227968 offset 0 length 224: 4 00000100:00100000:1.0:1784188978.481398:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1784188978.481440:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1784188978.481474:0:66170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436228096 00000100:00100000:0.0:1784188978.481486:0:66170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436228096 00000100:00100000:0.0:1784188978.481532:0:66170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436228224 00000100:00100000:0.0:1784188978.481535:0:66170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436228224 00000100:00100000:0.0:1784188978.481588:0:66170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 976 00000100:00100000:0.0:1784188978.481607:0:66170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc07b6e5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+6:2398:x1870854436228224:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:0.0:1784188978.481680:0:66170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc07b6e5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+6:2398:x1870854436228224:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 75us (240us total) trans 0 rc 0/0 00000100:00100000:1.0:1784188978.481685:0:66945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1032 00000100:00100000:0.0:1784188978.481695:0:66170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 976 00000100:00100000:1.0:1784188978.481697:0:66945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc07b6e4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2395:x1870854436228096:12345-192.168.203.12@tcp:38:kworker.0 00010000:00020000:1.0:1784188978.481732:0:66945:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.203.12@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1784188978.481763:0:66945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc07b6e4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2395:x1870854436228096:12345-192.168.203.12@tcp:38:kworker.0 Request processed in 67us (364us total) trans 0 rc -19/-19 00000100:00100000:1.0:1784188978.481770:0:66945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1032 00000100:00080000:1.0:1784188978.481791:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1784188978.486954:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1784188978.486997:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1784188978.487082:0:26164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436228480 00000100:00100000:2.0:1784188978.487091:0:26164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436228480 00000100:00100000:2.0:1784188978.487166:0:26164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436228352 00000100:00100000:2.0:1784188978.487169:0:26164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436228352 00000100:00100000:2.0:1784188978.487198:0:26164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 2289 00000100:00100000:2.0:1784188978.487208:0:26164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc081f80a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+5:2399:x1870854436228480:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:2.0:1784188978.487281:0:26164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc081f80a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+5:2399:x1870854436228480:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 74us (335us total) trans 0 rc 0/0 00000100:00100000:2.0:1784188978.487289:0:26164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 2289 00000100:00100000:2.0:1784188978.487306:0:26164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 2290 00000100:00100000:2.0:1784188978.487313:0:26164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc081f82d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+5:2399:x1870854436228352:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:2.0:1784188978.487388:0:26164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc081f82d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+5:2399:x1870854436228352:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 75us (389us total) trans 0 rc 0/0 00000100:00100000:2.0:1784188978.487395:0:26164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 2290 00000100:00080000:1.0:1784188978.487904:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1784188978.487909:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00100000:1.0:1784188978.737887:0:9506:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1784188978.737902:0:9506:0:(genops.c:906:class_export_put()) final put ffff9dc07a880800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1784188978.738338:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9dc07a880800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:2.0:1784188978.738384:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9dc07a884000 for lustre-OST0001 00000001:00100000:3.0:1784188978.738562:0:8423:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1784188978.738567:0:8423:0:(genops.c:906:class_export_put()) final put ffff9dc04932e000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1784188978.740798:0:63468:0:(genops.c:865:class_export_destroy()) destroying export ffff9dc04932e000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:0.0:1784188978.740864:0:63468:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9dbf42276800 for lustre-OST0000 00000001:00100000:2.0:1784188978.741239:0:75588:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:2.0:1784188978.741251:0:75588:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 81604378731 is committed 00000020:00000080:2.0:1784188978.741269:0:75588:0:(genops.c:906:class_export_put()) final put ffff9dbf43fce000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1784188978.741359:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9dbf43fce000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001 00000020:00000080:3.0:1784188978.744723:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9dbf43fcc000 for lustre-MDT0001 00010000:00010000:1.0:1784188978.927538:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784188979.952746:0:7454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784188980.976111:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784188981.999745:0:26173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784188982.319761:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf44bc2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1870854458014336:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1784188982.319849:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784188982.320240:0:9466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458014336 00000100:00100000:3.0:1784188982.320256:0:9466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458014336 00000100:00100000:3.0:1784188982.320341:0:9466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1828 00000100:00100000:3.0:1784188982.320351:0:9466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf4859a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1870854458014336:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1784188982.320511:0:9466:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8652352 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1784188982.320579:0:9466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf4859a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1870854458014336:12345-0@lo:13:osp-pre-1-1.0 Request processed in 230us (729us total) trans 0 rc 0/0 00000100:00100000:3.0:1784188982.320587:0:9466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1828 00000100:00100000:3.0:1784188982.320637:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf44bc2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1870854458014336:0@lo:13:osp-pre-1-1.0 00000100:00080000:1.0:1784188982.320708:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1784188982.321142:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf48598700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1870854458014464:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1784188982.321183:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784188982.321261:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458014464 00000100:00100000:0.0:1784188982.321266:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458014464 00000100:00100000:0.0:1784188982.321334:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1829 00000100:00080000:1.0:1784188982.321366:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1784188982.321395:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc074ad2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1870854458014464:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1784188982.321417:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8652352 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1784188982.321501:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc074ad2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1870854458014464:12345-0@lo:13:osp-pre-0-1.0 Request processed in 160us (318us total) trans 0 rc 0/0 00000100:00100000:2.0:1784188982.322120:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf48598700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1870854458014464:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1784188982.326174:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1829 00010000:00010000:1.0:1784188983.023639:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1784188983.345451:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1784188983.345459:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1784188983.345463:0:36:0:(import.c:65:import_set_state_nolock()) ffff9dbf42271800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1784188983.345471:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3220 00000100:00080000:0.0:1784188983.345477:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1784188983.345484:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9dbf42271800 using connection 192.168.203.112@tcp/0@lo 00000100:00100000:0.0:1784188983.345507:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9dc081f83800 x1870854458014720/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1784188983.345539:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1784188983.345542:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1784188983.345544:0:36:0:(import.c:65:import_set_state_nolock()) ffff9dbf425f4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1784188983.345548:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3220 00000100:00080000:0.0:1784188983.345550:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1784188983.345554:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9dbf425f4800 using connection 192.168.203.112@tcp/0@lo 00000100:00100000:0.0:1784188983.345576:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9dc081f82300 x1870854458014976/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1784188983.345597:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1784188983.345601:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1784188983.345603:0:36:0:(import.c:65:import_set_state_nolock()) ffff9dbf436c4000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1784188983.345606:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3220 00000100:00080000:0.0:1784188983.345609:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1784188983.345613:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9dbf436c4000 using connection 192.168.203.112@tcp/0@lo 00000100:00100000:1.0:1784188983.345621:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc081f83800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3639:1870854458014720:0@lo:38:kworker.0 00000100:00100000:0.0:1784188983.345624:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9dc081f80e00 x1870854458015232/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1784188983.345666:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1784188983.345670:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1784188983.345671:0:36:0:(import.c:65:import_set_state_nolock()) ffff9dbf43690800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1784188983.345674:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3220 00000100:00080000:0.0:1784188983.345677:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1784188983.345680:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff9dbf43690800 using connection 192.168.203.112@tcp/0@lo 00000100:00100000:0.0:1784188983.345689:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9dc081f81500 x1870854458015616/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1784188983.345694:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784188983.345730:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc081f82300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3639:1870854458014976:0@lo:38:kworker.0 00000100:00100000:0.0:1784188983.345730:0:68287:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458014720 00000100:00100000:0.0:1784188983.345737:0:68287:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458014720 00000100:00100000:1.0:1784188983.345750:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784188983.345771:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc081f80e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3639:1870854458015232:0@lo:38:kworker.0 00000100:00100000:0.0:1784188983.345771:0:68287:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458014976 00000100:00100000:0.0:1784188983.345774:0:68287:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458014976 00000100:00100000:0.0:1784188983.345790:0:68287:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1033 00000100:00100000:1.0:1784188983.345792:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784188983.345796:0:68287:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf48599500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3639:x1870854458014720:12345-0@lo:38:kworker.0 00000100:00100000:1.0:1784188983.345806:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc081f81500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3639:1870854458015616:0@lo:38:kworker.0 00010000:00020000:0.0:1784188983.345814:0:68287:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1784188983.345823:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784188983.345857:0:68287:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf48599500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3639:x1870854458014720:12345-0@lo:38:kworker.0 Request processed in 58us (161us total) trans 0 rc -19/-19 00000100:00100000:0.0:1784188983.345864:0:68287:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1033 00000100:00080000:1.0:1784188983.345870:0:3639:0:(import.c:65:import_set_state_nolock()) ffff9dbf42271800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1784188983.345874:0:3639:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1784188983.345877:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc081f83800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3639:1870854458014720:0@lo:38:kworker.0 00000100:00100000:0.0:1784188983.345878:0:68287:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458015616 00000100:00100000:0.0:1784188983.345881:0:68287:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458015616 00000100:00100000:0.0:1784188983.345892:0:68287:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1034 00000100:00100000:0.0:1784188983.345896:0:68287:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf4859bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3639:x1870854458014976:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1784188983.345906:0:68287:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1784188983.345909:0:66945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1035 00000100:00100000:1.0:1784188983.345914:0:66945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf4859a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3639:x1870854458015616:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1784188983.345923:0:66945:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1784188983.345933:0:68287:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf4859bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3639:x1870854458014976:12345-0@lo:38:kworker.0 Request processed in 36us (181us total) trans 0 rc -19/-19 00000100:00100000:1.0:1784188983.345943:0:66945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf4859a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3639:x1870854458015616:12345-0@lo:38:kworker.0 Request processed in 29us (118us total) trans 0 rc -19/-19 00000100:00100000:0.0:1784188983.345947:0:68287:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1034 00000100:00100000:1.0:1784188983.345950:0:66945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1035 00000100:00100000:0.0:1784188983.345965:0:26492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458015232 00000100:00100000:0.0:1784188983.345969:0:26492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458015232 00000100:00100000:0.0:1784188983.345985:0:26492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3689 00000100:00080000:1.0:1784188983.345988:0:3639:0:(import.c:65:import_set_state_nolock()) ffff9dbf43690800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00100000:0.0:1784188983.345989:0:26492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf48598000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3639:x1870854458015232:12345-0@lo:38:kworker.0 00000100:00080000:1.0:1784188983.345991:0:3639:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1784188983.345994:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc081f81500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3639:1870854458015616:0@lo:38:kworker.0 00010000:00020000:0.0:1784188983.346000:0:26492:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00080000:1.0:1784188983.346001:0:3639:0:(import.c:65:import_set_state_nolock()) ffff9dbf425f4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1784188983.346004:0:3639:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1784188983.346008:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc081f82300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3639:1870854458014976:0@lo:38:kworker.0 00000100:00080000:1.0:1784188983.346022:0:3639:0:(import.c:65:import_set_state_nolock()) ffff9dbf436c4000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00100000:0.0:1784188983.346024:0:26492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf48598000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3639:x1870854458015232:12345-0@lo:38:kworker.0 Request processed in 33us (231us total) trans 0 rc -19/-19 00000100:00080000:1.0:1784188983.346025:0:3639:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1784188983.346028:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc081f80e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3639:1870854458015232:0@lo:38:kworker.0 00000100:00100000:0.0:1784188983.346030:0:26492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3689 00000100:00100000:3.0:1784188983.346170:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc081f83b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3640:1870854458015104:0@lo:400:kworker.0 00000100:00100000:3.0:1784188983.346202:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784188983.346231:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1784188983.346244:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc081f81f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1870854458015360:0@lo:400:kworker.0 00000100:00100000:3.0:1784188983.346271:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784188983.346306:0:66171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458015104 00000100:00100000:3.0:1784188983.346310:0:66171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458015104 00000100:00100000:3.0:1784188983.346370:0:66171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 977 00000100:00100000:3.0:1784188983.346376:0:66171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf44bc2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1870854458015104:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784188983.346417:0:66171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf44bc2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1870854458015104:12345-0@lo:400:kworker.0 Request processed in 40us (214us total) trans 0 rc 0/0 00000100:00100000:3.0:1784188983.346423:0:66171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 977 00000100:00100000:3.0:1784188983.346455:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc081f83b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3640:1870854458015104:0@lo:400:kworker.0 00000100:00100000:3.0:1784188983.346472:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc081f80700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3643:1870854458014848:0@lo:400:kworker.0 00000100:00100000:3.0:1784188983.346495:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784188983.346510:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1784188983.346516:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc081f83480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:bd553d0d-03e2-4233-b06b-b55bbfa2b954:3643:1870854458014592:0@lo:400:kworker.0 00000400:00000100:3.0:1784188983.346534:0:3643:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1870854458014592 offset 0 length 224: 4 00000100:00100000:3.0:1784188983.346553:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc081f80000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1870854458015488:0@lo:400:kworker.0 00000100:00100000:3.0:1784188983.346585:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784188983.346690:0:26171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458015360 00000100:00100000:2.0:1784188983.346695:0:26171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458015360 00000100:00100000:2.0:1784188983.346733:0:26171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458015488 00000100:00100000:2.0:1784188983.346736:0:26171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458015488 00000100:00100000:2.0:1784188983.346755:0:26171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2291 00000100:00100000:2.0:1784188983.346761:0:26171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf44bc3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0001-mdtlov_UUID+5:3640:x1870854458015360:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784188983.346797:0:26171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf44bc3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0001-mdtlov_UUID+5:3640:x1870854458015360:12345-0@lo:400:kworker.0 Request processed in 36us (524us total) trans 0 rc 0/0 00000100:00100000:2.0:1784188983.346803:0:26171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2291 00000100:00100000:2.0:1784188983.346815:0:26171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2292 00000100:00100000:2.0:1784188983.346820:0:26171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf44bc2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0001-mdtlov_UUID+5:3643:x1870854458015488:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784188983.346846:0:26171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf44bc2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0001-mdtlov_UUID+5:3643:x1870854458015488:12345-0@lo:400:kworker.0 Request processed in 26us (260us total) trans 0 rc 0/0 00000100:00100000:2.0:1784188983.346851:0:26171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2292 00000100:00100000:2.0:1784188983.346869:0:66169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458014848 00000100:00100000:2.0:1784188983.346872:0:66169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458014848 00000100:00100000:2.0:1784188983.346891:0:66169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 978 00000100:00100000:2.0:1784188983.346896:0:66169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf44bc3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1870854458014848:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784188983.346925:0:66169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf44bc3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1870854458014848:12345-0@lo:400:kworker.0 Request processed in 28us (429us total) trans 0 rc 0/0 00000100:00100000:2.0:1784188983.346931:0:66169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 978 00000100:00100000:3.0:1784188983.347082:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc081f81f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1870854458015360:0@lo:400:kworker.0 00000100:00100000:3.0:1784188983.347104:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc081f80000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1870854458015488:0@lo:400:kworker.0 00000100:00100000:3.0:1784188983.347112:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc081f80700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3643:1870854458014848:0@lo:400:kworker.0 00000100:00080000:1.0:1784188983.347937:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1784188983.591906:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1784188983.591951:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000400:00000100:3.0:1784188983.591975:0:3633:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-192.168.203.12@tcp portal 26 match 1870854436228608 offset 0 length 224: 4 00000100:00100000:3.0:1784188983.591998:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1784188983.592110:0:66169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436228864 00000100:00100000:2.0:1784188983.592118:0:66169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436228864 00000100:00100000:2.0:1784188983.592179:0:66169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 979 00000100:00100000:2.0:1784188983.592200:0:66169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf44bc3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+6:2399:x1870854436228864:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:2.0:1784188983.592263:0:66169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf44bc3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+6:2399:x1870854436228864:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 65us (367us total) trans 0 rc 0/0 00000100:00100000:2.0:1784188983.592271:0:66169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 979 00000100:00080000:2.0:1784188983.592291:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1784188983.594732:0:26160:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436229120 00000100:00100000:1.0:1784188983.594744:0:26160:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436229120 00000100:00100000:1.0:1784188983.594813:0:26160:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436228992 00000100:00100000:1.0:1784188983.594816:0:26160:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436228992 00000100:00100000:1.0:1784188983.594839:0:26160:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 2293 00000100:00100000:1.0:1784188983.594848:0:26160:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf44bc0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+5:2399:x1870854436229120:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:1.0:1784188983.594921:0:26160:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf44bc0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+5:2399:x1870854436229120:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 74us (2969us total) trans 0 rc 0/0 00000100:00100000:1.0:1784188983.594928:0:26160:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 2293 00000100:00100000:1.0:1784188983.594944:0:26160:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 2294 00000100:00100000:1.0:1784188983.594949:0:26160:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf44bc1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+5:2399:x1870854436228992:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:1.0:1784188983.594970:0:26160:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf44bc1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+5:2399:x1870854436228992:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 21us (2972us total) trans 0 rc 0/0 00000100:00100000:1.0:1784188983.594975:0:26160:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 2294 00000100:00080000:3.0:1784188983.598398:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1784188983.598423:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1784188983.603467:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1784188983.603701:0:68287:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436228736 00000100:00100000:0.0:1784188983.603710:0:68287:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436228736 00000100:00100000:0.0:1784188983.603761:0:68287:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1036 00000100:00100000:0.0:1784188983.603769:0:68287:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf44bc0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2395:x1870854436228736:12345-192.168.203.12@tcp:38:kworker.0 00010000:00020000:0.0:1784188983.603792:0:68287:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.203.12@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1784188983.603923:0:68287:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf44bc0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2395:x1870854436228736:12345-192.168.203.12@tcp:38:kworker.0 Request processed in 153us (465us total) trans 0 rc -19/-19 00000100:00100000:0.0:1784188983.603931:0:68287:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1036 00010000:00010000:2.0:1784188984.047523:0:7454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784188985.073280:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784188986.099740:0:26173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784188987.119560:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784188987.441283:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc081f80380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1870854458015744:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1784188987.441407:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784188987.441522:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458015744 00000100:00100000:0.0:1784188987.441540:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458015744 00000100:00100000:0.0:1784188987.441632:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1830 00000100:00100000:0.0:1784188987.441643:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc074ad3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1870854458015744:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1784188987.441682:0:8432:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8652352 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1784188987.441735:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc074ad3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1870854458015744:12345-0@lo:13:osp-pre-0-1.0 Request processed in 93us (327us total) trans 0 rc 0/0 00000100:00100000:0.0:1784188987.441743:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1830 00000100:00080000:2.0:1784188987.441861:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1784188987.441904:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc081f80380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1870854458015744:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1784188987.442557:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1784188987.442572:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc074ad0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1870854458015872:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1784188987.442631:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784188987.442740:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458015872 00000100:00100000:2.0:1784188987.442746:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458015872 00000100:00100000:2.0:1784188987.442803:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1831 00000100:00100000:2.0:1784188987.442810:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc081f80380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1870854458015872:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1784188987.442834:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8652352 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1784188987.442876:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc081f80380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1870854458015872:12345-0@lo:13:osp-pre-1-1.0 Request processed in 67us (246us total) trans 0 rc 0/0 00000100:00100000:2.0:1784188987.442884:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1831 00000100:00100000:2.0:1784188987.442920:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc074ad0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1870854458015872:0@lo:13:osp-pre-1-1.0 00000100:00080000:0.0:1784188987.443073:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1784188988.143477:0:7454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1784188988.464041:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1784188988.464050:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1784188988.464055:0:36:0:(import.c:65:import_set_state_nolock()) ffff9dbf42271800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1784188988.464063:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3225 00000100:00100000:2.0:1784188988.464064:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf48598380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:bd553d0d-03e2-4233-b06b-b55bbfa2b954:3641:1870854458016000:0@lo:400:kworker.0 00000100:00080000:1.0:1784188988.464070:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 15s 00000100:00080000:1.0:1784188988.464078:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9dbf42271800 using connection 192.168.203.112@tcp/0@lo 00000100:00100000:1.0:1784188988.464106:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9dbf48598e00 x1870854458016128/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000400:00000100:2.0:1784188988.464135:0:3641:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1870854458016000 offset 0 length 224: 4 00000100:00080000:1.0:1784188988.464142:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1784188988.464146:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1784188988.464147:0:36:0:(import.c:65:import_set_state_nolock()) ffff9dbf425f4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1784188988.464150:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3225 00000100:00080000:1.0:1784188988.464153:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 15s 00000100:00080000:1.0:1784188988.464156:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9dbf425f4800 using connection 192.168.203.112@tcp/0@lo 00000100:00100000:1.0:1784188988.464167:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9dbf48599880 x1870854458016384/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1784188988.464184:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1784188988.464186:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1784188988.464188:0:36:0:(import.c:65:import_set_state_nolock()) ffff9dbf436c4000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1784188988.464191:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3225 00000100:00080000:1.0:1784188988.464194:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 15s 00000100:00080000:1.0:1784188988.464198:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9dbf436c4000 using connection 192.168.203.112@tcp/0@lo 00000100:00100000:1.0:1784188988.464209:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9dbf4859b100 x1870854458016640/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1784188988.464265:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1784188988.464268:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1784188988.464270:0:36:0:(import.c:65:import_set_state_nolock()) ffff9dbf43690800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1784188988.464273:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3225 00000100:00080000:1.0:1784188988.464276:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 15s 00000100:00080000:1.0:1784188988.464280:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff9dbf43690800 using connection 192.168.203.112@tcp/0@lo 00000100:00100000:1.0:1784188988.464310:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9dc080f6c000 x1870854458017024/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1784188988.464362:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf48598a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1870854458016768:0@lo:400:kworker.0 00000100:00100000:1.0:1784188988.464408:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784188988.464435:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1784188988.464441:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf48598700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1870854458016896:0@lo:400:kworker.0 00000100:00100000:1.0:1784188988.464463:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784188988.464501:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf48598e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3639:1870854458016128:0@lo:38:kworker.0 00000100:00100000:1.0:1784188988.464544:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784188988.464563:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf48599880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3639:1870854458016384:0@lo:38:kworker.0 00000100:00100000:1.0:1784188988.464584:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784188988.464600:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf4859b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3639:1870854458016640:0@lo:38:kworker.0 00000100:00100000:1.0:1784188988.464624:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784188988.464641:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc080f6c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3639:1870854458017024:0@lo:38:kworker.0 00000100:00100000:1.0:1784188988.464663:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784188988.464694:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf4859b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3642:1870854458016256:0@lo:400:kworker.0 00000100:00100000:1.0:1784188988.464720:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784188988.464758:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1784188988.464765:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf48599f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3642:1870854458016512:0@lo:400:kworker.0 00000100:00100000:2.0:1784188988.464785:0:68287:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458016128 00000100:00100000:1.0:1784188988.464786:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784188988.464801:0:68287:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458016128 00000100:00100000:1.0:1784188988.464822:0:14684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458016768 00000100:00100000:1.0:1784188988.464825:0:14684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458016768 00000100:00100000:2.0:1784188988.464835:0:68287:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458016384 00000100:00100000:2.0:1784188988.464837:0:68287:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458016384 00000100:00100000:2.0:1784188988.464843:0:68287:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458017024 00000100:00100000:2.0:1784188988.464845:0:68287:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458017024 00000100:00100000:2.0:1784188988.464856:0:68287:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1037 00000100:00100000:1.0:1784188988.464860:0:14684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458016896 00000100:00100000:1.0:1784188988.464862:0:14684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458016896 00000100:00100000:2.0:1784188988.464864:0:68287:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc080f6d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3639:x1870854458016128:12345-0@lo:38:kworker.0 00000100:00100000:1.0:1784188988.464878:0:14684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2295 00000100:00100000:1.0:1784188988.464883:0:14684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc080f6d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3640:x1870854458016768:12345-0@lo:400:kworker.0 00010000:00020000:2.0:1784188988.464886:0:68287:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1784188988.464929:0:68287:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc080f6d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3639:x1870854458016128:12345-0@lo:38:kworker.0 Request processed in 64us (383us total) trans 0 rc -19/-19 00000100:00100000:1.0:1784188988.464929:0:14684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc080f6d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3640:x1870854458016768:12345-0@lo:400:kworker.0 Request processed in 44us (519us total) trans 0 rc 0/0 00000100:00100000:2.0:1784188988.464938:0:68287:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1037 00000100:00100000:1.0:1784188988.464938:0:14684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2295 00000100:00100000:2.0:1784188988.464954:0:68287:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458016256 00000100:00100000:1.0:1784188988.464956:0:14684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2296 00000100:00100000:2.0:1784188988.464957:0:68287:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458016256 00000100:00100000:1.0:1784188988.464961:0:14684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc080f6c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3640:x1870854458016896:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784188988.464983:0:68287:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458016512 00000100:00100000:2.0:1784188988.464986:0:68287:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458016512 00000100:00100000:1.0:1784188988.464989:0:14684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc080f6c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3640:x1870854458016896:12345-0@lo:400:kworker.0 Request processed in 28us (525us total) trans 0 rc 0/0 00000100:00100000:1.0:1784188988.464995:0:14684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2296 00000100:00100000:2.0:1784188988.464999:0:68287:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 980 00000100:00100000:2.0:1784188988.465004:0:68287:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc080f6ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1870854458016256:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784188988.465018:0:66945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 981 00000100:00100000:1.0:1784188988.465025:0:66945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc080f6ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1870854458016512:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784188988.465035:0:68287:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc080f6ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1870854458016256:12345-0@lo:400:kworker.0 Request processed in 31us (315us total) trans 0 rc 0/0 00000100:00100000:2.0:1784188988.465041:0:68287:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 980 00000100:00100000:1.0:1784188988.465050:0:66945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc080f6ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1870854458016512:12345-0@lo:400:kworker.0 Request processed in 26us (263us total) trans 0 rc 0/0 00000100:00100000:2.0:1784188988.465052:0:68287:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1038 00000100:00100000:2.0:1784188988.465056:0:68287:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc080f6dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3639:x1870854458016384:12345-0@lo:38:kworker.0 00000100:00100000:1.0:1784188988.465056:0:66945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 981 00010000:00020000:2.0:1784188988.465066:0:68287:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1784188988.465068:0:66945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1039 00000100:00100000:1.0:1784188988.465072:0:66945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc080f6d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3639:x1870854458017024:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1784188988.465080:0:66945:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1784188988.465086:0:68287:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc080f6dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3639:x1870854458016384:12345-0@lo:38:kworker.0 Request processed in 28us (501us total) trans 0 rc -19/-19 00000100:00100000:2.0:1784188988.465091:0:68287:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1038 00000100:00100000:1.0:1784188988.465097:0:66945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc080f6d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3639:x1870854458017024:12345-0@lo:38:kworker.0 Request processed in 24us (434us total) trans 0 rc -19/-19 00000100:00100000:1.0:1784188988.465109:0:66945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1039 00000100:00100000:1.0:1784188988.465131:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458016640 00000100:00100000:1.0:1784188988.465134:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458016640 00000100:00100000:1.0:1784188988.465162:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3690 00000100:00100000:1.0:1784188988.465167:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc080f6f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3639:x1870854458016640:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1784188988.465177:0:8438:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1784188988.465204:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc080f6f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3639:x1870854458016640:12345-0@lo:38:kworker.0 Request processed in 36us (579us total) trans 0 rc -19/-19 00000100:00100000:1.0:1784188988.465211:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3690 00000100:00100000:1.0:1784188988.465261:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf48599f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3642:1870854458016512:0@lo:400:kworker.0 00000100:00100000:1.0:1784188988.465272:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf4859b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3642:1870854458016256:0@lo:400:kworker.0 00000100:00100000:1.0:1784188988.465307:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf48598700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1870854458016896:0@lo:400:kworker.0 00000100:00100000:1.0:1784188988.465350:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf48598a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1870854458016768:0@lo:400:kworker.0 00000100:00080000:1.0:1784188988.465375:0:3639:0:(import.c:65:import_set_state_nolock()) ffff9dbf42271800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1784188988.465381:0:3639:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1784188988.465384:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf48598e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3639:1870854458016128:0@lo:38:kworker.0 00000100:00080000:1.0:1784188988.465393:0:3639:0:(import.c:65:import_set_state_nolock()) ffff9dbf425f4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1784188988.465396:0:3639:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1784188988.465400:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf48599880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3639:1870854458016384:0@lo:38:kworker.0 00000100:00080000:1.0:1784188988.465407:0:3639:0:(import.c:65:import_set_state_nolock()) ffff9dbf436c4000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1784188988.465410:0:3639:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1784188988.465412:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf4859b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3639:1870854458016640:0@lo:38:kworker.0 00000100:00080000:1.0:1784188988.465435:0:3639:0:(import.c:65:import_set_state_nolock()) ffff9dbf43690800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1784188988.465439:0:3639:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1784188988.465442:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc080f6c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3639:1870854458017024:0@lo:38:kworker.0 00000100:00080000:0.0:1784188988.465552:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000400:00000100:2.0:1784188988.734118:0:3635:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-192.168.203.12@tcp portal 26 match 1870854436229248 offset 0 length 520: 4 00000100:00100000:0.0:1784188988.743242:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1784188988.743283:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1784188988.743335:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1784188988.743363:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1784188988.743394:0:68287:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436229376 00000100:00100000:0.0:1784188988.743394:0:26170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436229632 00000100:00100000:0.0:1784188988.743403:0:26170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436229632 00000100:00100000:2.0:1784188988.743423:0:68287:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436229376 00000100:00100000:0.0:1784188988.743459:0:26170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436229760 00000100:00100000:2.0:1784188988.743464:0:68287:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436229504 00000100:00100000:0.0:1784188988.743464:0:26170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436229760 00000100:00100000:2.0:1784188988.743470:0:68287:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436229504 00000100:00100000:1.0:1784188988.743482:0:66945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1040 00000100:00100000:1.0:1784188988.743491:0:66945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc081f80700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2395:x1870854436229376:12345-192.168.203.12@tcp:38:kworker.0 00000100:00100000:0.0:1784188988.743494:0:26170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 4916 00000100:00100000:0.0:1784188988.743502:0:26170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc081f81f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+5:2395:x1870854436229632:12345-192.168.203.12@tcp:9:kworker.0 00000100:00100000:2.0:1784188988.743512:0:68287:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 982 00010000:00020000:1.0:1784188988.743526:0:66945:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.203.12@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000020:00000080:0.0:1784188988.743537:0:26170:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xcc1762b626f8a409 00000100:00100000:2.0:1784188988.743540:0:68287:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc081f80000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+6:2397:x1870854436229504:12345-192.168.203.12@tcp:400:kworker.0 00000100:00080000:0.0:1784188988.743547:0:26170:0:(import.c:65:import_set_state_nolock()) ffff9dc05ed22000 : changing import state from FULL to CLOSED 00000100:00100000:1.0:1784188988.743591:0:66945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc081f80700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2395:x1870854436229376:12345-192.168.203.12@tcp:38:kworker.0 Request processed in 98us (356us total) trans 0 rc -19/-19 00000100:00100000:1.0:1784188988.743598:0:66945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1040 00000001:00000004:0.0:1784188988.743602:0:26170:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294968947 00010000:00010000:1.0:1784188988.743626:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784188988.743746:0:68287:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc081f80000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+6:2397:x1870854436229504:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 208us (461us total) trans 0 rc 0/0 00000100:00100000:2.0:1784188988.743754:0:68287:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 982 00000100:00080000:1.0:1784188988.744614:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1784188988.744620:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1784188988.744622:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1784188988.744639:0:26167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 4917 00000100:00100000:1.0:1784188988.744649:0:26167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc081f83b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+5:2395:x1870854436229760:12345-192.168.203.12@tcp:9:kworker.0 00000020:00000080:1.0:1784188988.744666:0:26167:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xcc1762b626f89f78 00000100:00080000:1.0:1784188988.744672:0:26167:0:(import.c:65:import_set_state_nolock()) ffff9dbf43d89000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1784188988.744706:0:26167:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294968951 00000100:00100000:1.0:1784188988.744805:0:26167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc081f83b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+2:2395:x1870854436229760:12345-192.168.203.12@tcp:9:kworker.0 Request processed in 157us (1440us total) trans 0 rc 0/0 00000100:00100000:1.0:1784188988.744812:0:26167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 4917 00010000:00010000:1.0:1784188988.744830:0:26173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784188988.747202:0:26170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc081f81f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+2:2395:x1870854436229632:12345-192.168.203.12@tcp:9:kworker.0 Request processed in 3691us (3855us total) trans 0 rc 0/0 00000100:00100000:0.0:1784188988.747216:0:26170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 4916 00010000:00010000:1.0:1784188989.167929:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784188990.196632:0:7454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784188991.216175:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784188992.247591:0:26173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784188992.562788:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1784188992.562811:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf44bc1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1870854458017152:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1784188992.562933:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784188992.562982:0:9466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458017152 00000100:00100000:3.0:1784188992.562989:0:9466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458017152 00000100:00100000:3.0:1784188992.563046:0:9466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1832 00000100:00100000:3.0:1784188992.563055:0:9466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf44bc0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1870854458017152:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1784188992.563083:0:9466:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 214592 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1784188992.563124:0:9466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf44bc0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1870854458017152:12345-0@lo:13:osp-pre-1-1.0 Request processed in 70us (191us total) trans 0 rc 0/0 00000100:00100000:3.0:1784188992.563131:0:9466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1832 00000100:00080000:3.0:1784188992.563150:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1784188992.563183:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf44bc1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1870854458017152:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1784188992.563585:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc080f6c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1870854458017280:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1784188992.563616:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784188992.563689:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458017280 00000100:00100000:1.0:1784188992.563707:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458017280 00000100:00100000:1.0:1784188992.563749:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1833 00000100:00100000:1.0:1784188992.563755:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf44bc1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1870854458017280:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1784188992.563774:0:8432:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 214592 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1784188992.563810:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf44bc1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1870854458017280:12345-0@lo:13:osp-pre-0-1.0 Request processed in 55us (194us total) trans 0 rc 0/0 00000100:00100000:1.0:1784188992.563817:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1833 00000100:00080000:3.0:1784188992.563869:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1784188992.563899:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc080f6c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1870854458017280:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1784188993.264508:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1784188993.586173:0:27065:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1784188993.586181:0:27065:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1784188993.586231:0:27065:0:(import.c:65:import_set_state_nolock()) ffff9dbf42271800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1784188993.586239:0:27065:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3230 00000100:00080000:2.0:1784188993.586243:0:27065:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1784188993.586251:0:27065:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9dbf42271800 using connection 192.168.203.112@tcp/0@lo 00000100:00100000:2.0:1784188993.586346:0:27065:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9dc074ad2300 x1870854458017536/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1784188993.586371:0:27065:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1784188993.586375:0:27065:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1784188993.586376:0:27065:0:(import.c:65:import_set_state_nolock()) ffff9dbf425f4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1784188993.586380:0:27065:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3230 00000100:00080000:2.0:1784188993.586383:0:27065:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1784188993.586387:0:27065:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9dbf425f4800 using connection 192.168.203.112@tcp/0@lo 00000100:00100000:2.0:1784188993.586399:0:27065:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9dc074ad0700 x1870854458017792/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1784188993.586533:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc074ad0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bd553d0d-03e2-4233-b06b-b55bbfa2b954:3640:1870854458017408:0@lo:400:kworker.0 00000400:00000100:1.0:1784188993.586650:0:3640:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1870854458017408 offset 0 length 224: 4 00000100:00100000:1.0:1784188993.586691:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1784188993.586697:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc074ad0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3640:1870854458017664:0@lo:400:kworker.0 00000100:00100000:1.0:1784188993.586727:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784188993.586760:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc074ad2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3639:1870854458017536:0@lo:38:kworker.0 00000100:00100000:1.0:1784188993.586780:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784188993.586795:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc074ad0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3639:1870854458017792:0@lo:38:kworker.0 00000100:00100000:1.0:1784188993.586814:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784188993.586840:0:66945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458017664 00000100:00100000:1.0:1784188993.586847:0:66945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458017664 00000100:00080000:2.0:1784188993.586949:0:27065:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1784188993.586953:0:27065:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1784188993.586955:0:27065:0:(import.c:65:import_set_state_nolock()) ffff9dbf436c4000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1784188993.586959:0:27065:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3230 00000100:00080000:2.0:1784188993.586961:0:27065:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1784188993.586966:0:27065:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9dbf436c4000 using connection 192.168.203.112@tcp/0@lo 00000100:00100000:2.0:1784188993.586984:0:27065:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9dc080f69c00 x1870854458018048/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1784188993.587016:0:27065:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1784188993.587019:0:27065:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1784188993.587021:0:27065:0:(import.c:65:import_set_state_nolock()) ffff9dbf43690800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1784188993.587024:0:27065:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3230 00000100:00080000:2.0:1784188993.587027:0:27065:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1784188993.587031:0:27065:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff9dbf43690800 using connection 192.168.203.112@tcp/0@lo 00000100:00100000:2.0:1784188993.587042:0:27065:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9dc080f68a80 x1870854458018432/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1784188993.587065:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1784188993.587073:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc080f69f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1870854458018304:0@lo:400:kworker.0 00000100:00100000:2.0:1784188993.587105:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784188993.587133:0:26163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458018304 00000100:00100000:2.0:1784188993.587137:0:26163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458018304 00000100:00100000:2.0:1784188993.587179:0:26163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2297 00000100:00100000:3.0:1784188993.587811:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc080f68380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1870854458018176:0@lo:400:kworker.0 00000100:00100000:3.0:1784188993.587851:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784188993.587980:0:26163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc080f68000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:3641:x1870854458018304:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784188993.588036:0:26163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc080f68000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:3641:x1870854458018304:12345-0@lo:400:kworker.0 Request processed in 62us (930us total) trans 0 rc 0/0 00000100:00100000:2.0:1784188993.588057:0:26163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2297 00000100:00100000:1.0:1784188993.588121:0:66945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458017536 00000100:00100000:1.0:1784188993.588126:0:66945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458017536 00000100:00100000:1.0:1784188993.588146:0:66945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458017792 00000100:00100000:1.0:1784188993.588150:0:66945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458017792 00000100:00100000:1.0:1784188993.588164:0:66945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 983 00000100:00100000:1.0:1784188993.588173:0:66945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc080f6ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1870854458017664:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784188993.588178:0:66170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1041 00000100:00100000:0.0:1784188993.588186:0:66170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc080f6c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3639:x1870854458017536:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1784188993.588206:0:66170:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1784188993.588367:0:66945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc080f6ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1870854458017664:12345-0@lo:400:kworker.0 Request processed in 195us (1639us total) trans 0 rc 0/0 00000100:00100000:1.0:1784188993.588375:0:66945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 983 00000100:00100000:1.0:1784188993.588398:0:66945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1042 00000100:00100000:1.0:1784188993.588403:0:66945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc080f6e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3639:x1870854458017792:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1784188993.588413:0:66945:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1784188993.588641:0:66170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc080f6c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3639:x1870854458017536:12345-0@lo:38:kworker.0 Request processed in 453us (1858us total) trans 0 rc -19/-19 00000100:00100000:2.0:1784188993.588655:0:26163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458018176 00000100:00100000:0.0:1784188993.588660:0:66170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1041 00000100:00100000:2.0:1784188993.588661:0:26163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458018176 00000100:00100000:2.0:1784188993.588694:0:26163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2298 00000100:00100000:2.0:1784188993.588700:0:26163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc081cd0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:3643:x1870854458018176:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784188993.588733:0:26163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc081cd0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:3643:x1870854458018176:12345-0@lo:400:kworker.0 Request processed in 34us (881us total) trans 0 rc 0/0 00000100:00100000:2.0:1784188993.588740:0:26163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2298 00000100:00100000:1.0:1784188993.588960:0:66945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc080f6e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3639:x1870854458017792:12345-0@lo:38:kworker.0 Request processed in 554us (2144us total) trans 0 rc -19/-19 00000100:00100000:1.0:1784188993.588967:0:66945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1042 00000100:00100000:1.0:1784188993.589012:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc080f69c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3639:1870854458018048:0@lo:38:kworker.0 00000100:00100000:1.0:1784188993.589045:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784188993.589077:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc080f68a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3639:1870854458018432:0@lo:38:kworker.0 00000100:00100000:1.0:1784188993.589100:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1784188993.589130:0:3639:0:(import.c:65:import_set_state_nolock()) ffff9dbf42271800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1784188993.589135:0:3639:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1784188993.589138:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc074ad2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3639:1870854458017536:0@lo:38:kworker.0 00000100:00080000:1.0:1784188993.589148:0:3639:0:(import.c:65:import_set_state_nolock()) ffff9dbf425f4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1784188993.589151:0:3639:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1784188993.589154:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc074ad0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3639:1870854458017792:0@lo:38:kworker.0 00000100:00100000:3.0:1784188993.589237:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1784188993.589249:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc074ad0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3643:1870854458017920:0@lo:400:kworker.0 00000100:00100000:3.0:1784188993.589278:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784188993.589306:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc080f68380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1870854458018176:0@lo:400:kworker.0 00000100:00080000:3.0:1784188993.589356:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1784188993.589744:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc080f69f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1870854458018304:0@lo:400:kworker.0 00000100:00100000:2.0:1784188993.589772:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc074ad0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3640:1870854458017664:0@lo:400:kworker.0 00000100:00100000:0.0:1784188993.590001:0:26492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458018048 00000100:00100000:0.0:1784188993.590007:0:26492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458018048 00000100:00100000:0.0:1784188993.590035:0:26492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3691 00000100:00100000:0.0:1784188993.590041:0:26492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc080f6f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3639:x1870854458018048:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1784188993.590058:0:26492:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1784188993.590101:0:26492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc080f6f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3639:x1870854458018048:12345-0@lo:38:kworker.0 Request processed in 60us (1056us total) trans 0 rc -19/-19 00000100:00100000:0.0:1784188993.590109:0:26492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3691 00000100:00100000:1.0:1784188993.590243:0:66170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458018432 00000100:00100000:1.0:1784188993.590248:0:66170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458018432 00000100:00100000:1.0:1784188993.590276:0:66170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458017920 00000100:00100000:1.0:1784188993.590279:0:66170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458017920 00000100:00100000:1.0:1784188993.590311:0:66170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 984 00000100:00100000:1.0:1784188993.590337:0:66170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf44bc1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1870854458017920:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784188993.590381:0:66170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf44bc1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1870854458017920:12345-0@lo:400:kworker.0 Request processed in 65us (1103us total) trans 0 rc 0/0 00000100:00100000:1.0:1784188993.590387:0:66170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 984 00000100:00100000:1.0:1784188993.590413:0:66170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1043 00000100:00100000:1.0:1784188993.590417:0:66170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc080f6f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3639:x1870854458018432:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1784188993.590428:0:66170:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00080000:2.0:1784188993.591037:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1784188993.591122:0:66170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc080f6f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3639:x1870854458018432:12345-0@lo:38:kworker.0 Request processed in 702us (2020us total) trans 0 rc -19/-19 00000100:00100000:1.0:1784188993.591130:0:66170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1043 00000100:00080000:1.0:1784188993.591170:0:3639:0:(import.c:65:import_set_state_nolock()) ffff9dbf436c4000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1784188993.591176:0:3639:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1784188993.591180:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc080f69c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3639:1870854458018048:0@lo:38:kworker.0 00000100:00080000:1.0:1784188993.591668:0:3639:0:(import.c:65:import_set_state_nolock()) ffff9dbf43690800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1784188993.591672:0:3639:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1784188993.591675:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc080f68a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3639:1870854458018432:0@lo:38:kworker.0 00000100:00100000:3.0:1784188993.592177:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc074ad0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3643:1870854458017920:0@lo:400:kworker.0 00000100:00100000:1.0:1784188993.836684:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1784188993.836773:0:68287:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436229888 00000100:00100000:1.0:1784188993.836776:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1784188993.836782:0:68287:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436229888 00000100:00100000:3.0:1784188993.836916:0:68287:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436230016 00000100:00100000:3.0:1784188993.836921:0:68287:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436230016 00000100:00080000:2.0:1784188993.836984:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1784188993.837581:0:66945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 985 00000100:00100000:1.0:1784188993.837596:0:66945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc080f6fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+6:2399:x1870854436230016:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:1.0:1784188993.837675:0:66945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc080f6fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+6:2399:x1870854436230016:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 84us (898us total) trans 0 rc 0/0 00000100:00100000:1.0:1784188993.837682:0:66945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 985 00000100:00100000:1.0:1784188993.837702:0:66945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1044 00000100:00100000:1.0:1784188993.837706:0:66945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc080f6e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2395:x1870854436229888:12345-192.168.203.12@tcp:38:kworker.0 00010000:00020000:1.0:1784188993.837726:0:66945:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.203.12@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1784188993.837747:0:66945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc080f6e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2395:x1870854436229888:12345-192.168.203.12@tcp:38:kworker.0 Request processed in 40us (1074us total) trans 0 rc -19/-19 00000100:00100000:1.0:1784188993.837761:0:66945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1044 00010000:00010000:3.0:1784188994.288619:0:7454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00000400:0.0:1784188994.607543:0:3642:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1784188978/real 1784188978] req@ffff9dc081f81c00 x1870854458013184/t0(0) o400->MGC192.168.203.112@tcp@0@lo:26/25 lens 224/224 e 0 to 1 dl 1784188994 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000001:00100000:1.0:1784188994.613625:0:9506:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of b90fcc1c-0e69-42a4-a116-a71fec7aeb78 00000020:00000080:1.0:1784188994.613635:0:9506:0:(genops.c:906:class_export_put()) final put ffff9dbf43d88000/b90fcc1c-0e69-42a4-a116-a71fec7aeb78 00000020:00000080:1.0:1784188994.613975:0:27065:0:(genops.c:865:class_export_destroy()) destroying export ffff9dbf43d88000/b90fcc1c-0e69-42a4-a116-a71fec7aeb78 for lustre-OST0001 00000020:00000080:1.0:1784188994.614030:0:27065:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9dbf43d89000 for lustre-OST0001 00000001:00100000:2.0:1784188994.616446:0:8423:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of b90fcc1c-0e69-42a4-a116-a71fec7aeb78 00000020:00000080:2.0:1784188994.616454:0:8423:0:(genops.c:906:class_export_put()) final put ffff9dc05ed26800/b90fcc1c-0e69-42a4-a116-a71fec7aeb78 00000020:00000080:1.0:1784188994.619309:0:63468:0:(genops.c:865:class_export_destroy()) destroying export ffff9dc05ed26800/b90fcc1c-0e69-42a4-a116-a71fec7aeb78 for lustre-OST0000 00000020:00000080:1.0:1784188994.619379:0:63468:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9dc05ed22000 for lustre-OST0000 00000100:00100000:0.0:1784188994.641125:0:3642:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ TIMEOUT-NORESEND: req@ffff9dc081f81c00 x1870854458013184/t0(0) o400->MGC192.168.203.112@tcp@0@lo:26/25 lens 224/224 e 0 to 1 dl 1784188994 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1784188994.641139:0:3642:0:(import.c:65:import_set_state_nolock()) ffff9dc07110c800 MGS: changing import state from FULL to DISCONN 00000100:02020000:0.0:1784188994.641143:0:3642:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.203.112@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00000100:00080000:0.0:1784188994.641146:0:3642:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.203.112@tcp not replayable, auto-deactivating 00000100:00080000:0.0:1784188994.641148:0:3642:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:0.0:1784188994.641157:0:3642:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9dc081f81c00 x1870854458013184/t0(0) o400->MGC192.168.203.112@tcp@0@lo:26/25 lens 224/224 e 0 to 1 dl 1784188994 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784188994.641167:0:3642:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9dc081f83480 x1870854458014592/t0(0) o400->MGC192.168.203.112@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1784188999 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784188994.641189:0:3642:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9dbf48598380 x1870854458016000/t0(0) o400->MGC192.168.203.112@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1784189004 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784188994.641209:0:3642:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9dc074ad0e00 x1870854458017408/t0(0) o400->MGC192.168.203.112@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1784189009 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 10000000:01000000:0.0:1784188994.641239:0:3642:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:0.0:1784188994.641242:0:3642:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:0.0:1784188994.641243:0:3642:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:0.0:1784188994.641245:0:3642:0:(import.c:418:ptlrpc_pinger_force()) MGS: waking up pinger s:DISCONN 00000100:00100000:0.0:1784188994.641272:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc081f81c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bd553d0d-03e2-4233-b06b-b55bbfa2b954:3642:1870854458013184:0@lo:400:kworker.0 00000100:00100000:3.0:1784188994.641357:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc081f83480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:bd553d0d-03e2-4233-b06b-b55bbfa2b954:3643:1870854458014592:0@lo:400:kworker.0 00000100:00080000:1.0:1784188994.641434:0:27065:0:(pinger.c:229:ptlrpc_pinger_process_import()) bd553d0d-03e2-4233-b06b-b55bbfa2b954->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1784188994.641440:0:27065:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:1.0:1784188994.641442:0:27065:0:(import.c:65:import_set_state_nolock()) ffff9dc07110c800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1784188994.641447:0:27065:0:(import.c:510:import_select_connection()) MGC192.168.203.112@tcp: connect to NID 0@lo last attempt 3003 00000100:00080000:1.0:1784188994.641455:0:27065:0:(import.c:624:import_select_connection()) MGC192.168.203.112@tcp: import ffff9dc07110c800 using connection 192.168.203.112@tcp/0@lo 00000100:00100000:1.0:1784188994.641493:0:27065:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9dc080f6ce00 x1870854458018560/t0(0) o250->MGC192.168.203.112@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1784188994.641511:0:27065:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1784188994.641514:0:27065:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1784188994.641516:0:27065:0:(import.c:65:import_set_state_nolock()) ffff9dbf42271800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1784188994.641519:0:27065:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3235 00000100:00080000:1.0:1784188994.641521:0:27065:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1784188994.641524:0:27065:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9dbf42271800 using connection 192.168.203.112@tcp/0@lo 00000100:00100000:1.0:1784188994.641537:0:27065:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9dc080f6df80 x1870854458018688/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1784188994.641556:0:27065:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1784188994.641559:0:27065:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1784188994.641567:0:27065:0:(import.c:65:import_set_state_nolock()) ffff9dbf425f4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1784188994.641571:0:27065:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3235 00000100:00080000:1.0:1784188994.641573:0:27065:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1784188994.641577:0:27065:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9dbf425f4800 using connection 192.168.203.112@tcp/0@lo 00000100:00100000:1.0:1784188994.641589:0:27065:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9dc080f6c380 x1870854458018944/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1784188994.641615:0:27065:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1784188994.641619:0:27065:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1784188994.641620:0:27065:0:(import.c:65:import_set_state_nolock()) ffff9dbf436c4000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1784188994.641624:0:27065:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3235 00000100:00080000:1.0:1784188994.641626:0:27065:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1784188994.641630:0:27065:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9dbf436c4000 using connection 192.168.203.112@tcp/0@lo 00000100:00100000:1.0:1784188994.641644:0:27065:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9dbf4859b480 x1870854458019200/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1784188994.641663:0:27065:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1784188994.641667:0:27065:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1784188994.641668:0:27065:0:(import.c:65:import_set_state_nolock()) ffff9dbf43690800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1784188994.641672:0:27065:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3235 00000100:00080000:1.0:1784188994.641674:0:27065:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1784188994.641677:0:27065:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff9dbf43690800 using connection 192.168.203.112@tcp/0@lo 00000100:00100000:1.0:1784188994.641687:0:27065:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9dbf48598e00 x1870854458019584/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1784188994.641716:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc080f6d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3641:1870854458018816:0@lo:400:kworker.0 00000100:00100000:3.0:1784188994.641742:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf4859b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1870854458019328:0@lo:400:kworker.0 00000100:00100000:2.0:1784188994.641771:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc074ad0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bd553d0d-03e2-4233-b06b-b55bbfa2b954:3640:1870854458017408:0@lo:400:kworker.0 00000100:00100000:2.0:1784188994.641790:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf48599880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1870854458019456:0@lo:400:kworker.0 00000100:00100000:1.0:1784188994.641875:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784188994.641916:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf48598380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:bd553d0d-03e2-4233-b06b-b55bbfa2b954:3641:1870854458016000:0@lo:400:kworker.0 00000100:00100000:1.0:1784188994.641942:0:66171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458018816 00000100:00100000:1.0:1784188994.641950:0:66171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458018816 00000100:00100000:0.0:1784188994.641954:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc080f6ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:bd553d0d-03e2-4233-b06b-b55bbfa2b954:3639:1870854458018560:0@lo:250:kworker.0 00000400:00000100:0.0:1784188994.641976:0:3639:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1870854458018560 offset 0 length 520: 4 00000100:00100000:1.0:1784188994.641994:0:66171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 986 00000100:00100000:0.0:1784188994.641995:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc080f6df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3639:1870854458018688:0@lo:38:kworker.0 00000100:00100000:1.0:1784188994.642002:0:66171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf48598a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1870854458018816:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784188994.642014:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784188994.642030:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc080f6c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3639:1870854458018944:0@lo:38:kworker.0 00000100:00100000:1.0:1784188994.642047:0:66171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf48598a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1870854458018816:12345-0@lo:400:kworker.0 Request processed in 45us (172us total) trans 0 rc 0/0 00000100:00100000:0.0:1784188994.642048:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784188994.642054:0:66171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 986 00000100:00100000:0.0:1784188994.642060:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf4859b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3639:1870854458019200:0@lo:38:kworker.0 00000100:00100000:1.0:1784188994.642069:0:66171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458018688 00000100:00100000:1.0:1784188994.642072:0:66171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458018688 00000100:00100000:0.0:1784188994.642080:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784188994.642087:0:66171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458018944 00000100:00100000:1.0:1784188994.642090:0:66171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458018944 00000100:00100000:0.0:1784188994.642095:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf48598e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3639:1870854458019584:0@lo:38:kworker.0 00000100:00100000:1.0:1784188994.642099:0:66171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1045 00000100:00100000:1.0:1784188994.642103:0:66171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc081f81c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3639:x1870854458018688:12345-0@lo:38:kworker.0 00000100:00100000:0.0:1784188994.642113:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00020000:1.0:1784188994.642119:0:66171:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1784188994.642132:0:66169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458019584 00000100:00100000:0.0:1784188994.642135:0:66169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458019584 00000100:00100000:1.0:1784188994.642148:0:66171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc081f81c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3639:x1870854458018688:12345-0@lo:38:kworker.0 Request processed in 43us (132us total) trans 0 rc -19/-19 00000100:00100000:0.0:1784188994.642150:0:66169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1046 00000100:00100000:1.0:1784188994.642155:0:66171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1045 00000100:00100000:0.0:1784188994.642155:0:66169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc081f80e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3639:x1870854458018944:12345-0@lo:38:kworker.0 00000100:00100000:1.0:1784188994.642165:0:66171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1047 00010000:00020000:0.0:1784188994.642165:0:66169:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1784188994.642169:0:66171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc081f81500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3639:x1870854458019584:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1784188994.642177:0:66171:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1784188994.642187:0:66169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc081f80e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3639:x1870854458018944:12345-0@lo:38:kworker.0 Request processed in 31us (137us total) trans 0 rc -19/-19 00000100:00100000:0.0:1784188994.642193:0:66169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1046 00000100:00100000:1.0:1784188994.642194:0:66171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc081f81500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3639:x1870854458019584:12345-0@lo:38:kworker.0 Request processed in 25us (81us total) trans 0 rc -19/-19 00000100:00100000:1.0:1784188994.642200:0:66171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1047 00000100:00080000:0.0:1784188994.642222:0:3639:0:(import.c:65:import_set_state_nolock()) ffff9dbf42271800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00100000:1.0:1784188994.642223:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc080f6d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3641:1870854458018816:0@lo:400:kworker.0 00000100:00080000:0.0:1784188994.642226:0:3639:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1784188994.642235:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc080f6df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3639:1870854458018688:0@lo:38:kworker.0 00000100:00080000:0.0:1784188994.642244:0:3639:0:(import.c:65:import_set_state_nolock()) ffff9dbf425f4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1784188994.642248:0:3639:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1784188994.642250:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc080f6c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3639:1870854458018944:0@lo:38:kworker.0 00000100:00080000:0.0:1784188994.642258:0:3639:0:(import.c:65:import_set_state_nolock()) ffff9dbf43690800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1784188994.642260:0:3639:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1784188994.642263:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf48598e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3639:1870854458019584:0@lo:38:kworker.0 00000100:00100000:3.0:1784188994.642377:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784188994.642398:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1784188994.642404:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc080f6c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3643:1870854458019072:0@lo:400:kworker.0 00000100:00100000:3.0:1784188994.642427:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784188994.642454:0:68287:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458019072 00000100:00100000:3.0:1784188994.642457:0:68287:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458019072 00000100:00100000:3.0:1784188994.642493:0:68287:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 987 00000100:00100000:3.0:1784188994.642500:0:68287:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf4690b050 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1870854458019072:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784188994.642534:0:68287:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf4690b050 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1870854458019072:12345-0@lo:400:kworker.0 Request processed in 35us (105us total) trans 0 rc 0/0 00000100:00100000:3.0:1784188994.642540:0:68287:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 987 00000100:00100000:3.0:1784188994.643750:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc080f6c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3643:1870854458019072:0@lo:400:kworker.0 00000100:00100000:0.0:1784188994.644033:0:26162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458019328 00000100:00100000:0.0:1784188994.644040:0:26162:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458019328 00000100:00100000:0.0:1784188994.644098:0:26162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2299 00000100:00100000:0.0:1784188994.644105:0:26162:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf44bc1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:3643:x1870854458019328:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784188994.644165:0:26162:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf44bc1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:3643:x1870854458019328:12345-0@lo:400:kworker.0 Request processed in 60us (1788us total) trans 0 rc 0/0 00000100:00100000:0.0:1784188994.644171:0:26162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2299 00000100:00100000:0.0:1784188994.644203:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf4859b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1870854458019328:0@lo:400:kworker.0 00000100:00080000:3.0:1784188994.644261:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1784188994.644352:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458019200 00000100:00100000:0.0:1784188994.644357:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458019200 00000100:00100000:0.0:1784188994.644378:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3692 00000100:00100000:0.0:1784188994.644382:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc081f82300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3639:x1870854458019200:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1784188994.644399:0:8439:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1784188994.644432:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc081f82300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3639:x1870854458019200:12345-0@lo:38:kworker.0 Request processed in 48us (2350us total) trans 0 rc -19/-19 00000100:00100000:0.0:1784188994.644437:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3692 00000100:00080000:0.0:1784188994.644458:0:3639:0:(import.c:65:import_set_state_nolock()) ffff9dbf436c4000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1784188994.644463:0:3639:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1784188994.644488:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf4859b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3639:1870854458019200:0@lo:38:kworker.0 00000100:00100000:2.0:1784188994.644805:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784188994.644929:0:9982:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458019456 00000100:00100000:0.0:1784188994.644934:0:9982:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458019456 00000100:00100000:0.0:1784188994.645009:0:9982:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2300 00000100:00100000:0.0:1784188994.645016:0:9982:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc080f69f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3640:x1870854458019456:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784188994.645052:0:9982:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc080f69f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3640:x1870854458019456:12345-0@lo:400:kworker.0 Request processed in 36us (247us total) trans 0 rc 0/0 00000100:00100000:0.0:1784188994.645057:0:9982:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2300 00000100:00100000:2.0:1784188994.645122:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf48599880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1870854458019456:0@lo:400:kworker.0 00000100:00080000:3.0:1784188994.645155:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000020:01000004:3.0:1784188994.647113:0:85077:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1784188994.647119:0:85077:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds1_flakey 00000020:01000004:3.0:1784188994.647120:0:85077:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:3.0:1784188994.647256:0:85077:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff9dc047a82000 00000020:01000004:3.0:1784188994.647280:0:85077:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0000, type=osd-ldiskfs, lsifl=200005, mountfl=0 00000020:01000004:3.0:1784188994.647293:0:85077:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-ldiskfs) 00000020:00000080:3.0:1784188994.647306:0:85077:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff9dc06bb319c0) 00000020:00000080:3.0:1784188994.647489:0:85077:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-ldiskfs with refcount 2 00100000:10000000:2.0:1784188994.751177:0:85077:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:2.0:1784188994.752155:0:85077:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:0.0:1784188994.758647:0:85077:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:0.0:1784188994.760066:0:85077:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/32) registered 00100000:10000000:0.0:1784188994.760362:0:85077:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:0.0:1784188994.760871:0:85077:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/32) registered 00100000:10000000:0.0:1784188994.761124:0:85077:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:0.0:1784188994.761429:0:85077:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/32) registered 00100000:10000000:0.0:1784188994.761769:0:85077:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/32) registered 00100000:10000000:0.0:1784188994.761951:0:85077:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:0.0:1784188994.762226:0:85077:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:0.0:1784188994.762540:0:85077:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/32) registered 00100000:10000000:0.0:1784188994.762903:0:85077:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:0.0:1784188994.763092:0:85077:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x9:0x0] (8/32) registered 00100000:10000000:1.0:1784188994.765284:0:85077:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2f:0x0] (24/16) registered 00100000:10000000:1.0:1784188994.765528:0:85077:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:1.0:1784188994.765731:0:85077:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:1.0:1784188994.765875:0:85077:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1e:0x0] (16/1) registered 00100000:10000000:1.0:1784188994.766081:0:85077:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:1.0:1784188994.766309:0:85077:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:1.0:1784188994.766638:0:85077:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:1.0:1784188994.766982:0:85077:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x32:0x0] (24/16) registered 00100000:10000000:1.0:1784188994.767521:0:85077:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x34:0x0] (24/16) registered 00100000:10000000:1.0:1784188994.767885:0:85077:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:1.0:1784188994.768077:0:85077:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:1.0:1784188994.768338:0:85077:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:1.0:1784188994.768617:0:85077:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:1.0:1784188994.768925:0:85077:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:1.0:1784188994.769277:0:85077:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x20:0x0] (16/1) registered 00100000:10000000:1.0:1784188994.769637:0:85077:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x22:0x0] (16/1) registered 00100000:10000000:1.0:1784188994.769944:0:85077:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:1.0:1784188994.771217:0:85077:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:1.0:1784188994.771501:0:85077:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:1.0:1784188994.771816:0:85077:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:1.0:1784188994.772022:0:85077:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:1.0:1784188994.772221:0:85077:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:1.0:1784188994.772438:0:85077:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1f:0x0] (16/1) registered 00100000:10000000:1.0:1784188994.772796:0:85077:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x21:0x0] (16/1) registered 00100000:10000000:1.0:1784188994.773075:0:85077:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x23:0x0] (16/1) registered 00100000:10000000:1.0:1784188994.773284:0:85077:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x33:0x0] (24/16) registered 00100000:10000000:1.0:1784188994.773804:0:85077:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:1.0:1784188994.774041:0:85077:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x31:0x0] (24/16) registered 00100000:10000000:1.0:1784188994.774276:0:85077:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:1.0:1784188994.774546:0:85077:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x30:0x0] (24/16) registered 00100000:10000000:1.0:1784188994.774840:0:85077:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:1.0:1784188994.775074:0:85077:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:1.0:1784188994.777314:0:85077:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2:0x0] (8/32) registered 00100000:10000000:1.0:1784188994.778553:0:85077:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/32) registered 00100000:10000000:1.0:1784188994.779104:0:85077:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/32) registered 00100000:10000000:1.0:1784188994.779338:0:85077:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/32) registered 00100000:10000000:1.0:1784188994.779899:0:85077:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/32) registered 00100000:10000000:1.0:1784188994.780097:0:85077:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/32) registered 00100000:10000000:1.0:1784188994.780750:0:85077:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/32) registered 00080000:01000000:1.0:1784188994.781267:0:85077:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0000: register osd-ldiskfs tunable parameters 00000020:00000080:1.0:1784188994.782571:0:85077:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:1.0:1784188994.782582:0:85077:0:(osd_handler.c:8929:osd_obd_connect()) connect #0 00000020:00000080:1.0:1784188994.782597:0:85077:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xcc1762b626f8a521 00000020:01000004:1.0:1784188994.782606:0:85077:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0000 on device /dev/mapper/mds1_flakey 00000020:01000000:1.0:1784188994.782618:0:85077:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:1.0:1784188994.782624:0:85077:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9dc047a82000 from MGS 00000020:01000004:1.0:1784188994.782627:0:85077:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:1.0:1784188994.782638:0:85077:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff9dc0762999c0) 00000020:00000080:1.0:1784188994.782650:0:85077:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mgs with refcount 2 00000020:01000004:1.0:1784188994.782709:0:85077:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9dc047a82000 from MGS, refs=2 00080000:01000000:1.0:1784188994.782713:0:85077:0:(osd_handler.c:8929:osd_obd_connect()) connect #1 00000020:00000080:1.0:1784188994.782717:0:85077:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xcc1762b626f8a52f 00010000:00010000:1.0:1784188994.783577:0:85077:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-MGS-3 is initialized 00000040:01000000:1.0:1784188994.797651:0:85077:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 10000000:01000000:2.0:1784188994.799012:0:85081:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:1.0:1784188994.804335:0:85077:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:1.0:1784188994.804392:0:85077:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1784188994.806129:0:85077:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:1.0:1784188994.807068:0:85077:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1784188994.807231:0:85077:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:1.0:1784188994.807237:0:85077:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:2.0:1784188994.809789:0:85077:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:2.0:1784188994.809802:0:85077:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:2.0:1784188994.813944:0:85077:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:2.0:1784188994.813963:0:85077:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:1.0:1784188994.815860:0:85077:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:1.0:1784188994.815885:0:85077:0:(obd_mount.c:392:lustre_start_mgc()) New MGS with live MGC 00000020:01000004:1.0:1784188994.815886:0:85077:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.112@tcp:Set MGC reconnect 2 10000000:01000000:1.0:1784188994.815890:0:85077:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.112@tcp 2/d0:i1:r0:or0:CONNECTING 00000100:00080000:1.0:1784188994.815895:0:85077:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffff9dc07110c800 already not connected (conn 54, was 0): CONNECTING 00000100:00100000:1.0:1784188994.815900:0:85077:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 13s for inflight to error out 00010000:00010000:2.0:1784188995.311815:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784188996.338380:0:26173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784188997.359519:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784188997.680966:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1784188997.680988:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf44bc2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1870854458019712:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1784188997.681062:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784188997.681114:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1784188997.681122:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf48598380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1870854458019840:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1784188997.681144:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784188997.681291:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458019712 00000100:00100000:1.0:1784188997.681299:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458019712 00000100:00100000:1.0:1784188997.681378:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1834 00000100:00100000:1.0:1784188997.681387:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc081f83800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1870854458019712:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1784188997.681413:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 214592 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1784188997.681474:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc081f83800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1870854458019712:12345-0@lo:13:osp-pre-1-1.0 Request processed in 87us (410us total) trans 0 rc 0/0 00000100:00100000:1.0:1784188997.681481:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1834 00000100:00100000:1.0:1784188997.681498:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458019840 00000100:00100000:1.0:1784188997.681501:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458019840 00000100:00100000:1.0:1784188997.681519:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1835 00000100:00100000:1.0:1784188997.681524:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc081f82a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1870854458019840:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1784188997.681539:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 214592 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1784188997.681570:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc081f82a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1870854458019840:12345-0@lo:13:osp-pre-0-1.0 Request processed in 45us (424us total) trans 0 rc 0/0 00000100:00100000:1.0:1784188997.681575:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1835 00000100:00100000:1.0:1784188997.681621:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf44bc2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1870854458019712:0@lo:13:osp-pre-1-1.0 00000100:00080000:0.0:1784188997.681894:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1784188997.681898:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1784188997.681922:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf48598380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1870854458019840:0@lo:13:osp-pre-0-1.0 00010000:00010000:3.0:1784188998.384664:0:7454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784188998.951669:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1784188998.953371:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1784188998.953565:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1784188998.953848:0:66171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436230400 00000100:00100000:3.0:1784188998.953858:0:85083:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436230144 00000100:00100000:0.0:1784188998.953859:0:66171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436230400 00000100:00100000:3.0:1784188998.953866:0:85083:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436230144 00000100:00100000:3.0:1784188998.953905:0:85083:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 0 00000100:00100000:3.0:1784188998.953913:0:85083:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc04a4a2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:2395:x1870854436230144:12345-192.168.203.12@tcp:250:kworker.0 00000100:00100000:0.0:1784188998.953923:0:66171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436230272 00000100:00100000:0.0:1784188998.953929:0:66171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436230272 00010000:00080000:3.0:1784188998.953942:0:85083:0:(ldlm_lib.c:1445:target_handle_connect()) MGS: connection from 9957a2dc-fd88-4a91-bca3-e2b7f365ab0c@192.168.203.12@tcp t0 exp 0000000000000000 cur 3241 last 0 00000100:00100000:0.0:1784188998.953953:0:66171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 988 00000100:00100000:0.0:1784188998.953964:0:66171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf48598700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+6:2397:x1870854436230400:12345-192.168.203.12@tcp:400:kworker.0 00000020:00000080:3.0:1784188998.953975:0:85083:0:(genops.c:1406:class_connect()) connect: client 9957a2dc-fd88-4a91-bca3-e2b7f365ab0c, cookie 0xcc1762b626f8a536 00000100:00100000:0.0:1784188998.954051:0:66171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf48598700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+6:2397:x1870854436230400:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 88us (2391us total) trans 0 rc 0/0 00000100:00100000:0.0:1784188998.954060:0:66171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 988 00000100:00100000:0.0:1784188998.954096:0:66171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1048 00000100:00100000:0.0:1784188998.954102:0:66171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf4859b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2395:x1870854436230272:12345-192.168.203.12@tcp:38:kworker.0 00010000:00020000:0.0:1784188998.954119:0:66171:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.203.12@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00080000:3.0:1784188998.954127:0:85083:0:(import.c:65:import_set_state_nolock()) ffff9dc0477d4000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1784188998.954146:0:66171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf4859b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2395:x1870854436230272:12345-192.168.203.12@tcp:38:kworker.0 Request processed in 42us (581us total) trans 0 rc -19/-19 00000100:00100000:0.0:1784188998.954153:0:66171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1048 00000100:00080000:1.0:1784188998.954238:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1784188998.954564:0:85083:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc04a4a2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9957a2dc-fd88-4a91-bca3-e2b7f365ab0c+5:2395:x1870854436230144:12345-192.168.203.12@tcp:250:kworker.0 Request processed in 649us (1199us total) trans 0 rc 0/0 00000100:00100000:3.0:1784188998.954572:0:85083:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 0 00010000:00010000:2.0:1784188999.407607:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1784188999.727461:0:27065:0:(pinger.c:229:ptlrpc_pinger_process_import()) bd553d0d-03e2-4233-b06b-b55bbfa2b954->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1784188999.727472:0:27065:0:(pinger.c:247:ptlrpc_pinger_process_import()) bd553d0d-03e2-4233-b06b-b55bbfa2b954->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1784188999.727475:0:27065:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1784188999.727478:0:27065:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1784188999.727482:0:27065:0:(import.c:65:import_set_state_nolock()) ffff9dbf42271800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1784188999.727489:0:27065:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3236 00000100:00080000:1.0:1784188999.727493:0:27065:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1784188999.727500:0:27065:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9dbf42271800 using connection 192.168.203.112@tcp/0@lo 00000100:00100000:1.0:1784188999.727540:0:27065:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9dbf48599f80 x1870854458019968/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1784188999.727606:0:27065:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1784188999.727611:0:27065:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1784188999.727613:0:27065:0:(import.c:65:import_set_state_nolock()) ffff9dbf425f4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1784188999.727616:0:27065:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3236 00000100:00080000:1.0:1784188999.727618:0:27065:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1784188999.727622:0:27065:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9dbf425f4800 using connection 192.168.203.112@tcp/0@lo 00000100:00100000:1.0:1784188999.727635:0:27065:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9dbf48599880 x1870854458020224/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1784188999.727662:0:27065:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1784188999.727665:0:27065:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1784188999.727666:0:27065:0:(import.c:65:import_set_state_nolock()) ffff9dbf436c4000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1784188999.727670:0:27065:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3236 00000100:00080000:1.0:1784188999.727686:0:27065:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1784188999.727690:0:27065:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9dbf436c4000 using connection 192.168.203.112@tcp/0@lo 00000100:00100000:1.0:1784188999.727708:0:27065:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9dbf4859b100 x1870854458020480/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1784188999.727728:0:27065:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1784188999.727730:0:27065:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1784188999.727732:0:27065:0:(import.c:65:import_set_state_nolock()) ffff9dbf43690800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1784188999.727734:0:27065:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3236 00000100:00080000:1.0:1784188999.727737:0:27065:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1784188999.727740:0:27065:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff9dbf43690800 using connection 192.168.203.112@tcp/0@lo 00000100:00100000:1.0:1784188999.727749:0:27065:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9dbf48599500 x1870854458020864/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1784188999.727780:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf4859ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1870854458020608:0@lo:400:kworker.0 00000100:00100000:1.0:1784188999.727847:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784188999.727886:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1784188999.727892:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf4859b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3641:1870854458020352:0@lo:400:kworker.0 00000100:00100000:1.0:1784188999.727916:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784188999.727948:0:26161:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458020608 00000100:00100000:1.0:1784188999.727954:0:26161:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458020608 00000100:00100000:1.0:1784188999.728021:0:26161:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2301 00000100:00100000:1.0:1784188999.728031:0:26161:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf4859bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:3641:x1870854458020608:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784188999.728081:0:26161:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf4859bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:3641:x1870854458020608:12345-0@lo:400:kworker.0 Request processed in 52us (234us total) trans 0 rc 0/0 00000100:00100000:1.0:1784188999.728089:0:26161:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2301 00000100:00080000:1.0:1784188999.728110:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1784188999.728159:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf4859ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1870854458020608:0@lo:400:kworker.0 00000100:00100000:3.0:1784188999.728274:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf48599c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1870854458020736:0@lo:400:kworker.0 00000100:00100000:3.0:1784188999.728306:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784188999.728357:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1784188999.728363:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf48598380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3642:1870854458020096:0@lo:400:kworker.0 00000100:00100000:3.0:1784188999.728387:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784188999.728414:0:66170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458020352 00000100:00100000:3.0:1784188999.728418:0:66170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458020352 00000100:00100000:3.0:1784188999.728463:0:66170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458020096 00000100:00100000:3.0:1784188999.728467:0:66170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458020096 00000100:00100000:3.0:1784188999.728490:0:66170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 989 00000100:00100000:3.0:1784188999.728497:0:66170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf4859a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1870854458020352:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784188999.728545:0:66170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf4859a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1870854458020352:12345-0@lo:400:kworker.0 Request processed in 46us (625us total) trans 0 rc 0/0 00000100:00100000:3.0:1784188999.728566:0:66170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 989 00000100:00100000:3.0:1784188999.728583:0:66170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 990 00000100:00100000:3.0:1784188999.728590:0:66170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf44bc3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1870854458020096:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784188999.728621:0:66170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf44bc3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1870854458020096:12345-0@lo:400:kworker.0 Request processed in 32us (232us total) trans 0 rc 0/0 00000100:00100000:3.0:1784188999.728628:0:66170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 990 00000100:00080000:3.0:1784188999.728650:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1784188999.728672:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf4859b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3641:1870854458020352:0@lo:400:kworker.0 00000100:00100000:3.0:1784188999.728697:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf48598380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3642:1870854458020096:0@lo:400:kworker.0 00000100:00100000:0.0:1784188999.731305:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf48599f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3639:1870854458019968:0@lo:38:kworker.0 00000100:00100000:0.0:1784188999.731396:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784188999.731450:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf48599880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3639:1870854458020224:0@lo:38:kworker.0 00000100:00100000:0.0:1784188999.731474:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784188999.731493:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf4859b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3639:1870854458020480:0@lo:38:kworker.0 00000100:00100000:3.0:1784188999.731494:0:68287:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458019968 00000100:00100000:3.0:1784188999.731501:0:68287:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458019968 00000100:00100000:0.0:1784188999.731517:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784188999.731531:0:68287:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458020224 00000100:00100000:0.0:1784188999.731532:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf48599500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3639:1870854458020864:0@lo:38:kworker.0 00000100:00100000:3.0:1784188999.731533:0:68287:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458020224 00000100:00100000:3.0:1784188999.731545:0:68287:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1049 00000100:00100000:3.0:1784188999.731551:0:68287:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc081f81180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3639:x1870854458019968:12345-0@lo:38:kworker.0 00000100:00100000:0.0:1784188999.731566:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00020000:3.0:1784188999.731572:0:68287:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1784188999.731589:0:66945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458020864 00000100:00100000:0.0:1784188999.731609:0:66945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458020864 00000100:00100000:3.0:1784188999.731612:0:68287:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc081f81180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3639:x1870854458019968:12345-0@lo:38:kworker.0 Request processed in 60us (216us total) trans 0 rc -19/-19 00000100:00100000:3.0:1784188999.731619:0:68287:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1049 00000100:00100000:1.0:1784188999.731953:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458020736 00000100:00100000:1.0:1784188999.731958:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458020736 00000100:00100000:1.0:1784188999.732068:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2302 00000100:00100000:1.0:1784188999.732077:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf44bc3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1870854458020736:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784188999.732586:0:66945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1050 00000100:00100000:0.0:1784188999.732604:0:66945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc081f80700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3639:x1870854458020224:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1784188999.732619:0:66945:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1784188999.733231:0:66945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc081f80700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3639:x1870854458020224:12345-0@lo:38:kworker.0 Request processed in 627us (1746us total) trans 0 rc -19/-19 00000100:00100000:0.0:1784188999.733239:0:66945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1050 00000100:00100000:0.0:1784188999.733256:0:66945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1051 00000100:00100000:0.0:1784188999.733260:0:66945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc081f81c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3639:x1870854458020864:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1784188999.733272:0:66945:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1784188999.733296:0:66945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc081f81c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3639:x1870854458020864:12345-0@lo:38:kworker.0 Request processed in 34us (1729us total) trans 0 rc -19/-19 00000100:00100000:0.0:1784188999.733302:0:66945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1051 00000100:00100000:0.0:1784188999.733350:0:26492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458020480 00000100:00100000:0.0:1784188999.733355:0:26492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458020480 00000100:00100000:0.0:1784188999.733378:0:26492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3693 00000100:00100000:0.0:1784188999.733382:0:26492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc081f80000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3639:x1870854458020480:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1784188999.733392:0:26492:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1784188999.733416:0:26492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc081f80000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3639:x1870854458020480:12345-0@lo:38:kworker.0 Request processed in 33us (1899us total) trans 0 rc -19/-19 00000100:00100000:0.0:1784188999.733422:0:26492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3693 00000100:00080000:0.0:1784188999.733467:0:3639:0:(import.c:65:import_set_state_nolock()) ffff9dbf42271800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1784188999.733472:0:3639:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1784188999.733476:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf48599f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3639:1870854458019968:0@lo:38:kworker.0 00000100:00080000:0.0:1784188999.733502:0:3639:0:(import.c:65:import_set_state_nolock()) ffff9dbf425f4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1784188999.733507:0:3639:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1784188999.733509:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf48599880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3639:1870854458020224:0@lo:38:kworker.0 00000100:00080000:0.0:1784188999.733518:0:3639:0:(import.c:65:import_set_state_nolock()) ffff9dbf436c4000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1784188999.733521:0:3639:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1784188999.733524:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf4859b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3639:1870854458020480:0@lo:38:kworker.0 00000100:00080000:0.0:1784188999.733532:0:3639:0:(import.c:65:import_set_state_nolock()) ffff9dbf43690800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1784188999.733534:0:3639:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1784188999.733537:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf48599500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3639:1870854458020864:0@lo:38:kworker.0 00000100:00080000:0.0:1784188999.733600:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1784188999.733631:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf48599c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1870854458020736:0@lo:400:kworker.0 00000100:00100000:1.0:1784188999.737748:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf44bc3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1870854458020736:12345-0@lo:400:kworker.0 Request processed in 5662us (9430us total) trans 0 rc 0/0 00000100:00100000:1.0:1784188999.737763:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2302 00010000:00010000:1.0:1784189000.431827:0:26173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784189000.617204:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1784189000.617308:0:85085:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436230528 00000100:00100000:2.0:1784189000.617345:0:85085:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436230528 00000100:00100000:2.0:1784189000.617400:0:85085:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1 00000100:00100000:2.0:1784189000.617409:0:85085:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc04a4a0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9957a2dc-fd88-4a91-bca3-e2b7f365ab0c+5:42415:x1870854436230528:12345-192.168.203.12@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1784189000.617426:0:85085:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784189000.617459:0:85085:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dc0755a4200/0xcc1762b626f8a53d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xcbfc5de7fe6c3cc7 expref: -99 pid: 85085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189000.617488:0:85085:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dc0755a4200/0xcc1762b626f8a53d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c3cc7 expref: 6 pid: 85085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189000.617500:0:85085:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dc0755a4200/0xcc1762b626f8a53d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c3cc7 expref: 6 pid: 85085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189000.617510:0:85085:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc0755a4200, rc 0) 00000100:00100000:2.0:1784189000.617571:0:85085:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc04a4a0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9957a2dc-fd88-4a91-bca3-e2b7f365ab0c+6:42415:x1870854436230528:12345-192.168.203.12@tcp:101:ll_cfg_requeue.0 Request processed in 162us (376us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189000.617578:0:85085:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1 00000100:00100000:1.0:1784189000.619866:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1784189000.620139:0:85083:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436230656 00000100:00100000:3.0:1784189000.620148:0:85083:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436230656 00000100:00100000:3.0:1784189000.620201:0:85083:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 2 00000100:00100000:3.0:1784189000.620212:0:85083:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc07617ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9957a2dc-fd88-4a91-bca3-e2b7f365ab0c+6:42415:x1870854436230656:12345-192.168.203.12@tcp:256:ll_cfg_requeue.0 00000100:00100000:3.0:1784189000.620288:0:85083:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc07617ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9957a2dc-fd88-4a91-bca3-e2b7f365ab0c+6:42415:x1870854436230656:12345-192.168.203.12@tcp:256:ll_cfg_requeue.0 Request processed in 78us (429us total) trans 0 rc -2/-2 00000100:00100000:3.0:1784189000.620310:0:85083:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 2 00000100:00100000:0.0:1784189000.633707:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1784189000.635116:0:85084:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436230784 00000100:00100000:1.0:1784189000.635129:0:85084:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436230784 00000100:00100000:1.0:1784189000.635194:0:85084:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 3 00000100:00100000:1.0:1784189000.635204:0:85084:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc07617d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9957a2dc-fd88-4a91-bca3-e2b7f365ab0c+6:42415:x1870854436230784:12345-192.168.203.12@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784189000.635220:0:85084:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784189000.635240:0:85084:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dc042d67e00/0xcc1762b626f8a544 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xcbfc5de7fe6c3cce expref: -99 pid: 85084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189000.635268:0:85084:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dc042d67e00/0xcc1762b626f8a544 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c3cce expref: 7 pid: 85084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189000.635279:0:85084:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dc042d67e00/0xcc1762b626f8a544 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c3cce expref: 7 pid: 85084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189000.635287:0:85084:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc042d67e00, rc 0) 00000100:00100000:1.0:1784189000.635402:0:85084:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc07617d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9957a2dc-fd88-4a91-bca3-e2b7f365ab0c+7:42415:x1870854436230784:12345-192.168.203.12@tcp:101:ll_cfg_requeue.0 Request processed in 199us (1704us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189000.635426:0:85084:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 3 00000100:00100000:1.0:1784189000.640135:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1784189000.640239:0:85085:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436230912 00000100:00100000:2.0:1784189000.640249:0:85085:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436230912 00000100:00100000:2.0:1784189000.640305:0:85085:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 4 00000100:00100000:2.0:1784189000.640316:0:85085:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc07617c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9957a2dc-fd88-4a91-bca3-e2b7f365ab0c+7:42415:x1870854436230912:12345-192.168.203.12@tcp:501:ll_cfg_requeue.0 10000000:01000000:2.0:1784189000.641122:0:85086:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:3.0:1784189000.641220:0:85085:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 100 20000000:01000000:3.0:1784189000.646869:0:85087:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:3.0:1784189000.646877:0:85087:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 1 20000000:01000000:3.0:1784189000.646880:0:85087:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:3.0:1784189000.646883:0:85087:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:3.0:1784189000.647163:0:85087:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 20000000:01000000:2.0:1784189000.647382:0:85085:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:2.0:1784189000.647486:0:85085:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc07617c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9957a2dc-fd88-4a91-bca3-e2b7f365ab0c+8:42415:x1870854436230912:12345-192.168.203.12@tcp:501:ll_cfg_requeue.0 Request processed in 7159us (7347us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189000.647508:0:85085:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 4 00000100:00100000:0.0:1784189000.653181:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1784189000.653274:0:85083:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436231040 00000100:00100000:3.0:1784189000.653284:0:85083:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436231040 00000100:00100000:3.0:1784189000.653484:0:85083:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 5 00000100:00100000:3.0:1784189000.653496:0:85083:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc07617cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9957a2dc-fd88-4a91-bca3-e2b7f365ab0c+8:42415:x1870854436231040:12345-192.168.203.12@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1784189000.653645:0:85083:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc07617cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9957a2dc-fd88-4a91-bca3-e2b7f365ab0c+8:42415:x1870854436231040:12345-192.168.203.12@tcp:503:ll_cfg_requeue.0 Request processed in 150us (471us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189000.653653:0:85083:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 5 00000100:00100000:0.0:1784189000.662158:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1784189000.662281:0:85085:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436231168 00000100:00100000:2.0:1784189000.662293:0:85085:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436231168 00000100:00100000:2.0:1784189000.662621:0:85085:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 6 00000100:00100000:2.0:1784189000.662634:0:85085:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc07617e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9957a2dc-fd88-4a91-bca3-e2b7f365ab0c+8:42415:x1870854436231168:12345-192.168.203.12@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1784189000.662658:0:85085:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784189000.662684:0:85085:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dc0755a5000/0xcc1762b626f8a54b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xcbfc5de7fe6c3cd5 expref: -99 pid: 85085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189000.662969:0:85085:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dc0755a5000/0xcc1762b626f8a54b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c3cd5 expref: 9 pid: 85085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189000.662984:0:85085:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dc0755a5000/0xcc1762b626f8a54b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c3cd5 expref: 9 pid: 85085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189000.662995:0:85085:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc0755a5000, rc 0) 00000100:00100000:2.0:1784189000.663176:0:85085:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc07617e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9957a2dc-fd88-4a91-bca3-e2b7f365ab0c+9:42415:x1870854436231168:12345-192.168.203.12@tcp:101:ll_cfg_requeue.0 Request processed in 544us (1031us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189000.663185:0:85085:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 6 00000100:00100000:2.0:1784189000.665691:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1784189000.665783:0:85083:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436231296 00000100:00100000:3.0:1784189000.665794:0:85083:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436231296 00000100:00100000:3.0:1784189000.665907:0:85083:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 7 00000100:00100000:3.0:1784189000.665919:0:85083:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc07617d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9957a2dc-fd88-4a91-bca3-e2b7f365ab0c+9:42415:x1870854436231296:12345-192.168.203.12@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784189000.666150:0:85083:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc07617d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9957a2dc-fd88-4a91-bca3-e2b7f365ab0c+9:42415:x1870854436231296:12345-192.168.203.12@tcp:501:ll_cfg_requeue.0 Request processed in 232us (472us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189000.666160:0:85083:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 7 00000100:00100000:0.0:1784189000.668889:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1784189000.669133:0:85085:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436231424 00000100:00100000:3.0:1784189000.669145:0:85085:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436231424 00000100:00100000:3.0:1784189000.669255:0:85085:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 8 00000100:00100000:3.0:1784189000.669265:0:85085:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc07617c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9957a2dc-fd88-4a91-bca3-e2b7f365ab0c+9:42415:x1870854436231424:12345-192.168.203.12@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1784189000.669503:0:85085:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc07617c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9957a2dc-fd88-4a91-bca3-e2b7f365ab0c+9:42415:x1870854436231424:12345-192.168.203.12@tcp:503:ll_cfg_requeue.0 Request processed in 237us (624us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189000.669529:0:85085:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 8 00000100:00100000:0.0:1784189000.675277:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1784189000.675767:0:85083:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436231552 00000100:00100000:3.0:1784189000.675781:0:85083:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436231552 00000100:00100000:3.0:1784189000.675855:0:85083:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 9 00000100:00100000:3.0:1784189000.675868:0:85083:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc07617d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9957a2dc-fd88-4a91-bca3-e2b7f365ab0c+9:42415:x1870854436231552:12345-192.168.203.12@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784189000.675889:0:85083:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784189000.675916:0:85083:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dc05ec0c200/0xcc1762b626f8a552 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xcbfc5de7fe6c3cdc expref: -99 pid: 85083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189000.675951:0:85083:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dc05ec0c200/0xcc1762b626f8a552 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c3cdc expref: 10 pid: 85083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189000.675963:0:85083:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dc05ec0c200/0xcc1762b626f8a552 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c3cdc expref: 10 pid: 85083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189000.675973:0:85083:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc05ec0c200, rc 0) 00000100:00100000:3.0:1784189000.676049:0:85083:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc07617d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9957a2dc-fd88-4a91-bca3-e2b7f365ab0c+10:42415:x1870854436231552:12345-192.168.203.12@tcp:101:ll_cfg_requeue.0 Request processed in 184us (787us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189000.676057:0:85083:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 9 00000100:00100000:2.0:1784189000.678838:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1784189000.678949:0:85085:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436231680 00000100:00100000:3.0:1784189000.678971:0:85085:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436231680 00000100:00100000:3.0:1784189000.679099:0:85085:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 10 00000100:00100000:3.0:1784189000.679111:0:85085:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc07617f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9957a2dc-fd88-4a91-bca3-e2b7f365ab0c+10:42415:x1870854436231680:12345-192.168.203.12@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784189000.679257:0:85085:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc07617f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9957a2dc-fd88-4a91-bca3-e2b7f365ab0c+10:42415:x1870854436231680:12345-192.168.203.12@tcp:501:ll_cfg_requeue.0 Request processed in 148us (432us total) trans 0 rc -2/-2 00000100:00100000:3.0:1784189000.679266:0:85085:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 10 00010000:00010000:1.0:1784189001.457875:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784189002.479758:0:7454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784189002.800666:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1784189002.800692:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf44bc0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1870854458020992:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1784189002.800817:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784189002.802796:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc080f68000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1870854458021120:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1784189002.803333:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458020992 00000100:00100000:1.0:1784189002.803344:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458020992 00000100:00100000:1.0:1784189002.803441:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1836 00000100:00100000:2.0:1784189002.803451:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784189002.803452:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc081f80e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1870854458020992:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1784189002.803491:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 214592 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1784189002.803503:0:9466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458021120 00000100:00100000:2.0:1784189002.803506:0:9466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458021120 00000100:00100000:2.0:1784189002.803528:0:9466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1837 00000100:00100000:2.0:1784189002.803535:0:9466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc080f68e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1870854458021120:12345-0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1784189002.803546:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc081f80e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1870854458020992:12345-0@lo:13:osp-pre-1-1.0 Request processed in 97us (2730us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189002.803554:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1836 00000100:00080000:3.0:1784189002.803630:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1784189002.803636:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00000024:2.0:1784189002.803685:0:9466:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 214592 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1784189002.803728:0:9466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc080f68e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1870854458021120:12345-0@lo:13:osp-pre-0-1.0 Request processed in 193us (277us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189002.803735:0:9466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1837 00000100:00100000:1.0:1784189002.803776:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc080f68000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1870854458021120:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1784189002.803962:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf44bc0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1870854458020992:0@lo:13:osp-pre-1-1.0 00010000:00010000:2.0:1784189003.505431:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784189004.071862:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1784189004.072435:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1784189004.072536:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1784189004.072666:0:85084:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436231808 00000100:00100000:1.0:1784189004.072679:0:85084:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436231808 00000100:00100000:3.0:1784189004.072715:0:66170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436231936 00000100:00100000:3.0:1784189004.072733:0:66170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436231936 00000100:00100000:1.0:1784189004.072766:0:85084:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 11 00000100:00100000:1.0:1784189004.072781:0:85084:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc07138c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9957a2dc-fd88-4a91-bca3-e2b7f365ab0c+10:2396:x1870854436231808:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:3.0:1784189004.072796:0:66170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436232064 00000100:00100000:3.0:1784189004.072802:0:66170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436232064 00000100:00100000:3.0:1784189004.072866:0:66170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 991 00000100:00100000:3.0:1784189004.072878:0:66170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc081f83480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+6:2396:x1870854436232064:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:1.0:1784189004.072907:0:85084:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc07138c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9957a2dc-fd88-4a91-bca3-e2b7f365ab0c+10:2396:x1870854436231808:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 122us (1051us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189004.072918:0:85084:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 11 00000100:00100000:3.0:1784189004.072962:0:66170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc081f83480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+6:2396:x1870854436232064:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 84us (422us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189004.072973:0:66170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 991 00000100:00100000:3.0:1784189004.072995:0:66170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1052 00000100:00100000:3.0:1784189004.073003:0:66170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc081f81500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2395:x1870854436231936:12345-192.168.203.12@tcp:38:kworker.0 00000100:00080000:1.0:1784189004.073004:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00020000:3.0:1784189004.073028:0:66170:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.203.12@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1784189004.073061:0:66170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc081f81500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2395:x1870854436231936:12345-192.168.203.12@tcp:38:kworker.0 Request processed in 57us (625us total) trans 0 rc -19/-19 00000100:00100000:3.0:1784189004.073068:0:66170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1052 00010000:00010000:1.0:1784189004.530781:0:26173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1784189004.847797:0:63468:0:(pinger.c:229:ptlrpc_pinger_process_import()) bd553d0d-03e2-4233-b06b-b55bbfa2b954->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1784189004.847814:0:63468:0:(pinger.c:247:ptlrpc_pinger_process_import()) bd553d0d-03e2-4233-b06b-b55bbfa2b954->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1784189004.847817:0:63468:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1784189004.847850:0:63468:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1784189004.847855:0:63468:0:(import.c:65:import_set_state_nolock()) ffff9dbf42271800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1784189004.847865:0:63468:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3241 00000100:00080000:1.0:1784189004.847871:0:63468:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1784189004.847881:0:63468:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9dbf42271800 using connection 192.168.203.112@tcp/0@lo 00000100:00100000:1.0:1784189004.848003:0:63468:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9dbf4859ad80 x1870854458021248/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1784189004.848129:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf48598a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3641:1870854458021376:0@lo:400:kworker.0 00000100:00100000:3.0:1784189004.848220:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784189004.848351:0:66169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458021376 00000100:00100000:0.0:1784189004.848379:0:66169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458021376 00000100:00100000:0.0:1784189004.848469:0:66169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 992 00000100:00100000:0.0:1784189004.848480:0:66169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf44bc1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1870854458021376:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1784189004.848696:0:63468:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1784189004.848701:0:63468:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1784189004.848704:0:63468:0:(import.c:65:import_set_state_nolock()) ffff9dbf425f4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1784189004.848709:0:63468:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3241 00000100:00080000:1.0:1784189004.848711:0:63468:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1784189004.848717:0:63468:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9dbf425f4800 using connection 192.168.203.112@tcp/0@lo 00000100:00100000:1.0:1784189004.848735:0:63468:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9dbf48598e00 x1870854458021504/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1784189004.848766:0:63468:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1784189004.848770:0:63468:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1784189004.848771:0:63468:0:(import.c:65:import_set_state_nolock()) ffff9dbf436c4000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1784189004.848775:0:63468:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3241 00000100:00080000:1.0:1784189004.848778:0:63468:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1784189004.848783:0:63468:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9dbf436c4000 using connection 192.168.203.112@tcp/0@lo 00000100:00100000:1.0:1784189004.848800:0:63468:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9dbf48599500 x1870854458021760/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1784189004.848920:0:3639:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1784188994/real 1784188994] req@ffff9dc080f6ce00 x1870854458018560/t0(0) o250->MGC192.168.203.112@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1784189004 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784189004.848944:0:3639:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9dc080f6ce00 x1870854458018560/t0(0) o250->MGC192.168.203.112@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1784189004 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784189004.848961:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf4859ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3639:1870854458021248:0@lo:38:kworker.0 00000100:00100000:2.0:1784189004.848995:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784189004.849019:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf48598e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3639:1870854458021504:0@lo:38:kworker.0 00000100:00100000:2.0:1784189004.849039:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784189004.849054:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf48599500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3639:1870854458021760:0@lo:38:kworker.0 00000100:00100000:2.0:1784189004.849079:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1784189004.849098:0:3639:0:(import.c:65:import_set_state_nolock()) ffff9dc07110c800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1784189004.849106:0:3639:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:2.0:1784189004.849115:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc080f6ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:bd553d0d-03e2-4233-b06b-b55bbfa2b954:3639:1870854458018560:0@lo:250:kworker.0 00000100:00100000:2.0:1784189004.849183:0:66170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458021248 00000100:00100000:2.0:1784189004.849189:0:66170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458021248 00000100:00100000:2.0:1784189004.849215:0:66170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458021504 00000100:00100000:2.0:1784189004.849219:0:66170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458021504 00000100:00100000:2.0:1784189004.849230:0:66170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1053 00000100:00100000:2.0:1784189004.849236:0:66170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc080f68000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3639:x1870854458021248:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1784189004.849260:0:66170:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1784189004.849313:0:66170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc080f68000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3639:x1870854458021248:12345-0@lo:38:kworker.0 Request processed in 75us (316us total) trans 0 rc -19/-19 00000100:00100000:2.0:1784189004.849339:0:66170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1053 00000100:00100000:2.0:1784189004.849358:0:66170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1054 00000100:00100000:2.0:1784189004.849363:0:66170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc080f6ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3639:x1870854458021504:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1784189004.849372:0:66170:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1784189004.849409:0:66170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc080f6ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3639:x1870854458021504:12345-0@lo:38:kworker.0 Request processed in 33us (356us total) trans 0 rc -19/-19 00000100:00100000:2.0:1784189004.849416:0:66170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1054 00000100:00080000:2.0:1784189004.849454:0:3639:0:(import.c:65:import_set_state_nolock()) ffff9dbf42271800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1784189004.849458:0:3639:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1784189004.849461:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf4859ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3639:1870854458021248:0@lo:38:kworker.0 00000100:00080000:2.0:1784189004.849469:0:3639:0:(import.c:65:import_set_state_nolock()) ffff9dbf425f4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1784189004.849472:0:3639:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1784189004.849475:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf48598e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3639:1870854458021504:0@lo:38:kworker.0 00000100:00100000:2.0:1784189004.849537:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf4859b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1870854458021888:0@lo:400:kworker.0 00000100:00100000:2.0:1784189004.849570:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784189004.849600:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1784189004.849607:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf48599c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3643:1870854458021632:0@lo:400:kworker.0 00000100:00100000:2.0:1784189004.849631:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784189004.849656:0:66170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458021632 00000100:00100000:2.0:1784189004.849659:0:66170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458021632 00000100:00100000:2.0:1784189004.849692:0:66170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 993 00000100:00100000:2.0:1784189004.849699:0:66170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc080f68a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1870854458021632:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784189004.849739:0:66170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc080f68a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1870854458021632:12345-0@lo:400:kworker.0 Request processed in 40us (107us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189004.849755:0:66170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 993 00000100:00100000:2.0:1784189004.849791:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf48599c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3643:1870854458021632:0@lo:400:kworker.0 00000100:00080000:2.0:1784189004.849836:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1784189004.849864:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf48599880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1870854458022016:0@lo:400:kworker.0 00000100:00100000:2.0:1784189004.849894:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 10000000:01000000:2.0:1784189004.849940:0:85077:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00010000:00010000:2.0:1784189004.849962:0:85077:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.112@tcp lock: ffff9dc080f05e00/0xcc1762b626f8a1e0 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0xcc1762b626f8a1e7 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1784189004.849975:0:85077:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.112@tcp lock: ffff9dc080f05e00/0xcc1762b626f8a1e0 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0xcc1762b626f8a1e7 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784189004.849982:0:85077:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:2.0:1784189004.849997:0:85077:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1784189004.850009:0:85077:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.112@tcp lock: ffff9dc080f05e00/0xcc1762b626f8a1e0 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0xcc1762b626f8a1e7 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189004.850045:0:85077:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.112@tcp lock: ffff9dc070146a00/0xcc1762b626f8a146 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x110e400000000 nid: local remote: 0xcc1762b626f8a14d expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1784189004.850052:0:85077:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.112@tcp lock: ffff9dc070146a00/0xcc1762b626f8a146 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x110f400000000 nid: local remote: 0xcc1762b626f8a14d expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784189004.850057:0:85077:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1784189004.850063:0:85077:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1784189004.850067:0:85077:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.112@tcp lock: ffff9dc070146a00/0xcc1762b626f8a146 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x590f400000000 nid: local remote: 0xcc1762b626f8a14d expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189004.850077:0:85077:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.112@tcp lock: ffff9dc070147c00/0xcc1762b626f8a162 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x110e400000000 nid: local remote: 0xcc1762b626f8a169 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1784189004.850091:0:85077:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.112@tcp lock: ffff9dc070147c00/0xcc1762b626f8a162 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x110f400000000 nid: local remote: 0xcc1762b626f8a169 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784189004.850096:0:85077:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1784189004.850111:0:85077:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1784189004.850116:0:85077:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.112@tcp lock: ffff9dc070147c00/0xcc1762b626f8a162 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x590f400000000 nid: local remote: 0xcc1762b626f8a169 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189004.850125:0:85077:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.112@tcp lock: ffff9dc080f04200/0xcc1762b626f8a18c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x110e400000000 nid: local remote: 0xcc1762b626f8a193 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1784189004.850131:0:85077:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.112@tcp lock: ffff9dc080f04200/0xcc1762b626f8a18c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x110f400000000 nid: local remote: 0xcc1762b626f8a193 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784189004.850137:0:85077:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1784189004.850149:0:85077:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1784189004.850153:0:85077:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.112@tcp lock: ffff9dc080f04200/0xcc1762b626f8a18c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x590f400000000 nid: local remote: 0xcc1762b626f8a193 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189004.850164:0:85077:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.112@tcp lock: ffff9dc04a20b200/0xcc1762b626f8a19a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x110e400000000 nid: local remote: 0xcc1762b626f8a1a1 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1784189004.850170:0:85077:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.112@tcp lock: ffff9dc04a20b200/0xcc1762b626f8a19a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x110f400000000 nid: local remote: 0xcc1762b626f8a1a1 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784189004.850175:0:85077:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1784189004.850187:0:85077:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1784189004.850191:0:85077:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.112@tcp lock: ffff9dc04a20b200/0xcc1762b626f8a19a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x590f400000000 nid: local remote: 0xcc1762b626f8a1a1 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189004.850212:0:85077:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.112@tcp lock: ffff9dc04a20a200/0xcc1762b626f8a1b6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x110e400000000 nid: local remote: 0xcc1762b626f8a1bd expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1784189004.850219:0:85077:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.112@tcp lock: ffff9dc04a20a200/0xcc1762b626f8a1b6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x110f400000000 nid: local remote: 0xcc1762b626f8a1bd expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784189004.850224:0:85077:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1784189004.850239:0:85077:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1784189004.850245:0:85077:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.112@tcp lock: ffff9dc04a20a200/0xcc1762b626f8a1b6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x590f400000000 nid: local remote: 0xcc1762b626f8a1bd expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189004.850254:0:85077:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.112@tcp lock: ffff9dc0565e6600/0xcc1762b626f8a1c4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x110e400000000 nid: local remote: 0xcc1762b626f8a1cb expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1784189004.850260:0:85077:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.112@tcp lock: ffff9dc0565e6600/0xcc1762b626f8a1c4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x110f400000000 nid: local remote: 0xcc1762b626f8a1cb expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784189004.850264:0:85077:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1784189004.850277:0:85077:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1784189004.850281:0:85077:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.112@tcp lock: ffff9dc0565e6600/0xcc1762b626f8a1c4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x590f400000000 nid: local remote: 0xcc1762b626f8a1cb expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189004.850290:0:85077:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.112@tcp lock: ffff9dc04a20b400/0xcc1762b626f8a1ee lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0xcc1762b626f8a1f5 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1784189004.850296:0:85077:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.112@tcp lock: ffff9dc04a20b400/0xcc1762b626f8a1ee lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0xcc1762b626f8a1f5 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784189004.850302:0:85077:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1784189004.850369:0:85077:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1784189004.850374:0:85077:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.112@tcp lock: ffff9dc04a20b400/0xcc1762b626f8a1ee lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0xcc1762b626f8a1f5 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189004.850410:0:85077:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.112@tcp lock: ffff9dc0565e6400/0xcc1762b626f8a154 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0xcc1762b626f8a15b expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1784189004.850418:0:85077:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.112@tcp lock: ffff9dc0565e6400/0xcc1762b626f8a154 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0xcc1762b626f8a15b expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784189004.850424:0:85077:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1784189004.850431:0:85077:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1784189004.850435:0:85077:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.112@tcp lock: ffff9dc0565e6400/0xcc1762b626f8a154 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0xcc1762b626f8a15b expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189004.850457:0:85077:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.112@tcp lock: ffff9dc080f04600/0xcc1762b626f8a170 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0xcc1762b626f8a177 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1784189004.850464:0:85077:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.112@tcp lock: ffff9dc080f04600/0xcc1762b626f8a170 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0xcc1762b626f8a177 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784189004.850469:0:85077:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 00010000:00010000:2.0:1784189004.850476:0:85077:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1784189004.850479:0:85077:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.112@tcp lock: ffff9dc080f04600/0xcc1762b626f8a170 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0xcc1762b626f8a177 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189004.850502:0:85077:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.112@tcp lock: ffff9dc080f05a00/0xcc1762b626f8a17e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x110e400000000 nid: local remote: 0xcc1762b626f8a185 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1784189004.850510:0:85077:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.112@tcp lock: ffff9dc080f05a00/0xcc1762b626f8a17e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x110f400000000 nid: local remote: 0xcc1762b626f8a185 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784189004.850525:0:85077:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1784189004.850532:0:85077:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1784189004.850537:0:85077:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.112@tcp lock: ffff9dc080f05a00/0xcc1762b626f8a17e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x590f400000000 nid: local remote: 0xcc1762b626f8a185 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189004.850547:0:85077:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.112@tcp lock: ffff9dc0565e6200/0xcc1762b626f8a1a8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x110e400000000 nid: local remote: 0xcc1762b626f8a1af expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1784189004.850553:0:85077:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.112@tcp lock: ffff9dc0565e6200/0xcc1762b626f8a1a8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x110f400000000 nid: local remote: 0xcc1762b626f8a1af expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784189004.850559:0:85077:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1784189004.850571:0:85077:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1784189004.850574:0:85077:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.112@tcp lock: ffff9dc0565e6200/0xcc1762b626f8a1a8 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x590f400000000 nid: local remote: 0xcc1762b626f8a1af expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189004.850583:0:85077:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.112@tcp lock: ffff9dc04a20ba00/0xcc1762b626f8a1d2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0xcc1762b626f8a1d9 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1784189004.850589:0:85077:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.112@tcp lock: ffff9dc04a20ba00/0xcc1762b626f8a1d2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0xcc1762b626f8a1d9 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784189004.850594:0:85077:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1784189004.850605:0:85077:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1784189004.850609:0:85077:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.112@tcp lock: ffff9dc04a20ba00/0xcc1762b626f8a1d2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0xcc1762b626f8a1d9 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1784189004.850631:0:85077:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffff9dc07110c800 already not connected (conn 54, was 0): DISCONN 00000100:00080000:2.0:1784189004.850637:0:85077:0:(import.c:65:import_set_state_nolock()) ffff9dc07110c800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1784189004.850648:0:85077:0:(import.c:510:import_select_connection()) MGC192.168.203.112@tcp: connect to NID 0@lo last attempt 3236 00000100:00080000:2.0:1784189004.850651:0:85077:0:(import.c:589:import_select_connection()) MGC192.168.203.112@tcp: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1784189004.850657:0:85077:0:(import.c:624:import_select_connection()) MGC192.168.203.112@tcp: import ffff9dc07110c800 using connection 192.168.203.112@tcp/0@lo 00000100:00100000:2.0:1784189004.850682:0:85077:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9dc080f68380 x1870854458022144/t0(0) o250->MGC192.168.203.112@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1784189004.850700:0:85077:0:(recover.c:337:ptlrpc_recover_import()) MGS: recovery started, waiting 20 seconds 00000100:00100000:2.0:1784189004.850713:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc080f68380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:bd553d0d-03e2-4233-b06b-b55bbfa2b954:3639:1870854458022144:0@lo:250:mount.lustre.0 00000100:00100000:2.0:1784189004.850757:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784189004.850832:0:85085:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458022144 00000100:00100000:2.0:1784189004.850838:0:85085:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458022144 00000100:00100000:2.0:1784189004.850866:0:85085:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1784189004.850872:0:85085:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc07138e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0+-99:3639:x1870854458022144:12345-0@lo:250:mount.lustre.0 00010000:00080000:2.0:1784189004.850897:0:85085:0:(ldlm_lib.c:1445:target_handle_connect()) MGS: connection from bd553d0d-03e2-4233-b06b-b55bbfa2b954@0@lo t0 exp 0000000000000000 cur 3247 last 0 00000020:00000080:2.0:1784189004.850937:0:85085:0:(genops.c:1406:class_connect()) connect: client bd553d0d-03e2-4233-b06b-b55bbfa2b954, cookie 0xcc1762b626f8a559 00000100:00080000:2.0:1784189004.851102:0:85085:0:(import.c:65:import_set_state_nolock()) ffff9dc06b3eb800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1784189004.851153:0:85085:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc07138e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd553d0d-03e2-4233-b06b-b55bbfa2b954+5:3639:x1870854458022144:12345-0@lo:250:mount.lustre.0 Request processed in 279us (394us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189004.851162:0:85085:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1784189004.851199:0:3639:0:(client.c:3112:ptlrpc_free_committed()) MGC192.168.203.112@tcp: committing for last_committed 0 gen 23 00000100:00080000:2.0:1784189004.851207:0:3639:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.203.112@tcp: connect to target with instance 0 00000100:00080000:2.0:1784189004.851216:0:3639:0:(import.c:956:ptlrpc_connect_set_flags()) MGC192.168.203.112@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:2.0:1784189004.851220:0:3639:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:2.0:1784189004.851223:0:3639:0:(import.c:65:import_set_state_nolock()) ffff9dc07110c800 MGS: changing import state from CONNECTING to FULL 10000000:01000000:2.0:1784189004.851225:0:3639:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:2.0:1784189004.851242:0:3639:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:2.0:1784189004.851249:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc080f68380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:bd553d0d-03e2-4233-b06b-b55bbfa2b954:3639:1870854458022144:0@lo:250:mount.lustre.0 00000020:01000000:2.0:1784189004.851294:0:27065:0:(tgt_mount.c:1626:tgt_import_update()) NID #0: 192.168.203.112@tcp 10000000:01000000:2.0:1784189004.851345:0:27065:0:(mgc_request_server.c:464:mgc_set_info_async_server()) NID notify for lustre-OST0000 about 1 new NIDs 00000020:01000004:2.0:1784189004.851350:0:27065:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: req 00000020:01000004:2.0:1784189004.851352:0:27065:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1784189004.851353:0:27065:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1784189004.851354:0:27065:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1784189004.851355:0:27065:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1784189004.851357:0:27065:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1784189004.851358:0:27065:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1784189004.851361:0:27065:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1784189004.851362:0:27065:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:01000000:2.0:1784189004.851392:0:27065:0:(tgt_mount.c:1637:tgt_import_update()) lustre-OST0000: notify about 1 NIDs, rc = 0 10000000:01000000:2.0:1784189004.851411:0:27065:0:(mgc_request_server.c:464:mgc_set_info_async_server()) NID notify for lustre-OST0001 about 1 new NIDs 00000020:01000004:2.0:1784189004.851413:0:27065:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: req 00000020:01000004:2.0:1784189004.851414:0:27065:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1784189004.851416:0:27065:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1784189004.851417:0:27065:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1784189004.851418:0:27065:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1784189004.851419:0:27065:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1784189004.851420:0:27065:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1784189004.851421:0:27065:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1784189004.851422:0:27065:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:01000000:2.0:1784189004.851448:0:27065:0:(tgt_mount.c:1637:tgt_import_update()) lustre-OST0001: notify about 1 NIDs, rc = 0 10000000:01000000:2.0:1784189004.851453:0:27065:0:(mgc_request_server.c:464:mgc_set_info_async_server()) NID notify for lustre-MDT0001 about 1 new NIDs 00000020:01000004:2.0:1784189004.851455:0:27065:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: req 00000020:01000004:2.0:1784189004.851456:0:27065:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1784189004.851457:0:27065:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1784189004.851458:0:27065:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1784189004.851460:0:27065:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1784189004.851461:0:27065:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1784189004.851462:0:27065:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1784189004.851463:0:27065:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1784189004.851464:0:27065:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:01000000:2.0:1784189004.851478:0:27065:0:(tgt_mount.c:1637:tgt_import_update()) lustre-MDT0001: notify about 1 NIDs, rc = 0 00000100:00100000:2.0:1784189004.851510:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc07016e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:bd553d0d-03e2-4233-b06b-b55bbfa2b954:3643:1870854458022528:0@lo:253:kworker.0 00000100:00100000:0.0:1784189004.851530:0:66169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf44bc1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1870854458021376:12345-0@lo:400:kworker.0 Request processed in 3049us (3308us total) trans 0 rc 0/0 00000100:00100000:0.0:1784189004.851544:0:66169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 992 00000100:00100000:3.0:1784189004.851552:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf48598a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3641:1870854458021376:0@lo:400:kworker.0 00000100:00100000:3.0:1784189004.851576:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc080f68380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:bd553d0d-03e2-4233-b06b-b55bbfa2b954:3641:1870854458022272:0@lo:253:kworker.0 00000100:00100000:0.0:1784189004.851583:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458021760 00000100:00100000:0.0:1784189004.851589:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458021760 00000100:00100000:0.0:1784189004.851622:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3694 00000100:00100000:0.0:1784189004.851627:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc080f6aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3639:x1870854458021760:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1784189004.851641:0:8439:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00080000:1.0:1784189004.851781:0:63468:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1784189004.851794:0:63468:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1784189004.851797:0:63468:0:(import.c:65:import_set_state_nolock()) ffff9dbf43690800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1784189004.851802:0:63468:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3241 00000100:00080000:1.0:1784189004.851805:0:63468:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1784189004.851809:0:63468:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff9dbf43690800 using connection 192.168.203.112@tcp/0@lo 00000100:00100000:1.0:1784189004.851829:0:26165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458021888 00000100:00100000:1.0:1784189004.851833:0:26165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458021888 00000100:00100000:1.0:1784189004.851882:0:26165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458022016 00000100:00100000:1.0:1784189004.851886:0:26165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458022016 00000100:00100000:1.0:1784189004.851906:0:26165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2303 00000100:00100000:1.0:1784189004.851920:0:26165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc080f6b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0001-mdtlov_UUID+5:3643:x1870854458021888:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784189004.853856:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784189004.853856:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784189004.854161:0:85085:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458022528 00000100:00100000:3.0:1784189004.854171:0:85085:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458022528 00000100:00100000:3.0:1784189004.854223:0:85085:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458022272 00000100:00100000:3.0:1784189004.854245:0:85085:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458022272 00000100:00100000:3.0:1784189004.854468:0:85085:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1784189004.854481:0:85085:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc056a55850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd553d0d-03e2-4233-b06b-b55bbfa2b954+6:3643:x1870854458022528:12345-0@lo:253:kworker.0 20000000:01000000:3.0:1784189004.854524:0:85085:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:3.0:1784189004.854541:0:85085:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00080000:3.0:1784189004.854697:0:85077:0:(recover.c:348:ptlrpc_recover_import()) MGS: recovery finished FULL, rc = 0 00000020:01000004:3.0:1784189004.854711:0:85077:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:3.0:1784189004.854757:0:85077:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds1_flakey 10000000:01000000:3.0:1784189004.854763:0:85077:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.112@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000100:00100000:2.0:1784189004.854856:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1784189004.854873:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc07016f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:bd553d0d-03e2-4233-b06b-b55bbfa2b954:3643:1870854458022400:0@lo:253:kworker.0 00000100:00100000:2.0:1784189004.855017:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000040:01000000:3.0:1784189004.855035:0:85077:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.112@tcp ctxt 0 is initialized 00000020:01000004:3.0:1784189004.855077:0:85077:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.203.112@tcp, index=0000, flags=0x20005 00000020:01000004:3.0:1784189004.855083:0:85077:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1784189004.855085:0:85077:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1784189004.855086:0:85077:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1784189004.855088:0:85077:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1784189004.855089:0:85077:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1784189004.855091:0:85077:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1784189004.855092:0:85077:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1784189004.855094:0:85077:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1784189004.855095:0:85077:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1784189004.855097:0:85077:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1784189004.855099:0:85077:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:3.0:1784189004.855102:0:85077:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1784189004.855103:0:85077:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1784189004.855104:0:85077:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1784189004.855105:0:85077:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1784189004.855107:0:85077:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1784189004.855108:0:85077:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1784189004.855109:0:85077:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1784189004.855110:0:85077:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1784189004.855111:0:85077:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1784189004.855113:0:85077:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1784189004.855140:0:85077:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:3.0:1784189004.855158:0:85077:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf44bc3480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd553d0d-03e2-4233-b06b-b55bbfa2b954:85077:1870854458022656:0@lo:253:mount.lustre.0 00000100:00080000:2.0:1784189004.855171:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1784189004.855180:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1784189004.855201:0:85077:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784189004.855208:0:26166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2304 00000100:00100000:2.0:1784189004.855224:0:26166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc080f69c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+5:3640:x1870854458022016:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784189004.855236:0:85077:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dbf426296c0 going to sleep for 11 seconds 00000100:00100000:3.0:1784189004.855466:0:85084:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458022400 00000100:00100000:3.0:1784189004.855472:0:85084:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458022400 00000100:00100000:3.0:1784189004.855496:0:85084:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458022656 00000100:00100000:3.0:1784189004.855498:0:85084:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458022656 00000100:00100000:3.0:1784189004.855509:0:85084:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1784189004.855515:0:85084:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc056a54850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd553d0d-03e2-4233-b06b-b55bbfa2b954+8:3641:x1870854458022272:12345-0@lo:253:kworker.0 20000000:01000000:3.0:1784189004.855538:0:85084:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 00000100:00100000:3.0:1784189004.855585:0:63468:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9dbf44bc1180 x1870854458022784/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1784189004.855619:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf44bc1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3639:1870854458022784:0@lo:38:kworker.0 00000100:00100000:0.0:1784189004.855675:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc080f6aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3639:x1870854458021760:12345-0@lo:38:kworker.0 Request processed in 4043us (6591us total) trans 0 rc -19/-19 00000100:00100000:3.0:1784189004.855677:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784189004.855691:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3694 00000100:00080000:3.0:1784189004.855730:0:3639:0:(import.c:65:import_set_state_nolock()) ffff9dbf436c4000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1784189004.855737:0:3639:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1784189004.855742:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf48599500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3639:1870854458021760:0@lo:38:kworker.0 00000100:00100000:3.0:1784189004.855782:0:66170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458022784 00000100:00100000:3.0:1784189004.855786:0:66170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458022784 00000100:00100000:3.0:1784189004.855833:0:66170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1055 00000100:00100000:3.0:1784189004.855838:0:66170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf44bc0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3639:x1870854458022784:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1784189004.856031:0:66170:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1784189004.856077:0:66170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf44bc0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3639:x1870854458022784:12345-0@lo:38:kworker.0 Request processed in 237us (401us total) trans 0 rc -19/-19 00000100:00100000:3.0:1784189004.856084:0:66170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1055 00000100:00080000:3.0:1784189004.856113:0:3639:0:(import.c:65:import_set_state_nolock()) ffff9dbf43690800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1784189004.856117:0:3639:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1784189004.856120:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf44bc1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3639:1870854458022784:0@lo:38:kworker.0 00000100:00100000:1.0:1784189004.856597:0:26165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc080f6b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0001-mdtlov_UUID+5:3643:x1870854458021888:12345-0@lo:400:kworker.0 Request processed in 4674us (7022us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189004.856607:0:26165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2303 00000100:00100000:0.0:1784189004.856694:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf4859b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1870854458021888:0@lo:400:kworker.0 00000100:00100000:2.0:1784189004.857507:0:26166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc080f69c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+5:3640:x1870854458022016:12345-0@lo:400:kworker.0 Request processed in 2284us (7606us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189004.857518:0:26166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2304 00000100:00100000:0.0:1784189004.857818:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf48599880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1870854458022016:0@lo:400:kworker.0 20000000:01000000:0.0:1784189004.863240:0:85085:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1784189004.863263:0:85085:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 20000000:01000000:2.0:1784189004.863435:0:85086:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1784189004.863441:0:85086:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1784189004.863470:0:85086:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9dc0755a5c00/0xcc1762b626f8a560 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 85086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189004.863505:0:85086:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9dc0755a4200/0xcc1762b626f8a53d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c3cc7 expref: 9 pid: 85085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189004.863516:0:85086:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9dc0755a5c00/0xcc1762b626f8a560 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 85086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189004.863571:0:85086:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9dc0755a4200/0xcc1762b626f8a53d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c3cc7 expref: 9 pid: 85085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189004.863589:0:85086:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9dc0755a4200/0xcc1762b626f8a53d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c3cc7 expref: 9 pid: 85085 timeout: 3347 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784189004.863623:0:85086:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc07016dc00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:85086:1870854458022912:192.168.203.12@tcp:104: 20000000:01000000:3.0:1784189004.863672:0:85084:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:2.0:1784189004.863743:0:85086:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dc06bb82300 going to sleep for 11 seconds 00000100:00100000:0.0:1784189004.864382:0:85085:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc056a55850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd553d0d-03e2-4233-b06b-b55bbfa2b954+8:3643:x1870854458022528:12345-0@lo:253:kworker.0 Request processed in 9901us (10532us total) trans 0 rc 0/0 00000100:00100000:0.0:1784189004.864410:0:85085:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1784189004.864465:0:85085:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1784189004.864478:0:85085:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc056a55c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd553d0d-03e2-4233-b06b-b55bbfa2b954+7:3643:x1870854458022400:12345-0@lo:253:kworker.0 20000000:01000000:0.0:1784189004.864514:0:85085:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 00000020:01000004:2.0:1784189004.865013:0:3643:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: rep 00000020:01000004:2.0:1784189004.865016:0:3643:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1784189004.865034:0:3643:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1784189004.865035:0:3643:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1784189004.865037:0:3643:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1784189004.865039:0:3643:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1784189004.865040:0:3643:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1784189004.865043:0:3643:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1784189004.865044:0:3643:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000100:00100000:2.0:1784189004.865048:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc07016e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:bd553d0d-03e2-4233-b06b-b55bbfa2b954:3643:1870854458022528:0@lo:253:kworker.0 00000100:00100000:2.0:1784189004.869389:0:85086:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc07016dc00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:85086:1870854458022912:192.168.203.12@tcp:104: 00010000:00010000:2.0:1784189004.869438:0:85086:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9dc0755a5c00/0xcc1762b626f8a560 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 85086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1784189004.870478:0:85084:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1784189004.870486:0:85084:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:0.0:1784189004.871026:0:85085:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:2.0:1784189004.871486:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1784189004.871496:0:85084:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc056a54850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd553d0d-03e2-4233-b06b-b55bbfa2b954+7:3641:x1870854458022272:12345-0@lo:253:kworker.0 Request processed in 15978us (17646us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189004.871510:0:85084:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1784189004.871523:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436232192 00000100:00100000:2.0:1784189004.871532:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436232192 00000100:00100000:1.0:1784189004.871562:0:85084:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00010000:00010000:2.0:1784189004.871572:0:6499:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9dc0755a4200/0xcc1762b626f8a53d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c3cc7 expref: 10 pid: 85085 timeout: 3347 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784189004.871572:0:85084:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc056a56450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd553d0d-03e2-4233-b06b-b55bbfa2b954+6:85077:x1870854458022656:12345-0@lo:253:mount.lustre.0 00000100:00100000:2.0:1784189004.871619:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 2538 20000000:01000000:1.0:1784189004.871627:0:85084:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:2.0:1784189004.871628:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc07016dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9957a2dc-fd88-4a91-bca3-e2b7f365ab0c+10:2397:x1870854436232192:12345-192.168.203.12@tcp:103:ldlm_bl.0 20000000:01000000:1.0:1784189004.871630:0:85084:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:1.0:1784189004.871632:0:85084:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 00010000:00010000:2.0:1784189004.871638:0:6499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 20000000:01000000:1.0:1784189004.871639:0:85084:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00010000:00010000:2.0:1784189004.871645:0:6499:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9dc0755a4200/0xcc1762b626f8a53d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c3cc7 expref: 10 pid: 85085 timeout: 3347 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189004.871658:0:6499:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9dc0755a4200/0xcc1762b626f8a53d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c3cc7 expref: 10 pid: 85085 timeout: 3347 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189004.871681:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dc0755a4200/0xcc1762b626f8a53d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c3cc7 expref: 10 pid: 85085 timeout: 3347 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189004.871703:0:6499:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9dc0755a5c00/0xcc1762b626f8a560 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 85086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189004.871731:0:6499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dc0755a5c00/0xcc1762b626f8a560 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 85086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1784189004.871750:0:6499:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.008309838s 00010000:00010000:2.0:1784189004.871755:0:6499:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9dc0755a5c00/0xcc1762b626f8a560 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 85086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189004.871763:0:6499:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9dc0755a5c00/0xcc1762b626f8a560 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 85086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189004.871771:0:6499:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9dc0755a5c00/0xcc1762b626f8a560 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 85086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189004.871778:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9dc0755a5c00/0xcc1762b626f8a560 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 85086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189004.871785:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc0755a5c00 already unused, calling callback (ffffffffc0b2e230) 00010000:00010000:2.0:1784189004.871790:0:6499:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9dc0755a5c00/0xcc1762b626f8a560 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 85086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189004.871798:0:6499:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9dc0755a5c00/0xcc1762b626f8a560 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 85086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189004.871822:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9dc0755a5c00/0xcc1762b626f8a560 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 85086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189004.871835:0:6499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784189004.871893:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc07016dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9957a2dc-fd88-4a91-bca3-e2b7f365ab0c+9:2397:x1870854436232192:12345-192.168.203.12@tcp:103:ldlm_bl.0 Request processed in 266us (413us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189004.871900:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 2538 00010000:00010000:1.0:1784189004.872089:0:85086:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9dc0755a5c00/0xcc1762b626f8a560 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 85086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189004.872119:0:85086:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9dc0755a5c00/0xcc1762b626f8a560 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 85086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189004.872126:0:85086:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dc0755a5c00/0xcc1762b626f8a560 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 85086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1784189004.872404:0:3641:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: rep 00000020:01000004:0.0:1784189004.872414:0:3641:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1784189004.872416:0:3641:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1784189004.872417:0:3641:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1784189004.872419:0:3641:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1784189004.872420:0:3641:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1784189004.872422:0:3641:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1784189004.872424:0:3641:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1784189004.872426:0:3641:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000100:00100000:0.0:1784189004.872431:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc080f68380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:bd553d0d-03e2-4233-b06b-b55bbfa2b954:3641:1870854458022272:0@lo:253:kworker.0 00000100:00100000:3.0:1784189004.884265:0:85084:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc056a56450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd553d0d-03e2-4233-b06b-b55bbfa2b954+6:85077:x1870854458022656:12345-0@lo:253:mount.lustre.0 Request processed in 12680us (29050us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189004.884286:0:85084:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1784189004.884629:0:85077:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf44bc3480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd553d0d-03e2-4233-b06b-b55bbfa2b954:85077:1870854458022656:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1784189004.884649:0:85077:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:1.0:1784189004.884654:0:85077:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1784189004.884655:0:85077:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1784189004.884657:0:85077:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1784189004.884658:0:85077:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1784189004.884660:0:85077:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1784189004.884661:0:85077:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1784189004.884663:0:85077:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1784189004.884664:0:85077:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1784189004.884666:0:85077:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1784189004.884668:0:85077:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1784189004.884700:0:85077:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9dc047a82000 from lustre-MDT0000 10000000:01000000:1.0:1784189004.884742:0:85077:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:1.0:1784189004.884746:0:85077:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:1.0:1784189004.884758:0:85077:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9dc047a82000 10000000:01000000:1.0:1784189004.884763:0:85077:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1784189004.884770:0:85077:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff9dc047a82000 10000000:01000000:1.0:1784189004.884773:0:85077:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:1.0:1784189004.884777:0:85077:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-barrier-ffff9dc047a82000 from 1 10000000:01000000:1.0:1784189004.884781:0:85077:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:1.0:1784189004.884829:0:85077:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff9dc042d66400/0xcc1762b626f8a567 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 85077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189004.884842:0:85077:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: ffff9dc042d66400/0xcc1762b626f8a567 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 85077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189004.884873:0:85077:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: ffff9dc042d66400/0xcc1762b626f8a567 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 85077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784189004.884899:0:85077:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf48599f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd553d0d-03e2-4233-b06b-b55bbfa2b954:85077:1870854458023040:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1784189004.884949:0:85077:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784189004.885002:0:85077:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dc0487df9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1784189004.885073:0:85083:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458023040 00000100:00100000:3.0:1784189004.885082:0:85083:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458023040 00000100:00100000:3.0:1784189004.885132:0:85083:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1784189004.885142:0:85083:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc056a55050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd553d0d-03e2-4233-b06b-b55bbfa2b954+6:85077:x1870854458023040:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1784189004.885158:0:85083:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784189004.885175:0:85083:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dc05ec0d600/0xcc1762b626f8a56e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xcc1762b626f8a567 expref: -99 pid: 85083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189004.885205:0:85083:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dc05ec0d600/0xcc1762b626f8a56e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcc1762b626f8a567 expref: 7 pid: 85083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189004.885218:0:85083:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dc05ec0d600/0xcc1762b626f8a56e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcc1762b626f8a567 expref: 7 pid: 85083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189004.885291:0:85083:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc05ec0d600, rc 0) 00000100:00100000:3.0:1784189004.885435:0:85083:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc056a55050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd553d0d-03e2-4233-b06b-b55bbfa2b954+7:85077:x1870854458023040:12345-0@lo:101:mount.lustre.0 Request processed in 218us (409us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189004.885443:0:85083:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 20000000:01000000:0.0:1784189004.885542:0:85085:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1784189004.885562:0:85085:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:1.0:1784189004.885726:0:85077:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf48599f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd553d0d-03e2-4233-b06b-b55bbfa2b954:85077:1870854458023040:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1784189004.885743:0:85077:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: ffff9dc042d66400/0xcc1762b626f8a567 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc1762b626f8a56e expref: -99 pid: 85077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189004.885753:0:85077:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: ffff9dc042d66400/0xcc1762b626f8a567 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcc1762b626f8a56e expref: -99 pid: 85077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784189004.885771:0:85077:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:1.0:1784189004.885786:0:85077:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff9dc042d66400/0xcc1762b626f8a567 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc1762b626f8a56e expref: -99 pid: 85077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189004.885795:0:85077:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: ffff9dc042d66400/0xcc1762b626f8a567 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc1762b626f8a56e expref: -99 pid: 85077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784189004.885802:0:85077:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:1.0:1784189004.885805:0:85077:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1784189004.885810:0:85077:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff9dc047a82000 10000000:01000000:1.0:1784189004.885813:0:85077:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:1.0:1784189004.885816:0:85077:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:1.0:1784189004.885818:0:85077:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1784189004.885840:0:85077:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff9dc042d66200/0xcc1762b626f8a575 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 85077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189004.885859:0:85077:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: ffff9dc042d66200/0xcc1762b626f8a575 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 85077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189004.885867:0:85077:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: ffff9dc042d66200/0xcc1762b626f8a575 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 85077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784189004.885887:0:85077:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf48599f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd553d0d-03e2-4233-b06b-b55bbfa2b954:85077:1870854458023168:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1784189004.885920:0:85077:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784189004.885940:0:85077:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dc0487df9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1784189004.886003:0:85083:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458023168 00000100:00100000:3.0:1784189004.886008:0:85083:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458023168 00000100:00100000:3.0:1784189004.886039:0:85083:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1784189004.886048:0:85083:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc056a56850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd553d0d-03e2-4233-b06b-b55bbfa2b954+7:85077:x1870854458023168:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1784189004.886057:0:85083:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784189004.886067:0:85083:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dc05ec0d400/0xcc1762b626f8a57c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xcc1762b626f8a575 expref: -99 pid: 85083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189004.886090:0:85083:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dc05ec0d400/0xcc1762b626f8a57c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcc1762b626f8a575 expref: 8 pid: 85083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189004.886099:0:85083:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dc05ec0d400/0xcc1762b626f8a57c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcc1762b626f8a575 expref: 8 pid: 85083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189004.886107:0:85083:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc05ec0d400, rc 0) 00000100:00100000:3.0:1784189004.886138:0:85083:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc056a56850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd553d0d-03e2-4233-b06b-b55bbfa2b954+8:85077:x1870854458023168:12345-0@lo:101:mount.lustre.0 Request processed in 92us (217us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189004.886144:0:85083:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 20000000:01000000:3.0:1784189004.886167:0:85086:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1784189004.886171:0:85086:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1784189004.886183:0:85086:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9dc05ec0c400/0xcc1762b626f8a583 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 85086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189004.886193:0:85086:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dc05ec0c400/0xcc1762b626f8a583 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 85086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1784189004.886201:0:85086:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.008309838s 00010000:00010000:3.0:1784189004.886206:0:85086:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9dc05ec0c400/0xcc1762b626f8a583 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 85086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189004.886213:0:85086:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9dc05ec0c400/0xcc1762b626f8a583 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 85086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189004.886221:0:85086:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9dc05ec0c400/0xcc1762b626f8a583 lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 85086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189004.886228:0:85086:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9dc05ec0c400/0xcc1762b626f8a583 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 85086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784189004.886442:0:85077:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf48599f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd553d0d-03e2-4233-b06b-b55bbfa2b954:85077:1870854458023168:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1784189004.886458:0:85077:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: ffff9dc042d66200/0xcc1762b626f8a575 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc1762b626f8a57c expref: -99 pid: 85077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189004.886466:0:85077:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: ffff9dc042d66200/0xcc1762b626f8a575 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcc1762b626f8a57c expref: -99 pid: 85077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784189004.886531:0:85077:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf48599f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd553d0d-03e2-4233-b06b-b55bbfa2b954:85077:1870854458023296:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1784189004.886563:0:85077:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784189004.886590:0:85077:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dc0487df9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1784189004.886616:0:85085:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc056a55c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd553d0d-03e2-4233-b06b-b55bbfa2b954+7:3643:x1870854458022400:12345-0@lo:253:kworker.0 Request processed in 22142us (31598us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189004.886625:0:85085:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000020:01000004:1.0:1784189004.886632:0:3643:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: rep 00000020:01000004:1.0:1784189004.886634:0:3643:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1784189004.886636:0:3643:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1784189004.886637:0:3643:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1784189004.886638:0:3643:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1784189004.886639:0:3643:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1784189004.886641:0:3643:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1784189004.886643:0:3643:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1784189004.886644:0:3643:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000100:00100000:1.0:1784189004.886647:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc07016f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:bd553d0d-03e2-4233-b06b-b55bbfa2b954:3643:1870854458022400:0@lo:253:kworker.0 00000100:00100000:2.0:1784189004.886648:0:85085:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458023296 00000100:00100000:2.0:1784189004.886651:0:85085:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458023296 00000100:00100000:2.0:1784189004.886681:0:85084:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1784189004.886688:0:85084:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc076253850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd553d0d-03e2-4233-b06b-b55bbfa2b954+7:85077:x1870854458023296:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1784189004.886853:0:85084:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc076253850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd553d0d-03e2-4233-b06b-b55bbfa2b954+8:85077:x1870854458023296:12345-0@lo:501:mount.lustre.0 Request processed in 166us (289us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189004.886860:0:85084:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00010000:00010000:3.0:1784189004.887459:0:85086:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc05ec0c400 already unused, calling callback (ffffffffc0b2e230) 00010000:00010000:3.0:1784189004.887465:0:85086:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9dc05ec0c400/0xcc1762b626f8a583 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 85086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189004.887474:0:85086:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9dc05ec0c400/0xcc1762b626f8a583 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 85086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189004.887490:0:85086:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9dc05ec0c400/0xcc1762b626f8a583 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 85086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189004.887499:0:85086:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9dc05ec0c400/0xcc1762b626f8a583 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 85086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189004.887505:0:85086:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dc05ec0c400/0xcc1762b626f8a583 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 85086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784189004.887591:0:85077:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf48599f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd553d0d-03e2-4233-b06b-b55bbfa2b954:85077:1870854458023296:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1784189004.887641:0:85077:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf48599f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd553d0d-03e2-4233-b06b-b55bbfa2b954:85077:1870854458023424:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1784189004.887697:0:85077:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784189004.887788:0:85077:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dc0487df9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1784189004.892341:0:85084:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458023424 00000100:00100000:2.0:1784189004.892696:0:85084:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458023424 00000100:00100000:2.0:1784189004.892851:0:85084:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1784189004.892864:0:85084:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc0715abc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd553d0d-03e2-4233-b06b-b55bbfa2b954+8:85077:x1870854458023424:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1784189004.896771:0:85084:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc0715abc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd553d0d-03e2-4233-b06b-b55bbfa2b954+8:85077:x1870854458023424:12345-0@lo:503:mount.lustre.0 Request processed in 3896us (9058us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189004.896790:0:85084:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1784189004.897968:0:85077:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf48599f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd553d0d-03e2-4233-b06b-b55bbfa2b954:85077:1870854458023424:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1784189004.901792:0:85089:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc081f83100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bd553d0d-03e2-4233-b06b-b55bbfa2b954:85089:1870854458023552:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1784189004.901915:0:85089:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784189004.901978:0:85089:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dc05085bf00 going to sleep for 11 seconds 00000100:00100000:3.0:1784189004.902057:0:85083:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458023552 00000100:00100000:3.0:1784189004.902067:0:85083:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458023552 00000100:00100000:3.0:1784189004.902126:0:85083:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1784189004.902137:0:85083:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc0715a8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd553d0d-03e2-4233-b06b-b55bbfa2b954+8:85089:x1870854458023552:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1784189004.903904:0:85083:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc0715a8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd553d0d-03e2-4233-b06b-b55bbfa2b954+8:85089:x1870854458023552:12345-0@lo:502:llog_process_th.0 Request processed in 1758us (1979us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189004.903922:0:85083:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1784189004.904072:0:85089:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc081f83100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bd553d0d-03e2-4233-b06b-b55bbfa2b954:85089:1870854458023552:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1784189004.904119:0:85089:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1784189004.904134:0:85089:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784189004.904137:0:85089:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:0.0:1784189004.904143:0:85089:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:0.0:1784189004.904146:0:85089:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1784189004.904168:0:85089:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff9dbf44d7b380) 00000020:00000080:0.0:1784189004.904198:0:85089:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type lod with refcount 2 00000020:00000080:0.0:1784189004.904206:0:85089:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00080000:01000000:0.0:1784189004.904496:0:85089:0:(osd_handler.c:8929:osd_obd_connect()) connect #2 00000020:00000080:0.0:1784189004.904506:0:85089:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xcc1762b626f8a591 00000020:00000080:0.0:1784189004.904794:0:85089:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:0.0:1784189004.904800:0:85089:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1784189004.904804:0:85089:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784189004.904806:0:85089:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:0.0:1784189004.904809:0:85089:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1784189004.904813:0:85089:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784189004.904814:0:85089:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:0.0:1784189004.904828:0:85089:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1784189004.904838:0:85089:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff9dbf44d799c0) 00000020:00000080:0.0:1784189004.904854:0:85089:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type mdt with refcount 2 00000020:00000080:0.0:1784189004.904858:0:85089:0:(obd_config.c:1470:class_process_config()) processing cmd: cf007 00000020:00000080:0.0:1784189004.904860:0:85089:0:(obd_config.c:1514:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:0.0:1784189004.904863:0:85089:0:(obd_config.c:1148:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:0.0:1784189004.904869:0:85089:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1784189004.904927:0:85089:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9dc047a82000 from lustre-MDT0000, refs=3 00000020:00000080:0.0:1784189004.904941:0:85089:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff9dbf44d78000) 00000020:00000080:0.0:1784189004.904952:0:85089:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type mdd with refcount 2 00000004:01000000:0.0:1784189004.905016:0:85089:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:0.0:1784189004.905021:0:85089:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xcc1762b626f8a5a6 00000020:00000080:0.0:1784189004.905130:0:85089:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:0.0:1784189004.905139:0:85089:0:(mdd_device.c:1596:mdd_obd_connect()) connect #0 00000020:00000080:0.0:1784189004.905145:0:85089:0:(genops.c:1406:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0xcc1762b626f8a5ad 00080000:01000000:0.0:1784189004.905150:0:85089:0:(osd_handler.c:8929:osd_obd_connect()) connect #3 00000020:00000080:0.0:1784189004.905155:0:85089:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xcc1762b626f8a5b4 00010000:00010000:2.0:1784189004.989069:0:85089:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-4 is initialized 00000001:00080000:2.0:1784189004.989207:0:85089:0:(tgt_lastrcvd.c:1748:tgt_clients_data_init()) RCVRNG CLIENT uuid: b90fcc1c-0e69-42a4-a116-a71fec7aeb78 idx: 0 lr: 0 srv lr: 94489280512 lx: 0 gen 22 00000001:00080000:2.0:1784189004.989670:0:85089:0:(tgt_lastrcvd.c:1748:tgt_clients_data_init()) RCVRNG CLIENT uuid: lustre-MDT0001-mdtlov_UUID idx: 1 lr: 0 srv lr: 94489280512 lx: 0 gen 21 00000001:00000004:2.0:1784189004.989700:0:85089:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 23, last_transno is 94489280512 00000001:00080000:2.0:1784189004.989810:0:85089:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000001:00080000:2.0:1784189004.989867:0:85089:0:(tgt_lastrcvd.c:2283:tgt_reply_data_init()) lustre-MDT0000: restore reply ffff9dc06bb820c0: xid 1870854436222208, transno 94489280513, client gen 22, slot idx 0 00000020:00000080:2.0:1784189004.993727:0:85089:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff9dc075478000) 00000020:00000080:2.0:1784189004.993755:0:85089:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type qmt with refcount 2 00080000:01000000:2.0:1784189004.993835:0:85089:0:(osd_handler.c:8929:osd_obd_connect()) connect #4 00000020:00000080:2.0:1784189004.993846:0:85089:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xcc1762b626f8a5d0 00000020:00000080:3.0:1784189004.995588:0:85089:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:0.0:1784189005.003529:0:85089:0:(genops.c:1406:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0xcc1762b626f8a5d7 00000020:00000080:3.0:1784189005.004271:0:85089:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:3.0:1784189005.004289:0:85089:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1784189005.004297:0:85089:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784189005.004300:0:85089:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:3.0:1784189005.004311:0:85089:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1784189005.004314:0:85089:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #8 00000020:01000000:3.0:1784189005.004316:0:85089:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1784189005.004335:0:85089:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1784189005.004338:0:85089:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1784189005.004341:0:85089:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784189005.004343:0:85089:0:(obd_config.c:1561:class_process_config()) marker 8 (0x6) lustre sys.timeout 00000020:01000000:3.0:1784189005.004347:0:85089:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1784189005.004353:0:85089:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784189005.004355:0:85089:0:(obd_config.c:1561:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:3.0:1784189005.004364:0:85089:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000004:01000000:3.0:1784189005.004441:0:85089:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:3.0:1784189005.004465:0:85089:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1784189005.004469:0:85089:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784189005.004470:0:85089:0:(obd_config.c:1561:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:3.0:1784189005.004473:0:85089:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1784189005.004477:0:85089:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784189005.004478:0:85089:0:(obd_config.c:1561:class_process_config()) marker 17 (0x1) lustre-MDT0001 add osp 00000020:00000080:3.0:1784189005.004490:0:85089:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1784189005.004497:0:85089:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.203.112@tcp to nid 0x20000c0a8cb70 (192.168.203.112@tcp) 00000020:00000080:3.0:1784189005.004531:0:85089:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1784189005.004551:0:85089:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osp-MDT0000 (ffff9dc06bb34d40) 00000020:00000080:3.0:1784189005.004574:0:85089:0:(obd_config.c:720:class_attach_name()) OBD: dev 21 attached type osp with refcount 2 00000020:00000080:3.0:1784189005.004582:0:85089:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1784189005.004654:0:85089:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0001-osp-MDT0000: connect to lustre-MDT0000-osd (lustre-MDT0001-osp-MDT0000) 00080000:01000000:3.0:1784189005.004660:0:85089:0:(osd_handler.c:8929:osd_obd_connect()) connect #5 00000020:00000080:3.0:1784189005.004668:0:85089:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xcc1762b626f8a5e5 00010000:00080000:3.0:1784189005.004711:0:85089:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9dc06b8e5000@lustre-MDT0001-osp-MDT0000: add connection 192.168.203.112@tcp at head 00010000:00010000:3.0:1784189005.009809:0:85089:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-osp-MDT0000-9 is initialized 00000020:00000080:1.0:1784189005.011727:0:85089:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1784189005.011747:0:85089:0:(obd_config.c:1470:class_process_config()) processing cmd: cf014 00000004:01000000:1.0:1784189005.011794:0:85089:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0001_UUID idx:1 gen:1 00000020:00000080:1.0:1784189005.011824:0:85089:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xcc1762b626f8a5ec 00000100:00080000:1.0:1784189005.011846:0:85089:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1784189005.011854:0:85089:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff9dc06b8e5000 using connection 192.168.203.112@tcp/0@lo 00000100:00100000:1.0:1784189005.011900:0:85089:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9dbf48599f80 x1870854458023680/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1784189005.011969:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf48599f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3639:1870854458023680:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1784189005.012058:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784189005.012121:0:26492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458023680 00000100:00100000:2.0:1784189005.012131:0:26492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458023680 00000100:00080000:1.0:1784189005.012137:0:85089:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000100:00100000:2.0:1784189005.012176:0:26492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3695 00000100:00100000:2.0:1784189005.012187:0:26492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf44bc1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3639:x1870854458023680:12345-0@lo:38:llog_process_th.0 00010000:00080000:2.0:1784189005.012219:0:26492:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 3247 last 0 00000020:01000000:1.0:1784189005.012221:0:85089:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1784189005.012228:0:85089:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784189005.012264:0:26492:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xcc1762b626f8a5f3 00000004:00100000:2.0:1784189005.012282:0:26492:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000020:00000080:1.0:1784189005.012288:0:85089:0:(obd_config.c:1561:class_process_config()) marker 17 (0x2) lustre-MDT0001 add osp 00000020:01000000:1.0:1784189005.012294:0:85089:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1784189005.012297:0:85089:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #19 00000020:01000000:1.0:1784189005.012299:0:85089:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1784189005.012300:0:85089:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1784189005.012302:0:85089:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1784189005.012305:0:85089:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784189005.012307:0:85089:0:(obd_config.c:1561:class_process_config()) marker 19 (0x6) lustre sys.timeout 00000020:01000000:1.0:1784189005.012309:0:85089:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1784189005.012314:0:85089:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:1.0:1784189005.012348:0:85089:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784189005.012349:0:85089:0:(obd_config.c:1561:class_process_config()) marker 22 (0x1) lustre-OST0000 add osc 00000020:00000080:1.0:1784189005.012365:0:85089:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1784189005.012369:0:85089:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.203.112@tcp to nid 0x20000c0a8cb70 (192.168.203.112@tcp) 00000020:01000000:1.0:1784189005.012406:0:85089:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:1.0:1784189005.012410:0:85089:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1784189005.012426:0:85089:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff9dbf449f3380) 00000020:00000080:1.0:1784189005.012445:0:85089:0:(obd_config.c:720:class_attach_name()) OBD: dev 22 attached type osp with refcount 2 00000020:00000080:1.0:1784189005.012452:0:85089:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000100:00080000:2.0:1784189005.012489:0:26492:0:(import.c:65:import_set_state_nolock()) ffff9dc0477b4000 : changing import state from RECOVER to FULL 00000004:00080000:1.0:1784189005.012533:0:85089:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:1.0:1784189005.012542:0:85089:0:(osd_handler.c:8929:osd_obd_connect()) connect #6 00000020:00000080:1.0:1784189005.012550:0:85089:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xcc1762b626f8a601 00010000:00080000:1.0:1784189005.012583:0:85089:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9dc07b5d1800@lustre-OST0000-osc-MDT0000: add connection 192.168.203.112@tcp at head 00010000:00010000:1.0:1784189005.012816:0:85089:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-10 is initialized 00000040:01000000:1.0:1784189005.014724:0:85089:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1784189005.014761:0:85089:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:1.0:1784189005.015101:0:85089:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0x1:0x2:0x0] first idx 21, last_idx 22 00000100:00100000:2.0:1784189005.015529:0:26492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf44bc1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3639:x1870854458023680:12345-0@lo:38:llog_process_th.0 Request processed in 3336us (3464us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189005.015546:0:26492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3695 00000040:00080000:2.0:1784189005.016994:0:85089:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1784189005.017037:0:3639:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 2 00000040:00080000:2.0:1784189005.017040:0:85089:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].23, 64 off9664 00000100:00080000:3.0:1784189005.017063:0:3639:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-osp-MDT0000: connect to target with instance 19 00000100:00080000:3.0:1784189005.017076:0:3639:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-osp-MDT0000: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:3.0:1784189005.017085:0:3639:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:3.0:1784189005.017099:0:3639:0:(import.c:65:import_set_state_nolock()) ffff9dc06b8e5000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1784189005.017122:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf48599f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3639:1870854458023680:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1784189005.017691:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1784189005.017713:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf48598380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1870854458023808:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1784189005.018050:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000040:00080000:2.0:1784189005.018280:0:85089:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5c:0x0].1, 64 off8256 00000100:00100000:0.0:1784189005.018424:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458023808 00000100:00100000:0.0:1784189005.018433:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458023808 00000100:00100000:0.0:1784189005.018600:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3696 00000100:00100000:0.0:1784189005.018621:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf44bc2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3641:x1870854458023808:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1784189005.018665:0:8438:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445576704 avail 1299337216 00000100:00100000:0.0:1784189005.018733:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf44bc2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3641:x1870854458023808:12345-0@lo:41:osp-pre-1-0.0 Request processed in 114us (683us total) trans 0 rc 0/0 00000100:00100000:0.0:1784189005.018741:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3696 00000100:00100000:3.0:1784189005.018818:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf48598380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1870854458023808:0@lo:41:osp-pre-1-0.0 00000040:00080000:2.0:1784189005.019944:0:85095:0:(llog.c:805:llog_process_thread()) index: 22, lh_last_idx: 23 synced_idx: 0 lgh_last_idx: 23 00000040:00080000:2.0:1784189005.019952:0:85095:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x58:0x0] at index 22 of catalog [0x1:0x2:0x0] 00000040:00080000:2.0:1784189005.020307:0:85095:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0x1:0x2:0x0] first idx 22, last_idx 23 00000040:00080000:2.0:1784189005.020970:0:85095:0:(llog_cat_server.c:902:llog_cat_cleanup()) cancel plain log [0x1:0x58:0x0] at index 22 of catalog [0x1:0x2:0x0] 00000040:00080000:2.0:1784189005.021444:0:85095:0:(llog.c:805:llog_process_thread()) index: 23, lh_last_idx: 23 synced_idx: 23 lgh_last_idx: 23 00000040:00080000:2.0:1784189005.021449:0:85095:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x5c:0x0] at index 23 of catalog [0x1:0x2:0x0] 00000020:00000080:1.0:1784189005.022156:0:85089:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1784189005.022172:0:85089:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1784189005.022623:0:85089:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:1.0:1784189005.022658:0:85089:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xcc1762b626f8a608 00000100:00080000:1.0:1784189005.022672:0:85089:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1784189005.022680:0:85089:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9dc07b5d1800 using connection 192.168.203.112@tcp/0@lo 00000100:00100000:1.0:1784189005.022728:0:85089:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9dbf4859b480 x1870854458023936/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1784189005.022792:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf4859b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3639:1870854458023936:0@lo:8:llog_process_th.0 00000100:00100000:3.0:1784189005.022906:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784189005.023019:0:26223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458023936 00000100:00100000:0.0:1784189005.023028:0:26223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458023936 00000100:00100000:0.0:1784189005.023075:0:26223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4918 00000100:00100000:0.0:1784189005.023084:0:26223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf44bc3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:0+-99:3639:x1870854458023936:12345-0@lo:8:llog_process_th.0 00010000:00080000:0.0:1784189005.023115:0:26223:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 3247 last 0 00000020:00000080:0.0:1784189005.023175:0:26223:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xcc1762b626f8a60f 00002000:00100000:0.0:1784189005.023200:0:26223:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff9dc07118f000 ocd_connect_flags: 0xa044401443000026 ocd_version: 21136a2 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:0.0:1784189005.023205:0:26223:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:0.0:1784189005.023208:0:26223:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00000100:00080000:1.0:1784189005.023275:0:85089:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00002000:00080000:0.0:1784189005.023314:0:26223:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1784189005.023377:0:26223:0:(import.c:65:import_set_state_nolock()) ffff9dc071188800 : changing import state from RECOVER to FULL 00000020:01000000:1.0:1784189005.023503:0:85089:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1784189005.023513:0:85089:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784189005.023515:0:85089:0:(obd_config.c:1561:class_process_config()) marker 22 (0x2) lustre-OST0000 add osc 00000020:01000000:1.0:1784189005.023518:0:85089:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1784189005.023521:0:85089:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #26 00000020:01000000:1.0:1784189005.023522:0:85089:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1784189005.023539:0:85089:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1784189005.023541:0:85089:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1784189005.023544:0:85089:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784189005.023545:0:85089:0:(obd_config.c:1561:class_process_config()) marker 26 (0x6) lustre sys.timeout 00000020:01000000:1.0:1784189005.023548:0:85089:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1784189005.023553:0:85089:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:1.0:1784189005.023556:0:85089:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784189005.023558:0:85089:0:(obd_config.c:1561:class_process_config()) marker 30 (0x1) lustre-OST0001 add osc 00000020:00000080:1.0:1784189005.023561:0:85089:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1784189005.023565:0:85089:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.203.112@tcp to nid 0x20000c0a8cb70 (192.168.203.112@tcp) 00000020:01000000:1.0:1784189005.023602:0:85089:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:1.0:1784189005.023605:0:85089:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1784189005.023621:0:85089:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff9dbf449f4d40) 00000020:00000080:1.0:1784189005.023643:0:85089:0:(obd_config.c:720:class_attach_name()) OBD: dev 27 attached type osp with refcount 2 00000020:00000080:1.0:1784189005.023648:0:85089:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1784189005.023722:0:85089:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:1.0:1784189005.023727:0:85089:0:(osd_handler.c:8929:osd_obd_connect()) connect #7 00000020:00000080:1.0:1784189005.023731:0:85089:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xcc1762b626f8a61d 00010000:00080000:1.0:1784189005.023757:0:85089:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9dc045ad7000@lustre-OST0001-osc-MDT0000: add connection 192.168.203.112@tcp at head 00000100:00100000:0.0:1784189005.023815:0:26223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf44bc3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0000-mdtlov_UUID+6:3639:x1870854458023936:12345-0@lo:8:llog_process_th.0 Request processed in 726us (904us total) trans 0 rc 0/0 00000100:00100000:0.0:1784189005.023826:0:26223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4918 00010000:00010000:1.0:1784189005.023930:0:85089:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-11 is initialized 00000100:00100000:3.0:1784189005.023963:0:3639:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1784189005.023976:0:3639:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 1 00000100:00080000:3.0:1784189005.023985:0:3639:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000040:01000000:1.0:1784189005.023985:0:85089:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00080000:3.0:1784189005.023996:0:3639:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:3.0:1784189005.024000:0:3639:0:(import.c:65:import_set_state_nolock()) ffff9dc07b5d1800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000040:01000000:1.0:1784189005.024003:0:85089:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000004:00080000:3.0:1784189005.024058:0:3639:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1784189005.024067:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf4859b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3639:1870854458023936:0@lo:8:llog_process_th.0 00000004:00080000:2.0:1784189005.024138:0:85095:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:2.0:1784189005.024228:0:85095:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 3247247908794ns, next at 0ns, rc = 0 00080000:00080000:2.0:1784189005.024235:0:85095:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0000: async commit OSD 00000040:00080000:1.0:1784189005.024942:0:85089:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0x1:0x5:0x0] first idx 21, last_idx 22 00000100:00100000:1.0:1784189005.025732:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc081f83100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1870854458024064:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1784189005.025946:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784189005.026051:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458024064 00000100:00100000:2.0:1784189005.026105:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458024064 00000100:00080000:0.0:1784189005.026270:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000040:00080000:0.0:1784189005.026544:0:85089:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1784189005.026584:0:85089:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].23, 64 off9664 00000040:00080000:0.0:1784189005.026777:0:85089:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5e:0x0].1, 64 off8256 00000100:00100000:2.0:1784189005.027001:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1838 00000100:00100000:2.0:1784189005.027015:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf4859b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3641:x1870854458024064:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1784189005.027060:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 214592 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1784189005.027962:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf4859b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3641:x1870854458024064:12345-0@lo:13:osp-pre-0-0.0 Request processed in 945us (2012us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189005.027974:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1838 00000040:00080000:0.0:1784189005.028819:0:85097:0:(llog.c:805:llog_process_thread()) index: 22, lh_last_idx: 23 synced_idx: 0 lgh_last_idx: 23 00000040:00080000:0.0:1784189005.028827:0:85097:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x5a:0x0] at index 22 of catalog [0x1:0x5:0x0] 00000100:00100000:2.0:1784189005.029078:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc081f83100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1870854458024064:0@lo:13:osp-pre-0-0.0 00000004:00080000:1.0:1784189005.030916:0:85078:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00000020:00000080:1.0:1784189005.031680:0:85089:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1784189005.031696:0:85089:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1784189005.031755:0:85089:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:1.0:1784189005.031788:0:85089:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xcc1762b626f8a624 00000100:00080000:1.0:1784189005.031802:0:85089:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1784189005.031825:0:85089:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9dc045ad7000 using connection 192.168.203.112@tcp/0@lo 00000100:00100000:1.0:1784189005.032112:0:85089:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9dbf48598380 x1870854458024192/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1784189005.032303:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf48598380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3639:1870854458024192:0@lo:8:llog_process_th.0 00000100:00100000:3.0:1784189005.032424:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1784189005.032507:0:85089:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:1.0:1784189005.032602:0:85089:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1784189005.032608:0:85089:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784189005.032611:0:85089:0:(obd_config.c:1561:class_process_config()) marker 30 (0x2) lustre-OST0001 add osc 00000020:01000000:1.0:1784189005.032614:0:85089:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1784189005.032618:0:85089:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784189005.032620:0:85089:0:(obd_config.c:1561:class_process_config()) marker 35 (0x1) lustre sys.timeout 00000020:00000080:1.0:1784189005.032622:0:85089:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1784189005.032624:0:85089:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1784189005.032627:0:85089:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1784189005.032629:0:85089:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784189005.032631:0:85089:0:(obd_config.c:1561:class_process_config()) marker 35 (0x2) lustre sys.timeout 00000020:01000000:1.0:1784189005.032633:0:85089:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1784189005.032636:0:85089:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784189005.032637:0:85089:0:(obd_config.c:1561:class_process_config()) marker 40 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1784189005.032640:0:85089:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:1.0:1784189005.032678:0:85089:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf48599f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bd553d0d-03e2-4233-b06b-b55bbfa2b954:85089:1870854458024320:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1784189005.032738:0:85089:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784189005.032779:0:85089:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dbf44c4fb40 going to sleep for 11 seconds 00000100:00100000:2.0:1784189005.033054:0:85084:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458024320 00000100:00100000:2.0:1784189005.033063:0:85084:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458024320 00000100:00100000:2.0:1784189005.033126:0:85084:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1784189005.033137:0:85084:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc0715aa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd553d0d-03e2-4233-b06b-b55bbfa2b954+8:85089:x1870854458024320:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1784189005.033341:0:85084:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc0715aa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd553d0d-03e2-4233-b06b-b55bbfa2b954+8:85089:x1870854458024320:12345-0@lo:502:llog_process_th.0 Request processed in 185us (582us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189005.033350:0:85084:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1784189005.033464:0:85089:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf48599f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bd553d0d-03e2-4233-b06b-b55bbfa2b954:85089:1870854458024320:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1784189005.033502:0:85089:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1784189005.033509:0:85089:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784189005.033511:0:85089:0:(obd_config.c:1561:class_process_config()) marker 40 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1784189005.033515:0:85089:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 46 count 46 00000020:01000000:2.0:1784189005.033868:0:85077:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-45 (rc=0) 10000000:01000000:2.0:1784189005.033897:0:85077:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1784189005.033922:0:85077:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff9dc042d66200/0xcc1762b626f8a575 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc1762b626f8a57c expref: -99 pid: 85077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189005.033935:0:85077:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: ffff9dc042d66200/0xcc1762b626f8a575 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc1762b626f8a57c expref: -99 pid: 85077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784189005.033944:0:85077:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff9dc047a82000 from 1 10000000:01000000:2.0:1784189005.033947:0:85077:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1784189005.033982:0:85077:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff9dc0755a4200/0xcc1762b626f8a62b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 85077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189005.033990:0:85077:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: ffff9dc0755a4200/0xcc1762b626f8a62b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 85077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189005.034001:0:85077:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: ffff9dc0755a4200/0xcc1762b626f8a62b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 85077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784189005.034027:0:85077:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc07016e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd553d0d-03e2-4233-b06b-b55bbfa2b954:85077:1870854458024448:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1784189005.034069:0:85077:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784189005.034097:0:85077:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dc081c5ce40 going to sleep for 11 seconds 00000100:00100000:2.0:1784189005.034118:0:85083:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458024448 00000100:00100000:2.0:1784189005.034123:0:85083:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458024448 00000100:00100000:2.0:1784189005.034152:0:85083:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1784189005.034160:0:85083:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc0715aa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd553d0d-03e2-4233-b06b-b55bbfa2b954+8:85077:x1870854458024448:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1784189005.034171:0:85083:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784189005.034187:0:85083:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dc0755a4800/0xcc1762b626f8a632 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xcc1762b626f8a62b expref: -99 pid: 85083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189005.034227:0:85083:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dc0755a4800/0xcc1762b626f8a632 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcc1762b626f8a62b expref: 9 pid: 85083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189005.034239:0:85083:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dc0755a4800/0xcc1762b626f8a632 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcc1762b626f8a62b expref: 9 pid: 85083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189005.034249:0:85083:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc0755a4800, rc 0) 00000100:00100000:2.0:1784189005.034288:0:85083:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc0715aa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd553d0d-03e2-4233-b06b-b55bbfa2b954+9:85077:x1870854458024448:12345-0@lo:101:mount.lustre.0 Request processed in 128us (219us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189005.034295:0:85083:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1784189005.034492:0:85077:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc07016e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd553d0d-03e2-4233-b06b-b55bbfa2b954:85077:1870854458024448:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1784189005.034508:0:85077:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: ffff9dc0755a4200/0xcc1762b626f8a62b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc1762b626f8a632 expref: -99 pid: 85077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189005.034518:0:85077:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: ffff9dc0755a4200/0xcc1762b626f8a62b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcc1762b626f8a632 expref: -99 pid: 85077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784189005.035086:0:85077:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf48599880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd553d0d-03e2-4233-b06b-b55bbfa2b954:85077:1870854458024576:0@lo:256:mount.lustre.0 00000100:00100000:1.0:1784189005.035147:0:85077:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784189005.035185:0:85077:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dbf44c4fa80 going to sleep for 11 seconds 00000100:00100000:2.0:1784189005.035566:0:85085:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458024576 00000100:00100000:2.0:1784189005.035574:0:85085:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458024576 00000100:00100000:2.0:1784189005.035703:0:85085:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1784189005.035714:0:85085:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc0715ab850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd553d0d-03e2-4233-b06b-b55bbfa2b954+9:85077:x1870854458024576:12345-0@lo:256:mount.lustre.0 20000000:01000000:2.0:1784189005.035737:0:85085:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:2.0:1784189005.035762:0:85085:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1784189005.035770:0:85085:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:2.0:1784189005.035774:0:85085:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:2.0:1784189005.035776:0:85085:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 103 00000100:00100000:2.0:1784189005.035897:0:85085:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc0715ab850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd553d0d-03e2-4233-b06b-b55bbfa2b954+9:85077:x1870854458024576:12345-0@lo:256:mount.lustre.0 Request processed in 185us (749us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189005.035906:0:85085:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1784189005.035980:0:85077:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf48599880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd553d0d-03e2-4233-b06b-b55bbfa2b954:85077:1870854458024576:0@lo:256:mount.lustre.0 10000000:01000000:1.0:1784189005.036803:0:85077:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1784189005.036830:0:85077:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff9dc0755a4200/0xcc1762b626f8a62b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc1762b626f8a632 expref: -99 pid: 85077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189005.036843:0:85077:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: ffff9dc0755a4200/0xcc1762b626f8a62b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc1762b626f8a632 expref: -99 pid: 85077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784189005.036852:0:85077:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9dc047a82000 from 1 10000000:01000000:1.0:1784189005.036856:0:85077:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1784189005.036897:0:85077:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff9dc042d66600/0xcc1762b626f8a639 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 85077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189005.036905:0:85077:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: ffff9dc042d66600/0xcc1762b626f8a639 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 85077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189005.036914:0:85077:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: ffff9dc042d66600/0xcc1762b626f8a639 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 85077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784189005.036936:0:85077:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf48599880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd553d0d-03e2-4233-b06b-b55bbfa2b954:85077:1870854458024704:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1784189005.036990:0:85077:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784189005.037161:0:26170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458024192 00000100:00100000:0.0:1784189005.037170:0:26170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458024192 00000100:00100000:0.0:1784189005.037212:0:26170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4919 00000100:00100000:0.0:1784189005.037219:0:26170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf44bc2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:0+-99:3639:x1870854458024192:12345-0@lo:8:llog_process_th.0 00010000:00080000:0.0:1784189005.037263:0:26170:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 3247 last 0 00000020:00000080:0.0:1784189005.037298:0:26170:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xcc1762b626f8a640 00002000:00100000:0.0:1784189005.037315:0:26170:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff9dc07118f800 ocd_connect_flags: 0xa044401443000026 ocd_version: 21136a2 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:0.0:1784189005.037335:0:26170:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:0.0:1784189005.037338:0:26170:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1784189005.037457:0:26170:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1784189005.037487:0:26170:0:(import.c:65:import_set_state_nolock()) ffff9dc07118e000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1784189005.037566:0:85077:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dbf44c4fa80 going to sleep for 11 seconds 00000100:00100000:3.0:1784189005.037660:0:85083:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458024704 00000100:00100000:3.0:1784189005.037665:0:85083:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458024704 00000100:00100000:3.0:1784189005.037697:0:85083:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1784189005.037704:0:85083:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc0715ab050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd553d0d-03e2-4233-b06b-b55bbfa2b954+9:85077:x1870854458024704:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1784189005.037715:0:85083:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784189005.037734:0:85083:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dc05ec0c400/0xcc1762b626f8a647 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xcc1762b626f8a639 expref: -99 pid: 85083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189005.037763:0:85083:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dc05ec0c400/0xcc1762b626f8a647 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcc1762b626f8a639 expref: 10 pid: 85083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784189005.037771:0:26170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf44bc2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+6:3639:x1870854458024192:12345-0@lo:8:llog_process_th.0 Request processed in 548us (5344us total) trans 0 rc 0/0 00010000:00010000:3.0:1784189005.037781:0:85083:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dc05ec0c400/0xcc1762b626f8a647 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcc1762b626f8a639 expref: 10 pid: 85083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189005.037791:0:85083:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc05ec0c400, rc 0) 00000100:00100000:3.0:1784189005.037899:0:85083:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc0715ab050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd553d0d-03e2-4233-b06b-b55bbfa2b954+10:85077:x1870854458024704:12345-0@lo:101:mount.lustre.0 Request processed in 127us (841us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189005.037908:0:85083:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1784189005.038070:0:3639:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1784189005.038081:0:3639:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 1 00000100:00080000:3.0:1784189005.038090:0:3639:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1784189005.038097:0:3639:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:3.0:1784189005.038100:0:3639:0:(import.c:65:import_set_state_nolock()) ffff9dc045ad7000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1784189005.038116:0:3639:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1784189005.038123:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf48598380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3639:1870854458024192:0@lo:8:llog_process_th.0 00000100:00100000:2.0:1784189005.038474:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc07016f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1870854458024832:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1784189005.038592:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000040:00080000:2.0:1784189005.038634:0:85097:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x5a:0x0] index 3 count 2 00000100:00100000:0.0:1784189005.038657:0:26170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4919 00000040:00080000:2.0:1784189005.038678:0:85097:0:(llog.c:805:llog_process_thread()) index: 23, lh_last_idx: 23 synced_idx: 23 lgh_last_idx: 23 00000100:00100000:0.0:1784189005.038679:0:26170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458024832 00000100:00100000:0.0:1784189005.038684:0:26170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458024832 00000040:00080000:2.0:1784189005.038686:0:85097:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x5e:0x0] at index 23 of catalog [0x1:0x5:0x0] 00000004:00080000:2.0:1784189005.038717:0:85097:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000100:00100000:0.0:1784189005.038733:0:26170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4920 00000100:00100000:0.0:1784189005.038743:0:26170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc07016d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+6:3642:x1870854458024832:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1784189005.038769:0:26170:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:1666 count 1 00000004:00080000:2.0:1784189005.038812:0:85097:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 3247262491763ns, next at 0ns, rc = 0 00080000:00080000:2.0:1784189005.038820:0:85097:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00100000:3.0:1784189005.038960:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1784189005.038969:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf44bc0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1870854458024960:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1784189005.039002:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784189005.039049:0:9466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458024960 00000100:00100000:3.0:1784189005.039054:0:9466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458024960 00000100:00100000:3.0:1784189005.039083:0:9466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1839 00000100:00100000:3.0:1784189005.039090:0:9466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf44bc1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3642:x1870854458024960:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1784189005.039110:0:9466:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 214592 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1784189005.039625:0:9466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf44bc1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3642:x1870854458024960:12345-0@lo:13:osp-pre-1-0.0 Request processed in 533us (620us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189005.039634:0:9466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1839 00000100:00100000:3.0:1784189005.039886:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf44bc0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1870854458024960:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1784189005.040371:0:26170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc07016d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+6:3642:x1870854458024832:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1629us (1777us total) trans 0 rc -2/-2 00000100:00100000:0.0:1784189005.040382:0:26170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4920 00000100:00080000:0.0:1784189005.040419:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:3.0:1784189005.040568:0:3642:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9dc07016f800, transno 0 00000004:00080000:3.0:1784189005.040574:0:3642:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9dc07016f800/1, rc -2, transno 0 00000100:00100000:3.0:1784189005.040586:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc07016f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1870854458024832:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1784189005.040681:0:85077:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf48599880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd553d0d-03e2-4233-b06b-b55bbfa2b954:85077:1870854458024704:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1784189005.040713:0:85077:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: ffff9dc042d66600/0xcc1762b626f8a639 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc1762b626f8a647 expref: -99 pid: 85077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189005.040729:0:85077:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: ffff9dc042d66600/0xcc1762b626f8a639 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcc1762b626f8a647 expref: -99 pid: 85077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1784189005.041060:0:85097:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0x1:0x5:0x0] first idx 22, last_idx 23 00000040:00080000:2.0:1784189005.041086:0:85097:0:(llog_cat_server.c:902:llog_cat_cleanup()) cancel plain log [0x1:0x5a:0x0] at index 22 of catalog [0x1:0x5:0x0] 00000100:00100000:0.0:1784189005.041221:0:85077:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc081f82680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd553d0d-03e2-4233-b06b-b55bbfa2b954:85077:1870854458025088:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1784189005.041355:0:85077:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784189005.041406:0:85077:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dc07545b0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1784189005.041412:0:85083:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458025088 00000100:00100000:3.0:1784189005.041420:0:85083:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458025088 00000100:00100000:3.0:1784189005.041470:0:85083:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1784189005.041537:0:85083:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc0715aa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd553d0d-03e2-4233-b06b-b55bbfa2b954+10:85077:x1870854458025088:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1784189005.041676:0:85083:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc0715aa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd553d0d-03e2-4233-b06b-b55bbfa2b954+10:85077:x1870854458025088:12345-0@lo:501:mount.lustre.0 Request processed in 194us (318us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189005.041686:0:85083:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1784189005.041698:0:85077:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc081f82680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd553d0d-03e2-4233-b06b-b55bbfa2b954:85077:1870854458025088:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1784189005.041736:0:85077:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc081f82680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd553d0d-03e2-4233-b06b-b55bbfa2b954:85077:1870854458025216:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1784189005.042130:0:85077:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784189005.042159:0:85077:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dc07545b0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1784189005.042706:0:85084:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458025216 00000100:00100000:2.0:1784189005.042715:0:85084:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458025216 00000004:00080000:1.0:1784189005.042723:0:85078:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000100:00100000:2.0:1784189005.042765:0:85084:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1784189005.042775:0:85084:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc0715ab450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd553d0d-03e2-4233-b06b-b55bbfa2b954+10:85077:x1870854458025216:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1784189005.042932:0:85084:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc0715ab450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd553d0d-03e2-4233-b06b-b55bbfa2b954+10:85077:x1870854458025216:12345-0@lo:503:mount.lustre.0 Request processed in 158us (1134us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189005.042940:0:85084:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1784189005.043542:0:85077:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc081f82680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd553d0d-03e2-4233-b06b-b55bbfa2b954:85077:1870854458025216:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1784189005.044072:0:85099:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf44bc0e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bd553d0d-03e2-4233-b06b-b55bbfa2b954:85099:1870854458025344:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1784189005.044143:0:85099:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784189005.044186:0:85099:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dc080ea9480 going to sleep for 11 seconds 00000100:00100000:0.0:1784189005.044418:0:85083:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458025344 00000100:00100000:0.0:1784189005.044434:0:85083:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458025344 00000100:00100000:0.0:1784189005.044475:0:85083:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1784189005.044491:0:85083:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc080f00850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd553d0d-03e2-4233-b06b-b55bbfa2b954+10:85099:x1870854458025344:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1784189005.045082:0:85083:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc080f00850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd553d0d-03e2-4233-b06b-b55bbfa2b954+10:85099:x1870854458025344:12345-0@lo:502:llog_process_th.0 Request processed in 597us (937us total) trans 0 rc 0/0 00000100:00100000:0.0:1784189005.045092:0:85083:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1784189005.045414:0:85099:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf44bc0e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bd553d0d-03e2-4233-b06b-b55bbfa2b954:85099:1870854458025344:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1784189005.045455:0:85099:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1784189005.045469:0:85099:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784189005.045471:0:85099:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1784189005.045488:0:85099:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9dc047a82000 00000020:00000080:3.0:1784189005.045490:0:85099:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1784189005.045500:0:85099:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1784189005.045502:0:85099:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784189005.045503:0:85099:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:3.0:1784189005.045506:0:85099:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1784189005.045508:0:85099:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784189005.045510:0:85099:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1784189005.045513:0:85099:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9dc047a82000 00000020:00000080:3.0:1784189005.045514:0:85099:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1784189005.045619:0:85099:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf44bc0e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bd553d0d-03e2-4233-b06b-b55bbfa2b954:85099:1870854458025472:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1784189005.045675:0:85099:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784189005.045715:0:85099:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dc080ea9480 going to sleep for 11 seconds 00000100:00100000:2.0:1784189005.045922:0:85085:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458025472 00000100:00100000:2.0:1784189005.045930:0:85085:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458025472 00000100:00100000:2.0:1784189005.045981:0:85085:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1784189005.045991:0:85085:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc080f01050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd553d0d-03e2-4233-b06b-b55bbfa2b954+10:85099:x1870854458025472:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1784189005.046964:0:85085:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc080f01050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd553d0d-03e2-4233-b06b-b55bbfa2b954+10:85099:x1870854458025472:12345-0@lo:502:llog_process_th.0 Request processed in 971us (1285us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189005.046975:0:85099:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf44bc0e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bd553d0d-03e2-4233-b06b-b55bbfa2b954:85099:1870854458025472:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1784189005.046985:0:85085:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000020:01000000:3.0:1784189005.047014:0:85099:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1784189005.047022:0:85099:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784189005.047025:0:85099:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:3.0:1784189005.047029:0:85099:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:0.0:1784189005.047282:0:85077:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-6 (rc=0) 10000000:01000000:0.0:1784189005.047334:0:85077:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1784189005.047358:0:85077:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff9dc042d66600/0xcc1762b626f8a639 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc1762b626f8a647 expref: -99 pid: 85077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189005.047372:0:85077:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: ffff9dc042d66600/0xcc1762b626f8a639 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc1762b626f8a647 expref: -99 pid: 85077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784189005.047453:0:85077:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1784189005.047457:0:85077:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9dc047a82000 10000000:01000000:0.0:1784189005.047461:0:85077:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9dc047a82000 10000000:01000000:0.0:1784189005.047466:0:85077:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1784189005.047472:0:85077:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9dc047a82000 from 1 10000000:01000000:0.0:1784189005.047476:0:85077:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1784189005.047515:0:85077:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff9dc070146a00/0xcc1762b626f8a64e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 85077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189005.047525:0:85077:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: ffff9dc070146a00/0xcc1762b626f8a64e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 85077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189005.047536:0:85077:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: ffff9dc070146a00/0xcc1762b626f8a64e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 85077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784189005.047565:0:85077:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc081f80a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd553d0d-03e2-4233-b06b-b55bbfa2b954:85077:1870854458025600:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1784189005.047622:0:85077:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784189005.047668:0:85084:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458025600 00000100:00100000:2.0:1784189005.047675:0:85084:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458025600 00000100:00100000:2.0:1784189005.047720:0:85084:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1784189005.047730:0:85084:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc080f00050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd553d0d-03e2-4233-b06b-b55bbfa2b954+10:85077:x1870854458025600:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1784189005.047743:0:85084:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784189005.047759:0:85084:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dc0755a4a00/0xcc1762b626f8a655 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xcc1762b626f8a64e expref: -99 pid: 85084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189005.047788:0:85084:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dc0755a4a00/0xcc1762b626f8a655 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcc1762b626f8a64e expref: 11 pid: 85084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189005.047801:0:85084:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dc0755a4a00/0xcc1762b626f8a655 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcc1762b626f8a64e expref: 11 pid: 85084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784189005.047810:0:85077:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dbf46a206c0 going to sleep for 11 seconds 00010000:00010000:2.0:1784189005.047811:0:85084:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc0755a4a00, rc 0) 00000100:00100000:2.0:1784189005.048024:0:85084:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc080f00050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd553d0d-03e2-4233-b06b-b55bbfa2b954+11:85077:x1870854458025600:12345-0@lo:101:mount.lustre.0 Request processed in 295us (401us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189005.048031:0:85084:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1784189005.048138:0:85077:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc081f80a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd553d0d-03e2-4233-b06b-b55bbfa2b954:85077:1870854458025600:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1784189005.048156:0:85077:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: ffff9dc070146a00/0xcc1762b626f8a64e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc1762b626f8a655 expref: -99 pid: 85077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189005.048167:0:85077:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: ffff9dc070146a00/0xcc1762b626f8a64e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xcc1762b626f8a655 expref: -99 pid: 85077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784189005.048428:0:85077:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc081f80a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd553d0d-03e2-4233-b06b-b55bbfa2b954:85077:1870854458025728:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1784189005.048465:0:85077:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784189005.048486:0:85077:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dbf46a206c0 going to sleep for 11 seconds 00000100:00100000:3.0:1784189005.048683:0:85083:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458025728 00000100:00100000:3.0:1784189005.048688:0:85083:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458025728 00000100:00100000:3.0:1784189005.048725:0:85083:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1784189005.048735:0:85083:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc080f03c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd553d0d-03e2-4233-b06b-b55bbfa2b954+11:85077:x1870854458025728:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1784189005.049099:0:85083:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc080f03c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd553d0d-03e2-4233-b06b-b55bbfa2b954+11:85077:x1870854458025728:12345-0@lo:501:mount.lustre.0 Request processed in 365us (632us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189005.049108:0:85083:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1784189005.049174:0:85077:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc081f80a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd553d0d-03e2-4233-b06b-b55bbfa2b954:85077:1870854458025728:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1784189005.049219:0:85077:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf44bc0e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd553d0d-03e2-4233-b06b-b55bbfa2b954:85077:1870854458025856:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1784189005.049270:0:85077:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784189005.049315:0:85077:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dc080ea99c0 going to sleep for 11 seconds 00000100:00100000:0.0:1784189005.049380:0:85084:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458025856 00000100:00100000:0.0:1784189005.049386:0:85084:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458025856 00000100:00100000:0.0:1784189005.049434:0:85084:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1784189005.049442:0:85084:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc080f01c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd553d0d-03e2-4233-b06b-b55bbfa2b954+11:85077:x1870854458025856:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1784189005.049551:0:85084:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc080f01c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd553d0d-03e2-4233-b06b-b55bbfa2b954+11:85077:x1870854458025856:12345-0@lo:503:mount.lustre.0 Request processed in 109us (280us total) trans 0 rc 0/0 00000100:00100000:0.0:1784189005.049558:0:85084:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1784189005.050376:0:85077:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf44bc0e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd553d0d-03e2-4233-b06b-b55bbfa2b954:85077:1870854458025856:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1784189005.052615:0:85101:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc081f82d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bd553d0d-03e2-4233-b06b-b55bbfa2b954:85101:1870854458025984:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1784189005.052723:0:85101:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784189005.052779:0:85101:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dbf46a20840 going to sleep for 11 seconds 00000100:00100000:3.0:1784189005.053058:0:85085:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458025984 00000100:00100000:3.0:1784189005.053067:0:85085:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458025984 00000100:00100000:3.0:1784189005.053133:0:85085:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1784189005.053155:0:85085:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc080f00450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd553d0d-03e2-4233-b06b-b55bbfa2b954+11:85101:x1870854458025984:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1784189005.053341:0:85085:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc080f00450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd553d0d-03e2-4233-b06b-b55bbfa2b954+11:85101:x1870854458025984:12345-0@lo:502:llog_process_th.0 Request processed in 175us (594us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189005.053350:0:85085:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1784189005.053431:0:85101:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc081f82d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bd553d0d-03e2-4233-b06b-b55bbfa2b954:85101:1870854458025984:0@lo:502:llog_process_th.0 00000020:01000004:3.0:1784189005.053527:0:85101:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:3.0:1784189005.053548:0:85101:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff9dc06bb33380) 00000020:00000080:3.0:1784189005.055207:0:85101:0:(obd_config.c:720:class_attach_name()) OBD: dev 28 attached type lwp with refcount 2 00000020:01000004:3.0:1784189005.055837:0:85101:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9dc047a82000 from lustre-MDT0000, refs=4 00000020:01000004:3.0:1784189005.055843:0:85101:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9dc047a82000 from lustre-MDT0000, refs=4 00000020:01000004:3.0:1784189005.055847:0:85101:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9dc047a82000 4 00010000:00080000:3.0:1784189005.055895:0:85101:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9dbf46b0c000@lustre-MDT0000-lwp-MDT0000: add connection 192.168.203.112@tcp at head 00010000:00010000:3.0:1784189005.062783:0:85101:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-12 is initialized 00000020:00000080:3.0:1784189005.063132:0:85101:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:3.0:1784189005.063966:0:85101:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1784189005.063990:0:85101:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0xcc1762b626f8a663 00000100:00080000:3.0:1784189005.064002:0:85101:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1784189005.064010:0:85101:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff9dbf46b0c000 using connection 192.168.203.112@tcp/0@lo 00000100:00100000:3.0:1784189005.064059:0:85101:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9dbf44bc0e00 x1870854458026112/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1784189005.064098:0:85101:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1784189005.064446:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf44bc0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3639:1870854458026112:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1784189005.064542:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784189005.064721:0:68287:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458026112 00000100:00100000:2.0:1784189005.064731:0:68287:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458026112 00000100:00100000:2.0:1784189005.064785:0:68287:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1056 00000100:00100000:2.0:1784189005.064796:0:68287:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc081f83b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3639:x1870854458026112:12345-0@lo:38:llog_process_th.0 00000100:00100000:0.0:1784189005.064887:0:85101:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc081f81f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bd553d0d-03e2-4233-b06b-b55bbfa2b954:85101:1870854458026240:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1784189005.065122:0:68287:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc081f83b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3639:x1870854458026112:12345-0@lo:38:llog_process_th.0 Request processed in 323us (576us total) trans 0 rc -11/-11 00000100:00100000:0.0:1784189005.065122:0:85101:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784189005.065135:0:68287:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1056 00000100:00100000:0.0:1784189005.065429:0:85101:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dbf46a20540 going to sleep for 11 seconds 00000100:00100000:3.0:1784189005.065504:0:85083:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458026240 00000100:00100000:3.0:1784189005.065517:0:85083:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458026240 00000100:00100000:3.0:1784189005.065558:0:85083:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1784189005.065565:0:85083:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf4507d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd553d0d-03e2-4233-b06b-b55bbfa2b954+11:85101:x1870854458026240:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1784189005.065708:0:85083:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf4507d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd553d0d-03e2-4233-b06b-b55bbfa2b954+11:85101:x1870854458026240:12345-0@lo:502:llog_process_th.0 Request processed in 143us (589us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189005.065717:0:85083:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1784189005.065789:0:3639:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1784189005.065799:0:3639:0:(import.c:65:import_set_state_nolock()) ffff9dbf46b0c000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1784189005.065803:0:3639:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:3.0:1784189005.065807:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf44bc0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3639:1870854458026112:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1784189005.065854:0:85101:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc081f81f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bd553d0d-03e2-4233-b06b-b55bbfa2b954:85101:1870854458026240:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1784189005.065901:0:85101:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf44bc0e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bd553d0d-03e2-4233-b06b-b55bbfa2b954:85101:1870854458026368:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1784189005.066042:0:85101:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784189005.066069:0:85101:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dc080ea9f00 going to sleep for 11 seconds 00000100:00100000:1.0:1784189005.066108:0:85084:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458026368 00000100:00100000:1.0:1784189005.066114:0:85084:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458026368 00000100:00100000:1.0:1784189005.066161:0:85084:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1784189005.066170:0:85084:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf4507e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd553d0d-03e2-4233-b06b-b55bbfa2b954+11:85101:x1870854458026368:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1784189005.066265:0:85084:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf4507e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd553d0d-03e2-4233-b06b-b55bbfa2b954+11:85101:x1870854458026368:12345-0@lo:502:llog_process_th.0 Request processed in 96us (223us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189005.066274:0:85084:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1784189005.066296:0:85101:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf44bc0e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bd553d0d-03e2-4233-b06b-b55bbfa2b954:85101:1870854458026368:0@lo:502:llog_process_th.0 00000040:00080000:0.0:1784189005.066506:0:85101:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:3.0:1784189005.066770:0:85077:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:3.0:1784189005.066796:0:85077:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1784189005.066920:0:85077:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff9dc070146a00/0xcc1762b626f8a64e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc1762b626f8a655 expref: -99 pid: 85077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189005.066940:0:85077:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: ffff9dc070146a00/0xcc1762b626f8a64e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc1762b626f8a655 expref: -99 pid: 85077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1784189005.067002:0:85077:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1784189005.067005:0:85077:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1784189005.067007:0:85077:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1784189005.067009:0:85077:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1784189005.067017:0:85077:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1784189005.067019:0:85077:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1784189005.067028:0:85077:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1784189005.067029:0:85077:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1784189005.067032:0:85077:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1784189005.067033:0:85077:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1784189005.067038:0:85077:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:3.0:1784189005.067040:0:85077:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1784189005.067042:0:85077:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1784189005.067042:0:85077:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1784189005.067043:0:85077:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1784189005.067044:0:85077:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1784189005.067045:0:85077:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1784189005.067046:0:85077:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1784189005.067047:0:85077:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1784189005.067048:0:85077:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1784189005.067049:0:85077:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1784189005.067075:0:85077:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:3.0:1784189005.067092:0:85077:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf44bc2a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd553d0d-03e2-4233-b06b-b55bbfa2b954:85077:1870854458026496:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1784189005.067163:0:85077:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784189005.067209:0:85077:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dc080ea9000 going to sleep for 11 seconds 00000100:00100000:3.0:1784189005.067232:0:85085:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458026496 00000100:00100000:3.0:1784189005.067237:0:85085:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458026496 00000100:00100000:3.0:1784189005.067423:0:85085:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1784189005.067431:0:85085:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf4507fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd553d0d-03e2-4233-b06b-b55bbfa2b954+11:85077:x1870854458026496:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1784189005.067465:0:85085:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:3.0:1784189005.067485:0:85085:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1784189005.072554:0:85085:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1784189005.072582:0:85085:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:2.0:1784189005.072677:0:85086:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1784189005.072684:0:85086:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1784189005.072725:0:85086:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9dc0755a5400/0xcc1762b626f8a66a lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 85086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189005.072749:0:85086:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9dc0755a4800/0xcc1762b626f8a632 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcc1762b626f8a62b expref: 11 pid: 85083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189005.072758:0:85086:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9dc0755a5400/0xcc1762b626f8a66a lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 85086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189005.072813:0:85086:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9dc0755a4800/0xcc1762b626f8a632 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcc1762b626f8a62b expref: 11 pid: 85083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189005.072899:0:85086:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9dc0755a4800/0xcc1762b626f8a632 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcc1762b626f8a62b expref: 11 pid: 85083 timeout: 3347 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784189005.072921:0:85086:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc07016f800 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:85086:1870854458026624:0@lo:104: 00000100:00100000:2.0:1784189005.073020:0:85086:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784189005.073136:0:85086:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dc05a698840 going to sleep for 11 seconds 00000100:00100000:2.0:1784189005.073170:0:6497:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1784189005.073194:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458026624 00000100:00100000:2.0:1784189005.073203:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458026624 00000100:00100000:2.0:1784189005.073263:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 307 00000100:00100000:2.0:1784189005.073273:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc07617dc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:bd553d0d-03e2-4233-b06b-b55bbfa2b954+3:85086:x1870854458026624:12345-0@lo:104: 00010000:00010000:2.0:1784189005.073288:0:6497:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.112@tcp lock: ffff9dc0755a4200/0xcc1762b626f8a62b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xcc1762b626f8a632 expref: -99 pid: 85077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189005.073377:0:6497:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1784189005.073384:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc07617dc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:bd553d0d-03e2-4233-b06b-b55bbfa2b954+3:85086:x1870854458026624:12345-0@lo:104: Request processed in 113us (365us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189005.073392:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 307 00000100:00100000:2.0:1784189005.073506:0:85086:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc07016f800 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:85086:1870854458026624:0@lo:104: 00010000:00010000:2.0:1784189005.073529:0:85086:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9dc0755a5400/0xcc1762b626f8a66a lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 85086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189005.073948:0:6502:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784189005.073959:0:6502:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.112@tcp lock: ffff9dc0755a4200/0xcc1762b626f8a62b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xcc1762b626f8a632 expref: -99 pid: 85077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189005.073971:0:6502:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc0755a4200 already unused, calling callback (ffffffffc114ac20) 10000000:00010000:1.0:1784189005.073976:0:6502:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.112@tcp lock: ffff9dc0755a4200/0xcc1762b626f8a62b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xcc1762b626f8a632 expref: -99 pid: 85077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189005.073986:0:6502:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.112@tcp lock: ffff9dc0755a4200/0xcc1762b626f8a62b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xcc1762b626f8a632 expref: -99 pid: 85077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1784189005.073994:0:6502:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.112@tcp lock: ffff9dc0755a4200/0xcc1762b626f8a62b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xcc1762b626f8a632 expref: -99 pid: 85077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784189005.074001:0:6502:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1784189005.074644:0:6502:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.112@tcp lock: ffff9dc0755a4200/0xcc1762b626f8a62b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcc1762b626f8a632 expref: -99 pid: 85077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189005.074655:0:6502:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1784189005.074687:0:85085:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf4507fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd553d0d-03e2-4233-b06b-b55bbfa2b954+11:85077:x1870854458026496:12345-0@lo:253:mount.lustre.0 Request processed in 7251us (7519us total) trans 0 rc 0/0 00010000:00010000:1.0:1784189005.074688:0:6502:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.112@tcp lock: ffff9dc0755a4200/0xcc1762b626f8a62b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcc1762b626f8a632 expref: -99 pid: 85077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189005.074704:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.112@tcp lock: ffff9dc0755a4200/0xcc1762b626f8a62b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcc1762b626f8a632 expref: -99 pid: 85077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784189005.074709:0:85085:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00010000:00010000:1.0:1784189005.074753:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784189005.074756:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784189005.074758:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784189005.074775:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf4859b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bd553d0d-03e2-4233-b06b-b55bbfa2b954:3640:1870854458026752:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1784189005.074815:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784189005.074867:0:85077:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf44bc2a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd553d0d-03e2-4233-b06b-b55bbfa2b954:85077:1870854458026496:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1784189005.074881:0:85077:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:0.0:1784189005.074885:0:85077:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1784189005.074888:0:85077:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1784189005.074889:0:85077:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1784189005.074891:0:85077:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1784189005.074892:0:85077:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1784189005.074894:0:85077:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1784189005.074895:0:85077:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1784189005.074897:0:85077:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1784189005.074900:0:85077:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1784189005.074901:0:85077:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1784189005.074922:0:85077:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:2.0:1784189005.074928:0:25703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458026752 00000100:00100000:2.0:1784189005.074937:0:25703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458026752 00010000:00010000:2.0:1784189005.074968:0:25703:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9dc0755a4800/0xcc1762b626f8a632 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcc1762b626f8a62b expref: 11 pid: 85083 timeout: 3347 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784189005.075008:0:25703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2539 00000100:00100000:2.0:1784189005.075017:0:25703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf48599500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:bd553d0d-03e2-4233-b06b-b55bbfa2b954+11:3640:x1870854458026752:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1784189005.075129:0:25703:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784189005.075203:0:25703:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9dc0755a4800/0xcc1762b626f8a632 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcc1762b626f8a62b expref: 11 pid: 85083 timeout: 3347 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189005.075217:0:25703:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9dc0755a4800/0xcc1762b626f8a632 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcc1762b626f8a62b expref: 11 pid: 85083 timeout: 3347 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189005.075257:0:25703:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dc0755a4800/0xcc1762b626f8a632 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcc1762b626f8a62b expref: 11 pid: 85083 timeout: 3347 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189005.075308:0:25703:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9dc0755a5400/0xcc1762b626f8a66a lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 85086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189005.075493:0:25703:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dc0755a5400/0xcc1762b626f8a66a lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 85086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1784189005.075528:0:25703:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.008309838s 00010000:00010000:2.0:1784189005.075534:0:25703:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9dc0755a5400/0xcc1762b626f8a66a lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 85086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189005.075555:0:25703:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9dc0755a5400/0xcc1762b626f8a66a lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 85086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189005.075564:0:25703:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9dc0755a5400/0xcc1762b626f8a66a lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 85086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189005.075786:0:25703:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9dc0755a5400/0xcc1762b626f8a66a lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 85086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189005.075794:0:25703:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc0755a5400 already unused, calling callback (ffffffffc0b2e230) 00010000:00010000:2.0:1784189005.075811:0:25703:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9dc0755a5400/0xcc1762b626f8a66a lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 85086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189005.075820:0:25703:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9dc0755a5400/0xcc1762b626f8a66a lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 85086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189005.077247:0:85086:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9dc0755a5400/0xcc1762b626f8a66a lrc: 5/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 85086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189005.077268:0:85086:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9dc0755a5400/0xcc1762b626f8a66a lrc: 5/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 85086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189005.077420:0:25703:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9dc0755a5400/0xcc1762b626f8a66a lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 85086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189005.077430:0:25703:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dc0755a5400/0xcc1762b626f8a66a lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 85086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189005.077468:0:25703:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784189005.077761:0:25703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf48599500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:bd553d0d-03e2-4233-b06b-b55bbfa2b954+10:3640:x1870854458026752:12345-0@lo:103:ldlm_bl.0 Request processed in 2740us (2941us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189005.077774:0:25703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2539 00000100:00100000:3.0:1784189005.078218:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf4859b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bd553d0d-03e2-4233-b06b-b55bbfa2b954:3640:1870854458026752:0@lo:103:ldlm_bl.0 00000020:00080000:0.0:1784189005.103089:0:85077:0:(update_trans.c:1495:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 73014444062 00000040:01000000:0.0:1784189005.104782:0:85077:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:3.0:1784189005.104879:0:85107:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 73014444062 00000020:00080000:3.0:1784189005.104884:0:85107:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 73014444062 00000040:01000000:3.0:1784189005.105958:0:85108:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:00080000:3.0:1784189005.106042:0:85108:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:01000000:0.0:1784189005.106826:0:85077:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osp-MDT0000 ctxt 16 is initialized 00000100:00100000:0.0:1784189005.107428:0:85109:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc081f81f80 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:85109:1870854458026880:0@lo:1000:lod0000_rec0001.0 00000040:01000000:1.0:1784189005.107999:0:85077:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:1.0:1784189005.108045:0:85077:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1784189005.108372:0:85108:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x20000a810:0x1:0x0] index 261376 count 1 00000100:00100000:0.0:1784189005.108438:0:85109:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784189005.108489:0:85109:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dc045d71840 going to sleep for 11 seconds 00000004:00080000:3.0:1784189005.108497:0:85108:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000100:00100000:2.0:1784189005.108999:0:23826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458026880 00000100:00100000:2.0:1784189005.109009:0:23826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458026880 00000004:00000080:1.0:1784189005.109054:0:85077:0:(mdd_device.c:553:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:1.0:1784189005.109065:0:85077:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000100:00100000:2.0:1784189005.109073:0:23826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3697 00000100:00100000:2.0:1784189005.109086:0:23826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc081f82d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:85109:x1870854458026880:12345-0@lo:1000:lod0000_rec0001.0 00000040:00080000:1.0:1784189005.109130:0:85077:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1784189005.110293:0:85077:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:1.0:1784189005.111018:0:85077:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:1.0:1784189005.111062:0:85077:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000100:00100000:3.0:1784189005.111096:0:23826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc081f82d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:85109:x1870854458026880:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 2008us (2657us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189005.111111:0:23826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3697 00000040:00080000:1.0:1784189005.111200:0:85077:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1784189005.111491:0:85109:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc081f81f80 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:85109:1870854458026880:0@lo:1000:lod0000_rec0001.0 00000040:01000000:0.0:1784189005.111552:0:85109:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:0.0:1784189005.111616:0:85109:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc081f81f80 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:85109:1870854458027008:0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1784189005.111682:0:85109:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784189005.111742:0:85109:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dc058300540 going to sleep for 11 seconds 00000100:00100000:2.0:1784189005.111862:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458027008 00000100:00100000:2.0:1784189005.111871:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458027008 00000100:00100000:2.0:1784189005.111961:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3698 00000100:00100000:2.0:1784189005.111973:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc081f80a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:85109:x1870854458027008:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1784189005.112144:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc081f80a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:85109:x1870854458027008:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 173us (461us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189005.112153:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3698 00000100:00100000:3.0:1784189005.112216:0:85109:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc081f81f80 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:85109:1870854458027008:0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1784189005.112292:0:85109:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf44bc0700 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:85109:1870854458027136:0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1784189005.112356:0:85109:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784189005.112379:0:85109:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dc080ea9c00 going to sleep for 11 seconds 00000100:00100000:0.0:1784189005.112445:0:26492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458027136 00000100:00100000:0.0:1784189005.112451:0:26492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458027136 00000100:00100000:0.0:1784189005.112488:0:26492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3699 00000100:00100000:0.0:1784189005.112496:0:26492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf44bc0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:85109:x1870854458027136:12345-0@lo:1000:lod0000_rec0001.0 00080000:10000000:1.0:1784189005.112519:0:85077:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x4a:0x0] (8/32) registered 00000100:00100000:0.0:1784189005.112631:0:26492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf44bc0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:85109:x1870854458027136:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 135us (275us total) trans 0 rc 0/0 00000100:00100000:0.0:1784189005.112639:0:26492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3699 00000100:00100000:3.0:1784189005.112733:0:85109:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf44bc0700 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:85109:1870854458027136:0@lo:1000:lod0000_rec0001.0 00000040:00080000:3.0:1784189005.112786:0:85109:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1784189005.114942:0:85109:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x2400090a4:0x1:0x0] index 261376 count 1 00000004:00080000:3.0:1784189005.115036:0:85109:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osp-MDT0000 retrieved update log, duration 0, retries 0 00000004:00080000:3.0:1784189005.115042:0:85109:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00010000:00080000:0.0:1784189005.118912:0:85077:0:(ldlm_lib.c:3053:target_recovery_init()) RECOVERY: service lustre-MDT0000, 2 recoverable clients, last_transno 94489280513 00010000:00080000:2.0:1784189005.121046:0:85110:0:(ldlm_lib.c:2853:target_recovery_thread()) lustre-MDT0000: started recovery thread pid 85110 00010000:02000000:2.0:1784189005.121072:0:85110:0:(ldlm_lib.c:2335:target_recovery_overseer()) lustre-MDT0000: in recovery but waiting for the first client to connect 00000020:01000004:0.0:1784189005.121424:0:85077:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1784189005.121449:0:85077:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.112@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1784189005.121601:0:85077:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=46 00000080:00000004:0.0:1784189005.121629:0:85077:0:(super25.c:181:lustre_fill_super()) /dev/mapper/mds1_flakey: Mount complete 00000020:00000004:0.0:1784189005.127890:0:85077:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1784189005.128272:0:85077:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00080000:2.0:1784189005.131860:0:85110:0:(ldlm_lib.c:2545:check_for_recovery_ready()) connected 0 stale 0 max_recoverable_clients 2 abort 0 expired 0 00010000:00080000:2.0:1784189005.131869:0:85110:0:(ldlm_lib.c:2545:check_for_recovery_ready()) connected 0 stale 0 max_recoverable_clients 2 abort 0 expired 0 00010000:00010000:3.0:1784189005.551627:0:7454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784189006.249853:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1784189006.249933:0:85083:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436232320 00000100:00100000:0.0:1784189006.249945:0:85083:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436232320 00000100:00100000:0.0:1784189006.250015:0:85083:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 37 00000100:00100000:0.0:1784189006.250026:0:85083:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf4507f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9957a2dc-fd88-4a91-bca3-e2b7f365ab0c+9:42415:x1870854436232320:12345-192.168.203.12@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784189006.250050:0:85083:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784189006.250080:0:85083:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dc070147200/0xcc1762b626f8a671 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xcbfc5de7fe6c3ce3 expref: -99 pid: 85083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189006.250115:0:85083:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dc070147200/0xcc1762b626f8a671 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c3ce3 expref: 10 pid: 85083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189006.250128:0:85083:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dc070147200/0xcc1762b626f8a671 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c3ce3 expref: 10 pid: 85083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189006.250138:0:85083:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc070147200, rc 0) 00000100:00100000:0.0:1784189006.250237:0:85083:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf4507f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9957a2dc-fd88-4a91-bca3-e2b7f365ab0c+10:42415:x1870854436232320:12345-192.168.203.12@tcp:101:ll_cfg_requeue.0 Request processed in 212us (396us total) trans 0 rc 0/0 00000100:00100000:0.0:1784189006.250245:0:85083:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 37 00000100:00100000:3.0:1784189006.256402:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1784189006.256908:0:85085:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436232448 00000100:00100000:0.0:1784189006.256921:0:85085:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436232448 00000100:00100000:0.0:1784189006.256991:0:85085:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 38 00000100:00100000:0.0:1784189006.257002:0:85085:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf4507e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9957a2dc-fd88-4a91-bca3-e2b7f365ab0c+10:42415:x1870854436232448:12345-192.168.203.12@tcp:256:ll_cfg_requeue.0 20000000:01000000:0.0:1784189006.257037:0:85085:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 16384. 20000000:01000000:0.0:1784189006.257058:0:85085:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1784189006.257062:0:85085:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/4/3. 20000000:01000000:0.0:1784189006.257066:0:85085:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/4/3. 20000000:01000000:0.0:1784189006.257069:0:85085:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/4/3. 20000000:01000000:0.0:1784189006.257071:0:85085:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 104 00000100:00100000:0.0:1784189006.258856:0:85085:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf4507e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9957a2dc-fd88-4a91-bca3-e2b7f365ab0c+10:42415:x1870854436232448:12345-192.168.203.12@tcp:256:ll_cfg_requeue.0 Request processed in 1846us (2467us total) trans 0 rc 0/0 00000100:00100000:0.0:1784189006.258873:0:85085:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 38 00000100:00100000:1.0:1784189006.265036:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1784189006.265141:0:66169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436232576 00000100:00100000:0.0:1784189006.265155:0:66169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436232576 00000100:00100000:0.0:1784189006.265208:0:66169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1057 00000100:00100000:0.0:1784189006.265217:0:66169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf48598a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2395:x1870854436232576:12345-192.168.203.12@tcp:38:ll_cfg_requeue.0 00010000:00080000:0.0:1784189006.265269:0:66169:0:(ldlm_lib.c:938:target_handle_reconnect()) connect export for UUID 'b90fcc1c-0e69-42a4-a116-a71fec7aeb78' at ffff9dc06b3ea000, cookie 0xcc1762b626f8a5bb 00010000:00080000:0.0:1784189006.265276:0:66169:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from b90fcc1c-0e69-42a4-a116-a71fec7aeb78@192.168.203.12@tcp recovering/t94489280514 exp ffff9dc06b3ea000 cur 3248 last 1784189004 00010000:02000400:0.0:1784189006.265294:0:66169:0:(ldlm_lib.c:2036:target_start_recovery_timer()) lustre-MDT0000: Will be in recovery for at least 1:00, or until 2 clients reconnect 00010000:00080000:0.0:1784189006.265301:0:66169:0:(ldlm_lib.c:2100:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 70 seconds 00000004:00100000:0.0:1784189006.265348:0:66169:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:0.0:1784189006.265526:0:66169:0:(import.c:65:import_set_state_nolock()) ffff9dc05ed27000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1784189006.265634:0:66169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf48598a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+6:2395:x1870854436232576:12345-192.168.203.12@tcp:38:ll_cfg_requeue.0 Request processed in 415us (611us total) trans 0 rc 0/0 00000100:00100000:0.0:1784189006.265643:0:66169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1057 00000100:00100000:3.0:1784189006.272771:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1784189006.272964:0:66945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436224512 00000100:00100000:0.0:1784189006.272977:0:66945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436224512 00000100:00100000:0.0:1784189006.273051:0:66945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1058 00000100:00100000:0.0:1784189006.273062:0:66945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf44bc0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+6:2395:x1870854436224512:12345-192.168.203.12@tcp:36:mcreate.0 00010000:00080000:0.0:1784189006.273085:0:66945:0:(ldlm_lib.c:3228:target_queue_recovery_request()) Next recovery transno: 94489280514, current: 94489280514, replaying 00000100:00100000:0.0:1784189006.273110:0:66945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf44bc0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+6:2395:x1870854436224512:12345-192.168.203.12@tcp:36:mcreate.0 Request processed in 51us (366us total) trans 0 rc 0/-999 00000100:00100000:0.0:1784189006.273118:0:66945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1058 00010000:00080000:1.0:1784189006.273263:0:85110:0:(ldlm_lib.c:2545:check_for_recovery_ready()) connected 1 stale 0 max_recoverable_clients 2 abort 0 expired 0 00010000:00010000:2.0:1784189006.576612:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1784189006.898207:0:6510:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1784189006.898214:0:6510:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff9dc047a82000 from 104 10000000:01000000:1.0:1784189006.898219:0:6510:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1784189006.898273:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff9dc042d67200/0xcc1762b626f8a678 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189006.898408:0:6510:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: ffff9dc042d67200/0xcc1762b626f8a678 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189006.898422:0:6510:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: ffff9dc042d67200/0xcc1762b626f8a678 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784189006.898458:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf48599c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458027264:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1784189006.898528:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784189006.898571:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dbf44c4fb40 going to sleep for 11 seconds 00000100:00100000:0.0:1784189006.899182:0:85083:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458027264 00000100:00100000:0.0:1784189006.899191:0:85083:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458027264 00000100:00100000:0.0:1784189006.899245:0:85083:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1784189006.899254:0:85083:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf4507d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd553d0d-03e2-4233-b06b-b55bbfa2b954+10:6510:x1870854458027264:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784189006.899267:0:85083:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784189006.899281:0:85083:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dc070146600/0xcc1762b626f8a67f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xcc1762b626f8a678 expref: -99 pid: 85083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189006.899305:0:85083:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dc070146600/0xcc1762b626f8a67f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcc1762b626f8a678 expref: 11 pid: 85083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189006.899333:0:85083:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dc070146600/0xcc1762b626f8a67f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcc1762b626f8a678 expref: 11 pid: 85083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189006.899344:0:85083:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc070146600, rc 0) 00000100:00100000:0.0:1784189006.899399:0:85083:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf4507d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd553d0d-03e2-4233-b06b-b55bbfa2b954+11:6510:x1870854458027264:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 146us (871us total) trans 0 rc 0/0 00000100:00100000:0.0:1784189006.899415:0:85083:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1784189006.899614:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf48599c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458027264:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784189006.899629:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: ffff9dc042d67200/0xcc1762b626f8a678 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc1762b626f8a67f expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189006.899639:0:6510:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: ffff9dc042d67200/0xcc1762b626f8a678 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcc1762b626f8a67f expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784189006.899685:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf48599c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458027392:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1784189006.899710:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784189006.899734:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dbf44c4fb40 going to sleep for 11 seconds 00000100:00100000:2.0:1784189006.899745:0:85085:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458027392 00000100:00100000:2.0:1784189006.899750:0:85085:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458027392 00000100:00100000:2.0:1784189006.899782:0:85085:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1784189006.899789:0:85085:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf4507ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd553d0d-03e2-4233-b06b-b55bbfa2b954+11:6510:x1870854458027392:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1784189006.899803:0:85085:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1784189006.899819:0:85085:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1784189006.899822:0:85085:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 104 00000100:00100000:2.0:1784189006.899897:0:85085:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf4507ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd553d0d-03e2-4233-b06b-b55bbfa2b954+11:6510:x1870854458027392:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 108us (185us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189006.899903:0:85085:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1784189006.899933:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf48599c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458027392:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1784189006.899976:0:6510:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1784189006.899983:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff9dc042d67200/0xcc1762b626f8a678 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc1762b626f8a67f expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189006.899999:0:6510:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: ffff9dc042d67200/0xcc1762b626f8a678 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc1762b626f8a67f expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784189006.900008:0:6510:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1784189006.900010:0:6510:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9dbf44675800 from 52 10000000:01000000:2.0:1784189006.900012:0:6510:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1784189006.900031:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff9dc0755a4000/0xcc1762b626f8a686 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189006.900038:0:6510:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: ffff9dc0755a4000/0xcc1762b626f8a686 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189006.900046:0:6510:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: ffff9dc0755a4000/0xcc1762b626f8a686 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784189006.900058:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc07016f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458027520:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1784189006.900081:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784189006.900095:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dbf45b9bc00 going to sleep for 11 seconds 00000100:00100000:2.0:1784189006.900107:0:85084:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458027520 00000100:00100000:2.0:1784189006.900110:0:85084:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458027520 00000100:00100000:2.0:1784189006.900132:0:85084:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1784189006.900138:0:85084:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf4507dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd553d0d-03e2-4233-b06b-b55bbfa2b954+11:6510:x1870854458027520:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1784189006.900145:0:85084:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784189006.900154:0:85084:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dc0755a4600/0xcc1762b626f8a68d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xcc1762b626f8a686 expref: -99 pid: 85084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189006.900166:0:85084:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dc0755a4600/0xcc1762b626f8a68d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcc1762b626f8a686 expref: 12 pid: 85084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189006.900185:0:85084:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dc0755a4600/0xcc1762b626f8a68d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcc1762b626f8a686 expref: 12 pid: 85084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189006.900192:0:85084:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc0755a4600, rc 0) 00000100:00100000:2.0:1784189006.900220:0:85084:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf4507dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd553d0d-03e2-4233-b06b-b55bbfa2b954+12:6510:x1870854458027520:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 81us (138us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189006.900226:0:85084:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1784189006.900254:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc07016f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458027520:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1784189006.900420:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: ffff9dc0755a4000/0xcc1762b626f8a686 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc1762b626f8a68d expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189006.900429:0:6510:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: ffff9dc0755a4000/0xcc1762b626f8a686 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xcc1762b626f8a68d expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784189006.900484:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc07016f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458027648:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1784189006.900509:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784189006.900524:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dbf45b9bc00 going to sleep for 11 seconds 00000100:00100000:2.0:1784189006.900535:0:85084:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458027648 00000100:00100000:2.0:1784189006.900538:0:85084:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458027648 00000100:00100000:2.0:1784189006.900558:0:85084:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1784189006.900564:0:85084:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf4507f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd553d0d-03e2-4233-b06b-b55bbfa2b954+12:6510:x1870854458027648:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1784189006.900673:0:85084:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf4507f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd553d0d-03e2-4233-b06b-b55bbfa2b954+12:6510:x1870854458027648:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 108us (162us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189006.900680:0:85084:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1784189006.900708:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc07016f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458027648:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1784189006.900744:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc07016f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458027776:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1784189006.900780:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784189006.900793:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dbf45b9bc00 going to sleep for 11 seconds 00000100:00100000:2.0:1784189006.900803:0:85084:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458027776 00000100:00100000:2.0:1784189006.900806:0:85084:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458027776 00000100:00100000:2.0:1784189006.900824:0:85084:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1784189006.900829:0:85084:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf4507cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd553d0d-03e2-4233-b06b-b55bbfa2b954+12:6510:x1870854458027776:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1784189006.900902:0:85084:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf4507cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd553d0d-03e2-4233-b06b-b55bbfa2b954+12:6510:x1870854458027776:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 71us (120us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189006.900909:0:85084:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1784189006.900948:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc07016f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458027776:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1784189006.902841:0:85201:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 51 00000020:01000000:0.0:1784189006.904215:0:6510:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 52-51 (rc=0) 10000000:01000000:0.0:1784189006.904266:0:6510:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1784189006.904277:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff9dc0755a4000/0xcc1762b626f8a686 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc1762b626f8a68d expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189006.904288:0:6510:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: ffff9dc0755a4000/0xcc1762b626f8a686 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc1762b626f8a68d expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784189006.904297:0:6510:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1784189006.904300:0:6510:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff9dbf44675800 from 101 10000000:01000000:0.0:1784189006.904303:0:6510:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1784189006.904368:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff9dc070147a00/0xcc1762b626f8a694 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189006.904378:0:6510:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: ffff9dc070147a00/0xcc1762b626f8a694 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189006.904398:0:6510:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: ffff9dc070147a00/0xcc1762b626f8a694 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784189006.904420:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc081f82680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458027904:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1784189006.904896:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784189006.904937:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dc04811d3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1784189006.905010:0:85084:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458027904 00000100:00100000:3.0:1784189006.905017:0:85084:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458027904 00000100:00100000:3.0:1784189006.905094:0:85084:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1784189006.905109:0:85084:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf4507c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd553d0d-03e2-4233-b06b-b55bbfa2b954+12:6510:x1870854458027904:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784189006.905122:0:85084:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784189006.905133:0:85084:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dc05ec0d800/0xcc1762b626f8a69b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xcc1762b626f8a694 expref: -99 pid: 85084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189006.905155:0:85084:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dc05ec0d800/0xcc1762b626f8a69b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcc1762b626f8a694 expref: 13 pid: 85084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189006.905165:0:85084:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dc05ec0d800/0xcc1762b626f8a69b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcc1762b626f8a694 expref: 13 pid: 85084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189006.905174:0:85084:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc05ec0d800, rc 0) 00000100:00100000:3.0:1784189006.905220:0:85084:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf4507c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd553d0d-03e2-4233-b06b-b55bbfa2b954+13:6510:x1870854458027904:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 112us (324us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189006.905227:0:85084:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1784189006.905291:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc081f82680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458027904:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784189006.905306:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: ffff9dc070147a00/0xcc1762b626f8a694 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc1762b626f8a69b expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189006.905334:0:6510:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: ffff9dc070147a00/0xcc1762b626f8a694 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xcc1762b626f8a69b expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784189006.905400:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf48598e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458028032:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1784189006.905438:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784189006.905682:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dbf44c4fb40 going to sleep for 11 seconds 00000100:00100000:0.0:1784189006.905709:0:85085:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458028032 00000100:00100000:0.0:1784189006.905714:0:85085:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458028032 00000100:00100000:0.0:1784189006.905738:0:85085:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1784189006.905743:0:85085:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf4507c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd553d0d-03e2-4233-b06b-b55bbfa2b954+13:6510:x1870854458028032:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1784189006.905756:0:85085:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1784189006.905773:0:85085:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1784189006.905777:0:85085:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/4/3. 20000000:01000000:0.0:1784189006.905780:0:85085:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/4/3. 20000000:01000000:0.0:1784189006.905783:0:85085:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/4/3. 20000000:01000000:0.0:1784189006.905785:0:85085:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 104 00000100:00100000:0.0:1784189006.905869:0:85085:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf4507c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd553d0d-03e2-4233-b06b-b55bbfa2b954+13:6510:x1870854458028032:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 125us (431us total) trans 0 rc 0/0 00000100:00100000:0.0:1784189006.905876:0:85085:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1784189006.905974:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf48598e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458028032:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1784189006.906048:0:6510:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1784189006.906058:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff9dc070147a00/0xcc1762b626f8a694 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc1762b626f8a69b expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189006.906066:0:6510:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: ffff9dc070147a00/0xcc1762b626f8a694 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc1762b626f8a69b expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784189006.906073:0:6510:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:1.0:1784189006.906075:0:6510:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 46 10000000:01000000:1.0:1784189006.906078:0:6510:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:1.0:1784189006.906095:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff9dc042d67000/0xcc1762b626f8a6a2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189006.906103:0:6510:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: ffff9dc042d67000/0xcc1762b626f8a6a2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189006.906111:0:6510:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: ffff9dc042d67000/0xcc1762b626f8a6a2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784189006.906123:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf48598e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458028160:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1784189006.906148:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784189006.906205:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dbf44c4fb40 going to sleep for 11 seconds 00000100:00100000:0.0:1784189006.906236:0:85085:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458028160 00000100:00100000:0.0:1784189006.906241:0:85085:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458028160 00000100:00100000:0.0:1784189006.906298:0:85085:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1784189006.906305:0:85085:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf4507e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd553d0d-03e2-4233-b06b-b55bbfa2b954+13:6510:x1870854458028160:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784189006.906312:0:85085:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784189006.906696:0:85085:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dc070146400/0xcc1762b626f8a6a9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xcc1762b626f8a6a2 expref: -99 pid: 85085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189006.906714:0:85085:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dc070146400/0xcc1762b626f8a6a9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcc1762b626f8a6a2 expref: 14 pid: 85085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189006.906723:0:85085:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dc070146400/0xcc1762b626f8a6a9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcc1762b626f8a6a2 expref: 14 pid: 85085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189006.906730:0:85085:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc070146400, rc 0) 00000100:00100000:0.0:1784189006.906768:0:85085:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf4507e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd553d0d-03e2-4233-b06b-b55bbfa2b954+14:6510:x1870854458028160:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 463us (618us total) trans 0 rc 0/0 00000100:00100000:0.0:1784189006.906774:0:85085:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1784189006.906829:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf48598e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458028160:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784189006.906841:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: ffff9dc042d67000/0xcc1762b626f8a6a2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc1762b626f8a6a9 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189006.906850:0:6510:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: ffff9dc042d67000/0xcc1762b626f8a6a2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xcc1762b626f8a6a9 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784189006.906899:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf48598e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458028288:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1784189006.906930:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784189006.907215:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dbf44c4fb40 going to sleep for 11 seconds 00000100:00100000:3.0:1784189006.907251:0:85084:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458028288 00000100:00100000:3.0:1784189006.907255:0:85084:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458028288 00000100:00100000:3.0:1784189006.907277:0:85084:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1784189006.907285:0:85084:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc07625b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd553d0d-03e2-4233-b06b-b55bbfa2b954+14:6510:x1870854458028288:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784189006.907450:0:85084:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc07625b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd553d0d-03e2-4233-b06b-b55bbfa2b954+14:6510:x1870854458028288:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 164us (517us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189006.907458:0:85084:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1784189006.907911:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf48598e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458028288:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784189006.907943:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf44bc2d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458028416:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1784189006.907980:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784189006.908092:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dc050243cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1784189006.908122:0:85084:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458028416 00000100:00100000:1.0:1784189006.908125:0:85084:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458028416 00000100:00100000:1.0:1784189006.908187:0:85084:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1784189006.908194:0:85084:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc076258450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd553d0d-03e2-4233-b06b-b55bbfa2b954+14:6510:x1870854458028416:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1784189006.910286:0:85084:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc076258450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd553d0d-03e2-4233-b06b-b55bbfa2b954+14:6510:x1870854458028416:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 2086us (2300us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189006.910299:0:85084:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1784189006.910590:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf44bc2d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458028416:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1784189006.911485:0:85206:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 64768 count 46 00000020:01000000:3.0:1784189006.911750:0:6510:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 46-45 (rc=0) 10000000:01000000:3.0:1784189006.911778:0:6510:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:3.0:1784189006.911788:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff9dc042d67000/0xcc1762b626f8a6a2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc1762b626f8a6a9 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189006.911799:0:6510:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: ffff9dc042d67000/0xcc1762b626f8a6a2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc1762b626f8a6a9 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784189006.911808:0:6510:0:(mgc_request.c:611:do_requeue()) updating log lustre-barrier 10000000:01000000:3.0:1784189006.911810:0:6510:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-barrier-ffff9dbf44675800 from 1 10000000:01000000:3.0:1784189006.911813:0:6510:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:3.0:1784189006.911842:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff9dc05ec0da00/0xcc1762b626f8a6b0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189006.911849:0:6510:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: ffff9dc05ec0da00/0xcc1762b626f8a6b0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189006.911858:0:6510:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: ffff9dc05ec0da00/0xcc1762b626f8a6b0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784189006.911877:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf44bc2d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458028544:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1784189006.911925:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784189006.911990:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dc050243780 going to sleep for 11 seconds 00000100:00100000:1.0:1784189006.912024:0:85083:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458028544 00000100:00100000:1.0:1784189006.912031:0:85083:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458028544 00000100:00100000:1.0:1784189006.912077:0:85083:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1784189006.912085:0:85083:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc07625a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd553d0d-03e2-4233-b06b-b55bbfa2b954+14:6510:x1870854458028544:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784189006.912096:0:85083:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784189006.912109:0:85083:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dc042d66a00/0xcc1762b626f8a6b7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xcc1762b626f8a6b0 expref: -99 pid: 85083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189006.912130:0:85083:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dc042d66a00/0xcc1762b626f8a6b7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcc1762b626f8a6b0 expref: 15 pid: 85083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189006.912140:0:85083:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dc042d66a00/0xcc1762b626f8a6b7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcc1762b626f8a6b0 expref: 15 pid: 85083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189006.912148:0:85083:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc042d66a00, rc 0) 00000100:00100000:1.0:1784189006.912258:0:85083:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc07625a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd553d0d-03e2-4233-b06b-b55bbfa2b954+15:6510:x1870854458028544:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 172us (332us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189006.912265:0:85083:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1784189006.912419:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf44bc2d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458028544:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784189006.912433:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: ffff9dc05ec0da00/0xcc1762b626f8a6b0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc1762b626f8a6b7 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189006.912442:0:6510:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: ffff9dc05ec0da00/0xcc1762b626f8a6b0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xcc1762b626f8a6b7 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784189006.912455:0:6510:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:3.0:1784189006.912464:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff9dc05ec0da00/0xcc1762b626f8a6b0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc1762b626f8a6b7 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189006.912602:0:6510:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: ffff9dc05ec0da00/0xcc1762b626f8a6b0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc1762b626f8a6b7 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784189006.912610:0:6510:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1784189006.912612:0:6510:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9dbf44675800 from 7 10000000:01000000:3.0:1784189006.912614:0:6510:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1784189006.912631:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff9dc05ec0ce00/0xcc1762b626f8a6be lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189006.912638:0:6510:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: ffff9dc05ec0ce00/0xcc1762b626f8a6be lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189006.912645:0:6510:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: ffff9dc05ec0ce00/0xcc1762b626f8a6be lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784189006.912658:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf44bc2d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458028672:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1784189006.912684:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784189006.912737:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dc050243780 going to sleep for 11 seconds 00000100:00100000:0.0:1784189006.912766:0:85084:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458028672 00000100:00100000:0.0:1784189006.912771:0:85084:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458028672 00000100:00100000:0.0:1784189006.912835:0:85084:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1784189006.912843:0:85084:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc07625b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd553d0d-03e2-4233-b06b-b55bbfa2b954+15:6510:x1870854458028672:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784189006.912856:0:85084:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784189006.912865:0:85084:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dc070147000/0xcc1762b626f8a6c5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xcc1762b626f8a6be expref: -99 pid: 85084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189006.912880:0:85084:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dc070147000/0xcc1762b626f8a6c5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcc1762b626f8a6be expref: 16 pid: 85084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189006.912888:0:85084:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dc070147000/0xcc1762b626f8a6c5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcc1762b626f8a6be expref: 16 pid: 85084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189006.912894:0:85084:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc070147000, rc 0) 00000100:00100000:0.0:1784189006.912933:0:85084:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc07625b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd553d0d-03e2-4233-b06b-b55bbfa2b954+16:6510:x1870854458028672:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 91us (248us total) trans 0 rc 0/0 00000100:00100000:0.0:1784189006.912939:0:85084:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1784189006.912993:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf44bc2d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458028672:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784189006.913004:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: ffff9dc05ec0ce00/0xcc1762b626f8a6be lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc1762b626f8a6c5 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189006.913012:0:6510:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: ffff9dc05ec0ce00/0xcc1762b626f8a6be lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xcc1762b626f8a6c5 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784189006.913057:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf44bc2d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458028800:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784189006.913090:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784189006.913149:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dc050243780 going to sleep for 11 seconds 00000100:00100000:1.0:1784189006.913176:0:85085:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458028800 00000100:00100000:1.0:1784189006.913181:0:85085:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458028800 00000100:00100000:1.0:1784189006.913202:0:85085:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1784189006.913207:0:85085:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc076259050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd553d0d-03e2-4233-b06b-b55bbfa2b954+16:6510:x1870854458028800:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1784189006.913302:0:85085:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc076259050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd553d0d-03e2-4233-b06b-b55bbfa2b954+16:6510:x1870854458028800:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 94us (211us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189006.913308:0:85085:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1784189006.913603:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf44bc2d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458028800:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784189006.913633:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf44bc2d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458028928:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1784189006.913671:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784189006.913723:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dc050243780 going to sleep for 11 seconds 00000100:00100000:1.0:1784189006.913753:0:85085:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458028928 00000100:00100000:1.0:1784189006.913757:0:85085:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458028928 00000100:00100000:1.0:1784189006.913814:0:85085:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1784189006.913821:0:85085:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc07625b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd553d0d-03e2-4233-b06b-b55bbfa2b954+16:6510:x1870854458028928:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1784189006.913931:0:85085:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc07625b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd553d0d-03e2-4233-b06b-b55bbfa2b954+16:6510:x1870854458028928:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 110us (259us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189006.913938:0:85085:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1784189006.914007:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf44bc2d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458028928:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1784189006.915961:0:85207:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:1.0:1784189006.916045:0:6510:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:1.0:1784189006.916066:0:6510:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1784189006.916075:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff9dc05ec0ce00/0xcc1762b626f8a6be lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc1762b626f8a6c5 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189006.916085:0:6510:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: ffff9dc05ec0ce00/0xcc1762b626f8a6be lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc1762b626f8a6c5 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784189006.916094:0:6510:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1784189006.916096:0:6510:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9dbf425f7000 from 52 10000000:01000000:1.0:1784189006.916098:0:6510:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1784189006.916130:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff9dc042d66000/0xcc1762b626f8a6cc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189006.916137:0:6510:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: ffff9dc042d66000/0xcc1762b626f8a6cc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189006.916154:0:6510:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: ffff9dc042d66000/0xcc1762b626f8a6cc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784189006.916178:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf4859ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458029056:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1784189006.916234:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784189006.916274:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dbf44443600 going to sleep for 11 seconds 00000100:00100000:2.0:1784189006.917208:0:85083:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458029056 00000100:00100000:2.0:1784189006.917218:0:85083:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458029056 00000100:00100000:2.0:1784189006.917272:0:85083:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1784189006.917282:0:85083:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc076259850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd553d0d-03e2-4233-b06b-b55bbfa2b954+16:6510:x1870854458029056:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1784189006.917296:0:85083:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784189006.917311:0:85083:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dc0755a4c00/0xcc1762b626f8a6d3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xcc1762b626f8a6cc expref: -99 pid: 85083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189006.917360:0:85083:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dc0755a4c00/0xcc1762b626f8a6d3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcc1762b626f8a6cc expref: 17 pid: 85083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189006.917371:0:85083:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dc0755a4c00/0xcc1762b626f8a6d3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcc1762b626f8a6cc expref: 17 pid: 85083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189006.917397:0:85083:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc0755a4c00, rc 0) 00000100:00100000:2.0:1784189006.917458:0:85083:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc076259850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd553d0d-03e2-4233-b06b-b55bbfa2b954+17:6510:x1870854458029056:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 177us (1223us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189006.917475:0:85083:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1784189006.917579:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf4859ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458029056:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1784189006.917595:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: ffff9dc042d66000/0xcc1762b626f8a6cc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc1762b626f8a6d3 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189006.917604:0:6510:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: ffff9dc042d66000/0xcc1762b626f8a6cc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xcc1762b626f8a6d3 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784189006.917667:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc07016f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458029184:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1784189006.917695:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784189006.917718:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dc0715a3180 going to sleep for 11 seconds 00000100:00100000:2.0:1784189006.917729:0:85085:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458029184 00000100:00100000:2.0:1784189006.917732:0:85085:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458029184 00000100:00100000:2.0:1784189006.917755:0:85085:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1784189006.917761:0:85085:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc076258850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd553d0d-03e2-4233-b06b-b55bbfa2b954+17:6510:x1870854458029184:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1784189006.917862:0:85085:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc076258850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd553d0d-03e2-4233-b06b-b55bbfa2b954+17:6510:x1870854458029184:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 101us (166us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189006.917869:0:85085:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1784189006.917900:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc07016f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458029184:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1784189006.917926:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc07016f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458029312:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1784189006.917961:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784189006.917979:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dc081c576c0 going to sleep for 11 seconds 00000100:00100000:2.0:1784189006.917991:0:85085:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458029312 00000100:00100000:2.0:1784189006.917994:0:85085:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458029312 00000100:00100000:2.0:1784189006.918014:0:85085:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1784189006.918020:0:85085:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc076258050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd553d0d-03e2-4233-b06b-b55bbfa2b954+17:6510:x1870854458029312:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1784189006.918106:0:85085:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc076258050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd553d0d-03e2-4233-b06b-b55bbfa2b954+17:6510:x1870854458029312:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 86us (144us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189006.918113:0:85085:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1784189006.918151:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc07016f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458029312:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1784189006.918933:0:85209:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 51 00000020:01000000:1.0:1784189006.919225:0:6510:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 52-51 (rc=0) 10000000:01000000:1.0:1784189006.919246:0:6510:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1784189006.919254:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff9dc042d66000/0xcc1762b626f8a6cc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc1762b626f8a6d3 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189006.919263:0:6510:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: ffff9dc042d66000/0xcc1762b626f8a6cc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc1762b626f8a6d3 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784189006.919272:0:6510:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:1.0:1784189006.919274:0:6510:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 11 10000000:01000000:1.0:1784189006.919277:0:6510:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:1.0:1784189006.919561:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff9dc042d66800/0xcc1762b626f8a6da lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189006.919571:0:6510:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: ffff9dc042d66800/0xcc1762b626f8a6da lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189006.919579:0:6510:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: ffff9dc042d66800/0xcc1762b626f8a6da lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784189006.919596:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf4859ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458029440:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1784189006.919638:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784189006.919671:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dbf44443a80 going to sleep for 11 seconds 00000100:00100000:2.0:1784189006.919698:0:85085:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458029440 00000100:00100000:2.0:1784189006.919703:0:85085:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458029440 00000100:00100000:2.0:1784189006.920605:0:85085:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1784189006.920618:0:85085:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc076259c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd553d0d-03e2-4233-b06b-b55bbfa2b954+17:6510:x1870854458029440:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1784189006.920634:0:85085:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784189006.920652:0:85085:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dc0755a5e00/0xcc1762b626f8a6e1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xcc1762b626f8a6da expref: -99 pid: 85085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189006.920675:0:85085:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dc0755a5e00/0xcc1762b626f8a6e1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcc1762b626f8a6da expref: 18 pid: 85085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189006.920686:0:85085:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dc0755a5e00/0xcc1762b626f8a6e1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcc1762b626f8a6da expref: 18 pid: 85085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189006.920695:0:85085:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc0755a5e00, rc 0) 00000100:00100000:2.0:1784189006.920754:0:85085:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc076259c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd553d0d-03e2-4233-b06b-b55bbfa2b954+18:6510:x1870854458029440:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 140us (1116us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189006.920761:0:85085:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1784189006.921563:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf4859ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458029440:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784189006.921579:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: ffff9dc042d66800/0xcc1762b626f8a6da lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc1762b626f8a6e1 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189006.921589:0:6510:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: ffff9dc042d66800/0xcc1762b626f8a6da lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xcc1762b626f8a6e1 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784189006.921655:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf4859ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458029568:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1784189006.921686:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784189006.921720:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dbf44443a80 going to sleep for 11 seconds 00000100:00100000:3.0:1784189006.921750:0:85084:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458029568 00000100:00100000:3.0:1784189006.921757:0:85084:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458029568 00000100:00100000:3.0:1784189006.921803:0:85084:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1784189006.921813:0:85084:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc07625bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd553d0d-03e2-4233-b06b-b55bbfa2b954+18:6510:x1870854458029568:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784189006.921949:0:85084:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc07625bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd553d0d-03e2-4233-b06b-b55bbfa2b954+18:6510:x1870854458029568:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 138us (261us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189006.921956:0:85084:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1784189006.921989:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf4859ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458029568:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784189006.922017:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf44bc2d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458029696:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1784189006.922053:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784189006.922065:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dc050243cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1784189006.922075:0:85084:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458029696 00000100:00100000:3.0:1784189006.922079:0:85084:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458029696 00000100:00100000:3.0:1784189006.922095:0:85084:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1784189006.922100:0:85084:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc0564cc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd553d0d-03e2-4233-b06b-b55bbfa2b954+18:6510:x1870854458029696:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1784189006.928760:0:85084:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc0564cc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd553d0d-03e2-4233-b06b-b55bbfa2b954+18:6510:x1870854458029696:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 6650us (6698us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189006.928774:0:85084:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1784189006.934752:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf44bc2d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458029696:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1784189006.937376:0:85211:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 64768 count 11 00000020:01000000:3.0:1784189006.937617:0:6510:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 11-10 (rc=0) 10000000:01000000:3.0:1784189006.937654:0:6510:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:3.0:1784189006.937664:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff9dc042d66800/0xcc1762b626f8a6da lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc1762b626f8a6e1 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189006.937676:0:6510:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: ffff9dc042d66800/0xcc1762b626f8a6da lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc1762b626f8a6e1 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784189006.937685:0:6510:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1784189006.937687:0:6510:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9dbf425f7000 from 7 10000000:01000000:3.0:1784189006.937690:0:6510:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1784189006.937723:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff9dc05ec0c800/0xcc1762b626f8a6e8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189006.937731:0:6510:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: ffff9dc05ec0c800/0xcc1762b626f8a6e8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189006.937742:0:6510:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: ffff9dc05ec0c800/0xcc1762b626f8a6e8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784189006.937765:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf44bc2d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458029824:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1784189006.937830:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784189006.937873:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dc050243cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1784189006.937925:0:85083:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458029824 00000100:00100000:2.0:1784189006.937933:0:85083:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458029824 00000100:00100000:2.0:1784189006.937979:0:85083:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1784189006.937989:0:85083:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc0564cdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd553d0d-03e2-4233-b06b-b55bbfa2b954+18:6510:x1870854458029824:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1784189006.938002:0:85083:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784189006.938015:0:85083:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dc0755a4400/0xcc1762b626f8a6ef lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xcc1762b626f8a6e8 expref: -99 pid: 85083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189006.938037:0:85083:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dc0755a4400/0xcc1762b626f8a6ef lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcc1762b626f8a6e8 expref: 19 pid: 85083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189006.938049:0:85083:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dc0755a4400/0xcc1762b626f8a6ef lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcc1762b626f8a6e8 expref: 19 pid: 85083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189006.938058:0:85083:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc0755a4400, rc 0) 00000100:00100000:2.0:1784189006.938101:0:85083:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc0564cdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd553d0d-03e2-4233-b06b-b55bbfa2b954+19:6510:x1870854458029824:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 113us (271us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189006.938109:0:85083:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1784189006.938195:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf44bc2d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458029824:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784189006.938208:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: ffff9dc05ec0c800/0xcc1762b626f8a6e8 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc1762b626f8a6ef expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189006.938216:0:6510:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: ffff9dc05ec0c800/0xcc1762b626f8a6e8 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xcc1762b626f8a6ef expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784189006.938271:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf44bc2d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458029952:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784189006.938303:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784189006.938349:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dc050243cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1784189006.938584:0:85084:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458029952 00000100:00100000:2.0:1784189006.938589:0:85084:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458029952 00000100:00100000:2.0:1784189006.938612:0:85084:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1784189006.938619:0:85084:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc0564cf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd553d0d-03e2-4233-b06b-b55bbfa2b954+19:6510:x1870854458029952:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1784189006.938716:0:85084:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc0564cf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd553d0d-03e2-4233-b06b-b55bbfa2b954+19:6510:x1870854458029952:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 97us (411us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189006.938723:0:85084:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1784189006.938952:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf44bc2d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458029952:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784189006.938982:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf44bc2d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458030080:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1784189006.939020:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784189006.939046:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dc050243cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1784189006.939095:0:85085:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458030080 00000100:00100000:2.0:1784189006.939100:0:85085:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458030080 00000100:00100000:2.0:1784189006.939132:0:85085:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1784189006.939146:0:85085:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc0564ce450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd553d0d-03e2-4233-b06b-b55bbfa2b954+19:6510:x1870854458030080:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1784189006.939242:0:85085:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc0564ce450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd553d0d-03e2-4233-b06b-b55bbfa2b954+19:6510:x1870854458030080:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 97us (220us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189006.939249:0:85085:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1784189006.939360:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf44bc2d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458030080:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1784189006.940636:0:85212:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:3.0:1784189006.940817:0:6510:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:3.0:1784189006.940844:0:6510:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1784189006.940852:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff9dc05ec0c800/0xcc1762b626f8a6e8 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc1762b626f8a6ef expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189006.940863:0:6510:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: ffff9dc05ec0c800/0xcc1762b626f8a6e8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc1762b626f8a6ef expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784189006.940872:0:6510:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1784189006.940874:0:6510:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9dc07b5d6800 from 52 10000000:01000000:3.0:1784189006.940877:0:6510:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1784189006.940905:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff9dc05ec0c000/0xcc1762b626f8a6f6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189006.940914:0:6510:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: ffff9dc05ec0c000/0xcc1762b626f8a6f6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189006.940924:0:6510:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: ffff9dc05ec0c000/0xcc1762b626f8a6f6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784189006.940942:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf44bc2d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458030208:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1784189006.941000:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784189006.941070:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dc050243cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1784189006.941107:0:85083:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458030208 00000100:00100000:2.0:1784189006.941112:0:85083:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458030208 00000100:00100000:2.0:1784189006.941185:0:85083:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1784189006.941195:0:85083:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc0564cc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd553d0d-03e2-4233-b06b-b55bbfa2b954+19:6510:x1870854458030208:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1784189006.941205:0:85083:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784189006.941217:0:85083:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dc0755a5800/0xcc1762b626f8a6fd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xcc1762b626f8a6f6 expref: -99 pid: 85083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189006.941236:0:85083:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dc0755a5800/0xcc1762b626f8a6fd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcc1762b626f8a6f6 expref: 20 pid: 85083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189006.941245:0:85083:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dc0755a5800/0xcc1762b626f8a6fd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcc1762b626f8a6f6 expref: 20 pid: 85083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189006.941253:0:85083:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc0755a5800, rc 0) 00000100:00100000:2.0:1784189006.941295:0:85083:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc0564cc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd553d0d-03e2-4233-b06b-b55bbfa2b954+20:6510:x1870854458030208:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 101us (294us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189006.941302:0:85083:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1784189006.941407:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf44bc2d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458030208:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784189006.941422:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: ffff9dc05ec0c000/0xcc1762b626f8a6f6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc1762b626f8a6fd expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189006.941431:0:6510:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: ffff9dc05ec0c000/0xcc1762b626f8a6f6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xcc1762b626f8a6fd expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784189006.941504:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf48598e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458030336:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1784189006.941532:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784189006.941797:0:85085:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458030336 00000100:00100000:3.0:1784189006.941802:0:85085:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458030336 00000100:00100000:3.0:1784189006.941823:0:85085:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1784189006.941829:0:85085:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc0564cec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd553d0d-03e2-4233-b06b-b55bbfa2b954+20:6510:x1870854458030336:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784189006.941926:0:85085:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc0564cec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd553d0d-03e2-4233-b06b-b55bbfa2b954+20:6510:x1870854458030336:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 96us (393us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189006.941933:0:85085:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1784189006.942034:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dbf444436c0 going to sleep for 11 seconds 00000100:00100000:1.0:1784189006.942050:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf48598e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458030336:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1784189006.942081:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf48598e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458030464:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1784189006.942128:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784189006.942192:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dbf444436c0 going to sleep for 11 seconds 00000100:00100000:3.0:1784189006.942224:0:85085:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458030464 00000100:00100000:3.0:1784189006.942229:0:85085:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458030464 00000100:00100000:3.0:1784189006.942286:0:85085:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1784189006.942293:0:85085:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc04a4a2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd553d0d-03e2-4233-b06b-b55bbfa2b954+20:6510:x1870854458030464:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1784189006.942410:0:85085:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc04a4a2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd553d0d-03e2-4233-b06b-b55bbfa2b954+20:6510:x1870854458030464:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 117us (281us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189006.942417:0:85085:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1784189006.942524:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf48598e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458030464:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1784189006.943678:0:85213:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 51 00000020:01000000:2.0:1784189006.943843:0:6510:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 52-51 (rc=0) 10000000:01000000:2.0:1784189006.943863:0:6510:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1784189006.943872:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff9dc05ec0c000/0xcc1762b626f8a6f6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc1762b626f8a6fd expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189006.943882:0:6510:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: ffff9dc05ec0c000/0xcc1762b626f8a6f6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc1762b626f8a6fd expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784189006.943902:0:6510:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:2.0:1784189006.943904:0:6510:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 14 10000000:01000000:2.0:1784189006.943907:0:6510:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:2.0:1784189006.943935:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff9dc0755a5a00/0xcc1762b626f8a704 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189006.943943:0:6510:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: ffff9dc0755a5a00/0xcc1762b626f8a704 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189006.943952:0:6510:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: ffff9dc0755a5a00/0xcc1762b626f8a704 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784189006.943971:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc07016f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458030592:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1784189006.944016:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784189006.944082:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dbf425bbd80 going to sleep for 11 seconds 00000100:00100000:1.0:1784189006.944115:0:85084:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458030592 00000100:00100000:1.0:1784189006.944121:0:85084:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458030592 00000100:00100000:1.0:1784189006.944186:0:85084:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1784189006.944195:0:85084:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc04a4a0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd553d0d-03e2-4233-b06b-b55bbfa2b954+20:6510:x1870854458030592:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784189006.944205:0:85084:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784189006.944217:0:85084:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dc042d66c00/0xcc1762b626f8a70b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xcc1762b626f8a704 expref: -99 pid: 85084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189006.944238:0:85084:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dc042d66c00/0xcc1762b626f8a70b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcc1762b626f8a704 expref: 21 pid: 85084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189006.944247:0:85084:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dc042d66c00/0xcc1762b626f8a70b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcc1762b626f8a704 expref: 21 pid: 85084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189006.944255:0:85084:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc042d66c00, rc 0) 00000100:00100000:1.0:1784189006.944298:0:85084:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc04a4a0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd553d0d-03e2-4233-b06b-b55bbfa2b954+21:6510:x1870854458030592:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 104us (281us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189006.944304:0:85084:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1784189006.944406:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc07016f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458030592:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784189006.944420:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: ffff9dc0755a5a00/0xcc1762b626f8a704 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc1762b626f8a70b expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189006.944430:0:6510:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: ffff9dc0755a5a00/0xcc1762b626f8a704 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0xcc1762b626f8a70b expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784189006.944491:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf44bc2a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458030720:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784189006.944528:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784189006.944785:0:85083:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458030720 00000100:00100000:2.0:1784189006.944791:0:85083:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458030720 00000100:00100000:2.0:1784189006.944813:0:85083:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1784189006.944820:0:85083:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc07617ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd553d0d-03e2-4233-b06b-b55bbfa2b954+21:6510:x1870854458030720:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1784189006.944941:0:85083:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc07617ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd553d0d-03e2-4233-b06b-b55bbfa2b954+21:6510:x1870854458030720:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 121us (412us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189006.944948:0:85083:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1784189006.945053:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dc050243780 going to sleep for 11 seconds 00000100:00100000:3.0:1784189006.945071:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf44bc2a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458030720:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784189006.945097:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf44bc2a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458030848:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1784189006.945132:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784189006.945179:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dc050243780 going to sleep for 11 seconds 00000100:00100000:2.0:1784189006.945215:0:85083:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458030848 00000100:00100000:2.0:1784189006.945219:0:85083:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458030848 00000100:00100000:2.0:1784189006.945270:0:85083:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1784189006.945277:0:85083:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc07617d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd553d0d-03e2-4233-b06b-b55bbfa2b954+21:6510:x1870854458030848:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1784189006.946209:0:85083:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc07617d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd553d0d-03e2-4233-b06b-b55bbfa2b954+21:6510:x1870854458030848:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 928us (1071us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189006.946225:0:85083:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1784189006.946673:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf44bc2a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458030848:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1784189006.947700:0:85214:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 64768 count 14 00000020:01000000:1.0:1784189006.947874:0:6510:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 14-13 (rc=0) 10000000:01000000:1.0:1784189006.947902:0:6510:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:1.0:1784189006.947911:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff9dc0755a5a00/0xcc1762b626f8a704 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc1762b626f8a70b expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189006.947922:0:6510:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: ffff9dc0755a5a00/0xcc1762b626f8a704 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc1762b626f8a70b expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784189006.947940:0:6510:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1784189006.947942:0:6510:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9dc07b5d6800 from 7 10000000:01000000:1.0:1784189006.947945:0:6510:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1784189006.947974:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff9dc042d67800/0xcc1762b626f8a712 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189006.947982:0:6510:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: ffff9dc042d67800/0xcc1762b626f8a712 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189006.947991:0:6510:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: ffff9dc042d67800/0xcc1762b626f8a712 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784189006.948012:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf48598e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458030976:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1784189006.948058:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784189006.948094:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dbf44443600 going to sleep for 11 seconds 00000100:00100000:3.0:1784189006.948161:0:85085:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458030976 00000100:00100000:3.0:1784189006.948167:0:85085:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458030976 00000100:00100000:3.0:1784189006.948202:0:85085:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1784189006.948210:0:85085:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc07617c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd553d0d-03e2-4233-b06b-b55bbfa2b954+21:6510:x1870854458030976:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784189006.948221:0:85085:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784189006.948234:0:85085:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dc05ec0cc00/0xcc1762b626f8a719 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xcc1762b626f8a712 expref: -99 pid: 85085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189006.948255:0:85085:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dc05ec0cc00/0xcc1762b626f8a719 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcc1762b626f8a712 expref: 22 pid: 85085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189006.948266:0:85085:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dc05ec0cc00/0xcc1762b626f8a719 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcc1762b626f8a712 expref: 22 pid: 85085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189006.948275:0:85085:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc05ec0cc00, rc 0) 00000100:00100000:3.0:1784189006.948310:0:85085:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc07617c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd553d0d-03e2-4233-b06b-b55bbfa2b954+22:6510:x1870854458030976:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 100us (251us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189006.948338:0:85085:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1784189006.948392:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf48598e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458030976:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784189006.948406:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: ffff9dc042d67800/0xcc1762b626f8a712 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc1762b626f8a719 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189006.948421:0:6510:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: ffff9dc042d67800/0xcc1762b626f8a712 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xcc1762b626f8a719 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784189006.948638:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf44bc2a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458031104:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784189006.948669:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784189006.948688:0:85085:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458031104 00000100:00100000:3.0:1784189006.948691:0:85085:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458031104 00000100:00100000:3.0:1784189006.948713:0:85085:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1784189006.948720:0:85085:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc07617cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd553d0d-03e2-4233-b06b-b55bbfa2b954+22:6510:x1870854458031104:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784189006.948809:0:85085:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc07617cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd553d0d-03e2-4233-b06b-b55bbfa2b954+22:6510:x1870854458031104:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 90us (140us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189006.948816:0:85085:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1784189006.948838:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dc07545bd80 going to sleep for 11 seconds 00000100:00100000:3.0:1784189006.948849:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf44bc2a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458031104:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784189006.948873:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf44bc2a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458031232:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1784189006.948911:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784189006.948929:0:85085:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458031232 00000100:00100000:3.0:1784189006.948933:0:85085:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458031232 00000100:00100000:3.0:1784189006.948953:0:85085:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1784189006.948959:0:85085:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc07617e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd553d0d-03e2-4233-b06b-b55bbfa2b954+22:6510:x1870854458031232:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1784189006.949029:0:85085:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc07617e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd553d0d-03e2-4233-b06b-b55bbfa2b954+22:6510:x1870854458031232:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 69us (117us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189006.949036:0:85085:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1784189006.949066:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dc07545bd80 going to sleep for 11 seconds 00000100:00100000:3.0:1784189006.949082:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf44bc2a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458031232:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1784189006.952060:0:85215:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:3.0:1784189006.952146:0:6510:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:3.0:1784189006.952189:0:6510:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1784189006.952199:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff9dc042d67800/0xcc1762b626f8a712 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc1762b626f8a719 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189006.952209:0:6510:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: ffff9dc042d67800/0xcc1762b626f8a712 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc1762b626f8a719 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784189006.952218:0:6510:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:3.0:1784189006.952221:0:6510:0:(mgc_request.c:1801:mgc_process_log()) Process log nodemap-ffff9dc06bb30000 from 1 10000000:01000000:3.0:1784189006.952224:0:6510:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:3.0:1784189006.952263:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff9dc05ec0c600/0xcc1762b626f8a720 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189006.952272:0:6510:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: ffff9dc05ec0c600/0xcc1762b626f8a720 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189006.952282:0:6510:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: ffff9dc05ec0c600/0xcc1762b626f8a720 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784189006.952304:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf44bc2a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458031360:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1784189006.952391:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784189006.952427:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dc07545b480 going to sleep for 11 seconds 00000100:00100000:3.0:1784189006.952448:0:85085:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458031360 00000100:00100000:3.0:1784189006.952454:0:85085:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458031360 00000100:00100000:3.0:1784189006.952751:0:85085:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1784189006.952761:0:85085:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc07617d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd553d0d-03e2-4233-b06b-b55bbfa2b954+22:6510:x1870854458031360:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784189006.952782:0:85085:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784189006.952795:0:85085:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dc05ec0de00/0xcc1762b626f8a727 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xcc1762b626f8a720 expref: -99 pid: 85085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189006.952816:0:85085:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dc05ec0de00/0xcc1762b626f8a727 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcc1762b626f8a720 expref: 23 pid: 85085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189006.952827:0:85085:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dc05ec0de00/0xcc1762b626f8a727 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcc1762b626f8a720 expref: 23 pid: 85085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189006.952835:0:85085:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc05ec0de00, rc 0) 00000100:00100000:3.0:1784189006.952879:0:85085:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc07617d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd553d0d-03e2-4233-b06b-b55bbfa2b954+23:6510:x1870854458031360:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 119us (498us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189006.952885:0:85085:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1784189006.952955:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf44bc2a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458031360:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784189006.952969:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: ffff9dc05ec0c600/0xcc1762b626f8a720 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc1762b626f8a727 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189006.952978:0:6510:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: ffff9dc05ec0c600/0xcc1762b626f8a720 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcc1762b626f8a727 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784189006.952994:0:6510:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:1.0:1784189006.952998:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff9dc05ec0c600/0xcc1762b626f8a720 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc1762b626f8a727 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189006.953004:0:6510:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: ffff9dc05ec0c600/0xcc1762b626f8a720 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc1762b626f8a727 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784189006.953023:0:6510:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:1.0:1784189006.953025:0:6510:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-sptlrpc-ffff9dc06bb30000 from 1 10000000:01000000:1.0:1784189006.953028:0:6510:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1784189006.953046:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff9dc042d67c00/0xcc1762b626f8a72e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189006.953054:0:6510:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: ffff9dc042d67c00/0xcc1762b626f8a72e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189006.953062:0:6510:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: ffff9dc042d67c00/0xcc1762b626f8a72e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784189006.953075:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf48599c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458031488:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1784189006.953105:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784189006.953201:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dbf44443cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1784189006.953240:0:85083:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458031488 00000100:00100000:2.0:1784189006.953245:0:85083:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458031488 00000100:00100000:2.0:1784189006.953270:0:85083:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1784189006.953277:0:85083:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc07617c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd553d0d-03e2-4233-b06b-b55bbfa2b954+23:6510:x1870854458031488:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1784189006.953284:0:85083:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784189006.953293:0:85083:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dc0755a4800/0xcc1762b626f8a735 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0xcc1762b626f8a72e expref: -99 pid: 85083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189006.953308:0:85083:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dc0755a4800/0xcc1762b626f8a735 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcc1762b626f8a72e expref: 24 pid: 85083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189006.953341:0:85083:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dc0755a4800/0xcc1762b626f8a735 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcc1762b626f8a72e expref: 24 pid: 85083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189006.953350:0:85083:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc0755a4800, rc 0) 00000100:00100000:2.0:1784189006.953396:0:85083:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc07617c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd553d0d-03e2-4233-b06b-b55bbfa2b954+24:6510:x1870854458031488:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 119us (290us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189006.953403:0:85083:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1784189006.953701:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf48599c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458031488:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784189006.953713:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: ffff9dc042d67c00/0xcc1762b626f8a72e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc1762b626f8a735 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189006.953722:0:6510:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: ffff9dc042d67c00/0xcc1762b626f8a72e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0xcc1762b626f8a735 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784189006.953777:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf48599c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458031616:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1784189006.953806:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784189006.953837:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dbf44443cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1784189006.954405:0:85083:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458031616 00000100:00100000:2.0:1784189006.954411:0:85083:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458031616 00000100:00100000:2.0:1784189006.954437:0:85083:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1784189006.954445:0:85083:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc07617d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd553d0d-03e2-4233-b06b-b55bbfa2b954+24:6510:x1870854458031616:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1784189006.954674:0:85083:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc07617d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd553d0d-03e2-4233-b06b-b55bbfa2b954+24:6510:x1870854458031616:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 229us (866us total) trans 0 rc -2/-2 00000100:00100000:2.0:1784189006.954683:0:85083:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1784189006.954962:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf48599c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458031616:0@lo:501:ll_cfg_requeue.0 10000000:01000000:1.0:1784189006.954994:0:6510:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1784189006.955008:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff9dc042d67c00/0xcc1762b626f8a72e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc1762b626f8a735 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189006.955018:0:6510:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: ffff9dc042d67c00/0xcc1762b626f8a72e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc1762b626f8a735 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189007.601596:0:26173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784189007.919568:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1784189007.919600:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc07016fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1870854458031744:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1784189007.919666:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784189007.919714:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458031744 00000100:00100000:2.0:1784189007.919721:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458031744 00000100:00100000:2.0:1784189007.919776:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1840 00000100:00100000:2.0:1784189007.919786:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc07016f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1870854458031744:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1784189007.919815:0:8432:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 214592 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1784189007.919858:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc07016f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1870854458031744:12345-0@lo:13:osp-pre-0-1.0 Request processed in 73us (191us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189007.919865:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1840 00000100:00080000:2.0:1784189007.919886:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1784189007.919921:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc07016fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1870854458031744:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1784189007.920288:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc07016fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1870854458031872:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1784189007.920336:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784189007.920431:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458031872 00000100:00100000:2.0:1784189007.920436:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458031872 00000100:00100000:2.0:1784189007.920476:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1841 00000100:00100000:2.0:1784189007.920483:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf48599c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1870854458031872:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1784189007.920499:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 214592 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1784189007.920532:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf48599c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1870854458031872:12345-0@lo:13:osp-pre-1-1.0 Request processed in 50us (195us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189007.920538:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1841 00000100:00080000:1.0:1784189007.920594:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1784189007.920620:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc07016fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1870854458031872:0@lo:13:osp-pre-1-1.0 00010000:00010000:1.0:1784189008.623854:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1784189008.823854:0:85361:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg312-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:0.0:1784189009.196259:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1784189009.196352:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1784189009.196651:0:85083:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436232704 00000100:00100000:0.0:1784189009.196660:0:85083:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436232704 00000100:00100000:0.0:1784189009.196706:0:85083:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 74 00000100:00100000:0.0:1784189009.196715:0:85083:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc07617f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9957a2dc-fd88-4a91-bca3-e2b7f365ab0c+10:2398:x1870854436232704:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:0.0:1784189009.196788:0:85083:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc07617f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9957a2dc-fd88-4a91-bca3-e2b7f365ab0c+10:2398:x1870854436232704:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 74us (439us total) trans 0 rc 0/0 00000100:00100000:0.0:1784189009.196796:0:85083:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 74 00000100:00100000:3.0:1784189009.197117:0:68287:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436232832 00000100:00100000:3.0:1784189009.197122:0:68287:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436232832 00000100:00100000:3.0:1784189009.197179:0:68287:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 994 00000100:00100000:3.0:1784189009.197187:0:68287:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc081f83100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+6:2398:x1870854436232832:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:3.0:1784189009.197226:0:68287:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc081f83100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+6:2398:x1870854436232832:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 39us (978us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189009.197233:0:68287:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 994 00000100:00080000:3.0:1784189009.197253:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:3.0:1784189009.650414:0:7454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1784189009.675034:0:85413:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1784189009.675297:0:85413:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00080000:2.0:1784189010.479832:0:27065:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1784189010.479839:0:27065:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1784189010.479843:0:27065:0:(import.c:65:import_set_state_nolock()) ffff9dbf42271800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1784189010.479851:0:27065:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3247 00000100:00080000:2.0:1784189010.479855:0:27065:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1784189010.479870:0:27065:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9dbf42271800 using connection 192.168.203.112@tcp/0@lo 00000100:00100000:2.0:1784189010.479895:0:27065:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9dc07016c000 x1870854458032128/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1784189010.479936:0:27065:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1784189010.479939:0:27065:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1784189010.479941:0:27065:0:(import.c:65:import_set_state_nolock()) ffff9dbf425f4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1784189010.479944:0:27065:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3247 00000100:00080000:2.0:1784189010.479947:0:27065:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1784189010.479951:0:27065:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9dbf425f4800 using connection 192.168.203.112@tcp/0@lo 00000100:00100000:2.0:1784189010.479964:0:27065:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9dc07016df80 x1870854458032384/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1784189010.479980:0:27065:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1784189010.479983:0:27065:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1784189010.479984:0:27065:0:(import.c:65:import_set_state_nolock()) ffff9dbf436c4000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1784189010.479987:0:27065:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3247 00000100:00080000:2.0:1784189010.479990:0:27065:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1784189010.479993:0:27065:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9dbf436c4000 using connection 192.168.203.112@tcp/0@lo 00000100:00100000:2.0:1784189010.480005:0:27065:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9dc07016f800 x1870854458032640/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1784189010.480025:0:27065:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1784189010.480028:0:27065:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1784189010.480029:0:27065:0:(import.c:65:import_set_state_nolock()) ffff9dbf43690800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1784189010.480033:0:27065:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3247 00000100:00080000:2.0:1784189010.480035:0:27065:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1784189010.480045:0:27065:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff9dbf43690800 using connection 192.168.203.112@tcp/0@lo 00000100:00100000:2.0:1784189010.480059:0:27065:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9dc06bbf3800 x1870854458033024/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1784189010.480082:0:27065:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1784189010.480085:0:27065:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1784189010.480087:0:27065:0:(import.c:65:import_set_state_nolock()) ffff9dbf46b0c000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1784189010.480091:0:27065:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff9dbf46b0c000 using connection 192.168.203.112@tcp/0@lo 00000100:00100000:2.0:1784189010.480100:0:27065:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9dc06bbf2300 x1870854458033536/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1784189010.480125:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc07016e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1870854458032768:0@lo:400:kworker.0 00000100:00100000:2.0:1784189010.480184:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784189010.480213:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc06bbf1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1870854458033408:0@lo:400:kworker.0 00000100:00100000:2.0:1784189010.480235:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784189010.480261:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1784189010.480267:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc07016d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bd553d0d-03e2-4233-b06b-b55bbfa2b954:3642:1870854458032000:0@lo:400:kworker.0 00000100:00100000:2.0:1784189010.480294:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784189010.480315:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc07016f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1870854458032896:0@lo:400:kworker.0 00000100:00100000:2.0:1784189010.480375:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784189010.480403:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc07016ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3640:1870854458032256:0@lo:400:kworker.0 00000100:00100000:2.0:1784189010.480428:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784189010.480443:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc06bbf0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1870854458033152:0@lo:400:kworker.0 00000100:00100000:2.0:1784189010.480467:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784189010.480483:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1784189010.480489:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc07016fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3640:1870854458032512:0@lo:400:kworker.0 00000100:00100000:2.0:1784189010.480521:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784189010.480538:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc06bbf3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1870854458033280:0@lo:400:kworker.0 00000100:00100000:2.0:1784189010.480557:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784189010.480585:0:26171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458032768 00000100:00100000:2.0:1784189010.480592:0:26171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458032768 00000100:00100000:2.0:1784189010.480635:0:26171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458033408 00000100:00100000:2.0:1784189010.480638:0:26171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458033408 00000100:00100000:2.0:1784189010.480656:0:26171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458032896 00000100:00100000:2.0:1784189010.480659:0:26171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458032896 00000100:00100000:2.0:1784189010.480674:0:26171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458033280 00000100:00100000:2.0:1784189010.480677:0:26171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458033280 00000100:00100000:2.0:1784189010.480696:0:26171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2305 00000100:00100000:2.0:1784189010.480704:0:26171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc06bbf3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0001-mdtlov_UUID+5:3642:x1870854458032768:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784189010.480755:0:26171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc06bbf3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0001-mdtlov_UUID+5:3642:x1870854458032768:12345-0@lo:400:kworker.0 Request processed in 52us (569us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189010.480762:0:26171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2305 00000100:00100000:2.0:1784189010.480777:0:26171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2306 00000100:00100000:2.0:1784189010.480783:0:26171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc06bbf2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+6:3642:x1870854458033408:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784189010.480809:0:26171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc06bbf2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+6:3642:x1870854458033408:12345-0@lo:400:kworker.0 Request processed in 27us (573us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189010.480814:0:26171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2306 00000100:00100000:2.0:1784189010.480825:0:26171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2307 00000100:00100000:2.0:1784189010.480831:0:26171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc06bbf0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0001-mdtlov_UUID+5:3642:x1870854458032896:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784189010.480856:0:26171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc06bbf0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0001-mdtlov_UUID+5:3642:x1870854458032896:12345-0@lo:400:kworker.0 Request processed in 26us (481us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189010.480862:0:26171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2307 00000100:00100000:2.0:1784189010.480872:0:26171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2308 00000100:00100000:2.0:1784189010.480886:0:26171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc06bbf0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+6:3640:x1870854458033280:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784189010.480917:0:26171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc06bbf0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+6:3640:x1870854458033280:12345-0@lo:400:kworker.0 Request processed in 33us (359us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189010.480924:0:26171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2308 00000100:00100000:2.0:1784189010.480947:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458033152 00000100:00100000:2.0:1784189010.480951:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458033152 00000100:00100000:2.0:1784189010.480977:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3700 00000100:00100000:2.0:1784189010.480983:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc06bbf2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3640:x1870854458033152:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784189010.481014:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc06bbf2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3640:x1870854458033152:12345-0@lo:400:kworker.0 Request processed in 31us (545us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189010.481020:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3700 00000100:00100000:2.0:1784189010.481038:0:66945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458032256 00000100:00100000:2.0:1784189010.481041:0:66945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458032256 00000100:00100000:2.0:1784189010.481063:0:66945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458032512 00000100:00100000:2.0:1784189010.481066:0:66945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458032512 00000100:00100000:2.0:1784189010.481085:0:66945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 995 00000100:00100000:2.0:1784189010.481092:0:66945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc06bbf1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1870854458032256:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784189010.481119:0:66945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc06bbf1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1870854458032256:12345-0@lo:400:kworker.0 Request processed in 28us (691us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189010.481126:0:66945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 995 00000100:00100000:2.0:1784189010.481136:0:66945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 996 00000100:00100000:2.0:1784189010.481142:0:66945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc06bbf2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1870854458032512:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784189010.481168:0:66945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc06bbf2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1870854458032512:12345-0@lo:400:kworker.0 Request processed in 26us (646us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189010.481174:0:66945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 996 00000100:00100000:2.0:1784189010.481228:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc07016fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3640:1870854458032512:0@lo:400:kworker.0 00000100:00100000:2.0:1784189010.481252:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc06bbf3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1870854458033280:0@lo:400:kworker.0 00000100:00100000:2.0:1784189010.481262:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc07016ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3640:1870854458032256:0@lo:400:kworker.0 00000100:00100000:2.0:1784189010.481271:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc06bbf0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1870854458033152:0@lo:400:kworker.0 00000100:00100000:2.0:1784189010.481304:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc07016f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1870854458032896:0@lo:400:kworker.0 00000100:00100000:2.0:1784189010.481314:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc07016e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1870854458032768:0@lo:400:kworker.0 00000100:00100000:2.0:1784189010.481349:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc06bbf1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1870854458033408:0@lo:400:kworker.0 00000100:00100000:3.0:1784189010.481506:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc07016c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3639:1870854458032128:0@lo:38:kworker.0 00000100:00100000:3.0:1784189010.481537:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784189010.481564:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc07016df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3639:1870854458032384:0@lo:38:kworker.0 00000100:00100000:3.0:1784189010.481585:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784189010.481611:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc07016f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3639:1870854458032640:0@lo:38:kworker.0 00000100:00100000:3.0:1784189010.481634:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784189010.481650:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc06bbf3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3639:1870854458033024:0@lo:38:kworker.0 00000100:00100000:3.0:1784189010.481671:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784189010.481680:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc06bbf2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3639:1870854458033536:0@lo:38:kworker.0 00000100:00100000:3.0:1784189010.481700:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784189010.481723:0:85084:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458032000 00000100:00100000:3.0:1784189010.481727:0:85084:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458032000 00000100:00100000:3.0:1784189010.481758:0:85084:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1784189010.481765:0:85084:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc07138c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd553d0d-03e2-4233-b06b-b55bbfa2b954+24:3642:x1870854458032000:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784189010.481799:0:85084:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc07138c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd553d0d-03e2-4233-b06b-b55bbfa2b954+24:3642:x1870854458032000:12345-0@lo:400:kworker.0 Request processed in 35us (1504us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189010.481806:0:85084:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1784189010.481835:0:66170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458032128 00000100:00100000:3.0:1784189010.481839:0:66170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458032128 00000100:00100000:3.0:1784189010.481850:0:66170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458032384 00000100:00100000:3.0:1784189010.481852:0:66170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458032384 00000100:00100000:3.0:1784189010.481859:0:66170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458033024 00000100:00100000:3.0:1784189010.481861:0:66170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458033024 00000100:00100000:3.0:1784189010.481868:0:66170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458033536 00000100:00100000:3.0:1784189010.481871:0:66170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458033536 00000100:00100000:3.0:1784189010.481881:0:66170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1059 00000100:00100000:3.0:1784189010.481885:0:66170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf44bc0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3639:x1870854458032128:12345-0@lo:38:kworker.0 00010000:00080000:3.0:1784189010.481906:0:66170:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo recovering/t0 exp 0000000000000000 cur 3252 last 0 00000020:00000080:3.0:1784189010.481955:0:66170:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0xcc1762b626f8a73c 00000004:00100000:3.0:1784189010.481969:0:66170:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1784189010.482094:0:66170:0:(import.c:65:import_set_state_nolock()) ffff9dc04ba07800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1784189010.482139:0:66170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf44bc0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1870854458032128:12345-0@lo:38:kworker.0 Request processed in 251us (600us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189010.482145:0:66170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1059 00000100:00100000:3.0:1784189010.482869:0:66170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1060 00000100:00100000:3.0:1784189010.482877:0:66170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf44bc3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3639:x1870854458032384:12345-0@lo:38:kworker.0 00010000:00080000:3.0:1784189010.482898:0:66170:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo recovering/t0 exp 0000000000000000 cur 3252 last 0 00000020:00000080:3.0:1784189010.482929:0:66170:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0xcc1762b626f8a743 00000004:00100000:3.0:1784189010.482939:0:66170:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1784189010.482961:0:66170:0:(import.c:65:import_set_state_nolock()) ffff9dc07118c000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1784189010.483003:0:66170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf44bc3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3639:x1870854458032384:12345-0@lo:38:kworker.0 Request processed in 125us (1416us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189010.483010:0:66170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1060 00000100:00100000:3.0:1784189010.483027:0:66170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1061 00000100:00100000:3.0:1784189010.483032:0:66170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf44bc2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3639:x1870854458033024:12345-0@lo:38:kworker.0 00010000:00080000:3.0:1784189010.483045:0:66170:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0001_UUID@0@lo recovering/t0 exp 0000000000000000 cur 3252 last 0 00000020:00000080:3.0:1784189010.483067:0:66170:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001_UUID, cookie 0xcc1762b626f8a74a 00000004:00100000:3.0:1784189010.483073:0:66170:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1784189010.483087:0:66170:0:(import.c:65:import_set_state_nolock()) ffff9dc075653800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1784189010.483116:0:66170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf44bc2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1870854458033024:12345-0@lo:38:kworker.0 Request processed in 83us (1445us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189010.483123:0:66170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1061 00000100:00100000:3.0:1784189010.483137:0:66170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1062 00000100:00100000:3.0:1784189010.483141:0:66170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf44acb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3639:x1870854458033536:12345-0@lo:38:kworker.0 00010000:00080000:3.0:1784189010.483156:0:66170:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo recovering/t0 exp 0000000000000000 cur 3252 last 0 00000020:00000080:3.0:1784189010.483180:0:66170:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0xcc1762b626f8a751 00000004:00100000:3.0:1784189010.483192:0:66170:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1784189010.483206:0:66170:0:(import.c:65:import_set_state_nolock()) ffff9dbf436c4800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1784189010.483236:0:66170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf44acb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1870854458033536:12345-0@lo:38:kworker.0 Request processed in 93us (1535us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189010.483242:0:66170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1062 00000100:00080000:3.0:1784189010.483265:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1784189010.483270:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1784189010.483273:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1784189010.483290:0:23826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458032640 00000100:00100000:3.0:1784189010.483295:0:23826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458032640 00000100:00100000:3.0:1784189010.483332:0:23826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3701 00000100:00100000:3.0:1784189010.483337:0:23826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf44bc2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3639:x1870854458032640:12345-0@lo:38:kworker.0 00010000:00080000:3.0:1784189010.483351:0:23826:0:(ldlm_lib.c:938:target_handle_reconnect()) connect export for UUID 'lustre-MDT0001-mdtlov_UUID' at ffff9dc06b3ef800, cookie 0xcc1762b626f8a5c2 00010000:00080000:3.0:1784189010.483367:0:23826:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo recovering/t77309411356 exp ffff9dc06b3ef800 cur 3252 last 1784189004 00000004:00100000:3.0:1784189010.483376:0:23826:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1784189010.483390:0:23826:0:(import.c:65:import_set_state_nolock()) ffff9dbf436c2000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1784189010.483428:0:23826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf44bc2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3639:x1870854458032640:12345-0@lo:38:kworker.0 Request processed in 89us (1792us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189010.483434:0:23826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3701 00000100:00100000:2.0:1784189010.483687:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc07016d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bd553d0d-03e2-4233-b06b-b55bbfa2b954:3642:1870854458032000:0@lo:400:kworker.0 00010000:00080000:2.0:1784189010.483730:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dc07016c000 x1870854458032128/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1784189035 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1784189010.483744:0:3639:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 23 00000100:00080000:2.0:1784189010.484600:0:3639:0:(import.c:1328:ptlrpc_connect_interpret()) @@@ lustre-MDT0000-lwp-OST0000: lwp recover req@ffff9dc07016c000 x1870854458032128/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1784189035 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1784189010.484610:0:3639:0:(import.c:65:import_set_state_nolock()) ffff9dbf42271800 lustre-MDT0000_UUID: changing import state from CONNECTING to RECOVER 00000100:00080000:2.0:1784189010.484614:0:3639:0:(import.c:65:import_set_state_nolock()) ffff9dbf42271800 lustre-MDT0000_UUID: changing import state from RECOVER to FULL 00000100:02000000:2.0:1784189010.484618:0:3639:0:(import.c:1743:ptlrpc_import_recovery_state_machine()) lustre-MDT0000-lwp-OST0000: Connection restored to 0@lo (at 0@lo) 00000100:00100000:2.0:1784189010.484623:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc07016c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3639:1870854458032128:0@lo:38:kworker.0 00010000:00080000:2.0:1784189010.484644:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dc07016df80 x1870854458032384/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1784189035 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1784189010.484656:0:3639:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 23 00000100:00100000:0.0:1784189010.485900:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1784189010.485920:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc081f82680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1870854458033664:0@lo:41:osp-pre-1-0.0 00010000:00080000:3.0:1784189010.485957:0:85110:0:(ldlm_lib.c:2545:check_for_recovery_ready()) connected 2 stale 0 max_recoverable_clients 2 abort 0 expired 0 00010000:00080000:3.0:1784189010.485966:0:85110:0:(ldlm_lib.c:2683:replay_request_or_update()) Waiting for transno 94489280514 00000020:00080000:3.0:1784189010.485974:0:85110:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1784189010.485979:0:85110:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 2, connected: 2, completed: 0, queue_len: 1, req_transno: 94489280514, next_transno: 94489280514 00010000:00080000:3.0:1784189010.485984:0:85110:0:(ldlm_lib.c:2246:check_for_next_transno()) waking for next (94489280514) 00000100:00100000:0.0:1784189010.485986:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00080000:3.0:1784189010.485991:0:85110:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1784189010.486006:0:85110:0:(ldlm_lib.c:2747:replay_request_or_update()) @@@ processing x1870854436224512 t94489280514 from 192.168.203.12@tcp req@ffff9dbf44bc0700 x1870854436224512/t0(94489280514) o36->b90fcc1c-0e69-42a4-a116-a71fec7aeb78@192.168.203.12@tcp:197/0 lens 528/0 e 0 to 0 dl 1784189017 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'mcreate.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1784189010.488255:0:3639:0:(import.c:1328:ptlrpc_connect_interpret()) @@@ lustre-MDT0000-lwp-OST0001: lwp recover req@ffff9dc07016df80 x1870854458032384/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1784189035 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1784189010.488282:0:3639:0:(import.c:65:import_set_state_nolock()) ffff9dbf425f4800 lustre-MDT0000_UUID: changing import state from CONNECTING to RECOVER 00000100:00080000:2.0:1784189010.488287:0:3639:0:(import.c:65:import_set_state_nolock()) ffff9dbf425f4800 lustre-MDT0000_UUID: changing import state from RECOVER to FULL 00000100:02000000:2.0:1784189010.488291:0:3639:0:(import.c:1743:ptlrpc_import_recovery_state_machine()) lustre-MDT0000-lwp-OST0001: Connection restored to 0@lo (at 0@lo) 00000100:00100000:2.0:1784189010.488297:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc07016df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3639:1870854458032384:0@lo:38:kworker.0 00000100:00100000:2.0:1784189010.488758:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458033664 00000100:00100000:2.0:1784189010.488766:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458033664 00000100:00100000:2.0:1784189010.488816:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3702 00000100:00100000:2.0:1784189010.488825:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc081f81f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3642:x1870854458033664:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1784189010.488860:0:8439:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445576704 avail 1299337216 00000100:00100000:2.0:1784189010.489161:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc081f81f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3642:x1870854458033664:12345-0@lo:41:osp-pre-1-0.0 Request processed in 335us (3176us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189010.489170:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3702 00000100:00100000:2.0:1784189010.489217:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc081f82680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1870854458033664:0@lo:41:osp-pre-1-0.0 00000100:00080000:2.0:1784189010.489424:0:3639:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-osp-MDT0001: connect to target with instance 23 00000100:00080000:2.0:1784189010.489436:0:3639:0:(import.c:65:import_set_state_nolock()) ffff9dbf436c4000 lustre-MDT0000_UUID: changing import state from CONNECTING to REPLAY 00000100:00080000:2.0:1784189010.489441:0:3639:0:(import.c:1700:ptlrpc_import_recovery_state_machine()) replay requested by lustre-MDT0000_UUID 00000100:00100000:2.0:1784189010.489443:0:3639:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 81604378625 gen 3 00000100:00080000:2.0:1784189010.489447:0:3639:0:(recover.c:53:ptlrpc_replay_next()) import ffff9dbf436c4000 from lustre-MDT0000_UUID committed 81604378625 last 0 00000100:00080000:2.0:1784189010.489450:0:3639:0:(import.c:65:import_set_state_nolock()) ffff9dbf436c4000 lustre-MDT0000_UUID: changing import state from REPLAY to REPLAY_LOCKS 00000004:00080000:3.0:1784189010.489795:0:85110:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 3710us 00000100:00100000:3.0:1784189010.489919:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc07016f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3639:1870854458032640:0@lo:38:kworker.0 00010000:00080000:3.0:1784189010.489943:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dc06bbf3800 x1870854458033024/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1784189035 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1784189010.489955:0:3639:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0001: connect to target with instance 23 00000100:00080000:3.0:1784189010.492234:0:3639:0:(import.c:1328:ptlrpc_connect_interpret()) @@@ lustre-MDT0000-lwp-MDT0001: lwp recover req@ffff9dc06bbf3800 x1870854458033024/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1784189035 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1784189010.492247:0:3639:0:(import.c:65:import_set_state_nolock()) ffff9dbf43690800 lustre-MDT0000_UUID: changing import state from CONNECTING to RECOVER 00000100:00080000:3.0:1784189010.492252:0:3639:0:(import.c:65:import_set_state_nolock()) ffff9dbf43690800 lustre-MDT0000_UUID: changing import state from RECOVER to FULL 00000100:02000000:3.0:1784189010.492257:0:3639:0:(import.c:1743:ptlrpc_import_recovery_state_machine()) lustre-MDT0000-lwp-MDT0001: Connection restored to 0@lo (at 0@lo) 00000100:00100000:3.0:1784189010.492263:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc06bbf3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3639:1870854458033024:0@lo:38:kworker.0 00010000:00080000:3.0:1784189010.492293:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dc06bbf2300 x1870854458033536/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1784189020 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1784189010.492308:0:3639:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 23 00000100:00080000:3.0:1784189010.492315:0:3639:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:3.0:1784189010.496417:0:3639:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1784189010.496424:0:3639:0:(import.c:65:import_set_state_nolock()) ffff9dbf46b0c000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1784189010.496438:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc06bbf2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3639:1870854458033536:0@lo:38:kworker.0 00010000:00080000:3.0:1784189010.496540:0:85453:0:(ldlm_request.c:2972:ldlm_lock_replay_thread()) lock replay thread lustre-MDT0000-osp-MDT0001 to lustre-MDT0000_UUID@0@lo 00010000:00010000:3.0:1784189010.496545:0:85453:0:(ldlm_request.c:2888:ldlm_cancel_unused_locks_for_replay()) Dropping as many unused locks as possible before replay for namespace lustre-MDT0000-osp-MDT0001 (0) 00010000:00010000:3.0:1784189010.496550:0:85453:0:(ldlm_request.c:2901:ldlm_cancel_unused_locks_for_replay()) Canceled 0 unused locks from namespace lustre-MDT0000-osp-MDT0001 00000100:00080000:3.0:1784189010.497035:0:85453:0:(import.c:65:import_set_state_nolock()) ffff9dbf436c4000 lustre-MDT0000_UUID: changing import state from REPLAY_LOCKS to REPLAY_WAIT 00000001:00100000:3.0:1784189010.497081:0:75588:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:3.0:1784189010.497130:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc05659df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3639:1870854458033792:0@lo:400:ldlm_lock_repla.0 00000100:00100000:3.0:1784189010.497199:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784189010.497248:0:23826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458033792 00000100:00100000:3.0:1784189010.497255:0:23826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458033792 00000100:00100000:3.0:1784189010.497303:0:23826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3703 00000100:00100000:3.0:1784189010.497312:0:23826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc05653a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3639:x1870854458033792:12345-0@lo:400:ldlm_lock_repla.0 00010000:00080000:3.0:1784189010.497351:0:23826:0:(ldlm_lib.c:3137:target_queue_recovery_request()) @@@ queue final req req@ffff9dc05653a300 x1870854458033792/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:201/0 lens 224/0 e 0 to 0 dl 1784189021 ref 2 fl Interpret:/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784189010.497377:0:23826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc05653a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3639:x1870854458033792:12345-0@lo:400:ldlm_lock_repla.0 Request processed in 67us (178us total) trans 0 rc 0/-999 00000100:00100000:3.0:1784189010.497385:0:23826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3703 00010000:00010000:0.0:1784189010.513563:0:85110:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc070147e00/0xcc1762b626f8a758 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 85110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189010.513594:0:85110:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc070147e00/0xcc1762b626f8a758 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 85110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189010.513609:0:85110:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc070147e00/0xcc1762b626f8a758 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 85110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189010.513621:0:85110:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc070147800/0xcc1762b626f8a75f lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x21e7de2f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 85110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189010.513627:0:85110:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc070147800/0xcc1762b626f8a75f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x21e7de2f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 85110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189010.513632:0:85110:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc070147800/0xcc1762b626f8a75f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x21e7de2f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 85110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189010.514196:0:85110:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc070147e00/0xcc1762b626f8a758 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 85110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189010.514206:0:85110:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc070147e00/0xcc1762b626f8a758 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 85110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189010.514214:0:85110:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dc070147e00/0xcc1762b626f8a758 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 85110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189010.514220:0:85110:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc070147e00 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:0.0:1784189010.514225:0:85110:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc070147e00/0xcc1762b626f8a758 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 85110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189010.514232:0:85110:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc070147e00/0xcc1762b626f8a758 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 85110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189010.514244:0:85110:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9dc056eaa700) 00010000:00010000:0.0:1784189010.514253:0:85110:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784189010.514258:0:85110:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dc070147e00/0xcc1762b626f8a758 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 85110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189010.514265:0:85110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc070147e00/0xcc1762b626f8a758 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 85110 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1784189010.514282:0:85110:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000003266d190 reply state 0000000044bdb511 transno 94489280514 ns: mdt-lustre-MDT0000_UUID lock: ffff9dc070147800/0xcc1762b626f8a75f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x21e7de2f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 85110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189010.514293:0:85110:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc070147800/0xcc1762b626f8a75f lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x21e7de2f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 85110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189010.514300:0:85110:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x21e7de2f (ffff9dc056eaa800) 00010000:00010000:0.0:1784189010.514303:0:85110:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1784189010.514305:0:85110:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:0.0:1784189010.515003:0:85110:0:(ldlm_lib.c:2100:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 101 seconds 00000020:00080000:0.0:1784189010.515024:0:85110:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:0.0:1784189010.515028:0:85110:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 94489280515 00000020:00080000:0.0:1784189010.515032:0:85110:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:0.0:1784189010.515034:0:85110:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 94489280515 00000100:00100000:0.0:1784189010.519306:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1784189010.519580:0:66170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436225024 00000100:00100000:2.0:1784189010.519589:0:66170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436225024 00000100:00100000:2.0:1784189010.519657:0:66170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1063 00000100:00100000:2.0:1784189010.519669:0:66170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc081f82680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+8:2395:x1870854436225024:12345-192.168.203.12@tcp:36:rm.0 00010000:00080000:2.0:1784189010.519688:0:66170:0:(ldlm_lib.c:3228:target_queue_recovery_request()) Next recovery transno: 94489280515, current: 94489280515, replaying 00000100:00100000:2.0:1784189010.519713:0:66170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc081f82680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+8:2395:x1870854436225024:12345-192.168.203.12@tcp:36:rm.0 Request processed in 47us (414us total) trans 0 rc 0/-999 00000100:00100000:2.0:1784189010.519721:0:66170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1063 00000020:00080000:1.0:1784189010.519810:0:85110:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1784189010.519815:0:85110:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 94489280515, next_transno: 94489280515 00010000:00080000:1.0:1784189010.519820:0:85110:0:(ldlm_lib.c:2246:check_for_next_transno()) waking for next (94489280515) 00000020:00080000:1.0:1784189010.519824:0:85110:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1784189010.519834:0:85110:0:(ldlm_lib.c:2747:replay_request_or_update()) @@@ processing x1870854436225024 t94489280515 from 192.168.203.12@tcp req@ffff9dc081f82680 x1870854436225024/t0(94489280515) o36->b90fcc1c-0e69-42a4-a116-a71fec7aeb78@192.168.203.12@tcp:201/0 lens 512/0 e 0 to 0 dl 1784189021 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'rm.0' uid:0 gid:0 projid:4294967295 00010000:00010000:1.0:1784189010.519916:0:85110:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc042d67400/0xcc1762b626f8a766 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 85110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189010.519932:0:85110:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc042d67400/0xcc1762b626f8a766 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 85110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189010.519944:0:85110:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc042d67400/0xcc1762b626f8a766 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 85110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189010.519968:0:85110:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc042d67a00/0xcc1762b626f8a76d lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x21e7de2f bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 85110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189010.519977:0:85110:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc042d67a00/0xcc1762b626f8a76d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x21e7de2f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 85110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189010.519985:0:85110:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc042d67a00/0xcc1762b626f8a76d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x21e7de2f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 85110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189010.520072:0:85110:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc042d66e00/0xcc1762b626f8a774 lrc: 3/0,1 mode: --/EX res: [0x20000a811:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 85110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189010.520082:0:85110:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc042d66e00/0xcc1762b626f8a774 lrc: 3/0,1 mode: EX/EX res: [0x20000a811:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 85110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189010.520089:0:85110:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc042d66e00/0xcc1762b626f8a774 lrc: 3/0,1 mode: EX/EX res: [0x20000a811:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 85110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189010.520295:0:85110:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc042d66e00/0xcc1762b626f8a774 lrc: 3/0,1 mode: EX/EX res: [0x20000a811:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 85110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189010.520304:0:85110:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc042d66e00/0xcc1762b626f8a774 lrc: 2/0,0 mode: EX/EX res: [0x20000a811:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 85110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189010.520310:0:85110:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dc042d66e00/0xcc1762b626f8a774 lrc: 3/0,0 mode: EX/EX res: [0x20000a811:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 85110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189010.522050:0:85110:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc042d66e00 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:1.0:1784189010.522063:0:85110:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc042d66e00/0xcc1762b626f8a774 lrc: 3/0,0 mode: EX/EX res: [0x20000a811:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 85110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189010.522076:0:85110:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc042d66e00/0xcc1762b626f8a774 lrc: 4/0,0 mode: EX/EX res: [0x20000a811:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 85110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189010.522100:0:85110:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x1:0x0].0x0 (ffff9dbf44e2ac00) 00010000:00010000:1.0:1784189010.522103:0:85110:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1784189010.522107:0:85110:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dc042d66e00/0xcc1762b626f8a774 lrc: 2/0,0 mode: --/EX res: [0x20000a811:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 85110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189010.522114:0:85110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc042d66e00/0xcc1762b626f8a774 lrc: 0/0,0 mode: --/EX res: [0x20000a811:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 85110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189010.522142:0:85110:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc042d67400/0xcc1762b626f8a766 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 85110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189010.522149:0:85110:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc042d67400/0xcc1762b626f8a766 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 85110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189010.522155:0:85110:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dc042d67400/0xcc1762b626f8a766 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 85110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189010.522161:0:85110:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc042d67400 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:1.0:1784189010.522163:0:85110:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc042d67400/0xcc1762b626f8a766 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 85110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189010.522169:0:85110:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc042d67400/0xcc1762b626f8a766 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 85110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189010.522176:0:85110:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9dbf44e2a100) 00010000:00010000:1.0:1784189010.522178:0:85110:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784189010.522181:0:85110:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dc042d67400/0xcc1762b626f8a766 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 85110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189010.522187:0:85110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc042d67400/0xcc1762b626f8a766 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 85110 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1784189010.522684:0:85110:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000874ad7ad reply state 000000004c889b3f transno 94489280515 ns: mdt-lustre-MDT0000_UUID lock: ffff9dc042d67a00/0xcc1762b626f8a76d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x21e7de2f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 85110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189010.522699:0:85110:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc042d67a00/0xcc1762b626f8a76d lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x21e7de2f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 85110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189010.522707:0:85110:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x21e7de2f (ffff9dc056eaa800) 00010000:00010000:1.0:1784189010.522709:0:85110:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1784189010.522712:0:85110:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:0.0:1784189010.522982:0:85110:0:(ldlm_lib.c:2100:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:0.0:1784189010.523005:0:85110:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:0.0:1784189010.523008:0:85110:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 94489280516 00000020:00080000:0.0:1784189010.523013:0:85110:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:0.0:1784189010.523015:0:85110:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 94489280516 00000100:00100000:1.0:1784189010.533959:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1784189010.533998:0:68287:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436226176 00000100:00100000:1.0:1784189010.534007:0:68287:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436226176 00000100:00100000:1.0:1784189010.534060:0:68287:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1064 00000100:00100000:1.0:1784189010.534070:0:68287:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf4859b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+10:2395:x1870854436226176:12345-192.168.203.12@tcp:101:lfs.0 00010000:00080000:1.0:1784189010.534089:0:68287:0:(ldlm_lib.c:3228:target_queue_recovery_request()) Next recovery transno: 94489280516, current: 94489280516, replaying 00000100:00100000:1.0:1784189010.534103:0:68287:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf4859b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+10:2395:x1870854436226176:12345-192.168.203.12@tcp:101:lfs.0 Request processed in 35us (153us total) trans 0 rc 0/-999 00000100:00100000:1.0:1784189010.534110:0:68287:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1064 00000020:00080000:1.0:1784189010.534128:0:85110:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1784189010.534132:0:85110:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 94489280516, next_transno: 94489280516 00010000:00080000:1.0:1784189010.534136:0:85110:0:(ldlm_lib.c:2246:check_for_next_transno()) waking for next (94489280516) 00000020:00080000:1.0:1784189010.534138:0:85110:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1784189010.534147:0:85110:0:(ldlm_lib.c:2747:replay_request_or_update()) @@@ processing x1870854436226176 t94489280516 from 192.168.203.12@tcp req@ffff9dbf4859b100 x1870854436226176/t0(94489280516) o101->b90fcc1c-0e69-42a4-a116-a71fec7aeb78@192.168.203.12@tcp:201/0 lens 536/0 e 0 to 0 dl 1784189021 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00010000:00010000:1.0:1784189010.534168:0:85110:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784189010.534191:0:85110:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc042d67600/0xcc1762b626f8a77b lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbfc5de7fe6c3cb9 expref: -99 pid: 85110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189010.534506:0:85110:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0565e6200/0xcc1762b626f8a782 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 85110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189010.534520:0:85110:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0565e6200/0xcc1762b626f8a782 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 85110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189010.534531:0:85110:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0565e6200/0xcc1762b626f8a782 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 85110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189010.534543:0:85110:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0565e6400/0xcc1762b626f8a789 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 85110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189010.534549:0:85110:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0565e6400/0xcc1762b626f8a789 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 85110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189010.534555:0:85110:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0565e6400/0xcc1762b626f8a789 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 85110 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784189010.535476:0:85110:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000a811:0x2:0x0]: returning size 0 00000004:00080000:0.0:1784189010.535500:0:85110:0:(mdt_open.c:504:mdt_mfd_open()) orphan mfd not found, fid = [0x20000a811:0x2:0x0], cookie = 0xcc1762b626f8a4fe 00000004:00080000:0.0:1784189010.535502:0:85110:0:(mdt_open.c:508:mdt_mfd_open()) Store old cookie 0xcc1762b626f8a4fe in new mfd 00010000:00010000:0.0:1784189010.535522:0:85110:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0565e6200/0xcc1762b626f8a782 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 85110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189010.535530:0:85110:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0565e6200/0xcc1762b626f8a782 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 85110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189010.535536:0:85110:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0565e6200/0xcc1762b626f8a782 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 85110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189010.535542:0:85110:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc0565e6200 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:0.0:1784189010.535546:0:85110:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0565e6200/0xcc1762b626f8a782 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 85110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189010.535552:0:85110:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0565e6200/0xcc1762b626f8a782 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 85110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189010.535565:0:85110:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9dbf44e2a700) 00010000:00010000:0.0:1784189010.535568:0:85110:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784189010.535572:0:85110:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0565e6200/0xcc1762b626f8a782 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 85110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189010.535578:0:85110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0565e6200/0xcc1762b626f8a782 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 85110 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1784189010.535591:0:85110:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000ba5184ed reply state 0000000060caf2a6 transno 94489280516 ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0565e6400/0xcc1762b626f8a789 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 85110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189010.535602:0:85110:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0565e6400/0xcc1762b626f8a789 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 85110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189010.535608:0:85110:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xed1d29cb (ffff9dbf44e2af00) 00010000:00010000:0.0:1784189010.535610:0:85110:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1784189010.535618:0:85110:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1784189010.535647:0:85110:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc042d67600/0xcc1762b626f8a77b lrc: 1/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c3cb9 expref: 12 pid: 85110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189010.535657:0:85110:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9dbf44e2a700) 00010000:00010000:0.0:1784189010.535659:0:85110:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784189010.535663:0:85110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc042d67600/0xcc1762b626f8a77b lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c3cb9 expref: 12 pid: 85110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189010.535680:0:85110:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc042d67600, rc 0) 00010000:00080000:0.0:1784189010.535850:0:85110:0:(ldlm_lib.c:2100:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:0.0:1784189010.535869:0:85110:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:0.0:1784189010.535872:0:85110:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 94489280517 00000020:00080000:0.0:1784189010.535876:0:85110:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:0.0:1784189010.535879:0:85110:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 94489280517 00000100:00100000:3.0:1784189010.569674:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1784189010.569987:0:66945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436226432 00000100:00100000:0.0:1784189010.569996:0:66945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436226432 00000100:00100000:0.0:1784189010.570058:0:66945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1065 00000100:00100000:0.0:1784189010.570068:0:66945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc056ead500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+12:2395:x1870854436226432:12345-192.168.203.12@tcp:101:lfs.0 00010000:00080000:0.0:1784189010.570090:0:66945:0:(ldlm_lib.c:3228:target_queue_recovery_request()) Next recovery transno: 94489280517, current: 94489280517, replaying 00000100:00100000:0.0:1784189010.570111:0:66945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc056ead500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+12:2395:x1870854436226432:12345-192.168.203.12@tcp:101:lfs.0 Request processed in 46us (447us total) trans 0 rc 0/-999 00000100:00100000:0.0:1784189010.570118:0:66945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1065 00000020:00080000:1.0:1784189010.570172:0:85110:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1784189010.570176:0:85110:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 94489280517, next_transno: 94489280517 00010000:00080000:1.0:1784189010.570180:0:85110:0:(ldlm_lib.c:2246:check_for_next_transno()) waking for next (94489280517) 00000020:00080000:1.0:1784189010.570183:0:85110:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1784189010.570192:0:85110:0:(ldlm_lib.c:2747:replay_request_or_update()) @@@ processing x1870854436226432 t94489280517 from 192.168.203.12@tcp req@ffff9dc056ead500 x1870854436226432/t0(94489280517) o101->b90fcc1c-0e69-42a4-a116-a71fec7aeb78@192.168.203.12@tcp:201/0 lens 736/0 e 0 to 0 dl 1784189021 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00010000:00010000:1.0:1784189010.570215:0:85110:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784189010.570236:0:85110:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0565e7c00/0xcc1762b626f8a797 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbfc5de7fe6c3cc0 expref: -99 pid: 85110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784189010.570364:0:85110:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000a811:0x2:0x0]: returning size 0 00000004:00080000:1.0:1784189010.570648:0:85110:0:(mdt_open.c:504:mdt_mfd_open()) orphan mfd not found, fid = [0x20000a811:0x2:0x0], cookie = 0xcc1762b626f8a513 00000004:00080000:1.0:1784189010.570652:0:85110:0:(mdt_open.c:508:mdt_mfd_open()) Store old cookie 0xcc1762b626f8a513 in new mfd 00010000:00010000:1.0:1784189010.570688:0:85110:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0565e7c00/0xcc1762b626f8a797 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c3cc0 expref: 14 pid: 85110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189010.570703:0:85110:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9dbf44e2a100) 00010000:00010000:1.0:1784189010.570706:0:85110:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1784189010.570711:0:85110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0565e7c00/0xcc1762b626f8a797 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c3cc0 expref: 14 pid: 85110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189010.570729:0:85110:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc0565e7c00, rc 0) 00010000:00080000:1.0:1784189010.570804:0:85110:0:(ldlm_lib.c:2100:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:1.0:1784189010.570819:0:85110:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1784189010.570822:0:85110:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 94489280518 00000020:00080000:1.0:1784189010.570826:0:85110:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1784189010.570829:0:85110:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 94489280518 00000100:00100000:1.0:1784189010.577876:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1784189010.577959:0:66172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436226816 00000100:00100000:2.0:1784189010.577968:0:66172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436226816 00000100:00100000:2.0:1784189010.578025:0:66172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 215 00000100:00100000:2.0:1784189010.578036:0:66172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf48599880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+13:2395:x1870854436226816:12345-192.168.203.12@tcp:35:lfs.0 00010000:00080000:2.0:1784189010.578055:0:66172:0:(ldlm_lib.c:3228:target_queue_recovery_request()) Next recovery transno: 94489280518, current: 94489280518, replaying 00000100:00100000:2.0:1784189010.578079:0:66172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf48599880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+13:2395:x1870854436226816:12345-192.168.203.12@tcp:35:lfs.0 Request processed in 46us (212us total) trans 0 rc 0/-999 00000100:00100000:2.0:1784189010.578087:0:66172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 215 00000020:00080000:3.0:1784189010.578146:0:85110:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1784189010.578151:0:85110:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 94489280518, next_transno: 94489280518 00010000:00080000:3.0:1784189010.578156:0:85110:0:(ldlm_lib.c:2246:check_for_next_transno()) waking for next (94489280518) 00000020:00080000:3.0:1784189010.578159:0:85110:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1784189010.578171:0:85110:0:(ldlm_lib.c:2747:replay_request_or_update()) @@@ processing x1870854436226816 t94489280518 from 192.168.203.12@tcp req@ffff9dbf48599880 x1870854436226816/t0(94489280518) o35->b90fcc1c-0e69-42a4-a116-a71fec7aeb78@192.168.203.12@tcp:201/0 lens 392/0 e 0 to 0 dl 1784189021 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00010000:00080000:3.0:1784189010.578460:0:85110:0:(ldlm_lib.c:2100:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:3.0:1784189010.578476:0:85110:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1784189010.578479:0:85110:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 94489280519 00000020:00080000:3.0:1784189010.578482:0:85110:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1784189010.578485:0:85110:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 94489280519 00000100:00100000:1.0:1784189010.587418:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1784189010.587610:0:66172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436227072 00000100:00100000:2.0:1784189010.587620:0:66172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436227072 00000100:00100000:2.0:1784189010.587815:0:66172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 216 00000100:00100000:2.0:1784189010.587827:0:66172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc045a5d050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+14:2395:x1870854436227072:12345-192.168.203.12@tcp:35:lfs.0 00010000:00080000:2.0:1784189010.587848:0:66172:0:(ldlm_lib.c:3228:target_queue_recovery_request()) Next recovery transno: 94489280519, current: 94489280519, replaying 00000100:00100000:2.0:1784189010.587865:0:66172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc045a5d050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+14:2395:x1870854436227072:12345-192.168.203.12@tcp:35:lfs.0 Request processed in 41us (457us total) trans 0 rc 0/-999 00000100:00100000:2.0:1784189010.587872:0:66172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 216 00000020:00080000:2.0:1784189010.591829:0:85110:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1784189010.591838:0:85110:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 94489280519, next_transno: 94489280519 00010000:00080000:2.0:1784189010.591844:0:85110:0:(ldlm_lib.c:2246:check_for_next_transno()) waking for next (94489280519) 00000020:00080000:2.0:1784189010.591848:0:85110:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1784189010.591861:0:85110:0:(ldlm_lib.c:2747:replay_request_or_update()) @@@ processing x1870854436227072 t94489280519 from 192.168.203.12@tcp req@ffff9dc045a5d050 x1870854436227072/t0(94489280519) o35->b90fcc1c-0e69-42a4-a116-a71fec7aeb78@192.168.203.12@tcp:201/0 lens 392/0 e 0 to 0 dl 1784189021 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00010000:00080000:2.0:1784189010.592121:0:85110:0:(ldlm_lib.c:2100:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:2.0:1784189010.592182:0:85110:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1784189010.592185:0:85110:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 94489280520 00000020:00080000:2.0:1784189010.592189:0:85110:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1784189010.592191:0:85110:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 94489280520 00000100:00100000:2.0:1784189010.606602:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1784189010.606746:0:66171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436232960 00000100:00100000:0.0:1784189010.606755:0:66171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436232960 00000100:00100000:0.0:1784189010.606811:0:66171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 997 00000100:00100000:0.0:1784189010.606822:0:66171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc06bbf1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+15:2395:x1870854436232960:12345-192.168.203.12@tcp:400:ldlm_lock_repla.0 00010000:00080000:0.0:1784189010.606859:0:66171:0:(ldlm_lib.c:3137:target_queue_recovery_request()) @@@ queue final req req@ffff9dc06bbf1c00 x1870854436232960/t0(0) o400->b90fcc1c-0e69-42a4-a116-a71fec7aeb78@192.168.203.12@tcp:201/0 lens 224/0 e 0 to 0 dl 1784189021 ref 2 fl Interpret:H/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784189010.606882:0:66171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc06bbf1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+15:2395:x1870854436232960:12345-192.168.203.12@tcp:400:ldlm_lock_repla.0 Request processed in 63us (289us total) trans 0 rc 0/-999 00000100:00100000:0.0:1784189010.606891:0:66171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 997 00000020:00080000:2.0:1784189010.606939:0:85110:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1784189010.606943:0:85110:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 2, connected: 2, completed: 2, queue_len: 0, req_transno: 0, next_transno: 94489280520 00010000:00080000:2.0:1784189010.606947:0:85110:0:(ldlm_lib.c:2262:check_for_next_transno()) waking for completed recovery 00000020:00000004:3.0:1784189010.606950:0:85465:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00080000:2.0:1784189010.606951:0:85110:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1784189010.606961:0:85110:0:(ldlm_lib.c:2452:target_next_replay_lock()) Waiting for lock 00010000:00080000:2.0:1784189010.606963:0:85110:0:(ldlm_lib.c:2285:check_for_next_lock()) waking for completed lock replay 00000001:00000004:2.0:1784189010.607065:0:85110:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 23, last_transno is 98784247808 00000020:00000004:3.0:1784189010.607257:0:85465:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000001:00100000:0.0:1784189010.608855:0:85078:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of b90fcc1c-0e69-42a4-a116-a71fec7aeb78 00000001:00100000:0.0:1784189010.608864:0:85078:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000001:00080000:0.0:1784189010.608890:0:85078:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 94489280519 is committed 00010000:00010000:2.0:1784189010.608973:0:3626:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc070147800/0xcc1762b626f8a75f lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x21e7de2f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 85110 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1784189010.608983:0:85110:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00010000:00010000:2.0:1784189010.608986:0:3626:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc070147800/0xcc1762b626f8a75f lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x21e7de2f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 85110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189010.608997:0:3626:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dc070147800/0xcc1762b626f8a75f lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x21e7de2f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 85110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189010.609004:0:3626:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc070147800 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:2.0:1784189010.609009:0:3626:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc070147800/0xcc1762b626f8a75f lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x21e7de2f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 85110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189010.609017:0:3626:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc070147800/0xcc1762b626f8a75f lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x21e7de2f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 85110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00080000:1.0:1784189010.609023:0:85110:0:(ldlm_lib.c:1996:target_cancel_recovery_timer()) lustre-MDT0000: cancel recovery timer 00010000:00010000:2.0:1784189010.609037:0:3626:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x21e7de2f (ffff9dc056eaa800) 00010000:00080000:1.0:1784189010.609038:0:85110:0:(ldlm_lib.c:2940:target_recovery_thread()) @@@ processing final ping from 0@lo: req@ffff9dc05653a300 x1870854458033792/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:201/0 lens 224/0 e 0 to 0 dl 1784189021 ref 1 fl Complete:/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00010000:2.0:1784189010.609042:0:3626:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784189010.609059:0:3626:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dc070147800/0xcc1762b626f8a75f lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x21e7de2f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 85110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189010.609067:0:3626:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc070147800/0xcc1762b626f8a75f lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x21e7de2f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 85110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189010.609087:0:3626:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc042d67a00/0xcc1762b626f8a76d lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x21e7de2f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 85110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189010.609094:0:3626:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc042d67a00/0xcc1762b626f8a76d lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x21e7de2f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 85110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189010.609100:0:3626:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dc042d67a00/0xcc1762b626f8a76d lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x21e7de2f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 85110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189010.609105:0:3626:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc042d67a00 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:2.0:1784189010.609108:0:3626:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc042d67a00/0xcc1762b626f8a76d lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x21e7de2f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 85110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189010.609114:0:3626:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc042d67a00/0xcc1762b626f8a76d lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x21e7de2f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 85110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189010.609122:0:3626:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x21e7de2f (ffff9dc056eaa800) 00010000:00010000:2.0:1784189010.609125:0:3626:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784189010.609127:0:3626:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dc042d67a00/0xcc1762b626f8a76d lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x21e7de2f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 85110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189010.609133:0:3626:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc042d67a00/0xcc1762b626f8a76d lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x21e7de2f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 85110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00080000:1.0:1784189010.609154:0:85110:0:(ldlm_lib.c:2940:target_recovery_thread()) @@@ processing final ping from 192.168.203.12@tcp: req@ffff9dc06bbf1c00 x1870854436232960/t0(0) o400->b90fcc1c-0e69-42a4-a116-a71fec7aeb78@192.168.203.12@tcp:201/0 lens 224/0 e 0 to 0 dl 1784189021 ref 1 fl Complete:H/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00010000:2.0:1784189010.609156:0:3626:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0565e6400/0xcc1762b626f8a789 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 85110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189010.609184:0:3626:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0565e6400/0xcc1762b626f8a789 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 85110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189010.609190:0:3626:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0565e6400/0xcc1762b626f8a789 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 85110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189010.609196:0:3626:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc0565e6400 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:2.0:1784189010.609199:0:3626:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0565e6400/0xcc1762b626f8a789 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 85110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189010.609205:0:3626:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0565e6400/0xcc1762b626f8a789 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 85110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189010.609215:0:3626:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xed1d29cb (ffff9dbf44e2af00) 00010000:00010000:2.0:1784189010.609218:0:3626:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:02000000:1.0:1784189010.609218:0:85110:0:(ldlm_lib.c:1868:target_finish_recovery()) lustre-MDT0000: Recovery over after 0:04, of 2 clients 2 recovered and 0 were evicted. 00010000:00010000:2.0:1784189010.609221:0:3626:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0565e6400/0xcc1762b626f8a789 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 85110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189010.609230:0:3626:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0565e6400/0xcc1762b626f8a789 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 85110 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1784189010.609498:0:3639:0:(import.c:65:import_set_state_nolock()) ffff9dbf436c4000 lustre-MDT0000_UUID: changing import state from REPLAY_WAIT to RECOVER 00000100:00080000:0.0:1784189010.609507:0:3639:0:(client.c:3234:ptlrpc_resend_req()) @@@ going to resend req@ffff9dc05659df80 x1870854458033792/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1784189026 ref 1 fl Interpret:RQU/2c0/0 rc 0/0 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1784189010.609516:0:3639:0:(client.c:3243:ptlrpc_resend_req()) @@@ it has reply, so skip it req@ffff9dc05659df80 x1870854458033792/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1784189026 ref 1 fl Interpret:RQU/2c0/0 rc 0/0 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1784189010.609523:0:3639:0:(import.c:65:import_set_state_nolock()) ffff9dbf436c4000 lustre-MDT0000_UUID: changing import state from RECOVER to FULL 00000100:02000000:0.0:1784189010.609540:0:3639:0:(import.c:1743:ptlrpc_import_recovery_state_machine()) lustre-MDT0000-osp-MDT0001: Connection restored to 0@lo (at 0@lo) 00000100:00100000:0.0:1784189010.609545:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc05659df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3639:1870854458033792:0@lo:400:ldlm_lock_repla.0 00000100:00100000:0.0:1784189010.609737:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc06bbf0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1870854458033920:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1784189010.609780:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784189010.609855:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458033920 00000100:00100000:2.0:1784189010.609861:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458033920 00000100:00100000:2.0:1784189010.609907:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3704 00000100:00100000:2.0:1784189010.609915:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc05659df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3640:x1870854458033920:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1784189010.609940:0:8439:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445289984 avail 1299050496 00000100:00100000:2.0:1784189010.609978:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc05659df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3640:x1870854458033920:12345-0@lo:41:osp-pre-0-1.0 Request processed in 63us (198us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189010.609984:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3704 00000100:00100000:0.0:1784189010.610057:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc06bbf0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1870854458033920:0@lo:41:osp-pre-0-1.0 00000004:00000080:1.0:1784189010.643615:0:85110:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffae0988683e10 00100000:10000000:1.0:1784189010.643630:0:85110:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000004:00080000:3.0:1784189010.652406:0:85096:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x280000401:0x45c:0x0] 00000100:00100000:3.0:1784189010.652462:0:85096:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc056eace00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:85096:1870854458034048:0@lo:5:osp-pre-0-0.0 00000100:00100000:3.0:1784189010.652522:0:85096:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784189010.652549:0:85096:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dbf46a20600 going to sleep for 11 seconds 00000100:00100000:3.0:1784189010.652570:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458034048 00000100:00100000:3.0:1784189010.652575:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458034048 00000100:00100000:3.0:1784189010.652621:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4921 00000100:00100000:3.0:1784189010.652631:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc056eaca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:85096:x1870854458034048:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:3.0:1784189010.652656:0:8428:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 1729 -> diff = -613 00002000:02000040:3.0:1784189010.652661:0:8428:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:1117 to 0x280000401:1729) 00000004:00080000:1.0:1784189010.652987:0:85098:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x2c0000401:0x682:0x0] 00000100:00100000:1.0:1784189010.653010:0:85098:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf48598380 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:85098:1870854458034176:0@lo:5:osp-pre-1-0.0 00000100:00100000:1.0:1784189010.653047:0:85098:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784189010.653062:0:85098:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dc04516ba80 going to sleep for 11 seconds 00000100:00100000:2.0:1784189010.657651:0:26168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458034176 00000100:00100000:2.0:1784189010.657666:0:26168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458034176 00000100:00100000:2.0:1784189010.657731:0:26168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4922 00000100:00100000:2.0:1784189010.657741:0:26168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf48599f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+6:85098:x1870854458034176:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:2.0:1784189010.657774:0:26168:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 1729 -> diff = -63 00002000:02000040:2.0:1784189010.657779:0:26168:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000401:1667 to 0x2c0000401:1729) 00002000:00010000:3.0:1784189010.671565:0:8428:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6c1:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784189010.671580:0:8428:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d9facf87/0xcc1762b626f8a7a5 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6c1:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189010.671597:0:8428:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6c1:0x0].0x0 since=3252s v=(0 0) 00010000:00010000:3.0:1784189010.671602:0:8428:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6c1:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784189010.671610:0:8428:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d9facf87/0xcc1762b626f8a7a5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189010.671626:0:8428:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d9facf87/0xcc1762b626f8a7a5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189010.671637:0:8428:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d9facf87/0xcc1762b626f8a7a5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189010.671645:0:8428:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d9facf87/0xcc1762b626f8a7a5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189010.671685:0:8428:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1784189010.671803:0:8428:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6c0:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784189010.671810:0:8428:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000076bc4524/0xcc1762b626f8a7ac lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6c0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189010.671819:0:8428:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6c0:0x0].0x0 since=3252s v=(0 0) 00010000:00010000:3.0:1784189010.671822:0:8428:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6c0:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784189010.671827:0:8428:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000076bc4524/0xcc1762b626f8a7ac lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189010.671837:0:8428:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000076bc4524/0xcc1762b626f8a7ac lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189010.671845:0:8428:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000076bc4524/0xcc1762b626f8a7ac lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189010.671853:0:8428:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000076bc4524/0xcc1762b626f8a7ac lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189010.671870:0:8428:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:3.0:1784189010.671914:0:8428:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6bf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784189010.671920:0:8428:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008aeccd8e/0xcc1762b626f8a7b3 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6bf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189010.671928:0:8428:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6bf:0x0].0x0 since=3252s v=(0 0) 00010000:00010000:3.0:1784189010.671938:0:8428:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6bf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784189010.671943:0:8428:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008aeccd8e/0xcc1762b626f8a7b3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189010.671955:0:8428:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008aeccd8e/0xcc1762b626f8a7b3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189010.671962:0:8428:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008aeccd8e/0xcc1762b626f8a7b3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189010.671970:0:8428:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008aeccd8e/0xcc1762b626f8a7b3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189010.671983:0:8428:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:3.0:1784189010.672035:0:8428:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6be:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784189010.672041:0:8428:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e101baf9/0xcc1762b626f8a7ba lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6be:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189010.672048:0:8428:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6be:0x0].0x0 since=3252s v=(0 0) 00010000:00010000:3.0:1784189010.672051:0:8428:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6be:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784189010.672055:0:8428:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e101baf9/0xcc1762b626f8a7ba lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189010.672063:0:8428:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e101baf9/0xcc1762b626f8a7ba lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189010.672071:0:8428:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e101baf9/0xcc1762b626f8a7ba lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189010.672086:0:8428:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e101baf9/0xcc1762b626f8a7ba lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189010.672101:0:8428:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00010000:00010000:3.0:1784189010.672114:0:7454:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:3.0:1784189010.672120:0:7454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d9facf87/0xcc1762b626f8a7a5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189010.672128:0:7454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc05ec0ca00 already unused, calling callback (ffffffffc0b2e230) 00010000:00010000:3.0:1784189010.672132:0:7454:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d9facf87/0xcc1762b626f8a7a5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189010.672141:0:7454:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d9facf87/0xcc1762b626f8a7a5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189010.672157:0:7454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d9facf87/0xcc1762b626f8a7a5 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189010.672164:0:7454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d9facf87/0xcc1762b626f8a7a5 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189010.672179:0:7454:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1784189010.672182:0:7454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000076bc4524/0xcc1762b626f8a7ac lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189010.672199:0:7454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc05ec0d200 already unused, calling callback (ffffffffc0b2e230) 00010000:00010000:3.0:1784189010.672203:0:7454:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000076bc4524/0xcc1762b626f8a7ac lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189010.672211:0:7454:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000076bc4524/0xcc1762b626f8a7ac lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189010.672222:0:7454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000076bc4524/0xcc1762b626f8a7ac lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189010.672230:0:7454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000076bc4524/0xcc1762b626f8a7ac lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189010.672243:0:7454:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1784189010.672247:0:7454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008aeccd8e/0xcc1762b626f8a7b3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189010.672253:0:7454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc05ec0d000 already unused, calling callback (ffffffffc0b2e230) 00010000:00010000:3.0:1784189010.672255:0:7454:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008aeccd8e/0xcc1762b626f8a7b3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189010.672264:0:7454:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008aeccd8e/0xcc1762b626f8a7b3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189010.672274:0:7454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008aeccd8e/0xcc1762b626f8a7b3 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189010.672287:0:7454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008aeccd8e/0xcc1762b626f8a7b3 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189010.672302:0:7454:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784189010.672306:0:7454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e101baf9/0xcc1762b626f8a7ba lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189010.672311:0:7454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc07116e600 already unused, calling callback (ffffffffc0b2e230) 00010000:00010000:3.0:1784189010.672315:0:7454:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e101baf9/0xcc1762b626f8a7ba lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189010.672968:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784189010.672975:0:26173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784189010.672978:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784189010.674855:0:7454:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e101baf9/0xcc1762b626f8a7ba lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189010.674880:0:7454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e101baf9/0xcc1762b626f8a7ba lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189010.674889:0:7454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e101baf9/0xcc1762b626f8a7ba lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189010.674914:0:7454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784189010.674916:0:7454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784189010.674919:0:7454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1784189010.675043:0:8428:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6bd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784189010.675050:0:8428:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007ca946a3/0xcc1762b626f8a7c1 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6bd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189010.675067:0:8428:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6bd:0x0].0x0 since=3252s v=(0 0) 00010000:00010000:3.0:1784189010.675072:0:8428:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6bd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784189010.675080:0:8428:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007ca946a3/0xcc1762b626f8a7c1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189010.675092:0:8428:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007ca946a3/0xcc1762b626f8a7c1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189010.675100:0:8428:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007ca946a3/0xcc1762b626f8a7c1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189010.675108:0:8428:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007ca946a3/0xcc1762b626f8a7c1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189010.675539:0:8428:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1784189010.675594:0:8428:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6bc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784189010.675600:0:8428:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000067956617/0xcc1762b626f8a7c8 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6bc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189010.675609:0:8428:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6bc:0x0].0x0 since=3252s v=(0 0) 00010000:00010000:3.0:1784189010.675612:0:8428:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6bc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784189010.675616:0:8428:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000067956617/0xcc1762b626f8a7c8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189010.675625:0:8428:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000067956617/0xcc1762b626f8a7c8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189010.675645:0:8428:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000067956617/0xcc1762b626f8a7c8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189010.675652:0:8428:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000067956617/0xcc1762b626f8a7c8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189010.675671:0:8428:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:3.0:1784189010.676289:0:8428:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6bb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784189010.676297:0:8428:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000091d4841/0xcc1762b626f8a7cf lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6bb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189010.676308:0:8428:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6bb:0x0].0x0 since=3252s v=(0 0) 00010000:00010000:3.0:1784189010.676312:0:8428:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6bb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784189010.676436:0:6501:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1784189010.676444:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007ca946a3/0xcc1762b626f8a7c1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189010.676453:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc07116fa00 already unused, calling callback (ffffffffc0b2e230) 00010000:00010000:0.0:1784189010.676465:0:6501:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007ca946a3/0xcc1762b626f8a7c1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189010.678497:0:6501:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007ca946a3/0xcc1762b626f8a7c1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189010.678518:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007ca946a3/0xcc1762b626f8a7c1 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189010.678526:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007ca946a3/0xcc1762b626f8a7c1 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189010.678553:0:6501:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784189010.678558:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000067956617/0xcc1762b626f8a7c8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189010.678565:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc07116e800 already unused, calling callback (ffffffffc0b2e230) 00010000:00010000:0.0:1784189010.678568:0:6501:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000067956617/0xcc1762b626f8a7c8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189010.678576:0:6501:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000067956617/0xcc1762b626f8a7c8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189010.678585:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000067956617/0xcc1762b626f8a7c8 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189010.678592:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000067956617/0xcc1762b626f8a7c8 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189010.678622:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784189010.678624:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784189010.678626:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784189010.683017:0:8428:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000091d4841/0xcc1762b626f8a7cf lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189010.683053:0:8428:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000091d4841/0xcc1762b626f8a7cf lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189010.683064:0:8428:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000091d4841/0xcc1762b626f8a7cf lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189010.683072:0:8428:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000091d4841/0xcc1762b626f8a7cf lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189010.683114:0:8428:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1784189010.683131:0:7454:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784189010.683137:0:7454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000091d4841/0xcc1762b626f8a7cf lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189010.683144:0:7454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc07116f200 already unused, calling callback (ffffffffc0b2e230) 00010000:00010000:3.0:1784189010.683147:0:7454:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000091d4841/0xcc1762b626f8a7cf lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189010.683155:0:7454:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000091d4841/0xcc1762b626f8a7cf lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189010.683170:0:7454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000091d4841/0xcc1762b626f8a7cf lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189010.683176:0:7454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000091d4841/0xcc1762b626f8a7cf lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189010.683308:0:7454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784189010.683310:0:7454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784189010.683312:0:7454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1784189010.683456:0:8428:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6ba:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784189010.683463:0:8428:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006a15f861/0xcc1762b626f8a7d6 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6ba:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189010.683474:0:8428:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6ba:0x0].0x0 since=3252s v=(0 0) 00010000:00010000:3.0:1784189010.683484:0:8428:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6ba:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784189010.683491:0:8428:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006a15f861/0xcc1762b626f8a7d6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189010.683501:0:8428:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006a15f861/0xcc1762b626f8a7d6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189010.683509:0:8428:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006a15f861/0xcc1762b626f8a7d6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189010.683516:0:8428:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006a15f861/0xcc1762b626f8a7d6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189010.683533:0:8428:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1784189010.683541:0:6501:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784189010.683545:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006a15f861/0xcc1762b626f8a7d6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189010.683552:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc07116f400 already unused, calling callback (ffffffffc0b2e230) 00010000:00010000:3.0:1784189010.683555:0:6501:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006a15f861/0xcc1762b626f8a7d6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189010.683562:0:6501:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006a15f861/0xcc1762b626f8a7d6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189010.683573:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006a15f861/0xcc1762b626f8a7d6 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189010.683591:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006a15f861/0xcc1762b626f8a7d6 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189010.683605:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784189010.683606:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784189010.683608:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1784189010.683651:0:8428:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6b9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784189010.683656:0:8428:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a47d5412/0xcc1762b626f8a7dd lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6b9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189010.683665:0:8428:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6b9:0x0].0x0 since=3252s v=(0 0) 00010000:00010000:3.0:1784189010.683668:0:8428:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6b9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784189010.683673:0:8428:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a47d5412/0xcc1762b626f8a7dd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189010.683682:0:8428:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a47d5412/0xcc1762b626f8a7dd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189010.683689:0:8428:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a47d5412/0xcc1762b626f8a7dd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189010.683696:0:8428:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a47d5412/0xcc1762b626f8a7dd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189010.683708:0:8428:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1784189010.683787:0:7454:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784189010.683798:0:7454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a47d5412/0xcc1762b626f8a7dd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189010.683952:0:7454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc07116ec00 already unused, calling callback (ffffffffc0b2e230) 00010000:00010000:3.0:1784189010.683956:0:7454:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a47d5412/0xcc1762b626f8a7dd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189010.683965:0:7454:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a47d5412/0xcc1762b626f8a7dd lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189010.683978:0:7454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a47d5412/0xcc1762b626f8a7dd lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189010.683985:0:7454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a47d5412/0xcc1762b626f8a7dd lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189010.684013:0:7454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784189010.684016:0:7454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784189010.684019:0:7454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1784189010.684072:0:8428:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6b8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784189010.684078:0:8428:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d358cced/0xcc1762b626f8a7e4 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6b8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189010.684087:0:8428:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6b8:0x0].0x0 since=3252s v=(0 0) 00010000:00010000:3.0:1784189010.684091:0:8428:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6b8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784189010.684095:0:8428:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d358cced/0xcc1762b626f8a7e4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189010.684118:0:8428:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d358cced/0xcc1762b626f8a7e4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189010.684126:0:8428:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d358cced/0xcc1762b626f8a7e4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189010.684134:0:8428:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d358cced/0xcc1762b626f8a7e4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189010.684148:0:8428:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1784189010.684158:0:6501:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784189010.684162:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d358cced/0xcc1762b626f8a7e4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189010.684170:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc07116e000 already unused, calling callback (ffffffffc0b2e230) 00010000:00010000:3.0:1784189010.684176:0:6501:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d358cced/0xcc1762b626f8a7e4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189010.684184:0:6501:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d358cced/0xcc1762b626f8a7e4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189010.684197:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d358cced/0xcc1762b626f8a7e4 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189010.684205:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d358cced/0xcc1762b626f8a7e4 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189010.684233:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784189010.684236:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784189010.684239:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1784189010.684288:0:8428:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6b7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784189010.684295:0:8428:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000004c81696/0xcc1762b626f8a7eb lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6b7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189010.684303:0:8428:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6b7:0x0].0x0 since=3252s v=(0 0) 00010000:00010000:3.0:1784189010.684306:0:8428:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6b7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784189010.684310:0:8428:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000004c81696/0xcc1762b626f8a7eb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189010.684339:0:8428:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000004c81696/0xcc1762b626f8a7eb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189010.684348:0:8428:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000004c81696/0xcc1762b626f8a7eb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189010.684362:0:8428:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000004c81696/0xcc1762b626f8a7eb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189010.684375:0:8428:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1784189010.684381:0:7454:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784189010.684385:0:7454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000004c81696/0xcc1762b626f8a7eb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189010.684402:0:7454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc07116ea00 already unused, calling callback (ffffffffc0b2e230) 00010000:00010000:3.0:1784189010.684406:0:7454:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000004c81696/0xcc1762b626f8a7eb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189010.684414:0:7454:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000004c81696/0xcc1762b626f8a7eb lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189010.684425:0:7454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000004c81696/0xcc1762b626f8a7eb lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189010.684432:0:7454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000004c81696/0xcc1762b626f8a7eb lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189010.684887:0:7454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784189010.684890:0:7454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784189010.684892:0:7454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1784189010.684948:0:8428:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6b6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784189010.684954:0:8428:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000316b11d0/0xcc1762b626f8a7f2 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6b6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189010.684965:0:8428:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6b6:0x0].0x0 since=3252s v=(0 0) 00010000:00010000:3.0:1784189010.684968:0:8428:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6b6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784189010.684973:0:8428:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000316b11d0/0xcc1762b626f8a7f2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189010.684982:0:8428:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000316b11d0/0xcc1762b626f8a7f2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189010.684997:0:8428:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000316b11d0/0xcc1762b626f8a7f2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189010.685003:0:8428:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000316b11d0/0xcc1762b626f8a7f2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189010.685017:0:8428:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1784189010.685024:0:6501:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784189010.685028:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000316b11d0/0xcc1762b626f8a7f2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189010.685035:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc07116fc00 already unused, calling callback (ffffffffc0b2e230) 00010000:00010000:3.0:1784189010.685039:0:6501:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000316b11d0/0xcc1762b626f8a7f2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189010.685046:0:6501:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000316b11d0/0xcc1762b626f8a7f2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189010.685057:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000316b11d0/0xcc1762b626f8a7f2 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189010.685064:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000316b11d0/0xcc1762b626f8a7f2 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189010.685080:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784189010.685087:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784189010.685089:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1784189010.685132:0:8428:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6b5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784189010.685138:0:8428:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000033b48b6c/0xcc1762b626f8a7f9 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6b5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189010.685145:0:8428:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6b5:0x0].0x0 since=3252s v=(0 0) 00010000:00010000:3.0:1784189010.685148:0:8428:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6b5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784189010.685152:0:8428:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000033b48b6c/0xcc1762b626f8a7f9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189010.685160:0:8428:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000033b48b6c/0xcc1762b626f8a7f9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189010.685167:0:8428:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000033b48b6c/0xcc1762b626f8a7f9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189010.685173:0:8428:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000033b48b6c/0xcc1762b626f8a7f9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189010.685185:0:8428:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1784189010.685190:0:7454:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784189010.685193:0:7454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000033b48b6c/0xcc1762b626f8a7f9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189010.685199:0:7454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc07116e200 already unused, calling callback (ffffffffc0b2e230) 00010000:00010000:3.0:1784189010.685201:0:7454:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000033b48b6c/0xcc1762b626f8a7f9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189010.685219:0:7454:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000033b48b6c/0xcc1762b626f8a7f9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189010.685229:0:7454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000033b48b6c/0xcc1762b626f8a7f9 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189010.685236:0:7454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000033b48b6c/0xcc1762b626f8a7f9 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189010.685247:0:7454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784189010.685249:0:7454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784189010.685250:0:7454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1784189010.685293:0:8428:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6b4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784189010.685299:0:8428:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d7af1b89/0xcc1762b626f8a800 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6b4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189010.685306:0:8428:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6b4:0x0].0x0 since=3252s v=(0 0) 00010000:00010000:3.0:1784189010.685309:0:8428:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6b4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784189010.685314:0:8428:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d7af1b89/0xcc1762b626f8a800 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189010.685343:0:8428:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d7af1b89/0xcc1762b626f8a800 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189010.685351:0:8428:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d7af1b89/0xcc1762b626f8a800 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189010.685374:0:8428:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d7af1b89/0xcc1762b626f8a800 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189010.685387:0:8428:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1784189010.685394:0:6501:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784189010.685397:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d7af1b89/0xcc1762b626f8a800 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189010.685404:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc07116f800 already unused, calling callback (ffffffffc0b2e230) 00010000:00010000:3.0:1784189010.685406:0:6501:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d7af1b89/0xcc1762b626f8a800 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189010.685414:0:6501:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d7af1b89/0xcc1762b626f8a800 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189010.685425:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d7af1b89/0xcc1762b626f8a800 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189010.685433:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d7af1b89/0xcc1762b626f8a800 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189010.685583:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784189010.685591:0:26173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784189010.685648:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784189010.685651:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784189010.685652:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1784189010.685699:0:8428:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6b3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784189010.685725:0:8428:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000006c4aa/0xcc1762b626f8a807 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6b3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189010.685734:0:8428:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6b3:0x0].0x0 since=3252s v=(0 0) 00010000:00010000:3.0:1784189010.685739:0:8428:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6b3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784189010.685744:0:8428:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000006c4aa/0xcc1762b626f8a807 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189010.685754:0:8428:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000006c4aa/0xcc1762b626f8a807 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189010.685762:0:8428:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000006c4aa/0xcc1762b626f8a807 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189010.685770:0:8428:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000006c4aa/0xcc1762b626f8a807 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189010.685784:0:8428:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1784189010.685792:0:7454:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784189010.685796:0:7454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000006c4aa/0xcc1762b626f8a807 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189010.685819:0:7454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc07116e400 already unused, calling callback (ffffffffc0b2e230) 00010000:00010000:3.0:1784189010.685824:0:7454:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000006c4aa/0xcc1762b626f8a807 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189010.685833:0:7454:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000006c4aa/0xcc1762b626f8a807 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189010.685852:0:7454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000006c4aa/0xcc1762b626f8a807 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189010.685859:0:7454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000006c4aa/0xcc1762b626f8a807 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189010.685872:0:7454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784189010.685874:0:7454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784189010.685876:0:7454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1784189010.685920:0:8428:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6b2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784189010.685926:0:8428:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000022fa77b/0xcc1762b626f8a80e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6b2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189010.685934:0:8428:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6b2:0x0].0x0 since=3252s v=(0 0) 00010000:00010000:3.0:1784189010.685936:0:8428:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6b2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784189010.685940:0:8428:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000022fa77b/0xcc1762b626f8a80e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189010.685949:0:8428:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000022fa77b/0xcc1762b626f8a80e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189010.685957:0:8428:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000022fa77b/0xcc1762b626f8a80e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189010.685964:0:8428:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000022fa77b/0xcc1762b626f8a80e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189010.685988:0:8428:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1784189010.686028:0:8428:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6b1:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784189010.686033:0:8428:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d638fecc/0xcc1762b626f8a815 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6b1:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189010.686041:0:8428:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6b1:0x0].0x0 since=3252s v=(0 0) 00010000:00010000:3.0:1784189010.686044:0:8428:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6b1:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784189010.686049:0:8428:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d638fecc/0xcc1762b626f8a815 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189010.686059:0:8428:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d638fecc/0xcc1762b626f8a815 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189010.686067:0:8428:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d638fecc/0xcc1762b626f8a815 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189010.686074:0:8428:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d638fecc/0xcc1762b626f8a815 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189010.686087:0:8428:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:3.0:1784189010.686124:0:8428:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6b0:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784189010.686129:0:8428:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000005567574/0xcc1762b626f8a81c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6b0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189010.686136:0:8428:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6b0:0x0].0x0 since=3252s v=(0 0) 00010000:00010000:3.0:1784189010.686144:0:8428:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6b0:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784189010.686149:0:8428:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000005567574/0xcc1762b626f8a81c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189010.686158:0:8428:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000005567574/0xcc1762b626f8a81c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189010.686167:0:8428:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000005567574/0xcc1762b626f8a81c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189010.686175:0:8428:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000005567574/0xcc1762b626f8a81c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189010.686189:0:8428:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:3.0:1784189010.686195:0:6501:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1784189010.686199:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000022fa77b/0xcc1762b626f8a80e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189010.686206:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc07116f000 already unused, calling callback (ffffffffc0b2e230) 00010000:00010000:3.0:1784189010.686209:0:6501:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000022fa77b/0xcc1762b626f8a80e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189010.686215:0:6501:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000022fa77b/0xcc1762b626f8a80e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189010.686226:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000022fa77b/0xcc1762b626f8a80e lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189010.686244:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000022fa77b/0xcc1762b626f8a80e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189010.686259:0:6501:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1784189010.686263:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d638fecc/0xcc1762b626f8a815 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189010.686269:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc07116f600 already unused, calling callback (ffffffffc0b2e230) 00010000:00010000:3.0:1784189010.686272:0:6501:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d638fecc/0xcc1762b626f8a815 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189010.686280:0:6501:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d638fecc/0xcc1762b626f8a815 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189010.686292:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d638fecc/0xcc1762b626f8a815 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189010.686298:0:6502:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784189010.686300:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d638fecc/0xcc1762b626f8a815 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189010.686306:0:6502:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000005567574/0xcc1762b626f8a81c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189010.686316:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784189010.686337:0:6502:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc07116ee00 already unused, calling callback (ffffffffc0b2e230) 00010000:00010000:3.0:1784189010.686338:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784189010.686343:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784189010.686343:0:6502:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000005567574/0xcc1762b626f8a81c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00100000:0.0:1784189010.686572:0:8423:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00002000:00010000:3.0:1784189010.686663:0:8428:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6af:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784189010.686669:0:8428:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006c76bcb1/0xcc1762b626f8a823 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6af:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189010.686683:0:8428:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6af:0x0].0x0 since=3252s v=(0 0) 00010000:00010000:3.0:1784189010.686686:0:8428:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6af:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784189010.686692:0:8428:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006c76bcb1/0xcc1762b626f8a823 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189010.686703:0:8428:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006c76bcb1/0xcc1762b626f8a823 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189010.686712:0:8428:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006c76bcb1/0xcc1762b626f8a823 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189010.686719:0:8428:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006c76bcb1/0xcc1762b626f8a823 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189010.686745:0:8428:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1784189010.686789:0:8428:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6ae:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784189010.686794:0:8428:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003854658c/0xcc1762b626f8a82a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6ae:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189010.686802:0:8428:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6ae:0x0].0x0 since=3252s v=(0 0) 00010000:00010000:3.0:1784189010.686804:0:8428:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6ae:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784189010.686808:0:8428:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003854658c/0xcc1762b626f8a82a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189010.686816:0:8428:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003854658c/0xcc1762b626f8a82a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189010.686835:0:8428:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003854658c/0xcc1762b626f8a82a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189010.686842:0:8428:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003854658c/0xcc1762b626f8a82a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189010.686854:0:8428:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1784189010.686861:0:6501:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1784189010.686865:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006c76bcb1/0xcc1762b626f8a823 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189010.686871:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc07116fe00 already unused, calling callback (ffffffffc0b2e230) 00010000:00010000:3.0:1784189010.686875:0:6501:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006c76bcb1/0xcc1762b626f8a823 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189010.686882:0:6501:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006c76bcb1/0xcc1762b626f8a823 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189010.686893:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006c76bcb1/0xcc1762b626f8a823 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189010.686902:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006c76bcb1/0xcc1762b626f8a823 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189010.686914:0:6501:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784189010.686923:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003854658c/0xcc1762b626f8a82a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189010.686930:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc081b17000 already unused, calling callback (ffffffffc0b2e230) 00010000:00010000:3.0:1784189010.686933:0:6501:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003854658c/0xcc1762b626f8a82a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189010.686940:0:6501:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003854658c/0xcc1762b626f8a82a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189010.686950:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003854658c/0xcc1762b626f8a82a lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189010.686956:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003854658c/0xcc1762b626f8a82a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189010.686967:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784189010.686968:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784189010.686970:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1784189010.687009:0:8428:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6ad:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784189010.687014:0:8428:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e61abee3/0xcc1762b626f8a831 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6ad:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189010.687021:0:8428:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6ad:0x0].0x0 since=3252s v=(0 0) 00010000:00010000:3.0:1784189010.687024:0:8428:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6ad:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784189010.687028:0:8428:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e61abee3/0xcc1762b626f8a831 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189010.687048:0:8428:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e61abee3/0xcc1762b626f8a831 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189010.687056:0:8428:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e61abee3/0xcc1762b626f8a831 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189010.687063:0:8428:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e61abee3/0xcc1762b626f8a831 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189010.687075:0:8428:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1784189010.687081:0:6501:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784189010.687084:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e61abee3/0xcc1762b626f8a831 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189010.687090:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc081b16600 already unused, calling callback (ffffffffc0b2e230) 00010000:00010000:3.0:1784189010.687093:0:6501:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e61abee3/0xcc1762b626f8a831 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189010.687101:0:6501:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e61abee3/0xcc1762b626f8a831 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189010.687110:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e61abee3/0xcc1762b626f8a831 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189010.687118:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e61abee3/0xcc1762b626f8a831 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189010.687136:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784189010.687138:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784189010.687139:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1784189010.687179:0:8428:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6ac:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784189010.687184:0:8428:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000000b3a42a/0xcc1762b626f8a838 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6ac:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189010.687192:0:8428:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6ac:0x0].0x0 since=3252s v=(0 0) 00010000:00010000:3.0:1784189010.687196:0:8428:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6ac:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784189010.687200:0:8428:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000000b3a42a/0xcc1762b626f8a838 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189010.687209:0:8428:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000000b3a42a/0xcc1762b626f8a838 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189010.687216:0:8428:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000000b3a42a/0xcc1762b626f8a838 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189010.687223:0:8428:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000000b3a42a/0xcc1762b626f8a838 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189010.687236:0:8428:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1784189010.687242:0:6501:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784189010.687246:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000000b3a42a/0xcc1762b626f8a838 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189010.687262:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc081b16c00 already unused, calling callback (ffffffffc0b2e230) 00010000:00010000:3.0:1784189010.687266:0:6501:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000000b3a42a/0xcc1762b626f8a838 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189010.687273:0:6501:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000000b3a42a/0xcc1762b626f8a838 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189010.687284:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000000b3a42a/0xcc1762b626f8a838 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189010.687291:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000000b3a42a/0xcc1762b626f8a838 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189010.687303:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784189010.687304:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784189010.687305:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784189010.687444:0:6502:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000005567574/0xcc1762b626f8a81c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189010.687458:0:6502:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000005567574/0xcc1762b626f8a81c lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189010.687579:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000005567574/0xcc1762b626f8a81c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189010.687600:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784189010.687602:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784189010.687610:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784189010.687617:0:26173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784189010.688058:0:7454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1784189010.688291:0:8428:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6ab:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784189010.688299:0:8428:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000091e65e04/0xcc1762b626f8a83f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6ab:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189010.688310:0:8428:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6ab:0x0].0x0 since=3252s v=(0 0) 00010000:00010000:3.0:1784189010.688314:0:8428:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6ab:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784189010.688335:0:8428:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000091e65e04/0xcc1762b626f8a83f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189010.688346:0:8428:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000091e65e04/0xcc1762b626f8a83f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189010.688371:0:8428:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000091e65e04/0xcc1762b626f8a83f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189010.688380:0:8428:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000091e65e04/0xcc1762b626f8a83f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189010.688406:0:8428:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1784189010.688464:0:8428:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6aa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784189010.688470:0:8428:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000045e176f4/0xcc1762b626f8a846 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6aa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189010.688477:0:8428:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6aa:0x0].0x0 since=3252s v=(0 0) 00010000:00010000:3.0:1784189010.688480:0:8428:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6aa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784189010.688485:0:8428:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000045e176f4/0xcc1762b626f8a846 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189010.688489:0:6501:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784189010.688496:0:8428:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000045e176f4/0xcc1762b626f8a846 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189010.688498:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000091e65e04/0xcc1762b626f8a83f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189010.688515:0:8428:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000045e176f4/0xcc1762b626f8a846 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189010.688517:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc081b16e00 already unused, calling callback (ffffffffc0b2e230) 00010000:00010000:0.0:1784189010.688523:0:6501:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000091e65e04/0xcc1762b626f8a83f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189010.688527:0:8428:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000045e176f4/0xcc1762b626f8a846 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189010.688541:0:6501:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000091e65e04/0xcc1762b626f8a83f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189010.688571:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000091e65e04/0xcc1762b626f8a83f lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189010.688575:0:8428:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1784189010.688584:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000091e65e04/0xcc1762b626f8a83f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189010.688604:0:6501:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784189010.688608:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000045e176f4/0xcc1762b626f8a846 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1784189010.688620:0:8428:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6a9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784189010.688630:0:8428:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000eb2a31c/0xcc1762b626f8a84d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6a9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189010.688634:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc081b17400 already unused, calling callback (ffffffffc0b2e230) 00010000:00010000:0.0:1784189010.688640:0:6501:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000045e176f4/0xcc1762b626f8a846 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189010.688643:0:8428:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6a9:0x0].0x0 since=3252s v=(0 0) 00010000:00010000:3.0:1784189010.688652:0:8428:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6a9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784189010.688658:0:6501:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000045e176f4/0xcc1762b626f8a846 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189010.688659:0:8428:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000eb2a31c/0xcc1762b626f8a84d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189010.688683:0:8428:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000eb2a31c/0xcc1762b626f8a84d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189010.688684:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000045e176f4/0xcc1762b626f8a846 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189010.688702:0:8428:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000eb2a31c/0xcc1762b626f8a84d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189010.688705:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000045e176f4/0xcc1762b626f8a846 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189010.688722:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784189010.688724:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784189010.688726:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784189010.689156:0:8428:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000eb2a31c/0xcc1762b626f8a84d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189010.689187:0:8428:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1784189010.689238:0:8428:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6a8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784189010.689244:0:8428:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ea8c125d/0xcc1762b626f8a854 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6a8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189010.689253:0:8428:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6a8:0x0].0x0 since=3252s v=(0 0) 00010000:00010000:3.0:1784189010.689264:0:8428:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6a8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784189010.689270:0:8428:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ea8c125d/0xcc1762b626f8a854 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189010.689279:0:8428:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ea8c125d/0xcc1762b626f8a854 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189010.689287:0:8428:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ea8c125d/0xcc1762b626f8a854 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189010.689294:0:8428:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ea8c125d/0xcc1762b626f8a854 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189010.689311:0:8428:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1784189010.689338:0:7454:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1784189010.689343:0:7454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000eb2a31c/0xcc1762b626f8a84d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189010.689350:0:7454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc081b16a00 already unused, calling callback (ffffffffc0b2e230) 00010000:00010000:3.0:1784189010.689365:0:7454:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000eb2a31c/0xcc1762b626f8a84d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189010.689373:0:7454:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000eb2a31c/0xcc1762b626f8a84d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189010.689384:0:7454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000eb2a31c/0xcc1762b626f8a84d lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189010.689401:0:7454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000eb2a31c/0xcc1762b626f8a84d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189010.689415:0:7454:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784189010.689418:0:7454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ea8c125d/0xcc1762b626f8a854 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189010.689425:0:7454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc081b17e00 already unused, calling callback (ffffffffc0b2e230) 00010000:00010000:3.0:1784189010.689429:0:7454:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ea8c125d/0xcc1762b626f8a854 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189010.689437:0:7454:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ea8c125d/0xcc1762b626f8a854 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189010.689448:0:7454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ea8c125d/0xcc1762b626f8a854 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189010.689455:0:7454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ea8c125d/0xcc1762b626f8a854 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189010.689467:0:7454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784189010.689469:0:7454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784189010.689471:0:7454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1784189010.689516:0:8428:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6a7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784189010.689522:0:8428:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a898aafb/0xcc1762b626f8a85b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6a7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189010.689535:0:8428:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6a7:0x0].0x0 since=3252s v=(0 0) 00010000:00010000:3.0:1784189010.689537:0:8428:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6a7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784189010.689542:0:8428:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a898aafb/0xcc1762b626f8a85b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189010.689551:0:8428:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a898aafb/0xcc1762b626f8a85b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189010.689559:0:8428:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a898aafb/0xcc1762b626f8a85b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189010.689567:0:8428:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a898aafb/0xcc1762b626f8a85b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189010.689578:0:8428:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1784189010.689618:0:8428:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6a6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784189010.689623:0:8428:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008da15b72/0xcc1762b626f8a862 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6a6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189010.689631:0:8428:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6a6:0x0].0x0 since=3252s v=(0 0) 00010000:00010000:3.0:1784189010.689634:0:8428:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6a6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784189010.689638:0:8428:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008da15b72/0xcc1762b626f8a862 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189010.689645:0:8428:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008da15b72/0xcc1762b626f8a862 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189010.689662:0:8428:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008da15b72/0xcc1762b626f8a862 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189010.689668:0:8428:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008da15b72/0xcc1762b626f8a862 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189010.689680:0:8428:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1784189010.689687:0:7454:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1784189010.689691:0:7454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a898aafb/0xcc1762b626f8a85b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189010.689697:0:7454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc081b16000 already unused, calling callback (ffffffffc0b2e230) 00010000:00010000:3.0:1784189010.689701:0:7454:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a898aafb/0xcc1762b626f8a85b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189010.689708:0:7454:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a898aafb/0xcc1762b626f8a85b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189010.690592:0:6502:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784189010.690602:0:6502:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008da15b72/0xcc1762b626f8a862 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189010.690614:0:6502:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc081b17800 already unused, calling callback (ffffffffc0b2e230) 00010000:00010000:1.0:1784189010.690619:0:6502:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008da15b72/0xcc1762b626f8a862 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189010.690628:0:6502:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008da15b72/0xcc1762b626f8a862 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189010.690643:0:6502:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008da15b72/0xcc1762b626f8a862 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189010.690652:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008da15b72/0xcc1762b626f8a862 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189010.690672:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784189010.690674:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784189010.690676:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784189010.690822:0:26173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784189010.690829:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784189010.691923:0:7454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a898aafb/0xcc1762b626f8a85b lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189010.691934:0:7454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a898aafb/0xcc1762b626f8a85b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189010.691955:0:7454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784189010.691972:0:7454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784189010.691974:0:7454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1784189010.693315:0:8428:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6a5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784189010.693340:0:8428:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d288a1db/0xcc1762b626f8a869 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6a5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189010.693363:0:8428:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6a5:0x0].0x0 since=3252s v=(0 0) 00010000:00010000:3.0:1784189010.693369:0:8428:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6a5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784189010.693375:0:8428:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d288a1db/0xcc1762b626f8a869 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189010.693390:0:8428:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d288a1db/0xcc1762b626f8a869 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189010.693400:0:8428:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d288a1db/0xcc1762b626f8a869 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189010.693408:0:8428:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d288a1db/0xcc1762b626f8a869 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189010.693431:0:8428:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1784189010.693470:0:6502:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784189010.693478:0:6502:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d288a1db/0xcc1762b626f8a869 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189010.693488:0:6502:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc081b17a00 already unused, calling callback (ffffffffc0b2e230) 00010000:00010000:1.0:1784189010.693494:0:6502:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d288a1db/0xcc1762b626f8a869 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189010.693514:0:6502:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d288a1db/0xcc1762b626f8a869 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1784189010.693515:0:8428:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6a4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784189010.693527:0:8428:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003b89c8b1/0xcc1762b626f8a870 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6a4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189010.693536:0:6502:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d288a1db/0xcc1762b626f8a869 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189010.693537:0:8428:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6a4:0x0].0x0 since=3252s v=(0 0) 00010000:00010000:3.0:1784189010.693545:0:8428:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6a4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784189010.693554:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d288a1db/0xcc1762b626f8a869 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189010.693556:0:8428:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003b89c8b1/0xcc1762b626f8a870 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189010.693574:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784189010.693577:0:8428:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003b89c8b1/0xcc1762b626f8a870 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189010.693578:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784189010.693580:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784189010.693590:0:8428:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003b89c8b1/0xcc1762b626f8a870 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189010.693597:0:8428:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003b89c8b1/0xcc1762b626f8a870 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189010.693615:0:8428:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1784189010.693654:0:26173:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784189010.693662:0:26173:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003b89c8b1/0xcc1762b626f8a870 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1784189010.693664:0:8428:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6a3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784189010.693674:0:8428:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c63cc5e6/0xcc1762b626f8a877 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6a3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189010.693675:0:26173:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc081b17600 already unused, calling callback (ffffffffc0b2e230) 00010000:00010000:0.0:1784189010.693681:0:26173:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003b89c8b1/0xcc1762b626f8a870 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189010.693689:0:8428:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6a3:0x0].0x0 since=3252s v=(0 0) 00010000:00010000:3.0:1784189010.693694:0:8428:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6a3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784189010.693699:0:8428:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c63cc5e6/0xcc1762b626f8a877 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189010.693714:0:26173:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003b89c8b1/0xcc1762b626f8a870 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189010.693725:0:26173:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003b89c8b1/0xcc1762b626f8a870 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189010.693732:0:26173:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003b89c8b1/0xcc1762b626f8a870 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189010.693744:0:26173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784189010.693746:0:26173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784189010.693747:0:26173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784189010.694070:0:8428:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c63cc5e6/0xcc1762b626f8a877 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189010.694080:0:8428:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c63cc5e6/0xcc1762b626f8a877 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189010.694099:0:8428:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c63cc5e6/0xcc1762b626f8a877 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189010.694118:0:8428:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1784189010.694138:0:6501:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784189010.694144:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c63cc5e6/0xcc1762b626f8a877 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189010.694153:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc081b17c00 already unused, calling callback (ffffffffc0b2e230) 00010000:00010000:0.0:1784189010.694157:0:6501:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c63cc5e6/0xcc1762b626f8a877 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1784189010.694163:0:8428:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6a2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784189010.694166:0:6501:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c63cc5e6/0xcc1762b626f8a877 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189010.694170:0:8428:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d0a53c2a/0xcc1762b626f8a87e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6a2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189010.694183:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c63cc5e6/0xcc1762b626f8a877 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189010.694184:0:8428:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6a2:0x0].0x0 since=3252s v=(0 0) 00010000:00010000:3.0:1784189010.694192:0:8428:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6a2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784189010.694200:0:8428:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d0a53c2a/0xcc1762b626f8a87e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189010.694224:0:8428:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d0a53c2a/0xcc1762b626f8a87e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189010.694224:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c63cc5e6/0xcc1762b626f8a877 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189010.694245:0:8428:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d0a53c2a/0xcc1762b626f8a87e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189010.694247:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784189010.694250:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784189010.694253:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784189010.694256:0:8428:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d0a53c2a/0xcc1762b626f8a87e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189010.694279:0:8428:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1784189010.694296:0:7454:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784189010.694301:0:7454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d0a53c2a/0xcc1762b626f8a87e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189010.694309:0:7454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc081b16800 already unused, calling callback (ffffffffc0b2e230) 00010000:00010000:0.0:1784189010.694313:0:7454:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d0a53c2a/0xcc1762b626f8a87e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189010.694346:0:7454:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d0a53c2a/0xcc1762b626f8a87e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189010.694555:0:7454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d0a53c2a/0xcc1762b626f8a87e lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189010.694563:0:7454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d0a53c2a/0xcc1762b626f8a87e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189010.694581:0:7454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784189010.694584:0:7454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784189010.694586:0:7454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1784189010.696851:0:26168:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6c1:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1784189010.696861:0:26168:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000b6eacba/0xcc1762b626f8a885 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6c1:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189010.696877:0:26168:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6c1:0x0].0x0 since=3252s v=(0 0) 00010000:00010000:2.0:1784189010.696882:0:26168:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6c1:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784189010.696888:0:26168:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000b6eacba/0xcc1762b626f8a885 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189010.696904:0:26168:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000b6eacba/0xcc1762b626f8a885 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189010.696914:0:26168:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000b6eacba/0xcc1762b626f8a885 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189010.696923:0:26168:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000b6eacba/0xcc1762b626f8a885 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189010.696942:0:26168:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1784189010.697029:0:26168:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6c0:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1784189010.697035:0:26168:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e88c95bf/0xcc1762b626f8a88c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6c0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189010.697051:0:26168:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6c0:0x0].0x0 since=3252s v=(0 0) 00010000:00010000:2.0:1784189010.697054:0:26168:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6c0:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784189010.697059:0:26168:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e88c95bf/0xcc1762b626f8a88c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189010.697069:0:26168:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e88c95bf/0xcc1762b626f8a88c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189010.697078:0:26168:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e88c95bf/0xcc1762b626f8a88c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189010.697085:0:26168:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e88c95bf/0xcc1762b626f8a88c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189010.697102:0:26168:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1784189010.697112:0:26173:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1784189010.697118:0:26173:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000b6eacba/0xcc1762b626f8a885 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189010.697127:0:26173:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc0755a4e00 already unused, calling callback (ffffffffc0b2e230) 00010000:00010000:2.0:1784189010.697132:0:26173:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000b6eacba/0xcc1762b626f8a885 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189010.697142:0:26173:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000b6eacba/0xcc1762b626f8a885 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189010.697169:0:26173:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000b6eacba/0xcc1762b626f8a885 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189010.697177:0:26173:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000b6eacba/0xcc1762b626f8a885 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189010.697197:0:26173:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784189010.697201:0:26173:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e88c95bf/0xcc1762b626f8a88c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189010.697208:0:26173:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc0755a5600 already unused, calling callback (ffffffffc0b2e230) 00010000:00010000:2.0:1784189010.697211:0:26173:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e88c95bf/0xcc1762b626f8a88c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189010.697219:0:26173:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e88c95bf/0xcc1762b626f8a88c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189010.697229:0:26173:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e88c95bf/0xcc1762b626f8a88c lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189010.697237:0:26173:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e88c95bf/0xcc1762b626f8a88c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189010.697250:0:26173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784189010.697252:0:26173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784189010.697258:0:26173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1784189010.697305:0:26168:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6bf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1784189010.697310:0:26168:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000090923e4f/0xcc1762b626f8a893 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6bf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189010.697526:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784189010.703540:0:26168:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6bf:0x0].0x0 since=3252s v=(0 0) 00010000:00010000:2.0:1784189010.703546:0:26168:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6bf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784189010.703554:0:26168:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000090923e4f/0xcc1762b626f8a893 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189010.703572:0:26168:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000090923e4f/0xcc1762b626f8a893 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189010.703584:0:26168:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000090923e4f/0xcc1762b626f8a893 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189010.703592:0:26168:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000090923e4f/0xcc1762b626f8a893 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189010.703903:0:26168:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1784189010.704014:0:26168:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6be:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1784189010.704021:0:26168:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000283735d0/0xcc1762b626f8a89a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6be:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189010.704033:0:26168:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6be:0x0].0x0 since=3252s v=(0 0) 00010000:00010000:2.0:1784189010.704037:0:26168:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6be:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784189010.704042:0:26168:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000283735d0/0xcc1762b626f8a89a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189010.704067:0:26168:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000283735d0/0xcc1762b626f8a89a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189010.704078:0:26168:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000283735d0/0xcc1762b626f8a89a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189010.704087:0:26168:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000283735d0/0xcc1762b626f8a89a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189010.704110:0:26168:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1784189010.704122:0:7454:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1784189010.704128:0:7454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000090923e4f/0xcc1762b626f8a893 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189010.704138:0:7454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc0755a5c00 already unused, calling callback (ffffffffc0b2e230) 00010000:00010000:2.0:1784189010.704144:0:7454:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000090923e4f/0xcc1762b626f8a893 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189010.704156:0:7454:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000090923e4f/0xcc1762b626f8a893 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189010.704175:0:7454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000090923e4f/0xcc1762b626f8a893 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189010.704183:0:7454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000090923e4f/0xcc1762b626f8a893 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189010.704217:0:7454:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784189010.704222:0:7454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000283735d0/0xcc1762b626f8a89a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189010.704229:0:7454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc0755a4200 already unused, calling callback (ffffffffc0b2e230) 00010000:00010000:2.0:1784189010.704234:0:7454:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000283735d0/0xcc1762b626f8a89a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189010.704242:0:7454:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000283735d0/0xcc1762b626f8a89a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189010.704254:0:7454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000283735d0/0xcc1762b626f8a89a lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189010.704263:0:7454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000283735d0/0xcc1762b626f8a89a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189010.704279:0:7454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784189010.704282:0:7454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784189010.704284:0:7454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1784189010.704625:0:9506:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00002000:00010000:2.0:1784189010.705049:0:26168:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6bd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1784189010.705056:0:26168:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000097385c8a/0xcc1762b626f8a8a1 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6bd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189010.705069:0:26168:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6bd:0x0].0x0 since=3252s v=(0 0) 00010000:00010000:2.0:1784189010.705079:0:26168:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6bd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784189010.705087:0:26168:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000097385c8a/0xcc1762b626f8a8a1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189010.705098:0:26168:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000097385c8a/0xcc1762b626f8a8a1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189010.705107:0:26168:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000097385c8a/0xcc1762b626f8a8a1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189010.705117:0:26168:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000097385c8a/0xcc1762b626f8a8a1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189010.705138:0:26168:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1784189010.705148:0:26173:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784189010.705154:0:26173:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000097385c8a/0xcc1762b626f8a8a1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189010.705163:0:26173:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc0755a5400 already unused, calling callback (ffffffffc0b2e230) 00010000:00010000:2.0:1784189010.705166:0:26173:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000097385c8a/0xcc1762b626f8a8a1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189010.705175:0:26173:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000097385c8a/0xcc1762b626f8a8a1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189010.705186:0:26173:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000097385c8a/0xcc1762b626f8a8a1 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189010.705207:0:26173:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000097385c8a/0xcc1762b626f8a8a1 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189010.705224:0:26173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784189010.705226:0:26173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784189010.705230:0:26173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1784189010.705297:0:26168:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6bc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1784189010.705305:0:26168:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c6b3e208/0xcc1762b626f8a8a8 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6bc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189010.705314:0:26168:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6bc:0x0].0x0 since=3252s v=(0 0) 00010000:00010000:2.0:1784189010.705337:0:26168:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6bc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784189010.705341:0:26168:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c6b3e208/0xcc1762b626f8a8a8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189010.705350:0:26168:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c6b3e208/0xcc1762b626f8a8a8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189010.705851:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784189010.705895:0:26168:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c6b3e208/0xcc1762b626f8a8a8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189010.705903:0:26168:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c6b3e208/0xcc1762b626f8a8a8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189010.705959:0:26168:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1784189010.706022:0:26168:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6bb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1784189010.706026:0:26168:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005850ddb8/0xcc1762b626f8a8af lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6bb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189010.706035:0:26168:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6bb:0x0].0x0 since=3252s v=(0 0) 00010000:00010000:2.0:1784189010.706039:0:26168:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6bb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784189010.706043:0:26168:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005850ddb8/0xcc1762b626f8a8af lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189010.706052:0:26168:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005850ddb8/0xcc1762b626f8a8af lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189010.706059:0:26168:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005850ddb8/0xcc1762b626f8a8af lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189010.706066:0:26168:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005850ddb8/0xcc1762b626f8a8af lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00080000:3.0:1784189010.708174:0:8428:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x280000401:1116 00000100:00100000:3.0:1784189010.708278:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc056eaca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:85096:x1870854458034048:12345-0@lo:5:osp-pre-0-0.0 Request processed in 55645us (55751us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189010.708296:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4921 00000100:00100000:3.0:1784189010.708389:0:85096:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc056eace00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:85096:1870854458034048:0@lo:5:osp-pre-0-0.0 00000004:00080000:3.0:1784189010.708405:0:85096:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x280000401:0x6c1:0x0] from OST, last_created [0x280000401:0x6c1:0x0]last_used is [0x280000401:0x45c:0x0] 00000100:00100000:3.0:1784189010.708472:0:85096:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc056ead180 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:85096:1870854458034432:0@lo:5:osp-pre-0-0.0 00000100:00100000:3.0:1784189010.708513:0:85096:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784189010.711369:0:85096:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dc04bb8d840 going to sleep for 11 seconds 00000100:00100000:3.0:1784189010.711407:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc056eace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1870854458034304:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1784189010.711466:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784189010.711513:0:9466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458034304 00000100:00100000:3.0:1784189010.711520:0:9466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458034304 00000100:00100000:3.0:1784189010.711567:0:9466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1842 00000100:00100000:3.0:1784189010.711575:0:9466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc056eafb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1870854458034304:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1784189010.711604:0:9466:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 214592 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1784189010.711645:0:9466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc056eafb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1870854458034304:12345-0@lo:13:osp-pre-0-0.0 Request processed in 70us (178us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189010.711652:0:9466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1842 00000100:00100000:3.0:1784189010.711698:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc056eace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1870854458034304:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1784189010.712077:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458034432 00000100:00100000:3.0:1784189010.712083:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458034432 00000100:00100000:3.0:1784189010.712113:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4923 00000100:00100000:3.0:1784189010.712119:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc056eac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:85096:x1870854458034432:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:3.0:1784189010.712148:0:8428:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000401 at 1730 00010000:00010000:0.0:1784189010.712541:0:6502:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1784189010.712551:0:6502:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c6b3e208/0xcc1762b626f8a8a8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189010.712564:0:6502:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc04a20ba00 already unused, calling callback (ffffffffc0b2e230) 00010000:00010000:0.0:1784189010.712569:0:6502:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c6b3e208/0xcc1762b626f8a8a8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189010.712578:0:6502:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c6b3e208/0xcc1762b626f8a8a8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189010.712598:0:6502:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c6b3e208/0xcc1762b626f8a8a8 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189010.712607:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c6b3e208/0xcc1762b626f8a8a8 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189010.712636:0:6502:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784189010.712641:0:6502:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005850ddb8/0xcc1762b626f8a8af lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189010.712648:0:6502:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc04a20b400 already unused, calling callback (ffffffffc0b2e230) 00010000:00010000:0.0:1784189010.712652:0:6502:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005850ddb8/0xcc1762b626f8a8af lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189010.712660:0:6502:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005850ddb8/0xcc1762b626f8a8af lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x6bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189010.712682:0:6502:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005850ddb8/0xcc1762b626f8a8af lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x6bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189010.712691:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784189010.712693:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784189010.712696:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784189010.715613:0:26168:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1784189010.715625:0:26168:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005850ddb8/0xcc1762b626f8a8af lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1784189010.715762:0:26168:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6ba:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1784189010.715768:0:26168:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000041e819fd/0xcc1762b626f8a8b6 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6ba:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189010.715780:0:26168:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6ba:0x0].0x0 since=3252s v=(0 0) 00010000:00010000:2.0:1784189010.715796:0:26168:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6ba:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784189010.715802:0:26168:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000041e819fd/0xcc1762b626f8a8b6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189010.715815:0:26168:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000041e819fd/0xcc1762b626f8a8b6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189010.715823:0:26168:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000041e819fd/0xcc1762b626f8a8b6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189010.715830:0:26168:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000041e819fd/0xcc1762b626f8a8b6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189010.715844:0:26168:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1784189010.715852:0:26173:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784189010.715857:0:26173:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000041e819fd/0xcc1762b626f8a8b6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189010.715864:0:26173:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc04a20a200 already unused, calling callback (ffffffffc0b2e230) 00010000:00010000:2.0:1784189010.715868:0:26173:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000041e819fd/0xcc1762b626f8a8b6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189010.715877:0:26173:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000041e819fd/0xcc1762b626f8a8b6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189010.715890:0:26173:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000041e819fd/0xcc1762b626f8a8b6 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189010.715908:0:26173:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000041e819fd/0xcc1762b626f8a8b6 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189010.715921:0:26173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784189010.715923:0:26173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784189010.715925:0:26173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1784189010.715962:0:26168:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6b9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1784189010.715967:0:26168:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009430fa1b/0xcc1762b626f8a8bd lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6b9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189010.715975:0:26168:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6b9:0x0].0x0 since=3252s v=(0 0) 00010000:00010000:2.0:1784189010.715978:0:26168:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6b9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784189010.715982:0:26168:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009430fa1b/0xcc1762b626f8a8bd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189010.715991:0:26168:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009430fa1b/0xcc1762b626f8a8bd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189010.715999:0:26168:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009430fa1b/0xcc1762b626f8a8bd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189010.716007:0:26168:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009430fa1b/0xcc1762b626f8a8bd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189010.716020:0:26168:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1784189010.716032:0:6501:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784189010.716036:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009430fa1b/0xcc1762b626f8a8bd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189010.716043:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc04a20b200 already unused, calling callback (ffffffffc0b2e230) 00010000:00010000:2.0:1784189010.716046:0:6501:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009430fa1b/0xcc1762b626f8a8bd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189010.716054:0:6501:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009430fa1b/0xcc1762b626f8a8bd lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189010.716065:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009430fa1b/0xcc1762b626f8a8bd lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189010.716072:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009430fa1b/0xcc1762b626f8a8bd lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189010.716083:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784189010.716084:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784189010.716086:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1784189010.716120:0:26168:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6b8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1784189010.716125:0:26168:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d66bdbcc/0xcc1762b626f8a8c4 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6b8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189010.716132:0:26168:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6b8:0x0].0x0 since=3252s v=(0 0) 00010000:00010000:2.0:1784189010.716135:0:26168:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6b8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784189010.716139:0:26168:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d66bdbcc/0xcc1762b626f8a8c4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189010.716158:0:26168:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d66bdbcc/0xcc1762b626f8a8c4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189010.716166:0:26168:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d66bdbcc/0xcc1762b626f8a8c4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189010.716173:0:26168:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d66bdbcc/0xcc1762b626f8a8c4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189010.716186:0:26168:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1784189010.716193:0:6502:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784189010.716197:0:6502:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d66bdbcc/0xcc1762b626f8a8c4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189010.716204:0:6502:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc04a20a400 already unused, calling callback (ffffffffc0b2e230) 00010000:00010000:2.0:1784189010.716207:0:6502:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d66bdbcc/0xcc1762b626f8a8c4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189010.716214:0:6502:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d66bdbcc/0xcc1762b626f8a8c4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189010.716223:0:6502:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d66bdbcc/0xcc1762b626f8a8c4 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189010.716230:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d66bdbcc/0xcc1762b626f8a8c4 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189010.716248:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784189010.716250:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784189010.716251:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1784189010.716287:0:26168:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6b7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1784189010.716292:0:26168:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003341b3a2/0xcc1762b626f8a8cb lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6b7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189010.716300:0:26168:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6b7:0x0].0x0 since=3252s v=(0 0) 00010000:00010000:2.0:1784189010.716302:0:26168:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6b7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784189010.716306:0:26168:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003341b3a2/0xcc1762b626f8a8cb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189010.716314:0:26168:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003341b3a2/0xcc1762b626f8a8cb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189010.716351:0:26168:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003341b3a2/0xcc1762b626f8a8cb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189010.716367:0:26168:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003341b3a2/0xcc1762b626f8a8cb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189010.716380:0:26168:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1784189010.716386:0:26173:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784189010.716389:0:26173:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003341b3a2/0xcc1762b626f8a8cb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189010.716406:0:26173:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc04a20b600 already unused, calling callback (ffffffffc0b2e230) 00010000:00010000:2.0:1784189010.716410:0:26173:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003341b3a2/0xcc1762b626f8a8cb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189010.716417:0:26173:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003341b3a2/0xcc1762b626f8a8cb lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189010.716427:0:26173:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003341b3a2/0xcc1762b626f8a8cb lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189010.716434:0:26173:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003341b3a2/0xcc1762b626f8a8cb lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189010.716543:0:7454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784189010.716585:0:26173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784189010.716587:0:26173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784189010.716588:0:26173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1784189010.716631:0:26168:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6b6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1784189010.716637:0:26168:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cf75c475/0xcc1762b626f8a8d2 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6b6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189010.716644:0:26168:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6b6:0x0].0x0 since=3252s v=(0 0) 00010000:00010000:2.0:1784189010.716647:0:26168:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6b6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784189010.716651:0:26168:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cf75c475/0xcc1762b626f8a8d2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189010.716660:0:26168:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cf75c475/0xcc1762b626f8a8d2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189010.716675:0:26168:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cf75c475/0xcc1762b626f8a8d2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189010.716681:0:26168:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000cf75c475/0xcc1762b626f8a8d2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189010.716733:0:26168:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1784189010.716777:0:26168:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6b5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1784189010.716782:0:26168:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f87d4f57/0xcc1762b626f8a8d9 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6b5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189010.716790:0:26168:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6b5:0x0].0x0 since=3252s v=(0 0) 00010000:00010000:2.0:1784189010.716793:0:26168:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6b5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784189010.716797:0:26168:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f87d4f57/0xcc1762b626f8a8d9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189010.716805:0:26168:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f87d4f57/0xcc1762b626f8a8d9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189010.716812:0:26168:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f87d4f57/0xcc1762b626f8a8d9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189010.716819:0:26168:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f87d4f57/0xcc1762b626f8a8d9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784189010.722137:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc056eac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:85096:x1870854458034432:12345-0@lo:5:osp-pre-0-0.0 Request processed in 10011us (13617us total) trans 4294968948 rc 0/0 00000100:00100000:3.0:1784189010.722160:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4923 00000100:00100000:3.0:1784189010.722568:0:85096:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc056ead180 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:85096:1870854458034432:0@lo:5:osp-pre-0-0.0 00000004:00080000:3.0:1784189010.722585:0:85096:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x280000401:0x6c1:0x0]-[0x280000401:0x6e1:0x0] 00010000:00010000:1.0:1784189010.723616:0:6501:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1784189010.723627:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000cf75c475/0xcc1762b626f8a8d2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189010.723640:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc04a20ac00 already unused, calling callback (ffffffffc0b2e230) 00010000:00010000:1.0:1784189010.723645:0:6501:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000cf75c475/0xcc1762b626f8a8d2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189010.723656:0:6501:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000cf75c475/0xcc1762b626f8a8d2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189010.723692:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000cf75c475/0xcc1762b626f8a8d2 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189010.723700:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cf75c475/0xcc1762b626f8a8d2 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189010.727577:0:26168:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1784189010.727709:0:26168:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6b4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1784189010.727717:0:26168:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000b9d4674/0xcc1762b626f8a8e0 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6b4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189010.727734:0:26168:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6b4:0x0].0x0 since=3252s v=(0 0) 00010000:00010000:2.0:1784189010.727739:0:26168:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6b4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784189010.727746:0:26168:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000b9d4674/0xcc1762b626f8a8e0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189010.727761:0:26168:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000b9d4674/0xcc1762b626f8a8e0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189010.727771:0:26168:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000b9d4674/0xcc1762b626f8a8e0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189010.727779:0:26168:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000b9d4674/0xcc1762b626f8a8e0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189010.727799:0:26168:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:2.0:1784189010.727837:0:26168:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6b3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1784189010.727843:0:26168:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009d2fcfa0/0xcc1762b626f8a8e7 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6b3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189010.727852:0:26168:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6b3:0x0].0x0 since=3252s v=(0 0) 00010000:00010000:2.0:1784189010.727866:0:26168:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6b3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784189010.727871:0:26168:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009d2fcfa0/0xcc1762b626f8a8e7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189010.727882:0:26168:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009d2fcfa0/0xcc1762b626f8a8e7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189010.727891:0:26168:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009d2fcfa0/0xcc1762b626f8a8e7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189010.727899:0:26168:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009d2fcfa0/0xcc1762b626f8a8e7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189010.727913:0:26168:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:2.0:1784189010.727926:0:26173:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1784189010.727932:0:26173:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f87d4f57/0xcc1762b626f8a8d9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189010.727940:0:26173:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc04a20aa00 already unused, calling callback (ffffffffc0b2e230) 00010000:00010000:2.0:1784189010.727944:0:26173:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f87d4f57/0xcc1762b626f8a8d9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189010.727952:0:26173:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f87d4f57/0xcc1762b626f8a8d9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189010.727967:0:26173:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f87d4f57/0xcc1762b626f8a8d9 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189010.727985:0:26173:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f87d4f57/0xcc1762b626f8a8d9 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189010.728005:0:26173:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1784189010.728008:0:26173:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000b9d4674/0xcc1762b626f8a8e0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189010.728015:0:26173:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc04a20a800 already unused, calling callback (ffffffffc0b2e230) 00010000:00010000:2.0:1784189010.728018:0:26173:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000b9d4674/0xcc1762b626f8a8e0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189010.728025:0:26173:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000b9d4674/0xcc1762b626f8a8e0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189010.728035:0:26173:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000b9d4674/0xcc1762b626f8a8e0 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189010.728041:0:26173:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000b9d4674/0xcc1762b626f8a8e0 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189010.728051:0:26173:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784189010.728054:0:26173:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009d2fcfa0/0xcc1762b626f8a8e7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189010.728059:0:26173:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc04a20b000 already unused, calling callback (ffffffffc0b2e230) 00010000:00010000:2.0:1784189010.728069:0:26173:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009d2fcfa0/0xcc1762b626f8a8e7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189010.728077:0:26173:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009d2fcfa0/0xcc1762b626f8a8e7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189010.728088:0:26173:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009d2fcfa0/0xcc1762b626f8a8e7 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189010.728095:0:26173:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009d2fcfa0/0xcc1762b626f8a8e7 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189010.728110:0:26173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784189010.728112:0:26173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784189010.728114:0:26173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1784189010.728162:0:26168:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6b2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1784189010.728167:0:26168:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000a3ed8d4/0xcc1762b626f8a8ee lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6b2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189010.728175:0:26168:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6b2:0x0].0x0 since=3252s v=(0 0) 00010000:00010000:2.0:1784189010.728178:0:26168:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6b2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784189010.728182:0:26168:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000a3ed8d4/0xcc1762b626f8a8ee lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189010.728189:0:26168:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000a3ed8d4/0xcc1762b626f8a8ee lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189010.728207:0:26168:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000a3ed8d4/0xcc1762b626f8a8ee lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189010.728213:0:26168:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000a3ed8d4/0xcc1762b626f8a8ee lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189010.728223:0:26168:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1784189010.728231:0:26173:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784189010.728234:0:26173:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000a3ed8d4/0xcc1762b626f8a8ee lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189010.728240:0:26173:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc04a20bc00 already unused, calling callback (ffffffffc0b2e230) 00010000:00010000:2.0:1784189010.728243:0:26173:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000a3ed8d4/0xcc1762b626f8a8ee lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189010.728250:0:26173:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000a3ed8d4/0xcc1762b626f8a8ee lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189010.728259:0:26173:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000a3ed8d4/0xcc1762b626f8a8ee lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189010.728266:0:26173:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000a3ed8d4/0xcc1762b626f8a8ee lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189010.728278:0:26173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784189010.728286:0:26173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784189010.728288:0:26173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1784189010.728376:0:26168:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6b1:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1784189010.728382:0:26168:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000051238ad7/0xcc1762b626f8a8f5 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6b1:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189010.728390:0:26168:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6b1:0x0].0x0 since=3252s v=(0 0) 00010000:00010000:2.0:1784189010.728393:0:26168:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6b1:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784189010.728396:0:26168:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000051238ad7/0xcc1762b626f8a8f5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189010.728404:0:26168:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000051238ad7/0xcc1762b626f8a8f5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189010.728411:0:26168:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000051238ad7/0xcc1762b626f8a8f5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189010.728416:0:26168:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000051238ad7/0xcc1762b626f8a8f5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189010.728428:0:26168:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1784189010.728434:0:26173:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784189010.728437:0:26173:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000051238ad7/0xcc1762b626f8a8f5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189010.728546:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784189010.728654:0:7454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784189010.728660:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784189010.728662:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784189010.728664:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1784189010.730697:0:26168:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6b0:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784189010.730709:0:26168:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a898aafb/0xcc1762b626f8a8fc lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6b0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189010.730725:0:26168:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6b0:0x0].0x0 since=3252s v=(0 0) 00010000:00010000:3.0:1784189010.730729:0:26168:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6b0:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784189010.730735:0:26168:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a898aafb/0xcc1762b626f8a8fc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189010.730749:0:26168:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a898aafb/0xcc1762b626f8a8fc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189010.730758:0:26168:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a898aafb/0xcc1762b626f8a8fc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189010.730765:0:26168:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a898aafb/0xcc1762b626f8a8fc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189010.730788:0:26168:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1784189010.730828:0:26168:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6af:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784189010.730833:0:26168:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ea8c125d/0xcc1762b626f8a903 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6af:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189010.730847:0:26168:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6af:0x0].0x0 since=3252s v=(0 0) 00010000:00010000:3.0:1784189010.730850:0:26168:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6af:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784189010.730854:0:26168:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ea8c125d/0xcc1762b626f8a903 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189010.730862:0:26168:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ea8c125d/0xcc1762b626f8a903 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189010.730869:0:26168:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ea8c125d/0xcc1762b626f8a903 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189010.730876:0:26168:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ea8c125d/0xcc1762b626f8a903 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189010.730888:0:26168:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:3.0:1784189010.730929:0:26168:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6ae:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784189010.730934:0:26168:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000eb2a31c/0xcc1762b626f8a90a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6ae:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189010.730942:0:26168:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6ae:0x0].0x0 since=3252s v=(0 0) 00010000:00010000:3.0:1784189010.730945:0:26168:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6ae:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784189010.730949:0:26168:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000eb2a31c/0xcc1762b626f8a90a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189010.730957:0:26168:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000eb2a31c/0xcc1762b626f8a90a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189010.730975:0:26168:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000eb2a31c/0xcc1762b626f8a90a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189010.730982:0:26168:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000eb2a31c/0xcc1762b626f8a90a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189010.730994:0:26168:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:3.0:1784189010.731034:0:26168:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6ad:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784189010.731038:0:26168:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000000b3a42a/0xcc1762b626f8a911 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6ad:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189010.731046:0:26168:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6ad:0x0].0x0 since=3252s v=(0 0) 00010000:00010000:3.0:1784189010.731049:0:26168:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6ad:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784189010.731052:0:26168:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000000b3a42a/0xcc1762b626f8a911 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189010.731061:0:26168:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000000b3a42a/0xcc1762b626f8a911 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189010.731068:0:26168:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000000b3a42a/0xcc1762b626f8a911 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189010.731075:0:26168:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000000b3a42a/0xcc1762b626f8a911 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189010.731094:0:26168:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00002000:00010000:3.0:1784189010.731135:0:26168:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6ac:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784189010.731140:0:26168:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e61abee3/0xcc1762b626f8a918 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6ac:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189010.731148:0:26168:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6ac:0x0].0x0 since=3252s v=(0 0) 00010000:00010000:3.0:1784189010.731151:0:26168:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6ac:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784189010.731155:0:26168:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e61abee3/0xcc1762b626f8a918 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189010.731163:0:26168:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e61abee3/0xcc1762b626f8a918 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189010.731172:0:26168:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e61abee3/0xcc1762b626f8a918 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189010.731179:0:26168:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e61abee3/0xcc1762b626f8a918 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189010.731188:0:26168:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00002000:00010000:3.0:1784189010.731219:0:26168:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6ab:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784189010.731224:0:26168:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003854658c/0xcc1762b626f8a91f lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6ab:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189010.731231:0:26168:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6ab:0x0].0x0 since=3252s v=(0 0) 00010000:00010000:3.0:1784189010.731241:0:26168:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6ab:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784189010.731246:0:26168:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003854658c/0xcc1762b626f8a91f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189010.731254:0:26168:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003854658c/0xcc1762b626f8a91f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189010.731261:0:26168:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003854658c/0xcc1762b626f8a91f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189010.731268:0:26168:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003854658c/0xcc1762b626f8a91f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189010.731276:0:26168:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to regular blp list, 6 blwis in pool 00002000:00010000:3.0:1784189010.731310:0:26168:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6aa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784189010.731314:0:26168:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a3fc1261/0xcc1762b626f8a926 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6aa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189010.731345:0:26168:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6aa:0x0].0x0 since=3252s v=(0 0) 00010000:00010000:3.0:1784189010.731348:0:26168:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6aa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784189010.731364:0:26168:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a3fc1261/0xcc1762b626f8a926 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189010.731374:0:26168:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a3fc1261/0xcc1762b626f8a926 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189010.731382:0:26168:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a3fc1261/0xcc1762b626f8a926 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189010.731395:0:26168:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a3fc1261/0xcc1762b626f8a926 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189010.731403:0:26168:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to regular blp list, 7 blwis in pool 00002000:00010000:3.0:1784189010.731439:0:26168:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6a9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1784189010.731598:0:26173:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc04a20a600 already unused, calling callback (ffffffffc0b2e230) 00010000:00010000:2.0:1784189010.731603:0:26173:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000051238ad7/0xcc1762b626f8a8f5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189010.731625:0:26173:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000051238ad7/0xcc1762b626f8a8f5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189010.731641:0:26173:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000051238ad7/0xcc1762b626f8a8f5 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189010.731648:0:26173:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000051238ad7/0xcc1762b626f8a8f5 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189010.731666:0:26173:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:2.0:1784189010.731670:0:26173:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a898aafb/0xcc1762b626f8a8fc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189010.731676:0:26173:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc081b16000 already unused, calling callback (ffffffffc0b2e230) 00010000:00010000:2.0:1784189010.731679:0:26173:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a898aafb/0xcc1762b626f8a8fc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189010.731685:0:26173:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a898aafb/0xcc1762b626f8a8fc lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189010.731694:0:26173:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a898aafb/0xcc1762b626f8a8fc lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189010.731701:0:26173:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a898aafb/0xcc1762b626f8a8fc lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189010.731725:0:26173:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:2.0:1784189010.731728:0:26173:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ea8c125d/0xcc1762b626f8a903 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189010.731734:0:26173:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc081b17e00 already unused, calling callback (ffffffffc0b2e230) 00010000:00010000:2.0:1784189010.731737:0:26173:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ea8c125d/0xcc1762b626f8a903 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189010.731744:0:26173:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ea8c125d/0xcc1762b626f8a903 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189010.731754:0:26173:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ea8c125d/0xcc1762b626f8a903 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189010.731761:0:26173:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ea8c125d/0xcc1762b626f8a903 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189010.731771:0:26173:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:2.0:1784189010.731774:0:26173:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000eb2a31c/0xcc1762b626f8a90a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189010.731779:0:26173:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc081b16a00 already unused, calling callback (ffffffffc0b2e230) 00010000:00010000:2.0:1784189010.731782:0:26173:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000eb2a31c/0xcc1762b626f8a90a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189010.731798:0:26173:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000eb2a31c/0xcc1762b626f8a90a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189010.731808:0:26173:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000eb2a31c/0xcc1762b626f8a90a lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189010.731815:0:26173:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000eb2a31c/0xcc1762b626f8a90a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189010.731827:0:26173:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1784189010.731830:0:26173:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000000b3a42a/0xcc1762b626f8a911 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189010.731836:0:26173:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc081b16c00 already unused, calling callback (ffffffffc0b2e230) 00010000:00010000:2.0:1784189010.731839:0:26173:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000000b3a42a/0xcc1762b626f8a911 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189010.731846:0:26173:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000000b3a42a/0xcc1762b626f8a911 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189010.731855:0:26173:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000000b3a42a/0xcc1762b626f8a911 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189010.731862:0:26173:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000000b3a42a/0xcc1762b626f8a911 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189010.731882:0:26173:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1784189010.731885:0:26173:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e61abee3/0xcc1762b626f8a918 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189010.731892:0:26173:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc081b16600 already unused, calling callback (ffffffffc0b2e230) 00010000:00010000:2.0:1784189010.731895:0:26173:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e61abee3/0xcc1762b626f8a918 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189010.731903:0:26173:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e61abee3/0xcc1762b626f8a918 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189010.731913:0:26173:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e61abee3/0xcc1762b626f8a918 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189010.731920:0:26173:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e61abee3/0xcc1762b626f8a918 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189010.731929:0:26173:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1784189010.731932:0:26173:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003854658c/0xcc1762b626f8a91f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189010.731937:0:26173:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc081b17000 already unused, calling callback (ffffffffc0b2e230) 00010000:00010000:2.0:1784189010.731940:0:26173:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003854658c/0xcc1762b626f8a91f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189010.731955:0:26173:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003854658c/0xcc1762b626f8a91f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189010.731965:0:26173:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003854658c/0xcc1762b626f8a91f lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189010.731972:0:26173:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003854658c/0xcc1762b626f8a91f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189010.731982:0:26173:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784189010.731985:0:26173:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a3fc1261/0xcc1762b626f8a926 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189010.731991:0:26173:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc081b16400 already unused, calling callback (ffffffffc0b2e230) 00010000:00010000:2.0:1784189010.731994:0:26173:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a3fc1261/0xcc1762b626f8a926 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189010.732001:0:26173:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a3fc1261/0xcc1762b626f8a926 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189010.732010:0:26173:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a3fc1261/0xcc1762b626f8a926 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189010.732017:0:26173:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a3fc1261/0xcc1762b626f8a926 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189010.732037:0:26173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784189010.732038:0:26173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784189010.732040:0:26173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784189010.732303:0:7454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784189010.732309:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784189010.732313:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784189010.734349:0:26168:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000068daad26/0xcc1762b626f8a92d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6a9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189010.734382:0:26168:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6a9:0x0].0x0 since=3252s v=(0 0) 00010000:00010000:3.0:1784189010.734387:0:26168:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6a9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784189010.734394:0:26168:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000068daad26/0xcc1762b626f8a92d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189010.734407:0:26168:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000068daad26/0xcc1762b626f8a92d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189010.734417:0:26168:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000068daad26/0xcc1762b626f8a92d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189010.734425:0:26168:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000068daad26/0xcc1762b626f8a92d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189010.734512:0:26168:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1784189010.734613:0:26168:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6a8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784189010.734618:0:26168:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f572eac6/0xcc1762b626f8a934 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6a8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189010.734633:0:26168:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6a8:0x0].0x0 since=3252s v=(0 0) 00010000:00010000:3.0:1784189010.734636:0:26168:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6a8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784189010.734640:0:26168:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f572eac6/0xcc1762b626f8a934 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189010.734649:0:26168:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f572eac6/0xcc1762b626f8a934 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189010.734656:0:26168:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f572eac6/0xcc1762b626f8a934 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189010.734662:0:26168:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f572eac6/0xcc1762b626f8a934 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189010.734679:0:26168:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:3.0:1784189010.734719:0:26168:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6a7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784189010.734725:0:26168:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d0a53c2a/0xcc1762b626f8a93b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6a7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189010.734731:0:26168:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6a7:0x0].0x0 since=3252s v=(0 0) 00010000:00010000:3.0:1784189010.734734:0:26168:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6a7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784189010.734738:0:26168:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d0a53c2a/0xcc1762b626f8a93b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189010.734745:0:26168:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d0a53c2a/0xcc1762b626f8a93b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189010.734763:0:26168:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d0a53c2a/0xcc1762b626f8a93b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189010.734769:0:26168:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d0a53c2a/0xcc1762b626f8a93b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189010.734779:0:26168:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:3.0:1784189010.734818:0:26168:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6a6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784189010.734824:0:26168:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c63cc5e6/0xcc1762b626f8a942 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6a6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189010.734831:0:26168:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6a6:0x0].0x0 since=3252s v=(0 0) 00010000:00010000:3.0:1784189010.734834:0:26168:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6a6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784189010.734838:0:26168:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c63cc5e6/0xcc1762b626f8a942 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189010.734847:0:26168:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c63cc5e6/0xcc1762b626f8a942 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189010.734855:0:26168:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c63cc5e6/0xcc1762b626f8a942 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189010.734862:0:26168:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c63cc5e6/0xcc1762b626f8a942 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189010.734884:0:26168:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00010000:00010000:1.0:1784189010.735166:0:6502:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:1.0:1784189010.735173:0:6502:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000068daad26/0xcc1762b626f8a92d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189010.735182:0:6502:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc081b16200 already unused, calling callback (ffffffffc0b2e230) 00010000:00010000:1.0:1784189010.735187:0:6502:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000068daad26/0xcc1762b626f8a92d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189010.735195:0:6502:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000068daad26/0xcc1762b626f8a92d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189010.735211:0:6502:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000068daad26/0xcc1762b626f8a92d lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189010.735231:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000068daad26/0xcc1762b626f8a92d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189010.735248:0:6502:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1784189010.735251:0:6502:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f572eac6/0xcc1762b626f8a934 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189010.735258:0:6502:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc081b17200 already unused, calling callback (ffffffffc0b2e230) 00010000:00010000:1.0:1784189010.735261:0:6502:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f572eac6/0xcc1762b626f8a934 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189010.735268:0:6502:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f572eac6/0xcc1762b626f8a934 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189010.735278:0:6502:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f572eac6/0xcc1762b626f8a934 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189010.735285:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f572eac6/0xcc1762b626f8a934 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189010.735296:0:6502:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1784189010.735299:0:6502:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d0a53c2a/0xcc1762b626f8a93b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189010.735306:0:6502:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc081b16800 already unused, calling callback (ffffffffc0b2e230) 00010000:00010000:1.0:1784189010.735316:0:6502:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d0a53c2a/0xcc1762b626f8a93b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189010.735343:0:6502:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d0a53c2a/0xcc1762b626f8a93b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189010.735365:0:6502:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d0a53c2a/0xcc1762b626f8a93b lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189010.735372:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d0a53c2a/0xcc1762b626f8a93b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189010.735386:0:6502:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784189010.735389:0:6502:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c63cc5e6/0xcc1762b626f8a942 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189010.735395:0:6502:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc081b17c00 already unused, calling callback (ffffffffc0b2e230) 00010000:00010000:1.0:1784189010.735398:0:6502:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c63cc5e6/0xcc1762b626f8a942 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189010.735405:0:6502:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c63cc5e6/0xcc1762b626f8a942 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189010.735415:0:6502:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c63cc5e6/0xcc1762b626f8a942 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189010.735422:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c63cc5e6/0xcc1762b626f8a942 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189010.735511:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784189010.735514:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784189010.735516:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784189010.735522:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1784189010.735602:0:26168:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6a5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784189010.735607:0:26168:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003b89c8b1/0xcc1762b626f8a949 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6a5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189010.735617:0:26168:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6a5:0x0].0x0 since=3252s v=(0 0) 00010000:00010000:3.0:1784189010.735621:0:26168:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6a5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784189010.735626:0:26168:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003b89c8b1/0xcc1762b626f8a949 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189010.735634:0:26168:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003b89c8b1/0xcc1762b626f8a949 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189010.735642:0:26168:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003b89c8b1/0xcc1762b626f8a949 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189010.735648:0:26168:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003b89c8b1/0xcc1762b626f8a949 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189010.735764:0:26168:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1784189010.735812:0:26168:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6a4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784189010.735817:0:26168:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000045e176f4/0xcc1762b626f8a950 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6a4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189010.735825:0:26168:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6a4:0x0].0x0 since=3252s v=(0 0) 00010000:00010000:3.0:1784189010.735833:0:26168:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6a4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784189010.735837:0:26168:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000045e176f4/0xcc1762b626f8a950 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189010.735846:0:26168:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000045e176f4/0xcc1762b626f8a950 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189010.735854:0:26168:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000045e176f4/0xcc1762b626f8a950 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189010.735861:0:26168:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000045e176f4/0xcc1762b626f8a950 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189010.739213:0:6502:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1784189010.739228:0:6502:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003b89c8b1/0xcc1762b626f8a949 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189010.739243:0:6502:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc081b17600 already unused, calling callback (ffffffffc0b2e230) 00010000:00010000:1.0:1784189010.739249:0:6502:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003b89c8b1/0xcc1762b626f8a949 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189010.739260:0:6502:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003b89c8b1/0xcc1762b626f8a949 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189010.739280:0:6502:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003b89c8b1/0xcc1762b626f8a949 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189010.739287:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003b89c8b1/0xcc1762b626f8a949 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189010.739329:0:6502:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784189010.739333:0:6502:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000045e176f4/0xcc1762b626f8a950 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189010.739340:0:6502:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc081b17400 already unused, calling callback (ffffffffc0b2e230) 00010000:00010000:1.0:1784189010.739931:0:6502:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000045e176f4/0xcc1762b626f8a950 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189010.739941:0:6502:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000045e176f4/0xcc1762b626f8a950 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x6a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189010.739953:0:6502:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000045e176f4/0xcc1762b626f8a950 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x6a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189010.739961:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784189010.739962:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784189010.739964:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784189010.740666:0:26173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784189010.743538:0:26168:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1784189010.743552:0:26168:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000045e176f4/0xcc1762b626f8a950 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189010.744157:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784189010.749560:0:7454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1784189010.749973:0:26168:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6a3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784189010.749981:0:26168:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000091e65e04/0xcc1762b626f8a957 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6a3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189010.749998:0:26168:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6a3:0x0].0x0 since=3252s v=(0 0) 00010000:00010000:3.0:1784189010.750003:0:26168:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6a3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784189010.750010:0:26168:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000091e65e04/0xcc1762b626f8a957 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189010.750025:0:26168:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000091e65e04/0xcc1762b626f8a957 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189010.750040:0:26168:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000091e65e04/0xcc1762b626f8a957 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189010.750048:0:26168:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000091e65e04/0xcc1762b626f8a957 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189010.750073:0:26168:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1784189010.750113:0:26168:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6a2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784189010.750118:0:26168:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d288a1db/0xcc1762b626f8a95e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6a2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189010.750125:0:26168:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6a2:0x0].0x0 since=3252s v=(0 0) 00010000:00010000:3.0:1784189010.750128:0:26168:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6a2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784189010.750132:0:26168:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d288a1db/0xcc1762b626f8a95e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189010.750140:0:26168:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d288a1db/0xcc1762b626f8a95e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189010.750148:0:26168:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d288a1db/0xcc1762b626f8a95e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189010.750155:0:26168:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d288a1db/0xcc1762b626f8a95e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189010.750182:0:26168:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1784189010.750675:0:6502:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1784189010.750683:0:6502:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000091e65e04/0xcc1762b626f8a957 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189010.750691:0:6502:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc081b16e00 already unused, calling callback (ffffffffc0b2e230) 00010000:00010000:0.0:1784189010.750695:0:6502:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000091e65e04/0xcc1762b626f8a957 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189010.750703:0:6502:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000091e65e04/0xcc1762b626f8a957 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189010.750718:0:6502:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000091e65e04/0xcc1762b626f8a957 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189010.750726:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000091e65e04/0xcc1762b626f8a957 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189010.750742:0:6502:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784189010.750746:0:6502:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d288a1db/0xcc1762b626f8a95e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189010.750757:0:6502:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc081b17a00 already unused, calling callback (ffffffffc0b2e230) 00010000:00010000:0.0:1784189010.750761:0:6502:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d288a1db/0xcc1762b626f8a95e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189010.750768:0:6502:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d288a1db/0xcc1762b626f8a95e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189010.750779:0:6502:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d288a1db/0xcc1762b626f8a95e lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189010.750785:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d288a1db/0xcc1762b626f8a95e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189010.750797:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784189010.750798:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784189010.750800:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784189010.750839:0:26173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:3.0:1784189010.750928:0:26168:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x2c0000401:1666 00000100:00100000:3.0:1784189010.751018:0:26168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf48599f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+5:85098:x1870854458034176:12345-0@lo:5:osp-pre-1-0.0 Request processed in 93275us (97967us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189010.751029:0:26168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4922 00000100:00100000:2.0:1784189010.751111:0:85098:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf48598380 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:85098:1870854458034176:0@lo:5:osp-pre-1-0.0 00000004:00080000:2.0:1784189010.751125:0:85098:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x2c0000401:0x6c1:0x0] from OST, last_created [0x2c0000401:0x6c1:0x0]last_used is [0x2c0000401:0x682:0x0] 00000100:00100000:3.0:1784189010.751196:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1784189010.751233:0:85098:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc06bbf0380 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:85098:1870854458034688:0@lo:5:osp-pre-1-0.0 00000100:00100000:2.0:1784189010.751272:0:85098:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784189010.751302:0:85098:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dbf437c49c0 going to sleep for 11 seconds 00000100:00100000:0.0:1784189010.751409:0:26223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458034688 00000100:00100000:0.0:1784189010.751415:0:26223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458034688 00000100:00100000:0.0:1784189010.751526:0:26223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4924 00000100:00100000:0.0:1784189010.751536:0:26223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc06bbf3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0000-mdtlov_UUID+5:85098:x1870854458034688:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:0.0:1784189010.751573:0:26223:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000401 at 1730 00000100:00100000:0.0:1784189010.754367:0:26223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc06bbf3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0000-mdtlov_UUID+6:85098:x1870854458034688:12345-0@lo:5:osp-pre-1-0.0 Request processed in 2816us (3079us total) trans 4294968952 rc 0/0 00000100:00100000:0.0:1784189010.754379:0:26223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4924 00000100:00100000:3.0:1784189010.754546:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc06bbf3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1870854458034560:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1784189010.754586:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784189010.756517:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458034560 00000100:00100000:0.0:1784189010.756536:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458034560 00000100:00100000:0.0:1784189010.756598:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1843 00000100:00100000:0.0:1784189010.756608:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc056eace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3643:x1870854458034560:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1784189010.756633:0:8432:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 213696 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1784189010.756710:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc056eace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3643:x1870854458034560:12345-0@lo:13:osp-pre-1-0.0 Request processed in 104us (2122us total) trans 0 rc 0/0 00000100:00100000:0.0:1784189010.756716:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1843 00000100:00100000:2.0:1784189010.756744:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc06bbf3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1870854458034560:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1784189010.757604:0:85098:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc06bbf0380 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:85098:1870854458034688:0@lo:5:osp-pre-1-0.0 00000004:00080000:1.0:1784189010.757617:0:85098:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x2c0000401:0x6c1:0x0]-[0x2c0000401:0x6e1:0x0] 00000100:00100000:1.0:1784189011.240170:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1784189011.240211:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1784189011.240246:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1784189011.240366:0:66945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436233344 00000100:00100000:0.0:1784189011.240375:0:66945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436233344 00000100:00100000:0.0:1784189011.240439:0:66945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436233216 00000100:00100000:0.0:1784189011.240451:0:66945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436233216 00000100:00100000:0.0:1784189011.240472:0:66945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 998 00000100:00100000:0.0:1784189011.240481:0:66945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf48598380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+6:2399:x1870854436233344:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:0.0:1784189011.240560:0:66945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf48598380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+6:2399:x1870854436233344:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 70us (338us total) trans 0 rc 0/0 00000100:00100000:0.0:1784189011.240568:0:66945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 998 00000100:00100000:0.0:1784189011.240585:0:66945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 999 00000100:00100000:0.0:1784189011.240592:0:66945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf48599880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+6:2399:x1870854436233216:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:0.0:1784189011.240619:0:66945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf48599880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+6:2399:x1870854436233216:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 27us (372us total) trans 0 rc 0/0 00000100:00100000:0.0:1784189011.240625:0:66945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 999 00000100:00080000:1.0:1784189011.241114:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1784189011.241233:0:85085:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436233088 00000100:00100000:3.0:1784189011.241239:0:85085:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436233088 00000100:00100000:3.0:1784189011.241281:0:85085:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 76 00000100:00100000:3.0:1784189011.241288:0:85085:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc07138e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9957a2dc-fd88-4a91-bca3-e2b7f365ab0c+10:2399:x1870854436233088:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:3.0:1784189011.241365:0:85085:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc07138e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9957a2dc-fd88-4a91-bca3-e2b7f365ab0c+10:2399:x1870854436233088:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 76us (1203us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189011.241371:0:85085:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 76 00010000:00010000:1.0:1784189011.699819:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784189012.592151:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1784189012.592426:0:66171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436233472 00000100:00100000:0.0:1784189012.592436:0:66171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436233472 00000100:00080000:1.0:1784189012.592509:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1784189012.592515:0:66171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1066 00000100:00100000:0.0:1784189012.592527:0:66171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc056eadf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+6:65229:x1870854436233472:12345-192.168.203.12@tcp:101:lfs.0 00010000:00010000:0.0:1784189012.592546:0:66171:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784189012.592582:0:66171:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc070147c00/0xcc1762b626f8a965 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbfc5de7fe6c3cea expref: -99 pid: 66171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189012.592647:0:66171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc070147e00/0xcc1762b626f8a96c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189012.592661:0:66171:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc070147e00/0xcc1762b626f8a96c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189012.592673:0:66171:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc070147e00/0xcc1762b626f8a96c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784189012.592732:0:66171:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1784189012.592736:0:66171:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1784189012.592757:0:66171:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9dc070147e00/0xcc1762b626f8a96c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189012.592780:0:66171:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc070147c00/0xcc1762b626f8a965 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c3cea expref: 8 pid: 66171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189012.592797:0:66171:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc070147e00/0xcc1762b626f8a96c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c3cea expref: 7 pid: 66171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189012.592966:0:66171:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9dc056eaa500) 00010000:00010000:0.0:1784189012.592969:0:66171:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1784189012.592973:0:66171:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc070147e00, rc 0) 00000100:00100000:0.0:1784189012.593036:0:66171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc056eadf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+7:65229:x1870854436233472:12345-192.168.203.12@tcp:101:lfs.0 Request processed in 511us (893us total) trans 0 rc 0/0 00000100:00100000:0.0:1784189012.593043:0:66171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1066 00000100:00100000:1.0:1784189012.598978:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1784189012.599827:0:66169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436233600 00000100:00100000:2.0:1784189012.599838:0:66169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436233600 00000100:00100000:2.0:1784189012.599942:0:66169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1067 00000100:00100000:2.0:1784189012.599953:0:66169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf48598e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+7:65229:x1870854436233600:12345-192.168.203.12@tcp:41:lfs.0 00000004:00000024:2.0:1784189012.600002:0:66169:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445289984 avail 1299050496 00000100:00100000:2.0:1784189012.600082:0:66169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf48598e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+7:65229:x1870854436233600:12345-192.168.203.12@tcp:41:lfs.0 Request processed in 130us (1112us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189012.600089:0:66169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1067 00000100:00100000:3.0:1784189012.603295:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1784189012.610596:0:68287:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436233728 00000100:00100000:1.0:1784189012.610610:0:68287:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436233728 00000100:00100000:1.0:1784189012.610687:0:68287:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1068 00000100:00100000:1.0:1784189012.610697:0:68287:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc056eae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+6:65229:x1870854436233728:12345-192.168.203.12@tcp:41:lfs.0 00000004:00000024:1.0:1784189012.610733:0:68287:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445576704 avail 1299337216 00000100:00100000:1.0:1784189012.610817:0:68287:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc056eae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+6:65229:x1870854436233728:12345-192.168.203.12@tcp:41:lfs.0 Request processed in 122us (7533us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189012.610826:0:68287:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1068 00000100:00100000:3.0:1784189012.614636:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1784189012.615087:0:26163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436233856 00000100:00100000:2.0:1784189012.615096:0:26163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436233856 00000100:00100000:2.0:1784189012.615141:0:26163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 4925 00000100:00100000:2.0:1784189012.615149:0:26163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc056ead880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:0+-99:2395:x1870854436233856:12345-192.168.203.12@tcp:8:lfs.0 00010000:00080000:2.0:1784189012.615181:0:26163:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0000: connection from b90fcc1c-0e69-42a4-a116-a71fec7aeb78@192.168.203.12@tcp t0 exp 0000000000000000 cur 3254 last 0 00000020:00000080:2.0:1784189012.615221:0:26163:0:(genops.c:1406:class_connect()) connect: client b90fcc1c-0e69-42a4-a116-a71fec7aeb78, cookie 0xcc1762b626f8a973 00002000:00100000:2.0:1784189012.615233:0:26163:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli b90fcc1c-0e69-42a4-a116-a71fec7aeb78/ffff9dbf43fc9000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 21136a2 ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1784189012.615250:0:26163:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:2.0:1784189012.615309:0:26163:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1784189012.615469:0:26163:0:(import.c:65:import_set_state_nolock()) ffff9dbf43fcb000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1784189012.615533:0:26163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc056ead880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+6:2395:x1870854436233856:12345-192.168.203.12@tcp:8:lfs.0 Request processed in 383us (905us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189012.615541:0:26163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 4925 00000100:00100000:1.0:1784189012.622832:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1784189012.623061:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436233984 00000100:00100000:3.0:1784189012.623071:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436233984 00000100:00100000:3.0:1784189012.623188:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1844 00000100:00100000:3.0:1784189012.623198:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf4859ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+6:65229:x1870854436233984:12345-192.168.203.12@tcp:13:lfs.0 00002000:00000024:3.0:1784189012.623223:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8651456 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1784189012.623289:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf4859ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+6:65229:x1870854436233984:12345-192.168.203.12@tcp:13:lfs.0 Request processed in 93us (466us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189012.623313:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1844 00000100:00080000:1.0:1784189012.624081:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1784189012.636951:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1784189012.637106:0:26170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436234112 00000100:00100000:2.0:1784189012.637115:0:26170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436234112 00000100:00100000:2.0:1784189012.637160:0:26170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 4926 00000100:00100000:2.0:1784189012.637167:0:26170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc080f6a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:0+-99:2395:x1870854436234112:12345-192.168.203.12@tcp:8:lfs.0 00010000:00080000:2.0:1784189012.637201:0:26170:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0001: connection from b90fcc1c-0e69-42a4-a116-a71fec7aeb78@192.168.203.12@tcp t0 exp 0000000000000000 cur 3254 last 0 00000020:00000080:2.0:1784189012.637227:0:26170:0:(genops.c:1406:class_connect()) connect: client b90fcc1c-0e69-42a4-a116-a71fec7aeb78, cookie 0xcc1762b626f8a97a 00002000:00100000:2.0:1784189012.637238:0:26170:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli b90fcc1c-0e69-42a4-a116-a71fec7aeb78/ffff9dbf43fcc000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 21136a2 ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1784189012.637254:0:26170:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1784189012.637313:0:26170:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1784189012.637594:0:26170:0:(import.c:65:import_set_state_nolock()) ffff9dbf43fce000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1784189012.637655:0:26170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc080f6a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+6:2395:x1870854436234112:12345-192.168.203.12@tcp:8:lfs.0 Request processed in 485us (711us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189012.637662:0:26170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 4926 00000100:00100000:0.0:1784189012.640221:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1784189012.640613:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436234240 00000100:00100000:2.0:1784189012.640622:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436234240 00000100:00100000:2.0:1784189012.640695:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1845 00000100:00100000:2.0:1784189012.640704:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc080f6bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+6:65229:x1870854436234240:12345-192.168.203.12@tcp:13:lfs.0 00002000:00000024:2.0:1784189012.640741:0:8432:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8651456 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1784189012.640802:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc080f6bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+6:65229:x1870854436234240:12345-192.168.203.12@tcp:13:lfs.0 Request processed in 99us (589us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189012.640809:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1845 00000100:00080000:3.0:1784189012.642055:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1784189012.719602:0:7454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784189013.039621:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc06bbf3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1870854458034816:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1784189013.039691:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784189013.039783:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458034816 00000100:00100000:0.0:1784189013.039790:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458034816 00000100:00100000:0.0:1784189013.039853:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1846 00000100:00100000:0.0:1784189013.039862:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc056eaea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1870854458034816:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1784189013.039884:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8651456 pending 0 free 3923529728 avail 3692007424 00000100:00080000:1.0:1784189013.040029:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1784189013.040169:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc080f6ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1870854458034944:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1784189013.040200:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784189013.040237:0:9466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458034944 00000100:00100000:1.0:1784189013.040241:0:9466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458034944 00000100:00100000:1.0:1784189013.040267:0:9466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1847 00000100:00100000:1.0:1784189013.040273:0:9466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc080f6c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1870854458034944:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1784189013.040284:0:9466:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8651456 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1784189013.040359:0:9466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc080f6c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1870854458034944:12345-0@lo:13:osp-pre-1-1.0 Request processed in 85us (158us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189013.040366:0:9466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1847 00000100:00080000:1.0:1784189013.040383:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1784189013.040417:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc080f6ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1870854458034944:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1784189013.044714:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc056eaea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1870854458034816:12345-0@lo:13:osp-pre-0-1.0 Request processed in 4844us (5014us total) trans 0 rc 0/0 00000100:00100000:0.0:1784189013.044728:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1846 00000100:00100000:3.0:1784189013.049874:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc06bbf3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1870854458034816:0@lo:13:osp-pre-0-1.0 00010000:00010000:0.0:1784189013.744512:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784189014.767971:0:26173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784189015.600959:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc06bbf0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3643:1870854458035328:0@lo:400:kworker.0 00000100:00100000:2.0:1784189015.601026:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784189015.601063:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc07016df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1870854458035840:0@lo:400:kworker.0 00000100:00100000:2.0:1784189015.601088:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784189015.601117:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc07016f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1870854458036352:0@lo:400:kworker.0 00000100:00100000:2.0:1784189015.601137:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784189015.601161:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:2.0:1784189015.601167:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc06bbf3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3643:1870854458035200:0@lo:400:kworker.0 00000100:00100000:2.0:1784189015.601188:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784189015.601206:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc07016f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1870854458035712:0@lo:400:kworker.0 00000100:00100000:2.0:1784189015.601227:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784189015.601245:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc07016e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1870854458036224:0@lo:400:kworker.0 00000100:00100000:2.0:1784189015.601276:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784189015.601313:0:26162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458035840 00000100:00100000:2.0:1784189015.601352:0:26162:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458035840 00000100:00100000:2.0:1784189015.601401:0:26162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458036352 00000100:00100000:2.0:1784189015.601615:0:26162:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458036352 00000100:00100000:2.0:1784189015.601655:0:26162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2309 00000100:00100000:2.0:1784189015.601663:0:26162:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc075f7f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:3643:x1870854458035840:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784189015.601711:0:26162:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc075f7f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:3643:x1870854458035840:12345-0@lo:400:kworker.0 Request processed in 49us (621us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189015.601732:0:26162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2309 00000100:00100000:2.0:1784189015.601749:0:26162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2310 00000100:00100000:2.0:1784189015.601755:0:26162:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc075f7f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+6:3643:x1870854458036352:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784189015.601784:0:26162:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc075f7f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+6:3643:x1870854458036352:12345-0@lo:400:kworker.0 Request processed in 31us (647us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189015.601790:0:26162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2310 00000100:00100000:2.0:1784189015.601812:0:23826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458035712 00000100:00100000:2.0:1784189015.601815:0:23826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458035712 00000100:00100000:2.0:1784189015.601838:0:23826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458036224 00000100:00100000:2.0:1784189015.601841:0:23826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458036224 00000100:00100000:2.0:1784189015.601857:0:23826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3705 00000100:00100000:2.0:1784189015.601863:0:23826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc075f7ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3643:x1870854458035712:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784189015.601893:0:23826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc075f7ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3643:x1870854458035712:12345-0@lo:400:kworker.0 Request processed in 30us (665us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189015.601899:0:23826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3705 00000100:00100000:2.0:1784189015.601910:0:23826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3706 00000100:00100000:2.0:1784189015.601916:0:23826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc075f7f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3643:x1870854458036224:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784189015.601941:0:23826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc075f7f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3643:x1870854458036224:12345-0@lo:400:kworker.0 Request processed in 25us (664us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189015.601948:0:23826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3706 00000100:00100000:2.0:1784189015.606511:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc07016f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1870854458035712:0@lo:400:kworker.0 00000100:00100000:2.0:1784189015.606531:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc07016e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1870854458036224:0@lo:400:kworker.0 00000100:00100000:2.0:1784189015.606545:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc07016df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1870854458035840:0@lo:400:kworker.0 00000100:00100000:2.0:1784189015.606557:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc07016f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1870854458036352:0@lo:400:kworker.0 00000100:00100000:2.0:1784189015.606588:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1784189015.606607:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc056eaed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1870854458036736:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1784189015.606672:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784189015.606715:0:23826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458036736 00000100:00100000:2.0:1784189015.606721:0:23826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458036736 00000100:00100000:2.0:1784189015.606761:0:23826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3707 00000100:00100000:2.0:1784189015.606769:0:23826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc075f7c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3643:x1870854458036736:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1784189015.606802:0:23826:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445576704 avail 1299337216 00000100:00100000:2.0:1784189015.606844:0:23826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc075f7c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3643:x1870854458036736:12345-0@lo:41:osp-pre-1-0.0 Request processed in 75us (171us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189015.606852:0:23826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3707 00000100:00100000:2.0:1784189015.606887:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc056eaed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1870854458036736:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1784189015.610586:0:68287:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458035328 00000100:00100000:2.0:1784189015.610602:0:68287:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458035328 00000100:00100000:2.0:1784189015.610670:0:68287:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458035200 00000100:00100000:2.0:1784189015.610673:0:68287:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458035200 00000100:00100000:2.0:1784189015.610700:0:68287:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1000 00000100:00100000:2.0:1784189015.610713:0:68287:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc075f7e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1870854458035328:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784189015.610806:0:68287:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc075f7e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1870854458035328:12345-0@lo:400:kworker.0 Request processed in 97us (9779us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189015.610814:0:68287:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1000 00000100:00100000:2.0:1784189015.610832:0:68287:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1001 00000100:00100000:2.0:1784189015.610838:0:68287:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc075f7ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1870854458035200:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784189015.610868:0:68287:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc075f7ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1870854458035200:12345-0@lo:400:kworker.0 Request processed in 31us (9679us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189015.610874:0:68287:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1001 00000100:00100000:2.0:1784189015.610918:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc06bbf2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3640:1870854458035456:0@lo:400:kworker.0 00000100:00100000:2.0:1784189015.610956:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784189015.610984:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc07016c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1870854458035968:0@lo:400:kworker.0 00000100:00100000:2.0:1784189015.611008:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784189015.611025:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc07016ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1870854458036480:0@lo:400:kworker.0 00000100:00100000:2.0:1784189015.611044:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784189015.611062:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [1->0] 00000100:00100000:2.0:1784189015.611068:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc06bbf1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bd553d0d-03e2-4233-b06b-b55bbfa2b954:3640:1870854458035072:0@lo:400:kworker.0 00000100:00100000:2.0:1784189015.611093:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784189015.611134:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc06bbf3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3640:1870854458035584:0@lo:400:kworker.0 00000100:00100000:2.0:1784189015.611155:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784189015.611169:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc07016d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3640:1870854458036096:0@lo:400:kworker.0 00000100:00100000:2.0:1784189015.611191:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784189015.611202:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc07016fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3640:1870854458036608:0@lo:400:kworker.0 00000100:00100000:2.0:1784189015.611225:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784189015.611246:0:66945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458035456 00000100:00100000:2.0:1784189015.611250:0:66945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458035456 00000100:00100000:2.0:1784189015.611271:0:66945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458035584 00000100:00100000:2.0:1784189015.611274:0:66945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458035584 00000100:00100000:2.0:1784189015.611286:0:66945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458036096 00000100:00100000:2.0:1784189015.611288:0:66945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458036096 00000100:00100000:2.0:1784189015.611299:0:66945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458036608 00000100:00100000:2.0:1784189015.611302:0:66945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458036608 00000100:00100000:2.0:1784189015.611349:0:66945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1002 00000100:00100000:2.0:1784189015.611358:0:66945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc075f7d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3640:x1870854458035456:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784189015.611399:0:66945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc075f7d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3640:x1870854458035456:12345-0@lo:400:kworker.0 Request processed in 42us (442us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189015.611415:0:66945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1002 00000100:00100000:2.0:1784189015.611429:0:66945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1003 00000100:00100000:2.0:1784189015.611436:0:66945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc075f7ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1870854458035584:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784189015.611465:0:66945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc075f7ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1870854458035584:12345-0@lo:400:kworker.0 Request processed in 30us (309us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189015.611471:0:66945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1003 00000100:00100000:2.0:1784189015.611483:0:66945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1004 00000100:00100000:2.0:1784189015.611489:0:66945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc075f7e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1870854458036096:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784189015.611513:0:66945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc075f7e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1870854458036096:12345-0@lo:400:kworker.0 Request processed in 25us (321us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189015.611518:0:66945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1004 00000100:00100000:2.0:1784189015.611530:0:66945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1005 00000100:00100000:2.0:1784189015.611536:0:66945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc075f7ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1870854458036608:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784189015.611563:0:66945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc075f7ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1870854458036608:12345-0@lo:400:kworker.0 Request processed in 27us (336us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189015.611568:0:66945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1005 00000100:00100000:2.0:1784189015.611590:0:26161:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458035968 00000100:00100000:2.0:1784189015.611593:0:26161:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458035968 00000100:00100000:2.0:1784189015.611617:0:26161:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458036480 00000100:00100000:2.0:1784189015.611620:0:26161:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458036480 00000100:00100000:2.0:1784189015.611641:0:26161:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2311 00000100:00100000:2.0:1784189015.611648:0:26161:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc075f7c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:3640:x1870854458035968:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784189015.611675:0:26161:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc075f7c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:3640:x1870854458035968:12345-0@lo:400:kworker.0 Request processed in 28us (666us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189015.611681:0:26161:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2311 00000100:00100000:2.0:1784189015.611701:0:26161:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2312 00000100:00100000:2.0:1784189015.611707:0:26161:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc075f7c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+6:3640:x1870854458036480:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784189015.611736:0:26161:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc075f7c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+6:3640:x1870854458036480:12345-0@lo:400:kworker.0 Request processed in 30us (691us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189015.611742:0:26161:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2312 00000100:00100000:2.0:1784189015.611762:0:85083:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458035072 00000100:00100000:2.0:1784189015.611765:0:85083:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458035072 00000100:00100000:2.0:1784189015.611790:0:85083:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1784189015.611796:0:85083:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc056a55850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd553d0d-03e2-4233-b06b-b55bbfa2b954+24:3640:x1870854458035072:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784189015.611823:0:85083:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc056a55850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd553d0d-03e2-4233-b06b-b55bbfa2b954+24:3640:x1870854458035072:12345-0@lo:400:kworker.0 Request processed in 27us (729us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189015.611828:0:85083:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1784189015.611889:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc06bbf1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bd553d0d-03e2-4233-b06b-b55bbfa2b954:3640:1870854458035072:0@lo:400:kworker.0 00000100:00100000:2.0:1784189015.611902:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc06bbf3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3640:1870854458035584:0@lo:400:kworker.0 00000100:00100000:2.0:1784189015.611910:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc07016d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3640:1870854458036096:0@lo:400:kworker.0 00000100:00100000:2.0:1784189015.611919:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc07016fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3640:1870854458036608:0@lo:400:kworker.0 00000100:00100000:2.0:1784189015.611927:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc06bbf2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3640:1870854458035456:0@lo:400:kworker.0 00000100:00100000:2.0:1784189015.611935:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc07016c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1870854458035968:0@lo:400:kworker.0 00000100:00100000:2.0:1784189015.611943:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc07016ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1870854458036480:0@lo:400:kworker.0 00000100:00100000:2.0:1784189015.611981:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc06bbf3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3643:1870854458035200:0@lo:400:kworker.0 00000100:00100000:2.0:1784189015.611992:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc06bbf0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3643:1870854458035328:0@lo:400:kworker.0 00000100:00080000:1.0:1784189015.615168:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1784189015.615186:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1784189015.615189:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1784189015.615192:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1784189015.793543:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784189016.111652:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc075f7d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1870854458036864:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1784189016.111721:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784189016.111775:0:9466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458036864 00000100:00100000:2.0:1784189016.111785:0:9466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458036864 00000100:00100000:2.0:1784189016.111834:0:9466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1848 00000100:00100000:2.0:1784189016.111844:0:9466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc075f7d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3643:x1870854458036864:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1784189016.111874:0:9466:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8651456 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1784189016.111912:0:9466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc075f7d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3643:x1870854458036864:12345-0@lo:13:osp-pre-1-0.0 Request processed in 70us (191us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189016.111918:0:9466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1848 00000100:00100000:2.0:1784189016.111955:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc075f7d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1870854458036864:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1784189016.113620:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1784189016.113638:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc075f7d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1870854458036992:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1784189016.113692:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784189016.113732:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458036992 00000100:00100000:2.0:1784189016.113738:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458036992 00000100:00100000:2.0:1784189016.113776:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1849 00000100:00100000:2.0:1784189016.113783:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc06bbf0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3641:x1870854458036992:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1784189016.113809:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8651456 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1784189016.113847:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc06bbf0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3641:x1870854458036992:12345-0@lo:13:osp-pre-0-0.0 Request processed in 64us (155us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189016.113853:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1849 00000100:00100000:2.0:1784189016.113893:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc075f7d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1870854458036992:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1784189016.121268:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc06bbf3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1870854458037120:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1784189016.121381:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784189016.121825:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458037120 00000100:00100000:2.0:1784189016.121834:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458037120 00000100:00100000:2.0:1784189016.121880:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3708 00000100:00100000:2.0:1784189016.121888:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc07cb4c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3641:x1870854458037120:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1784189016.121923:0:8439:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445289984 avail 1299050496 00000100:00100000:2.0:1784189016.121968:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc07cb4c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3641:x1870854458037120:12345-0@lo:41:osp-pre-0-1.0 Request processed in 80us (587us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189016.121975:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3708 00000100:00100000:2.0:1784189016.122275:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc06bbf3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1870854458037120:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1784189016.368107:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1784189016.368172:0:85084:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436234368 00000100:00100000:0.0:1784189016.368184:0:85084:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436234368 00000100:00100000:0.0:1784189016.368244:0:85084:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 78 00000100:00100000:0.0:1784189016.368255:0:85084:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc056a54850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9957a2dc-fd88-4a91-bca3-e2b7f365ab0c+10:2397:x1870854436234368:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:0.0:1784189016.368353:0:85084:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc056a54850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9957a2dc-fd88-4a91-bca3-e2b7f365ab0c+10:2397:x1870854436234368:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 99us (253us total) trans 0 rc 0/0 00000100:00100000:0.0:1784189016.368361:0:85084:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 78 00000100:00100000:0.0:1784189016.378039:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1784189016.378080:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1784189016.378104:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1784189016.378175:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1784189016.378209:0:66169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436234496 00000100:00100000:0.0:1784189016.378218:0:66169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436234496 00000100:00100000:0.0:1784189016.378280:0:66169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436234624 00000100:00100000:0.0:1784189016.378283:0:66169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436234624 00000100:00100000:0.0:1784189016.378305:0:66169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1006 00000100:00100000:0.0:1784189016.378342:0:66169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc080f68380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+7:2397:x1870854436234496:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:0.0:1784189016.378430:0:66169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc080f68380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+7:2397:x1870854436234496:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 116us (395us total) trans 0 rc 0/0 00000100:00100000:0.0:1784189016.378438:0:66169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1006 00000100:00100000:0.0:1784189016.378456:0:66169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1007 00000100:00100000:0.0:1784189016.378463:0:66169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc080f69880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+6:2396:x1870854436234624:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:0.0:1784189016.378490:0:66169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc080f69880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+6:2396:x1870854436234624:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 28us (409us total) trans 0 rc 0/0 00000100:00100000:0.0:1784189016.378496:0:66169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1007 00000100:00100000:0.0:1784189016.378517:0:26165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436234752 00000100:00100000:0.0:1784189016.378520:0:26165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436234752 00000100:00100000:0.0:1784189016.378544:0:26165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436234880 00000100:00100000:0.0:1784189016.378547:0:26165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436234880 00000100:00100000:0.0:1784189016.378569:0:26165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 2313 00000100:00100000:0.0:1784189016.378576:0:26165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc080f6b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+6:2396:x1870854436234752:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:0.0:1784189016.378600:0:26165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc080f6b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+6:2396:x1870854436234752:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 25us (496us total) trans 0 rc 0/0 00000100:00100000:0.0:1784189016.378606:0:26165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 2313 00000100:00100000:0.0:1784189016.378618:0:26165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 2314 00000100:00100000:0.0:1784189016.378624:0:26165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc080f6a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+6:2396:x1870854436234880:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:0.0:1784189016.378646:0:26165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc080f6a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+6:2396:x1870854436234880:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 22us (471us total) trans 0 rc 0/0 00000100:00100000:0.0:1784189016.378652:0:26165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 2314 00000100:00080000:1.0:1784189016.379055:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1784189016.379061:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1784189016.379063:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1784189016.379065:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00100000:0.0:1784189016.632137:0:9506:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of b90fcc1c-0e69-42a4-a116-a71fec7aeb78 00000001:00080000:0.0:1784189016.632163:0:9506:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294968952 is committed 00000001:00100000:1.0:1784189016.634169:0:8423:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of b90fcc1c-0e69-42a4-a116-a71fec7aeb78 00000001:00080000:1.0:1784189016.634185:0:8423:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294968948 is committed 00010000:00010000:0.0:1784189016.815471:0:7454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784189017.839785:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784189018.159606:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1784189018.159630:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc06bbf3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1870854458037248:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1784189018.159696:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784189018.159745:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458037248 00000100:00100000:2.0:1784189018.159751:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458037248 00000100:00100000:2.0:1784189018.159804:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1850 00000100:00100000:2.0:1784189018.159815:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc06bbf1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1870854458037248:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1784189018.159844:0:8432:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8651456 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1784189018.159885:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc06bbf1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1870854458037248:12345-0@lo:13:osp-pre-0-1.0 Request processed in 73us (189us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189018.159892:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1850 00000100:00080000:2.0:1784189018.159913:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1784189018.159947:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc06bbf3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1870854458037248:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1784189018.163728:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc06bbf3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1870854458037376:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1784189018.163799:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784189018.163885:0:9466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458037376 00000100:00100000:2.0:1784189018.163893:0:9466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458037376 00000100:00100000:2.0:1784189018.163953:0:9466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1851 00000100:00100000:2.0:1784189018.163964:0:9466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc056eac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1870854458037376:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1784189018.164006:0:9466:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8651456 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1784189018.164050:0:9466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc056eac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1870854458037376:12345-0@lo:13:osp-pre-1-1.0 Request processed in 88us (250us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189018.164058:0:9466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1851 00000100:00080000:3.0:1784189018.164123:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1784189018.164159:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc06bbf3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1870854458037376:0@lo:13:osp-pre-1-1.0 00000001:02000400:2.0:1784189018.618105:0:85660:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg312-client.virtnet: executing wait_import_state_mount (FULL|IDLE) mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 00010000:00010000:2.0:1784189018.863607:0:26173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784189019.895349:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1784189020.032148:0:85708:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: mdc.lustre-MDT0000-mdc-*.mds_server_uuid in FULL state after 0 sec 00000100:00100000:1.0:1784189020.720180:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc080f6aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3641:1870854458037632:0@lo:400:kworker.0 00000100:00100000:1.0:1784189020.720249:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784189020.720299:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc075663480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1870854458038144:0@lo:400:kworker.0 00000100:00100000:1.0:1784189020.720347:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784189020.720363:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc075663b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1870854458038656:0@lo:400:kworker.0 00000100:00100000:1.0:1784189020.720398:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784189020.720427:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [0->1] 00000100:00100000:1.0:1784189020.720433:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc080f6b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:bd553d0d-03e2-4233-b06b-b55bbfa2b954:3641:1870854458037504:0@lo:400:kworker.0 00000100:00100000:1.0:1784189020.720458:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784189020.720482:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc075661180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3641:1870854458038016:0@lo:400:kworker.0 00000100:00100000:1.0:1784189020.720500:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784189020.720516:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc075662300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3641:1870854458038528:0@lo:400:kworker.0 00000100:00100000:1.0:1784189020.720536:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784189020.720551:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc075662a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3641:1870854458039040:0@lo:400:kworker.0 00000100:00100000:1.0:1784189020.720573:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784189020.720595:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc075662d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3642:1870854458037760:0@lo:400:kworker.0 00000100:00100000:1.0:1784189020.720616:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784189020.720630:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc075661880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1870854458038272:0@lo:400:kworker.0 00000100:00100000:1.0:1784189020.720651:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784189020.720664:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc075662680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1870854458038784:0@lo:400:kworker.0 00000100:00100000:1.0:1784189020.720698:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784189020.720717:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1784189020.720722:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc075663800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3642:1870854458037888:0@lo:400:kworker.0 00000100:00100000:1.0:1784189020.720763:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784189020.720773:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc075661c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1870854458038400:0@lo:400:kworker.0 00000100:00100000:1.0:1784189020.720792:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784189020.721054:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc075660a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1870854458038912:0@lo:400:kworker.0 00000100:00100000:1.0:1784189020.721079:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784189020.721109:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458038144 00000100:00100000:1.0:1784189020.721115:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458038144 00000100:00100000:1.0:1784189020.721152:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458038656 00000100:00100000:1.0:1784189020.721156:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458038656 00000100:00100000:1.0:1784189020.721175:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3709 00000100:00100000:1.0:1784189020.721183:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc080f6d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3641:x1870854458038144:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784189020.721237:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc080f6d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3641:x1870854458038144:12345-0@lo:400:kworker.0 Request processed in 55us (889us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189020.721244:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3709 00000100:00100000:1.0:1784189020.721261:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3710 00000100:00100000:1.0:1784189020.721267:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc080f6ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3641:x1870854458038656:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784189020.721306:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc080f6ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3641:x1870854458038656:12345-0@lo:400:kworker.0 Request processed in 40us (907us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189020.721311:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3710 00000100:00100000:1.0:1784189020.721350:0:85085:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458037504 00000100:00100000:1.0:1784189020.721353:0:85085:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458037504 00000100:00100000:1.0:1784189020.721562:0:85085:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1784189020.721571:0:85085:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc056a56450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd553d0d-03e2-4233-b06b-b55bbfa2b954+24:3641:x1870854458037504:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784189020.721603:0:85085:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc056a56450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd553d0d-03e2-4233-b06b-b55bbfa2b954+24:3641:x1870854458037504:12345-0@lo:400:kworker.0 Request processed in 34us (1143us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189020.721608:0:85085:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1784189020.721646:0:66169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458037632 00000100:00100000:1.0:1784189020.721651:0:66169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458037632 00000100:00100000:1.0:1784189020.721678:0:66169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458038016 00000100:00100000:1.0:1784189020.721681:0:66169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458038016 00000100:00100000:2.0:1784189020.721937:0:68287:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458038528 00000100:00100000:2.0:1784189020.721941:0:68287:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458038528 00000100:00100000:2.0:1784189020.721961:0:68287:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458039040 00000100:00100000:2.0:1784189020.721964:0:68287:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458039040 00000100:00100000:2.0:1784189020.721974:0:68287:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458037760 00000100:00100000:2.0:1784189020.721977:0:68287:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458037760 00000100:00100000:2.0:1784189020.721990:0:68287:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458037888 00000100:00100000:2.0:1784189020.721992:0:68287:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458037888 00000100:00100000:2.0:1784189020.722006:0:68287:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1008 00000100:00100000:2.0:1784189020.722012:0:68287:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc080f6ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1870854458037632:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784189020.722049:0:68287:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc080f6ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1870854458037632:12345-0@lo:400:kworker.0 Request processed in 37us (1800us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189020.722055:0:68287:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1008 00000100:00100000:2.0:1784189020.722068:0:68287:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1009 00000100:00100000:2.0:1784189020.722074:0:68287:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc080f6dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1870854458038528:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784189020.722103:0:68287:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc080f6dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1870854458038528:12345-0@lo:400:kworker.0 Request processed in 29us (1566us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189020.722109:0:68287:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1009 00000100:00100000:2.0:1784189020.722119:0:68287:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1010 00000100:00100000:2.0:1784189020.722125:0:68287:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc080f6d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1870854458039040:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784189020.722152:0:68287:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc080f6d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1870854458039040:12345-0@lo:400:kworker.0 Request processed in 28us (1579us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189020.722166:0:68287:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1010 00000100:00100000:2.0:1784189020.722178:0:68287:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1011 00000100:00100000:2.0:1784189020.722183:0:68287:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc080f6ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1870854458037760:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784189020.722224:0:68287:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc080f6ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1870854458037760:12345-0@lo:400:kworker.0 Request processed in 41us (1607us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189020.722230:0:68287:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1011 00000100:00100000:2.0:1784189020.722240:0:68287:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1012 00000100:00100000:2.0:1784189020.722246:0:68287:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc080f6f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3642:x1870854458037888:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784189020.722272:0:68287:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc080f6f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3642:x1870854458037888:12345-0@lo:400:kworker.0 Request processed in 26us (1508us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189020.722287:0:68287:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1012 00000100:00100000:2.0:1784189020.722306:0:26163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458038272 00000100:00100000:2.0:1784189020.722309:0:26163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458038272 00000100:00100000:2.0:1784189020.722349:0:26163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458038784 00000100:00100000:2.0:1784189020.722352:0:26163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458038784 00000100:00100000:2.0:1784189020.722365:0:26163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458038400 00000100:00100000:2.0:1784189020.722437:0:26163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458038400 00000100:00100000:2.0:1784189020.722459:0:26163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458038912 00000100:00100000:2.0:1784189020.722462:0:26163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458038912 00000100:00100000:2.0:1784189020.722478:0:26163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2315 00000100:00100000:2.0:1784189020.722484:0:26163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc080f6c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:3642:x1870854458038272:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784189020.722516:0:26163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc080f6c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:3642:x1870854458038272:12345-0@lo:400:kworker.0 Request processed in 32us (1864us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189020.722522:0:26163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2315 00000100:00100000:2.0:1784189020.722531:0:26163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2316 00000100:00100000:2.0:1784189020.722536:0:26163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc080f6e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+5:3642:x1870854458038784:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784189020.722570:0:26163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc080f6e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+5:3642:x1870854458038784:12345-0@lo:400:kworker.0 Request processed in 35us (1887us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189020.722576:0:26163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2316 00000100:00100000:2.0:1784189020.722585:0:26163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2317 00000100:00100000:2.0:1784189020.722590:0:26163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc080f6fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:3642:x1870854458038400:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784189020.722612:0:26163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc080f6fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:3642:x1870854458038400:12345-0@lo:400:kworker.0 Request processed in 23us (1819us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189020.722617:0:26163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2317 00000100:00100000:2.0:1784189020.722624:0:26163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2318 00000100:00100000:2.0:1784189020.722629:0:26163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc080f6e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+5:3642:x1870854458038912:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784189020.722647:0:26163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc080f6e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+5:3642:x1870854458038912:12345-0@lo:400:kworker.0 Request processed in 19us (1568us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189020.722652:0:26163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2318 00000100:00100000:1.0:1784189020.722920:0:66169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1013 00000100:00100000:1.0:1784189020.722927:0:66169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc080f6ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1870854458038016:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784189020.722959:0:66169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc080f6ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1870854458038016:12345-0@lo:400:kworker.0 Request processed in 33us (2457us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189020.722966:0:66169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1013 00000100:00100000:1.0:1784189020.723008:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc080f6b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:bd553d0d-03e2-4233-b06b-b55bbfa2b954:3641:1870854458037504:0@lo:400:kworker.0 00000100:00100000:1.0:1784189020.723022:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc075661180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3641:1870854458038016:0@lo:400:kworker.0 00000100:00100000:1.0:1784189020.723032:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc075662300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3641:1870854458038528:0@lo:400:kworker.0 00000100:00100000:1.0:1784189020.723042:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc075662a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3641:1870854458039040:0@lo:400:kworker.0 00000100:00100000:1.0:1784189020.723052:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc080f6aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3641:1870854458037632:0@lo:400:kworker.0 00000100:00100000:1.0:1784189020.723062:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc075663480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1870854458038144:0@lo:400:kworker.0 00000100:00100000:1.0:1784189020.723073:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc075663b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1870854458038656:0@lo:400:kworker.0 00000100:00100000:2.0:1784189020.724630:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc075663800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3642:1870854458037888:0@lo:400:kworker.0 00000100:00100000:2.0:1784189020.724660:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc075661c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1870854458038400:0@lo:400:kworker.0 00000100:00100000:2.0:1784189020.724671:0:3642:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294968952 gen 2 00000100:00100000:2.0:1784189020.724746:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc075660a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1870854458038912:0@lo:400:kworker.0 00000100:00100000:2.0:1784189020.724762:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc075662d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3642:1870854458037760:0@lo:400:kworker.0 00000100:00100000:2.0:1784189020.724772:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc075661880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1870854458038272:0@lo:400:kworker.0 00000100:00100000:2.0:1784189020.724781:0:3642:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294968948 gen 2 00000100:00100000:2.0:1784189020.724790:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc075662680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1870854458038784:0@lo:400:kworker.0 00000100:00080000:3.0:1784189020.729005:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1784189020.729014:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1784189020.729016:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1784189020.729019:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1784189020.729712:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc056eadc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1870854458039168:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1784189020.729781:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784189020.730003:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458039168 00000100:00100000:3.0:1784189020.730011:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458039168 00000100:00100000:3.0:1784189020.730061:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3711 00000100:00100000:3.0:1784189020.730070:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc080f6c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3641:x1870854458039168:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1784189020.730103:0:8438:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445576704 avail 1299337216 00000100:00100000:3.0:1784189020.730155:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc080f6c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3641:x1870854458039168:12345-0@lo:41:osp-pre-1-0.0 Request processed in 86us (373us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189020.730162:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3711 00000100:00100000:1.0:1784189020.732995:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc056eadc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1870854458039168:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1784189020.911796:0:7454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784189021.231717:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc06bbf0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1870854458039296:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1784189021.231802:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784189021.231862:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458039296 00000100:00100000:2.0:1784189021.231870:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458039296 00000100:00100000:1.0:1784189021.232078:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1784189021.232086:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc080f6df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1870854458039424:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1784189021.232115:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784189021.232138:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458039424 00000100:00100000:1.0:1784189021.232147:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458039424 00000100:00100000:1.0:1784189021.232180:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1852 00000100:00100000:1.0:1784189021.232187:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc080f6d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1870854458039424:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1784189021.232212:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8651456 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1784189021.232248:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc080f6d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1870854458039424:12345-0@lo:13:osp-pre-1-0.0 Request processed in 61us (132us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189021.232255:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1852 00000100:00100000:1.0:1784189021.232303:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc080f6df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1870854458039424:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1784189021.232520:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc075660e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1870854458039552:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1784189021.232544:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784189021.232616:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458039552 00000100:00100000:0.0:1784189021.232620:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458039552 00000100:00100000:0.0:1784189021.232648:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1853 00000100:00100000:0.0:1784189021.232654:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc080f6df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1870854458039552:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1784189021.232669:0:8432:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8651456 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1784189021.232702:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc080f6df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1870854458039552:12345-0@lo:13:osp-pre-0-0.0 Request processed in 48us (157us total) trans 0 rc 0/0 00000100:00100000:0.0:1784189021.232707:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1853 00000100:00100000:0.0:1784189021.232739:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc075660e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1870854458039552:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1784189021.233048:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3712 00000100:00100000:2.0:1784189021.233058:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc06bbf1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3642:x1870854458039296:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1784189021.233080:0:8439:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445289984 avail 1299050496 00000100:00100000:2.0:1784189021.233118:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc06bbf1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3642:x1870854458039296:12345-0@lo:41:osp-pre-0-1.0 Request processed in 63us (1316us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189021.233124:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3712 00000100:00100000:1.0:1784189021.233175:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc06bbf0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1870854458039296:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1784189021.486014:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1784189021.486058:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1784189021.486109:0:66169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436235136 00000100:00100000:1.0:1784189021.486119:0:66169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436235136 00000100:00100000:3.0:1784189021.486125:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1784189021.486153:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1784189021.486182:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1784189021.486187:0:66169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436235264 00000100:00100000:1.0:1784189021.486192:0:66169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436235264 00000100:00100000:3.0:1784189021.486208:0:85083:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436235008 00000100:00100000:3.0:1784189021.486214:0:85083:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436235008 00000100:00100000:1.0:1784189021.486227:0:66169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1014 00000100:00100000:1.0:1784189021.486240:0:66169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc056eae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+7:2399:x1870854436235136:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:3.0:1784189021.486253:0:85083:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 80 00000100:00100000:3.0:1784189021.486264:0:85083:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc056a55050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9957a2dc-fd88-4a91-bca3-e2b7f365ab0c+10:2399:x1870854436235008:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:1.0:1784189021.486383:0:66169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc056eae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+7:2399:x1870854436235136:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 145us (378us total) trans 0 rc 0/0 00000100:00100000:0.0:1784189021.486393:0:66171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1015 00000100:00100000:0.0:1784189021.486404:0:66171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc056eaf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+6:2399:x1870854436235264:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:2.0:1784189021.486550:0:9982:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436235392 00000100:00100000:2.0:1784189021.486555:0:9982:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436235392 00000100:00100000:2.0:1784189021.486586:0:9982:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436235520 00000100:00100000:2.0:1784189021.486589:0:9982:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436235520 00000100:00100000:2.0:1784189021.486613:0:9982:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 2319 00000100:00100000:2.0:1784189021.486621:0:9982:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc056eaf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+5:2399:x1870854436235392:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:3.0:1784189021.486642:0:85083:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc056a55050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9957a2dc-fd88-4a91-bca3-e2b7f365ab0c+10:2399:x1870854436235008:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 377us (514us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189021.486650:0:85083:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 80 00000100:00100000:2.0:1784189021.486657:0:9982:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc056eaf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+5:2399:x1870854436235392:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 36us (597us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189021.486666:0:9982:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 2319 00000100:00100000:2.0:1784189021.486685:0:9982:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 2320 00000100:00080000:3.0:1784189021.486686:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1784189021.486692:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1784189021.486694:0:9982:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc056eac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+5:2399:x1870854436235520:12345-192.168.203.12@tcp:400:kworker.0 00000100:00080000:3.0:1784189021.486696:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1784189021.486701:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1784189021.486726:0:9982:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc056eac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+5:2399:x1870854436235520:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 34us (542us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189021.486734:0:9982:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 2320 00000100:00100000:1.0:1784189021.486928:0:66169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1014 00000100:00100000:0.0:1784189021.488951:0:66171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc056eaf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+6:2399:x1870854436235264:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 2538us (2786us total) trans 0 rc 0/0 00000100:00100000:0.0:1784189021.488964:0:66171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1015 00000100:00100000:3.0:1784189021.878573:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1784189021.878751:0:66170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436235648 00000100:00100000:0.0:1784189021.878761:0:66170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436235648 00000100:00100000:0.0:1784189021.878835:0:66170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1069 00000100:00100000:0.0:1784189021.878846:0:66170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc056eaf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+7:65699:x1870854436235648:12345-192.168.203.12@tcp:41:lfs.0 00000004:00000024:0.0:1784189021.879017:0:66170:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445289984 avail 1299050496 00000100:00100000:0.0:1784189021.879108:0:66170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc056eaf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+7:65699:x1870854436235648:12345-192.168.203.12@tcp:41:lfs.0 Request processed in 263us (543us total) trans 0 rc 0/0 00000100:00100000:0.0:1784189021.879117:0:66170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1069 00000100:00100000:3.0:1784189021.881741:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1784189021.882018:0:66945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436235776 00000100:00100000:2.0:1784189021.882027:0:66945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436235776 00000100:00100000:2.0:1784189021.882417:0:66945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1070 00000100:00100000:2.0:1784189021.882441:0:66945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc056eadc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+6:65699:x1870854436235776:12345-192.168.203.12@tcp:41:lfs.0 00000004:00000024:2.0:1784189021.882488:0:66945:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445576704 avail 1299337216 00000100:00100000:2.0:1784189021.882560:0:66945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc056eadc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+6:65699:x1870854436235776:12345-192.168.203.12@tcp:41:lfs.0 Request processed in 122us (827us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189021.882568:0:66945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1070 00000100:00100000:2.0:1784189021.889597:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1784189021.889721:0:9466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436235904 00000100:00100000:1.0:1784189021.889729:0:9466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436235904 00000100:00100000:1.0:1784189021.889839:0:9466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1854 00000100:00100000:1.0:1784189021.889850:0:9466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc06bbf2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+5:65699:x1870854436235904:12345-192.168.203.12@tcp:13:lfs.0 00002000:00000024:1.0:1784189021.889875:0:9466:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8651456 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1784189021.889955:0:9466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc06bbf2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+5:65699:x1870854436235904:12345-192.168.203.12@tcp:13:lfs.0 Request processed in 106us (366us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189021.889964:0:9466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1854 00000100:00100000:3.0:1784189021.894196:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1784189021.894494:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436236032 00000100:00100000:1.0:1784189021.894506:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436236032 00000100:00100000:1.0:1784189021.894634:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1855 00000100:00100000:1.0:1784189021.894647:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc056ead180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+5:65699:x1870854436236032:12345-192.168.203.12@tcp:13:lfs.0 00002000:00000024:1.0:1784189021.894680:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8651456 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1784189021.894759:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc056ead180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+5:65699:x1870854436236032:12345-192.168.203.12@tcp:13:lfs.0 Request processed in 116us (649us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189021.894767:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1855 00000100:00100000:3.0:1784189021.933870:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1784189021.934177:0:66171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436236288 00000100:00100000:0.0:1784189021.934207:0:66171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436236288 00000100:00100000:0.0:1784189021.934302:0:66171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1071 00000100:00100000:0.0:1784189021.934313:0:66171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc056eaed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+7:65715:x1870854436236288:12345-192.168.203.12@tcp:101:lfs.0 00010000:00010000:0.0:1784189021.934452:0:66171:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784189021.934495:0:66171:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc070147600/0xcc1762b626f8a981 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbfc5de7fe6c3cf1 expref: -99 pid: 66171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189021.934594:0:66171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc070147400/0xcc1762b626f8a988 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189021.934611:0:66171:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc070147400/0xcc1762b626f8a988 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189021.934626:0:66171:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc070147400/0xcc1762b626f8a988 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189021.934643:0:66171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc070146e00/0xcc1762b626f8a98f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189021.934650:0:66171:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc070146e00/0xcc1762b626f8a98f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189021.934657:0:66171:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc070146e00/0xcc1762b626f8a98f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189021.935307:0:66171:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc070147400/0xcc1762b626f8a988 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189021.935461:0:66171:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc070147400/0xcc1762b626f8a988 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189021.935470:0:66171:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc070147400/0xcc1762b626f8a988 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189021.935491:0:66171:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dc070147400/0xcc1762b626f8a988 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189021.935497:0:66171:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc070147400 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:0.0:1784189021.935502:0:66171:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc070147400/0xcc1762b626f8a988 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189021.935510:0:66171:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc070147400/0xcc1762b626f8a988 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189021.935903:0:66171:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9dc056eaa500) 00010000:00010000:0.0:1784189021.935907:0:66171:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784189021.935913:0:66171:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dc070147400/0xcc1762b626f8a988 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189021.935921:0:66171:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc070147400/0xcc1762b626f8a988 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189021.935953:0:66171:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc070146e00/0xcc1762b626f8a98f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189021.935960:0:66171:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc070146e00/0xcc1762b626f8a98f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189021.935965:0:66171:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dc070146e00/0xcc1762b626f8a98f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189021.935970:0:66171:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc070146e00 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:0.0:1784189021.935974:0:66171:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc070146e00/0xcc1762b626f8a98f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189021.935993:0:66171:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc070146e00/0xcc1762b626f8a98f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189021.936002:0:66171:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xed1d29cb (ffff9dc07b032000) 00010000:00010000:0.0:1784189021.936004:0:66171:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784189021.936007:0:66171:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dc070146e00/0xcc1762b626f8a98f lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189021.936013:0:66171:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc070146e00/0xcc1762b626f8a98f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189021.936067:0:66171:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc070147600/0xcc1762b626f8a981 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c3cf1 expref: 8 pid: 66171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189021.936079:0:66171:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9dc056eaa500) 00010000:00010000:0.0:1784189021.936081:0:66171:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1784189021.936084:0:66171:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc070147600/0xcc1762b626f8a981 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c3cf1 expref: 8 pid: 66171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189021.936093:0:66171:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc070147600, rc 0) 00000100:00100000:0.0:1784189021.936253:0:66171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc056eaed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+7:65715:x1870854436236288:12345-192.168.203.12@tcp:101:lfs.0 Request processed in 1940us (2399us total) trans 0 rc 301/301 00000100:00100000:0.0:1784189021.936263:0:66171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1071 00010000:00010000:0.0:1784189021.936516:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784189021.942611:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1784189021.943753:0:68287:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436236416 00000100:00100000:3.0:1784189021.943770:0:68287:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436236416 00000100:00100000:3.0:1784189021.944111:0:68287:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1072 00000100:00100000:3.0:1784189021.944126:0:68287:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc06bbf2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+7:65715:x1870854436236416:12345-192.168.203.12@tcp:34:lfs.0 00010000:00010000:3.0:1784189021.944236:0:68287:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc081b17800/0xcc1762b626f8a996 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189021.944257:0:68287:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc081b17800/0xcc1762b626f8a996 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189021.944285:0:68287:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc081b17800/0xcc1762b626f8a996 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189021.944355:0:68287:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc081b17400/0xcc1762b626f8a99d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189021.944374:0:68287:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc081b17400/0xcc1762b626f8a99d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189021.944382:0:68287:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc081b17400/0xcc1762b626f8a99d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189021.944501:0:68287:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc081b17a00/0xcc1762b626f8a9a4 lrc: 3/1,0 mode: --/PR res: [0x20000a811:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189021.944511:0:68287:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc081b17a00/0xcc1762b626f8a9a4 lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189021.944518:0:68287:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc081b17a00/0xcc1762b626f8a9a4 lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784189021.944569:0:68287:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1784189021.944585:0:68287:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9dc081b17a00/0xcc1762b626f8a9a4 lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189021.944603:0:68287:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc081b17800/0xcc1762b626f8a996 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189021.944610:0:68287:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc081b17800/0xcc1762b626f8a996 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189021.944617:0:68287:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc081b17800/0xcc1762b626f8a996 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189021.944623:0:68287:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dc081b17800/0xcc1762b626f8a996 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189021.944638:0:68287:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc081b17800 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:3.0:1784189021.944643:0:68287:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc081b17800/0xcc1762b626f8a996 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189021.944652:0:68287:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc081b17800/0xcc1762b626f8a996 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189021.944666:0:68287:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9dc056eaa500) 00010000:00010000:3.0:1784189021.944669:0:68287:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784189021.944676:0:68287:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dc081b17800/0xcc1762b626f8a996 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189021.944682:0:68287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc081b17800/0xcc1762b626f8a996 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189021.944699:0:68287:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc081b17400/0xcc1762b626f8a99d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189021.944705:0:68287:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc081b17400/0xcc1762b626f8a99d lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189021.944711:0:68287:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dc081b17400/0xcc1762b626f8a99d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189021.944716:0:68287:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc081b17400 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:3.0:1784189021.944719:0:68287:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc081b17400/0xcc1762b626f8a99d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189021.944724:0:68287:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc081b17400/0xcc1762b626f8a99d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189021.944744:0:68287:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xed1d29cb (ffff9dc074ae2900) 00010000:00010000:3.0:1784189021.944747:0:68287:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784189021.944750:0:68287:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dc081b17400/0xcc1762b626f8a99d lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189021.944756:0:68287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc081b17400/0xcc1762b626f8a99d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189021.944771:0:68287:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc081b17a00/0xcc1762b626f8a9a4 lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189021.944778:0:68287:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc081b17a00/0xcc1762b626f8a9a4 lrc: 2/0,0 mode: PR/PR res: [0x20000a811:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189021.944800:0:68287:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dc081b17a00/0xcc1762b626f8a9a4 lrc: 3/0,0 mode: PR/PR res: [0x20000a811:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189021.944805:0:68287:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc081b17a00 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:3.0:1784189021.944808:0:68287:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc081b17a00/0xcc1762b626f8a9a4 lrc: 3/0,0 mode: PR/PR res: [0x20000a811:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189021.944817:0:68287:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc081b17a00/0xcc1762b626f8a9a4 lrc: 4/0,0 mode: PR/PR res: [0x20000a811:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189021.944825:0:68287:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x2:0x0].0x0 (ffff9dc074ae2800) 00010000:00010000:3.0:1784189021.944827:0:68287:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784189021.944830:0:68287:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dc081b17a00/0xcc1762b626f8a9a4 lrc: 2/0,0 mode: --/PR res: [0x20000a811:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189021.944835:0:68287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc081b17a00/0xcc1762b626f8a9a4 lrc: 0/0,0 mode: --/PR res: [0x20000a811:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784189021.945279:0:68287:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc06bbf2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+7:65715:x1870854436236416:12345-192.168.203.12@tcp:34:lfs.0 Request processed in 1143us (2667us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189021.945291:0:68287:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1072 00010000:00010000:2.0:1784189022.961594:0:26173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784189023.280513:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1784189023.280551:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc06bbf3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1870854458039680:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1784189023.280560:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1784189023.280575:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc06bbf1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1870854458039808:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1784189023.280995:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784189023.281160:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784189023.283773:0:9466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458039680 00000100:00100000:1.0:1784189023.283793:0:9466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458039680 00000100:00100000:2.0:1784189023.283889:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458039808 00000100:00100000:2.0:1784189023.283896:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458039808 00000100:00100000:1.0:1784189023.283936:0:9466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1856 00000100:00100000:1.0:1784189023.283950:0:9466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc075660e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1870854458039680:12345-0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1784189023.283952:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1857 00000100:00100000:2.0:1784189023.283969:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc06bbf0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1870854458039808:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1784189023.284001:0:8432:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8651456 pending 0 free 3923529728 avail 3692007424 00002000:00000024:1.0:1784189023.284001:0:9466:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8651456 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1784189023.284097:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc06bbf0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1870854458039808:12345-0@lo:13:osp-pre-1-1.0 Request processed in 132us (2944us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189023.284105:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1857 00000100:00100000:2.0:1784189023.284347:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc06bbf1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1870854458039808:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1784189023.287185:0:9466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc075660e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1870854458039680:12345-0@lo:13:osp-pre-0-1.0 Request processed in 3224us (6175us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189023.287206:0:9466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1856 00000100:00080000:1.0:1784189023.287269:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1784189023.287276:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1784189023.287380:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc06bbf3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1870854458039680:0@lo:13:osp-pre-0-1.0 00010000:00010000:1.0:1784189023.983752:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784189025.007574:0:7454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784189025.839833:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc075660000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:bd553d0d-03e2-4233-b06b-b55bbfa2b954:3643:1870854458039936:0@lo:400:kworker.0 00000100:00100000:0.0:1784189025.839949:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784189025.839960:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc075660380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3642:1870854458040320:0@lo:400:kworker.0 00000100:00100000:0.0:1784189025.839997:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc075660700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3643:1870854458040448:0@lo:400:kworker.0 00000100:00100000:1.0:1784189025.839998:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784189025.840022:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784189025.840023:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc075662d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1870854458040832:0@lo:400:kworker.0 00000100:00100000:0.0:1784189025.840048:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc075660a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3643:1870854458040960:0@lo:400:kworker.0 00000100:00100000:0.0:1784189025.840072:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784189025.840074:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784189025.840091:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc075663b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1870854458041344:0@lo:400:kworker.0 00000100:00100000:1.0:1784189025.840117:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784189025.840170:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc075661f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3640:1870854458040064:0@lo:400:kworker.0 00000100:00100000:1.0:1784189025.840199:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784189025.840220:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc075662680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1870854458040576:0@lo:400:kworker.0 00000100:00100000:1.0:1784189025.840269:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784189025.840278:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc075663480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3643:1870854458041472:0@lo:400:kworker.0 00000100:00100000:1.0:1784189025.840286:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc075661c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1870854458041088:0@lo:400:kworker.0 00000100:00100000:1.0:1784189025.840306:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784189025.840306:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784189025.840436:0:85084:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458039936 00000100:00100000:0.0:1784189025.840445:0:85084:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458039936 00000100:00100000:0.0:1784189025.840501:0:85084:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1784189025.840512:0:85084:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc056a56850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd553d0d-03e2-4233-b06b-b55bbfa2b954+24:3643:x1870854458039936:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784189025.840576:0:85084:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc056a56850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd553d0d-03e2-4233-b06b-b55bbfa2b954+24:3643:x1870854458039936:12345-0@lo:400:kworker.0 Request processed in 64us (626us total) trans 0 rc 0/0 00000100:00100000:0.0:1784189025.840584:0:85084:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1784189025.840629:0:66171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458040320 00000100:00100000:0.0:1784189025.840633:0:66171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458040320 00000100:00100000:0.0:1784189025.840669:0:66171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458040448 00000100:00100000:0.0:1784189025.840672:0:66171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458040448 00000100:00100000:0.0:1784189025.840686:0:66171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458040960 00000100:00100000:0.0:1784189025.840687:0:66171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458040960 00000100:00100000:0.0:1784189025.840700:0:66171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1016 00000100:00100000:0.0:1784189025.840706:0:66171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc080f6f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3642:x1870854458040320:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784189025.840745:0:66171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc080f6f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3642:x1870854458040320:12345-0@lo:400:kworker.0 Request processed in 39us (746us total) trans 0 rc 0/0 00000100:00100000:0.0:1784189025.840813:0:66171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1016 00000100:00100000:0.0:1784189025.840827:0:66171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458040064 00000100:00100000:0.0:1784189025.840837:0:66171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458040064 00000100:00100000:0.0:1784189025.840856:0:66171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458041472 00000100:00100000:0.0:1784189025.840859:0:66171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458041472 00000100:00100000:0.0:1784189025.840870:0:66171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1017 00000100:00100000:0.0:1784189025.840876:0:66171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc075662a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1870854458040448:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784189025.840909:0:66171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc075662a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1870854458040448:12345-0@lo:400:kworker.0 Request processed in 32us (886us total) trans 0 rc 0/0 00000100:00100000:0.0:1784189025.840915:0:66171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1017 00000100:00100000:0.0:1784189025.840928:0:66171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1018 00000100:00100000:0.0:1784189025.840934:0:66171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc075662300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1870854458040960:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784189025.840961:0:66171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc075662300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1870854458040960:12345-0@lo:400:kworker.0 Request processed in 27us (888us total) trans 0 rc 0/0 00000100:00100000:0.0:1784189025.840967:0:66171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1018 00000100:00100000:0.0:1784189025.840979:0:66171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1019 00000100:00100000:0.0:1784189025.840985:0:66171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc080f6b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1870854458040064:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784189025.841011:0:66171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc080f6b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1870854458040064:12345-0@lo:400:kworker.0 Request processed in 27us (812us total) trans 0 rc 0/0 00000100:00100000:0.0:1784189025.841017:0:66171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1019 00000100:00100000:0.0:1784189025.841029:0:66171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1020 00000100:00100000:0.0:1784189025.841035:0:66171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc075661180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1870854458041472:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784189025.841174:0:66171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc075661180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1870854458041472:12345-0@lo:400:kworker.0 Request processed in 138us (866us total) trans 0 rc 0/0 00000100:00100000:0.0:1784189025.841181:0:66171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1020 00000100:00100000:1.0:1784189025.841215:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc075661f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3640:1870854458040064:0@lo:400:kworker.0 00000100:00100000:0.0:1784189025.841215:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc075660000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:bd553d0d-03e2-4233-b06b-b55bbfa2b954:3643:1870854458039936:0@lo:400:kworker.0 00000100:00100000:0.0:1784189025.841227:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc075660700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3643:1870854458040448:0@lo:400:kworker.0 00000100:00100000:1.0:1784189025.841236:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1784189025.841265:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc075661500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3640:1870854458040192:0@lo:400:kworker.0 00000100:00100000:0.0:1784189025.841265:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc075660a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3643:1870854458040960:0@lo:400:kworker.0 00000100:00100000:0.0:1784189025.841275:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc075663480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3643:1870854458041472:0@lo:400:kworker.0 00000100:00100000:1.0:1784189025.841293:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784189025.841310:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc075661880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1870854458040704:0@lo:400:kworker.0 00000100:00100000:0.0:1784189025.841310:0:66171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458040192 00000100:00100000:0.0:1784189025.841313:0:66171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458040192 00000100:00100000:0.0:1784189025.841440:0:66171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1021 00000100:00100000:0.0:1784189025.841447:0:66171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf43c5ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1870854458040192:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784189025.841483:0:66171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf43c5ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1870854458040192:12345-0@lo:400:kworker.0 Request processed in 36us (188us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189025.841487:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458040576 00000100:00100000:0.0:1784189025.841492:0:66171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1021 00000100:00100000:3.0:1784189025.841494:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458040576 00000100:00100000:3.0:1784189025.841532:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458041088 00000100:00100000:3.0:1784189025.841536:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458041088 00000100:00100000:0.0:1784189025.841566:0:23826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3713 00000100:00100000:3.0:1784189025.841573:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3714 00000100:00100000:0.0:1784189025.841578:0:23826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf43c5d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3640:x1870854458040576:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784189025.841586:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf43c5d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3640:x1870854458041088:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784189025.841628:0:23826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf43c5d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3640:x1870854458040576:12345-0@lo:400:kworker.0 Request processed in 54us (1358us total) trans 0 rc 0/0 00000100:00100000:0.0:1784189025.841636:0:23826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3713 00000100:00100000:3.0:1784189025.841641:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf43c5d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3640:x1870854458041088:12345-0@lo:400:kworker.0 Request processed in 57us (1332us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189025.841649:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3714 00000100:00100000:1.0:1784189025.841726:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784189025.841834:0:26167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458040832 00000100:00100000:0.0:1784189025.841839:0:26167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458040832 00000100:00100000:1.0:1784189025.841848:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc075663800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1870854458041216:0@lo:400:kworker.0 00000100:00100000:1.0:1784189025.841875:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784189025.841918:0:26167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2321 00000100:00100000:0.0:1784189025.841927:0:26167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc080f6f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0001-mdtlov_UUID+5:3642:x1870854458040832:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784189025.841939:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc075662680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1870854458040576:0@lo:400:kworker.0 00000100:00100000:1.0:1784189025.841950:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc075661c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1870854458041088:0@lo:400:kworker.0 00000100:00100000:0.0:1784189025.841960:0:26167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc080f6f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0001-mdtlov_UUID+5:3642:x1870854458040832:12345-0@lo:400:kworker.0 Request processed in 36us (1886us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189025.841966:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf44c8aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1870854458041600:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1784189025.841966:0:26167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2321 00000100:00100000:0.0:1784189025.841976:0:26167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458041344 00000100:00100000:0.0:1784189025.841979:0:26167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458041344 00000100:00100000:1.0:1784189025.841988:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784189025.842001:0:26167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458040704 00000100:00100000:0.0:1784189025.842004:0:26167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458040704 00000100:00100000:1.0:1784189025.842010:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc075661500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3640:1870854458040192:0@lo:400:kworker.0 00000100:00100000:0.0:1784189025.842025:0:26167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458041216 00000100:00100000:0.0:1784189025.842037:0:26167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458041216 00000100:00100000:1.0:1784189025.842068:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2322 00000100:00100000:0.0:1784189025.842079:0:26167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2323 00000100:00100000:1.0:1784189025.842082:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc080f6aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3642:x1870854458041344:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784189025.842092:0:26167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf43c5dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0001-mdtlov_UUID+5:3640:x1870854458040704:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784189025.842116:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc080f6aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3642:x1870854458041344:12345-0@lo:400:kworker.0 Request processed in 35us (1999us total) trans 0 rc 0/0 00000100:00100000:0.0:1784189025.842119:0:26167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf43c5dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0001-mdtlov_UUID+5:3640:x1870854458040704:12345-0@lo:400:kworker.0 Request processed in 35us (394us total) trans 0 rc 0/0 00000100:00100000:0.0:1784189025.842125:0:26167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2323 00000100:00100000:1.0:1784189025.842133:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2322 00000100:00100000:0.0:1784189025.842137:0:26167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2324 00000100:00100000:0.0:1784189025.842143:0:26167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf43c5e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+5:3640:x1870854458041216:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784189025.842161:0:26492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458041600 00000100:00100000:1.0:1784189025.842164:0:26492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458041600 00000100:00100000:0.0:1784189025.842168:0:26167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf43c5e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+5:3640:x1870854458041216:12345-0@lo:400:kworker.0 Request processed in 26us (293us total) trans 0 rc 0/0 00000100:00100000:0.0:1784189025.842174:0:26167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2324 00000100:00100000:1.0:1784189025.842187:0:26492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3715 00000100:00100000:1.0:1784189025.842193:0:26492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf43c5ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3640:x1870854458041600:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1784189025.842222:0:26492:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445576704 avail 1299337216 00000100:00100000:1.0:1784189025.842274:0:26492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf43c5ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3640:x1870854458041600:12345-0@lo:41:osp-pre-1-0.0 Request processed in 80us (285us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189025.842281:0:26492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3715 00000100:00080000:1.0:1784189025.842302:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1784189025.842306:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1784189025.842308:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1784189025.842310:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1784189025.842384:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc075660380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3642:1870854458040320:0@lo:400:kworker.0 00000100:00100000:1.0:1784189025.842397:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc075662d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1870854458040832:0@lo:400:kworker.0 00000100:00100000:1.0:1784189025.842408:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc075663b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1870854458041344:0@lo:400:kworker.0 00000100:00100000:1.0:1784189025.842452:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf44c8aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1870854458041600:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1784189025.842463:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc075661880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1870854458040704:0@lo:400:kworker.0 00000100:00100000:1.0:1784189025.842472:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc075663800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1870854458041216:0@lo:400:kworker.0 00010000:00010000:2.0:1784189026.037148:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784189026.353132:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf43c5df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1870854458041728:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1784189026.353225:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784189026.354014:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1784189026.354027:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc06bbf1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1870854458041856:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1784189026.354066:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784189026.354626:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458041728 00000100:00100000:3.0:1784189026.354634:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458041728 00000100:00100000:3.0:1784189026.354685:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1858 00000100:00100000:3.0:1784189026.354695:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf43c5ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1870854458041728:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1784189026.354724:0:8432:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8651456 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1784189026.354781:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf43c5ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1870854458041728:12345-0@lo:13:osp-pre-1-0.0 Request processed in 87us (1555us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189026.354799:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1858 00000100:00100000:3.0:1784189026.354823:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458041856 00000100:00100000:3.0:1784189026.354826:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458041856 00000100:00100000:3.0:1784189026.354854:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3716 00000100:00100000:3.0:1784189026.354860:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc06bbf3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3643:x1870854458041856:12345-0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1784189026.354880:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf43c5df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1870854458041728:0@lo:13:osp-pre-1-0.0 00000004:00000024:3.0:1784189026.354882:0:8439:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445289984 avail 1299050496 00000100:00100000:3.0:1784189026.354931:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc06bbf3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3643:x1870854458041856:12345-0@lo:41:osp-pre-0-1.0 Request processed in 71us (864us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189026.354935:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1784189026.354944:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3716 00000100:00100000:2.0:1784189026.354944:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc06bbf3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1870854458041984:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1784189026.354978:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784189026.355005:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458041984 00000100:00100000:2.0:1784189026.355021:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458041984 00000100:00100000:2.0:1784189026.355047:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1859 00000100:00100000:2.0:1784189026.355053:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf4859aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1870854458041984:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1784189026.355068:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8651456 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1784189026.355097:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf4859aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1870854458041984:12345-0@lo:13:osp-pre-0-0.0 Request processed in 44us (118us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189026.355102:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1859 00000100:00100000:2.0:1784189026.355128:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc06bbf3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1870854458041984:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1784189026.355385:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc06bbf1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1870854458041856:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1784189026.599426:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1784189026.599468:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1784189026.599495:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1784189026.599521:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1784189026.599546:0:66171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436236800 00000100:00100000:3.0:1784189026.599552:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1784189026.599557:0:66171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436236800 00000100:00100000:3.0:1784189026.599573:0:68287:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436236672 00000100:00100000:3.0:1784189026.599578:0:68287:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436236672 00000100:00100000:1.0:1784189026.599590:0:85085:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436236544 00000100:00100000:1.0:1784189026.599605:0:85085:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436236544 00000100:00100000:1.0:1784189026.599642:0:85085:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 82 00000100:00100000:1.0:1784189026.599651:0:85085:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc056a55c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9957a2dc-fd88-4a91-bca3-e2b7f365ab0c+10:2396:x1870854436236544:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:2.0:1784189026.599662:0:26170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436237056 00000100:00100000:2.0:1784189026.599666:0:26170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436237056 00000100:00100000:2.0:1784189026.599694:0:26170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436236928 00000100:00100000:2.0:1784189026.599697:0:26170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436236928 00000100:00100000:1.0:1784189026.599713:0:85085:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc056a55c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9957a2dc-fd88-4a91-bca3-e2b7f365ab0c+10:2396:x1870854436236544:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 63us (295us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189026.599716:0:26170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 2325 00000100:00100000:1.0:1784189026.599721:0:85085:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 82 00000100:00100000:2.0:1784189026.599722:0:26170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf44c89c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+5:2396:x1870854436237056:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:2.0:1784189026.599750:0:26170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf44c89c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+5:2396:x1870854436237056:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 28us (253us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189026.599756:0:26170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 2325 00000100:00100000:0.0:1784189026.599779:0:66171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1022 00000100:00100000:0.0:1784189026.599797:0:66171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf44c88700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+6:2396:x1870854436236800:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:0.0:1784189026.599828:0:66171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf44c88700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+6:2396:x1870854436236800:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 43us (360us total) trans 0 rc 0/0 00000100:00100000:0.0:1784189026.599836:0:66171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1022 00000100:00100000:0.0:1784189026.599851:0:66171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1023 00000100:00100000:0.0:1784189026.599857:0:66171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf44c8aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+7:2396:x1870854436236672:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:0.0:1784189026.599881:0:66171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf44c8aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+7:2396:x1870854436236672:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 24us (359us total) trans 0 rc 0/0 00000100:00100000:0.0:1784189026.599886:0:66171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1023 00000100:00100000:2.0:1784189026.599938:0:26170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 2326 00000100:00100000:2.0:1784189026.599945:0:26170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc0477c3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+5:2396:x1870854436236928:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:2.0:1784189026.599973:0:26170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc0477c3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+5:2396:x1870854436236928:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 28us (422us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189026.599979:0:26170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 2326 00000100:00080000:2.0:1784189026.600143:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1784189026.600160:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1784189026.600162:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1784189026.600165:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:2.0:1784189027.055566:0:26173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1784189027.921885:0:85905:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == replay-single test 130b: DoM file create (inherited) replay ========================================================== 04:03:45 (1784189025) 00000100:00100000:1.0:1784189028.075989:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1784189028.076041:0:66169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436237184 00000100:00100000:1.0:1784189028.076051:0:66169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436237184 00000100:00100000:1.0:1784189028.076120:0:66169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1073 00000100:00100000:1.0:1784189028.076131:0:66169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf43c5df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+7:66304:x1870854436237184:12345-192.168.203.12@tcp:101:lfs.0 00010000:00010000:1.0:1784189028.076151:0:66169:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784189028.076185:0:66169:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0565e6400/0xcc1762b626f8a9ab lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbfc5de7fe6c3cf8 expref: -99 pid: 66169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189028.076261:0:66169:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0565e7c00/0xcc1762b626f8a9b2 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189028.076275:0:66169:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0565e7c00/0xcc1762b626f8a9b2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189028.076289:0:66169:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0565e7c00/0xcc1762b626f8a9b2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189028.076306:0:66169:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0565e6600/0xcc1762b626f8a9b9 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189028.076373:0:66169:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0565e6600/0xcc1762b626f8a9b9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189028.076381:0:66169:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0565e6600/0xcc1762b626f8a9b9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189028.076429:0:66169:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0565e7c00/0xcc1762b626f8a9b2 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189028.076437:0:66169:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0565e7c00/0xcc1762b626f8a9b2 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189028.076443:0:66169:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0565e7c00/0xcc1762b626f8a9b2 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189028.076449:0:66169:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0565e7c00/0xcc1762b626f8a9b2 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189028.076454:0:66169:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc0565e7c00 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:1.0:1784189028.076458:0:66169:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0565e7c00/0xcc1762b626f8a9b2 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189028.076465:0:66169:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0565e7c00/0xcc1762b626f8a9b2 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189028.076476:0:66169:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9dc056eaa500) 00010000:00010000:1.0:1784189028.076480:0:66169:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784189028.076484:0:66169:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0565e7c00/0xcc1762b626f8a9b2 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189028.076490:0:66169:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0565e7c00/0xcc1762b626f8a9b2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189028.076514:0:66169:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0565e6600/0xcc1762b626f8a9b9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189028.076521:0:66169:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0565e6600/0xcc1762b626f8a9b9 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189028.076526:0:66169:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0565e6600/0xcc1762b626f8a9b9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189028.076531:0:66169:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc0565e6600 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:1.0:1784189028.076535:0:66169:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0565e6600/0xcc1762b626f8a9b9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189028.076541:0:66169:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0565e6600/0xcc1762b626f8a9b9 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189028.076549:0:66169:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xef7738bc (ffff9dc074a73600) 00010000:00010000:1.0:1784189028.076551:0:66169:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784189028.076554:0:66169:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0565e6600/0xcc1762b626f8a9b9 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189028.076559:0:66169:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0565e6600/0xcc1762b626f8a9b9 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189028.076588:0:66169:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0565e6400/0xcc1762b626f8a9ab lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c3cf8 expref: 8 pid: 66169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189028.076598:0:66169:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9dc056eaa500) 00010000:00010000:1.0:1784189028.076600:0:66169:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784189028.076610:0:66169:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0565e6400/0xcc1762b626f8a9ab lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c3cf8 expref: 8 pid: 66169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189028.076619:0:66169:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc0565e6400, rc 0) 00000100:00100000:1.0:1784189028.076682:0:66169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf43c5df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+7:66304:x1870854436237184:12345-192.168.203.12@tcp:101:lfs.0 Request processed in 554us (703us total) trans 0 rc 301/301 00000100:00100000:1.0:1784189028.076689:0:66169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1073 00000100:00080000:2.0:1784189028.077516:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1784189028.080556:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784189028.088754:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1784189028.091716:0:66171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436237440 00000100:00100000:3.0:1784189028.091740:0:66171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436237440 00000100:00100000:3.0:1784189028.091834:0:66171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1074 00000100:00100000:3.0:1784189028.091847:0:66171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf43c5ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+7:66304:x1870854436237440:12345-192.168.203.12@tcp:36:lfs.0 00010000:00010000:3.0:1784189028.091929:0:66171:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784189028.091966:0:66171:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc070147e00/0xcc1762b626f8a96c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c3cea expref: 7 pid: 66171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189028.091991:0:66171:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9dc056eaa500) 00010000:00010000:3.0:1784189028.092007:0:66171:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1784189028.092101:0:66171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc081b17400/0xcc1762b626f8a9c0 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189028.092117:0:66171:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc081b17400/0xcc1762b626f8a9c0 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189028.092130:0:66171:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc081b17400/0xcc1762b626f8a9c0 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189028.092145:0:66171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc081b17a00/0xcc1762b626f8a9c7 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xef7738bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189028.092172:0:66171:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc081b17a00/0xcc1762b626f8a9c7 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189028.092179:0:66171:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc081b17a00/0xcc1762b626f8a9c7 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189028.098447:0:66171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0565e6400/0xcc1762b626f8a9ce lrc: 3/0,1 mode: --/PW res: [0x20000a811:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189028.098474:0:66171:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0565e6400/0xcc1762b626f8a9ce lrc: 3/0,1 mode: PW/PW res: [0x20000a811:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189028.098487:0:66171:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0565e6400/0xcc1762b626f8a9ce lrc: 3/0,1 mode: PW/PW res: [0x20000a811:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1784189028.098504:0:66171:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000069b88450 reply state 00000000ab436b6a transno 98784247809 ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0565e6400/0xcc1762b626f8a9ce lrc: 3/0,1 mode: PW/PW res: [0x20000a811:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189028.098514:0:66171:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0565e6400/0xcc1762b626f8a9ce lrc: 3/0,1 mode: TXN/TXN res: [0x20000a811:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189028.098522:0:66171:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x3:0x0].0x0 (ffff9dc074a73600) 00010000:00010000:1.0:1784189028.098525:0:66171:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1784189028.098528:0:66171:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1784189028.098534:0:66171:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000a811:0x3:0x0]: returning size 4096 00010000:00010000:1.0:1784189028.098544:0:66171:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc081b17400/0xcc1762b626f8a9c0 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189028.098552:0:66171:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc081b17400/0xcc1762b626f8a9c0 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189028.098570:0:66171:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc081b17400/0xcc1762b626f8a9c0 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189028.098576:0:66171:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dc081b17400/0xcc1762b626f8a9c0 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189028.098582:0:66171:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc081b17400 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:1.0:1784189028.098587:0:66171:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc081b17400/0xcc1762b626f8a9c0 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189028.098593:0:66171:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc081b17400/0xcc1762b626f8a9c0 lrc: 5/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189028.098606:0:66171:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9dc074ae2100) 00010000:00010000:1.0:1784189028.098609:0:66171:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784189028.098612:0:66171:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dc081b17400/0xcc1762b626f8a9c0 lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189028.098623:0:66171:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc081b17400/0xcc1762b626f8a9c0 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1784189028.098639:0:66171:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000069b88450 reply state 00000000ab436b6a transno 98784247809 ns: mdt-lustre-MDT0000_UUID lock: ffff9dc081b17a00/0xcc1762b626f8a9c7 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189028.098647:0:66171:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc081b17a00/0xcc1762b626f8a9c7 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189028.098654:0:66171:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xef7738bc (ffff9dc074ae2000) 00010000:00010000:1.0:1784189028.098656:0:66171:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1784189028.098658:0:66171:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:1.0:1784189028.098825:0:66171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf43c5ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+8:66304:x1870854436237440:12345-192.168.203.12@tcp:36:lfs.0 Request processed in 6977us (10076us total) trans 98784247809 rc 0/0 00000100:00100000:1.0:1784189028.098840:0:66171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1074 00000100:00100000:0.0:1784189028.138749:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1784189028.147614:0:68287:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436237568 00000100:00100000:2.0:1784189028.147637:0:68287:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436237568 00000100:00100000:2.0:1784189028.147747:0:68287:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1075 00000100:00100000:2.0:1784189028.147760:0:68287:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc075663480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+8:66305:x1870854436237568:12345-192.168.203.12@tcp:101:lfs.0 00010000:00010000:2.0:1784189028.147798:0:68287:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784189028.147833:0:68287:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04a20b000/0xcc1762b626f8a9d5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbfc5de7fe6c3cff expref: -99 pid: 68287 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189028.147922:0:68287:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04a20b400/0xcc1762b626f8a9dc lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189028.147939:0:68287:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04a20b400/0xcc1762b626f8a9dc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189028.147953:0:68287:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04a20b400/0xcc1762b626f8a9dc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784189028.148017:0:68287:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1784189028.148021:0:68287:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1784189028.148045:0:68287:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04a20b400/0xcc1762b626f8a9dc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189028.148074:0:68287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04a20b000/0xcc1762b626f8a9d5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c3cff expref: 10 pid: 68287 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189028.148116:0:68287:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04a20b400/0xcc1762b626f8a9dc lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c3cff expref: 9 pid: 68287 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189028.148125:0:68287:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9dc0514a2000) 00010000:00010000:2.0:1784189028.148129:0:68287:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1784189028.148133:0:68287:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc04a20b400, rc 0) 00000100:00100000:2.0:1784189028.148220:0:68287:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc075663480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+9:66305:x1870854436237568:12345-192.168.203.12@tcp:101:lfs.0 Request processed in 461us (9485us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189028.148240:0:68287:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1075 00000100:00100000:3.0:1784189028.151615:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1784189028.151667:0:66945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436237696 00000100:00100000:3.0:1784189028.151679:0:66945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436237696 00000100:00100000:3.0:1784189028.151756:0:66945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1076 00000100:00100000:3.0:1784189028.151767:0:66945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc0477c1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+9:66305:x1870854436237696:12345-192.168.203.12@tcp:101:lfs.0 00010000:00010000:3.0:1784189028.151796:0:66945:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784189028.151826:0:66945:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc081b17800/0xcc1762b626f8a9e3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbfc5de7fe6c3d06 expref: -99 pid: 66945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189028.151912:0:66945:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc081b16e00/0xcc1762b626f8a9ea lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189028.151929:0:66945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc081b16e00/0xcc1762b626f8a9ea lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189028.151944:0:66945:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc081b16e00/0xcc1762b626f8a9ea lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189028.151957:0:66945:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc081b17600/0xcc1762b626f8a9f1 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189028.151964:0:66945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc081b17600/0xcc1762b626f8a9f1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189028.151986:0:66945:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc081b17600/0xcc1762b626f8a9f1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189028.152091:0:66945:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc081b17c00/0xcc1762b626f8a9f8 lrc: 3/1,0 mode: --/PR res: [0x20000a811:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189028.152100:0:66945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc081b17c00/0xcc1762b626f8a9f8 lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189028.152108:0:66945:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc081b17c00/0xcc1762b626f8a9f8 lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784189028.152157:0:66945:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000a811:0x3:0x0]: returning size 4096 00000004:00200000:3.0:1784189028.152161:0:66945:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1784189028.152188:0:66945:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9dc081b17c00/0xcc1762b626f8a9f8 lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189028.152205:0:66945:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc081b16e00/0xcc1762b626f8a9ea lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189028.152212:0:66945:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc081b16e00/0xcc1762b626f8a9ea lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189028.152219:0:66945:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc081b16e00/0xcc1762b626f8a9ea lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189028.152239:0:66945:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dc081b16e00/0xcc1762b626f8a9ea lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189028.152245:0:66945:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc081b16e00 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:3.0:1784189028.152250:0:66945:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc081b16e00/0xcc1762b626f8a9ea lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189028.152265:0:66945:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc081b16e00/0xcc1762b626f8a9ea lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189028.152279:0:66945:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9dc0514a2000) 00010000:00010000:3.0:1784189028.152282:0:66945:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784189028.152287:0:66945:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dc081b16e00/0xcc1762b626f8a9ea lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189028.152293:0:66945:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc081b16e00/0xcc1762b626f8a9ea lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189028.152309:0:66945:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc081b17600/0xcc1762b626f8a9f1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189028.152314:0:66945:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc081b17600/0xcc1762b626f8a9f1 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189028.152348:0:66945:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dc081b17600/0xcc1762b626f8a9f1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189028.152355:0:66945:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc081b17600 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:3.0:1784189028.152357:0:66945:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc081b17600/0xcc1762b626f8a9f1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189028.152364:0:66945:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc081b17600/0xcc1762b626f8a9f1 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189028.152372:0:66945:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xef7738bc (ffff9dc074ae2000) 00010000:00010000:3.0:1784189028.152375:0:66945:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784189028.152378:0:66945:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dc081b17600/0xcc1762b626f8a9f1 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189028.152394:0:66945:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc081b17600/0xcc1762b626f8a9f1 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189028.152427:0:66945:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc081b17800/0xcc1762b626f8a9e3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c3d06 expref: 11 pid: 66945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189028.152443:0:66945:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc081b17c00/0xcc1762b626f8a9f8 lrc: 3/0,0 mode: PR/PR res: [0x20000a811:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c3d06 expref: 10 pid: 66945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189028.152451:0:66945:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x3:0x0].0x0 (ffff9dc074a73600) 00010000:00010000:3.0:1784189028.152453:0:66945:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1784189028.152456:0:66945:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc081b17c00, rc 0) 00000100:00100000:3.0:1784189028.152534:0:66945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc0477c1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+10:66305:x1870854436237696:12345-192.168.203.12@tcp:101:lfs.0 Request processed in 767us (934us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189028.152542:0:66945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1076 00000100:00100000:2.0:1784189028.164096:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1784189028.164187:0:66171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436237952 00000100:00100000:0.0:1784189028.164208:0:66171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436237952 00000100:00100000:0.0:1784189028.164292:0:66171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1077 00000100:00100000:0.0:1784189028.164305:0:66171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf48598000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+10:66305:x1870854436237952:12345-192.168.203.12@tcp:101:lfs.0 00010000:00010000:0.0:1784189028.164357:0:66171:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784189028.164386:0:66171:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc070147e00/0xcc1762b626f8a9ff lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbfc5de7fe6c3d0d expref: -99 pid: 66171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784189028.164534:0:66171:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000a811:0x3:0x0]: returning size 4096 00010000:00010000:0.0:1784189028.164674:0:66171:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc070147e00/0xcc1762b626f8a9ff lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c3d0d expref: 12 pid: 66171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189028.164692:0:66171:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9dc0514a2000) 00010000:00010000:0.0:1784189028.164695:0:66171:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1784189028.164700:0:66171:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc070147e00/0xcc1762b626f8a9ff lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c3d0d expref: 12 pid: 66171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189028.164714:0:66171:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc070147e00, rc 0) 00000100:00100000:0.0:1784189028.164790:0:66171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf48598000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+11:66305:x1870854436237952:12345-192.168.203.12@tcp:101:lfs.0 Request processed in 487us (705us total) trans 98784247810 rc 301/301 00000100:00100000:0.0:1784189028.164797:0:66171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1077 00000100:00100000:0.0:1784189028.182493:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1784189028.182903:0:66169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436238208 00000100:00100000:3.0:1784189028.182918:0:66169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436238208 00000100:00100000:3.0:1784189028.183007:0:66169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1078 00000100:00100000:3.0:1784189028.183018:0:66169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc075660a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+11:66305:x1870854436238208:12345-192.168.203.12@tcp:36:lfs.0 00010000:00010000:3.0:1784189028.183092:0:66169:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784189028.183126:0:66169:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc081b17c00/0xcc1762b626f8a9f8 lrc: 0/0,0 mode: --/PR res: [0x20000a811:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c3d06 expref: 11 pid: 66945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189028.183147:0:66169:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x3:0x0].0x0 (ffff9dc074a73600) 00010000:00010000:3.0:1784189028.183153:0:66169:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1784189028.183182:0:66169:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc081b17800/0xcc1762b626f8aa0d lrc: 3/0,1 mode: --/PW res: [0x20000a811:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189028.183211:0:66169:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc081b17800/0xcc1762b626f8aa0d lrc: 3/0,1 mode: PW/PW res: [0x20000a811:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189028.183233:0:66169:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc081b17800/0xcc1762b626f8aa0d lrc: 3/0,1 mode: PW/PW res: [0x20000a811:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1784189028.183560:0:66169:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000b57b3371 reply state 00000000945514c4 transno 98784247811 ns: mdt-lustre-MDT0000_UUID lock: ffff9dc081b17800/0xcc1762b626f8aa0d lrc: 3/0,1 mode: PW/PW res: [0x20000a811:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189028.183576:0:66169:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc081b17800/0xcc1762b626f8aa0d lrc: 3/0,1 mode: TXN/TXN res: [0x20000a811:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189028.183583:0:66169:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x3:0x0].0x0 (ffff9dc074a73600) 00010000:00010000:3.0:1784189028.183585:0:66169:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00000100:00100000:3.0:1784189028.183588:0:66169:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1784189028.183599:0:66169:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000a811:0x3:0x0]: returning size 4096 00000100:00100000:3.0:1784189028.183702:0:66169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc075660a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+12:66305:x1870854436238208:12345-192.168.203.12@tcp:36:lfs.0 Request processed in 685us (1222us total) trans 98784247811 rc 0/0 00000100:00100000:3.0:1784189028.183710:0:66169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1078 00000100:00100000:2.0:1784189028.187421:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1784189028.187472:0:66172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436238464 00000100:00100000:2.0:1784189028.187484:0:66172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436238464 00000100:00100000:2.0:1784189028.187550:0:66172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 217 00000100:00100000:2.0:1784189028.187562:0:66172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc06bbf1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+12:66305:x1870854436238464:12345-192.168.203.12@tcp:35:lfs.0 00000100:00100000:2.0:1784189028.187864:0:66172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc06bbf1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+13:66305:x1870854436238464:12345-192.168.203.12@tcp:35:lfs.0 Request processed in 303us (455us total) trans 98784247812 rc 0/0 00000100:00100000:2.0:1784189028.187873:0:66172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 217 00000100:00100000:1.0:1784189028.400443:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf43c5c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1870854458042112:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1784189028.400542:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784189028.402150:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc06bbf3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1870854458042240:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1784189028.402237:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784189028.402644:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458042112 00000100:00100000:2.0:1784189028.402655:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458042112 00000100:00100000:2.0:1784189028.402723:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458042240 00000100:00100000:2.0:1784189028.402727:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458042240 00000100:00100000:2.0:1784189028.402747:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1860 00000100:00100000:2.0:1784189028.402759:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf43c5c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1870854458042112:12345-0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1784189028.402878:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1861 00000100:00100000:0.0:1784189028.402903:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf43c5fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1870854458042240:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1784189028.402938:0:8432:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8651456 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1784189028.403030:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf43c5fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1870854458042240:12345-0@lo:13:osp-pre-1-1.0 Request processed in 141us (793us total) trans 0 rc 0/0 00000100:00100000:0.0:1784189028.403038:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1861 00002000:00000024:2.0:1784189028.403099:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8651456 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1784189028.403147:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc06bbf3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1870854458042240:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1784189028.403185:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf43c5c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1870854458042112:12345-0@lo:13:osp-pre-0-1.0 Request processed in 426us (2640us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189028.403196:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1860 00000100:00100000:0.0:1784189028.403232:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf43c5c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1870854458042112:0@lo:13:osp-pre-0-1.0 00000100:00080000:2.0:1784189028.403256:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1784189028.403262:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:2.0:1784189029.079847:0:85078:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 98784247812 is committed 00010000:00010000:3.0:1784189029.079959:0:3627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc081b17a00/0xcc1762b626f8a9c7 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189029.079972:0:3627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc081b17a00/0xcc1762b626f8a9c7 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189029.079980:0:3627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dc081b17a00/0xcc1762b626f8a9c7 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189029.079987:0:3627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc081b17a00 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:3.0:1784189029.079992:0:3627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc081b17a00/0xcc1762b626f8a9c7 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189029.080014:0:3627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc081b17a00/0xcc1762b626f8a9c7 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189029.080032:0:3627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xef7738bc (ffff9dc074ae2000) 00010000:00010000:3.0:1784189029.080035:0:3627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784189029.080040:0:3627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dc081b17a00/0xcc1762b626f8a9c7 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189029.080047:0:3627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc081b17a00/0xcc1762b626f8a9c7 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189029.080065:0:3627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0565e6400/0xcc1762b626f8a9ce lrc: 3/0,1 mode: TXN/TXN res: [0x20000a811:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189029.080072:0:3627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0565e6400/0xcc1762b626f8a9ce lrc: 2/0,0 mode: TXN/TXN res: [0x20000a811:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189029.080078:0:3627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0565e6400/0xcc1762b626f8a9ce lrc: 3/0,0 mode: TXN/TXN res: [0x20000a811:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189029.080083:0:3627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc0565e6400 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:3.0:1784189029.080086:0:3627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0565e6400/0xcc1762b626f8a9ce lrc: 3/0,0 mode: TXN/TXN res: [0x20000a811:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189029.080092:0:3627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0565e6400/0xcc1762b626f8a9ce lrc: 4/0,0 mode: TXN/TXN res: [0x20000a811:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189029.080099:0:3627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x3:0x0].0x0 (ffff9dc074a73600) 00010000:00010000:3.0:1784189029.080102:0:3627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784189029.080105:0:3627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0565e6400/0xcc1762b626f8a9ce lrc: 2/0,0 mode: --/TXN res: [0x20000a811:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189029.080116:0:3627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0565e6400/0xcc1762b626f8a9ce lrc: 0/0,0 mode: --/TXN res: [0x20000a811:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189029.080132:0:3627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc081b17800/0xcc1762b626f8aa0d lrc: 3/0,1 mode: TXN/TXN res: [0x20000a811:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189029.080138:0:3627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc081b17800/0xcc1762b626f8aa0d lrc: 2/0,0 mode: TXN/TXN res: [0x20000a811:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189029.080144:0:3627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dc081b17800/0xcc1762b626f8aa0d lrc: 3/0,0 mode: TXN/TXN res: [0x20000a811:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189029.080148:0:3627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc081b17800 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:3.0:1784189029.080152:0:3627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc081b17800/0xcc1762b626f8aa0d lrc: 3/0,0 mode: TXN/TXN res: [0x20000a811:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189029.080169:0:3627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc081b17800/0xcc1762b626f8aa0d lrc: 4/0,0 mode: TXN/TXN res: [0x20000a811:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189029.080177:0:3627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x3:0x0].0x0 (ffff9dc074a73600) 00010000:00010000:3.0:1784189029.080179:0:3627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1784189029.080186:0:3627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dc081b17800/0xcc1762b626f8aa0d lrc: 2/0,0 mode: --/TXN res: [0x20000a811:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189029.080193:0:3627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc081b17800/0xcc1762b626f8aa0d lrc: 0/0,0 mode: --/TXN res: [0x20000a811:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189029.104553:0:7454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784189029.138564:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1784189029.138612:0:66170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436238592 00000100:00100000:0.0:1784189029.138622:0:66170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436238592 00000100:00100000:0.0:1784189029.138738:0:66170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1079 00000100:00100000:0.0:1784189029.138749:0:66170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc075660700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+7:66314:x1870854436238592:12345-192.168.203.12@tcp:41:lfs.0 00000004:00000024:0.0:1784189029.138788:0:66170:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445285888 avail 1299046400 00000100:00100000:0.0:1784189029.138866:0:66170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc075660700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+7:66314:x1870854436238592:12345-192.168.203.12@tcp:41:lfs.0 Request processed in 118us (312us total) trans 0 rc 0/0 00000100:00100000:0.0:1784189029.138874:0:66170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1079 00000100:00100000:0.0:1784189029.142765:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1784189029.146599:0:68287:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436238720 00000100:00100000:3.0:1784189029.146612:0:68287:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436238720 00000100:00100000:3.0:1784189029.146704:0:68287:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1080 00000100:00100000:3.0:1784189029.146715:0:68287:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc075660000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+6:66314:x1870854436238720:12345-192.168.203.12@tcp:41:lfs.0 00000004:00000024:3.0:1784189029.146761:0:68287:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445576704 avail 1299337216 00000100:00100000:3.0:1784189029.146835:0:68287:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc075660000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+6:66314:x1870854436238720:12345-192.168.203.12@tcp:41:lfs.0 Request processed in 122us (4078us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189029.146843:0:68287:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1080 00000100:00080000:1.0:1784189029.146987:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1784189029.150346:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1784189029.150547:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436238848 00000100:00100000:3.0:1784189029.150557:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436238848 00000100:00100000:3.0:1784189029.150615:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1862 00000100:00100000:3.0:1784189029.150626:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc07b871450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+5:66314:x1870854436238848:12345-192.168.203.12@tcp:13:lfs.0 00000100:00080000:1.0:1784189029.151288:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00000024:3.0:1784189029.151541:0:8432:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8651456 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1784189029.153185:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc07b871450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+5:66314:x1870854436238848:12345-192.168.203.12@tcp:13:lfs.0 Request processed in 2553us (2857us total) trans 0 rc 0/0 00000100:00100000:0.0:1784189029.153198:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1862 00000100:00100000:3.0:1784189029.158718:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1784189029.158787:0:9466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436238976 00000100:00100000:2.0:1784189029.158797:0:9466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436238976 00000100:00100000:2.0:1784189029.158863:0:9466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1863 00000100:00100000:2.0:1784189029.158873:0:9466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc0477c0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+5:66314:x1870854436238976:12345-192.168.203.12@tcp:13:lfs.0 00002000:00000024:2.0:1784189029.158906:0:9466:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8651456 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1784189029.158969:0:9466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc0477c0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+5:66314:x1870854436238976:12345-192.168.203.12@tcp:13:lfs.0 Request processed in 97us (259us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189029.158977:0:9466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1863 00000100:00080000:3.0:1784189029.159267:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1784189029.222465:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1784189029.222498:0:66945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436239232 00000100:00100000:2.0:1784189029.222506:0:66945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436239232 00000100:00100000:2.0:1784189029.222556:0:66945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1081 00000100:00100000:2.0:1784189029.222565:0:66945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc06bbf0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+7:66321:x1870854436239232:12345-192.168.203.12@tcp:36:mcreate.0 00010000:00010000:2.0:1784189029.222621:0:66945:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784189029.222646:0:66945:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04a20b400/0xcc1762b626f8a9dc lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c3cff expref: 7 pid: 68287 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189029.222663:0:66945:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9dc0514a2000) 00010000:00010000:2.0:1784189029.222674:0:66945:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1784189029.222732:0:66945:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04a20be00/0xcc1762b626f8aa14 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189029.222756:0:66945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04a20be00/0xcc1762b626f8aa14 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189029.222766:0:66945:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04a20be00/0xcc1762b626f8aa14 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189029.222779:0:66945:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04a20ac00/0xcc1762b626f8aa1b lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x21e7de2f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189029.222785:0:66945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04a20ac00/0xcc1762b626f8aa1b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x21e7de2f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189029.222790:0:66945:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04a20ac00/0xcc1762b626f8aa1b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x21e7de2f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189029.223134:0:66945:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04a20be00/0xcc1762b626f8aa14 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189029.223142:0:66945:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04a20be00/0xcc1762b626f8aa14 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189029.223149:0:66945:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04a20be00/0xcc1762b626f8aa14 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189029.223155:0:66945:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04a20be00/0xcc1762b626f8aa14 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189029.223160:0:66945:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc04a20be00 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:2.0:1784189029.223165:0:66945:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04a20be00/0xcc1762b626f8aa14 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189029.223172:0:66945:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04a20be00/0xcc1762b626f8aa14 lrc: 5/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189029.223187:0:66945:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9dc07a72bb00) 00010000:00010000:2.0:1784189029.223190:0:66945:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784189029.223194:0:66945:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04a20be00/0xcc1762b626f8aa14 lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189029.223200:0:66945:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04a20be00/0xcc1762b626f8aa14 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1784189029.223213:0:66945:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000044f920b9 reply state 00000000ba9f5782 transno 98784247813 ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04a20ac00/0xcc1762b626f8aa1b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x21e7de2f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189029.223236:0:66945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04a20ac00/0xcc1762b626f8aa1b lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x21e7de2f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189029.223241:0:66945:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x21e7de2f (ffff9dc07a72b600) 00010000:00010000:2.0:1784189029.223243:0:66945:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1784189029.223246:0:66945:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1784189029.223345:0:66945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc06bbf0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+8:66321:x1870854436239232:12345-192.168.203.12@tcp:36:mcreate.0 Request processed in 780us (885us total) trans 98784247813 rc 0/0 00000100:00100000:2.0:1784189029.223353:0:66945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1081 00000100:00100000:2.0:1784189029.246714:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1784189029.246769:0:66171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436239360 00000100:00100000:3.0:1784189029.246778:0:66171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436239360 00000100:00100000:3.0:1784189029.246829:0:66171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1082 00000100:00100000:3.0:1784189029.246839:0:66171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc06bbf0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+8:66324:x1870854436239360:12345-192.168.203.12@tcp:101:rm.0 00010000:00010000:3.0:1784189029.246862:0:66171:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784189029.246885:0:66171:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc081b17800/0xcc1762b626f8aa22 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbfc5de7fe6c3d14 expref: -99 pid: 66171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189029.246948:0:66171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc081b17a00/0xcc1762b626f8aa29 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189029.246962:0:66171:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc081b17a00/0xcc1762b626f8aa29 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189029.246973:0:66171:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc081b17a00/0xcc1762b626f8aa29 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784189029.247030:0:66171:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1784189029.247034:0:66171:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1784189029.247055:0:66171:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9dc081b17a00/0xcc1762b626f8aa29 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189029.247080:0:66171:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc081b17800/0xcc1762b626f8aa22 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c3d14 expref: 10 pid: 66171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189029.247097:0:66171:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc081b17a00/0xcc1762b626f8aa29 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c3d14 expref: 9 pid: 66171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189029.247106:0:66171:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9dc074ae2000) 00010000:00010000:3.0:1784189029.247109:0:66171:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1784189029.247113:0:66171:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc081b17a00, rc 0) 00000100:00100000:3.0:1784189029.247173:0:66171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc06bbf0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+9:66324:x1870854436239360:12345-192.168.203.12@tcp:101:rm.0 Request processed in 335us (466us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189029.247180:0:66171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1082 00000100:00100000:0.0:1784189029.256135:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1784189029.256637:0:66169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436239488 00000100:00100000:3.0:1784189029.256647:0:66169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436239488 00000100:00100000:3.0:1784189029.256849:0:66169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1083 00000100:00100000:3.0:1784189029.256862:0:66169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc075663100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+9:66324:x1870854436239488:12345-192.168.203.12@tcp:101:rm.0 00010000:00010000:3.0:1784189029.256883:0:66169:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784189029.256902:0:66169:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc081b17c00/0xcc1762b626f8aa30 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbfc5de7fe6c3d1b expref: -99 pid: 66169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189029.256971:0:66169:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc081b17800/0xcc1762b626f8aa37 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189029.256998:0:66169:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc081b17800/0xcc1762b626f8aa37 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189029.257010:0:66169:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc081b17800/0xcc1762b626f8aa37 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189029.257987:0:66169:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc081b17600/0xcc1762b626f8aa3e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x21e7de2f bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189029.258001:0:66169:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc081b17600/0xcc1762b626f8aa3e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x21e7de2f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189029.258011:0:66169:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc081b17600/0xcc1762b626f8aa3e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x21e7de2f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189029.258094:0:66169:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc081b17200/0xcc1762b626f8aa45 lrc: 3/1,0 mode: --/PR res: [0x20000a811:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189029.258103:0:66169:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc081b17200/0xcc1762b626f8aa45 lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189029.258856:0:66169:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc081b17200/0xcc1762b626f8aa45 lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784189029.258908:0:66169:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000a811:0x4:0x0]: returning size 0 00000004:00200000:3.0:1784189029.258912:0:66169:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1784189029.258931:0:66169:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9dc081b17200/0xcc1762b626f8aa45 lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189029.258944:0:66169:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc081b17200/0xcc1762b626f8aa45 lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189029.258966:0:66169:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc081b17800/0xcc1762b626f8aa37 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189029.258973:0:66169:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc081b17800/0xcc1762b626f8aa37 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189029.258980:0:66169:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc081b17800/0xcc1762b626f8aa37 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189029.258987:0:66169:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dc081b17800/0xcc1762b626f8aa37 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189029.258993:0:66169:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc081b17800 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:3.0:1784189029.258996:0:66169:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc081b17800/0xcc1762b626f8aa37 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189029.259003:0:66169:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc081b17800/0xcc1762b626f8aa37 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189029.259016:0:66169:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9dc074ae2000) 00010000:00010000:3.0:1784189029.259018:0:66169:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784189029.259022:0:66169:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dc081b17800/0xcc1762b626f8aa37 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189029.259028:0:66169:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc081b17800/0xcc1762b626f8aa37 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189029.259041:0:66169:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc081b17600/0xcc1762b626f8aa3e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x21e7de2f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189029.259047:0:66169:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc081b17600/0xcc1762b626f8aa3e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x21e7de2f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189029.259059:0:66169:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dc081b17600/0xcc1762b626f8aa3e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x21e7de2f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189029.259064:0:66169:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc081b17600 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:3.0:1784189029.259067:0:66169:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc081b17600/0xcc1762b626f8aa3e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x21e7de2f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189029.259074:0:66169:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc081b17600/0xcc1762b626f8aa3e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x21e7de2f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189029.259083:0:66169:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x21e7de2f (ffff9dc07a72b600) 00010000:00010000:3.0:1784189029.259086:0:66169:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784189029.259088:0:66169:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dc081b17600/0xcc1762b626f8aa3e lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x21e7de2f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189029.259094:0:66169:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc081b17600/0xcc1762b626f8aa3e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x21e7de2f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189029.259142:0:66169:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc081b17c00/0xcc1762b626f8aa30 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c3d1b expref: 11 pid: 66169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189029.259157:0:66169:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc081b17200/0xcc1762b626f8aa45 lrc: 3/0,0 mode: PR/PR res: [0x20000a811:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c3d1b expref: 10 pid: 66169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189029.259165:0:66169:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x4:0x0].0x0 (ffff9dc074ae2600) 00010000:00010000:3.0:1784189029.259167:0:66169:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1784189029.259169:0:66169:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc081b17200, rc 0) 00000100:00100000:1.0:1784189029.263602:0:66169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc075663100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+10:66324:x1870854436239488:12345-192.168.203.12@tcp:101:rm.0 Request processed in 6732us (7466us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189029.263614:0:66169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1083 00000100:00100000:3.0:1784189029.270711:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1784189029.271093:0:66170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436239744 00000100:00100000:0.0:1784189029.271103:0:66170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436239744 00000100:00100000:0.0:1784189029.271164:0:66170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1084 00000100:00100000:0.0:1784189029.271175:0:66170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc0477c2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+10:66324:x1870854436239744:12345-192.168.203.12@tcp:36:rm.0 00010000:00010000:0.0:1784189029.271238:0:66170:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:0.0:1784189029.271266:0:66170:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc081b17200/0xcc1762b626f8aa45 lrc: 0/0,0 mode: --/PR res: [0x20000a811:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c3d1b expref: 10 pid: 66169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189029.271286:0:66170:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x4:0x0].0x0 (ffff9dc074ae2600) 00010000:00010000:0.0:1784189029.271352:0:66170:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc081b17a00/0xcc1762b626f8aa29 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c3d14 expref: 9 pid: 66171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189029.271363:0:66170:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9dc074ae2000) 00010000:00010000:0.0:1784189029.271372:0:66170:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1784189029.271397:0:66170:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc070147e00/0xcc1762b626f8aa4c lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189029.271409:0:66170:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc070147e00/0xcc1762b626f8aa4c lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189029.271420:0:66170:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc070147e00/0xcc1762b626f8aa4c lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189029.271431:0:66170:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc070147800/0xcc1762b626f8aa53 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x21e7de2f bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189029.271439:0:66170:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc070147800/0xcc1762b626f8aa53 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x21e7de2f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189029.271445:0:66170:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc070147800/0xcc1762b626f8aa53 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x21e7de2f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189029.271527:0:66170:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc070147c00/0xcc1762b626f8aa5a lrc: 3/0,1 mode: --/EX res: [0x20000a811:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189029.271535:0:66170:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc070147c00/0xcc1762b626f8aa5a lrc: 3/0,1 mode: EX/EX res: [0x20000a811:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189029.271542:0:66170:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc070147c00/0xcc1762b626f8aa5a lrc: 3/0,1 mode: EX/EX res: [0x20000a811:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189029.271726:0:66170:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc070146200/0xcc1762b626f8aa61 lrc: 3/0,1 mode: --/PW res: [0x20000a811:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189029.271741:0:66170:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc070146200/0xcc1762b626f8aa61 lrc: 3/0,1 mode: PW/PW res: [0x20000a811:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189029.271749:0:66170:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc070146200/0xcc1762b626f8aa61 lrc: 3/0,1 mode: PW/PW res: [0x20000a811:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189029.271756:0:66170:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc070146200/0xcc1762b626f8aa61 lrc: 4/0,1 mode: PW/PW res: [0x20000a811:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189029.271763:0:66170:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc070146200/0xcc1762b626f8aa61 lrc: 4/0,1 mode: PW/PW res: [0x20000a811:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189029.271769:0:66170:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc070146200/0xcc1762b626f8aa61 lrc: 3/0,0 mode: PW/PW res: [0x20000a811:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189029.271795:0:66170:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1784189029.271815:0:66170:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc070147c00/0xcc1762b626f8aa5a lrc: 3/0,1 mode: EX/EX res: [0x20000a811:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189029.271823:0:66170:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc070147c00/0xcc1762b626f8aa5a lrc: 2/0,0 mode: EX/EX res: [0x20000a811:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189029.271825:0:6502:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784189029.271829:0:66170:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dc070147c00/0xcc1762b626f8aa5a lrc: 3/0,0 mode: EX/EX res: [0x20000a811:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189029.271840:0:66170:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc070147c00 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:3.0:1784189029.271841:0:6502:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dc070146200/0xcc1762b626f8aa61 lrc: 2/0,0 mode: PW/PW res: [0x20000a811:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189029.271846:0:66170:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc070147c00/0xcc1762b626f8aa5a lrc: 3/0,0 mode: EX/EX res: [0x20000a811:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189029.271851:0:6502:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc070146200 already unused, calling callback (ffffffffc0b2e230) 00010000:00010000:3.0:1784189029.271858:0:6502:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc070146200/0xcc1762b626f8aa61 lrc: 2/0,0 mode: PW/PW res: [0x20000a811:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189029.271859:0:66170:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc070147c00/0xcc1762b626f8aa5a lrc: 4/0,0 mode: EX/EX res: [0x20000a811:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189029.271874:0:6502:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc070146200/0xcc1762b626f8aa61 lrc: 3/0,0 mode: PW/PW res: [0x20000a811:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189029.271887:0:6502:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x4:0x0].0x0 (ffff9dbf47406f00) 00010000:00010000:3.0:1784189029.271891:0:6502:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1784189029.271894:0:6502:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dc070146200/0xcc1762b626f8aa61 lrc: 1/0,0 mode: --/PW res: [0x20000a811:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189029.271901:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc070146200/0xcc1762b626f8aa61 lrc: 0/0,0 mode: --/PW res: [0x20000a811:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189029.271904:0:66170:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x4:0x0].0x0 (ffff9dbf47406f00) 00010000:00010000:0.0:1784189029.271909:0:66170:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1784189029.271912:0:66170:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dc070147c00/0xcc1762b626f8aa5a lrc: 2/0,0 mode: --/EX res: [0x20000a811:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189029.271913:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784189029.271916:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784189029.271919:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784189029.271921:0:66170:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc070147c00/0xcc1762b626f8aa5a lrc: 0/0,0 mode: --/EX res: [0x20000a811:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189029.271942:0:66170:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc070147e00/0xcc1762b626f8aa4c lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189029.271948:0:66170:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc070147e00/0xcc1762b626f8aa4c lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189029.271954:0:66170:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc070147e00/0xcc1762b626f8aa4c lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189029.271959:0:66170:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dc070147e00/0xcc1762b626f8aa4c lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189029.271963:0:66170:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc070147e00 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:0.0:1784189029.271966:0:66170:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc070147e00/0xcc1762b626f8aa4c lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189029.271971:0:66170:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc070147e00/0xcc1762b626f8aa4c lrc: 5/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189029.271977:0:66170:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9dbf47406700) 00010000:00010000:0.0:1784189029.271979:0:66170:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784189029.271981:0:66170:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dc070147e00/0xcc1762b626f8aa4c lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189029.271995:0:66170:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc070147e00/0xcc1762b626f8aa4c lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1784189029.272005:0:66170:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000e2b3e669 reply state 00000000a468d822 transno 98784247814 ns: mdt-lustre-MDT0000_UUID lock: ffff9dc070147800/0xcc1762b626f8aa53 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x21e7de2f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189029.272015:0:66170:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc070147800/0xcc1762b626f8aa53 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x21e7de2f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189029.272021:0:66170:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x21e7de2f (ffff9dc07a72b600) 00010000:00010000:0.0:1784189029.272023:0:66170:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1784189029.272025:0:66170:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1784189029.272101:0:66170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc0477c2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+10:66324:x1870854436239744:12345-192.168.203.12@tcp:36:rm.0 Request processed in 926us (1396us total) trans 98784247814 rc 0/0 00000100:00100000:0.0:1784189029.272109:0:66170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1084 00010000:00010000:2.0:1784189030.130157:0:26173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784189030.960073:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf43c5ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1870854458042368:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1784189030.960608:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784189030.961016:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc0477c1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3640:1870854458042624:0@lo:400:kworker.0 00000100:00100000:3.0:1784189030.961058:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784189030.961084:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc0477c0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1870854458043136:0@lo:400:kworker.0 00000100:00100000:3.0:1784189030.961109:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784189030.961126:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf4367d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1870854458043648:0@lo:400:kworker.0 00000100:00100000:3.0:1784189030.961149:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784189030.961167:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1784189030.961173:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc0477c1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3640:1870854458042752:0@lo:400:kworker.0 00000100:00100000:3.0:1784189030.961192:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784189030.961235:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc0477c0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1870854458043264:0@lo:400:kworker.0 00000100:00100000:3.0:1784189030.961280:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784189030.961297:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf4367ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1870854458043776:0@lo:400:kworker.0 00000100:00100000:3.0:1784189030.961373:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784189030.961405:0:68287:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458042624 00000100:00100000:3.0:1784189030.961412:0:68287:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458042624 00000100:00100000:3.0:1784189030.961461:0:68287:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458042752 00000100:00100000:3.0:1784189030.961465:0:68287:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458042752 00000100:00100000:3.0:1784189030.961488:0:68287:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1024 00000100:00100000:3.0:1784189030.961497:0:68287:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf4367c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1870854458042624:12345-0@lo:400:kworker.0 00010000:00000080:3.0:1784189030.961519:0:68287:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9dbf4367c700 x1870854458042624/t0(0) o400->lustre-MDT0000-lwp-OST0000_UUID@0@lo:221/0 lens 224/224 e 0 to 0 dl 1784189041 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784189030.961563:0:68287:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf4367c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1870854458042624:12345-0@lo:400:kworker.0 Request processed in 66us (503us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189030.961571:0:68287:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1024 00000100:00100000:3.0:1784189030.961593:0:68287:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1025 00000100:00100000:3.0:1784189030.961602:0:68287:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf4367f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1870854458042752:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784189030.961633:0:23826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458042368 00000100:00100000:3.0:1784189030.961634:0:68287:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf4367f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1870854458042752:12345-0@lo:400:kworker.0 Request processed in 35us (441us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189030.961639:0:23826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458042368 00000100:00100000:3.0:1784189030.961644:0:68287:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1025 00000100:00100000:1.0:1784189030.961933:0:23826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458043136 00000100:00100000:1.0:1784189030.961938:0:23826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458043136 00000100:00100000:1.0:1784189030.961974:0:23826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3717 00000100:00100000:1.0:1784189030.961981:0:23826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf43c5fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3642:x1870854458042368:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1784189030.962007:0:23826:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445576704 avail 1299337216 00000100:00100000:2.0:1784189030.962027:0:26492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3718 00000100:00100000:2.0:1784189030.962038:0:26492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf4367f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3640:x1870854458043136:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784189030.962051:0:23826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf43c5fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3642:x1870854458042368:12345-0@lo:41:osp-pre-1-0.0 Request processed in 69us (1442us total) trans 0 rc 0/0 00010000:00000080:2.0:1784189030.962056:0:26492:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9dbf4367f480 x1870854458043136/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:221/0 lens 224/224 e 0 to 0 dl 1784189041 ref 1 fl Interpret:/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784189030.962061:0:23826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3717 00000100:00100000:2.0:1784189030.962099:0:26492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf4367f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3640:x1870854458043136:12345-0@lo:400:kworker.0 Request processed in 64us (989us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189030.962117:0:26492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3718 00000100:00100000:3.0:1784189030.962242:0:26168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458043648 00000100:00100000:3.0:1784189030.962247:0:26168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458043648 00000100:00100000:3.0:1784189030.962312:0:26168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458043264 00000100:00100000:3.0:1784189030.962337:0:26168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458043264 00000100:00100000:2.0:1784189030.964267:0:26169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458043776 00000100:00100000:2.0:1784189030.964279:0:26169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458043776 00000100:00100000:2.0:1784189030.964363:0:26169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2327 00000100:00100000:2.0:1784189030.964373:0:26169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf4367f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+5:3640:x1870854458043648:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784189030.964448:0:26169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf4367f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+5:3640:x1870854458043648:12345-0@lo:400:kworker.0 Request processed in 77us (3298us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189030.964455:0:26169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2327 00000100:00100000:2.0:1784189030.964471:0:26169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2328 00000100:00100000:2.0:1784189030.964478:0:26169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc080e61f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:3640:x1870854458043264:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784189030.964507:0:26169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc080e61f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:3640:x1870854458043264:12345-0@lo:400:kworker.0 Request processed in 30us (3227us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189030.964512:0:26169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2328 00000100:00100000:2.0:1784189030.964522:0:26169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2329 00000100:00100000:2.0:1784189030.964527:0:26169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc080e63480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+5:3640:x1870854458043776:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784189030.964565:0:26169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc080e63480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+5:3640:x1870854458043776:12345-0@lo:400:kworker.0 Request processed in 37us (3247us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189030.964571:0:26169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2329 00000100:00080000:3.0:1784189030.965215:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1784189030.965219:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1784189030.965222:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1784189030.965225:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1784189030.965264:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc0477c1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:bd553d0d-03e2-4233-b06b-b55bbfa2b954:3643:1870854458042496:0@lo:400:kworker.0 00000100:00100000:3.0:1784189030.965309:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784189030.965403:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc0477c2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3643:1870854458043008:0@lo:400:kworker.0 00000100:00100000:3.0:1784189030.965429:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784189030.965450:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf4367d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3643:1870854458043520:0@lo:400:kworker.0 00000100:00100000:3.0:1784189030.965470:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784189030.965488:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:3.0:1784189030.965494:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc0477c0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3643:1870854458042880:0@lo:400:kworker.0 00000100:00100000:3.0:1784189030.965516:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784189030.965532:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf4367ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1870854458043392:0@lo:400:kworker.0 00000100:00100000:3.0:1784189030.965566:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784189030.965585:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf4367c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3643:1870854458043904:0@lo:400:kworker.0 00000100:00100000:3.0:1784189030.965605:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784189030.965687:0:66170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458043008 00000100:00100000:3.0:1784189030.965692:0:66170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458043008 00000100:00100000:3.0:1784189030.965731:0:66170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458043520 00000100:00100000:3.0:1784189030.965735:0:66170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458043520 00000100:00100000:3.0:1784189030.965746:0:66170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458042880 00000100:00100000:3.0:1784189030.965748:0:66170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458042880 00000100:00100000:3.0:1784189030.965758:0:66170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458043904 00000100:00100000:3.0:1784189030.965760:0:66170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458043904 00000100:00100000:3.0:1784189030.965771:0:66170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1026 00000100:00100000:3.0:1784189030.965777:0:66170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc080e62a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1870854458043008:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784189030.965814:0:66170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc080e62a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1870854458043008:12345-0@lo:400:kworker.0 Request processed in 37us (384us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189030.965819:0:66170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1026 00000100:00100000:3.0:1784189030.965831:0:66170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1027 00000100:00100000:3.0:1784189030.965844:0:66170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc080e62680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1870854458043520:12345-0@lo:400:kworker.0 00010000:00000080:3.0:1784189030.965856:0:66170:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9dc080e62680 x1870854458043520/t0(0) o400->lustre-MDT0000-lwp-MDT0001_UUID@0@lo:221/0 lens 224/224 e 0 to 0 dl 1784189041 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784189030.965880:0:66170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc080e62680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1870854458043520:12345-0@lo:400:kworker.0 Request processed in 38us (410us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189030.965886:0:66170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1027 00000100:00100000:3.0:1784189030.965896:0:66170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1028 00000100:00100000:3.0:1784189030.965916:0:66170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc05ed9b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1870854458042880:12345-0@lo:400:kworker.0 00010000:00000080:3.0:1784189030.965925:0:66170:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9dc05ed9b100 x1870854458042880/t0(0) o400->lustre-MDT0000-lwp-OST0001_UUID@0@lo:221/0 lens 224/224 e 0 to 0 dl 1784189041 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784189030.965950:0:66170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc05ed9b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1870854458042880:12345-0@lo:400:kworker.0 Request processed in 34us (433us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189030.965955:0:66170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1028 00000100:00100000:3.0:1784189030.965966:0:66170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1029 00000100:00100000:3.0:1784189030.965971:0:66170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc05ed98700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1870854458043904:12345-0@lo:400:kworker.0 00010000:00000080:3.0:1784189030.965981:0:66170:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9dc05ed98700 x1870854458043904/t0(0) o400->lustre-MDT0000-lwp-MDT0000_UUID@0@lo:221/0 lens 224/224 e 0 to 0 dl 1784189041 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784189030.966005:0:66170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc05ed98700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1870854458043904:12345-0@lo:400:kworker.0 Request processed in 34us (399us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189030.966011:0:66170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1029 00000100:00100000:3.0:1784189030.966030:0:9982:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458043392 00000100:00100000:3.0:1784189030.966034:0:9982:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458043392 00000100:00100000:3.0:1784189030.966061:0:9982:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2330 00000100:00100000:3.0:1784189030.966067:0:9982:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc05ed98000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3643:x1870854458043392:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784189030.966095:0:9982:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc05ed98000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3643:x1870854458043392:12345-0@lo:400:kworker.0 Request processed in 28us (528us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189030.966108:0:9982:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2330 00000100:00080000:3.0:1784189030.966125:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1784189030.966128:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1784189030.966129:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1784189030.966189:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf43c5ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1870854458042368:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1784189030.966237:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc0477c0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3643:1870854458042880:0@lo:400:kworker.0 00000100:00100000:3.0:1784189030.966246:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf4367ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1870854458043392:0@lo:400:kworker.0 00000100:00100000:3.0:1784189030.966254:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf4367c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3643:1870854458043904:0@lo:400:kworker.0 00000100:00100000:3.0:1784189030.966262:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc0477c2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3643:1870854458043008:0@lo:400:kworker.0 00000100:00100000:3.0:1784189030.966270:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf4367d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3643:1870854458043520:0@lo:400:kworker.0 00000100:00100000:3.0:1784189030.966304:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc0477c1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3640:1870854458042752:0@lo:400:kworker.0 00000100:00100000:3.0:1784189030.966314:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc0477c0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1870854458043264:0@lo:400:kworker.0 00000100:00100000:3.0:1784189030.966348:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf4367ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1870854458043776:0@lo:400:kworker.0 00000100:00100000:3.0:1784189030.966358:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc0477c1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3640:1870854458042624:0@lo:400:kworker.0 00000100:00100000:3.0:1784189030.966368:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc0477c0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1870854458043136:0@lo:400:kworker.0 00000100:00100000:3.0:1784189030.966378:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf4367d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1870854458043648:0@lo:400:kworker.0 00000100:00100000:2.0:1784189030.967055:0:85083:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458042496 00000100:00100000:2.0:1784189030.967062:0:85083:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458042496 00000100:00100000:2.0:1784189030.967107:0:85083:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1784189030.967115:0:85083:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc076253850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd553d0d-03e2-4233-b06b-b55bbfa2b954+24:3643:x1870854458042496:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784189030.967164:0:85083:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc076253850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd553d0d-03e2-4233-b06b-b55bbfa2b954+24:3643:x1870854458042496:12345-0@lo:400:kworker.0 Request processed in 51us (1855us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189030.967170:0:85083:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1784189030.967581:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc0477c1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:bd553d0d-03e2-4233-b06b-b55bbfa2b954:3643:1870854458042496:0@lo:400:kworker.0 00010000:00010000:0.0:1784189031.153575:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784189031.473537:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf43c5c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1870854458044032:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1784189031.473691:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc075660e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1870854458044160:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1784189031.479151:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784189031.480068:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784189031.480086:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc075663800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1870854458044288:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1784189031.480137:0:23826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458044160 00000100:00100000:0.0:1784189031.480147:0:23826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458044160 00000100:00100000:0.0:1784189031.480214:0:23826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3719 00000100:00100000:0.0:1784189031.480224:0:23826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc06bbf1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3640:x1870854458044160:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1784189031.480258:0:23826:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445285888 avail 1299046400 00010000:00000080:0.0:1784189031.480274:0:23826:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9dc06bbf1f80 x1870854458044160/t0(0) o41->lustre-MDT0001-mdtlov_UUID@0@lo:222/0 lens 224/368 e 0 to 0 dl 1784189042 ref 1 fl Interpret:/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784189031.480352:0:23826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc06bbf1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3640:x1870854458044160:12345-0@lo:41:osp-pre-0-1.0 Request processed in 130us (294us total) trans 0 rc 0/0 00000100:00100000:0.0:1784189031.480359:0:23826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3719 00000100:00100000:0.0:1784189031.480484:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc075660e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1870854458044160:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1784189031.481035:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784189031.481057:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458044032 00000100:00100000:2.0:1784189031.481069:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458044032 00000100:00100000:2.0:1784189031.481129:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458044288 00000100:00100000:2.0:1784189031.481133:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458044288 00000100:00100000:2.0:1784189031.481162:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1864 00000100:00100000:2.0:1784189031.481171:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc05ed9b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1870854458044032:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1784189031.481213:0:8432:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8651456 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1784189031.481217:0:9466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1865 00000100:00100000:0.0:1784189031.481235:0:9466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc05ed9a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1870854458044288:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1784189031.481263:0:9466:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8651456 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1784189031.481301:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc05ed9b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1870854458044032:12345-0@lo:13:osp-pre-1-0.0 Request processed in 128us (2154us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189031.481313:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1864 00000100:00100000:0.0:1784189031.481363:0:9466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc05ed9a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1870854458044288:12345-0@lo:13:osp-pre-0-0.0 Request processed in 134us (329us total) trans 0 rc 0/0 00000100:00100000:0.0:1784189031.481373:0:9466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1865 00000100:00100000:3.0:1784189031.481517:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf43c5c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1870854458044032:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1784189031.481552:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc075663800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1870854458044288:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1784189031.721638:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1784189031.721686:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1784189031.721711:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1784189031.721747:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1784189031.721776:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1784189031.721817:0:85084:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436239872 00000100:00100000:3.0:1784189031.721830:0:85084:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436239872 00000100:00100000:3.0:1784189031.721899:0:85084:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 84 00000100:00100000:3.0:1784189031.721911:0:85084:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc0715abc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9957a2dc-fd88-4a91-bca3-e2b7f365ab0c+10:2399:x1870854436239872:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:3.0:1784189031.722003:0:85084:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc0715abc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9957a2dc-fd88-4a91-bca3-e2b7f365ab0c+10:2399:x1870854436239872:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 94us (379us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189031.722012:0:85084:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 84 00000100:00100000:3.0:1784189031.722053:0:66170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436240000 00000100:00100000:3.0:1784189031.722057:0:66170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436240000 00000100:00100000:3.0:1784189031.722115:0:66170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436240128 00000100:00100000:3.0:1784189031.722119:0:66170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436240128 00000100:00100000:3.0:1784189031.722144:0:66170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1030 00000100:00100000:3.0:1784189031.722150:0:66170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc05ed9aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+10:2398:x1870854436240000:12345-192.168.203.12@tcp:400:kworker.0 00010000:00000080:3.0:1784189031.722178:0:66170:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9dc05ed9aa00 x1870854436240000/t0(0) o400->b90fcc1c-0e69-42a4-a116-a71fec7aeb78@192.168.203.12@tcp:222/0 lens 224/224 e 0 to 0 dl 1784189042 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784189031.722215:0:66170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc05ed9aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+10:2398:x1870854436240000:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 65us (528us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189031.722229:0:66170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1030 00000100:00100000:3.0:1784189031.722243:0:66170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1031 00000100:00100000:3.0:1784189031.722249:0:66170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf4367d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+6:2399:x1870854436240128:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:3.0:1784189031.722274:0:66170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf4367d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+6:2399:x1870854436240128:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 26us (563us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189031.722281:0:66170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1031 00000100:00100000:3.0:1784189031.722343:0:14684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436240384 00000100:00100000:3.0:1784189031.722347:0:14684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436240384 00000100:00100000:3.0:1784189031.722379:0:14684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436240256 00000100:00100000:3.0:1784189031.722384:0:14684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436240256 00000100:00100000:3.0:1784189031.722407:0:14684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 2331 00000100:00100000:3.0:1784189031.722414:0:14684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf4367ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+5:2399:x1870854436240384:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:3.0:1784189031.722443:0:14684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf4367ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+5:2399:x1870854436240384:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 30us (709us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189031.722450:0:14684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 2331 00000100:00100000:3.0:1784189031.722462:0:14684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 2332 00000100:00100000:3.0:1784189031.722468:0:14684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf4367d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+5:2398:x1870854436240256:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:3.0:1784189031.722493:0:14684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf4367d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+5:2398:x1870854436240256:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 25us (716us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189031.722499:0:14684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 2332 00000100:00080000:3.0:1784189031.722658:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1784189031.722664:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1784189031.722667:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1784189031.722668:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1784189032.177414:0:7454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784189033.204899:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784189033.519757:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1784189033.519780:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf4367c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1870854458044416:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1784189033.519847:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784189033.519920:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc0477c1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1870854458044544:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1784189033.519945:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784189033.519985:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458044416 00000100:00100000:3.0:1784189033.519992:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458044416 00000100:00100000:3.0:1784189033.520036:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458044544 00000100:00100000:3.0:1784189033.520040:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458044544 00000100:00100000:3.0:1784189033.520056:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1866 00000100:00100000:3.0:1784189033.520065:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf4367ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1870854458044416:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1784189033.520094:0:8432:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8651456 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1784189033.520135:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf4367ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1870854458044416:12345-0@lo:13:osp-pre-0-1.0 Request processed in 72us (288us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189033.520142:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1866 00000100:00100000:3.0:1784189033.520158:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1867 00000100:00100000:3.0:1784189033.520165:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc0477c0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1870854458044544:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1784189033.520181:0:8432:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8651456 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1784189033.520219:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc0477c0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1870854458044544:12345-0@lo:13:osp-pre-1-1.0 Request processed in 54us (273us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189033.520225:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1867 00000100:00080000:3.0:1784189033.520242:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1784189033.520246:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1784189033.520287:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc0477c1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1870854458044544:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1784189033.520311:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf4367c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1870854458044416:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1784189034.223902:0:26173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1784189034.544301:0:85078:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 98784247814 is committed 00010000:00010000:2.0:1784189034.544349:0:3626:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04a20ac00/0xcc1762b626f8aa1b lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x21e7de2f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189034.544361:0:3626:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04a20ac00/0xcc1762b626f8aa1b lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x21e7de2f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189034.544369:0:3626:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04a20ac00/0xcc1762b626f8aa1b lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x21e7de2f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189034.544375:0:3626:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc04a20ac00 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:2.0:1784189034.544380:0:3626:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04a20ac00/0xcc1762b626f8aa1b lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x21e7de2f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189034.544387:0:3626:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04a20ac00/0xcc1762b626f8aa1b lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x21e7de2f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189034.544413:0:3626:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x21e7de2f (ffff9dc07a72b600) 00010000:00010000:2.0:1784189034.544416:0:3626:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784189034.544421:0:3626:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04a20ac00/0xcc1762b626f8aa1b lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x21e7de2f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189034.544428:0:3626:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04a20ac00/0xcc1762b626f8aa1b lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x21e7de2f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189034.544447:0:3626:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc070147800/0xcc1762b626f8aa53 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x21e7de2f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189034.544452:0:3626:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc070147800/0xcc1762b626f8aa53 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x21e7de2f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189034.544458:0:3626:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dc070147800/0xcc1762b626f8aa53 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x21e7de2f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189034.544463:0:3626:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc070147800 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:2.0:1784189034.544466:0:3626:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc070147800/0xcc1762b626f8aa53 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x21e7de2f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189034.544472:0:3626:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc070147800/0xcc1762b626f8aa53 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x21e7de2f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189034.544479:0:3626:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x21e7de2f (ffff9dc07a72b600) 00010000:00010000:2.0:1784189034.544482:0:3626:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784189034.544484:0:3626:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dc070147800/0xcc1762b626f8aa53 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x21e7de2f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189034.544490:0:3626:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc070147800/0xcc1762b626f8aa53 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x21e7de2f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189035.250510:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1784189035.361315:0:86302:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: mds1 REPLAY BARRIER on lustre-MDT0000 00000100:00100000:3.0:1784189035.448668:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1784189035.448783:0:68287:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436240512 00000100:00100000:2.0:1784189035.448792:0:68287:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436240512 00000100:00100000:2.0:1784189035.448865:0:68287:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1085 00000100:00100000:2.0:1784189035.448882:0:68287:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc0477c1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+6:66391:x1870854436240512:12345-192.168.203.12@tcp:101:touch.0 00010000:00010000:2.0:1784189035.448902:0:68287:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784189035.448924:0:68287:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04a20bc00/0xcc1762b626f8aa68 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbfc5de7fe6c3d22 expref: -99 pid: 68287 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189035.448984:0:68287:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04a20ae00/0xcc1762b626f8aa6f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189035.448998:0:68287:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04a20ae00/0xcc1762b626f8aa6f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189035.449010:0:68287:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04a20ae00/0xcc1762b626f8aa6f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784189035.449053:0:68287:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1784189035.449057:0:68287:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1784189035.449087:0:68287:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04a20ae00/0xcc1762b626f8aa6f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189035.449108:0:68287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04a20bc00/0xcc1762b626f8aa68 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c3d22 expref: 8 pid: 68287 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189035.449124:0:68287:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04a20ae00/0xcc1762b626f8aa6f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c3d22 expref: 7 pid: 68287 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189035.449144:0:68287:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9dc082150600) 00010000:00010000:2.0:1784189035.449148:0:68287:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1784189035.449150:0:68287:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc04a20ae00, rc 0) 00010000:00000080:2.0:1784189035.449159:0:68287:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9dc0477c1180 x1870854436240512/t0(0) o101->b90fcc1c-0e69-42a4-a116-a71fec7aeb78@192.168.203.12@tcp:226/0 lens 576/688 e 0 to 0 dl 1784189046 ref 1 fl Interpret:/600/0 rc 0/0 job:'touch.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1784189035.449224:0:68287:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc0477c1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+7:66391:x1870854436240512:12345-192.168.203.12@tcp:101:touch.0 Request processed in 343us (564us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189035.449232:0:68287:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1085 00000100:00080000:3.0:1784189035.449459:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1784189035.454642:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1784189035.454840:0:66945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436240640 00000100:00100000:3.0:1784189035.454849:0:66945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436240640 00000100:00100000:3.0:1784189035.454911:0:66945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1086 00000100:00100000:3.0:1784189035.454921:0:66945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc06bbf2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+7:66391:x1870854436240640:12345-192.168.203.12@tcp:101:touch.0 00010000:00010000:3.0:1784189035.454940:0:66945:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784189035.454960:0:66945:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc081b17c00/0xcc1762b626f8aa76 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbfc5de7fe6c3d29 expref: -99 pid: 66945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189035.455025:0:66945:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc081b17800/0xcc1762b626f8aa7d lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189035.455039:0:66945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc081b17800/0xcc1762b626f8aa7d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189035.455050:0:66945:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc081b17800/0xcc1762b626f8aa7d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189035.455065:0:66945:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc081b17600/0xcc1762b626f8aa84 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189035.455072:0:66945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc081b17600/0xcc1762b626f8aa84 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189035.455078:0:66945:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc081b17600/0xcc1762b626f8aa84 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189035.455158:0:66945:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc081b16800/0xcc1762b626f8aa8b lrc: 3/1,0 mode: --/PR res: [0x20000a811:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189035.455167:0:66945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc081b16800/0xcc1762b626f8aa8b lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189035.455193:0:66945:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc081b16800/0xcc1762b626f8aa8b lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784189035.455230:0:66945:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000a811:0x3:0x0]: returning size 4096 00000004:00200000:3.0:1784189035.455234:0:66945:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1784189035.455257:0:66945:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9dc081b16800/0xcc1762b626f8aa8b lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189035.455270:0:66945:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc081b17800/0xcc1762b626f8aa7d lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189035.455277:0:66945:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc081b17800/0xcc1762b626f8aa7d lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189035.455283:0:66945:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc081b17800/0xcc1762b626f8aa7d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189035.455290:0:66945:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dc081b17800/0xcc1762b626f8aa7d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189035.455296:0:66945:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc081b17800 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:3.0:1784189035.455299:0:66945:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc081b17800/0xcc1762b626f8aa7d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189035.455307:0:66945:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc081b17800/0xcc1762b626f8aa7d lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189035.455347:0:66945:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9dc082150600) 00010000:00010000:3.0:1784189035.455351:0:66945:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784189035.455356:0:66945:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dc081b17800/0xcc1762b626f8aa7d lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189035.455373:0:66945:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc081b17800/0xcc1762b626f8aa7d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189035.455386:0:66945:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc081b17600/0xcc1762b626f8aa84 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189035.455392:0:66945:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc081b17600/0xcc1762b626f8aa84 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189035.455398:0:66945:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dc081b17600/0xcc1762b626f8aa84 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189035.455403:0:66945:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc081b17600 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:3.0:1784189035.455407:0:66945:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc081b17600/0xcc1762b626f8aa84 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189035.455413:0:66945:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc081b17600/0xcc1762b626f8aa84 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189035.455421:0:66945:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xef7738bc (ffff9dc06adaa100) 00010000:00010000:3.0:1784189035.455423:0:66945:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784189035.455426:0:66945:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dc081b17600/0xcc1762b626f8aa84 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189035.455431:0:66945:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc081b17600/0xcc1762b626f8aa84 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189035.455462:0:66945:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc081b17c00/0xcc1762b626f8aa76 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c3d29 expref: 9 pid: 66945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189035.455487:0:66945:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc081b16800/0xcc1762b626f8aa8b lrc: 3/0,0 mode: PR/PR res: [0x20000a811:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c3d29 expref: 8 pid: 66945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189035.455495:0:66945:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x3:0x0].0x0 (ffff9dc06adaa700) 00010000:00010000:3.0:1784189035.455497:0:66945:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1784189035.455499:0:66945:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc081b16800, rc 0) 00010000:00000080:3.0:1784189035.455506:0:66945:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9dc06bbf2a00 x1870854436240640/t0(0) o101->b90fcc1c-0e69-42a4-a116-a71fec7aeb78@192.168.203.12@tcp:226/0 lens 592/688 e 0 to 0 dl 1784189046 ref 1 fl Interpret:/600/0 rc 0/0 job:'touch.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1784189035.455570:0:66945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc06bbf2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+8:66391:x1870854436240640:12345-192.168.203.12@tcp:101:touch.0 Request processed in 650us (938us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189035.455578:0:66945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1086 00000100:00100000:3.0:1784189035.458584:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1784189035.459407:0:66171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436240896 00000100:00100000:0.0:1784189035.459418:0:66171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436240896 00000100:00100000:0.0:1784189035.459480:0:66171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1087 00000100:00100000:0.0:1784189035.459490:0:66171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc0477c1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+8:66391:x1870854436240896:12345-192.168.203.12@tcp:101:touch.0 00010000:00010000:0.0:1784189035.459509:0:66171:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784189035.459529:0:66171:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc070147800/0xcc1762b626f8aa92 lrc: 2/0,0 mode: --/CW res: [0x20000a811:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbfc5de7fe6c3d30 expref: -99 pid: 66171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189035.459628:0:66171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc070146c00/0xcc1762b626f8aa99 lrc: 3/0,1 mode: --/CW res: [0x20000a811:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189035.459643:0:66171:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc070146c00/0xcc1762b626f8aa99 lrc: 3/0,1 mode: CW/CW res: [0x20000a811:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189035.459654:0:66171:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc070146c00/0xcc1762b626f8aa99 lrc: 3/0,1 mode: CW/CW res: [0x20000a811:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189035.459667:0:66171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc070147400/0xcc1762b626f8aaa0 lrc: 3/0,1 mode: --/PW res: [0x20000a811:0x3:0x0].0xfa0fa5c1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189035.459674:0:66171:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc070147400/0xcc1762b626f8aaa0 lrc: 3/0,1 mode: PW/PW res: [0x20000a811:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189035.459697:0:66171:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc070147400/0xcc1762b626f8aaa0 lrc: 3/0,1 mode: PW/PW res: [0x20000a811:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189035.460123:0:66171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc070146e00/0xcc1762b626f8aaa7 lrc: 3/0,1 mode: --/PW res: [0x20000a811:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189035.460133:0:66171:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc070146e00/0xcc1762b626f8aaa7 lrc: 3/0,1 mode: PW/PW res: [0x20000a811:0x5:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189035.460139:0:66171:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc070146e00/0xcc1762b626f8aaa7 lrc: 3/0,1 mode: PW/PW res: [0x20000a811:0x5:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1784189035.460186:0:66171:0:(mdt_lvb.c:89:mdt_dom_disk_lvbo_update()) res: [0x20000a811:0x5:0x0] updating lvb size from disk: 0 -> 0 00000004:00010000:0.0:1784189035.460190:0:66171:0:(mdt_lvb.c:96:mdt_dom_disk_lvbo_update()) res: [0x20000a811:0x5:0x0] updating lvb mtime from disk: 0 -> 1784189034 00000004:00010000:0.0:1784189035.460192:0:66171:0:(mdt_lvb.c:102:mdt_dom_disk_lvbo_update()) res: [0x20000a811:0x5:0x0] updating lvb atime from disk: 0 -> 1784189034 00000004:00010000:0.0:1784189035.460194:0:66171:0:(mdt_lvb.c:108:mdt_dom_disk_lvbo_update()) res: [0x20000a811:0x5:0x0] updating lvb ctime from disk: 0 -> 1784189034 00000004:00010000:0.0:1784189035.460196:0:66171:0:(mdt_lvb.c:114:mdt_dom_disk_lvbo_update()) res: [0x20000a811:0x5:0x0] updating lvb blocks from disk: 18427282363563114435 -> 0 00002000:00010000:0.0:1784189035.460199:0:66171:0:(mdt_io.c:1550:mdt_lvb2reply()) size 0 00010000:00010000:0.0:1784189035.460206:0:66171:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc070146c00/0xcc1762b626f8aa99 lrc: 4/0,1 mode: CW/CW res: [0x20000a811:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189035.460212:0:66171:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc070146c00/0xcc1762b626f8aa99 lrc: 4/0,1 mode: CW/CW res: [0x20000a811:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189035.460217:0:66171:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc070146c00/0xcc1762b626f8aa99 lrc: 3/0,0 mode: CW/CW res: [0x20000a811:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189035.460223:0:66171:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dc070146c00/0xcc1762b626f8aa99 lrc: 4/0,0 mode: CW/CW res: [0x20000a811:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189035.460229:0:66171:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc070146c00 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:0.0:1784189035.460241:0:66171:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc070146c00/0xcc1762b626f8aa99 lrc: 4/0,0 mode: CW/CW res: [0x20000a811:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189035.460248:0:66171:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc070146c00/0xcc1762b626f8aa99 lrc: 5/0,0 mode: CW/CW res: [0x20000a811:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189035.460260:0:66171:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x3:0x0].0x0 (ffff9dc06adaa700) 00010000:00010000:0.0:1784189035.460263:0:66171:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784189035.460267:0:66171:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dc070146c00/0xcc1762b626f8aa99 lrc: 3/0,0 mode: --/CW res: [0x20000a811:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189035.460274:0:66171:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc070146c00/0xcc1762b626f8aa99 lrc: 0/0,0 mode: --/CW res: [0x20000a811:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1784189035.460286:0:66171:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000007d7043b9 reply state 00000000a41541f0 transno 98784247815 ns: mdt-lustre-MDT0000_UUID lock: ffff9dc070147400/0xcc1762b626f8aaa0 lrc: 3/0,1 mode: PW/PW res: [0x20000a811:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189035.460296:0:66171:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc070147400/0xcc1762b626f8aaa0 lrc: 3/0,1 mode: TXN/TXN res: [0x20000a811:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189035.460302:0:66171:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x3:0x0].0xfa0fa5c1 (ffff9dc074ae2200) 00010000:00010000:0.0:1784189035.460304:0:66171:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1784189035.460306:0:66171:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1784189035.460376:0:66171:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc070147800/0xcc1762b626f8aa92 lrc: 0/0,0 mode: --/CW res: [0x20000a811:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c3d30 expref: 11 pid: 66171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189035.460391:0:66171:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc070146e00/0xcc1762b626f8aaa7 lrc: 3/0,0 mode: PW/PW res: [0x20000a811:0x5:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c3d30 expref: 10 pid: 66171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189035.460399:0:66171:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x5:0x0].0x0 (ffff9dc074ae2000) 00010000:00010000:0.0:1784189035.460401:0:66171:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5b 00010000:00010000:0.0:1784189035.460410:0:66171:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc070146e00, rc 0) 00010000:00000080:0.0:1784189035.460418:0:66171:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9dc0477c1500 x1870854436240896/t98784247815(0) o101->b90fcc1c-0e69-42a4-a116-a71fec7aeb78@192.168.203.12@tcp:226/0 lens 752/824 e 0 to 0 dl 1784189046 ref 1 fl Interpret:/600/0 rc 0/0 job:'touch.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1784189035.460482:0:66171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc0477c1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+11:66391:x1870854436240896:12345-192.168.203.12@tcp:101:touch.0 Request processed in 994us (1905us total) trans 98784247815 rc 0/0 00000100:00100000:0.0:1784189035.460489:0:66171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1087 00000100:00100000:3.0:1784189035.464235:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1784189035.465943:0:66170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436241152 00000100:00100000:0.0:1784189035.465957:0:66170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436241152 00000100:00100000:0.0:1784189035.466020:0:66170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1088 00000100:00100000:0.0:1784189035.466030:0:66170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc0477c0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+11:66391:x1870854436241152:12345-192.168.203.12@tcp:36:touch.0 00010000:00010000:0.0:1784189035.466150:0:66170:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc070147600/0xcc1762b626f8aab5 lrc: 3/0,1 mode: --/PW res: [0x20000a811:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189035.466167:0:66170:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc070146e00/0xcc1762b626f8aaa7 lrc: 2/0,0 mode: PW/PW res: [0x20000a811:0x5:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c3d30 expref: 11 pid: 66171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189035.466185:0:66170:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc070147600/0xcc1762b626f8aab5 lrc: 4/0,1 mode: --/PW res: [0x20000a811:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189035.466222:0:66170:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9dc070146e00/0xcc1762b626f8aaa7 lrc: 3/0,0 mode: PW/PW res: [0x20000a811:0x5:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c3d30 expref: 11 pid: 66171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189035.466236:0:66170:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc070146e00/0xcc1762b626f8aaa7 lrc: 4/0,0 mode: PW/PW res: [0x20000a811:0x5:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c3d30 expref: 11 pid: 66171 timeout: 3377 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784189035.466251:0:66170:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc075660e00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:66170:1870854458044672:192.168.203.12@tcp:104: 00000100:00100000:0.0:1784189035.466349:0:66170:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dc04a63b840 going to sleep for 11 seconds 00000100:00100000:0.0:1784189035.470677:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1784189035.470726:0:7455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436241280 00000100:00100000:0.0:1784189035.470734:0:7455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436241280 00010000:00010000:0.0:1784189035.470770:0:7455:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc070146e00/0xcc1762b626f8aaa7 lrc: 5/0,0 mode: PW/PW res: [0x20000a811:0x5:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c3d30 expref: 12 pid: 66171 timeout: 3377 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784189035.473630:0:7455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 2540 00000100:00100000:0.0:1784189035.473650:0:7455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc075661880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+12:2396:x1870854436241280:12345-192.168.203.12@tcp:102:ldlm_bl.0 00010000:00010000:0.0:1784189035.473678:0:7455:0:(ldlm_lockd.c:1655:ldlm_handle_convert0()) ### server-side convert handler START ns: mdt-lustre-MDT0000_UUID lock: ffff9dc070146e00/0xcc1762b626f8aaa7 lrc: 5/0,0 mode: PW/PW res: [0x20000a811:0x5:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c3d30 expref: 12 pid: 66171 timeout: 3377 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189035.473693:0:7455:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9dc070146e00/0xcc1762b626f8aaa7 lrc: 4/0,0 mode: PW/PW res: [0x20000a811:0x5:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c3d30 expref: 12 pid: 66171 timeout: 3377 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189035.473705:0:7455:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc070146e00/0xcc1762b626f8aaa7 lrc: 4/0,0 mode: PW/PW res: [0x20000a811:0x5:0x0].0x0 bits 0x59/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c3d30 expref: 12 pid: 66171 timeout: 3377 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189035.473714:0:7455:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x5:0x0].0x0 (ffff9dc074ae2000) 00010000:00010000:0.0:1784189035.473716:0:7455:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5b 00010000:00010000:0.0:1784189035.473720:0:7455:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9dc070147600/0xcc1762b626f8aab5 lrc: 3/0,1 mode: --/PW res: [0x20000a811:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189035.473731:0:7455:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc070147600/0xcc1762b626f8aab5 lrc: 3/0,1 mode: PW/PW res: [0x20000a811:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50290000000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189035.473737:0:7455:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc070147600/0xcc1762b626f8aab5 lrc: 4/0,1 mode: PW/PW res: [0x20000a811:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50290000000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189035.473762:0:7455:0:(ldlm_lockd.c:1704:ldlm_handle_convert0()) ### server-side convert handler END, rc = 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9dc070146e00/0xcc1762b626f8aaa7 lrc: 4/0,0 mode: PW/PW res: [0x20000a811:0x5:0x0].0x0 bits 0x59/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c3d30 expref: 12 pid: 66171 timeout: 3377 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784189035.473840:0:7455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc075661880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+12:2396:x1870854436241280:12345-192.168.203.12@tcp:102:ldlm_bl.0 Request processed in 198us (3171us total) trans 0 rc 0/0 00000100:00100000:0.0:1784189035.473847:0:7455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 2540 00000100:00100000:3.0:1784189035.474262:0:66170:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc075660e00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:66170:1870854458044672:192.168.203.12@tcp:104: 00010000:00010000:3.0:1784189035.474284:0:66170:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9dc070147600/0xcc1762b626f8aab5 lrc: 3/0,1 mode: PW/PW res: [0x20000a811:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189035.474293:0:66170:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9dc070147600/0xcc1762b626f8aab5 lrc: 3/0,1 mode: PW/PW res: [0x20000a811:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189035.474299:0:66170:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc070147600/0xcc1762b626f8aab5 lrc: 3/0,1 mode: PW/PW res: [0x20000a811:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1784189035.474440:0:66170:0:(mdt_lvb.c:89:mdt_dom_disk_lvbo_update()) res: [0x20000a811:0x5:0x0] updating lvb size from disk: 0 -> 0 00000004:00010000:3.0:1784189035.474444:0:66170:0:(mdt_lvb.c:96:mdt_dom_disk_lvbo_update()) res: [0x20000a811:0x5:0x0] updating lvb mtime from disk: 1784189034 -> 1784189034 00000004:00010000:3.0:1784189035.474446:0:66170:0:(mdt_lvb.c:102:mdt_dom_disk_lvbo_update()) res: [0x20000a811:0x5:0x0] updating lvb atime from disk: 1784189034 -> 1784189034 00000004:00010000:3.0:1784189035.474455:0:66170:0:(mdt_lvb.c:108:mdt_dom_disk_lvbo_update()) res: [0x20000a811:0x5:0x0] updating lvb ctime from disk: 1784189034 -> 1784189034 00000004:00010000:3.0:1784189035.474457:0:66170:0:(mdt_lvb.c:114:mdt_dom_disk_lvbo_update()) res: [0x20000a811:0x5:0x0] updating lvb blocks from disk: 0 -> 0 00000004:00010000:3.0:1784189035.474465:0:66170:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000b0cc1981 reply state 00000000dbc1ae71 transno 98784247816 ns: mdt-lustre-MDT0000_UUID lock: ffff9dc070147600/0xcc1762b626f8aab5 lrc: 3/0,1 mode: PW/PW res: [0x20000a811:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189035.474478:0:66170:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc070147600/0xcc1762b626f8aab5 lrc: 3/0,1 mode: TXN/TXN res: [0x20000a811:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189035.474484:0:66170:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x5:0x0].0x0 (ffff9dc074ae2000) 00010000:00010000:3.0:1784189035.474486:0:66170:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1784189035.474489:0:66170:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00000080:3.0:1784189035.474541:0:66170:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9dc0477c0700 x1870854436241152/t98784247816(0) o36->b90fcc1c-0e69-42a4-a116-a71fec7aeb78@192.168.203.12@tcp:226/0 lens 488/456 e 0 to 0 dl 1784189046 ref 1 fl Interpret:/200/0 rc 0/0 job:'touch.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784189035.474583:0:66170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc0477c0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+13:66391:x1870854436241152:12345-192.168.203.12@tcp:36:touch.0 Request processed in 8554us (10358us total) trans 98784247816 rc 0/0 00000100:00100000:3.0:1784189035.474591:0:66170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1088 00000100:00100000:2.0:1784189035.483530:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1784189035.483998:0:66173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436241536 00000100:00100000:3.0:1784189035.484013:0:66173:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436241536 00000100:00100000:3.0:1784189035.484184:0:66173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 218 00000100:00100000:3.0:1784189035.484196:0:66173:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc06bbf0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+13:66391:x1870854436241536:12345-192.168.203.12@tcp:35:touch.0 00010000:00000080:3.0:1784189035.484442:0:66173:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9dc06bbf0380 x1870854436241536/t98784247817(0) o35->b90fcc1c-0e69-42a4-a116-a71fec7aeb78@192.168.203.12@tcp:226/0 lens 392/456 e 0 to 0 dl 1784189046 ref 1 fl Interpret:/600/0 rc 0/0 job:'touch.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1784189035.484510:0:66173:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc06bbf0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+14:66391:x1870854436241536:12345-192.168.203.12@tcp:35:touch.0 Request processed in 317us (2624us total) trans 98784247817 rc 0/0 00000100:00100000:3.0:1784189035.484518:0:66173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 218 00000100:00100000:3.0:1784189036.079526:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc0477c2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3641:1870854458044928:0@lo:400:kworker.0 00000100:00100000:3.0:1784189036.079613:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784189036.079644:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc080df1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1870854458045440:0@lo:400:kworker.0 00000100:00100000:3.0:1784189036.079669:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784189036.079686:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf444e1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1870854458045952:0@lo:400:kworker.0 00000100:00100000:3.0:1784189036.079704:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784189036.079738:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [0->1] 00000100:00100000:3.0:1784189036.079744:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc0477c1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:bd553d0d-03e2-4233-b06b-b55bbfa2b954:3641:1870854458044800:0@lo:400:kworker.0 00000100:00100000:3.0:1784189036.080037:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784189036.080070:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc080df3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3641:1870854458045312:0@lo:400:kworker.0 00000100:00100000:1.0:1784189036.080110:0:85085:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458044800 00000100:00100000:1.0:1784189036.080118:0:85085:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458044800 00000100:00100000:3.0:1784189036.080198:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784189036.080249:0:85085:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1784189036.080269:0:85085:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc0715a8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd553d0d-03e2-4233-b06b-b55bbfa2b954+24:3641:x1870854458044800:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784189036.080435:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc080df3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3641:1870854458045824:0@lo:400:kworker.0 00000100:00100000:3.0:1784189036.080466:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784189036.080483:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf444e1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3641:1870854458046336:0@lo:400:kworker.0 00000100:00100000:3.0:1784189036.080502:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784189036.080522:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf43c5c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1870854458046464:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1784189036.080542:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784189036.080628:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc0477c1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:bd553d0d-03e2-4233-b06b-b55bbfa2b954:3641:1870854458044800:0@lo:400:kworker.0 00000100:00100000:3.0:1784189036.080656:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc0477c0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3642:1870854458045056:0@lo:400:kworker.0 00000100:00100000:3.0:1784189036.080679:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784189036.080696:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc080df1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1870854458045568:0@lo:400:kworker.0 00000100:00100000:3.0:1784189036.080789:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784189036.080811:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf444e1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1870854458046080:0@lo:400:kworker.0 00000100:00100000:3.0:1784189036.080833:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784189036.080863:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1784189036.080869:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf4367c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3642:1870854458045184:0@lo:400:kworker.0 00000100:00100000:3.0:1784189036.080888:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784189036.080896:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc080df2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1870854458045696:0@lo:400:kworker.0 00000100:00100000:3.0:1784189036.080911:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784189036.080925:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf444e0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1870854458046208:0@lo:400:kworker.0 00000100:00100000:3.0:1784189036.080941:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784189036.080970:0:66169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458044928 00000100:00100000:3.0:1784189036.080974:0:66169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458044928 00000100:00100000:3.0:1784189036.081007:0:66169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458045312 00000100:00100000:3.0:1784189036.081009:0:66169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458045312 00000100:00100000:3.0:1784189036.081022:0:66169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458045824 00000100:00100000:3.0:1784189036.081025:0:66169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458045824 00000100:00100000:3.0:1784189036.081034:0:66169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458046336 00000100:00100000:3.0:1784189036.081035:0:66169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458046336 00000100:00100000:3.0:1784189036.081043:0:66169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458045056 00000100:00100000:3.0:1784189036.081046:0:66169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458045056 00000100:00100000:3.0:1784189036.081055:0:66169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458045184 00000100:00100000:3.0:1784189036.081057:0:66169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458045184 00000100:00100000:3.0:1784189036.081069:0:66169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1032 00000100:00100000:3.0:1784189036.081075:0:66169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf425f9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1870854458044928:12345-0@lo:400:kworker.0 00010000:00000080:3.0:1784189036.081092:0:66169:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9dbf425f9500 x1870854458044928/t0(0) o400->lustre-MDT0000-lwp-OST0000_UUID@0@lo:227/0 lens 224/224 e 0 to 0 dl 1784189047 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784189036.081125:0:66169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf425f9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1870854458044928:12345-0@lo:400:kworker.0 Request processed in 50us (1513us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189036.081132:0:66169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1032 00000100:00100000:3.0:1784189036.081148:0:66169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1033 00000100:00100000:3.0:1784189036.081154:0:66169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf425f9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1870854458045312:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784189036.081206:0:66169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf425f9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1870854458045312:12345-0@lo:400:kworker.0 Request processed in 52us (1008us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189036.081212:0:66169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1033 00000100:00100000:3.0:1784189036.081224:0:66169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1034 00000100:00100000:3.0:1784189036.081230:0:66169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf425fa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1870854458045824:12345-0@lo:400:kworker.0 00010000:00000080:3.0:1784189036.081241:0:66169:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9dbf425fa300 x1870854458045824/t0(0) o400->lustre-MDT0000-lwp-MDT0001_UUID@0@lo:227/0 lens 224/224 e 0 to 0 dl 1784189047 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784189036.081264:0:66169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf425fa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1870854458045824:12345-0@lo:400:kworker.0 Request processed in 35us (798us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189036.081269:0:66169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1034 00000100:00100000:3.0:1784189036.081280:0:66169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1035 00000100:00100000:3.0:1784189036.081286:0:66169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf425f8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1870854458046336:12345-0@lo:400:kworker.0 00010000:00000080:3.0:1784189036.081295:0:66169:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9dbf425f8700 x1870854458046336/t0(0) o400->lustre-MDT0000-lwp-MDT0000_UUID@0@lo:227/0 lens 224/224 e 0 to 0 dl 1784189047 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784189036.081532:0:85085:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc0715a8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd553d0d-03e2-4233-b06b-b55bbfa2b954+24:3641:x1870854458044800:12345-0@lo:400:kworker.0 Request processed in 50us (280us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189036.081542:0:85085:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1784189036.081795:0:66169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf425f8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1870854458046336:12345-0@lo:400:kworker.0 Request processed in 32us (815us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189036.081804:0:66169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1035 00000100:00100000:3.0:1784189036.081818:0:66169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1036 00000100:00100000:3.0:1784189036.081825:0:66169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf425fb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1870854458045056:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784189036.081903:0:66169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf425fb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1870854458045056:12345-0@lo:400:kworker.0 Request processed in 79us (1222us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189036.081909:0:66169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1036 00000100:00100000:3.0:1784189036.081919:0:66169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1037 00000100:00100000:3.0:1784189036.081924:0:66169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf4262df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3642:x1870854458045184:12345-0@lo:400:kworker.0 00010000:00000080:3.0:1784189036.081945:0:66169:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9dbf4262df80 x1870854458045184/t0(0) o400->lustre-MDT0000-lwp-OST0001_UUID@0@lo:227/0 lens 224/224 e 0 to 0 dl 1784189047 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784189036.081969:0:66169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf4262df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3642:x1870854458045184:12345-0@lo:400:kworker.0 Request processed in 46us (1081us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189036.081974:0:66169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1037 00000100:00100000:3.0:1784189036.081994:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458045440 00000100:00100000:3.0:1784189036.081999:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458045440 00000100:00100000:3.0:1784189036.082022:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458045952 00000100:00100000:3.0:1784189036.082024:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458045952 00000100:00100000:3.0:1784189036.082033:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458046464 00000100:00100000:3.0:1784189036.082035:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458046464 00000100:00100000:3.0:1784189036.082044:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3720 00000100:00100000:3.0:1784189036.082049:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf425fad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3641:x1870854458045440:12345-0@lo:400:kworker.0 00010000:00000080:3.0:1784189036.082062:0:8438:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9dbf425fad80 x1870854458045440/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:227/0 lens 224/224 e 0 to 0 dl 1784189047 ref 1 fl Interpret:/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784189036.082086:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf425fad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3641:x1870854458045440:12345-0@lo:400:kworker.0 Request processed in 37us (2416us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189036.082091:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3720 00000100:00100000:3.0:1784189036.082100:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3721 00000100:00100000:3.0:1784189036.082104:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf425f8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3641:x1870854458045952:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784189036.082125:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf425f8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3641:x1870854458045952:12345-0@lo:400:kworker.0 Request processed in 20us (2420us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189036.082129:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3721 00000100:00100000:3.0:1784189036.082137:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3722 00000100:00100000:3.0:1784189036.082142:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf425fb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3641:x1870854458046464:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1784189036.082174:0:8438:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445576704 avail 1299337216 00000100:00100000:3.0:1784189036.082214:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf425fb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3641:x1870854458046464:12345-0@lo:41:osp-pre-1-0.0 Request processed in 71us (1671us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189036.082221:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3722 00000100:00100000:3.0:1784189036.082280:0:26166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458045568 00000100:00100000:3.0:1784189036.082284:0:26166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458045568 00000100:00100000:3.0:1784189036.082312:0:26166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458046080 00000100:00100000:3.0:1784189036.082315:0:26166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458046080 00000100:00100000:3.0:1784189036.082373:0:26166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458045696 00000100:00100000:3.0:1784189036.082376:0:26166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458045696 00000100:00100000:3.0:1784189036.082393:0:26166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458046208 00000100:00100000:3.0:1784189036.082396:0:26166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458046208 00000100:00100000:3.0:1784189036.082415:0:26166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2333 00000100:00100000:3.0:1784189036.082421:0:26166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc0477c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+5:3642:x1870854458045568:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784189036.082452:0:26166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc0477c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+5:3642:x1870854458045568:12345-0@lo:400:kworker.0 Request processed in 32us (1663us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189036.082457:0:26166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2333 00000100:00100000:3.0:1784189036.082467:0:26166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2334 00000100:00100000:3.0:1784189036.082473:0:26166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf4262dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+5:3642:x1870854458046080:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784189036.082500:0:26166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf4262dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+5:3642:x1870854458046080:12345-0@lo:400:kworker.0 Request processed in 27us (1665us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189036.082505:0:26166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2334 00000100:00100000:3.0:1784189036.082516:0:26166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2335 00000100:00100000:3.0:1784189036.082521:0:26166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf4262c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+5:3642:x1870854458045696:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784189036.082547:0:26166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf4262c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+5:3642:x1870854458045696:12345-0@lo:400:kworker.0 Request processed in 26us (1635us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189036.082553:0:26166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2335 00000100:00100000:3.0:1784189036.082563:0:26166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2336 00000100:00100000:3.0:1784189036.082569:0:26166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf4262d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+5:3642:x1870854458046208:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784189036.082604:0:26166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf4262d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+5:3642:x1870854458046208:12345-0@lo:400:kworker.0 Request processed in 36us (1662us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189036.082610:0:26166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2336 00000100:00080000:3.0:1784189036.082637:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1784189036.082641:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1784189036.082643:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1784189036.082645:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1784189036.082689:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf43c5c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1870854458046464:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1784189036.082704:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc080df3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3641:1870854458045312:0@lo:400:kworker.0 00000100:00100000:3.0:1784189036.082726:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc080df3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3641:1870854458045824:0@lo:400:kworker.0 00000100:00100000:3.0:1784189036.082737:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf444e1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3641:1870854458046336:0@lo:400:kworker.0 00000100:00100000:3.0:1784189036.082749:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc0477c2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3641:1870854458044928:0@lo:400:kworker.0 00000100:00100000:3.0:1784189036.082758:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc080df1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1870854458045440:0@lo:400:kworker.0 00000100:00100000:3.0:1784189036.082765:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf444e1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1870854458045952:0@lo:400:kworker.0 00000100:00100000:1.0:1784189036.087248:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc0477c0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3642:1870854458045056:0@lo:400:kworker.0 00000100:00100000:1.0:1784189036.088162:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc080df1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1870854458045568:0@lo:400:kworker.0 00000100:00100000:1.0:1784189036.088188:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf444e1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1870854458046080:0@lo:400:kworker.0 00000100:00100000:1.0:1784189036.088221:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf4367c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3642:1870854458045184:0@lo:400:kworker.0 00000100:00100000:1.0:1784189036.088234:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc080df2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1870854458045696:0@lo:400:kworker.0 00000100:00100000:1.0:1784189036.088246:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf444e0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1870854458046208:0@lo:400:kworker.0 00010000:00010000:1.0:1784189036.276177:0:7454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784189036.598089:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf43c5c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1870854458046848:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1784189036.598226:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784189036.598300:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc075663b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1870854458046592:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1784189036.598354:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784189036.598379:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1784189036.598386:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf4262ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1870854458046720:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1784189036.598407:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784189036.598438:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458046592 00000100:00100000:1.0:1784189036.598444:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458046592 00000100:00100000:1.0:1784189036.598491:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3723 00000100:00100000:1.0:1784189036.598500:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf43c5c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3642:x1870854458046592:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1784189036.598539:0:8438:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445285888 avail 1299046400 00010000:00000080:1.0:1784189036.598558:0:8438:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9dbf43c5c000 x1870854458046592/t0(0) o41->lustre-MDT0001-mdtlov_UUID@0@lo:227/0 lens 224/368 e 0 to 0 dl 1784189047 ref 1 fl Interpret:/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784189036.598609:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf43c5c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3642:x1870854458046592:12345-0@lo:41:osp-pre-0-1.0 Request processed in 110us (254us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189036.598617:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3723 00000100:00100000:1.0:1784189036.598641:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458046848 00000100:00100000:1.0:1784189036.598645:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458046848 00000100:00100000:1.0:1784189036.598676:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458046720 00000100:00100000:1.0:1784189036.598679:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458046720 00000100:00100000:1.0:1784189036.598691:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1868 00000100:00100000:1.0:1784189036.598697:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc075662d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1870854458046848:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1784189036.598719:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8651456 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1784189036.599215:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1869 00000100:00100000:3.0:1784189036.599226:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf43c5ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1870854458046720:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1784189036.599246:0:8432:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8651456 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1784189036.599282:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf43c5ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1870854458046720:12345-0@lo:13:osp-pre-1-0.0 Request processed in 59us (874us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189036.599287:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1869 00000100:00100000:1.0:1784189036.605353:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc075662d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1870854458046848:12345-0@lo:13:osp-pre-0-0.0 Request processed in 6644us (7182us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189036.605366:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1868 00000100:00100000:1.0:1784189036.605459:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf4262ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1870854458046720:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1784189036.605477:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc075663b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1870854458046592:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1784189036.609427:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf43c5c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1870854458046848:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1784189036.842482:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1784189036.842570:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1784189036.842596:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1784189036.842618:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1784189036.842674:0:26161:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436242048 00000100:00100000:1.0:1784189036.842683:0:26161:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436242048 00000100:00100000:1.0:1784189036.842753:0:26161:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 2337 00000100:00100000:1.0:1784189036.842764:0:26161:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc075661500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+5:2397:x1870854436242048:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:1.0:1784189036.842837:0:26161:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc075661500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+5:2397:x1870854436242048:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 75us (265us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189036.842845:0:26161:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 2337 00000100:00080000:1.0:1784189036.842870:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1784189036.848688:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1784189036.848719:0:85083:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436241664 00000100:00100000:0.0:1784189036.848728:0:85083:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436241664 00000100:00100000:0.0:1784189036.848779:0:85083:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 86 00000100:00100000:0.0:1784189036.848790:0:85083:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc0715aa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9957a2dc-fd88-4a91-bca3-e2b7f365ab0c+10:2397:x1870854436241664:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:0.0:1784189036.848855:0:85083:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc0715aa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9957a2dc-fd88-4a91-bca3-e2b7f365ab0c+10:2397:x1870854436241664:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 67us (6257us total) trans 0 rc 0/0 00000100:00100000:0.0:1784189036.848862:0:85083:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 86 00000100:00100000:0.0:1784189036.848895:0:26159:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436242176 00000100:00100000:0.0:1784189036.848898:0:26159:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436242176 00000100:00100000:0.0:1784189036.848936:0:26159:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 2338 00000100:00100000:0.0:1784189036.848942:0:26159:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc075662680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+5:2397:x1870854436242176:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:0.0:1784189036.848968:0:26159:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc075662680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+5:2397:x1870854436242176:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 27us (293us total) trans 0 rc 0/0 00000100:00100000:0.0:1784189036.848982:0:26159:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 2338 00000100:00080000:0.0:1784189036.849106:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1784189036.850576:0:66169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436241792 00000100:00100000:2.0:1784189036.850587:0:66169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436241792 00000100:00100000:3.0:1784189036.850881:0:66169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436241920 00000100:00100000:3.0:1784189036.850886:0:66169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436241920 00000100:00100000:3.0:1784189036.850933:0:66945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1038 00000100:00100000:3.0:1784189036.850942:0:66945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc075660380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+14:2397:x1870854436241792:12345-192.168.203.12@tcp:400:kworker.0 00010000:00000080:3.0:1784189036.850983:0:66945:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9dc075660380 x1870854436241792/t0(0) o400->b90fcc1c-0e69-42a4-a116-a71fec7aeb78@192.168.203.12@tcp:227/0 lens 224/224 e 0 to 0 dl 1784189047 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784189036.851037:0:66945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc075660380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+14:2397:x1870854436241792:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 96us (8566us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189036.851044:0:66945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1038 00000100:00100000:3.0:1784189036.851061:0:66945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1039 00000100:00100000:3.0:1784189036.851068:0:66945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc075661c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+6:2397:x1870854436241920:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:3.0:1784189036.851092:0:66945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc075661c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+6:2397:x1870854436241920:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 24us (8473us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189036.851097:0:66945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1039 00000100:00080000:0.0:1784189036.851725:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000020:01000004:2.0:1784189037.176957:0:86401:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:2.0:1784189037.177017:0:86401:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff9dc070146a00/0xcc1762b626f8a64e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc1762b626f8a655 expref: -99 pid: 85077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189037.177032:0:86401:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff9dc070146a00/0xcc1762b626f8a64e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0xcc1762b626f8a655 expref: -99 pid: 85077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189037.177040:0:86401:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff9dc070146a00/0xcc1762b626f8a64e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0xcc1762b626f8a655 expref: -99 pid: 85077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189037.177047:0:86401:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.112@tcp lock: ffff9dc070146a00/0xcc1762b626f8a64e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0xcc1762b626f8a655 expref: -99 pid: 85077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189037.177304:0:86401:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1784189037.177312:0:86401:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:2.0:1784189037.177826:0:86401:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1784189037.177832:0:86401:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:2.0:1784189037.177838:0:86401:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1784189037.177861:0:86401:0:(import.c:65:import_set_state_nolock()) ffff9dbf46b0c000 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:1.0:1784189037.177919:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc06bbf3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3639:1870854458046976:0@lo:39:umount.0 00000100:00100000:1.0:1784189037.177982:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784189037.178024:0:66170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458046976 00000100:00100000:3.0:1784189037.178033:0:66170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458046976 00000100:00100000:3.0:1784189037.178095:0:66170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1089 00000100:00100000:3.0:1784189037.178104:0:66170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf43c5c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1870854458046976:12345-0@lo:39:umount.0 00010000:00010000:0.0:1784189037.178185:0:6502:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784189037.178192:0:6502:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.112@tcp lock: ffff9dc070146a00/0xcc1762b626f8a64e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0xcc1762b626f8a655 expref: -99 pid: 85077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189037.178202:0:6502:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc070146a00 already unused, calling callback (ffffffffc114ac20) 10000000:00010000:0.0:1784189037.178206:0:6502:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.112@tcp lock: ffff9dc070146a00/0xcc1762b626f8a64e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0xcc1762b626f8a655 expref: -99 pid: 85077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189037.178215:0:6502:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.112@tcp lock: ffff9dc070146a00/0xcc1762b626f8a64e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1008400000000 nid: local remote: 0xcc1762b626f8a655 expref: -99 pid: 85077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1784189037.178222:0:6502:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.112@tcp lock: ffff9dc070146a00/0xcc1762b626f8a64e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1009400000000 nid: local remote: 0xcc1762b626f8a655 expref: -99 pid: 85077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784189037.178228:0:6502:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1784189037.178230:0:6502:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:0.0:1784189037.178232:0:6502:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00000020:00000080:3.0:1784189037.178276:0:66170:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xcc1762b626f8a751 00000100:00080000:3.0:1784189037.178294:0:66170:0:(import.c:65:import_set_state_nolock()) ffff9dbf436c4800 : changing import state from FULL to CLOSED 00010000:00000080:3.0:1784189037.178356:0:66170:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9dbf43c5c700 x1870854458046976/t0(0) o39->lustre-MDT0000-lwp-MDT0000_UUID@0@lo:228/0 lens 224/224 e 0 to 0 dl 1784189048 ref 1 fl Interpret:/200/0 rc 0/0 job:'umount.0' uid:0 gid:0 projid:4294967295 00010000:00010000:2.0:1784189037.178357:0:26173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784189037.178414:0:66170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf43c5c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+1:3639:x1870854458046976:12345-0@lo:39:umount.0 Request processed in 310us (431us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189037.178421:0:66170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1089 00000020:00000080:3.0:1784189037.178432:0:66170:0:(genops.c:906:class_export_put()) final put ffff9dbf436c1800/lustre-MDT0000-lwp-MDT0000_UUID 00000100:00080000:2.0:1784189037.178444:0:3639:0:(import.c:65:import_set_state_nolock()) ffff9dbf46b0c000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:2.0:1784189037.178455:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc06bbf3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3639:1870854458046976:0@lo:39:umount.0 00000100:00080000:2.0:1784189037.178476:0:86401:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1784189037.178479:0:86401:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:2.0:1784189037.178482:0:86401:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1784189037.178685:0:63468:0:(genops.c:865:class_export_destroy()) destroying export ffff9dbf436c1800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000020:00000080:0.0:1784189037.178734:0:63468:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9dbf436c4800 for lustre-MDT0000 00010000:00010000:2.0:1784189037.179560:0:86401:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff9dc042d66200/0xcc1762b626f8a575 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc1762b626f8a57c expref: -99 pid: 85077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189037.179573:0:86401:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff9dc042d66200/0xcc1762b626f8a575 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0xcc1762b626f8a57c expref: -99 pid: 85077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189037.179579:0:86401:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff9dc042d66200/0xcc1762b626f8a575 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0xcc1762b626f8a57c expref: -99 pid: 85077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189037.179586:0:86401:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.112@tcp lock: ffff9dc042d66200/0xcc1762b626f8a575 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0xcc1762b626f8a57c expref: -99 pid: 85077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189037.179737:0:6502:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.112@tcp lock: ffff9dc070146a00/0xcc1762b626f8a64e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0xcc1762b626f8a655 expref: -99 pid: 85077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189037.179745:0:6502:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1784189037.179767:0:6502:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.112@tcp lock: ffff9dc070146a00/0xcc1762b626f8a64e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0xcc1762b626f8a655 expref: -99 pid: 85077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189037.179773:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.112@tcp lock: ffff9dc070146a00/0xcc1762b626f8a64e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0xcc1762b626f8a655 expref: -99 pid: 85077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189037.179786:0:6502:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784189037.179789:0:6502:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.112@tcp lock: ffff9dc042d66200/0xcc1762b626f8a575 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0xcc1762b626f8a57c expref: -99 pid: 85077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189037.179795:0:6502:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc042d66200 already unused, calling callback (ffffffffc114ac20) 10000000:00010000:1.0:1784189037.179799:0:6502:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.112@tcp lock: ffff9dc042d66200/0xcc1762b626f8a575 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0xcc1762b626f8a57c expref: -99 pid: 85077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189037.179807:0:6502:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.112@tcp lock: ffff9dc042d66200/0xcc1762b626f8a575 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1008400000000 nid: local remote: 0xcc1762b626f8a57c expref: -99 pid: 85077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1784189037.179814:0:6502:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.112@tcp lock: ffff9dc042d66200/0xcc1762b626f8a575 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1009400000000 nid: local remote: 0xcc1762b626f8a57c expref: -99 pid: 85077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784189037.179819:0:6502:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1784189037.179822:0:6502:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 00010000:00010000:1.0:1784189037.179839:0:6502:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.112@tcp lock: ffff9dc042d66200/0xcc1762b626f8a575 lrc: 3/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0xcc1762b626f8a57c expref: -99 pid: 85077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189037.179845:0:6502:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1784189037.179856:0:6502:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.112@tcp lock: ffff9dc042d66200/0xcc1762b626f8a575 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0xcc1762b626f8a57c expref: -99 pid: 85077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189037.179877:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784189037.179879:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784189037.179896:0:86401:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1784189037.179901:0:86401:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.112@tcp lock: ffff9dc042d66200/0xcc1762b626f8a575 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0xcc1762b626f8a57c expref: -99 pid: 85077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189037.179912:0:86401:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff9dc042d67200/0xcc1762b626f8a678 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc1762b626f8a67f expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189037.179928:0:86401:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff9dc042d67200/0xcc1762b626f8a678 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xcc1762b626f8a67f expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189037.179935:0:86401:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff9dc042d67200/0xcc1762b626f8a678 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xcc1762b626f8a67f expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189037.179941:0:86401:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.112@tcp lock: ffff9dc042d67200/0xcc1762b626f8a678 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xcc1762b626f8a67f expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784189037.180026:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1784189037.180041:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc05f02df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:bd553d0d-03e2-4233-b06b-b55bbfa2b954:3643:1870854458047232:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1784189037.180093:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784189037.180218:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458047232 00000100:00100000:3.0:1784189037.180224:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458047232 00000100:00100000:3.0:1784189037.180258:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 684 00000100:00100000:3.0:1784189037.180265:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc0711a5850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bd553d0d-03e2-4233-b06b-b55bbfa2b954+24:3643:x1870854458047232:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1784189037.180276:0:6499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784189037.180289:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dc05ec0d400/0xcc1762b626f8a57c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xcc1762b626f8a575 expref: 24 pid: 85083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189037.180300:0:6499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784189037.180342:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc0711a5850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bd553d0d-03e2-4233-b06b-b55bbfa2b954+23:3643:x1870854458047232:12345-0@lo:103:ldlm_bl.0 Request processed in 77us (248us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189037.180348:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 684 00000100:00100000:3.0:1784189037.180412:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc05f02df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:bd553d0d-03e2-4233-b06b-b55bbfa2b954:3643:1870854458047232:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1784189037.180475:0:6501:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784189037.180480:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.112@tcp lock: ffff9dc042d67200/0xcc1762b626f8a678 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xcc1762b626f8a67f expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189037.180487:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc042d67200 already unused, calling callback (ffffffffc114ac20) 10000000:00010000:0.0:1784189037.180491:0:6501:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.112@tcp lock: ffff9dc042d67200/0xcc1762b626f8a678 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xcc1762b626f8a67f expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189037.180508:0:6501:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.112@tcp lock: ffff9dc042d67200/0xcc1762b626f8a678 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xcc1762b626f8a67f expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1784189037.180515:0:6501:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.112@tcp lock: ffff9dc042d67200/0xcc1762b626f8a678 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xcc1762b626f8a67f expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784189037.180520:0:6501:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:0.0:1784189037.180522:0:6501:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 00010000:00010000:0.0:1784189037.180536:0:6501:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.112@tcp lock: ffff9dc042d67200/0xcc1762b626f8a678 lrc: 3/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xcc1762b626f8a67f expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189037.180541:0:6501:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1784189037.180576:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc075661f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:bd553d0d-03e2-4233-b06b-b55bbfa2b954:3643:1870854458047360:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1784189037.180597:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1784189037.180634:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.112@tcp lock: ffff9dc042d67200/0xcc1762b626f8a678 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xcc1762b626f8a67f expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189037.180642:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784189037.180644:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784189037.180646:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784189037.183583:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf4367c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:bd553d0d-03e2-4233-b06b-b55bbfa2b954:3641:1870854458047104:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1784189037.183651:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1784189037.183811:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784189037.183829:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458047360 00000100:00100000:1.0:1784189037.183836:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458047360 00000100:00100000:1.0:1784189037.183882:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458047104 00000100:00100000:1.0:1784189037.183885:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458047104 00000100:00100000:1.0:1784189037.183908:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 685 00000100:00100000:1.0:1784189037.183916:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf4262ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bd553d0d-03e2-4233-b06b-b55bbfa2b954+24:3643:x1870854458047360:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1784189037.183928:0:6500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784189037.183947:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dc070146600/0xcc1762b626f8a67f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xcc1762b626f8a678 expref: 24 pid: 85083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189037.183963:0:6500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784189037.184031:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 686 00000100:00100000:0.0:1784189037.184039:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc075661880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bd553d0d-03e2-4233-b06b-b55bbfa2b954+23:3641:x1870854458047104:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1784189037.184051:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784189037.184061:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dc0755a4a00/0xcc1762b626f8a655 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xcc1762b626f8a64e expref: 23 pid: 85084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189037.184071:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784189037.184098:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc075661880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bd553d0d-03e2-4233-b06b-b55bbfa2b954+22:3641:x1870854458047104:12345-0@lo:103:ldlm_bl.0 Request processed in 60us (447us total) trans 0 rc 0/0 00000100:00100000:0.0:1784189037.184119:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 686 00000100:00100000:0.0:1784189037.184167:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf4367c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:bd553d0d-03e2-4233-b06b-b55bbfa2b954:3641:1870854458047104:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1784189037.184500:0:86401:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1784189037.184509:0:86401:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.112@tcp lock: ffff9dc042d67200/0xcc1762b626f8a678 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xcc1762b626f8a67f expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784189037.184521:0:86401:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:2.0:1784189037.184530:0:86401:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff9dc042d66600/0xcc1762b626f8a639 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc1762b626f8a647 expref: -99 pid: 85077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189037.184538:0:86401:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff9dc042d66600/0xcc1762b626f8a639 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xcc1762b626f8a647 expref: -99 pid: 85077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189037.184546:0:86401:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff9dc042d66600/0xcc1762b626f8a639 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xcc1762b626f8a647 expref: -99 pid: 85077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189037.184553:0:86401:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.112@tcp lock: ffff9dc042d66600/0xcc1762b626f8a639 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xcc1762b626f8a647 expref: -99 pid: 85077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189037.184568:0:86401:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1784189037.184579:0:26173:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784189037.184584:0:26173:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.112@tcp lock: ffff9dc042d66600/0xcc1762b626f8a639 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xcc1762b626f8a647 expref: -99 pid: 85077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189037.184599:0:26173:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc042d66600 already unused, calling callback (ffffffffc114ac20) 10000000:00010000:2.0:1784189037.184603:0:26173:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.112@tcp lock: ffff9dc042d66600/0xcc1762b626f8a639 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xcc1762b626f8a647 expref: -99 pid: 85077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189037.184611:0:26173:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.112@tcp lock: ffff9dc042d66600/0xcc1762b626f8a639 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0xcc1762b626f8a647 expref: -99 pid: 85077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1784189037.184617:0:26173:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.112@tcp lock: ffff9dc042d66600/0xcc1762b626f8a639 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0xcc1762b626f8a647 expref: -99 pid: 85077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784189037.184623:0:26173:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:2.0:1784189037.184626:0:26173:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:2.0:1784189037.184628:0:26173:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:2.0:1784189037.184651:0:26173:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.112@tcp lock: ffff9dc042d66600/0xcc1762b626f8a639 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xcc1762b626f8a647 expref: -99 pid: 85077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189037.184658:0:26173:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1784189037.184673:0:26173:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.112@tcp lock: ffff9dc042d66600/0xcc1762b626f8a639 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xcc1762b626f8a647 expref: -99 pid: 85077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189037.184680:0:26173:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.112@tcp lock: ffff9dc042d66600/0xcc1762b626f8a639 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xcc1762b626f8a647 expref: -99 pid: 85077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189037.184691:0:26173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784189037.184693:0:26173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784189037.184695:0:26173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784189037.184706:0:86401:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff9dc042d66400/0xcc1762b626f8a567 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc1762b626f8a56e expref: -99 pid: 85077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189037.184715:0:86401:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff9dc042d66400/0xcc1762b626f8a567 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xcc1762b626f8a56e expref: -99 pid: 85077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189037.184728:0:86401:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff9dc042d66400/0xcc1762b626f8a567 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xcc1762b626f8a56e expref: -99 pid: 85077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189037.184735:0:86401:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.112@tcp lock: ffff9dc042d66400/0xcc1762b626f8a567 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xcc1762b626f8a56e expref: -99 pid: 85077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189037.184745:0:86401:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1784189037.184749:0:86401:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 10000000:01000000:2.0:1784189037.184752:0:86401:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00000020:01000004:2.0:1784189037.184789:0:86401:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-MDT0000 00000020:01000000:2.0:1784189037.184794:0:86401:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='FA') 00000020:00000080:2.0:1784189037.184798:0:86401:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:02000400:2.0:1784189037.184803:0:86401:0:(obd_config.c:932:class_cleanup()) Failing over lustre-MDT0000 00010000:00010000:0.0:1784189037.185509:0:7454:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784189037.185515:0:7454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.112@tcp lock: ffff9dc042d66400/0xcc1762b626f8a567 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xcc1762b626f8a56e expref: -99 pid: 85077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189037.185523:0:7454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc042d66400 already unused, calling callback (ffffffffc114ac20) 10000000:00010000:0.0:1784189037.185526:0:7454:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.112@tcp lock: ffff9dc042d66400/0xcc1762b626f8a567 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xcc1762b626f8a56e expref: -99 pid: 85077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189037.185534:0:7454:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.112@tcp lock: ffff9dc042d66400/0xcc1762b626f8a567 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xcc1762b626f8a56e expref: -99 pid: 85077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1784189037.185542:0:7454:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.112@tcp lock: ffff9dc042d66400/0xcc1762b626f8a567 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xcc1762b626f8a56e expref: -99 pid: 85077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784189037.185548:0:7454:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:0.0:1784189037.185550:0:7454:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:0.0:1784189037.185552:0:7454:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:0.0:1784189037.185573:0:7454:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.112@tcp lock: ffff9dc042d66400/0xcc1762b626f8a567 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xcc1762b626f8a56e expref: -99 pid: 85077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189037.185580:0:7454:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1784189037.185589:0:7454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.112@tcp lock: ffff9dc042d66400/0xcc1762b626f8a567 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xcc1762b626f8a56e expref: -99 pid: 85077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189037.185595:0:7454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.112@tcp lock: ffff9dc042d66400/0xcc1762b626f8a567 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xcc1762b626f8a56e expref: -99 pid: 85077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189037.185618:0:7454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784189037.185620:0:7454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784189037.185622:0:7454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784189037.185629:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784189037.185643:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc075663b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:bd553d0d-03e2-4233-b06b-b55bbfa2b954:3641:1870854458047616:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1784189037.185689:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784189037.185719:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1784189037.185725:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc06bbf3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:bd553d0d-03e2-4233-b06b-b55bbfa2b954:3641:1870854458047488:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1784189037.185746:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784189037.190492:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf4262ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bd553d0d-03e2-4233-b06b-b55bbfa2b954+21:3643:x1870854458047360:12345-0@lo:103:ldlm_bl.0 Request processed in 6565us (9882us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189037.190508:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 685 00000100:00100000:1.0:1784189037.190545:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458047616 00000100:00100000:1.0:1784189037.190552:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458047616 00000100:00100000:1.0:1784189037.190597:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458047488 00000100:00100000:1.0:1784189037.190601:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458047488 00000100:00100000:1.0:1784189037.190619:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 687 00000100:00100000:1.0:1784189037.190627:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc075660e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bd553d0d-03e2-4233-b06b-b55bbfa2b954+22:3641:x1870854458047616:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1784189037.190641:0:6500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784189037.190662:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dc05ec0d600/0xcc1762b626f8a56e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xcc1762b626f8a567 expref: 22 pid: 85083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189037.190677:0:6500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784189037.190743:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc075660e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bd553d0d-03e2-4233-b06b-b55bbfa2b954+21:3641:x1870854458047616:12345-0@lo:103:ldlm_bl.0 Request processed in 117us (5053us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189037.190750:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 687 00000100:00100000:1.0:1784189037.190762:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 688 00000100:00100000:1.0:1784189037.190768:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc075663800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bd553d0d-03e2-4233-b06b-b55bbfa2b954+20:3641:x1870854458047488:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1784189037.190775:0:6500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784189037.190785:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dc05ec0c400/0xcc1762b626f8a647 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xcc1762b626f8a639 expref: 20 pid: 85083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189037.190794:0:6500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784189037.190815:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc075663800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bd553d0d-03e2-4233-b06b-b55bbfa2b954+19:3641:x1870854458047488:12345-0@lo:103:ldlm_bl.0 Request processed in 47us (5068us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189037.190821:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 688 00000100:00100000:1.0:1784189037.190880:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc06bbf3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:bd553d0d-03e2-4233-b06b-b55bbfa2b954:3641:1870854458047488:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1784189037.190890:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc075663b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:bd553d0d-03e2-4233-b06b-b55bbfa2b954:3641:1870854458047616:0@lo:103:ldlm_bl.0 00000004:00000080:2.0:1784189037.191565:0:86401:0:(mdt_handler.c:8168:mdt_iocontrol()) lustre-MDT0000: cmd=40086672 len=0 karg=0000000000000000 uarg=0000000000000000 00000001:00080000:2.0:1784189037.191943:0:85078:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 98784247817 is committed 00000020:00000080:2.0:1784189037.191989:0:86401:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 5/11 00000020:00080000:2.0:1784189037.191997:0:86401:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff9dc07118e800 lustre-MDT0000-lwp-MDT0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1784189037.192003:0:86401:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff9dc04ba05800 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1784189037.192007:0:86401:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff9dc07110f800 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1784189037.192012:0:86401:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff9dc06b3ef800 lustre-MDT0001-mdtlov_UUID 0@lo 5 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1784189037.192019:0:86401:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff9dc06b3ea000 b90fcc1c-0e69-42a4-a116-a71fec7aeb78 192.168.203.12@tcp 10 (0 0 3) 0 0 0 2: ffff9dc046939000 98784247817 stale:0 00000020:00080000:2.0:1784189037.192023:0:86401:0:(genops.c:1574:class_disconnect_exports()) OBD device 13 (ffff9dbf44d799c0) has exports, disconnecting them 00000020:00080000:2.0:1784189037.192028:0:86401:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9dc07118e800), last request at 1784189010 00000020:00000080:2.0:1784189037.192034:0:86401:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xcc1762b626f8a74a 00000100:00080000:2.0:1784189037.192043:0:86401:0:(import.c:65:import_set_state_nolock()) ffff9dc075653800 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1784189037.192060:0:86401:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9dc07118e800): rc 0 00000020:00000080:2.0:1784189037.192069:0:86401:0:(genops.c:906:class_export_put()) final put ffff9dc07118e800/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00080000:2.0:1784189037.192080:0:86401:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9dc04ba05800), last request at 1784189036 00000020:00000080:2.0:1784189037.192083:0:86401:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xcc1762b626f8a743 00000100:00080000:2.0:1784189037.192088:0:86401:0:(import.c:65:import_set_state_nolock()) ffff9dc07118c000 : changing import state from FULL to CLOSED 00010000:00010000:2.0:1784189037.192104:0:26173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:2.0:1784189037.192112:0:86401:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9dc04ba05800): rc 0 00000020:00000080:2.0:1784189037.192114:0:86401:0:(genops.c:906:class_export_put()) final put ffff9dc04ba05800/lustre-MDT0000-lwp-OST0001_UUID 00000020:00080000:2.0:1784189037.192118:0:86401:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9dc07110f800), last request at 1784189036 00000020:00000080:2.0:1784189037.192121:0:86401:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xcc1762b626f8a73c 00000100:00080000:2.0:1784189037.192126:0:86401:0:(import.c:65:import_set_state_nolock()) ffff9dc04ba07800 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1784189037.192142:0:86401:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9dc07110f800): rc 0 00000020:00000080:2.0:1784189037.192144:0:86401:0:(genops.c:906:class_export_put()) final put ffff9dc07110f800/lustre-MDT0000-lwp-OST0000_UUID 00000020:00080000:2.0:1784189037.192148:0:86401:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9dc06b3ef800), last request at 1784189004 00000020:00000080:2.0:1784189037.192153:0:86401:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xcc1762b626f8a5c2 00000100:00080000:2.0:1784189037.192173:0:86401:0:(import.c:65:import_set_state_nolock()) ffff9dbf436c2000 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1784189037.192206:0:86401:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9dc06b3ef800): rc 0 00000020:00000080:2.0:1784189037.192208:0:86401:0:(genops.c:906:class_export_put()) final put ffff9dc06b3ef800/lustre-MDT0001-mdtlov_UUID 00000020:00080000:2.0:1784189037.192212:0:86401:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 192.168.203.12@tcp (ffff9dc06b3ea000), last request at 1784189036 00000020:00000080:2.0:1784189037.192215:0:86401:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xcc1762b626f8a5bb 00000020:00010000:2.0:1784189037.192219:0:86401:0:(genops.c:1942:obd_stale_export_put()) Put export ffff9dc06b3ea000: total 4 00000100:00080000:2.0:1784189037.192222:0:86401:0:(import.c:65:import_set_state_nolock()) ffff9dc05ed27000 : changing import state from FULL to CLOSED 00000020:00010000:2.0:1784189037.192231:0:26173:0:(genops.c:1928:obd_stale_export_get()) Get export ffff9dc06b3ea000: total 4 00010000:00010000:2.0:1784189037.192233:0:26173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784189037.192258:0:26173:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff9dc06b3ea000, canceled 0 locks, left on hash table 3. 00010000:00010000:2.0:1784189037.192289:0:26173:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc070146e00/0xcc1762b626f8aaa7 lrc: 0/0,0 mode: --/PW res: [0x20000a811:0x5:0x0].0x0 bits 0x59/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c3d30 expref: 9 pid: 66171 timeout: 3377 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189037.192308:0:26173:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc081b16800/0xcc1762b626f8aa8b lrc: 0/0,0 mode: --/PR res: [0x20000a811:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c3d29 expref: 8 pid: 66945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189037.192376:0:26173:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04a20ae00/0xcc1762b626f8aa6f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c3d22 expref: 7 pid: 68287 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189037.192390:0:26173:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff9dc06b3ea000, canceled 3 locks, left on hash table 0. 00010000:00010000:1.0:1784189037.195255:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784189037.195386:0:7454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784189037.195397:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784189037.195549:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc075661f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:bd553d0d-03e2-4233-b06b-b55bbfa2b954:3643:1870854458047360:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1784189037.195601:0:3627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc070147400/0xcc1762b626f8aaa0 lrc: 3/0,1 mode: TXN/TXN res: [0x20000a811:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189037.195612:0:3627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc070147400/0xcc1762b626f8aaa0 lrc: 2/0,0 mode: TXN/TXN res: [0x20000a811:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189037.195619:0:3627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dc070147400/0xcc1762b626f8aaa0 lrc: 3/0,0 mode: TXN/TXN res: [0x20000a811:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189037.195625:0:3627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc070147400 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:3.0:1784189037.195630:0:3627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc070147400/0xcc1762b626f8aaa0 lrc: 3/0,0 mode: TXN/TXN res: [0x20000a811:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189037.195659:0:3627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc070147400/0xcc1762b626f8aaa0 lrc: 4/0,0 mode: TXN/TXN res: [0x20000a811:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189037.195677:0:3627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x3:0x0].0xfa0fa5c1 (ffff9dc074ae2200) 00010000:00010000:3.0:1784189037.195680:0:3627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784189037.195685:0:3627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dc070147400/0xcc1762b626f8aaa0 lrc: 2/0,0 mode: --/TXN res: [0x20000a811:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189037.195690:0:3627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc070147400/0xcc1762b626f8aaa0 lrc: 0/0,0 mode: --/TXN res: [0x20000a811:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189037.195713:0:3627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc070147600/0xcc1762b626f8aab5 lrc: 3/0,1 mode: TXN/TXN res: [0x20000a811:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189037.195719:0:3627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc070147600/0xcc1762b626f8aab5 lrc: 2/0,0 mode: TXN/TXN res: [0x20000a811:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189037.195724:0:3627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dc070147600/0xcc1762b626f8aab5 lrc: 3/0,0 mode: TXN/TXN res: [0x20000a811:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189037.195729:0:3627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc070147600 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:3.0:1784189037.195732:0:3627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc070147600/0xcc1762b626f8aab5 lrc: 3/0,0 mode: TXN/TXN res: [0x20000a811:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189037.195738:0:3627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc070147600/0xcc1762b626f8aab5 lrc: 4/0,0 mode: TXN/TXN res: [0x20000a811:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189037.195745:0:3627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x5:0x0].0x0 (ffff9dc074ae2000) 00010000:00010000:3.0:1784189037.195747:0:3627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784189037.195750:0:3627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dc070147600/0xcc1762b626f8aab5 lrc: 2/0,0 mode: --/TXN res: [0x20000a811:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189037.195763:0:3627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc070147600/0xcc1762b626f8aab5 lrc: 0/0,0 mode: --/TXN res: [0x20000a811:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00000080:3.0:1784189037.195789:0:27065:0:(genops.c:865:class_export_destroy()) destroying export ffff9dc07118e800/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000 00000020:00000080:3.0:1784189037.199274:0:27065:0:(genops.c:865:class_export_destroy()) destroying export ffff9dc04ba05800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000020:00000080:3.0:1784189037.199434:0:27065:0:(genops.c:865:class_export_destroy()) destroying export ffff9dc07110f800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00000080:3.0:1784189037.199466:0:27065:0:(genops.c:865:class_export_destroy()) destroying export ffff9dc06b3ef800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000 00000020:00000080:3.0:1784189037.199490:0:27065:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9dc075653800 for lustre-MDT0000 00000020:00000080:3.0:1784189037.199495:0:27065:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9dc07118c000 for lustre-MDT0000 00000020:00000080:3.0:1784189037.199499:0:27065:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9dc04ba07800 for lustre-MDT0000 00000020:00000080:3.0:1784189037.199502:0:27065:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9dbf436c2000 for lustre-MDT0000 00000020:00080000:3.0:1784189037.200501:0:86401:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 192.168.203.12@tcp (ffff9dc06b3ea000): rc 0 00000004:00000080:3.0:1784189037.200511:0:86401:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffae0981503ae0 00000100:00080000:3.0:1784189037.200536:0:86401:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1784189037.200540:0:86401:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:3.0:1784189037.202517:0:86401:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000100:00080000:3.0:1784189037.202552:0:86401:0:(import.c:65:import_set_state_nolock()) ffff9dc06b8e5000 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:1.0:1784189037.202618:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf4262ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3639:1870854458047744:0@lo:39:umount.0 00000100:00100000:1.0:1784189037.202687:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784189037.202764:0:23826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458047744 00000100:00100000:0.0:1784189037.202772:0:23826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458047744 00000100:00100000:0.0:1784189037.202826:0:23826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3724 00000100:00100000:0.0:1784189037.202835:0:23826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc05f02ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3639:x1870854458047744:12345-0@lo:39:umount.0 00000020:00000080:0.0:1784189037.202861:0:23826:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xcc1762b626f8a5f3 00000100:00080000:0.0:1784189037.202868:0:23826:0:(import.c:65:import_set_state_nolock()) ffff9dc0477b4000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1784189037.202888:0:23826:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 19, last_transno is 81604378731 00010000:00010000:3.0:1784189037.209554:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1784189037.209634:0:86401:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1784189037.209638:0:86401:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294968948 gen 3 00000004:00080000:3.0:1784189037.209658:0:86401:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:3.0:1784189037.209716:0:86401:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:3.0:1784189037.209742:0:86401:0:(import.c:65:import_set_state_nolock()) ffff9dc07b5d1800 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:3.0:1784189037.209755:0:86401:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1784189037.209758:0:86401:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294968952 gen 3 00000004:00080000:3.0:1784189037.209767:0:86401:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:3.0:1784189037.209832:0:86401:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:3.0:1784189037.209854:0:86401:0:(import.c:65:import_set_state_nolock()) ffff9dc045ad7000 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:3.0:1784189037.209947:0:86401:0:(genops.c:1579:class_disconnect_exports()) OBD device 13 (ffff9dbf44d799c0) has no exports 00000100:00100000:0.0:1784189037.210246:0:23826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc05f02ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+3:3639:x1870854458047744:12345-0@lo:39:umount.0 Request processed in 7406us (7553us total) trans 81604378732 rc 0/0 00000100:00100000:0.0:1784189037.210259:0:23826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3724 00000020:00080000:3.0:1784189037.210439:0:86401:0:(genops.c:1579:class_disconnect_exports()) OBD device 13 (ffff9dbf44d799c0) has no exports 00000100:00080000:1.0:1784189037.213273:0:3639:0:(import.c:65:import_set_state_nolock()) ffff9dc06b8e5000 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:1.0:1784189037.213287:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf4262ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3639:1870854458047744:0@lo:39:umount.0 00000100:00100000:1.0:1784189037.213339:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf4262ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3639:1870854458047872:0@lo:9:umount.0 00000100:00100000:1.0:1784189037.213404:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784189037.213446:0:26160:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458047872 00000100:00100000:1.0:1784189037.213452:0:26160:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458047872 00000100:00100000:1.0:1784189037.213491:0:26160:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4927 00000100:00100000:1.0:1784189037.213499:0:26160:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc05f02c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+5:3639:x1870854458047872:12345-0@lo:9:umount.0 00000020:00000080:1.0:1784189037.213537:0:26160:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xcc1762b626f8a60f 00000100:00080000:1.0:1784189037.213545:0:26160:0:(import.c:65:import_set_state_nolock()) ffff9dc071188800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1784189037.213588:0:26160:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294968948 00000100:00100000:1.0:1784189037.213725:0:26160:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc05f02c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+2:3639:x1870854458047872:12345-0@lo:9:umount.0 Request processed in 226us (320us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189037.213733:0:26160:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4927 00010000:00010000:1.0:1784189037.213754:0:7454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1784189037.213770:0:3639:0:(import.c:65:import_set_state_nolock()) ffff9dc07b5d1800 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:1.0:1784189037.213778:0:3639:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:1.0:1784189037.213780:0:3639:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1784189037.213782:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf4262ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3639:1870854458047872:0@lo:9:umount.0 00000100:00100000:1.0:1784189037.213793:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf4262d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3639:1870854458048000:0@lo:9:umount.0 00000100:00100000:1.0:1784189037.213897:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784189037.213920:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458048000 00000100:00100000:1.0:1784189037.213924:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458048000 00000100:00100000:1.0:1784189037.213947:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4928 00000100:00100000:1.0:1784189037.214297:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc05f02f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3639:x1870854458048000:12345-0@lo:9:umount.0 00000020:00000080:1.0:1784189037.214314:0:8429:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xcc1762b626f8a640 00000100:00080000:1.0:1784189037.214331:0:8429:0:(import.c:65:import_set_state_nolock()) ffff9dc07118e000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1784189037.214359:0:8429:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294968952 00000100:00100000:1.0:1784189037.214451:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc05f02f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+2:3639:x1870854458048000:12345-0@lo:9:umount.0 Request processed in 157us (553us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189037.214457:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4928 00010000:00010000:1.0:1784189037.214473:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1784189037.214488:0:3639:0:(import.c:65:import_set_state_nolock()) ffff9dc045ad7000 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:1.0:1784189037.214497:0:3639:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:1.0:1784189037.214499:0:3639:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1784189037.214502:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf4262d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3639:1870854458048000:0@lo:9:umount.0 00000020:00000080:2.0:1784189037.214578:0:26173:0:(genops.c:906:class_export_put()) final put ffff9dc06b3ea000/b90fcc1c-0e69-42a4-a116-a71fec7aeb78 00010000:00010000:2.0:1784189037.214733:0:26173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784189037.214735:0:26173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784189037.214737:0:26173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1784189037.214927:0:63468:0:(genops.c:865:class_export_destroy()) destroying export ffff9dc06b3ea000/b90fcc1c-0e69-42a4-a116-a71fec7aeb78 for lustre-MDT0000 00000020:00000080:0.0:1784189037.215169:0:63468:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9dc05ed27000 for lustre-MDT0000 00000020:00000080:3.0:1784189037.249812:0:86401:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xcc1762b626f8a5d7 00000020:00000080:3.0:1784189037.249828:0:86401:0:(genops.c:906:class_export_put()) final put ffff9dbf43d88000/lustre-QMT0000_UUID 00000020:01000000:3.0:1784189037.249902:0:86401:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:0.0:1784189037.250215:0:63468:0:(genops.c:865:class_export_destroy()) destroying export ffff9dbf43d88000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:0.0:1784189037.250244:0:86401:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1784189037.250257:0:86401:0:(obd_config.c:955:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1784189037.250274:0:86401:0:(genops.c:1579:class_disconnect_exports()) OBD device 15 (ffff9dc075478000) has no exports 00000020:00000080:2.0:1784189037.250855:0:86401:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xcc1762b626f8a5d0 00000020:00000080:2.0:1784189037.250863:0:86401:0:(genops.c:906:class_export_put()) final put ffff9dc0477b6000/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1784189037.250912:0:86401:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1784189037.250921:0:86401:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:2.0:1784189037.250923:0:86401:0:(genops.c:906:class_export_put()) final put ffff9dc0477b1000/lustre-QMT0000_UUID 00000020:00000080:2.0:1784189037.250925:0:86401:0:(genops.c:865:class_export_destroy()) destroying export ffff9dc0477b1000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:2.0:1784189037.250932:0:86401:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00000020:00000080:0.0:1784189037.251105:0:63468:0:(genops.c:865:class_export_destroy()) destroying export ffff9dc0477b6000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:2.0:1784189037.251151:0:86401:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9dbf464d45a0 - data ffff9dc06bf8d438/ffff9dc06b883000 00000020:01000000:2.0:1784189037.251292:0:86401:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9dc081c340c0 - data ffff9dc06bff9288/ffff9dbf43601400 00010000:00010000:0.0:1784189037.296289:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1784189037.296718:0:86401:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1784189037.296724:0:86401:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:1.0:1784189037.296739:0:86401:0:(client.c:3150:ptlrpc_free_committed()) @@@ free request with old gen req@ffff9dbf4262ea00 x1870854458047744/t81604378732(81604378732) o39->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1784189047 ref 1 fl Complete:RNQU/204/0 rc 0/0 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784189037.296766:0:86401:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:1.0:1784189037.298521:0:86401:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1784189037.298528:0:86401:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294968948 gen 4 00000004:00080000:1.0:1784189037.298553:0:86401:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1784189037.298555:0:86401:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:2.0:1784189037.298899:0:85095:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:2.0:1784189037.298904:0:85095:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x5c:0x0] index 1 count 1 00000040:00080000:2.0:1784189037.298916:0:85095:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 23 count 2 00000100:00080000:1.0:1784189037.299570:0:86401:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1784189037.299574:0:86401:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294968952 gen 4 00000004:00080000:1.0:1784189037.299592:0:86401:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1784189037.299594:0:86401:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1784189037.299948:0:85097:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1784189037.299953:0:85097:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x5e:0x0] index 1 count 1 00000040:00080000:0.0:1784189037.299962:0:85097:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 23 count 2 00000020:00000080:2.0:1784189037.300994:0:86401:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xcc1762b626f8a591 00000020:00000080:2.0:1784189037.301005:0:86401:0:(genops.c:906:class_export_put()) final put ffff9dc071188000/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1784189037.301643:0:63468:0:(genops.c:865:class_export_destroy()) destroying export ffff9dc071188000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1784189037.306839:0:86401:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xcc1762b626f8a5a6 00000020:00000080:1.0:1784189037.306852:0:86401:0:(genops.c:906:class_export_put()) final put ffff9dc05106d000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:1.0:1784189037.306872:0:86401:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:1.0:1784189037.306878:0:86401:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1784189037.306888:0:86401:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1784189037.306892:0:86401:0:(genops.c:1579:class_disconnect_exports()) OBD device 12 (ffff9dbf44d7b380) has no exports 00000020:00000080:0.0:1784189037.307220:0:63468:0:(genops.c:865:class_export_destroy()) destroying export ffff9dc05106d000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000004:01000000:1.0:1784189037.307900:0:86401:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:1.0:1784189037.307911:0:86401:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xcc1762b626f8a624 00000020:00000080:1.0:1784189037.307917:0:86401:0:(genops.c:906:class_export_put()) final put ffff9dc06b8e4000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:1.0:1784189037.307933:0:86401:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:1.0:1784189037.307939:0:86401:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1784189037.307949:0:86401:0:(obd_config.c:955:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1784189037.307953:0:86401:0:(genops.c:1579:class_disconnect_exports()) OBD device 27 (ffff9dbf449f4d40) has no exports 00000020:00000080:1.0:1784189037.307961:0:86401:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xcc1762b626f8a61d 00000020:00000080:1.0:1784189037.307965:0:86401:0:(genops.c:906:class_export_put()) final put ffff9dc045ad4000/lustre-MDT0000-osd_UUID 00010000:01000000:1.0:1784189037.308453:0:86401:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:1.0:1784189037.308457:0:86401:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1784189037.308461:0:86401:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294968952 gen 5 00000004:00080000:1.0:1784189037.308477:0:86401:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1784189037.308479:0:86401:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1784189037.308513:0:86401:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1784189037.308527:0:86401:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1784189037.308533:0:86401:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xcc1762b626f8a608 00000020:00000080:1.0:1784189037.308537:0:86401:0:(genops.c:906:class_export_put()) final put ffff9dbf42275000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:1.0:1784189037.308548:0:86401:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:1.0:1784189037.308551:0:86401:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1784189037.308554:0:86401:0:(obd_config.c:955:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1784189037.308556:0:86401:0:(genops.c:1579:class_disconnect_exports()) OBD device 22 (ffff9dbf449f3380) has no exports 00000020:00000080:1.0:1784189037.308561:0:86401:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xcc1762b626f8a601 00000020:00000080:1.0:1784189037.308564:0:86401:0:(genops.c:906:class_export_put()) final put ffff9dbf44677800/lustre-MDT0000-osd_UUID 00010000:01000000:1.0:1784189037.309133:0:86401:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:1.0:1784189037.309137:0:86401:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000020:00000080:0.0:1784189037.309253:0:63468:0:(genops.c:865:class_export_destroy()) destroying export ffff9dc06b8e4000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:00000080:0.0:1784189037.309263:0:63468:0:(genops.c:865:class_export_destroy()) destroying export ffff9dc045ad4000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1784189037.309270:0:63468:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9dc045ad7000 for lustre-OST0001-osc-MDT0000 00000020:00000080:0.0:1784189037.309276:0:63468:0:(genops.c:906:class_export_put()) final put ffff9dbf42276800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1784189037.309278:0:63468:0:(genops.c:865:class_export_destroy()) destroying export ffff9dbf42276800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:0.0:1784189037.309283:0:63468:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000100:00100000:1.0:1784189037.309447:0:86401:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294968948 gen 5 00000004:00080000:1.0:1784189037.309452:0:86401:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1784189037.309453:0:86401:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1784189037.309605:0:86401:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1784189037.309614:0:86401:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000004:01000000:1.0:1784189037.309625:0:86401:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:1.0:1784189037.309630:0:86401:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xcc1762b626f8a5ec 00000020:00000080:1.0:1784189037.309636:0:86401:0:(genops.c:906:class_export_put()) final put ffff9dc051068000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:1.0:1784189037.309736:0:86401:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osp-MDT0000 (flags='') 00000020:00000080:1.0:1784189037.309740:0:86401:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1784189037.309746:0:86401:0:(obd_config.c:955:class_cleanup()) lustre-MDT0001-osp-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1784189037.309749:0:86401:0:(genops.c:1579:class_disconnect_exports()) OBD device 21 (ffff9dc06bb34d40) has no exports 00000020:00000080:1.0:1784189037.309753:0:86401:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xcc1762b626f8a5e5 00000020:00000080:1.0:1784189037.309756:0:86401:0:(genops.c:906:class_export_put()) final put ffff9dc06b8e3000/lustre-MDT0000-osd_UUID 00010000:01000000:2.0:1784189037.315785:0:86401:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0001-osp-MDT0000: client import never connected 00000100:00080000:2.0:1784189037.315793:0:86401:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1784189037.315797:0:86401:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:2.0:1784189037.315805:0:86401:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1784189037.315863:0:86401:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1784189037.315878:0:86401:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1784189037.315928:0:86401:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1784189037.315934:0:86401:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1784189037.315939:0:86401:0:(genops.c:906:class_export_put()) final put ffff9dc075652800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1784189037.315944:0:86401:0:(genops.c:865:class_export_destroy()) destroying export ffff9dc075652800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:2.0:1784189037.315955:0:86401:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1784189037.316055:0:86401:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xcc1762b626f8a5ad 00000020:00000080:2.0:1784189037.316062:0:86401:0:(genops.c:906:class_export_put()) final put ffff9dc05106f000/lustre-MDD0000_UUID 00000020:01000000:2.0:1784189037.316071:0:86401:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:2.0:1784189037.316080:0:86401:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1784189037.316085:0:86401:0:(obd_config.c:955:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1784189037.316089:0:86401:0:(genops.c:1579:class_disconnect_exports()) OBD device 14 (ffff9dbf44d78000) has no exports 00000020:00000080:2.0:1784189037.316108:0:86401:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1784189037.316111:0:86401:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:2.0:1784189037.316115:0:86401:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xcc1762b626f8a5b4 00000020:00000080:2.0:1784189037.316119:0:86401:0:(genops.c:906:class_export_put()) final put ffff9dc05106c800/lustre-MDT0000-osd_UUID 00000020:01000004:2.0:1784189037.316133:0:86401:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9dc047a82000 from lustre-MDT0000, refs=3 00000020:01000004:2.0:1784189037.316137:0:86401:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9dc047a82000 3 00000020:01000004:2.0:1784189037.316140:0:86401:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9dc047a82000 from lustre-MDT0000 00000020:00000080:2.0:1784189037.316165:0:86401:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1784189037.316170:0:86401:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:2.0:1784189037.316173:0:86401:0:(genops.c:906:class_export_put()) final put ffff9dc07118d800/lustre-MDT0000_UUID 00000020:00000080:2.0:1784189037.316175:0:86401:0:(genops.c:865:class_export_destroy()) destroying export ffff9dc07118d800/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:2.0:1784189037.316183:0:86401:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:2.0:1784189037.316211:0:86401:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 3 references. 00000020:01000004:2.0:1784189037.316215:0:86401:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:2.0:1784189037.316218:0:86401:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:2.0:1784189037.316220:0:86401:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1784189037.316223:0:86401:0:(obd_config.c:955:class_cleanup()) MGS: forcing exports to disconnect: 2/5 00000020:00080000:2.0:1784189037.316229:0:86401:0:(genops.c:1840:print_export_data()) MGS: ACTIVE ffff9dc06b3e9800 bd553d0d-03e2-4233-b06b-b55bbfa2b954 0@lo 18 (0 0 13) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1784189037.316237:0:86401:0:(genops.c:1840:print_export_data()) MGS: ACTIVE ffff9dc0477d2000 9957a2dc-fd88-4a91-bca3-e2b7f365ab0c 192.168.203.12@tcp 9 (0 0 4) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1784189037.316242:0:86401:0:(genops.c:1574:class_disconnect_exports()) OBD device 3 (ffff9dc0762999c0) has exports, disconnecting them 00000020:00080000:2.0:1784189037.316252:0:86401:0:(genops.c:1549:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff9dc06b3e9800), last request at 1784189004 00000020:00000080:2.0:1784189037.316271:0:86401:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xcc1762b626f8a559 00000020:00010000:2.0:1784189037.316276:0:86401:0:(genops.c:1942:obd_stale_export_put()) Put export ffff9dc06b3e9800: total 6 00000100:00080000:2.0:1784189037.316279:0:86401:0:(import.c:65:import_set_state_nolock()) ffff9dc06b3eb800 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1784189037.316291:0:86401:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9dc06b3e9800): rc 0 00000020:00080000:2.0:1784189037.316294:0:86401:0:(genops.c:1549:class_disconnect_export_list()) MGS: disconnecting export at 192.168.203.12@tcp (ffff9dc0477d2000), last request at 1784188998 00000020:00000080:2.0:1784189037.316349:0:86401:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xcc1762b626f8a536 00000020:00010000:2.0:1784189037.316352:0:86401:0:(genops.c:1942:obd_stale_export_put()) Put export ffff9dc0477d2000: total 6 00000100:00080000:2.0:1784189037.316355:0:86401:0:(import.c:65:import_set_state_nolock()) ffff9dc0477d4000 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1784189037.316364:0:86401:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 192.168.203.12@tcp (ffff9dc0477d2000): rc 0 00000020:00080000:2.0:1784189037.316368:0:86401:0:(genops.c:1579:class_disconnect_exports()) OBD device 3 (ffff9dc0762999c0) has no exports 00000020:00000080:0.0:1784189037.317280:0:63468:0:(genops.c:865:class_export_destroy()) destroying export ffff9dbf42275000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000100:00100000:0.0:1784189037.317342:0:85083:0:(service.c:3183:ptlrpc_main()) ll_mgs_0000: service thread [ffff9dc07609ca00:85083] 0 exiting: rc = 1 00000100:00100000:3.0:1784189037.317497:0:85084:0:(service.c:3183:ptlrpc_main()) ll_mgs_0001: service thread [ffff9dc0761c3200:85084] 1 exiting: rc = 0 00000100:00100000:0.0:1784189037.317513:0:85085:0:(service.c:3183:ptlrpc_main()) ll_mgs_0002: service thread [ffff9dc0761c2200:85085] 2 exiting: rc = 0 00000020:00000080:0.0:1784189037.317757:0:63468:0:(genops.c:865:class_export_destroy()) destroying export ffff9dbf44677800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1784189037.317765:0:63468:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9dc07b5d1800 for lustre-OST0000-osc-MDT0000 00000020:00000080:0.0:1784189037.317771:0:63468:0:(genops.c:906:class_export_put()) final put ffff9dc06b8e5800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1784189037.317773:0:63468:0:(genops.c:865:class_export_destroy()) destroying export ffff9dc06b8e5800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:0.0:1784189037.317777:0:63468:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1784189037.317837:0:63468:0:(genops.c:865:class_export_destroy()) destroying export ffff9dc051068000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:00000080:0.0:1784189037.317842:0:63468:0:(genops.c:865:class_export_destroy()) destroying export ffff9dc06b8e3000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1784189037.317846:0:63468:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9dc06b8e5000 for lustre-MDT0001-osp-MDT0000 00000020:00000080:0.0:1784189037.317851:0:63468:0:(genops.c:906:class_export_put()) final put ffff9dc06b8e0000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1784189037.317853:0:63468:0:(genops.c:865:class_export_destroy()) destroying export ffff9dc06b8e0000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:01000000:0.0:1784189037.317864:0:63468:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osp-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1784189037.317892:0:63468:0:(genops.c:865:class_export_destroy()) destroying export ffff9dc05106f000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:0.0:1784189037.317896:0:63468:0:(genops.c:906:class_export_put()) final put ffff9dc07118b800/lustre-MDD0000_UUID 00000020:00000080:0.0:1784189037.317898:0:63468:0:(genops.c:865:class_export_destroy()) destroying export ffff9dc07118b800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:0.0:1784189037.317901:0:63468:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:00000080:0.0:1784189037.317925:0:63468:0:(genops.c:865:class_export_destroy()) destroying export ffff9dc05106c800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000100:00100000:2.0:1784189037.318179:0:86401:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784189037.318188:0:86401:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784189037.318200:0:86401:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784189037.318206:0:86401:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784189037.318211:0:86401:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784189037.318218:0:86401:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784189037.318223:0:86401:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784189037.318229:0:86401:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784189037.318235:0:86401:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784189037.318240:0:86401:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784189037.318245:0:86401:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784189037.318251:0:86401:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784189037.318258:0:86401:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784189037.318263:0:86401:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784189037.318268:0:86401:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784189037.318273:0:86401:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784189037.318279:0:86401:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784189037.318284:0:86401:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784189037.318290:0:86401:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784189037.318295:0:86401:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00010000:0.0:1784189037.320185:0:7454:0:(genops.c:1928:obd_stale_export_get()) Get export ffff9dc06b3e9800: total 0 00010000:00010000:0.0:1784189037.320283:0:7454:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff9dc06b3e9800, canceled 0 locks, left on hash table 13. 00010000:00010000:0.0:1784189037.320333:0:7454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dc0755a4800/0xcc1762b626f8a735 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xcc1762b626f8a72e expref: 14 pid: 85083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189037.320354:0:7454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dc070147000/0xcc1762b626f8a6c5 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xcc1762b626f8a6be expref: 13 pid: 85084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189037.320365:0:7454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dc0755a4c00/0xcc1762b626f8a6d3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xcc1762b626f8a6cc expref: 12 pid: 85083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189037.320390:0:7454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dc0755a4400/0xcc1762b626f8a6ef lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xcc1762b626f8a6e8 expref: 11 pid: 85083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189037.320400:0:7454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dc0755a5e00/0xcc1762b626f8a6e1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xcc1762b626f8a6da expref: 10 pid: 85085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189037.320411:0:7454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dc0755a5800/0xcc1762b626f8a6fd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xcc1762b626f8a6f6 expref: 9 pid: 85083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189037.320420:0:7454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dc0755a4600/0xcc1762b626f8a68d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xcc1762b626f8a686 expref: 8 pid: 85084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189037.320431:0:7454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dc042d66c00/0xcc1762b626f8a70b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xcc1762b626f8a704 expref: 7 pid: 85084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189037.320460:0:7454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dc05ec0d800/0xcc1762b626f8a69b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xcc1762b626f8a694 expref: 6 pid: 85084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189037.320471:0:7454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dc05ec0cc00/0xcc1762b626f8a719 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xcc1762b626f8a712 expref: 5 pid: 85085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189037.320480:0:7454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dc070146400/0xcc1762b626f8a6a9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xcc1762b626f8a6a2 expref: 4 pid: 85085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189037.320508:0:7454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dc05ec0de00/0xcc1762b626f8a727 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xcc1762b626f8a720 expref: 3 pid: 85085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189037.320526:0:7454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dc042d66a00/0xcc1762b626f8a6b7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xcc1762b626f8a6b0 expref: 2 pid: 85083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189037.320538:0:7454:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff9dc06b3e9800, canceled 13 locks, left on hash table 0. 00000020:00000080:0.0:1784189037.320566:0:7454:0:(genops.c:906:class_export_put()) final put ffff9dc06b3e9800/bd553d0d-03e2-4233-b06b-b55bbfa2b954 00000020:00010000:0.0:1784189037.320578:0:7454:0:(genops.c:1928:obd_stale_export_get()) Get export ffff9dc0477d2000: total 1 00010000:00010000:0.0:1784189037.320595:0:7454:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff9dc0477d2000, canceled 0 locks, left on hash table 4. 00010000:00010000:0.0:1784189037.320628:0:7454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dc042d67e00/0xcc1762b626f8a544 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c3cce expref: 5 pid: 85084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189037.320711:0:7454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dc05ec0c200/0xcc1762b626f8a552 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c3cdc expref: 4 pid: 85083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189037.320727:0:7454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dc0755a5000/0xcc1762b626f8a54b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c3cd5 expref: 3 pid: 85085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189037.320740:0:7454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dc070147200/0xcc1762b626f8a671 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c3ce3 expref: 2 pid: 85083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189037.320758:0:7454:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff9dc0477d2000, canceled 4 locks, left on hash table 0. 00000020:00000080:0.0:1784189037.320771:0:7454:0:(genops.c:906:class_export_put()) final put ffff9dc0477d2000/9957a2dc-fd88-4a91-bca3-e2b7f365ab0c 00010000:00010000:0.0:1784189037.320776:0:7454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784189037.320778:0:7454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784189037.320780:0:7454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1784189037.320803:0:63468:0:(genops.c:865:class_export_destroy()) destroying export ffff9dc06b3e9800/bd553d0d-03e2-4233-b06b-b55bbfa2b954 for MGS 00000020:00000080:0.0:1784189037.321009:0:63468:0:(genops.c:865:class_export_destroy()) destroying export ffff9dc0477d2000/9957a2dc-fd88-4a91-bca3-e2b7f365ab0c for MGS 00000020:00000080:0.0:1784189037.321032:0:63468:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9dc06b3eb800 for MGS 00000020:00000080:0.0:1784189037.321037:0:63468:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9dc0477d4000 for MGS 00000100:00100000:2.0:1784189037.322036:0:86401:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784189037.322048:0:86401:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784189037.322067:0:86401:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784189037.322073:0:86401:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784189037.322078:0:86401:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784189037.322084:0:86401:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784189037.322089:0:86401:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784189037.322095:0:86401:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784189037.322099:0:86401:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784189037.322105:0:86401:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784189037.322111:0:86401:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784189037.322116:0:86401:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784189037.322122:0:86401:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784189037.322127:0:86401:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784189037.322133:0:86401:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784189037.322138:0:86401:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784189037.322144:0:86401:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784189037.322149:0:86401:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784189037.322164:0:86401:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784189037.322170:0:86401:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784189037.322176:0:86401:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784189037.322181:0:86401:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784189037.322187:0:86401:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784189037.322192:0:86401:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784189037.322198:0:86401:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784189037.322203:0:86401:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784189037.322209:0:86401:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784189037.322215:0:86401:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784189037.322220:0:86401:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784189037.322226:0:86401:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784189037.322231:0:86401:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784189037.322236:0:86401:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784189037.322242:0:86401:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784189037.322248:0:86401:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784189037.322253:0:86401:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784189037.322259:0:86401:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784189037.322265:0:86401:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784189037.322279:0:86401:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784189037.322283:0:86401:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784189037.322288:0:86401:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784189037.322293:0:86401:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784189037.322299:0:86401:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784189037.322304:0:86401:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784189037.322309:0:86401:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:01000000:2.0:1784189037.323889:0:86401:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9dbf457f8a80 - data ffff9dc060351bd0/ffff9dbf410ed000 00000020:01000000:2.0:1784189037.324003:0:86401:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9dbf45b1d060 - data ffff9dc0704d1d80/ffff9dc075a93400 00000020:00000080:2.0:1784189037.325119:0:86401:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xcc1762b626f8a52f 00000020:00000080:2.0:1784189037.325132:0:86401:0:(genops.c:906:class_export_put()) final put ffff9dbf48459000/lustre-MDT0000-osd_UUID 00000020:01000004:2.0:1784189037.325144:0:86401:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9dc047a82000 from MGS, refs=2 00000020:01000004:2.0:1784189037.325148:0:86401:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9dc047a82000 2 00000020:01000004:2.0:1784189037.325151:0:86401:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9dc047a82000 from MGS 00000020:00000080:2.0:1784189037.325185:0:86401:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1784189037.325189:0:63468:0:(genops.c:865:class_export_destroy()) destroying export ffff9dbf48459000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1784189037.325193:0:86401:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:2.0:1784189037.325198:0:86401:0:(genops.c:906:class_export_put()) final put ffff9dbf4845f000/MGS 00000020:00000080:2.0:1784189037.325200:0:86401:0:(genops.c:865:class_export_destroy()) destroying export ffff9dbf4845f000/MGS for MGS 00000020:01000000:2.0:1784189037.325208:0:86401:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:2.0:1784189037.325294:0:86401:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:2.0:1784189037.325298:0:86401:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1784189037.325307:0:86401:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1784189037.325315:0:86401:0:(genops.c:1840:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff9dc075655800 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1784189037.325344:0:86401:0:(genops.c:1574:class_disconnect_exports()) OBD device 28 (ffff9dc06bb33380) has exports, disconnecting them 00000020:00080000:2.0:1784189037.325349:0:86401:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff9dc075655800), last request at 1784189005 00000020:00000080:2.0:1784189037.325353:0:86401:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xcc1762b626f8a663 00000020:00080000:2.0:1784189037.325363:0:86401:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9dc075655800): rc 0 00000020:00000080:2.0:1784189037.325368:0:86401:0:(genops.c:906:class_export_put()) final put ffff9dc075655800/lustre-MDT0000-lwp-MDT0000 00000020:00000080:0.0:1784189037.325424:0:63468:0:(genops.c:865:class_export_destroy()) destroying export ffff9dc075655800/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:0.0:1784189037.326477:0:86401:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:0.0:1784189037.326483:0:86401:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1784189037.326487:0:86401:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:0.0:1784189037.326494:0:86401:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1784189037.326516:0:63468:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9dbf46b0c000 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:0.0:1784189037.326648:0:86401:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1784189037.326660:0:86401:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:0.0:1784189037.326665:0:86401:0:(genops.c:906:class_export_put()) final put ffff9dbf46b0e000/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:0.0:1784189037.326668:0:86401:0:(genops.c:865:class_export_destroy()) destroying export ffff9dbf46b0e000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:0.0:1784189037.326675:0:86401:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:0.0:1784189037.328038:0:86401:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9dc047a82000 1 00000020:00000080:0.0:1784189037.328047:0:86401:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xcc1762b626f8a521 00000020:00000080:0.0:1784189037.328055:0:86401:0:(genops.c:906:class_export_put()) final put ffff9dbf4845d800/lustre-MDT0000-osd_UUID 00000020:01000000:0.0:1784189037.328069:0:86401:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:0.0:1784189037.328084:0:63468:0:(genops.c:865:class_export_destroy()) destroying export ffff9dbf4845d800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1784189037.328098:0:86401:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1784189037.328113:0:86401:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1784189037.328117:0:86401:0:(genops.c:1579:class_disconnect_exports()) OBD device 0 (ffff9dc06bb319c0) has no exports 00010000:00010000:1.0:1784189037.361003:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1784189037.380022:0:86401:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1784189037.380105:0:86401:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:0.0:1784189037.380111:0:86401:0:(genops.c:906:class_export_put()) final put ffff9dc075485800/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1784189037.380116:0:86401:0:(genops.c:865:class_export_destroy()) destroying export ffff9dc075485800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:0.0:1784189037.380126:0:86401:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:0.0:1784189037.380253:0:86401:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9dc047a85000 00000020:02000400:0.0:1784189037.380654:0:86401:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-MDT0000 complete 00010000:00010000:2.0:1784189038.323010:0:26173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784189038.640610:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1784189038.640632:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc06bbf3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1870854458048128:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1784189038.640705:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784189038.640745:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458048128 00000100:00100000:2.0:1784189038.640752:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458048128 00000100:00100000:2.0:1784189038.640803:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1870 00000100:00100000:2.0:1784189038.640813:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf44bc0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1870854458048128:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1784189038.640840:0:8432:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8651456 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1784189038.640880:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf44bc0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1870854458048128:12345-0@lo:13:osp-pre-1-1.0 Request processed in 69us (174us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189038.640887:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1870 00000100:00100000:2.0:1784189038.640929:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc06bbf3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1870854458048128:0@lo:13:osp-pre-1-1.0 00000100:00080000:0.0:1784189038.640985:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1784189038.645357:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1784189038.647194:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc05f02ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1870854458048256:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1784189038.647510:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784189038.647629:0:9466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458048256 00000100:00100000:1.0:1784189038.647636:0:9466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458048256 00000100:00100000:1.0:1784189038.647694:0:9466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1871 00000100:00100000:1.0:1784189038.647704:0:9466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc075661f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1870854458048256:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1784189038.647743:0:9466:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8651456 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1784189038.647788:0:9466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc075661f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1870854458048256:12345-0@lo:13:osp-pre-0-1.0 Request processed in 85us (278us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189038.647795:0:9466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1871 00000100:00080000:0.0:1784189038.648823:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1784189038.648872:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc05f02ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1870854458048256:0@lo:13:osp-pre-0-1.0 00010000:00010000:0.0:1784189039.343946:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784189040.367559:0:7454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784189041.199745:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf4367c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3641:1870854458048512:0@lo:400:kworker.0 00000100:00100000:2.0:1784189041.199815:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784189041.199856:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc080f68e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1870854458049024:0@lo:400:kworker.0 00000100:00100000:2.0:1784189041.199883:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784189041.199910:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:2.0:1784189041.199916:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc075663b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:bd553d0d-03e2-4233-b06b-b55bbfa2b954:3641:1870854458048384:0@lo:400:kworker.0 00000400:00000100:2.0:1784189041.199949:0:3641:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1870854458048384 offset 0 length 224: 4 00000100:00100000:2.0:1784189041.199971:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc080f68700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3641:1870854458048896:0@lo:400:kworker.0 00000100:00100000:2.0:1784189041.199991:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784189041.200007:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc080f6d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3641:1870854458049408:0@lo:400:kworker.0 00000100:00100000:2.0:1784189041.200027:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784189041.200050:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc080f69180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3643:1870854458048768:0@lo:400:kworker.0 00000100:00100000:2.0:1784189041.200073:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784189041.200090:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc080f6c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1870854458049280:0@lo:400:kworker.0 00000100:00100000:2.0:1784189041.200143:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784189041.200163:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1784189041.200169:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc080f69500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3643:1870854458048640:0@lo:400:kworker.0 00000100:00100000:2.0:1784189041.200191:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784189041.200214:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc080f6bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1870854458049152:0@lo:400:kworker.0 00000100:00100000:2.0:1784189041.200235:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784189041.200262:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458049024 00000100:00100000:2.0:1784189041.200269:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458049024 00000100:00100000:2.0:1784189041.200302:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3725 00000100:00100000:2.0:1784189041.200309:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf44bc1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3641:x1870854458049024:12345-0@lo:400:kworker.0 00000020:00080000:2.0:1784189041.200338:0:8438:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:2.0:1784189041.200386:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf44bc1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3641:x1870854458049024:12345-0@lo:400:kworker.0 Request processed in 65us (491us total) trans 0 rc -107/-107 00000100:00100000:2.0:1784189041.200395:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3725 00000100:00100000:2.0:1784189041.200416:0:68287:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458048512 00000100:00100000:2.0:1784189041.200419:0:68287:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458048512 00000100:00100000:2.0:1784189041.200436:0:68287:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458048896 00000100:00100000:2.0:1784189041.200438:0:68287:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458048896 00000100:00100000:2.0:1784189041.200462:0:68287:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458049408 00000100:00100000:2.0:1784189041.200465:0:68287:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458049408 00000100:00100000:2.0:1784189041.200473:0:68287:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458048768 00000100:00100000:2.0:1784189041.200475:0:68287:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458048768 00000100:00100000:2.0:1784189041.200482:0:68287:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458048640 00000100:00100000:2.0:1784189041.200484:0:68287:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458048640 00000100:00100000:2.0:1784189041.200497:0:68287:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1040 00000100:00100000:2.0:1784189041.200502:0:68287:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf44bc1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1870854458048896:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784189041.200542:0:68287:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf44bc1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1870854458048896:12345-0@lo:400:kworker.0 Request processed in 39us (550us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189041.200548:0:68287:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1040 00000100:00100000:2.0:1784189041.200570:0:68287:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1041 00000100:00100000:2.0:1784189041.200576:0:68287:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc06bbf3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1870854458048640:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784189041.200609:0:68287:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc06bbf3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1870854458048640:12345-0@lo:400:kworker.0 Request processed in 33us (416us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189041.200615:0:68287:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1041 00000100:00100000:2.0:1784189041.200626:0:68287:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1090 00000100:00100000:2.0:1784189041.200630:0:68287:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf44bc1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3641:x1870854458048512:12345-0@lo:400:kworker.0 00000020:00080000:2.0:1784189041.200634:0:68287:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:2.0:1784189041.200655:0:68287:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf44bc1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3641:x1870854458048512:12345-0@lo:400:kworker.0 Request processed in 23us (840us total) trans 0 rc -107/-107 00000100:00100000:2.0:1784189041.200660:0:68287:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1090 00000100:00100000:2.0:1784189041.200670:0:68287:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1091 00000100:00100000:2.0:1784189041.200673:0:68287:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf44bc2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3641:x1870854458049408:12345-0@lo:400:kworker.0 00000020:00080000:2.0:1784189041.200677:0:68287:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:2.0:1784189041.200697:0:68287:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf44bc2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3641:x1870854458049408:12345-0@lo:400:kworker.0 Request processed in 22us (670us total) trans 0 rc -107/-107 00000100:00100000:2.0:1784189041.200702:0:68287:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1091 00000100:00100000:2.0:1784189041.200713:0:68287:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1092 00000100:00100000:2.0:1784189041.200716:0:68287:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf44bc0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3643:x1870854458048768:12345-0@lo:400:kworker.0 00000020:00080000:2.0:1784189041.200720:0:68287:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:2.0:1784189041.200739:0:68287:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf44bc0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3643:x1870854458048768:12345-0@lo:400:kworker.0 Request processed in 22us (666us total) trans 0 rc -107/-107 00000100:00100000:2.0:1784189041.200744:0:68287:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1092 00000100:00100000:2.0:1784189041.200781:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc080f69500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3643:1870854458048640:0@lo:400:kworker.0 00000100:00080000:2.0:1784189041.200791:0:3643:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1784189041.200795:0:3643:0:(import.c:65:import_set_state_nolock()) ffff9dbf425f4800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:2.0:1784189041.200805:0:3643:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:2.0:1784189041.200810:0:3643:0:(import.c:65:import_set_state_nolock()) ffff9dbf425f4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1784189041.200813:0:3643:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3252 00000100:00080000:2.0:1784189041.200818:0:3643:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9dbf425f4800 using connection 192.168.203.112@tcp/0@lo 00000100:00100000:2.0:1784189041.200847:0:3643:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9dc081f80380 x1870854458049536/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1784189041.200866:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc080f69180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3643:1870854458048768:0@lo:400:kworker.0 00000100:00100000:2.0:1784189041.200898:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc080f68700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3641:1870854458048896:0@lo:400:kworker.0 00000100:00080000:2.0:1784189041.200907:0:3641:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1784189041.200909:0:3641:0:(import.c:65:import_set_state_nolock()) ffff9dbf43690800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:2.0:1784189041.200912:0:3641:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:2.0:1784189041.200914:0:3641:0:(import.c:65:import_set_state_nolock()) ffff9dbf43690800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1784189041.200916:0:3641:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3252 00000100:00080000:2.0:1784189041.200920:0:3641:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff9dbf43690800 using connection 192.168.203.112@tcp/0@lo 00000100:00100000:2.0:1784189041.200933:0:3641:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9dc081f83800 x1870854458049664/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1784189041.200943:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc080f6d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3641:1870854458049408:0@lo:400:kworker.0 00000100:00080000:2.0:1784189041.200953:0:3641:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0000 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1784189041.200956:0:3641:0:(import.c:65:import_set_state_nolock()) ffff9dbf42271800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:2.0:1784189041.200959:0:3641:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:2.0:1784189041.200961:0:3641:0:(import.c:65:import_set_state_nolock()) ffff9dbf42271800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1784189041.200964:0:3641:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3252 00000100:00080000:2.0:1784189041.200973:0:3641:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9dbf42271800 using connection 192.168.203.112@tcp/0@lo 00000100:00100000:2.0:1784189041.200986:0:3641:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9dc081f82a00 x1870854458049792/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1784189041.200995:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf4367c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3641:1870854458048512:0@lo:400:kworker.0 00000100:00080000:2.0:1784189041.201006:0:3641:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-osp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1784189041.201009:0:3641:0:(import.c:65:import_set_state_nolock()) ffff9dbf436c4000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:2.0:1784189041.201012:0:3641:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:2.0:1784189041.201015:0:3641:0:(import.c:65:import_set_state_nolock()) ffff9dbf436c4000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1784189041.201018:0:3641:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3252 00000100:00080000:2.0:1784189041.201022:0:3641:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9dbf436c4000 using connection 192.168.203.112@tcp/0@lo 00000100:00100000:2.0:1784189041.201032:0:3641:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9dc081f80e00 x1870854458049920/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1784189041.201041:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc080f68e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1870854458049024:0@lo:400:kworker.0 00000100:00080000:0.0:1784189041.201412:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1784189041.201599:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc081f80380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3639:1870854458049536:0@lo:38:ptlrpcd_00_03.0 00000100:00100000:1.0:1784189041.201640:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784189041.201668:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc081f83800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3639:1870854458049664:0@lo:38:ptlrpcd_00_01.0 00000100:00100000:1.0:1784189041.201687:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784189041.201712:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc081f82a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3639:1870854458049792:0@lo:38:ptlrpcd_00_01.0 00000100:00100000:1.0:1784189041.201731:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784189041.201747:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc081f80e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3639:1870854458049920:0@lo:38:ptlrpcd_00_01.0 00000100:00100000:1.0:1784189041.201768:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784189041.201797:0:66169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458049536 00000100:00100000:1.0:1784189041.201803:0:66169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458049536 00000100:00100000:1.0:1784189041.201826:0:66169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458049664 00000100:00100000:1.0:1784189041.201829:0:66169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458049664 00000100:00100000:1.0:1784189041.201836:0:66169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458049792 00000100:00100000:1.0:1784189041.201839:0:66169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458049792 00000100:00100000:1.0:1784189041.201848:0:66169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1093 00000100:00100000:1.0:1784189041.201854:0:66169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc05f02d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3639:x1870854458049536:12345-0@lo:38:ptlrpcd_00_03.0 00010000:00020000:1.0:1784189041.201871:0:66169:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1784189041.201905:0:66169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc05f02d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3639:x1870854458049536:12345-0@lo:38:ptlrpcd_00_03.0 Request processed in 50us (264us total) trans 0 rc -19/-19 00000100:00100000:1.0:1784189041.201912:0:66169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1093 00000100:00100000:1.0:1784189041.201926:0:66169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1094 00000100:00100000:1.0:1784189041.201930:0:66169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc05f02ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3639:x1870854458049664:12345-0@lo:38:ptlrpcd_00_01.0 00000100:00100000:0.0:1784189041.203437:0:66945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1095 00000100:00100000:0.0:1784189041.203447:0:66945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc05f02f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3639:x1870854458049792:12345-0@lo:38:ptlrpcd_00_01.0 00010000:00020000:0.0:1784189041.203466:0:66945:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1784189041.203538:0:66945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc05f02f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3639:x1870854458049792:12345-0@lo:38:ptlrpcd_00_01.0 Request processed in 90us (1805us total) trans 0 rc -19/-19 00000100:00100000:0.0:1784189041.203546:0:66945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1095 00000100:00080000:0.0:1784189041.203614:0:3639:0:(import.c:65:import_set_state_nolock()) ffff9dbf425f4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1784189041.203619:0:3639:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1784189041.203623:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc081f80380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3639:1870854458049536:0@lo:38:ptlrpcd_00_03.0 00000100:00080000:0.0:1784189041.203632:0:3639:0:(import.c:65:import_set_state_nolock()) ffff9dbf42271800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1784189041.203649:0:3639:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1784189041.203652:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc081f82a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3639:1870854458049792:0@lo:38:ptlrpcd_00_01.0 00010000:00020000:1.0:1784189041.204047:0:66169:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1784189041.204091:0:66169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc05f02ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3639:x1870854458049664:12345-0@lo:38:ptlrpcd_00_01.0 Request processed in 2158us (2402us total) trans 0 rc -19/-19 00000100:00100000:1.0:1784189041.204098:0:66169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1094 00000100:00100000:3.0:1784189041.204355:0:26167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458049280 00000100:00100000:3.0:1784189041.204362:0:26167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458049280 00000100:00100000:3.0:1784189041.204418:0:26167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458049152 00000100:00100000:3.0:1784189041.204422:0:26167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458049152 00000100:00100000:3.0:1784189041.204445:0:26167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2339 00000100:00100000:3.0:1784189041.204453:0:26167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf44bc2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0001-mdtlov_UUID+5:3643:x1870854458049280:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784189041.204501:0:26167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf44bc2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0001-mdtlov_UUID+5:3643:x1870854458049280:12345-0@lo:400:kworker.0 Request processed in 49us (4357us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189041.204575:0:26167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2339 00000100:00100000:3.0:1784189041.204589:0:26167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2340 00000100:00100000:3.0:1784189041.204595:0:26167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc081f81880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0001-mdtlov_UUID+5:3643:x1870854458049152:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784189041.204625:0:26167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc081f81880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0001-mdtlov_UUID+5:3643:x1870854458049152:12345-0@lo:400:kworker.0 Request processed in 31us (4388us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189041.204631:0:26167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2340 00000100:00100000:3.0:1784189041.204656:0:26492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458049920 00000100:00100000:3.0:1784189041.204660:0:26492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458049920 00000100:00100000:3.0:1784189041.204678:0:26492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3726 00000100:00100000:3.0:1784189041.204683:0:26492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc05f02c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3639:x1870854458049920:12345-0@lo:38:ptlrpcd_00_01.0 00010000:00020000:3.0:1784189041.204694:0:26492:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1784189041.204719:0:26492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc05f02c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3639:x1870854458049920:12345-0@lo:38:ptlrpcd_00_01.0 Request processed in 35us (2951us total) trans 0 rc -19/-19 00000100:00100000:3.0:1784189041.204733:0:26492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3726 00000100:00100000:3.0:1784189041.204773:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc080f6bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1870854458049152:0@lo:400:kworker.0 00000100:00100000:3.0:1784189041.204784:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc080f6c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1870854458049280:0@lo:400:kworker.0 00000100:00080000:0.0:1784189041.205466:0:3639:0:(import.c:65:import_set_state_nolock()) ffff9dbf43690800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1784189041.205473:0:3639:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1784189041.205477:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc081f83800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3639:1870854458049664:0@lo:38:ptlrpcd_00_01.0 00000100:00080000:0.0:1784189041.205487:0:3639:0:(import.c:65:import_set_state_nolock()) ffff9dbf436c4000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1784189041.205490:0:3639:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1784189041.205493:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc081f80e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3639:1870854458049920:0@lo:38:ptlrpcd_00_01.0 00000100:00080000:1.0:1784189041.205637:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1784189041.205642:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1784189041.391565:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000400:00000100:0.0:1784189041.959736:0:3634:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-192.168.203.12@tcp portal 26 match 1870854436242304 offset 0 length 224: 4 00000100:00100000:0.0:1784189041.959783:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1784189041.959813:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1784189041.959832:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1784189041.960233:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1784189041.960607:0:26165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436242816 00000100:00100000:3.0:1784189041.960619:0:26165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436242816 00000100:00100000:3.0:1784189041.960680:0:26165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436242688 00000100:00100000:3.0:1784189041.960683:0:26165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436242688 00000100:00100000:3.0:1784189041.960702:0:26165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 2341 00000100:00100000:3.0:1784189041.960710:0:26165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc080f6c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+5:2397:x1870854436242816:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:3.0:1784189041.960784:0:26165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc080f6c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+5:2397:x1870854436242816:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 74us (970us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189041.960791:0:26165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 2341 00000100:00100000:3.0:1784189041.960812:0:26165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 2342 00000100:00100000:3.0:1784189041.960818:0:26165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc056eafb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+5:2397:x1870854436242688:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:3.0:1784189041.960842:0:26165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc056eafb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+5:2397:x1870854436242688:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 24us (609us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189041.960848:0:26165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 2342 00000100:00100000:1.0:1784189041.961086:0:66171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436242560 00000100:00100000:1.0:1784189041.961091:0:66171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436242560 00000100:00080000:0.0:1784189041.961151:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1784189041.961157:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1784189041.961159:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1784189041.961213:0:66171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436242432 00000100:00100000:1.0:1784189041.961217:0:66171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436242432 00000100:00100000:1.0:1784189041.961243:0:66171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1042 00000100:00100000:1.0:1784189041.961252:0:66171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc080f6df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+6:2397:x1870854436242560:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:1.0:1784189041.961286:0:66171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc080f6df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+6:2397:x1870854436242560:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 36us (1503us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189041.961293:0:66171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1042 00000100:00100000:1.0:1784189041.961308:0:66171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1096 00000100:00100000:1.0:1784189041.961313:0:66171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc080f6d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2397:x1870854436242432:12345-192.168.203.12@tcp:400:kworker.0 00000020:00080000:1.0:1784189041.961336:0:66171:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-192.168.203.12@tcp 00000100:00100000:1.0:1784189041.961358:0:66171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc080f6d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2397:x1870854436242432:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 44us (1525us total) trans 0 rc -107/-107 00000100:00100000:1.0:1784189041.961364:0:66171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1096 00000100:00100000:0.0:1784189041.969141:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1784189041.969877:0:68287:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436242944 00000100:00100000:2.0:1784189041.969897:0:68287:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436242944 00000100:00100000:2.0:1784189041.969953:0:68287:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1097 00000100:00100000:2.0:1784189041.969961:0:68287:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc056eace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2395:x1870854436242944:12345-192.168.203.12@tcp:38:ptlrpcd_00_01.0 00010000:00020000:2.0:1784189041.969983:0:68287:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.203.12@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1784189041.970054:0:68287:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc056eace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2395:x1870854436242944:12345-192.168.203.12@tcp:38:ptlrpcd_00_01.0 Request processed in 92us (931us total) trans 0 rc -19/-19 00000100:00100000:2.0:1784189041.970062:0:68287:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1097 00010000:00010000:2.0:1784189042.416707:0:26173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1784189042.738650:0:9506:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1784189042.738658:0:9506:0:(genops.c:906:class_export_put()) final put ffff9dc07118f800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1784189042.738732:0:27065:0:(genops.c:865:class_export_destroy()) destroying export ffff9dc07118f800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:2.0:1784189042.738784:0:27065:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9dc07118e000 for lustre-OST0001 00000001:00100000:2.0:1784189042.745082:0:8423:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1784189042.745091:0:8423:0:(genops.c:906:class_export_put()) final put ffff9dc07118f000/lustre-MDT0000-mdtlov_UUID 00000001:00100000:0.0:1784189042.745134:0:75588:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:0.0:1784189042.745146:0:75588:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 81604378732 is committed 00000020:00000080:0.0:1784189042.745150:0:75588:0:(genops.c:906:class_export_put()) final put ffff9dc0477b2000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1784189042.745201:0:63468:0:(genops.c:865:class_export_destroy()) destroying export ffff9dc07118f000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:3.0:1784189042.745245:0:63468:0:(genops.c:865:class_export_destroy()) destroying export ffff9dc0477b2000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001 00000020:00000080:3.0:1784189042.745274:0:63468:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9dc071188800 for lustre-OST0000 00000020:00000080:3.0:1784189042.745278:0:63468:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9dc0477b4000 for lustre-MDT0001 00010000:00010000:0.0:1784189043.439629:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784189043.759805:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1784189043.759838:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc081f82300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1870854458050048:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1784189043.759922:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784189043.760214:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1784189043.760225:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc05f02ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1870854458050176:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1784189043.760257:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784189043.760459:0:9466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458050048 00000100:00100000:1.0:1784189043.760466:0:9466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458050048 00000100:00100000:1.0:1784189043.760518:0:9466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458050176 00000100:00100000:1.0:1784189043.760521:0:9466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458050176 00000100:00100000:1.0:1784189043.760537:0:9466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1872 00000100:00100000:1.0:1784189043.760545:0:9466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc05f02c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1870854458050048:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1784189043.760571:0:9466:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8651456 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1784189043.760627:0:9466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc05f02c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1870854458050048:12345-0@lo:13:osp-pre-1-1.0 Request processed in 82us (704us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189043.760635:0:9466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1872 00000100:00100000:1.0:1784189043.760652:0:9466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1873 00000100:00100000:1.0:1784189043.760658:0:9466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc056eaea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1870854458050176:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1784189043.760672:0:9466:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8651456 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1784189043.760697:0:9466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc056eaea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1870854458050176:12345-0@lo:13:osp-pre-0-1.0 Request processed in 39us (440us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189043.760704:0:9466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1873 00000100:00100000:1.0:1784189043.760740:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc081f82300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1870854458050048:0@lo:13:osp-pre-1-1.0 00000100:00080000:0.0:1784189043.761006:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1784189043.761011:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1784189043.761044:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc05f02ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1870854458050176:0@lo:13:osp-pre-0-1.0 00010000:00010000:0.0:1784189044.463469:0:7454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784189045.487542:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1784189046.319594:0:63468:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1784189046.319601:0:63468:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1784189046.319604:0:63468:0:(import.c:65:import_set_state_nolock()) ffff9dbf42271800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1784189046.319624:0:63468:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3283 00000100:00080000:3.0:1784189046.319630:0:63468:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1784189046.319636:0:63468:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9dbf42271800 using connection 192.168.203.112@tcp/0@lo 00000100:00100000:3.0:1784189046.319659:0:63468:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9dbf4262d880 x1870854458050432/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1784189046.319696:0:63468:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1784189046.319700:0:63468:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1784189046.319702:0:63468:0:(import.c:65:import_set_state_nolock()) ffff9dbf425f4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1784189046.319705:0:63468:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3283 00000100:00080000:3.0:1784189046.319708:0:63468:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1784189046.319711:0:63468:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9dbf425f4800 using connection 192.168.203.112@tcp/0@lo 00000100:00100000:3.0:1784189046.319721:0:63468:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9dbf4262e300 x1870854458050688/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1784189046.319737:0:63468:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1784189046.319740:0:63468:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1784189046.319741:0:63468:0:(import.c:65:import_set_state_nolock()) ffff9dbf436c4000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1784189046.319745:0:63468:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3283 00000100:00080000:3.0:1784189046.319748:0:63468:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1784189046.319751:0:63468:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9dbf436c4000 using connection 192.168.203.112@tcp/0@lo 00000100:00100000:3.0:1784189046.319761:0:63468:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9dbf4262f480 x1870854458050944/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1784189046.319782:0:63468:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1784189046.319785:0:63468:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1784189046.319787:0:63468:0:(import.c:65:import_set_state_nolock()) ffff9dbf43690800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1784189046.319796:0:63468:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3283 00000100:00080000:3.0:1784189046.319798:0:63468:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1784189046.319802:0:63468:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff9dbf43690800 using connection 192.168.203.112@tcp/0@lo 00000100:00100000:3.0:1784189046.319815:0:63468:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9dbf4262d180 x1870854458051328/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1784189046.319891:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf4262f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:bd553d0d-03e2-4233-b06b-b55bbfa2b954:3643:1870854458050304:0@lo:400:kworker.0 00000400:00000100:0.0:1784189046.319942:0:3643:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1870854458050304 offset 0 length 224: 4 00000100:00100000:0.0:1784189046.319979:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf4262ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1870854458051200:0@lo:400:kworker.0 00000100:00100000:0.0:1784189046.320011:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784189046.320044:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1784189046.320050:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf4262e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1870854458051072:0@lo:400:kworker.0 00000100:00100000:0.0:1784189046.320072:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784189046.320108:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf4262c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3641:1870854458050816:0@lo:400:kworker.0 00000100:00100000:0.0:1784189046.320133:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784189046.320152:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1784189046.320157:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf4262fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3641:1870854458050560:0@lo:400:kworker.0 00000100:00100000:0.0:1784189046.320176:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784189046.320202:0:66170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458050816 00000100:00100000:0.0:1784189046.320208:0:66170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458050816 00000100:00100000:0.0:1784189046.320251:0:66170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458050560 00000100:00100000:0.0:1784189046.320254:0:66170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458050560 00000100:00100000:0.0:1784189046.320275:0:66170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1043 00000100:00100000:0.0:1784189046.320282:0:66170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf48599500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1870854458050816:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784189046.320344:0:66170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf48599500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1870854458050816:12345-0@lo:400:kworker.0 Request processed in 62us (209us total) trans 0 rc 0/0 00000100:00100000:0.0:1784189046.320351:0:66170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1043 00000100:00100000:0.0:1784189046.320365:0:66170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1044 00000100:00100000:0.0:1784189046.320370:0:66170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf4859a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1870854458050560:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784189046.320393:0:66170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf4859a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1870854458050560:12345-0@lo:400:kworker.0 Request processed in 23us (216us total) trans 0 rc 0/0 00000100:00100000:0.0:1784189046.320405:0:66170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1044 00000100:00080000:0.0:1784189046.320423:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1784189046.320449:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf4262fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3641:1870854458050560:0@lo:400:kworker.0 00000100:00100000:0.0:1784189046.320458:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf4262c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3641:1870854458050816:0@lo:400:kworker.0 00000100:00100000:3.0:1784189046.320772:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458051200 00000100:00100000:3.0:1784189046.320776:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458051200 00000100:00100000:3.0:1784189046.320823:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458051072 00000100:00100000:3.0:1784189046.320826:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458051072 00000100:00100000:3.0:1784189046.320846:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2343 00000100:00100000:3.0:1784189046.320853:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc056eac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1870854458051200:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784189046.320891:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc056eac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1870854458051200:12345-0@lo:400:kworker.0 Request processed in 39us (880us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189046.320897:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2343 00000100:00100000:3.0:1784189046.320909:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2344 00000100:00100000:3.0:1784189046.320915:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc056ead180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1870854458051072:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784189046.320941:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc056ead180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1870854458051072:12345-0@lo:400:kworker.0 Request processed in 26us (868us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189046.320947:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2344 00000100:00100000:2.0:1784189046.321072:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf4262d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3639:1870854458050432:0@lo:38:kworker.0 00000100:00100000:2.0:1784189046.321115:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784189046.321141:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf4262e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3639:1870854458050688:0@lo:38:kworker.0 00000100:00100000:2.0:1784189046.321162:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784189046.321184:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf4262f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3639:1870854458050944:0@lo:38:kworker.0 00000100:00100000:2.0:1784189046.321205:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784189046.321222:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf4262d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3639:1870854458051328:0@lo:38:kworker.0 00000100:00100000:2.0:1784189046.321240:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784189046.321267:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458050944 00000100:00100000:2.0:1784189046.321270:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458050944 00000100:00100000:2.0:1784189046.321290:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3727 00000100:00100000:2.0:1784189046.321295:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc081f80a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3639:x1870854458050944:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1784189046.321312:0:8438:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1784189046.321376:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc081f80a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3639:x1870854458050944:12345-0@lo:38:kworker.0 Request processed in 79us (168us total) trans 0 rc -19/-19 00000100:00100000:2.0:1784189046.321381:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3727 00000100:00080000:2.0:1784189046.321407:0:3639:0:(import.c:65:import_set_state_nolock()) ffff9dbf436c4000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1784189046.321412:0:3639:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1784189046.321416:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf4262f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3639:1870854458050944:0@lo:38:kworker.0 00000100:00100000:1.0:1784189046.321496:0:66171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458050432 00000100:00100000:1.0:1784189046.321501:0:66171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458050432 00000100:00100000:1.0:1784189046.321527:0:66171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458050688 00000100:00100000:1.0:1784189046.321530:0:66171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458050688 00000100:00100000:1.0:1784189046.321542:0:66171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458051328 00000100:00100000:1.0:1784189046.321544:0:66171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458051328 00000100:00100000:1.0:1784189046.321554:0:66171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1098 00000100:00100000:1.0:1784189046.321559:0:66171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc081f80000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3639:x1870854458050432:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1784189046.321570:0:66171:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1784189046.321609:0:66171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc081f80000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3639:x1870854458050432:12345-0@lo:38:kworker.0 Request processed in 49us (493us total) trans 0 rc -19/-19 00000100:00100000:1.0:1784189046.321616:0:66171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1098 00000100:00100000:1.0:1784189046.321630:0:66171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1099 00000100:00100000:1.0:1784189046.321635:0:66171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc081f82d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3639:x1870854458050688:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1784189046.321644:0:66171:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1784189046.321666:0:66171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc081f82d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3639:x1870854458050688:12345-0@lo:38:kworker.0 Request processed in 30us (504us total) trans 0 rc -19/-19 00000100:00100000:1.0:1784189046.321672:0:66171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1099 00000100:00100000:1.0:1784189046.321684:0:66171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1100 00000100:00100000:1.0:1784189046.321688:0:66171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc081f81f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3639:x1870854458051328:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1784189046.321697:0:66171:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1784189046.321719:0:66171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc081f81f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3639:x1870854458051328:12345-0@lo:38:kworker.0 Request processed in 29us (477us total) trans 0 rc -19/-19 00000100:00100000:1.0:1784189046.321724:0:66171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1100 00000100:00080000:2.0:1784189046.321799:0:3639:0:(import.c:65:import_set_state_nolock()) ffff9dbf42271800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1784189046.321803:0:3639:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1784189046.321806:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf4262d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3639:1870854458050432:0@lo:38:kworker.0 00000100:00080000:2.0:1784189046.321814:0:3639:0:(import.c:65:import_set_state_nolock()) ffff9dbf425f4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1784189046.321824:0:3639:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1784189046.321827:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf4262e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3639:1870854458050688:0@lo:38:kworker.0 00000100:00080000:2.0:1784189046.321836:0:3639:0:(import.c:65:import_set_state_nolock()) ffff9dbf43690800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1784189046.321839:0:3639:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1784189046.321841:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf4262d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3639:1870854458051328:0@lo:38:kworker.0 00000100:00080000:0.0:1784189046.324470:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1784189046.324480:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1784189046.324536:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf4262e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1870854458051072:0@lo:400:kworker.0 00000100:00100000:0.0:1784189046.324552:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf4262ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1870854458051200:0@lo:400:kworker.0 00010000:00010000:2.0:1784189046.515350:0:26173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000400:00000100:0.0:1784189047.078979:0:3633:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-192.168.203.12@tcp portal 26 match 1870854436243072 offset 0 length 224: 4 00000100:00100000:0.0:1784189047.079021:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1784189047.079066:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1784189047.079104:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1784189047.079149:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1784189047.079282:0:26168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436243456 00000100:00100000:3.0:1784189047.079290:0:26168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436243456 00000100:00100000:3.0:1784189047.079385:0:26168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436243584 00000100:00100000:3.0:1784189047.079389:0:26168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436243584 00000100:00100000:3.0:1784189047.079414:0:26168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 2345 00000100:00100000:3.0:1784189047.079424:0:26168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf48599c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+5:2396:x1870854436243456:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:3.0:1784189047.079486:0:26168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf48599c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+5:2396:x1870854436243456:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 63us (419us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189047.079508:0:26168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 2345 00000100:00100000:3.0:1784189047.079523:0:26168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 2346 00000100:00100000:3.0:1784189047.079529:0:26168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc081cd2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+5:2397:x1870854436243584:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:3.0:1784189047.079556:0:26168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc081cd2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+5:2397:x1870854436243584:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 27us (452us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189047.079561:0:26168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 2346 00000100:00080000:0.0:1784189047.079780:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1784189047.079785:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1784189047.080004:0:66171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436243328 00000100:00100000:1.0:1784189047.080009:0:66171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436243328 00000100:00100000:1.0:1784189047.080059:0:66171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436243200 00000100:00100000:1.0:1784189047.080062:0:66171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436243200 00000100:00100000:1.0:1784189047.080079:0:66171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1045 00000100:00100000:1.0:1784189047.080096:0:66171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf4859b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+6:2397:x1870854436243328:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:1.0:1784189047.080128:0:66171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf4859b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+6:2397:x1870854436243328:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 43us (1107us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189047.080135:0:66171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1045 00000100:00100000:1.0:1784189047.080149:0:66171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1101 00000100:00100000:1.0:1784189047.080154:0:66171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf4859ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2395:x1870854436243200:12345-192.168.203.12@tcp:38:kworker.0 00010000:00020000:1.0:1784189047.080189:0:66171:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.203.12@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1784189047.080214:0:66171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf4859ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2395:x1870854436243200:12345-192.168.203.12@tcp:38:kworker.0 Request processed in 59us (1064us total) trans 0 rc -19/-19 00000100:00100000:1.0:1784189047.080220:0:66171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1101 00000100:00080000:0.0:1784189047.080374:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:0.0:1784189047.536261:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784189048.560533:0:7454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784189048.880050:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc081f81880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1870854458051456:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1784189048.880148:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784189048.880209:0:9466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458051456 00000100:00100000:0.0:1784189048.880218:0:9466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458051456 00000100:00100000:0.0:1784189048.880292:0:9466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1874 00000100:00100000:0.0:1784189048.880301:0:9466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc05f02d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1870854458051456:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1784189048.880347:0:9466:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8651456 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1784189048.880397:0:9466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc05f02d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1870854458051456:12345-0@lo:13:osp-pre-1-1.0 Request processed in 97us (261us total) trans 0 rc 0/0 00000100:00100000:0.0:1784189048.880420:0:9466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1874 00000100:00100000:0.0:1784189048.880479:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc081f81880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1870854458051456:0@lo:13:osp-pre-1-1.0 00000100:00080000:1.0:1784189048.880909:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1784189048.882566:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf4262dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1870854458051584:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1784189048.882845:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784189048.883391:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458051584 00000100:00100000:2.0:1784189048.883399:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458051584 00000100:00100000:2.0:1784189048.883520:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1875 00000100:00100000:2.0:1784189048.883529:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf4859aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1870854458051584:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1784189048.883557:0:8432:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8651456 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1784189048.883667:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf4859aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1870854458051584:12345-0@lo:13:osp-pre-0-1.0 Request processed in 139us (965us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189048.883674:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1875 00000100:00100000:3.0:1784189048.883981:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf4262dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1870854458051584:0@lo:13:osp-pre-0-1.0 00000100:00080000:1.0:1784189048.884029:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1784189049.583585:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784189050.608819:0:26173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1784189051.441900:0:27065:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1784189051.442204:0:27065:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1784189051.442208:0:27065:0:(import.c:65:import_set_state_nolock()) ffff9dbf42271800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1784189051.442215:0:27065:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3288 00000100:00080000:2.0:1784189051.442221:0:27065:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1784189051.442228:0:27065:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9dbf42271800 using connection 192.168.203.112@tcp/0@lo 00000100:00100000:2.0:1784189051.442250:0:27065:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9dc081f80e00 x1870854458051840/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1784189051.442277:0:27065:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1784189051.442280:0:27065:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1784189051.442282:0:27065:0:(import.c:65:import_set_state_nolock()) ffff9dbf425f4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1784189051.442291:0:27065:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3288 00000100:00080000:2.0:1784189051.442294:0:27065:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1784189051.442298:0:27065:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9dbf425f4800 using connection 192.168.203.112@tcp/0@lo 00000100:00100000:2.0:1784189051.442311:0:27065:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9dc081f82a00 x1870854458052096/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1784189051.442360:0:27065:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1784189051.442363:0:27065:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1784189051.442365:0:27065:0:(import.c:65:import_set_state_nolock()) ffff9dbf436c4000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1784189051.442369:0:27065:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3288 00000100:00080000:2.0:1784189051.442372:0:27065:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1784189051.442376:0:27065:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9dbf436c4000 using connection 192.168.203.112@tcp/0@lo 00000100:00100000:2.0:1784189051.442389:0:27065:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9dc081f81880 x1870854458052352/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1784189051.442411:0:27065:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1784189051.442415:0:27065:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1784189051.442416:0:27065:0:(import.c:65:import_set_state_nolock()) ffff9dbf43690800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1784189051.442420:0:27065:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3288 00000100:00080000:2.0:1784189051.442422:0:27065:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1784189051.442425:0:27065:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff9dbf43690800 using connection 192.168.203.112@tcp/0@lo 00000100:00100000:2.0:1784189051.442984:0:27065:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9dbf4367d500 x1870854458052736/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1784189051.443105:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc081f82300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bd553d0d-03e2-4233-b06b-b55bbfa2b954:3642:1870854458051712:0@lo:400:kworker.0 00000400:00000100:2.0:1784189051.443260:0:3642:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1870854458051712 offset 0 length 224: 4 00000100:00100000:2.0:1784189051.443294:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf4367ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1870854458052608:0@lo:400:kworker.0 00000100:00100000:2.0:1784189051.443751:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784189051.443780:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1784189051.443787:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc081f83800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3642:1870854458051968:0@lo:400:kworker.0 00000100:00100000:2.0:1784189051.443815:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784189051.443841:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc081f80e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3639:1870854458051840:0@lo:38:kworker.0 00000100:00100000:2.0:1784189051.443863:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784189051.443881:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc081f82a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3639:1870854458052096:0@lo:38:kworker.0 00000100:00100000:0.0:1784189051.443966:0:66169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458051968 00000100:00100000:0.0:1784189051.443973:0:66169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458051968 00000100:00100000:2.0:1784189051.444013:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784189051.444043:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc081f81880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3639:1870854458052352:0@lo:38:kworker.0 00000100:00100000:2.0:1784189051.444077:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784189051.444093:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf4367d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3639:1870854458052736:0@lo:38:kworker.0 00000100:00100000:2.0:1784189051.444114:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784189051.445576:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc081f80380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3640:1870854458052224:0@lo:400:kworker.0 00000100:00100000:2.0:1784189051.445612:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784189051.448875:0:66169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458051840 00000100:00100000:0.0:1784189051.448887:0:66169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458051840 00000100:00100000:0.0:1784189051.448926:0:66169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458052096 00000100:00100000:0.0:1784189051.448930:0:66169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458052096 00000100:00100000:0.0:1784189051.448940:0:66169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458052736 00000100:00100000:0.0:1784189051.448943:0:66169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458052736 00000100:00100000:0.0:1784189051.448957:0:66169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1046 00000100:00100000:0.0:1784189051.448970:0:66169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc080f69f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1870854458051968:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784189051.449075:0:66169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc080f69f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1870854458051968:12345-0@lo:400:kworker.0 Request processed in 110us (5258us total) trans 0 rc 0/0 00000100:00100000:0.0:1784189051.449083:0:66169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1046 00000100:00100000:0.0:1784189051.449100:0:66169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1102 00000100:00100000:0.0:1784189051.449105:0:66169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc080f6b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3639:x1870854458051840:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1784189051.449228:0:66169:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1784189051.449474:0:66169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc080f6b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3639:x1870854458051840:12345-0@lo:38:kworker.0 Request processed in 367us (5609us total) trans 0 rc -19/-19 00000100:00100000:0.0:1784189051.449481:0:66169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1102 00000100:00100000:0.0:1784189051.449494:0:66169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1103 00000100:00100000:0.0:1784189051.449498:0:66169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc080f69c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3639:x1870854458052096:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1784189051.449508:0:66169:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1784189051.449543:0:66169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc080f69c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3639:x1870854458052096:12345-0@lo:38:kworker.0 Request processed in 43us (5639us total) trans 0 rc -19/-19 00000100:00100000:0.0:1784189051.449549:0:66169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1103 00000100:00100000:0.0:1784189051.449560:0:66169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1104 00000100:00100000:0.0:1784189051.449565:0:66169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc080f6b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3639:x1870854458052736:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1784189051.449573:0:66169:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1784189051.449595:0:66169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc080f6b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3639:x1870854458052736:12345-0@lo:38:kworker.0 Request processed in 29us (5481us total) trans 0 rc -19/-19 00000100:00100000:0.0:1784189051.449601:0:66169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1104 00000100:00080000:0.0:1784189051.449621:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1784189051.450092:0:23826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458052352 00000100:00100000:0.0:1784189051.450098:0:23826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458052352 00000100:00100000:0.0:1784189051.450515:0:23826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3728 00000100:00100000:0.0:1784189051.450520:0:23826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc080f6a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3639:x1870854458052352:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1784189051.450535:0:23826:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1784189051.450578:0:23826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc080f6a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3639:x1870854458052352:12345-0@lo:38:kworker.0 Request processed in 57us (6501us total) trans 0 rc -19/-19 00000100:00100000:0.0:1784189051.450585:0:23826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3728 00000100:00100000:2.0:1784189051.451227:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1784189051.451240:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf4367f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1870854458052480:0@lo:400:kworker.0 00000100:00100000:2.0:1784189051.451280:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784189051.451337:0:9982:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458052608 00000100:00100000:2.0:1784189051.451342:0:9982:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458052608 00000100:00100000:2.0:1784189051.451386:0:9982:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458052480 00000100:00100000:2.0:1784189051.451389:0:9982:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458052480 00000100:00100000:2.0:1784189051.451412:0:9982:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2347 00000100:00100000:2.0:1784189051.451418:0:9982:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf4367c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3642:x1870854458052608:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784189051.451500:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc081f83800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3642:1870854458051968:0@lo:400:kworker.0 00000100:00080000:0.0:1784189051.451523:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1784189051.451526:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1784189051.452045:0:9982:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf4367c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3642:x1870854458052608:12345-0@lo:400:kworker.0 Request processed in 626us (8294us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189051.452064:0:9982:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2347 00000100:00100000:2.0:1784189051.452091:0:9982:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2348 00000100:00100000:2.0:1784189051.452098:0:9982:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc080f6aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3640:x1870854458052480:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784189051.452135:0:9982:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc080f6aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3640:x1870854458052480:12345-0@lo:400:kworker.0 Request processed in 38us (855us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189051.452254:0:9982:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2348 00000100:00100000:2.0:1784189051.452277:0:66171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458052224 00000100:00100000:2.0:1784189051.452282:0:66171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458052224 00000100:00100000:2.0:1784189051.452335:0:66171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1047 00000100:00100000:2.0:1784189051.452342:0:66171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc080f6a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1870854458052224:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784189051.452374:0:66171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc080f6a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1870854458052224:12345-0@lo:400:kworker.0 Request processed in 33us (6761us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189051.452381:0:66171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1047 00000100:00100000:2.0:1784189051.452431:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf4367f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1870854458052480:0@lo:400:kworker.0 00000100:00100000:2.0:1784189051.452779:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc081f80380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3640:1870854458052224:0@lo:400:kworker.0 00000100:00080000:0.0:1784189051.454664:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1784189051.455899:0:3639:0:(import.c:65:import_set_state_nolock()) ffff9dbf42271800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1784189051.455908:0:3639:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1784189051.455913:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc081f80e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3639:1870854458051840:0@lo:38:kworker.0 00000100:00080000:0.0:1784189051.455927:0:3639:0:(import.c:65:import_set_state_nolock()) ffff9dbf425f4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1784189051.455937:0:3639:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1784189051.455941:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc081f82a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3639:1870854458052096:0@lo:38:kworker.0 00000100:00080000:0.0:1784189051.455955:0:3639:0:(import.c:65:import_set_state_nolock()) ffff9dbf436c4000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1784189051.455958:0:3639:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1784189051.455961:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc081f81880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3639:1870854458052352:0@lo:38:kworker.0 00000100:00080000:0.0:1784189051.455970:0:3639:0:(import.c:65:import_set_state_nolock()) ffff9dbf43690800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1784189051.455974:0:3639:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1784189051.455976:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf4367d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3639:1870854458052736:0@lo:38:kworker.0 00000100:00100000:0.0:1784189051.456024:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf4367ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1870854458052608:0@lo:400:kworker.0 00010000:00010000:3.0:1784189051.631829:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784189052.199492:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000400:00000100:0.0:1784189052.199521:0:3633:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-192.168.203.12@tcp portal 26 match 1870854436243712 offset 0 length 224: 4 00000100:00100000:0.0:1784189052.199538:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1784189052.199561:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1784189052.199636:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1784189052.199664:0:68287:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436243968 00000100:00100000:0.0:1784189052.199673:0:68287:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436243968 00000100:00100000:0.0:1784189052.199733:0:68287:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436243840 00000100:00100000:0.0:1784189052.199737:0:68287:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436243840 00000100:00100000:0.0:1784189052.199755:0:68287:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1048 00000100:00100000:0.0:1784189052.199765:0:68287:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf4859bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+6:2397:x1870854436243968:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:0.0:1784189052.199837:0:68287:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf4859bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+6:2397:x1870854436243968:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 73us (352us total) trans 0 rc 0/0 00000100:00100000:0.0:1784189052.199844:0:68287:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1048 00000100:00100000:0.0:1784189052.199859:0:68287:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1105 00000100:00100000:0.0:1784189052.199864:0:68287:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf48599f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2395:x1870854436243840:12345-192.168.203.12@tcp:38:kworker.0 00010000:00020000:0.0:1784189052.199894:0:68287:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.203.12@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1784189052.199920:0:68287:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf48599f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2395:x1870854436243840:12345-192.168.203.12@tcp:38:kworker.0 Request processed in 55us (381us total) trans 0 rc -19/-19 00000100:00100000:0.0:1784189052.199927:0:68287:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1105 00000100:00100000:0.0:1784189052.199946:0:26163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436244096 00000100:00100000:0.0:1784189052.199949:0:26163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436244096 00000100:00100000:0.0:1784189052.199975:0:26163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436244224 00000100:00100000:0.0:1784189052.199978:0:26163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436244224 00000100:00100000:0.0:1784189052.200006:0:26163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 4929 00000100:00100000:0.0:1784189052.200012:0:26163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf48599c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+5:2395:x1870854436244096:12345-192.168.203.12@tcp:9:kworker.0 00000020:00000080:0.0:1784189052.200030:0:26163:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xcc1762b626f8a973 00000100:00080000:0.0:1784189052.200037:0:26163:0:(import.c:65:import_set_state_nolock()) ffff9dbf43fcb000 : changing import state from FULL to CLOSED 00000100:00080000:1.0:1784189052.200284:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1784189052.200288:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1784189052.200290:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1784189052.200304:0:26164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 4930 00000100:00100000:1.0:1784189052.200311:0:26164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc081f81880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+5:2395:x1870854436244224:12345-192.168.203.12@tcp:9:kworker.0 00000020:00000080:1.0:1784189052.200360:0:26164:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xcc1762b626f8a97a 00000100:00080000:1.0:1784189052.200366:0:26164:0:(import.c:65:import_set_state_nolock()) ffff9dbf43fce000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1784189052.200408:0:26164:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294968952 00010000:00010000:2.0:1784189052.200476:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784189052.200524:0:26164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc081f81880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+2:2395:x1870854436244224:12345-192.168.203.12@tcp:9:kworker.0 Request processed in 213us (887us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189052.200531:0:26164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 4930 00000001:00000004:0.0:1784189052.202170:0:26163:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294968948 00000100:00100000:0.0:1784189052.202314:0:26163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf48599c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+2:2395:x1870854436244096:12345-192.168.203.12@tcp:9:kworker.0 Request processed in 2297us (2747us total) trans 0 rc 0/0 00000100:00100000:0.0:1784189052.202341:0:26163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 4929 00010000:00010000:0.0:1784189052.202490:0:7454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784189052.658637:0:26173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784189053.679521:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784189054.010978:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1784189054.010998:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc080f6bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1870854458052864:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1784189054.011072:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784189054.011110:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc080f68e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1870854458052992:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1784189054.011133:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784189054.011166:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458052864 00000100:00100000:2.0:1784189054.011173:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458052864 00000100:00100000:2.0:1784189054.011221:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458052992 00000100:00100000:2.0:1784189054.011224:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458052992 00000100:00100000:2.0:1784189054.011241:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1876 00000100:00100000:2.0:1784189054.011248:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc080f68700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1870854458052864:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1784189054.011287:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 213696 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1784189054.011347:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc080f68700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1870854458052864:12345-0@lo:13:osp-pre-0-1.0 Request processed in 99us (275us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189054.011355:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1876 00000100:00100000:2.0:1784189054.011370:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1877 00000100:00100000:2.0:1784189054.011377:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc080f69180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1870854458052992:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1784189054.011390:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 213696 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1784189054.011420:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc080f69180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1870854458052992:12345-0@lo:13:osp-pre-1-1.0 Request processed in 44us (285us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189054.011426:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1877 00000100:00080000:2.0:1784189054.011444:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1784189054.011448:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1784189054.011495:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc080f68e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1870854458052992:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1784189054.011527:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc080f6bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1870854458052864:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1784189054.705456:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784189055.730500:0:7454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1784189056.562262:0:27065:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1784189056.562270:0:27065:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1784189056.562274:0:27065:0:(import.c:65:import_set_state_nolock()) ffff9dbf42271800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1784189056.562281:0:27065:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3293 00000100:00080000:2.0:1784189056.562287:0:27065:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 15s 00000100:00080000:2.0:1784189056.562294:0:27065:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9dbf42271800 using connection 192.168.203.112@tcp/0@lo 00000100:00100000:2.0:1784189056.562335:0:27065:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9dc080f68e00 x1870854458053248/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1784189056.562373:0:27065:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00100000:0.0:1784189056.562382:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00080000:2.0:1784189056.562383:0:27065:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1784189056.562385:0:27065:0:(import.c:65:import_set_state_nolock()) ffff9dbf425f4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1784189056.562389:0:27065:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3293 00000100:00080000:2.0:1784189056.562391:0:27065:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 15s 00000100:00080000:2.0:1784189056.562395:0:27065:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9dbf425f4800 using connection 192.168.203.112@tcp/0@lo 00000100:00100000:0.0:1784189056.562398:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc080f69500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3643:1870854458053376:0@lo:400:kworker.0 00000100:00100000:2.0:1784189056.562492:0:27065:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9dbf4367ea00 x1870854458053504/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1784189056.562508:0:27065:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1784189056.562511:0:27065:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1784189056.562513:0:27065:0:(import.c:65:import_set_state_nolock()) ffff9dbf436c4000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:0.0:1784189056.562516:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1784189056.562517:0:27065:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3293 00000100:00080000:2.0:1784189056.562519:0:27065:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 15s 00000100:00080000:2.0:1784189056.562523:0:27065:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9dbf436c4000 using connection 192.168.203.112@tcp/0@lo 00000100:00100000:2.0:1784189056.562532:0:27065:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9dbf4367f800 x1870854458053760/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1784189056.562549:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf4367d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3643:1870854458053632:0@lo:400:kworker.0 00000100:00080000:2.0:1784189056.562553:0:27065:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1784189056.562556:0:27065:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1784189056.562558:0:27065:0:(import.c:65:import_set_state_nolock()) ffff9dbf43690800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1784189056.562560:0:27065:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3293 00000100:00080000:2.0:1784189056.562563:0:27065:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 15s 00000100:00080000:2.0:1784189056.562566:0:27065:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff9dbf43690800 using connection 192.168.203.112@tcp/0@lo 00000100:00100000:2.0:1784189056.562577:0:27065:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9dc075f7f800 x1870854458054144/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1784189056.562601:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc080f6bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:bd553d0d-03e2-4233-b06b-b55bbfa2b954:3641:1870854458053120:0@lo:400:kworker.0 00000400:00000100:2.0:1784189056.562642:0:3641:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1870854458053120 offset 0 length 224: 4 00000100:00100000:0.0:1784189056.562644:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784189056.562664:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc05659df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1870854458054016:0@lo:400:kworker.0 00000100:00100000:0.0:1784189056.562678:0:66169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458053376 00000100:00100000:0.0:1784189056.562685:0:66169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458053376 00000100:00100000:2.0:1784189056.562686:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784189056.562708:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1784189056.562713:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc05653a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1870854458053888:0@lo:400:kworker.0 00000100:00100000:2.0:1784189056.562735:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784189056.562761:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc080f68e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3639:1870854458053248:0@lo:38:kworker.0 00000100:00100000:2.0:1784189056.562783:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784189056.562798:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf4367ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3639:1870854458053504:0@lo:38:kworker.0 00000100:00100000:0.0:1784189056.562806:0:66169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458053632 00000100:00100000:0.0:1784189056.562809:0:66169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458053632 00000100:00100000:2.0:1784189056.562816:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784189056.562826:0:66169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1049 00000100:00100000:2.0:1784189056.562829:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf4367f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3639:1870854458053760:0@lo:38:kworker.0 00000100:00100000:0.0:1784189056.562840:0:66169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc081f82a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1870854458053376:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784189056.562848:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784189056.562862:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc075f7f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3639:1870854458054144:0@lo:38:kworker.0 00000100:00100000:2.0:1784189056.562878:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784189056.562905:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458054016 00000100:00100000:2.0:1784189056.562909:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458054016 00000100:00100000:2.0:1784189056.562935:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458053888 00000100:00100000:2.0:1784189056.562938:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458053888 00000100:00100000:2.0:1784189056.562958:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2349 00000100:00100000:2.0:1784189056.562964:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc075f7f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1870854458054016:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784189056.563166:0:66169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc081f82a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1870854458053376:12345-0@lo:400:kworker.0 Request processed in 326us (648us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189056.563168:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc075f7f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1870854458054016:12345-0@lo:400:kworker.0 Request processed in 204us (480us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189056.563174:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2349 00000100:00100000:0.0:1784189056.563174:0:66169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1049 00000100:00100000:0.0:1784189056.563188:0:66169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458053248 00000100:00100000:2.0:1784189056.563189:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2350 00000100:00100000:0.0:1784189056.563191:0:66169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458053248 00000100:00100000:2.0:1784189056.563196:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc075f7c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1870854458053888:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784189056.563200:0:66169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458053504 00000100:00100000:0.0:1784189056.563202:0:66169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458053504 00000100:00100000:0.0:1784189056.563210:0:66169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458054144 00000100:00100000:0.0:1784189056.563212:0:66169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458054144 00000100:00100000:2.0:1784189056.563235:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc075f7c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1870854458053888:12345-0@lo:400:kworker.0 Request processed in 40us (499us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189056.563241:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2350 00000100:00080000:2.0:1784189056.563260:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1784189056.563264:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1784189056.563266:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1784189056.563276:0:66945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1050 00000100:00100000:2.0:1784189056.563289:0:66945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc081f80e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1870854458053632:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784189056.563294:0:66169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1106 00000100:00100000:0.0:1784189056.563298:0:66169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc075f7c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3639:x1870854458053248:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1784189056.563315:0:66169:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1784189056.563334:0:66945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc081f80e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1870854458053632:12345-0@lo:400:kworker.0 Request processed in 31us (674us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189056.563340:0:66945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1050 00000100:00100000:2.0:1784189056.563355:0:66945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1107 00000100:00100000:2.0:1784189056.563359:0:66945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc075f7d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3639:x1870854458053504:12345-0@lo:38:kworker.0 00000100:00100000:0.0:1784189056.563363:0:66169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc075f7c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3639:x1870854458053248:12345-0@lo:38:kworker.0 Request processed in 64us (579us total) trans 0 rc -19/-19 00010000:00020000:2.0:1784189056.563369:0:66945:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1784189056.563369:0:66169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1106 00000100:00100000:0.0:1784189056.563381:0:66169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1108 00000100:00100000:0.0:1784189056.563384:0:66169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc075f7dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3639:x1870854458054144:12345-0@lo:38:kworker.0 00000100:00100000:2.0:1784189056.563389:0:66945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc075f7d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3639:x1870854458053504:12345-0@lo:38:kworker.0 Request processed in 30us (573us total) trans 0 rc -19/-19 00010000:00020000:0.0:1784189056.563393:0:66169:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1784189056.563395:0:66945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1107 00000100:00100000:0.0:1784189056.563412:0:66169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc075f7dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3639:x1870854458054144:12345-0@lo:38:kworker.0 Request processed in 26us (533us total) trans 0 rc -19/-19 00000100:00100000:0.0:1784189056.563474:0:66169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1108 00000100:00100000:2.0:1784189056.563490:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458053760 00000100:00100000:2.0:1784189056.563494:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458053760 00000100:00100000:0.0:1784189056.563510:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf4367d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3643:1870854458053632:0@lo:400:kworker.0 00000100:00100000:2.0:1784189056.563513:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3729 00000100:00100000:2.0:1784189056.563517:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc075f7df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3639:x1870854458053760:12345-0@lo:38:kworker.0 00000100:00100000:0.0:1784189056.563521:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc080f69500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3643:1870854458053376:0@lo:400:kworker.0 00010000:00020000:2.0:1784189056.563526:0:8439:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1784189056.563551:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc075f7df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3639:x1870854458053760:12345-0@lo:38:kworker.0 Request processed in 33us (702us total) trans 0 rc -19/-19 00000100:00100000:2.0:1784189056.563557:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3729 00000100:00080000:2.0:1784189056.563583:0:3639:0:(import.c:65:import_set_state_nolock()) ffff9dbf42271800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1784189056.563593:0:3639:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1784189056.563596:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc080f68e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3639:1870854458053248:0@lo:38:kworker.0 00000100:00080000:2.0:1784189056.563605:0:3639:0:(import.c:65:import_set_state_nolock()) ffff9dbf425f4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1784189056.563608:0:3639:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1784189056.563611:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf4367ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3639:1870854458053504:0@lo:38:kworker.0 00000100:00080000:2.0:1784189056.563617:0:3639:0:(import.c:65:import_set_state_nolock()) ffff9dbf436c4000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1784189056.563620:0:3639:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1784189056.563622:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf4367f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3639:1870854458053760:0@lo:38:kworker.0 00000100:00080000:2.0:1784189056.563628:0:3639:0:(import.c:65:import_set_state_nolock()) ffff9dbf43690800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1784189056.563630:0:3639:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1784189056.563633:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc075f7f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3639:1870854458054144:0@lo:38:kworker.0 00000100:00100000:3.0:1784189056.563783:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc05653a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1870854458053888:0@lo:400:kworker.0 00000100:00100000:3.0:1784189056.563794:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc05659df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1870854458054016:0@lo:400:kworker.0 00010000:00010000:2.0:1784189056.754335:0:26173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000400:00000100:0.0:1784189057.324599:0:3635:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-192.168.203.12@tcp portal 26 match 1870854436244352 offset 0 length 224: 4 00000100:00100000:0.0:1784189057.324681:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1784189057.324718:0:66945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436244480 00000100:00100000:0.0:1784189057.324727:0:66945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436244480 00000100:00100000:0.0:1784189057.324769:0:66945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1109 00000100:00100000:0.0:1784189057.324777:0:66945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc081f80380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2395:x1870854436244480:12345-192.168.203.12@tcp:38:kworker.0 00010000:00020000:0.0:1784189057.324801:0:66945:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.203.12@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1784189057.324858:0:66945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc081f80380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2395:x1870854436244480:12345-192.168.203.12@tcp:38:kworker.0 Request processed in 80us (177us total) trans 0 rc -19/-19 00000100:00100000:0.0:1784189057.324866:0:66945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1109 00000100:00100000:0.0:1784189057.333688:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1784189057.333721:0:66171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436244608 00000100:00100000:0.0:1784189057.333730:0:66171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436244608 00000100:00100000:0.0:1784189057.333789:0:66171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1051 00000100:00100000:0.0:1784189057.333799:0:66171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc081f83800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+6:2396:x1870854436244608:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:0.0:1784189057.333864:0:66171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc081f83800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+6:2396:x1870854436244608:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 66us (185us total) trans 0 rc 0/0 00000100:00100000:0.0:1784189057.333872:0:66171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1051 00000100:00080000:0.0:1784189057.333895:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00000400:3.0:1784189057.584044:0:3641:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1784189041/real 1784189041] req@ffff9dc075663b80 x1870854458048384/t0(0) o400->MGC192.168.203.112@tcp@0@lo:26/25 lens 224/224 e 0 to 1 dl 1784189057 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784189057.584142:0:3641:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ TIMEOUT-NORESEND: req@ffff9dc075663b80 x1870854458048384/t0(0) o400->MGC192.168.203.112@tcp@0@lo:26/25 lens 224/224 e 0 to 1 dl 1784189057 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1784189057.584152:0:3641:0:(import.c:65:import_set_state_nolock()) ffff9dc07110c800 MGS: changing import state from FULL to DISCONN 00000100:02020000:3.0:1784189057.584156:0:3641:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.203.112@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00000001:00100000:1.0:1784189057.588527:0:9506:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of b90fcc1c-0e69-42a4-a116-a71fec7aeb78 00000020:00000080:1.0:1784189057.588673:0:9506:0:(genops.c:906:class_export_put()) final put ffff9dbf43fcc000/b90fcc1c-0e69-42a4-a116-a71fec7aeb78 00000020:00000080:2.0:1784189057.594519:0:63468:0:(genops.c:865:class_export_destroy()) destroying export ffff9dbf43fcc000/b90fcc1c-0e69-42a4-a116-a71fec7aeb78 for lustre-OST0001 00000001:00100000:1.0:1784189057.594659:0:8423:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of b90fcc1c-0e69-42a4-a116-a71fec7aeb78 00000020:00000080:1.0:1784189057.594665:0:8423:0:(genops.c:906:class_export_put()) final put ffff9dbf43fc9000/b90fcc1c-0e69-42a4-a116-a71fec7aeb78 00000020:00000080:2.0:1784189057.597552:0:63468:0:(genops.c:865:class_export_destroy()) destroying export ffff9dbf43fc9000/b90fcc1c-0e69-42a4-a116-a71fec7aeb78 for lustre-OST0000 00000020:00000080:2.0:1784189057.597604:0:63468:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9dbf43fce000 for lustre-OST0001 00000020:00000080:2.0:1784189057.597610:0:63468:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9dbf43fcb000 for lustre-OST0000 00000100:00080000:3.0:1784189057.622706:0:3641:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.203.112@tcp not replayable, auto-deactivating 00000100:00080000:3.0:1784189057.622712:0:3641:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:3.0:1784189057.622721:0:3641:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9dc075663b80 x1870854458048384/t0(0) o400->MGC192.168.203.112@tcp@0@lo:26/25 lens 224/224 e 0 to 1 dl 1784189057 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784189057.622735:0:3641:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9dbf4262f100 x1870854458050304/t0(0) o400->MGC192.168.203.112@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1784189062 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784189057.622792:0:3641:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9dc081f82300 x1870854458051712/t0(0) o400->MGC192.168.203.112@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1784189067 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784189057.622813:0:3641:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9dc080f6bb80 x1870854458053120/t0(0) o400->MGC192.168.203.112@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1784189072 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 10000000:01000000:3.0:1784189057.622823:0:3641:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:3.0:1784189057.622826:0:3641:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:3.0:1784189057.622827:0:3641:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:3.0:1784189057.622829:0:3641:0:(import.c:418:ptlrpc_pinger_force()) MGS: waking up pinger s:DISCONN 00000100:00100000:3.0:1784189057.622872:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc080f6bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:bd553d0d-03e2-4233-b06b-b55bbfa2b954:3641:1870854458053120:0@lo:400:kworker.0 00000100:00100000:3.0:1784189057.622888:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc075663b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:bd553d0d-03e2-4233-b06b-b55bbfa2b954:3641:1870854458048384:0@lo:400:kworker.0 00000100:00080000:2.0:1784189057.623043:0:63468:0:(pinger.c:229:ptlrpc_pinger_process_import()) bd553d0d-03e2-4233-b06b-b55bbfa2b954->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1784189057.623048:0:63468:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:2.0:1784189057.623052:0:63468:0:(import.c:65:import_set_state_nolock()) ffff9dc07110c800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1784189057.623057:0:63468:0:(import.c:510:import_select_connection()) MGC192.168.203.112@tcp: connect to NID 0@lo last attempt 3247 00000100:00080000:2.0:1784189057.623066:0:63468:0:(import.c:624:import_select_connection()) MGC192.168.203.112@tcp: import ffff9dc07110c800 using connection 192.168.203.112@tcp/0@lo 00000100:00100000:2.0:1784189057.623094:0:63468:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9dc075f7f800 x1870854458054272/t0(0) o250->MGC192.168.203.112@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1784189057.623114:0:63468:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1784189057.623123:0:63468:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1784189057.623125:0:63468:0:(import.c:65:import_set_state_nolock()) ffff9dbf42271800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1784189057.623128:0:63468:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3298 00000100:00080000:2.0:1784189057.623131:0:63468:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1784189057.623135:0:63468:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9dbf42271800 using connection 192.168.203.112@tcp/0@lo 00000100:00100000:2.0:1784189057.623148:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc075f7f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:bd553d0d-03e2-4233-b06b-b55bbfa2b954:3639:1870854458054272:0@lo:250:kworker.0 00000400:00000100:2.0:1784189057.623192:0:3639:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1870854458054272 offset 0 length 520: 4 00000100:00100000:2.0:1784189057.623243:0:63468:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9dc075f7fb80 x1870854458054400/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1784189057.623264:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc075f7fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3639:1870854458054400:0@lo:38:kworker.0 00000100:00100000:2.0:1784189057.623294:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784189057.623348:0:66170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458054400 00000100:00100000:2.0:1784189057.623355:0:66170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458054400 00000100:00100000:2.0:1784189057.623390:0:66170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1110 00000100:00100000:2.0:1784189057.623396:0:66170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc075f7ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3639:x1870854458054400:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1784189057.623415:0:66170:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1784189057.623452:0:66170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc075f7ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3639:x1870854458054400:12345-0@lo:38:kworker.0 Request processed in 55us (157us total) trans 0 rc -19/-19 00000100:00100000:2.0:1784189057.623460:0:66170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1110 00000100:00080000:2.0:1784189057.623495:0:3639:0:(import.c:65:import_set_state_nolock()) ffff9dbf42271800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1784189057.623499:0:3639:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1784189057.623503:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc075f7fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3639:1870854458054400:0@lo:38:kworker.0 00000100:00080000:2.0:1784189057.623525:0:63468:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00100000:0.0:1784189057.623631:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf4262f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:bd553d0d-03e2-4233-b06b-b55bbfa2b954:3643:1870854458050304:0@lo:400:kworker.0 00000100:00100000:0.0:1784189057.623646:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1784189057.623652:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc075f7fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3643:1870854458054528:0@lo:400:kworker.0 00000100:00100000:0.0:1784189057.623681:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784189057.623729:0:66169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458054528 00000100:00100000:0.0:1784189057.623734:0:66169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458054528 00000100:00100000:0.0:1784189057.623768:0:66169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1052 00000100:00100000:0.0:1784189057.623775:0:66169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc080f6bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1870854458054528:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784189057.623821:0:66169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc080f6bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1870854458054528:12345-0@lo:400:kworker.0 Request processed in 46us (140us total) trans 0 rc 0/0 00000100:00100000:0.0:1784189057.623835:0:66169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1052 00000100:00100000:0.0:1784189057.623866:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc075f7fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3643:1870854458054528:0@lo:400:kworker.0 00000100:00100000:1.0:1784189057.624038:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc081f82300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bd553d0d-03e2-4233-b06b-b55bbfa2b954:3642:1870854458051712:0@lo:400:kworker.0 00000100:00080000:2.0:1784189057.624097:0:63468:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1784189057.624105:0:63468:0:(import.c:65:import_set_state_nolock()) ffff9dbf425f4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1784189057.624109:0:63468:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3298 00000100:00080000:2.0:1784189057.624111:0:63468:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1784189057.624115:0:63468:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9dbf425f4800 using connection 192.168.203.112@tcp/0@lo 00000100:00100000:0.0:1784189057.624688:0:63468:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9dc080f68e00 x1870854458054656/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1784189057.624806:0:63468:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1784189057.624810:0:63468:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1784189057.624812:0:63468:0:(import.c:65:import_set_state_nolock()) ffff9dbf436c4000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1784189057.624816:0:63468:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3298 00000100:00080000:0.0:1784189057.624819:0:63468:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1784189057.624823:0:63468:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9dbf436c4000 using connection 192.168.203.112@tcp/0@lo 00000100:00100000:0.0:1784189057.624831:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1784189057.624841:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc080f69500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3642:1870854458054784:0@lo:400:kworker.0 00000100:00100000:0.0:1784189057.624883:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784189057.624918:0:68287:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458054784 00000100:00100000:0.0:1784189057.624922:0:68287:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458054784 00000100:00100000:0.0:1784189057.624956:0:68287:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1053 00000100:00100000:0.0:1784189057.624963:0:68287:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf4367f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1870854458054784:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784189057.625002:0:68287:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf4367f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1870854458054784:12345-0@lo:400:kworker.0 Request processed in 40us (119us total) trans 0 rc 0/0 00000100:00100000:0.0:1784189057.625019:0:68287:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1053 00000100:00100000:0.0:1784189057.625051:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc080f69500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3642:1870854458054784:0@lo:400:kworker.0 00000100:00100000:0.0:1784189057.625077:0:63468:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9dbf4367ea00 x1870854458054912/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1784189057.625106:0:63468:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1784189057.625116:0:63468:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1784189057.625118:0:63468:0:(import.c:65:import_set_state_nolock()) ffff9dbf43690800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1784189057.625122:0:63468:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3298 00000100:00080000:0.0:1784189057.625124:0:63468:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1784189057.625128:0:63468:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff9dbf43690800 using connection 192.168.203.112@tcp/0@lo 00000100:00100000:0.0:1784189057.625143:0:63468:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9dc0762d4000 x1870854458055296/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1784189057.625431:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf4367d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1870854458055040:0@lo:400:kworker.0 00000100:00100000:2.0:1784189057.625464:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784189057.625485:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1784189057.625491:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc080f69500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1870854458055168:0@lo:400:kworker.0 00000100:00100000:2.0:1784189057.625510:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784189057.625979:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc080f68e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3639:1870854458054656:0@lo:38:kworker.0 00000100:00100000:2.0:1784189057.626018:0:26223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458055040 00000100:00100000:2.0:1784189057.626024:0:26223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458055040 00000100:00100000:3.0:1784189057.626028:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784189057.626054:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf4367ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3639:1870854458054912:0@lo:38:kworker.0 00000100:00100000:2.0:1784189057.626063:0:26223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458055168 00000100:00100000:2.0:1784189057.626068:0:26223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458055168 00000100:00100000:2.0:1784189057.626090:0:26223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2351 00000100:00100000:2.0:1784189057.626097:0:26223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc075f7f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0001-mdtlov_UUID+5:3640:x1870854458055040:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784189057.626106:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784189057.626139:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc0762d4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3639:1870854458055296:0@lo:38:kworker.0 00000100:00100000:2.0:1784189057.626153:0:26223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc075f7f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0001-mdtlov_UUID+5:3640:x1870854458055040:12345-0@lo:400:kworker.0 Request processed in 55us (687us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189057.626162:0:26223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2351 00000100:00100000:3.0:1784189057.626170:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784189057.626179:0:26223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2352 00000100:00100000:2.0:1784189057.626186:0:26223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc075f7c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0001-mdtlov_UUID+5:3640:x1870854458055168:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784189057.626219:0:23826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458054912 00000100:00100000:2.0:1784189057.626221:0:26223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc075f7c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0001-mdtlov_UUID+5:3640:x1870854458055168:12345-0@lo:400:kworker.0 Request processed in 34us (709us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189057.626224:0:23826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458054912 00000100:00100000:2.0:1784189057.626232:0:26223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2352 00000100:00100000:3.0:1784189057.626255:0:23826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3730 00000100:00100000:3.0:1784189057.626263:0:23826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf4262c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3639:x1870854458054912:12345-0@lo:38:kworker.0 00000100:00100000:2.0:1784189057.626278:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc080f69500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1870854458055168:0@lo:400:kworker.0 00010000:00020000:3.0:1784189057.626282:0:23826:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1784189057.626291:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf4367d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1870854458055040:0@lo:400:kworker.0 00000100:00100000:2.0:1784189057.626335:0:66945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458054656 00000100:00100000:3.0:1784189057.626344:0:23826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf4262c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3639:x1870854458054912:12345-0@lo:38:kworker.0 Request processed in 81us (248us total) trans 0 rc -19/-19 00000100:00100000:2.0:1784189057.626349:0:66945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458054656 00000100:00100000:3.0:1784189057.626353:0:23826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3730 00000100:00100000:3.0:1784189057.626375:0:66169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458055296 00000100:00100000:2.0:1784189057.626381:0:66945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1111 00000100:00100000:3.0:1784189057.626386:0:66169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458055296 00000100:00100000:2.0:1784189057.626390:0:66945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf4262dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3639:x1870854458054656:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1784189057.626402:0:66945:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1784189057.626416:0:66169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1112 00000100:00100000:3.0:1784189057.626423:0:66169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf4262d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3639:x1870854458055296:12345-0@lo:38:kworker.0 00000100:00100000:2.0:1784189057.626433:0:66945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf4262dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3639:x1870854458054656:12345-0@lo:38:kworker.0 Request processed in 43us (406us total) trans 0 rc -19/-19 00010000:00020000:3.0:1784189057.626436:0:66169:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1784189057.626446:0:66945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1111 00000100:00100000:3.0:1784189057.626479:0:66169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf4262d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3639:x1870854458055296:12345-0@lo:38:kworker.0 Request processed in 54us (310us total) trans 0 rc -19/-19 00000100:00100000:3.0:1784189057.626485:0:66169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1112 00000100:00080000:3.0:1784189057.626517:0:3639:0:(import.c:65:import_set_state_nolock()) ffff9dbf425f4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1784189057.626521:0:3639:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1784189057.626524:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc080f68e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3639:1870854458054656:0@lo:38:kworker.0 00000100:00080000:3.0:1784189057.626533:0:3639:0:(import.c:65:import_set_state_nolock()) ffff9dbf436c4000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1784189057.626536:0:3639:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1784189057.626538:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf4367ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3639:1870854458054912:0@lo:38:kworker.0 00000100:00080000:3.0:1784189057.626545:0:3639:0:(import.c:65:import_set_state_nolock()) ffff9dbf43690800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1784189057.626547:0:3639:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1784189057.626550:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc0762d4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3639:1870854458055296:0@lo:38:kworker.0 00010000:00010000:3.0:1784189057.778457:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784189058.349167:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000400:00000100:0.0:1784189058.349206:0:3633:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-192.168.203.12@tcp portal 26 match 1870854436244736 offset 0 length 520: 4 00000100:00100000:0.0:1784189058.349273:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1784189058.354222:0:66171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436244992 00000100:00100000:1.0:1784189058.354236:0:66171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436244992 00000100:00100000:1.0:1784189058.354286:0:66171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436244864 00000100:00100000:1.0:1784189058.354290:0:66171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436244864 00000100:00100000:1.0:1784189058.354339:0:66171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1054 00000100:00100000:1.0:1784189058.354349:0:66171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc0762d7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+6:2398:x1870854436244992:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:2.0:1784189058.354571:0:66170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1113 00000100:00100000:2.0:1784189058.354578:0:66170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc0762d4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2395:x1870854436244864:12345-192.168.203.12@tcp:38:kworker.0 00010000:00020000:2.0:1784189058.354599:0:66170:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.203.12@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1784189058.354676:0:66170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc0762d4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2395:x1870854436244864:12345-192.168.203.12@tcp:38:kworker.0 Request processed in 97us (5402us total) trans 0 rc -19/-19 00000100:00100000:2.0:1784189058.354684:0:66170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1113 00000100:00100000:1.0:1784189058.354913:0:66171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc0762d7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+6:2398:x1870854436244992:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 565us (5755us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189058.354922:0:66171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1054 00000020:01000004:3.0:1784189058.719157:0:87021:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1784189058.719162:0:87021:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds1_flakey 00000020:01000004:3.0:1784189058.719164:0:87021:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:3.0:1784189058.719272:0:87021:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff9dc06b3eb800 00000020:01000004:3.0:1784189058.719287:0:87021:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0000, type=osd-ldiskfs, lsifl=200005, mountfl=0 00000020:01000004:3.0:1784189058.719301:0:87021:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-ldiskfs) 00000020:00000080:3.0:1784189058.719489:0:87021:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff9dc06bb319c0) 00000020:00000080:3.0:1784189058.719510:0:87021:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-ldiskfs with refcount 2 00010000:00010000:2.0:1784189058.800589:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00100000:10000000:1.0:1784189058.867794:0:87021:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:1.0:1784189058.869062:0:87021:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:1.0:1784189058.878369:0:87021:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:2.0:1784189058.879121:0:87021:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/32) registered 00100000:10000000:2.0:1784189058.879372:0:87021:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:2.0:1784189058.879618:0:87021:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/32) registered 00100000:10000000:2.0:1784189058.879953:0:87021:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:2.0:1784189058.880230:0:87021:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/32) registered 00100000:10000000:2.0:1784189058.880499:0:87021:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/32) registered 00100000:10000000:2.0:1784189058.880823:0:87021:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:2.0:1784189058.881832:0:87021:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:2.0:1784189058.882898:0:87021:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/32) registered 00100000:10000000:2.0:1784189058.883214:0:87021:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:2.0:1784189058.883515:0:87021:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x9:0x0] (8/32) registered 00100000:10000000:2.0:1784189058.885578:0:87021:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2f:0x0] (24/16) registered 00100000:10000000:2.0:1784189058.886390:0:87021:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:2.0:1784189058.888941:0:87021:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:2.0:1784189058.889814:0:87021:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1e:0x0] (16/1) registered 00100000:10000000:2.0:1784189058.890192:0:87021:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:2.0:1784189058.890430:0:87021:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:2.0:1784189058.890789:0:87021:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:2.0:1784189058.891013:0:87021:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x32:0x0] (24/16) registered 00100000:10000000:2.0:1784189058.891690:0:87021:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x34:0x0] (24/16) registered 00100000:10000000:2.0:1784189058.892122:0:87021:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:2.0:1784189058.892350:0:87021:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:2.0:1784189058.892557:0:87021:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:2.0:1784189058.893049:0:87021:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:2.0:1784189058.893278:0:87021:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:2.0:1784189058.893575:0:87021:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x20:0x0] (16/1) registered 00100000:10000000:2.0:1784189058.893887:0:87021:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x22:0x0] (16/1) registered 00100000:10000000:2.0:1784189058.894091:0:87021:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:2.0:1784189058.894456:0:87021:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:2.0:1784189058.894803:0:87021:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:2.0:1784189058.895018:0:87021:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:2.0:1784189058.897512:0:87021:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:2.0:1784189058.898105:0:87021:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:2.0:1784189058.898348:0:87021:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1f:0x0] (16/1) registered 00100000:10000000:2.0:1784189058.898678:0:87021:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x21:0x0] (16/1) registered 00100000:10000000:2.0:1784189058.899097:0:87021:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x23:0x0] (16/1) registered 00100000:10000000:2.0:1784189058.899365:0:87021:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x33:0x0] (24/16) registered 00100000:10000000:2.0:1784189058.899620:0:87021:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:2.0:1784189058.899955:0:87021:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x31:0x0] (24/16) registered 00100000:10000000:2.0:1784189058.900228:0:87021:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:3.0:1784189058.900829:0:87021:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x30:0x0] (24/16) registered 00100000:10000000:3.0:1784189058.906289:0:87021:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:3.0:1784189058.906942:0:87021:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:3.0:1784189058.914786:0:87021:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2:0x0] (8/32) registered 00100000:10000000:3.0:1784189058.920083:0:87021:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/32) registered 00100000:10000000:3.0:1784189058.921269:0:87021:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/32) registered 00100000:10000000:3.0:1784189058.922260:0:87021:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/32) registered 00100000:10000000:3.0:1784189058.923031:0:87021:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/32) registered 00100000:10000000:3.0:1784189058.923423:0:87021:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/32) registered 00100000:10000000:3.0:1784189058.923658:0:87021:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/32) registered 00080000:01000000:2.0:1784189058.924667:0:87021:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0000: register osd-ldiskfs tunable parameters 00000020:00000080:2.0:1784189058.924982:0:87021:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:2.0:1784189058.924992:0:87021:0:(osd_handler.c:8929:osd_obd_connect()) connect #0 00000020:00000080:2.0:1784189058.925274:0:87021:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xcc1762b626f8aac3 00000020:01000004:2.0:1784189058.925284:0:87021:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0000 on device /dev/mapper/mds1_flakey 00000020:01000000:2.0:1784189058.925296:0:87021:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:2.0:1784189058.925301:0:87021:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9dc06b3eb800 from MGS 00000020:01000004:2.0:1784189058.925305:0:87021:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:2.0:1784189058.925452:0:87021:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff9dc075478000) 00000020:00000080:2.0:1784189058.925469:0:87021:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mgs with refcount 2 00000020:01000004:2.0:1784189058.925535:0:87021:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9dc06b3eb800 from MGS, refs=2 00080000:01000000:2.0:1784189058.925541:0:87021:0:(osd_handler.c:8929:osd_obd_connect()) connect #1 00000020:00000080:2.0:1784189058.925546:0:87021:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xcc1762b626f8aad1 00010000:00010000:2.0:1784189058.925671:0:87021:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-MGS-3 is initialized 00000040:01000000:2.0:1784189058.930578:0:87021:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 10000000:01000000:2.0:1784189058.931657:0:87025:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:3.0:1784189058.931702:0:87021:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:3.0:1784189058.931738:0:87021:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1784189058.932493:0:87021:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:3.0:1784189058.932741:0:87021:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1784189058.932884:0:87021:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:3.0:1784189058.932890:0:87021:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:2.0:1784189058.935209:0:87021:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:2.0:1784189058.935221:0:87021:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:3.0:1784189058.935759:0:87021:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:3.0:1784189058.935766:0:87021:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:2.0:1784189058.936422:0:87021:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:2.0:1784189058.936446:0:87021:0:(obd_mount.c:392:lustre_start_mgc()) New MGS with live MGC 00000020:01000004:2.0:1784189058.936448:0:87021:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.112@tcp:Set MGC reconnect 2 10000000:01000000:2.0:1784189058.936451:0:87021:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.112@tcp 2/d0:i1:r0:or0:CONNECTING 00000100:00080000:2.0:1784189058.936456:0:87021:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffff9dc07110c800 already not connected (conn 56, was 0): CONNECTING 00000100:00100000:2.0:1784189058.936461:0:87021:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 12s for inflight to error out 00000100:00100000:1.0:1784189059.119669:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc075f7d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1870854458055424:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1784189059.119736:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784189059.119903:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458055424 00000100:00100000:2.0:1784189059.119911:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458055424 00000100:00100000:2.0:1784189059.119977:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1878 00000100:00100000:2.0:1784189059.119988:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc05f02e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1870854458055424:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1784189059.120028:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 213696 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1784189059.120071:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc05f02e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1870854458055424:12345-0@lo:13:osp-pre-0-1.0 Request processed in 85us (334us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189059.120093:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1878 00000100:00080000:1.0:1784189059.120234:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1784189059.120266:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc075f7d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1870854458055424:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1784189059.120503:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc0762d4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1870854458055552:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1784189059.120534:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784189059.121247:0:9466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458055552 00000100:00100000:0.0:1784189059.121254:0:9466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458055552 00000100:00100000:0.0:1784189059.121303:0:9466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1879 00000100:00100000:0.0:1784189059.121312:0:9466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc05f02dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1870854458055552:12345-0@lo:13:osp-pre-1-1.0 00000100:00080000:1.0:1784189059.121403:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00000024:3.0:1784189059.121563:0:9466:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 213696 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1784189059.121620:0:9466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc05f02dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1870854458055552:12345-0@lo:13:osp-pre-1-1.0 Request processed in 308us (1085us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189059.121628:0:9466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1879 00000100:00100000:1.0:1784189059.121704:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc0762d4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1870854458055552:0@lo:13:osp-pre-1-1.0 00010000:00010000:2.0:1784189059.825295:0:7454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784189060.847527:0:26173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784189061.873987:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1784189062.703636:0:27065:0:(pinger.c:229:ptlrpc_pinger_process_import()) bd553d0d-03e2-4233-b06b-b55bbfa2b954->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1784189062.703645:0:27065:0:(pinger.c:247:ptlrpc_pinger_process_import()) bd553d0d-03e2-4233-b06b-b55bbfa2b954->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1784189062.703648:0:27065:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1784189062.703652:0:27065:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1784189062.703655:0:27065:0:(import.c:65:import_set_state_nolock()) ffff9dbf42271800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1784189062.703662:0:27065:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3299 00000100:00080000:0.0:1784189062.703667:0:27065:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1784189062.703675:0:27065:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9dbf42271800 using connection 192.168.203.112@tcp/0@lo 00000100:00100000:0.0:1784189062.703710:0:27065:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9dc0762d5c00 x1870854458055680/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1784189062.703770:0:27065:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1784189062.703788:0:27065:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1784189062.703790:0:27065:0:(import.c:65:import_set_state_nolock()) ffff9dbf425f4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1784189062.703794:0:27065:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3299 00000100:00080000:0.0:1784189062.703796:0:27065:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1784189062.703800:0:27065:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9dbf425f4800 using connection 192.168.203.112@tcp/0@lo 00000100:00100000:0.0:1784189062.703813:0:27065:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9dc0762d6680 x1870854458055936/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1784189062.703830:0:27065:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1784189062.703833:0:27065:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1784189062.703834:0:27065:0:(import.c:65:import_set_state_nolock()) ffff9dbf436c4000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1784189062.703837:0:27065:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3299 00000100:00080000:0.0:1784189062.703839:0:27065:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1784189062.703844:0:27065:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9dbf436c4000 using connection 192.168.203.112@tcp/0@lo 00000100:00100000:0.0:1784189062.703856:0:27065:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9dc0762d5500 x1870854458056192/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1784189062.703892:0:27065:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00100000:1.0:1784189062.703893:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc0762d5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3639:1870854458055680:0@lo:38:kworker.0 00000100:00080000:0.0:1784189062.703899:0:27065:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1784189062.703903:0:27065:0:(import.c:65:import_set_state_nolock()) ffff9dbf43690800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1784189062.703907:0:27065:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3299 00000100:00080000:0.0:1784189062.703909:0:27065:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1784189062.703912:0:27065:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff9dbf43690800 using connection 192.168.203.112@tcp/0@lo 00000100:00100000:0.0:1784189062.703925:0:27065:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9dc0762d4000 x1870854458056576/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1784189062.703964:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784189062.704004:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc0762d6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3639:1870854458055936:0@lo:38:kworker.0 00000100:00100000:1.0:1784189062.704040:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784189062.704056:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc0762d4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1870854458056448:0@lo:400:kworker.0 00000100:00100000:1.0:1784189062.704066:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc0762d5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3639:1870854458056192:0@lo:38:kworker.0 00000100:00100000:1.0:1784189062.704113:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784189062.704117:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784189062.704144:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1784189062.704149:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc0762d4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3639:1870854458056576:0@lo:38:kworker.0 00000100:00100000:0.0:1784189062.704154:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc0762d5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1870854458056320:0@lo:400:kworker.0 00000100:00100000:1.0:1784189062.704183:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784189062.704193:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784189062.704226:0:66171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458055680 00000100:00100000:1.0:1784189062.704234:0:66171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458055680 00000100:00100000:0.0:1784189062.704236:0:26171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458056448 00000100:00100000:0.0:1784189062.704242:0:26171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458056448 00000100:00100000:1.0:1784189062.704263:0:66171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458055936 00000100:00100000:1.0:1784189062.704268:0:66171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458055936 00000100:00100000:0.0:1784189062.704285:0:26171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458056320 00000100:00100000:0.0:1784189062.704290:0:26171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458056320 00000100:00100000:1.0:1784189062.704292:0:66171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458056576 00000100:00100000:1.0:1784189062.704297:0:66171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458056576 00000100:00100000:1.0:1784189062.704316:0:66171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1114 00000100:00100000:0.0:1784189062.704346:0:26171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2353 00000100:00100000:1.0:1784189062.704348:0:66171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc05f02fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3639:x1870854458055680:12345-0@lo:38:kworker.0 00000100:00100000:0.0:1784189062.704358:0:26171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf44faea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0001-mdtlov_UUID+5:3643:x1870854458056448:12345-0@lo:400:kworker.0 00010000:00020000:1.0:1784189062.704370:0:66171:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1784189062.704417:0:26171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf44faea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0001-mdtlov_UUID+5:3643:x1870854458056448:12345-0@lo:400:kworker.0 Request processed in 62us (305us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189062.704424:0:66171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc05f02fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3639:x1870854458055680:12345-0@lo:38:kworker.0 Request processed in 75us (458us total) trans 0 rc -19/-19 00000100:00100000:0.0:1784189062.704428:0:26171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2353 00000100:00100000:1.0:1784189062.704439:0:66171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1114 00000100:00100000:0.0:1784189062.704453:0:26171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2354 00000100:00100000:1.0:1784189062.704464:0:66171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1115 00000100:00100000:0.0:1784189062.704464:0:26171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf44fae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0001-mdtlov_UUID+5:3643:x1870854458056320:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784189062.704475:0:66171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc05f02d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3639:x1870854458055936:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1784189062.704486:0:66171:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1784189062.704496:0:26171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf44fae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0001-mdtlov_UUID+5:3643:x1870854458056320:12345-0@lo:400:kworker.0 Request processed in 35us (303us total) trans 0 rc 0/0 00000100:00100000:0.0:1784189062.704503:0:26171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2354 00000100:00100000:1.0:1784189062.704521:0:66171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc05f02d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3639:x1870854458055936:12345-0@lo:38:kworker.0 Request processed in 46us (480us total) trans 0 rc -19/-19 00000100:00100000:1.0:1784189062.704528:0:66171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1115 00000100:00100000:1.0:1784189062.704542:0:66171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1116 00000100:00100000:0.0:1784189062.704546:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc0762d5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1870854458056320:0@lo:400:kworker.0 00000100:00100000:1.0:1784189062.704550:0:66171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc05f02c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3639:x1870854458056576:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1784189062.704562:0:66171:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1784189062.704564:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc0762d4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1870854458056448:0@lo:400:kworker.0 00000100:00100000:1.0:1784189062.704592:0:66171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc05f02c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3639:x1870854458056576:12345-0@lo:38:kworker.0 Request processed in 41us (408us total) trans 0 rc -19/-19 00000100:00080000:0.0:1784189062.704605:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1784189062.704606:0:66171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1116 00000100:00080000:0.0:1784189062.704613:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1784189062.704640:0:3639:0:(import.c:65:import_set_state_nolock()) ffff9dbf43690800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1784189062.704645:0:3639:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1784189062.704648:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc0762d4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3639:1870854458056576:0@lo:38:kworker.0 00000100:00080000:0.0:1784189062.704656:0:3639:0:(import.c:65:import_set_state_nolock()) ffff9dbf42271800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1784189062.704665:0:3639:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1784189062.704668:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc0762d5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3639:1870854458055680:0@lo:38:kworker.0 00000100:00080000:0.0:1784189062.704678:0:3639:0:(import.c:65:import_set_state_nolock()) ffff9dbf425f4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1784189062.704681:0:3639:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1784189062.704683:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc0762d6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3639:1870854458055936:0@lo:38:kworker.0 00000100:00100000:3.0:1784189062.704856:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc0762d4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3641:1870854458056064:0@lo:400:kworker.0 00000100:00100000:3.0:1784189062.704889:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784189062.704914:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1784189062.704920:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc0762d7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3641:1870854458055808:0@lo:400:kworker.0 00000100:00100000:3.0:1784189062.704942:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784189062.704990:0:68287:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458056064 00000100:00100000:3.0:1784189062.704994:0:68287:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458056064 00000100:00100000:3.0:1784189062.705020:0:68287:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458055808 00000100:00100000:3.0:1784189062.705028:0:68287:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458055808 00000100:00100000:3.0:1784189062.705047:0:68287:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1055 00000100:00100000:3.0:1784189062.705053:0:68287:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf4262ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1870854458056064:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784189062.705089:0:68287:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf4262ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1870854458056064:12345-0@lo:400:kworker.0 Request processed in 35us (199us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189062.705095:0:68287:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1055 00000100:00100000:3.0:1784189062.705108:0:68287:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1056 00000100:00100000:3.0:1784189062.705114:0:68287:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf4262ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1870854458055808:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784189062.705138:0:68287:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf4262ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1870854458055808:12345-0@lo:400:kworker.0 Request processed in 25us (195us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189062.705144:0:68287:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1056 00000100:00100000:3.0:1784189062.705176:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc0762d7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3641:1870854458055808:0@lo:400:kworker.0 00000100:00100000:3.0:1784189062.705186:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc0762d4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3641:1870854458056064:0@lo:400:kworker.0 00000100:00100000:2.0:1784189062.705816:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458056192 00000100:00100000:2.0:1784189062.705824:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458056192 00000100:00100000:2.0:1784189062.705862:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3731 00000100:00100000:2.0:1784189062.705867:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc05f02f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3639:x1870854458056192:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1784189062.705881:0:8439:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1784189062.705929:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc05f02f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3639:x1870854458056192:12345-0@lo:38:kworker.0 Request processed in 61us (1818us total) trans 0 rc -19/-19 00000100:00100000:2.0:1784189062.705935:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3731 00000100:00080000:2.0:1784189062.705987:0:3639:0:(import.c:65:import_set_state_nolock()) ffff9dbf436c4000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1784189062.705991:0:3639:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1784189062.705994:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc0762d5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3639:1870854458056192:0@lo:38:kworker.0 00000100:00080000:0.0:1784189062.707525:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:2.0:1784189062.895586:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784189063.466020:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1784189063.466075:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1784189063.466256:0:68287:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436245248 00000100:00100000:3.0:1784189063.466266:0:68287:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436245248 00000100:00100000:3.0:1784189063.466363:0:68287:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436245120 00000100:00100000:3.0:1784189063.466368:0:68287:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436245120 00000100:00100000:3.0:1784189063.466388:0:68287:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1057 00000100:00100000:3.0:1784189063.466399:0:68287:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf44fac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+6:2399:x1870854436245248:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:3.0:1784189063.466468:0:68287:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf44fac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+6:2399:x1870854436245248:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 72us (459us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189063.466476:0:68287:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1057 00000100:00100000:0.0:1784189063.466580:0:66169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1117 00000100:00100000:0.0:1784189063.466586:0:66169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf44fac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2395:x1870854436245120:12345-192.168.203.12@tcp:38:kworker.0 00010000:00020000:0.0:1784189063.466607:0:66169:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.203.12@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1784189063.466637:0:66169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf44fac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2395:x1870854436245120:12345-192.168.203.12@tcp:38:kworker.0 Request processed in 50us (562us total) trans 0 rc -19/-19 00000100:00100000:0.0:1784189063.466644:0:66169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1117 00000100:00080000:0.0:1784189063.466662:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:2.0:1784189063.922282:0:7454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784189064.239688:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1784189064.239712:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf44faca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1870854458056704:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1784189064.239777:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784189064.239922:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458056704 00000100:00100000:3.0:1784189064.239930:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458056704 00000100:00100000:3.0:1784189064.240003:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1880 00000100:00100000:3.0:1784189064.240013:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf44fad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1870854458056704:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1784189064.240056:0:8432:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 213696 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1784189064.240104:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf44fad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1870854458056704:12345-0@lo:13:osp-pre-1-1.0 Request processed in 92us (325us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189064.240112:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1880 00000100:00100000:0.0:1784189064.240127:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf44faca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1870854458056704:0@lo:13:osp-pre-1-1.0 00000100:00080000:1.0:1784189064.240182:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1784189064.240389:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc075f7d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1870854458056832:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1784189064.240418:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784189064.240490:0:9466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458056832 00000100:00100000:3.0:1784189064.240496:0:9466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458056832 00000100:00100000:3.0:1784189064.240561:0:9466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1881 00000100:00100000:3.0:1784189064.240570:0:9466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf44faca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1870854458056832:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1784189064.240587:0:9466:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 213696 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1784189064.240628:0:9466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf44faca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1870854458056832:12345-0@lo:13:osp-pre-0-1.0 Request processed in 60us (210us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189064.240635:0:9466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1881 00000100:00080000:1.0:1784189064.240692:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1784189064.240846:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc075f7d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1870854458056832:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1784189064.943904:0:26173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784189065.968589:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784189066.991587:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784189067.823525:0:3639:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1784189057/real 1784189057] req@ffff9dc075f7f800 x1870854458054272/t0(0) o250->MGC192.168.203.112@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1784189067 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784189067.823562:0:3639:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9dc075f7f800 x1870854458054272/t0(0) o250->MGC192.168.203.112@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1784189067 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1784189067.823585:0:3639:0:(import.c:65:import_set_state_nolock()) ffff9dc07110c800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1784189067.823610:0:3639:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:2.0:1784189067.823645:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc075f7f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:bd553d0d-03e2-4233-b06b-b55bbfa2b954:3639:1870854458054272:0@lo:250:kworker.0 10000000:01000000:0.0:1784189067.823804:0:87021:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00010000:00010000:0.0:1784189067.823838:0:87021:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.112@tcp lock: ffff9dc05ec0c600/0xcc1762b626f8a720 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0xcc1762b626f8a727 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1784189067.823860:0:63468:0:(pinger.c:229:ptlrpc_pinger_process_import()) bd553d0d-03e2-4233-b06b-b55bbfa2b954->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 10000000:00010000:0.0:1784189067.823861:0:87021:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.112@tcp lock: ffff9dc05ec0c600/0xcc1762b626f8a720 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0xcc1762b626f8a727 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1784189067.823876:0:63468:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 10000000:01000000:0.0:1784189067.823880:0:87021:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00000100:00080000:3.0:1784189067.823883:0:63468:0:(import.c:65:import_set_state_nolock()) ffff9dc07110c800 MGS: changing import state from DISCONN to CONNECTING 00010000:00010000:0.0:1784189067.823905:0:87021:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1784189067.823917:0:87021:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.112@tcp lock: ffff9dc05ec0c600/0xcc1762b626f8a720 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0xcc1762b626f8a727 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189067.823946:0:87021:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.112@tcp lock: ffff9dc0755a4000/0xcc1762b626f8a686 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x110e400000000 nid: local remote: 0xcc1762b626f8a68d expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1784189067.823952:0:87021:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.112@tcp lock: ffff9dc0755a4000/0xcc1762b626f8a686 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x110f400000000 nid: local remote: 0xcc1762b626f8a68d expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784189067.823957:0:87021:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1784189067.823961:0:87021:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1784189067.823965:0:87021:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.112@tcp lock: ffff9dc0755a4000/0xcc1762b626f8a686 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x590f400000000 nid: local remote: 0xcc1762b626f8a68d expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1784189067.823968:0:63468:0:(import.c:510:import_select_connection()) MGC192.168.203.112@tcp: connect to NID 0@lo last attempt 3299 00000100:00080000:3.0:1784189067.823980:0:63468:0:(import.c:589:import_select_connection()) MGC192.168.203.112@tcp: tried all connections, increasing latency to 5s 00010000:00010000:0.0:1784189067.823985:0:87021:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.112@tcp lock: ffff9dc042d67000/0xcc1762b626f8a6a2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x110e400000000 nid: local remote: 0xcc1762b626f8a6a9 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1784189067.823992:0:63468:0:(import.c:624:import_select_connection()) MGC192.168.203.112@tcp: import ffff9dc07110c800 using connection 192.168.203.112@tcp/0@lo 10000000:00010000:0.0:1784189067.823998:0:87021:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.112@tcp lock: ffff9dc042d67000/0xcc1762b626f8a6a2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x110f400000000 nid: local remote: 0xcc1762b626f8a6a9 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784189067.824006:0:87021:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1784189067.824010:0:87021:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1784189067.824013:0:87021:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.112@tcp lock: ffff9dc042d67000/0xcc1762b626f8a6a2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x590f400000000 nid: local remote: 0xcc1762b626f8a6a9 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189067.824035:0:87021:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.112@tcp lock: ffff9dc042d66000/0xcc1762b626f8a6cc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x110e400000000 nid: local remote: 0xcc1762b626f8a6d3 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1784189067.824041:0:87021:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.112@tcp lock: ffff9dc042d66000/0xcc1762b626f8a6cc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x110f400000000 nid: local remote: 0xcc1762b626f8a6d3 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784189067.824046:0:87021:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:3.0:1784189067.824053:0:63468:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9dbf4262f100 x1870854458056960/t0(0) o250->MGC192.168.203.112@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00010000:00010000:0.0:1784189067.824064:0:87021:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1784189067.824070:0:87021:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.112@tcp lock: ffff9dc042d66000/0xcc1762b626f8a6cc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x590f400000000 nid: local remote: 0xcc1762b626f8a6d3 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189067.824080:0:87021:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.112@tcp lock: ffff9dc042d66800/0xcc1762b626f8a6da lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x110e400000000 nid: local remote: 0xcc1762b626f8a6e1 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1784189067.824086:0:87021:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.112@tcp lock: ffff9dc042d66800/0xcc1762b626f8a6da lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x110f400000000 nid: local remote: 0xcc1762b626f8a6e1 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784189067.824091:0:87021:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1784189067.824094:0:87021:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1784189067.824098:0:87021:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.112@tcp lock: ffff9dc042d66800/0xcc1762b626f8a6da lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x590f400000000 nid: local remote: 0xcc1762b626f8a6e1 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189067.824106:0:87021:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.112@tcp lock: ffff9dc05ec0c000/0xcc1762b626f8a6f6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x110e400000000 nid: local remote: 0xcc1762b626f8a6fd expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1784189067.824111:0:87021:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.112@tcp lock: ffff9dc05ec0c000/0xcc1762b626f8a6f6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x110f400000000 nid: local remote: 0xcc1762b626f8a6fd expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784189067.824126:0:87021:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1784189067.824138:0:87021:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1784189067.824144:0:87021:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.112@tcp lock: ffff9dc05ec0c000/0xcc1762b626f8a6f6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x590f400000000 nid: local remote: 0xcc1762b626f8a6fd expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189067.824155:0:87021:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.112@tcp lock: ffff9dc0755a5a00/0xcc1762b626f8a704 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x110e400000000 nid: local remote: 0xcc1762b626f8a70b expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1784189067.824161:0:87021:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.112@tcp lock: ffff9dc0755a5a00/0xcc1762b626f8a704 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x110f400000000 nid: local remote: 0xcc1762b626f8a70b expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784189067.824166:0:87021:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1784189067.824179:0:87021:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1784189067.824183:0:87021:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.112@tcp lock: ffff9dc0755a5a00/0xcc1762b626f8a704 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x590f400000000 nid: local remote: 0xcc1762b626f8a70b expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189067.824192:0:87021:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.112@tcp lock: ffff9dc042d67c00/0xcc1762b626f8a72e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0xcc1762b626f8a735 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1784189067.824464:0:87021:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.112@tcp lock: ffff9dc042d67c00/0xcc1762b626f8a72e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0xcc1762b626f8a735 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784189067.824469:0:87021:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1784189067.824481:0:87021:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1784189067.824486:0:87021:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.112@tcp lock: ffff9dc042d67c00/0xcc1762b626f8a72e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0xcc1762b626f8a735 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189067.824499:0:87021:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.112@tcp lock: ffff9dc070147a00/0xcc1762b626f8a694 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0xcc1762b626f8a69b expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1784189067.824506:0:87021:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.112@tcp lock: ffff9dc070147a00/0xcc1762b626f8a694 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0xcc1762b626f8a69b expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784189067.824523:0:87021:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1784189067.824538:0:87021:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1784189067.824543:0:87021:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.112@tcp lock: ffff9dc070147a00/0xcc1762b626f8a694 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0xcc1762b626f8a69b expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189067.824557:0:87021:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.112@tcp lock: ffff9dc05ec0da00/0xcc1762b626f8a6b0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0xcc1762b626f8a6b7 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1784189067.824562:0:87021:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.112@tcp lock: ffff9dc05ec0da00/0xcc1762b626f8a6b0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0xcc1762b626f8a6b7 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784189067.824567:0:87021:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 00010000:00010000:0.0:1784189067.824570:0:87021:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1784189067.824573:0:87021:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.112@tcp lock: ffff9dc05ec0da00/0xcc1762b626f8a6b0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0xcc1762b626f8a6b7 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189067.824585:0:87021:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.112@tcp lock: ffff9dc05ec0ce00/0xcc1762b626f8a6be lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x110e400000000 nid: local remote: 0xcc1762b626f8a6c5 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1784189067.824593:0:87021:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.112@tcp lock: ffff9dc05ec0ce00/0xcc1762b626f8a6be lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x110f400000000 nid: local remote: 0xcc1762b626f8a6c5 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784189067.824598:0:87021:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1784189067.824835:0:87021:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1784189067.824841:0:87021:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.112@tcp lock: ffff9dc05ec0ce00/0xcc1762b626f8a6be lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x590f400000000 nid: local remote: 0xcc1762b626f8a6c5 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189067.824852:0:87021:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.112@tcp lock: ffff9dc05ec0c800/0xcc1762b626f8a6e8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x110e400000000 nid: local remote: 0xcc1762b626f8a6ef expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1784189067.824870:0:87021:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.112@tcp lock: ffff9dc05ec0c800/0xcc1762b626f8a6e8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x110f400000000 nid: local remote: 0xcc1762b626f8a6ef expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784189067.824875:0:87021:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00000100:00080000:3.0:1784189067.826082:0:63468:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1784189067.826090:0:63468:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1784189067.826093:0:63468:0:(import.c:65:import_set_state_nolock()) ffff9dbf42271800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1784189067.826101:0:63468:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3304 00000100:00080000:3.0:1784189067.826106:0:63468:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1784189067.826132:0:63468:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9dbf42271800 using connection 192.168.203.112@tcp/0@lo 00000100:00100000:3.0:1784189067.826175:0:63468:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9dbf4262ea00 x1870854458057088/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1784189067.826225:0:63468:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1784189067.826229:0:63468:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1784189067.826230:0:63468:0:(import.c:65:import_set_state_nolock()) ffff9dbf425f4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1784189067.826234:0:63468:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3304 00000100:00080000:3.0:1784189067.826236:0:63468:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1784189067.826241:0:63468:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9dbf425f4800 using connection 192.168.203.112@tcp/0@lo 00000100:00100000:3.0:1784189067.826253:0:63468:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9dbf4262d180 x1870854458057344/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1784189067.826274:0:63468:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1784189067.826277:0:63468:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1784189067.826279:0:63468:0:(import.c:65:import_set_state_nolock()) ffff9dbf436c4000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1784189067.826282:0:63468:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3304 00000100:00080000:3.0:1784189067.826285:0:63468:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1784189067.826290:0:63468:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9dbf436c4000 using connection 192.168.203.112@tcp/0@lo 00000100:00100000:3.0:1784189067.826302:0:63468:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9dbf4262d880 x1870854458057600/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1784189067.826358:0:63468:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1784189067.826362:0:63468:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1784189067.826364:0:63468:0:(import.c:65:import_set_state_nolock()) ffff9dbf43690800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1784189067.826368:0:63468:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3304 00000100:00080000:3.0:1784189067.826371:0:63468:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1784189067.826382:0:63468:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff9dbf43690800 using connection 192.168.203.112@tcp/0@lo 00000100:00100000:3.0:1784189067.826396:0:63468:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9dbf4262fb80 x1870854458057984/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1784189067.826443:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf4262e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3642:1870854458057216:0@lo:400:kworker.0 00000100:00100000:3.0:1784189067.826534:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784189067.826586:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1784189067.826593:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf4262e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3642:1870854458057472:0@lo:400:kworker.0 00000100:00100000:3.0:1784189067.826619:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784189067.826647:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf4262f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1870854458057728:0@lo:400:kworker.0 00000100:00100000:3.0:1784189067.826679:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784189067.826700:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1784189067.826706:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf4262c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1870854458057856:0@lo:400:kworker.0 00000100:00100000:3.0:1784189067.826729:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784189067.826766:0:66169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458057216 00000100:00100000:3.0:1784189067.826775:0:66169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458057216 00000100:00100000:3.0:1784189067.826843:0:66169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458057472 00000100:00100000:3.0:1784189067.826847:0:66169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458057472 00000100:00100000:3.0:1784189067.826877:0:66169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1058 00000100:00100000:3.0:1784189067.826887:0:66169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc05659df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1870854458057216:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784189067.827113:0:14684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458057728 00000100:00100000:2.0:1784189067.827119:0:14684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458057728 00000100:00100000:2.0:1784189067.827152:0:14684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458057856 00000100:00100000:2.0:1784189067.827155:0:14684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458057856 00000100:00100000:2.0:1784189067.827175:0:14684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2355 00000100:00100000:2.0:1784189067.827182:0:14684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc06bbf3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3640:x1870854458057728:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784189067.827251:0:14684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc06bbf3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3640:x1870854458057728:12345-0@lo:400:kworker.0 Request processed in 69us (571us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189067.827260:0:14684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2355 00000100:00100000:2.0:1784189067.827279:0:14684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2356 00000100:00100000:2.0:1784189067.827285:0:14684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc06bbf2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3640:x1870854458057856:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784189067.827313:0:14684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc06bbf2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3640:x1870854458057856:12345-0@lo:400:kworker.0 Request processed in 28us (583us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189067.827346:0:14684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2356 00000100:00100000:2.0:1784189067.827399:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf4262c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1870854458057856:0@lo:400:kworker.0 00000100:00100000:2.0:1784189067.827410:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf4262f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1870854458057728:0@lo:400:kworker.0 00000100:00020000:2.0:1784189067.827444:0:3639:0:(client.c:1391:ptlrpc_import_delay_req()) @@@ invalidate in flight req@ffff9dbf4262f100 x1870854458056960/t0(0) o250->MGC192.168.203.112@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl Rpc:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784189067.827884:0:66171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1059 00000100:00100000:1.0:1784189067.827908:0:66171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc05653a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1870854458057472:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784189067.828011:0:66171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc05653a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1870854458057472:12345-0@lo:400:kworker.0 Request processed in 114us (1390us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189067.828019:0:66171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1059 00000100:00100000:1.0:1784189067.828072:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf4262e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3642:1870854458057472:0@lo:400:kworker.0 00000100:00080000:1.0:1784189067.828127:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1784189067.828133:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1784189067.828135:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:0.0:1784189067.830092:0:87021:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1784189067.830109:0:87021:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.112@tcp lock: ffff9dc05ec0c800/0xcc1762b626f8a6e8 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x590f400000000 nid: local remote: 0xcc1762b626f8a6ef expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189067.830133:0:87021:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.112@tcp lock: ffff9dc042d67800/0xcc1762b626f8a712 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0xcc1762b626f8a719 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1784189067.830141:0:87021:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.112@tcp lock: ffff9dc042d67800/0xcc1762b626f8a712 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0xcc1762b626f8a719 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784189067.830147:0:87021:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1784189067.830159:0:87021:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1784189067.830163:0:87021:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.112@tcp lock: ffff9dc042d67800/0xcc1762b626f8a712 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0xcc1762b626f8a719 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784189067.831842:0:66169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc05659df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1870854458057216:12345-0@lo:400:kworker.0 Request processed in 4945us (5297us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189067.831859:0:66169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1058 00000100:00100000:1.0:1784189067.836663:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf4262e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3642:1870854458057216:0@lo:400:kworker.0 00000100:00080000:2.0:1784189067.848821:0:3639:0:(import.c:65:import_set_state_nolock()) ffff9dc07110c800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1784189067.848822:0:87021:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffff9dc07110c800 already not connected (conn 57, was 0): CONNECTING 00000100:00080000:2.0:1784189067.848879:0:3639:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-5) 00000100:00100000:2.0:1784189067.848890:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf4262f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:bd553d0d-03e2-4233-b06b-b55bbfa2b954:0:1870854458056960:0@lo:250:kworker.0 00000100:00100000:2.0:1784189067.848926:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf4262ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3639:1870854458057088:0@lo:38:kworker.0 00000100:00080000:3.0:1784189067.849182:0:63468:0:(pinger.c:229:ptlrpc_pinger_process_import()) bd553d0d-03e2-4233-b06b-b55bbfa2b954->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1784189067.849189:0:63468:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1784189067.849192:0:63468:0:(import.c:65:import_set_state_nolock()) ffff9dc07110c800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1784189067.849199:0:63468:0:(import.c:510:import_select_connection()) MGC192.168.203.112@tcp: connect to NID 0@lo last attempt 3310 00000100:00080000:3.0:1784189067.849226:0:63468:0:(import.c:589:import_select_connection()) MGC192.168.203.112@tcp: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1784189067.849235:0:63468:0:(import.c:624:import_select_connection()) MGC192.168.203.112@tcp: import ffff9dc07110c800 using connection 192.168.203.112@tcp/0@lo 00000100:00100000:3.0:1784189067.849277:0:63468:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9dc06bbf0a80 x1870854458058112/t0(0) o250->MGC192.168.203.112@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1784189067.849676:0:87021:0:(recover.c:337:ptlrpc_recover_import()) MGS: recovery started, waiting 20 seconds 00000100:00100000:2.0:1784189067.849693:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784189067.849758:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf4262d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3639:1870854458057344:0@lo:38:kworker.0 00000100:00100000:2.0:1784189067.849808:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784189067.849888:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf4262d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3639:1870854458057600:0@lo:38:kworker.0 00000100:00100000:2.0:1784189067.849920:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784189067.849954:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf4262fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3639:1870854458057984:0@lo:38:kworker.0 00000100:00100000:2.0:1784189067.849980:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784189067.850811:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc06bbf0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:bd553d0d-03e2-4233-b06b-b55bbfa2b954:3639:1870854458058112:0@lo:250:kworker.0 00000100:00100000:2.0:1784189067.850856:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784189067.850898:0:66171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458057088 00000100:00100000:0.0:1784189067.850909:0:66171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458057088 00000100:00100000:2.0:1784189067.850922:0:23826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458057600 00000100:00100000:2.0:1784189067.850925:0:23826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458057600 00000100:00100000:2.0:1784189067.850976:0:23826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3732 00000100:00100000:2.0:1784189067.850984:0:23826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc075f7fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3639:x1870854458057600:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1784189067.851010:0:23826:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1784189067.851058:0:66945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458057344 00000100:00100000:1.0:1784189067.851064:0:66945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458057344 00000100:00100000:1.0:1784189067.851102:0:66945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458057984 00000100:00100000:1.0:1784189067.851106:0:66945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458057984 00000100:00100000:1.0:1784189067.851127:0:66945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1118 00000100:00100000:1.0:1784189067.851131:0:66945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc075f7d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3639:x1870854458057344:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1784189067.851141:0:66945:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1784189067.851257:0:68287:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1119 00000100:00100000:0.0:1784189067.851262:0:68287:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf4262e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3639:x1870854458057984:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1784189067.851272:0:68287:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1784189067.851549:0:23826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc075f7fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3639:x1870854458057600:12345-0@lo:38:kworker.0 Request processed in 563us (1625us total) trans 0 rc -19/-19 00000100:00100000:1.0:1784189067.851549:0:66945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc075f7d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3639:x1870854458057344:12345-0@lo:38:kworker.0 Request processed in 414us (1738us total) trans 0 rc -19/-19 00000100:00100000:2.0:1784189067.851558:0:23826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3732 00000100:00100000:1.0:1784189067.851558:0:66945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1118 00000100:00100000:1.0:1784189067.851595:0:66171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1120 00000100:00100000:1.0:1784189067.851600:0:66171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc075f7f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3639:x1870854458057088:12345-0@lo:38:kworker.0 00000100:00080000:2.0:1784189067.851609:0:3639:0:(import.c:65:import_set_state_nolock()) ffff9dbf425f4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00010000:00020000:1.0:1784189067.851610:0:66171:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00080000:2.0:1784189067.851614:0:3639:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1784189067.851618:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf4262d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3639:1870854458057344:0@lo:38:kworker.0 00000100:00080000:2.0:1784189067.851628:0:3639:0:(import.c:65:import_set_state_nolock()) ffff9dbf436c4000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1784189067.851632:0:3639:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1784189067.851635:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf4262d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3639:1870854458057600:0@lo:38:kworker.0 00000100:00100000:1.0:1784189067.851649:0:66171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc075f7f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3639:x1870854458057088:12345-0@lo:38:kworker.0 Request processed in 48us (1961us total) trans 0 rc -19/-19 00000100:00100000:1.0:1784189067.851656:0:66171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1120 00000100:00080000:2.0:1784189067.851658:0:3639:0:(import.c:65:import_set_state_nolock()) ffff9dbf42271800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1784189067.851662:0:3639:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1784189067.851664:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf4262ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3639:1870854458057088:0@lo:38:kworker.0 00000100:00100000:2.0:1784189067.851705:0:87026:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458058112 00000100:00100000:2.0:1784189067.851709:0:87026:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458058112 00000100:00100000:2.0:1784189067.851890:0:87026:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1784189067.851896:0:87026:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc0762ab450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3639:x1870854458058112:12345-0@lo:250:kworker.0 00010000:00080000:2.0:1784189067.851915:0:87026:0:(ldlm_lib.c:1445:target_handle_connect()) MGS: connection from bd553d0d-03e2-4233-b06b-b55bbfa2b954@0@lo t0 exp 0000000000000000 cur 3310 last 0 00000020:00000080:2.0:1784189067.851962:0:87026:0:(genops.c:1406:class_connect()) connect: client bd553d0d-03e2-4233-b06b-b55bbfa2b954, cookie 0xcc1762b626f8aad8 00000100:00100000:1.0:1784189067.851966:0:68287:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf4262e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3639:x1870854458057984:12345-0@lo:38:kworker.0 Request processed in 702us (1984us total) trans 0 rc -19/-19 00000100:00100000:1.0:1784189067.851972:0:68287:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1119 00000100:00080000:0.0:1784189067.852035:0:3639:0:(import.c:65:import_set_state_nolock()) ffff9dbf43690800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1784189067.852039:0:3639:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1784189067.852051:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf4262fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3639:1870854458057984:0@lo:38:kworker.0 00000100:00080000:2.0:1784189067.852265:0:87026:0:(import.c:65:import_set_state_nolock()) ffff9dc0756a4000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1784189067.852350:0:87026:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc0762ab450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd553d0d-03e2-4233-b06b-b55bbfa2b954+5:3639:x1870854458058112:12345-0@lo:250:kworker.0 Request processed in 452us (1493us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189067.852479:0:87026:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1784189067.852593:0:3639:0:(client.c:3112:ptlrpc_free_committed()) MGC192.168.203.112@tcp: committing for last_committed 0 gen 24 00000100:00080000:0.0:1784189067.852603:0:3639:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.203.112@tcp: connect to target with instance 0 00000100:00080000:0.0:1784189067.852613:0:3639:0:(import.c:956:ptlrpc_connect_set_flags()) MGC192.168.203.112@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:0.0:1784189067.852621:0:3639:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:0.0:1784189067.852625:0:3639:0:(import.c:65:import_set_state_nolock()) ffff9dc07110c800 MGS: changing import state from CONNECTING to FULL 10000000:01000000:0.0:1784189067.852628:0:3639:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:1.0:1784189067.852890:0:3639:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:1.0:1784189067.852907:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc06bbf0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:bd553d0d-03e2-4233-b06b-b55bbfa2b954:3639:1870854458058112:0@lo:250:kworker.0 00000020:01000000:0.0:1784189067.852947:0:63468:0:(tgt_mount.c:1626:tgt_import_update()) NID #0: 192.168.203.112@tcp 10000000:01000000:1.0:1784189067.852996:0:63468:0:(mgc_request_server.c:464:mgc_set_info_async_server()) NID notify for lustre-OST0000 about 1 new NIDs 00000020:01000004:1.0:1784189067.853004:0:63468:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: req 00000020:01000004:1.0:1784189067.853007:0:63468:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1784189067.853008:0:63468:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1784189067.853010:0:63468:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1784189067.853012:0:63468:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1784189067.853013:0:63468:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1784189067.853015:0:63468:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1784189067.853017:0:63468:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1784189067.853019:0:63468:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:01000000:1.0:1784189067.853075:0:63468:0:(tgt_mount.c:1637:tgt_import_update()) lustre-OST0000: notify about 1 NIDs, rc = 0 10000000:01000000:1.0:1784189067.853083:0:63468:0:(mgc_request_server.c:464:mgc_set_info_async_server()) NID notify for lustre-OST0001 about 1 new NIDs 00000100:00100000:0.0:1784189067.853149:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc05f02f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bd553d0d-03e2-4233-b06b-b55bbfa2b954:3642:1870854458058240:0@lo:253:kworker.0 00000100:00100000:0.0:1784189067.853206:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1784189067.853239:0:87021:0:(recover.c:348:ptlrpc_recover_import()) MGS: recovery finished FULL, rc = 0 00000020:01000004:2.0:1784189067.853254:0:87021:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:2.0:1784189067.853298:0:87021:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds1_flakey 10000000:01000000:2.0:1784189067.853303:0:87021:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.112@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:2.0:1784189067.853474:0:87021:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.112@tcp ctxt 0 is initialized 00000020:01000004:2.0:1784189067.853513:0:87021:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.203.112@tcp, index=0000, flags=0x20005 00000020:01000004:2.0:1784189067.853517:0:87021:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1784189067.853518:0:87021:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1784189067.853519:0:87021:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1784189067.853521:0:87021:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1784189067.853522:0:87021:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1784189067.853523:0:87021:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1784189067.853524:0:87021:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1784189067.853525:0:87021:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1784189067.853526:0:87021:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1784189067.853528:0:87021:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1784189067.853530:0:87021:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:2.0:1784189067.853532:0:87021:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1784189067.853534:0:87021:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1784189067.853535:0:87021:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1784189067.853536:0:87021:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1784189067.853537:0:87021:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1784189067.853542:0:87021:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1784189067.853543:0:87021:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1784189067.853544:0:87021:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1784189067.853545:0:87021:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1784189067.853546:0:87021:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1784189067.853563:0:87021:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1784189067.853573:0:87021:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf4262ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd553d0d-03e2-4233-b06b-b55bbfa2b954:87021:1870854458058368:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1784189067.853615:0:87021:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:01000004:1.0:1784189067.853670:0:63468:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: req 00000020:01000004:1.0:1784189067.853674:0:63468:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1784189067.853675:0:63468:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1784189067.853677:0:63468:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1784189067.853678:0:63468:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1784189067.853679:0:63468:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1784189067.853681:0:63468:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1784189067.853682:0:63468:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1784189067.853683:0:63468:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:01000000:1.0:1784189067.853704:0:63468:0:(tgt_mount.c:1637:tgt_import_update()) lustre-OST0001: notify about 1 NIDs, rc = 0 10000000:01000000:1.0:1784189067.853710:0:63468:0:(mgc_request_server.c:464:mgc_set_info_async_server()) NID notify for lustre-MDT0001 about 1 new NIDs 00000020:01000004:1.0:1784189067.853712:0:63468:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: req 00000100:00100000:0.0:1784189067.854011:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1784189067.854029:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc05f02ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bd553d0d-03e2-4233-b06b-b55bbfa2b954:3642:1870854458058496:0@lo:253:kworker.0 00000020:01000004:1.0:1784189067.854128:0:63468:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1784189067.854130:0:63468:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1784189067.854131:0:63468:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1784189067.854141:0:63468:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1784189067.854142:0:63468:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1784189067.854143:0:63468:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1784189067.854145:0:63468:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1784189067.854146:0:63468:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000100:00100000:0.0:1784189067.854177:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:01000000:1.0:1784189067.854184:0:63468:0:(tgt_mount.c:1637:tgt_import_update()) lustre-MDT0001: notify about 1 NIDs, rc = 0 00000100:00100000:2.0:1784189067.854226:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc05f02ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bd553d0d-03e2-4233-b06b-b55bbfa2b954:3640:1870854458058624:0@lo:253:kworker.0 00000100:00100000:2.0:1784189067.854261:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784189067.854302:0:87027:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458058240 00000100:00100000:2.0:1784189067.854309:0:87027:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458058240 00000100:00100000:2.0:1784189067.854363:0:87027:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458058368 00000100:00100000:2.0:1784189067.854367:0:87027:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458058368 00000100:00100000:2.0:1784189067.854378:0:87027:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458058624 00000100:00100000:2.0:1784189067.854381:0:87027:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458058624 00000100:00100000:2.0:1784189067.854395:0:87027:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1784189067.854403:0:87027:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf46908050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd553d0d-03e2-4233-b06b-b55bbfa2b954+7:3642:x1870854458058240:12345-0@lo:253:kworker.0 00000100:00100000:1.0:1784189067.854422:0:87026:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1784189067.854430:0:87026:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf4649e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd553d0d-03e2-4233-b06b-b55bbfa2b954+7:87021:x1870854458058368:12345-0@lo:253:mount.lustre.0 00000100:00100000:0.0:1784189067.854613:0:87028:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 3 min 3 max 32 00000100:00100000:0.0:1784189067.854623:0:87028:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0003' 20000000:01000000:1.0:1784189067.854636:0:87026:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1784189067.854639:0:87026:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:1.0:1784189067.854642:0:87026:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 20000000:01000000:2.0:1784189067.854746:0:87027:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 00000100:00100000:2.0:1784189067.854760:0:87021:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dbf46a20f00 going to sleep for 11 seconds 00000100:00100000:2.0:1784189067.854957:0:87028:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458058496 00000100:00100000:2.0:1784189067.854962:0:87028:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458058496 10000000:01000000:0.0:1784189067.855034:0:87032:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00000100:00100000:1.0:1784189067.855104:0:87031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1784189067.855111:0:87031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf4649dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:bd553d0d-03e2-4233-b06b-b55bbfa2b954+8:3640:x1870854458058624:12345-0@lo:253:kworker.0 20000000:01000000:1.0:1784189067.855132:0:87031:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:2.0:1784189067.855263:0:87026:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 104 20000000:01000000:3.0:1784189067.858189:0:87033:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:3.0:1784189067.858199:0:87033:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 1 20000000:01000000:3.0:1784189067.858202:0:87033:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:3.0:1784189067.858205:0:87033:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:3.0:1784189067.858650:0:87033:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 20000000:01000000:2.0:1784189067.859246:0:87026:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1784189067.859274:0:87026:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:1.0:1784189067.859340:0:87027:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:2.0:1784189067.861599:0:87026:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf4649e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd553d0d-03e2-4233-b06b-b55bbfa2b954+8:87021:x1870854458058368:12345-0@lo:253:mount.lustre.0 Request processed in 7160us (7973us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189067.861615:0:87026:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1784189067.861660:0:87026:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1784189067.861672:0:87026:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf4649fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd553d0d-03e2-4233-b06b-b55bbfa2b954+7:3642:x1870854458058496:12345-0@lo:253:kworker.0 20000000:01000000:2.0:1784189067.861703:0:87026:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 00000100:00100000:3.0:1784189067.861791:0:87021:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf4262ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd553d0d-03e2-4233-b06b-b55bbfa2b954:87021:1870854458058368:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1784189067.861806:0:87021:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:3.0:1784189067.861809:0:87021:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1784189067.861811:0:87021:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1784189067.861812:0:87021:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1784189067.861814:0:87021:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1784189067.861815:0:87021:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1784189067.861816:0:87021:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1784189067.861817:0:87021:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1784189067.861819:0:87021:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1784189067.861821:0:87021:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1784189067.861822:0:87021:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1784189067.861847:0:87021:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9dc06b3eb800 from lustre-MDT0000 10000000:01000000:3.0:1784189067.861881:0:87021:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:3.0:1784189067.861883:0:87021:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:3.0:1784189067.861892:0:87021:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9dc06b3eb800 10000000:01000000:3.0:1784189067.861896:0:87021:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1784189067.861901:0:87021:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff9dc06b3eb800 10000000:01000000:3.0:1784189067.861903:0:87021:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:3.0:1784189067.861906:0:87021:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-barrier-ffff9dc06b3eb800 from 1 10000000:01000000:3.0:1784189067.861910:0:87021:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:3.0:1784189067.861956:0:87021:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff9dc081b17c00/0xcc1762b626f8aadf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 87021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189067.861979:0:87021:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: ffff9dc081b17c00/0xcc1762b626f8aadf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 87021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189067.861988:0:87021:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: ffff9dc081b17c00/0xcc1762b626f8aadf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 87021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784189067.862008:0:87021:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc06bbf0000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd553d0d-03e2-4233-b06b-b55bbfa2b954:87021:1870854458058752:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1784189067.862055:0:87021:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784189067.862091:0:87021:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dbf44443cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1784189067.862194:0:87028:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 4 min 3 max 32 00000100:00100000:2.0:1784189067.862202:0:87028:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0004' 00000100:00100000:2.0:1784189067.862737:0:87028:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458058752 00000100:00100000:2.0:1784189067.862743:0:87028:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458058752 00000100:00100000:3.0:1784189067.862860:0:87034:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1784189067.862869:0:87034:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf4649c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:bd553d0d-03e2-4233-b06b-b55bbfa2b954+8:87021:x1870854458058752:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1784189067.862881:0:87034:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784189067.862894:0:87034:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dc081b17600/0xcc1762b626f8aae6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xcc1762b626f8aadf expref: -99 pid: 87034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189067.862915:0:87034:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dc081b17600/0xcc1762b626f8aae6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcc1762b626f8aadf expref: 9 pid: 87034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189067.862925:0:87034:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dc081b17600/0xcc1762b626f8aae6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcc1762b626f8aadf expref: 9 pid: 87034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189067.862945:0:87034:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc081b17600, rc 0) 00000100:00100000:3.0:1784189067.862997:0:87034:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf4649c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:bd553d0d-03e2-4233-b06b-b55bbfa2b954+9:87021:x1870854458058752:12345-0@lo:101:mount.lustre.0 Request processed in 130us (941us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189067.863005:0:87034:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1784189067.863125:0:87021:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc06bbf0000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd553d0d-03e2-4233-b06b-b55bbfa2b954:87021:1870854458058752:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1784189067.863141:0:87021:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: ffff9dc081b17c00/0xcc1762b626f8aadf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc1762b626f8aae6 expref: -99 pid: 87021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189067.863151:0:87021:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: ffff9dc081b17c00/0xcc1762b626f8aadf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcc1762b626f8aae6 expref: -99 pid: 87021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784189067.863182:0:87021:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:2.0:1784189067.863199:0:87021:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff9dc081b17c00/0xcc1762b626f8aadf lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc1762b626f8aae6 expref: -99 pid: 87021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189067.863206:0:87021:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: ffff9dc081b17c00/0xcc1762b626f8aadf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc1762b626f8aae6 expref: -99 pid: 87021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784189067.863213:0:87021:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:2.0:1784189067.863217:0:87021:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1784189067.863222:0:87021:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff9dc06b3eb800 10000000:01000000:2.0:1784189067.863224:0:87021:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:2.0:1784189067.863228:0:87021:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:2.0:1784189067.863230:0:87021:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1784189067.863249:0:87021:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff9dc04a20be00/0xcc1762b626f8aaed lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 87021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189067.863258:0:87021:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: ffff9dc04a20be00/0xcc1762b626f8aaed lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 87021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189067.863265:0:87021:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: ffff9dc04a20be00/0xcc1762b626f8aaed lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 87021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784189067.863291:0:87021:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf4262d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd553d0d-03e2-4233-b06b-b55bbfa2b954:87021:1870854458058880:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1784189067.863350:0:87021:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784189067.863380:0:87021:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dc0761bb180 going to sleep for 11 seconds 00000100:00100000:3.0:1784189067.863728:0:87034:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458058880 00000100:00100000:3.0:1784189067.863733:0:87034:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458058880 00000100:00100000:3.0:1784189067.863765:0:87034:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1784189067.863772:0:87034:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf4649e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:bd553d0d-03e2-4233-b06b-b55bbfa2b954+9:87021:x1870854458058880:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1784189067.863781:0:87034:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784189067.863792:0:87034:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dc081b17800/0xcc1762b626f8aaf4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xcc1762b626f8aaed expref: -99 pid: 87034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189067.863808:0:87034:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dc081b17800/0xcc1762b626f8aaf4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcc1762b626f8aaed expref: 10 pid: 87034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189067.863817:0:87034:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dc081b17800/0xcc1762b626f8aaf4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcc1762b626f8aaed expref: 10 pid: 87034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189067.863823:0:87034:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc081b17800, rc 0) 00000100:00100000:3.0:1784189067.863853:0:87034:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf4649e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:bd553d0d-03e2-4233-b06b-b55bbfa2b954+10:87021:x1870854458058880:12345-0@lo:101:mount.lustre.0 Request processed in 81us (503us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189067.863860:0:87034:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1784189067.863945:0:87021:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf4262d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd553d0d-03e2-4233-b06b-b55bbfa2b954:87021:1870854458058880:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1784189067.863957:0:87021:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: ffff9dc04a20be00/0xcc1762b626f8aaed lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc1762b626f8aaf4 expref: -99 pid: 87021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189067.863964:0:87021:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: ffff9dc04a20be00/0xcc1762b626f8aaed lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcc1762b626f8aaf4 expref: -99 pid: 87021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784189067.864086:0:87021:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf4262d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd553d0d-03e2-4233-b06b-b55bbfa2b954:87021:1870854458059008:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1784189067.864115:0:87021:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784189067.864143:0:87021:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dc0761bb180 going to sleep for 11 seconds 00000100:00100000:3.0:1784189067.864315:0:87034:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458059008 00000100:00100000:3.0:1784189067.864337:0:87034:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458059008 00000100:00100000:3.0:1784189067.864373:0:87034:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1784189067.864381:0:87034:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf4649f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:bd553d0d-03e2-4233-b06b-b55bbfa2b954+10:87021:x1870854458059008:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1784189067.864718:0:87034:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf4649f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:bd553d0d-03e2-4233-b06b-b55bbfa2b954+11:87021:x1870854458059008:12345-0@lo:501:mount.lustre.0 Request processed in 336us (600us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189067.864725:0:87034:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1784189067.864992:0:87021:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf4262d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd553d0d-03e2-4233-b06b-b55bbfa2b954:87021:1870854458059008:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1784189067.865100:0:87021:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf44faf480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd553d0d-03e2-4233-b06b-b55bbfa2b954:87021:1870854458059136:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1784189067.865267:0:87021:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784189067.865370:0:87021:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dc0718de900 going to sleep for 11 seconds 00000100:00100000:2.0:1784189067.865523:0:87028:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458059136 00000100:00100000:2.0:1784189067.865529:0:87028:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458059136 00000100:00100000:2.0:1784189067.865594:0:87028:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1784189067.865602:0:87028:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf4649ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd553d0d-03e2-4233-b06b-b55bbfa2b954+11:87021:x1870854458059136:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1784189067.867829:0:87028:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf4649ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd553d0d-03e2-4233-b06b-b55bbfa2b954+11:87021:x1870854458059136:12345-0@lo:503:mount.lustre.0 Request processed in 2220us (2554us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189067.867842:0:87028:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1784189067.868024:0:87021:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf44faf480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd553d0d-03e2-4233-b06b-b55bbfa2b954:87021:1870854458059136:0@lo:503:mount.lustre.0 20000000:01000000:2.0:1784189067.870309:0:87027:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1784189067.870358:0:87027:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:0.0:1784189067.870387:0:87032:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1784189067.870395:0:87032:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1784189067.870423:0:87032:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9dc070147a00/0xcc1762b626f8aafb lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 87032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189067.870440:0:87032:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dc070147a00/0xcc1762b626f8aafb lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 87032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1784189067.870601:0:87032:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.000206497s 00010000:00010000:0.0:1784189067.870606:0:87032:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9dc070147a00/0xcc1762b626f8aafb lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 87032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189067.870612:0:87032:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9dc070147a00/0xcc1762b626f8aafb lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 87032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189067.870619:0:87032:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9dc070147a00/0xcc1762b626f8aafb lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 87032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189067.870626:0:87032:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9dc070147a00/0xcc1762b626f8aafb lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 87032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189067.870632:0:87032:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc070147a00 already unused, calling callback (ffffffffc0b2e230) 00010000:00010000:0.0:1784189067.870636:0:87032:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9dc070147a00/0xcc1762b626f8aafb lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 87032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189067.870644:0:87032:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9dc070147a00/0xcc1762b626f8aafb lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 87032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189067.870663:0:87032:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9dc070147a00/0xcc1762b626f8aafb lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 87032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189067.870671:0:87032:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9dc070147a00/0xcc1762b626f8aafb lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 87032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189067.870677:0:87032:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dc070147a00/0xcc1762b626f8aafb lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 87032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784189067.870729:0:87035:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc06bbf3100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bd553d0d-03e2-4233-b06b-b55bbfa2b954:87035:1870854458059264:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1784189067.870807:0:87035:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 20000000:01000000:1.0:1784189067.870900:0:87031:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:3.0:1784189067.871075:0:87035:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dbf44443600 going to sleep for 11 seconds 00000100:00100000:2.0:1784189067.871091:0:87027:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf46908050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd553d0d-03e2-4233-b06b-b55bbfa2b954+10:3642:x1870854458058240:12345-0@lo:253:kworker.0 Request processed in 16683us (17879us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189067.871106:0:87027:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000020:01000004:3.0:1784189067.872639:0:3642:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: rep 00000020:01000004:3.0:1784189067.872645:0:3642:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1784189067.872661:0:3642:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1784189067.872662:0:3642:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1784189067.872665:0:3642:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1784189067.872667:0:3642:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1784189067.872668:0:3642:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1784189067.872670:0:3642:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1784189067.872672:0:3642:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000100:00100000:3.0:1784189067.872676:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc05f02f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bd553d0d-03e2-4233-b06b-b55bbfa2b954:3642:1870854458058240:0@lo:253:kworker.0 00000100:00100000:0.0:1784189067.872787:0:87034:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458059264 00000100:00100000:0.0:1784189067.872802:0:87034:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458059264 00000100:00100000:0.0:1784189067.872889:0:87034:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1784189067.872901:0:87034:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc056555450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:bd553d0d-03e2-4233-b06b-b55bbfa2b954+10:87035:x1870854458059264:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1784189067.873984:0:87034:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc056555450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:bd553d0d-03e2-4233-b06b-b55bbfa2b954+10:87035:x1870854458059264:12345-0@lo:502:llog_process_th.0 Request processed in 1081us (3173us total) trans 0 rc 0/0 00000100:00100000:0.0:1784189067.873995:0:87034:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1784189067.878404:0:87035:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc06bbf3100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bd553d0d-03e2-4233-b06b-b55bbfa2b954:87035:1870854458059264:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1784189067.878525:0:87035:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1784189067.878539:0:87035:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784189067.878542:0:87035:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:1.0:1784189067.878547:0:87035:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:1.0:1784189067.878550:0:87035:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1784189067.878566:0:87035:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff9dbf449f0000) 00000020:00000080:1.0:1784189067.878591:0:87035:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type lod with refcount 2 00000020:00000080:1.0:1784189067.878598:0:87035:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00080000:01000000:1.0:1784189067.878692:0:87035:0:(osd_handler.c:8929:osd_obd_connect()) connect #2 00000020:00000080:1.0:1784189067.878699:0:87035:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xcc1762b626f8ab09 00000020:00000080:1.0:1784189067.878906:0:87035:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:1.0:1784189067.878910:0:87035:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1784189067.878914:0:87035:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784189067.878915:0:87035:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:1.0:1784189067.879915:0:87035:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1784189067.879936:0:87035:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784189067.879938:0:87035:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:1.0:1784189067.879946:0:87035:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1784189067.879958:0:87035:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff9dbf449f3380) 00000020:00000080:1.0:1784189067.879978:0:87035:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type mdt with refcount 2 00000020:00000080:1.0:1784189067.879984:0:87035:0:(obd_config.c:1470:class_process_config()) processing cmd: cf007 00000020:00000080:1.0:1784189067.879985:0:87035:0:(obd_config.c:1514:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:1.0:1784189067.879988:0:87035:0:(obd_config.c:1148:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:1.0:1784189067.879994:0:87035:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1784189067.880130:0:87035:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9dc06b3eb800 from lustre-MDT0000, refs=3 00000020:00000080:1.0:1784189067.880251:0:87035:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff9dbf449f4d40) 00000020:00000080:1.0:1784189067.880264:0:87035:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type mdd with refcount 2 00000004:01000000:1.0:1784189067.880340:0:87035:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:1.0:1784189067.880350:0:87035:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xcc1762b626f8ab1e 00000020:00000080:1.0:1784189067.880606:0:87035:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:1.0:1784189067.880613:0:87035:0:(mdd_device.c:1596:mdd_obd_connect()) connect #0 00000020:00000080:1.0:1784189067.880618:0:87035:0:(genops.c:1406:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0xcc1762b626f8ab25 00080000:01000000:1.0:1784189067.880623:0:87035:0:(osd_handler.c:8929:osd_obd_connect()) connect #3 00000020:00000080:1.0:1784189067.880627:0:87035:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xcc1762b626f8ab2c 20000000:01000000:0.0:1784189067.888127:0:87031:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1784189067.888146:0:87031:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 00000100:00100000:0.0:1784189067.888449:0:87031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf4649dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:bd553d0d-03e2-4233-b06b-b55bbfa2b954+9:3640:x1870854458058624:12345-0@lo:253:kworker.0 Request processed in 33333us (34182us total) trans 0 rc 0/0 00000100:00100000:0.0:1784189067.888527:0:87031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000020:01000004:2.0:1784189067.888657:0:3640:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: rep 00000020:01000004:2.0:1784189067.888660:0:3640:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1784189067.888662:0:3640:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1784189067.888664:0:3640:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1784189067.888665:0:3640:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1784189067.888666:0:3640:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1784189067.888668:0:3640:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1784189067.888670:0:3640:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1784189067.888671:0:3640:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000100:00100000:2.0:1784189067.888674:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc05f02ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bd553d0d-03e2-4233-b06b-b55bbfa2b954:3640:1870854458058624:0@lo:253:kworker.0 20000000:01000000:2.0:1784189067.888777:0:87026:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:3.0:1784189067.888963:0:87032:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1784189067.888969:0:87032:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1784189067.888989:0:87032:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9dc081b16200/0xcc1762b626f8ab33 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 87032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189067.889005:0:87032:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dc081b16200/0xcc1762b626f8ab33 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 87032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1784189067.889026:0:87032:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.000206497s 00010000:00010000:3.0:1784189067.889031:0:87032:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9dc081b16200/0xcc1762b626f8ab33 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 87032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189067.889039:0:87032:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9dc081b16200/0xcc1762b626f8ab33 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 87032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189067.889047:0:87032:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9dc081b16200/0xcc1762b626f8ab33 lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 87032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189067.889054:0:87032:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9dc081b16200/0xcc1762b626f8ab33 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 87032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189067.889061:0:87032:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc081b16200 already unused, calling callback (ffffffffc0b2e230) 00010000:00010000:3.0:1784189067.889066:0:87032:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9dc081b16200/0xcc1762b626f8ab33 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 87032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189067.889074:0:87032:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9dc081b16200/0xcc1762b626f8ab33 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 87032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189067.889096:0:87032:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9dc081b16200/0xcc1762b626f8ab33 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 87032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189067.889104:0:87032:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9dc081b16200/0xcc1762b626f8ab33 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 87032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189067.889111:0:87032:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dc081b16200/0xcc1762b626f8ab33 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 87032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1784189067.895768:0:87026:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1784189067.895834:0:87026:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:3.0:1784189067.896202:0:87026:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf4649fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd553d0d-03e2-4233-b06b-b55bbfa2b954+8:3642:x1870854458058496:12345-0@lo:253:kworker.0 Request processed in 34528us (42018us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189067.896215:0:87026:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000020:01000004:2.0:1784189067.896342:0:3642:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: rep 00000020:01000004:2.0:1784189067.896345:0:3642:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1784189067.896347:0:3642:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1784189067.896348:0:3642:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1784189067.896349:0:3642:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1784189067.896351:0:3642:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1784189067.896352:0:3642:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1784189067.896354:0:3642:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1784189067.896355:0:3642:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000100:00100000:2.0:1784189067.896360:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc05f02ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bd553d0d-03e2-4233-b06b-b55bbfa2b954:3642:1870854458058496:0@lo:253:kworker.0 20000000:01000000:0.0:1784189067.896747:0:87032:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1784189067.896753:0:87032:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1784189067.896846:0:87032:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9dc04a20b400/0xcc1762b626f8ab3a lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 87032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189067.896863:0:87032:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dc04a20b400/0xcc1762b626f8ab3a lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 87032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1784189067.896873:0:87032:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.000206497s 00010000:00010000:2.0:1784189067.896878:0:87032:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9dc04a20b400/0xcc1762b626f8ab3a lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 87032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189067.896885:0:87032:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9dc04a20b400/0xcc1762b626f8ab3a lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 87032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189067.896893:0:87032:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9dc04a20b400/0xcc1762b626f8ab3a lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 87032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189067.896907:0:87032:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9dc04a20b400/0xcc1762b626f8ab3a lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 87032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189067.896913:0:87032:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc04a20b400 already unused, calling callback (ffffffffc0b2e230) 00010000:00010000:2.0:1784189067.896917:0:87032:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9dc04a20b400/0xcc1762b626f8ab3a lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 87032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189067.896927:0:87032:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9dc04a20b400/0xcc1762b626f8ab3a lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 87032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189067.896950:0:87032:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9dc04a20b400/0xcc1762b626f8ab3a lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 87032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189067.896959:0:87032:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9dc04a20b400/0xcc1762b626f8ab3a lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 87032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189067.896966:0:87032:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dc04a20b400/0xcc1762b626f8ab3a lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 87032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189067.981581:0:87035:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-4 is initialized 00000001:00080000:2.0:1784189067.981716:0:87035:0:(tgt_lastrcvd.c:1748:tgt_clients_data_init()) RCVRNG CLIENT uuid: b90fcc1c-0e69-42a4-a116-a71fec7aeb78 idx: 0 lr: 94489280519 srv lr: 98784247808 lx: 0 gen 22 00000001:00080000:2.0:1784189067.981762:0:87035:0:(tgt_lastrcvd.c:1748:tgt_clients_data_init()) RCVRNG CLIENT uuid: lustre-MDT0001-mdtlov_UUID idx: 1 lr: 0 srv lr: 98784247808 lx: 0 gen 21 00000001:00000004:2.0:1784189067.982551:0:87035:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 24, last_transno is 98784247808 00000001:00080000:2.0:1784189067.982672:0:87035:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000001:00080000:2.0:1784189067.982732:0:87035:0:(tgt_lastrcvd.c:2283:tgt_reply_data_init()) lustre-MDT0000: restore reply ffff9dc042a4cd80: xid 1870854436238464, transno 98784247812, client gen 22, slot idx 0 00000001:00080000:2.0:1784189067.982745:0:87035:0:(tgt_lastrcvd.c:2283:tgt_reply_data_init()) lustre-MDT0000: restore reply ffff9dc05a5b13c0: xid 1870854436238208, transno 98784247811, client gen 22, slot idx 1 00000020:00000080:2.0:1784189067.984531:0:87035:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff9dc07547b380) 00000020:00000080:2.0:1784189067.984568:0:87035:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type qmt with refcount 2 00080000:01000000:2.0:1784189067.984647:0:87035:0:(osd_handler.c:8929:osd_obd_connect()) connect #4 00000020:00000080:2.0:1784189067.984654:0:87035:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xcc1762b626f8ab56 00000020:00000080:1.0:1784189067.986480:0:87035:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:1.0:1784189067.989413:0:87035:0:(genops.c:1406:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0xcc1762b626f8ab5d 00000020:00000080:2.0:1784189067.990237:0:87035:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:2.0:1784189067.990249:0:87035:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1784189067.990256:0:87035:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784189067.990258:0:87035:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:2.0:1784189067.990262:0:87035:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1784189067.990265:0:87035:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #8 00000020:01000000:2.0:1784189067.990266:0:87035:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1784189067.990268:0:87035:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1784189067.990269:0:87035:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1784189067.990272:0:87035:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784189067.990273:0:87035:0:(obd_config.c:1561:class_process_config()) marker 8 (0x6) lustre sys.timeout 00000020:01000000:2.0:1784189067.990275:0:87035:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1784189067.990280:0:87035:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784189067.990281:0:87035:0:(obd_config.c:1561:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:2.0:1784189067.990285:0:87035:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000004:01000000:2.0:1784189067.990352:0:87035:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:2.0:1784189067.990373:0:87035:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1784189067.990594:0:87035:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784189067.990597:0:87035:0:(obd_config.c:1561:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:1.0:1784189067.990602:0:87035:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1784189067.990607:0:87035:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784189067.990608:0:87035:0:(obd_config.c:1561:class_process_config()) marker 17 (0x1) lustre-MDT0001 add osp 00000020:00000080:1.0:1784189067.990611:0:87035:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1784189067.990616:0:87035:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.203.112@tcp to nid 0x20000c0a8cb70 (192.168.203.112@tcp) 00000020:00000080:1.0:1784189067.990637:0:87035:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1784189067.990653:0:87035:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osp-MDT0000 (ffff9dbf431299c0) 00000020:00000080:1.0:1784189067.990669:0:87035:0:(obd_config.c:720:class_attach_name()) OBD: dev 21 attached type osp with refcount 2 00000020:00000080:1.0:1784189067.990674:0:87035:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1784189067.990743:0:87035:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0001-osp-MDT0000: connect to lustre-MDT0000-osd (lustre-MDT0001-osp-MDT0000) 00080000:01000000:1.0:1784189067.990748:0:87035:0:(osd_handler.c:8929:osd_obd_connect()) connect #5 00000020:00000080:1.0:1784189067.990754:0:87035:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xcc1762b626f8ab6b 00010000:00080000:1.0:1784189067.990784:0:87035:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9dbf47268000@lustre-MDT0001-osp-MDT0000: add connection 192.168.203.112@tcp at head 00010000:00010000:1.0:1784189067.994733:0:87035:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-osp-MDT0000-9 is initialized 00000020:00000080:3.0:1784189068.000707:0:87035:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1784189068.000724:0:87035:0:(obd_config.c:1470:class_process_config()) processing cmd: cf014 00000004:01000000:3.0:1784189068.000936:0:87035:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0001_UUID idx:1 gen:1 00000020:00000080:3.0:1784189068.000965:0:87035:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xcc1762b626f8ab72 00000100:00080000:3.0:1784189068.000976:0:87035:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1784189068.000982:0:87035:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff9dbf47268000 using connection 192.168.203.112@tcp/0@lo 00000100:00100000:3.0:1784189068.001017:0:87035:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9dc06bbf3100 x1870854458059392/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1784189068.001043:0:87035:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000100:00100000:1.0:1784189068.001218:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc06bbf3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3639:1870854458059392:0@lo:38:llog_process_th.0 00000020:01000000:3.0:1784189068.001224:0:87035:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1784189068.001229:0:87035:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784189068.001231:0:87035:0:(obd_config.c:1561:class_process_config()) marker 17 (0x2) lustre-MDT0001 add osp 00000020:01000000:3.0:1784189068.001235:0:87035:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1784189068.001238:0:87035:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #19 00000020:01000000:3.0:1784189068.001240:0:87035:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1784189068.001254:0:87035:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1784189068.001256:0:87035:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1784189068.001260:0:87035:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784189068.001261:0:87035:0:(obd_config.c:1561:class_process_config()) marker 19 (0x6) lustre sys.timeout 00000020:01000000:3.0:1784189068.001264:0:87035:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1784189068.001268:0:87035:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:3.0:1784189068.001273:0:87035:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784189068.001275:0:87035:0:(obd_config.c:1561:class_process_config()) marker 22 (0x1) lustre-OST0000 add osc 00000020:00000080:3.0:1784189068.001278:0:87035:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1784189068.001281:0:87035:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.203.112@tcp to nid 0x20000c0a8cb70 (192.168.203.112@tcp) 00000100:00100000:1.0:1784189068.001293:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:01000000:3.0:1784189068.001304:0:87035:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1784189068.001308:0:87035:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1784189068.001349:0:87035:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff9dc06bb33380) 00000020:00000080:3.0:1784189068.001370:0:87035:0:(obd_config.c:720:class_attach_name()) OBD: dev 22 attached type osp with refcount 2 00000100:00100000:1.0:1784189068.001374:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458059392 00000020:00000080:3.0:1784189068.001377:0:87035:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000100:00100000:1.0:1784189068.001381:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458059392 00000100:00100000:1.0:1784189068.001425:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3733 00000100:00100000:1.0:1784189068.001432:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc05f02df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3639:x1870854458059392:12345-0@lo:38:llog_process_th.0 00010000:00080000:1.0:1784189068.001457:0:8439:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 3310 last 0 00000004:00080000:3.0:1784189068.001483:0:87035:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:3.0:1784189068.001493:0:87035:0:(osd_handler.c:8929:osd_obd_connect()) connect #6 00000020:00000080:1.0:1784189068.001496:0:8439:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xcc1762b626f8ab80 00000020:00000080:3.0:1784189068.001502:0:87035:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xcc1762b626f8ab87 00000004:00100000:1.0:1784189068.001513:0:8439:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00010000:00080000:3.0:1784189068.001533:0:87035:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9dc0477b2800@lustre-OST0000-osc-MDT0000: add connection 192.168.203.112@tcp at head 00000100:00080000:1.0:1784189068.001622:0:8439:0:(import.c:65:import_set_state_nolock()) ffff9dc047a82000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1784189068.001685:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc05f02df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3639:x1870854458059392:12345-0@lo:38:llog_process_th.0 Request processed in 251us (391us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189068.001694:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3733 00000100:00100000:1.0:1784189068.001732:0:3639:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1784189068.001741:0:3639:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-osp-MDT0000: connect to target with instance 19 00000100:00080000:1.0:1784189068.001751:0:3639:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-osp-MDT0000: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00010000:00010000:3.0:1784189068.001754:0:87035:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-10 is initialized 00000100:00080000:1.0:1784189068.001757:0:3639:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:1.0:1784189068.001760:0:3639:0:(import.c:65:import_set_state_nolock()) ffff9dbf47268000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1784189068.001769:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc06bbf3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3639:1870854458059392:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1784189068.002378:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1784189068.002390:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf4262d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1870854458059520:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1784189068.002432:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784189068.002469:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458059520 00000100:00100000:3.0:1784189068.002474:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458059520 00000100:00100000:3.0:1784189068.002503:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3734 00000100:00100000:3.0:1784189068.002511:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc06bbf0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3640:x1870854458059520:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1784189068.002536:0:8438:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445576704 avail 1299337216 00000100:00100000:3.0:1784189068.002569:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc06bbf0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3640:x1870854458059520:12345-0@lo:41:osp-pre-1-0.0 Request processed in 59us (136us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189068.002584:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3734 00000100:00100000:3.0:1784189068.002620:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf4262d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1870854458059520:0@lo:41:osp-pre-1-0.0 00000040:01000000:2.0:1784189068.003272:0:87035:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1784189068.003296:0:87035:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:2.0:1784189068.003883:0:87035:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0x1:0x2:0x0] first idx 22, last_idx 23 00000040:00080000:2.0:1784189068.005408:0:87035:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1784189068.005452:0:87035:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].24, 64 off9728 00000040:00080000:0.0:1784189068.005723:0:87035:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x60:0x0].1, 64 off8256 00000040:00080000:2.0:1784189068.006840:0:87041:0:(llog.c:805:llog_process_thread()) index: 23, lh_last_idx: 24 synced_idx: 0 lgh_last_idx: 24 00000040:00080000:2.0:1784189068.006846:0:87041:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x5c:0x0] at index 23 of catalog [0x1:0x2:0x0] 00000040:00080000:2.0:1784189068.007011:0:87041:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0x1:0x2:0x0] first idx 23, last_idx 24 00000040:00080000:2.0:1784189068.007040:0:87041:0:(llog_cat_server.c:902:llog_cat_cleanup()) cancel plain log [0x1:0x5c:0x0] at index 23 of catalog [0x1:0x2:0x0] 00000040:00080000:2.0:1784189068.007173:0:87041:0:(llog.c:805:llog_process_thread()) index: 24, lh_last_idx: 24 synced_idx: 24 lgh_last_idx: 24 00000040:00080000:2.0:1784189068.007176:0:87041:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x60:0x0] at index 24 of catalog [0x1:0x2:0x0] 00000020:00000080:3.0:1784189068.011038:0:87035:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1784189068.011054:0:87035:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1784189068.011106:0:87035:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:3.0:1784189068.011130:0:87035:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xcc1762b626f8ab8e 00000100:00080000:3.0:1784189068.011142:0:87035:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1784189068.011148:0:87035:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9dc0477b2800 using connection 192.168.203.112@tcp/0@lo 00000100:00100000:3.0:1784189068.011184:0:87035:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9dc06bbf0a80 x1870854458059648/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1784189068.011213:0:87035:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:3.0:1784189068.011269:0:87035:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1784189068.011274:0:87035:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784189068.011276:0:87035:0:(obd_config.c:1561:class_process_config()) marker 22 (0x2) lustre-OST0000 add osc 00000020:01000000:3.0:1784189068.011280:0:87035:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1784189068.011282:0:87035:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #26 00000020:01000000:3.0:1784189068.011284:0:87035:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1784189068.011285:0:87035:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1784189068.011287:0:87035:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1784189068.011289:0:87035:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784189068.011291:0:87035:0:(obd_config.c:1561:class_process_config()) marker 26 (0x6) lustre sys.timeout 00000020:01000000:3.0:1784189068.011293:0:87035:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1784189068.011297:0:87035:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:3.0:1784189068.011300:0:87035:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784189068.011301:0:87035:0:(obd_config.c:1561:class_process_config()) marker 30 (0x1) lustre-OST0001 add osc 00000020:00000080:3.0:1784189068.011304:0:87035:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1784189068.011308:0:87035:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.203.112@tcp to nid 0x20000c0a8cb70 (192.168.203.112@tcp) 00000020:01000000:3.0:1784189068.011360:0:87035:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1784189068.011364:0:87035:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1784189068.011383:0:87035:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff9dc06bb34d40) 00000020:00000080:3.0:1784189068.011399:0:87035:0:(obd_config.c:720:class_attach_name()) OBD: dev 27 attached type osp with refcount 2 00000020:00000080:3.0:1784189068.011405:0:87035:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1784189068.011467:0:87035:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:3.0:1784189068.011473:0:87035:0:(osd_handler.c:8929:osd_obd_connect()) connect #7 00000020:00000080:3.0:1784189068.011478:0:87035:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xcc1762b626f8ab9c 00010000:00080000:3.0:1784189068.011512:0:87035:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9dbf43fc9000@lustre-OST0001-osc-MDT0000: add connection 192.168.203.112@tcp at head 00010000:00010000:3.0:1784189068.011687:0:87035:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-11 is initialized 00000040:01000000:3.0:1784189068.011756:0:87035:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:3.0:1784189068.011772:0:87035:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000100:00100000:1.0:1784189068.012119:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc06bbf0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3639:1870854458059648:0@lo:8:llog_process_th.0 00000100:00100000:1.0:1784189068.012191:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784189068.013216:0:26163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458059648 00000100:00100000:3.0:1784189068.013227:0:26163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458059648 00000100:00100000:3.0:1784189068.013268:0:26163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4931 00000100:00100000:3.0:1784189068.013278:0:26163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc05f02ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:0+-99:3639:x1870854458059648:12345-0@lo:8:llog_process_th.0 00010000:00080000:3.0:1784189068.013308:0:26163:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 3310 last 0 00000020:00000080:3.0:1784189068.013365:0:26163:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xcc1762b626f8aba3 00002000:00100000:3.0:1784189068.013380:0:26163:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff9dbf43fcc000 ocd_connect_flags: 0xa044401443000026 ocd_version: 21136a2 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:3.0:1784189068.013384:0:26163:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:3.0:1784189068.013387:0:26163:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1784189068.013453:0:26163:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1784189068.013474:0:26163:0:(import.c:65:import_set_state_nolock()) ffff9dbf43fcb000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1784189068.013545:0:26163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc05f02ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+6:3639:x1870854458059648:12345-0@lo:8:llog_process_th.0 Request processed in 267us (1353us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189068.013552:0:26163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4931 00000100:00100000:2.0:1784189068.013680:0:3639:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1784189068.013690:0:3639:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 1 00000100:00080000:2.0:1784189068.013708:0:3639:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1784189068.013713:0:3639:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:2.0:1784189068.013716:0:3639:0:(import.c:65:import_set_state_nolock()) ffff9dc0477b2800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1784189068.013730:0:3639:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1784189068.013736:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc06bbf0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3639:1870854458059648:0@lo:8:llog_process_th.0 00000004:00080000:2.0:1784189068.013765:0:87041:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000040:00080000:1.0:1784189068.013794:0:87035:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0x1:0x5:0x0] first idx 22, last_idx 23 00000004:00080000:2.0:1784189068.013820:0:87041:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 3310237500473ns, next at 0ns, rc = 0 00080000:00080000:2.0:1784189068.013829:0:87041:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00100000:0.0:1784189068.014191:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf4262f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1870854458059776:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1784189068.014234:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784189068.014275:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458059776 00000100:00100000:0.0:1784189068.014281:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458059776 00000100:00080000:1.0:1784189068.014308:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1784189068.014343:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1882 00000100:00100000:0.0:1784189068.014352:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf44faf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3642:x1870854458059776:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1784189068.014371:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 213696 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1784189068.014407:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf44faf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3642:x1870854458059776:12345-0@lo:13:osp-pre-0-0.0 Request processed in 57us (172us total) trans 0 rc 0/0 00000100:00100000:0.0:1784189068.014414:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1882 00000100:00100000:2.0:1784189068.014649:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf4262f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1870854458059776:0@lo:13:osp-pre-0-0.0 00000040:00080000:1.0:1784189068.014734:0:87035:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1784189068.014760:0:87035:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].24, 64 off9728 00000040:00080000:1.0:1784189068.014902:0:87035:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x62:0x0].1, 64 off8256 00000040:00080000:1.0:1784189068.015287:0:87043:0:(llog.c:805:llog_process_thread()) index: 23, lh_last_idx: 24 synced_idx: 0 lgh_last_idx: 24 00000040:00080000:1.0:1784189068.015291:0:87043:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x5e:0x0] at index 23 of catalog [0x1:0x5:0x0] 00000040:00080000:1.0:1784189068.015606:0:87043:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0x1:0x5:0x0] first idx 23, last_idx 24 00000040:00080000:1.0:1784189068.015622:0:87043:0:(llog_cat_server.c:902:llog_cat_cleanup()) cancel plain log [0x1:0x5e:0x0] at index 23 of catalog [0x1:0x5:0x0] 00000040:00080000:1.0:1784189068.015727:0:87043:0:(llog.c:805:llog_process_thread()) index: 24, lh_last_idx: 24 synced_idx: 24 lgh_last_idx: 24 00000040:00080000:1.0:1784189068.015730:0:87043:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x62:0x0] at index 24 of catalog [0x1:0x5:0x0] 00010000:00010000:1.0:1784189068.016194:0:7454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1784189068.016653:0:87035:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1784189068.016665:0:87035:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1784189068.016705:0:87035:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:3.0:1784189068.016727:0:87035:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xcc1762b626f8abaa 00000100:00080000:3.0:1784189068.016736:0:87035:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1784189068.016751:0:87035:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9dbf43fc9000 using connection 192.168.203.112@tcp/0@lo 00000100:00100000:3.0:1784189068.016782:0:87035:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9dc06bbf0a80 x1870854458059904/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1784189068.016809:0:87035:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00100000:2.0:1784189068.016923:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc06bbf0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3639:1870854458059904:0@lo:8:llog_process_th.0 00000100:00100000:2.0:1784189068.017077:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784189068.017227:0:26165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458059904 00000100:00100000:0.0:1784189068.017235:0:26165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458059904 00000100:00100000:0.0:1784189068.017270:0:26165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4932 00000100:00100000:0.0:1784189068.017277:0:26165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf4262f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:0+-99:3639:x1870854458059904:12345-0@lo:8:llog_process_th.0 00010000:00080000:0.0:1784189068.017312:0:26165:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 3310 last 0 00000020:00000080:0.0:1784189068.017362:0:26165:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xcc1762b626f8abb1 00002000:00100000:0.0:1784189068.017375:0:26165:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff9dc0477d2000 ocd_connect_flags: 0xa044401443000026 ocd_version: 21136a2 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:0.0:1784189068.017379:0:26165:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:0.0:1784189068.017382:0:26165:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1784189068.017448:0:26165:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1784189068.017470:0:26165:0:(import.c:65:import_set_state_nolock()) ffff9dc0477d3800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1784189068.017526:0:26165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf4262f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+6:3639:x1870854458059904:12345-0@lo:8:llog_process_th.0 Request processed in 248us (449us total) trans 0 rc 0/0 00000100:00100000:0.0:1784189068.017533:0:26165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4932 00000100:00100000:2.0:1784189068.017692:0:3639:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1784189068.017701:0:3639:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 1 00000100:00080000:2.0:1784189068.017708:0:3639:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1784189068.017713:0:3639:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:2.0:1784189068.017716:0:3639:0:(import.c:65:import_set_state_nolock()) ffff9dbf43fc9000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000020:01000000:3.0:1784189068.017837:0:87035:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1784189068.017843:0:87035:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784189068.017845:0:87035:0:(obd_config.c:1561:class_process_config()) marker 30 (0x2) lustre-OST0001 add osc 00000020:01000000:3.0:1784189068.017848:0:87035:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1784189068.017852:0:87035:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784189068.017853:0:87035:0:(obd_config.c:1561:class_process_config()) marker 35 (0x1) lustre sys.timeout 00000020:00000080:3.0:1784189068.017856:0:87035:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1784189068.017858:0:87035:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1784189068.017860:0:87035:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1784189068.017862:0:87035:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784189068.017863:0:87035:0:(obd_config.c:1561:class_process_config()) marker 35 (0x2) lustre sys.timeout 00000020:01000000:3.0:1784189068.017866:0:87035:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1784189068.017868:0:87035:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784189068.017869:0:87035:0:(obd_config.c:1561:class_process_config()) marker 40 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1784189068.017872:0:87035:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:3.0:1784189068.017902:0:87035:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc06bbf3100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bd553d0d-03e2-4233-b06b-b55bbfa2b954:87035:1870854458060032:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1784189068.017962:0:87035:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784189068.017991:0:87035:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dc05a7a6240 going to sleep for 11 seconds 00000100:00100000:0.0:1784189068.018260:0:87028:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458060032 00000100:00100000:0.0:1784189068.018266:0:87028:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458060032 00000100:00100000:0.0:1784189068.018305:0:87028:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1784189068.018311:0:87028:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc056555850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd553d0d-03e2-4233-b06b-b55bbfa2b954+8:87035:x1870854458060032:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1784189068.018437:0:87028:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc056555850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd553d0d-03e2-4233-b06b-b55bbfa2b954+8:87035:x1870854458060032:12345-0@lo:502:llog_process_th.0 Request processed in 125us (474us total) trans 0 rc 0/0 00000100:00100000:0.0:1784189068.018444:0:87028:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1784189068.018700:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc05f02ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1870854458060160:0@lo:13:osp-pre-1-0.0 00000004:00080000:0.0:1784189068.018700:0:87022:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00000100:00100000:1.0:1784189068.018735:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784189068.018764:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458060160 00000100:00100000:0.0:1784189068.018768:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458060160 00000100:00080000:1.0:1784189068.018792:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1784189068.018802:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1883 00000100:00100000:0.0:1784189068.018809:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc05f02f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3643:x1870854458060160:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1784189068.018951:0:87035:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc06bbf3100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bd553d0d-03e2-4233-b06b-b55bbfa2b954:87035:1870854458060032:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1784189068.018977:0:87035:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1784189068.018982:0:87035:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784189068.018983:0:87035:0:(obd_config.c:1561:class_process_config()) marker 40 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1784189068.018987:0:87035:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 46 count 46 00002000:00000024:0.0:1784189068.019165:0:8432:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 213696 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1784189068.019207:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc05f02f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3643:x1870854458060160:12345-0@lo:13:osp-pre-1-0.0 Request processed in 399us (470us total) trans 0 rc 0/0 00000100:00100000:0.0:1784189068.019214:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1883 00000100:00100000:0.0:1784189068.019261:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc05f02ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1870854458060160:0@lo:13:osp-pre-1-0.0 00000020:01000000:1.0:1784189068.019442:0:87021:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-45 (rc=0) 10000000:01000000:1.0:1784189068.019467:0:87021:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1784189068.019479:0:87021:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff9dc04a20be00/0xcc1762b626f8aaed lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc1762b626f8aaf4 expref: -99 pid: 87021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189068.019490:0:87021:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: ffff9dc04a20be00/0xcc1762b626f8aaed lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc1762b626f8aaf4 expref: -99 pid: 87021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784189068.019497:0:87021:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff9dc06b3eb800 from 1 10000000:01000000:1.0:1784189068.019499:0:87021:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1784189068.019527:0:87021:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff9dc0565e6600/0xcc1762b626f8abb8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 87021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189068.019535:0:87021:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: ffff9dc0565e6600/0xcc1762b626f8abb8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 87021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189068.019555:0:87021:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: ffff9dc0565e6600/0xcc1762b626f8abb8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 87021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784189068.019570:0:87021:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc05f02ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd553d0d-03e2-4233-b06b-b55bbfa2b954:87021:1870854458060288:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1784189068.019599:0:87021:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784189068.019627:0:87021:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dc0713f2300 going to sleep for 11 seconds 00000100:00100000:3.0:1784189068.019718:0:87034:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458060288 00000100:00100000:3.0:1784189068.019723:0:87034:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458060288 00000100:00100000:3.0:1784189068.019757:0:87034:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1784189068.019764:0:87034:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc07037d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:bd553d0d-03e2-4233-b06b-b55bbfa2b954+8:87021:x1870854458060288:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1784189068.019780:0:87034:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784189068.019792:0:87034:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dc081b16200/0xcc1762b626f8abbf lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xcc1762b626f8abb8 expref: -99 pid: 87034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189068.019813:0:87034:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dc081b16200/0xcc1762b626f8abbf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcc1762b626f8abb8 expref: 9 pid: 87034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189068.019823:0:87034:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dc081b16200/0xcc1762b626f8abbf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcc1762b626f8abb8 expref: 9 pid: 87034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189068.019946:0:87034:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc081b16200, rc 0) 00000100:00100000:3.0:1784189068.019986:0:87034:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc07037d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:bd553d0d-03e2-4233-b06b-b55bbfa2b954+9:87021:x1870854458060288:12345-0@lo:101:mount.lustre.0 Request processed in 222us (385us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189068.019992:0:87034:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1784189068.020172:0:87021:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc05f02ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd553d0d-03e2-4233-b06b-b55bbfa2b954:87021:1870854458060288:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1784189068.020185:0:87021:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: ffff9dc0565e6600/0xcc1762b626f8abb8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc1762b626f8abbf expref: -99 pid: 87021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189068.020194:0:87021:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: ffff9dc0565e6600/0xcc1762b626f8abb8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcc1762b626f8abbf expref: -99 pid: 87021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784189068.020810:0:87021:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc05f02ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd553d0d-03e2-4233-b06b-b55bbfa2b954:87021:1870854458060416:0@lo:256:mount.lustre.0 00000100:00100000:1.0:1784189068.020944:0:87021:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784189068.021027:0:87021:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dc0713f2300 going to sleep for 11 seconds 00000100:00100000:3.0:1784189068.021182:0:87026:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458060416 00000100:00100000:3.0:1784189068.021187:0:87026:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458060416 00000100:00100000:3.0:1784189068.021231:0:87026:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1784189068.021238:0:87026:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc07037dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd553d0d-03e2-4233-b06b-b55bbfa2b954+9:87021:x1870854458060416:12345-0@lo:256:mount.lustre.0 20000000:01000000:3.0:1784189068.021254:0:87026:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:3.0:1784189068.021272:0:87026:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:3.0:1784189068.021276:0:87026:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:3.0:1784189068.021279:0:87026:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:3.0:1784189068.021282:0:87026:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 107 00000100:00100000:3.0:1784189068.021746:0:87026:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc07037dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd553d0d-03e2-4233-b06b-b55bbfa2b954+9:87021:x1870854458060416:12345-0@lo:256:mount.lustre.0 Request processed in 507us (801us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189068.021755:0:87026:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1784189068.021800:0:87021:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc05f02ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd553d0d-03e2-4233-b06b-b55bbfa2b954:87021:1870854458060416:0@lo:256:mount.lustre.0 00000004:00080000:2.0:1784189068.021800:0:3639:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1784189068.021814:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc06bbf0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3639:1870854458059904:0@lo:8:llog_process_th.0 10000000:01000000:3.0:1784189068.022859:0:87021:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1784189068.022889:0:87021:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff9dc0565e6600/0xcc1762b626f8abb8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc1762b626f8abbf expref: -99 pid: 87021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189068.022971:0:87021:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: ffff9dc0565e6600/0xcc1762b626f8abb8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc1762b626f8abbf expref: -99 pid: 87021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784189068.022981:0:87021:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9dc06b3eb800 from 1 10000000:01000000:3.0:1784189068.022983:0:87021:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1784189068.023014:0:87021:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff9dc081b16400/0xcc1762b626f8abc6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 87021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189068.023022:0:87021:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: ffff9dc081b16400/0xcc1762b626f8abc6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 87021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189068.023031:0:87021:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: ffff9dc081b16400/0xcc1762b626f8abc6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 87021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784189068.023049:0:87021:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc06bbf3100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd553d0d-03e2-4233-b06b-b55bbfa2b954:87021:1870854458060544:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1784189068.023096:0:87021:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784189068.023133:0:87021:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dc062096a80 going to sleep for 11 seconds 00000100:00100000:2.0:1784189068.023208:0:87027:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458060544 00000100:00100000:2.0:1784189068.023215:0:87027:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458060544 00000100:00100000:2.0:1784189068.023253:0:87027:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1784189068.023261:0:87027:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc07037c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd553d0d-03e2-4233-b06b-b55bbfa2b954+9:87021:x1870854458060544:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1784189068.023272:0:87027:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784189068.023286:0:87027:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dc04a20b400/0xcc1762b626f8abcd lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xcc1762b626f8abc6 expref: -99 pid: 87027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189068.023307:0:87027:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dc04a20b400/0xcc1762b626f8abcd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcc1762b626f8abc6 expref: 10 pid: 87027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189068.023351:0:87027:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dc04a20b400/0xcc1762b626f8abcd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcc1762b626f8abc6 expref: 10 pid: 87027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1784189068.023358:0:87043:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00010000:00010000:2.0:1784189068.023360:0:87027:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc04a20b400, rc 0) 00000100:00100000:2.0:1784189068.023406:0:87027:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc07037c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd553d0d-03e2-4233-b06b-b55bbfa2b954+10:87021:x1870854458060544:12345-0@lo:101:mount.lustre.0 Request processed in 145us (309us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189068.023414:0:87027:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1784189068.023425:0:87021:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc06bbf3100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd553d0d-03e2-4233-b06b-b55bbfa2b954:87021:1870854458060544:0@lo:101:mount.lustre.0 00000004:00080000:1.0:1784189068.023434:0:87043:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 3310247114107ns, next at 0ns, rc = 0 00010000:00010000:3.0:1784189068.023440:0:87021:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: ffff9dc081b16400/0xcc1762b626f8abc6 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc1762b626f8abcd expref: -99 pid: 87021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00080000:00080000:1.0:1784189068.023440:0:87043:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0000: async commit OSD 00010000:00010000:3.0:1784189068.023448:0:87021:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: ffff9dc081b16400/0xcc1762b626f8abc6 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcc1762b626f8abcd expref: -99 pid: 87021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784189068.023500:0:87021:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc06bbf3100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd553d0d-03e2-4233-b06b-b55bbfa2b954:87021:1870854458060672:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1784189068.023526:0:87021:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784189068.023594:0:87021:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dc062096a80 going to sleep for 11 seconds 00000100:00100000:3.0:1784189068.023613:0:87027:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458060672 00000100:00100000:3.0:1784189068.023617:0:87027:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458060672 00000100:00100000:3.0:1784189068.023653:0:87027:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1784189068.023662:0:87027:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc07037f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd553d0d-03e2-4233-b06b-b55bbfa2b954+10:87021:x1870854458060672:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1784189068.023779:0:87027:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc07037f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd553d0d-03e2-4233-b06b-b55bbfa2b954+10:87021:x1870854458060672:12345-0@lo:501:mount.lustre.0 Request processed in 119us (251us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189068.023787:0:87027:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1784189068.024007:0:87021:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc06bbf3100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd553d0d-03e2-4233-b06b-b55bbfa2b954:87021:1870854458060672:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1784189068.024037:0:87021:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf4262e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd553d0d-03e2-4233-b06b-b55bbfa2b954:87021:1870854458060800:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1784189068.024079:0:87021:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784189068.024101:0:87021:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dc042badc00 going to sleep for 11 seconds 00000100:00100000:3.0:1784189068.024231:0:87031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458060800 00000100:00100000:3.0:1784189068.024236:0:87031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458060800 00000100:00100000:3.0:1784189068.024426:0:87031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1784189068.024434:0:87031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc07037e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:bd553d0d-03e2-4233-b06b-b55bbfa2b954+10:87021:x1870854458060800:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1784189068.024574:0:87031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc07037e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:bd553d0d-03e2-4233-b06b-b55bbfa2b954+10:87021:x1870854458060800:12345-0@lo:503:mount.lustre.0 Request processed in 140us (493us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189068.024581:0:87031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1784189068.024643:0:87021:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf4262e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd553d0d-03e2-4233-b06b-b55bbfa2b954:87021:1870854458060800:0@lo:503:mount.lustre.0 00000004:00080000:1.0:1784189068.025443:0:87022:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000100:00100000:2.0:1784189068.025549:0:87045:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf4262e300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bd553d0d-03e2-4233-b06b-b55bbfa2b954:87045:1870854458060928:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1784189068.025671:0:87045:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784189068.025743:0:87045:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dc042badc00 going to sleep for 11 seconds 00000100:00100000:2.0:1784189068.025775:0:87034:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458060928 00000100:00100000:2.0:1784189068.025781:0:87034:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458060928 00000100:00100000:2.0:1784189068.025918:0:87034:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1784189068.025935:0:87034:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc07037d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:bd553d0d-03e2-4233-b06b-b55bbfa2b954+10:87045:x1870854458060928:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1784189068.026350:0:87034:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc07037d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:bd553d0d-03e2-4233-b06b-b55bbfa2b954+10:87045:x1870854458060928:12345-0@lo:502:llog_process_th.0 Request processed in 423us (679us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189068.026358:0:87034:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1784189068.026382:0:87045:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf4262e300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bd553d0d-03e2-4233-b06b-b55bbfa2b954:87045:1870854458060928:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1784189068.026410:0:87045:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1784189068.026420:0:87045:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784189068.026422:0:87045:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1784189068.026429:0:87045:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9dc06b3eb800 00000020:00000080:3.0:1784189068.026432:0:87045:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1784189068.026441:0:87045:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1784189068.026443:0:87045:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784189068.026445:0:87045:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:3.0:1784189068.026447:0:87045:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1784189068.026449:0:87045:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784189068.026450:0:87045:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1784189068.026461:0:87045:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9dc06b3eb800 00000020:00000080:3.0:1784189068.026463:0:87045:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1784189068.026536:0:87045:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc06bbf3100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bd553d0d-03e2-4233-b06b-b55bbfa2b954:87045:1870854458061056:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1784189068.026571:0:87045:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784189068.026600:0:87045:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dc062096a80 going to sleep for 11 seconds 00000100:00100000:1.0:1784189068.026711:0:87026:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458061056 00000100:00100000:1.0:1784189068.026716:0:87026:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458061056 00000100:00100000:1.0:1784189068.026753:0:87026:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1784189068.026760:0:87026:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc07037f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd553d0d-03e2-4233-b06b-b55bbfa2b954+10:87045:x1870854458061056:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1784189068.026855:0:87026:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc07037f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd553d0d-03e2-4233-b06b-b55bbfa2b954+10:87045:x1870854458061056:12345-0@lo:502:llog_process_th.0 Request processed in 94us (282us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189068.026870:0:87026:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1784189068.027080:0:87045:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc06bbf3100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bd553d0d-03e2-4233-b06b-b55bbfa2b954:87045:1870854458061056:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1784189068.027110:0:87045:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1784189068.027115:0:87045:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784189068.027116:0:87045:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:3.0:1784189068.027120:0:87045:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:0.0:1784189068.027236:0:87021:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-6 (rc=0) 10000000:01000000:0.0:1784189068.027260:0:87021:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1784189068.027285:0:87021:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff9dc081b16400/0xcc1762b626f8abc6 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc1762b626f8abcd expref: -99 pid: 87021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189068.027295:0:87021:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: ffff9dc081b16400/0xcc1762b626f8abc6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc1762b626f8abcd expref: -99 pid: 87021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784189068.027372:0:87021:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1784189068.027375:0:87021:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9dc06b3eb800 10000000:01000000:0.0:1784189068.027378:0:87021:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9dc06b3eb800 10000000:01000000:0.0:1784189068.027382:0:87021:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1784189068.027388:0:87021:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9dc06b3eb800 from 1 10000000:01000000:0.0:1784189068.027391:0:87021:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1784189068.027420:0:87021:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff9dc070147a00/0xcc1762b626f8abd4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 87021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189068.027429:0:87021:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: ffff9dc070147a00/0xcc1762b626f8abd4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 87021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189068.027439:0:87021:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: ffff9dc070147a00/0xcc1762b626f8abd4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 87021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784189068.027455:0:87021:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc0762d5500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd553d0d-03e2-4233-b06b-b55bbfa2b954:87021:1870854458061184:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1784189068.027492:0:87021:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784189068.027511:0:87021:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dc0718de300 going to sleep for 11 seconds 00000100:00100000:3.0:1784189068.029412:0:87031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458061184 00000100:00100000:3.0:1784189068.029423:0:87031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458061184 00000100:00100000:3.0:1784189068.029473:0:87031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1784189068.029481:0:87031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc07037e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:bd553d0d-03e2-4233-b06b-b55bbfa2b954+10:87021:x1870854458061184:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1784189068.029495:0:87031:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784189068.029510:0:87031:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dc081b17000/0xcc1762b626f8abdb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xcc1762b626f8abd4 expref: -99 pid: 87031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189068.029535:0:87031:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dc081b17000/0xcc1762b626f8abdb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcc1762b626f8abd4 expref: 11 pid: 87031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189068.029546:0:87031:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dc081b17000/0xcc1762b626f8abdb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcc1762b626f8abd4 expref: 11 pid: 87031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189068.029554:0:87031:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc081b17000, rc 0) 00000100:00100000:3.0:1784189068.029616:0:87031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc07037e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:bd553d0d-03e2-4233-b06b-b55bbfa2b954+11:87021:x1870854458061184:12345-0@lo:101:mount.lustre.0 Request processed in 136us (2124us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189068.029623:0:87031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1784189068.029641:0:87021:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc0762d5500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd553d0d-03e2-4233-b06b-b55bbfa2b954:87021:1870854458061184:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1784189068.029660:0:87021:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: ffff9dc070147a00/0xcc1762b626f8abd4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc1762b626f8abdb expref: -99 pid: 87021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189068.029682:0:87021:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: ffff9dc070147a00/0xcc1762b626f8abd4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xcc1762b626f8abdb expref: -99 pid: 87021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784189068.029751:0:87021:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf4262f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd553d0d-03e2-4233-b06b-b55bbfa2b954:87021:1870854458061312:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1784189068.029786:0:87021:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784189068.029822:0:87021:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dc04a63b840 going to sleep for 11 seconds 00000100:00100000:3.0:1784189068.029996:0:87034:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458061312 00000100:00100000:3.0:1784189068.030007:0:87034:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458061312 00000100:00100000:3.0:1784189068.030041:0:87034:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1784189068.030047:0:87034:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc07037c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:bd553d0d-03e2-4233-b06b-b55bbfa2b954+11:87021:x1870854458061312:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1784189068.030180:0:87034:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc07037c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:bd553d0d-03e2-4233-b06b-b55bbfa2b954+11:87021:x1870854458061312:12345-0@lo:501:mount.lustre.0 Request processed in 129us (390us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189068.030187:0:87034:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1784189068.030451:0:87021:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf4262f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd553d0d-03e2-4233-b06b-b55bbfa2b954:87021:1870854458061312:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1784189068.030486:0:87021:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf4262f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd553d0d-03e2-4233-b06b-b55bbfa2b954:87021:1870854458061440:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1784189068.030525:0:87021:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784189068.030543:0:87021:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dc04a63b840 going to sleep for 11 seconds 00000100:00100000:0.0:1784189068.030575:0:87026:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458061440 00000100:00100000:0.0:1784189068.030580:0:87026:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458061440 00000100:00100000:0.0:1784189068.030609:0:87026:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1784189068.030624:0:87026:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc07037e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd553d0d-03e2-4233-b06b-b55bbfa2b954+11:87021:x1870854458061440:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1784189068.030712:0:87026:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc07037e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd553d0d-03e2-4233-b06b-b55bbfa2b954+11:87021:x1870854458061440:12345-0@lo:503:mount.lustre.0 Request processed in 89us (185us total) trans 0 rc 0/0 00000100:00100000:0.0:1784189068.030719:0:87026:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1784189068.030720:0:87021:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf4262f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd553d0d-03e2-4233-b06b-b55bbfa2b954:87021:1870854458061440:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1784189068.031988:0:87047:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf4262f480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bd553d0d-03e2-4233-b06b-b55bbfa2b954:87047:1870854458061568:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1784189068.032047:0:87047:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784189068.032084:0:87047:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dc04a63b540 going to sleep for 11 seconds 00000100:00100000:0.0:1784189068.032102:0:87027:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458061568 00000100:00100000:0.0:1784189068.032108:0:87027:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458061568 00000100:00100000:0.0:1784189068.032152:0:87027:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1784189068.032164:0:87027:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc07037fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd553d0d-03e2-4233-b06b-b55bbfa2b954+11:87047:x1870854458061568:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1784189068.032267:0:87027:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc07037fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd553d0d-03e2-4233-b06b-b55bbfa2b954+11:87047:x1870854458061568:12345-0@lo:502:llog_process_th.0 Request processed in 105us (220us total) trans 0 rc 0/0 00000100:00100000:0.0:1784189068.032274:0:87027:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1784189068.032406:0:87047:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf4262f480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bd553d0d-03e2-4233-b06b-b55bbfa2b954:87047:1870854458061568:0@lo:502:llog_process_th.0 00000020:01000004:2.0:1784189068.032467:0:87047:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:2.0:1784189068.032482:0:87047:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff9dc07547cd40) 00000020:00000080:2.0:1784189068.032507:0:87047:0:(obd_config.c:720:class_attach_name()) OBD: dev 28 attached type lwp with refcount 2 00000020:01000004:2.0:1784189068.032792:0:87047:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9dc06b3eb800 from lustre-MDT0000, refs=4 00000020:01000004:2.0:1784189068.032797:0:87047:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9dc06b3eb800 from lustre-MDT0000, refs=4 00000020:01000004:2.0:1784189068.032800:0:87047:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9dc06b3eb800 4 00010000:00080000:2.0:1784189068.032829:0:87047:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9dc07a883800@lustre-MDT0000-lwp-MDT0000: add connection 192.168.203.112@tcp at head 00010000:00010000:1.0:1784189068.042920:0:87047:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-12 is initialized 00000020:00000080:1.0:1784189068.043052:0:87047:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:1.0:1784189068.043105:0:87047:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1784189068.043119:0:87047:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0xcc1762b626f8abe9 00000100:00080000:1.0:1784189068.043129:0:87047:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1784189068.043135:0:87047:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff9dc07a883800 using connection 192.168.203.112@tcp/0@lo 00000100:00100000:1.0:1784189068.043169:0:87047:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9dc05f02ed80 x1870854458061696/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1784189068.043204:0:87047:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1784189068.043532:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc05f02ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3639:1870854458061696:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1784189068.043603:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784189068.043731:0:66171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458061696 00000100:00100000:1.0:1784189068.043738:0:66171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458061696 00000100:00100000:1.0:1784189068.043769:0:66171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1121 00000100:00100000:1.0:1784189068.043777:0:66171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf4262f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3639:x1870854458061696:12345-0@lo:38:llog_process_th.0 00000100:00100000:1.0:1784189068.043839:0:66171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf4262f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3639:x1870854458061696:12345-0@lo:38:llog_process_th.0 Request processed in 61us (235us total) trans 0 rc -11/-11 00000100:00100000:1.0:1784189068.043847:0:66171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1121 00000100:00100000:1.0:1784189068.043962:0:3639:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1784189068.043971:0:3639:0:(import.c:65:import_set_state_nolock()) ffff9dc07a883800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1784189068.043976:0:3639:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1784189068.043980:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc05f02ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3639:1870854458061696:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1784189068.046077:0:87047:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc0762d4a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bd553d0d-03e2-4233-b06b-b55bbfa2b954:87047:1870854458061824:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1784189068.046152:0:87047:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784189068.046192:0:87047:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dc0718de780 going to sleep for 11 seconds 00000100:00100000:3.0:1784189068.046315:0:87031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458061824 00000100:00100000:3.0:1784189068.046352:0:87031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458061824 00000100:00100000:3.0:1784189068.046396:0:87031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1784189068.046405:0:87031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc07037c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:bd553d0d-03e2-4233-b06b-b55bbfa2b954+11:87047:x1870854458061824:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1784189068.046526:0:87031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc07037c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:bd553d0d-03e2-4233-b06b-b55bbfa2b954+11:87047:x1870854458061824:12345-0@lo:502:llog_process_th.0 Request processed in 122us (373us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189068.046534:0:87031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1784189068.046796:0:87047:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc0762d4a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bd553d0d-03e2-4233-b06b-b55bbfa2b954:87047:1870854458061824:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1784189068.046841:0:87047:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc06bbf3100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bd553d0d-03e2-4233-b06b-b55bbfa2b954:87047:1870854458061952:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1784189068.046877:0:87047:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784189068.046900:0:87028:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458061952 00000100:00100000:3.0:1784189068.046903:0:87028:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458061952 00000100:00100000:3.0:1784189068.046938:0:87028:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1784189068.046946:0:87028:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc07b22a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd553d0d-03e2-4233-b06b-b55bbfa2b954+11:87047:x1870854458061952:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1784189068.047015:0:87028:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc07b22a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd553d0d-03e2-4233-b06b-b55bbfa2b954+11:87047:x1870854458061952:12345-0@lo:502:llog_process_th.0 Request processed in 69us (137us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189068.047022:0:87028:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1784189068.047061:0:87047:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dc0718de780 going to sleep for 11 seconds 00000100:00100000:3.0:1784189068.047074:0:87047:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc06bbf3100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bd553d0d-03e2-4233-b06b-b55bbfa2b954:87047:1870854458061952:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1784189068.047101:0:87047:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:0.0:1784189068.047316:0:87021:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:0.0:1784189068.047369:0:87021:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1784189068.047383:0:87021:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff9dc070147a00/0xcc1762b626f8abd4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc1762b626f8abdb expref: -99 pid: 87021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189068.047394:0:87021:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: ffff9dc070147a00/0xcc1762b626f8abd4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc1762b626f8abdb expref: -99 pid: 87021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1784189068.047448:0:87021:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1784189068.047451:0:87021:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1784189068.047452:0:87021:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1784189068.047454:0:87021:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1784189068.047455:0:87021:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1784189068.047456:0:87021:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1784189068.047458:0:87021:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1784189068.047463:0:87021:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1784189068.047465:0:87021:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1784189068.047466:0:87021:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1784189068.047470:0:87021:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:0.0:1784189068.047473:0:87021:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1784189068.047474:0:87021:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1784189068.047475:0:87021:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1784189068.047477:0:87021:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1784189068.047478:0:87021:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1784189068.047479:0:87021:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1784189068.047481:0:87021:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1784189068.047482:0:87021:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1784189068.047483:0:87021:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1784189068.047485:0:87021:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1784189068.047500:0:87021:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:0.0:1784189068.047510:0:87021:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc0762d7b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd553d0d-03e2-4233-b06b-b55bbfa2b954:87021:1870854458062080:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1784189068.047546:0:87021:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784189068.047565:0:87021:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dbf44443900 going to sleep for 11 seconds 00000100:00100000:3.0:1784189068.048369:0:87034:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458062080 00000100:00100000:3.0:1784189068.048377:0:87034:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458062080 00000100:00100000:3.0:1784189068.048425:0:87034:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1784189068.048437:0:87034:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc07b229c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:bd553d0d-03e2-4233-b06b-b55bbfa2b954+11:87021:x1870854458062080:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1784189068.048464:0:87034:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:3.0:1784189068.048479:0:87034:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1784189068.054981:0:87034:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1784189068.055004:0:87034:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:0.0:1784189068.055105:0:87032:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1784189068.055109:0:87032:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1784189068.055130:0:87032:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9dc070147800/0xcc1762b626f8abf0 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 87032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189068.055147:0:87032:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9dc081b16200/0xcc1762b626f8abbf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcc1762b626f8abb8 expref: 11 pid: 87034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189068.055156:0:87032:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9dc070147800/0xcc1762b626f8abf0 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 87032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189068.055193:0:87032:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9dc081b16200/0xcc1762b626f8abbf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcc1762b626f8abb8 expref: 11 pid: 87034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189068.055221:0:87032:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9dc081b16200/0xcc1762b626f8abbf lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcc1762b626f8abb8 expref: 11 pid: 87034 timeout: 3410 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784189068.055257:0:87032:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc0762d6680 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:87032:1870854458062208:0@lo:104: 00000100:00100000:0.0:1784189068.055361:0:87032:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784189068.055370:0:87034:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc07b229c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:bd553d0d-03e2-4233-b06b-b55bbfa2b954+11:87021:x1870854458062080:12345-0@lo:253:mount.lustre.0 Request processed in 6933us (7821us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189068.055381:0:87034:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1784189068.055399:0:87032:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dc07563bb40 going to sleep for 11 seconds 00000100:00100000:0.0:1784189068.055425:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458062208 00000100:00100000:0.0:1784189068.055431:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458062208 00000100:00100000:0.0:1784189068.055478:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 308 00000100:00100000:0.0:1784189068.055488:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc0762d5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:bd553d0d-03e2-4233-b06b-b55bbfa2b954+3:87032:x1870854458062208:12345-0@lo:104: 00010000:00010000:0.0:1784189068.055500:0:6497:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.112@tcp lock: ffff9dc0565e6600/0xcc1762b626f8abb8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xcc1762b626f8abbf expref: -99 pid: 87021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189068.055558:0:6497:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1784189068.055564:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc0762d5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:bd553d0d-03e2-4233-b06b-b55bbfa2b954+3:87032:x1870854458062208:12345-0@lo:104: Request processed in 78us (205us total) trans 0 rc 0/0 00000100:00100000:0.0:1784189068.055571:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 308 00010000:00010000:0.0:1784189068.055590:0:26173:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784189068.055596:0:26173:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.112@tcp lock: ffff9dc0565e6600/0xcc1762b626f8abb8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xcc1762b626f8abbf expref: -99 pid: 87021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189068.055603:0:26173:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc0565e6600 already unused, calling callback (ffffffffc114ac20) 10000000:00010000:0.0:1784189068.055607:0:26173:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.112@tcp lock: ffff9dc0565e6600/0xcc1762b626f8abb8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xcc1762b626f8abbf expref: -99 pid: 87021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189068.055615:0:26173:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.112@tcp lock: ffff9dc0565e6600/0xcc1762b626f8abb8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xcc1762b626f8abbf expref: -99 pid: 87021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1784189068.055623:0:26173:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.112@tcp lock: ffff9dc0565e6600/0xcc1762b626f8abb8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xcc1762b626f8abbf expref: -99 pid: 87021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784189068.055641:0:26173:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00000100:00100000:2.0:1784189068.055644:0:87032:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc0762d6680 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:87032:1870854458062208:0@lo:104: 00010000:00010000:2.0:1784189068.055667:0:87032:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9dc070147800/0xcc1762b626f8abf0 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 87032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189068.055840:0:26173:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.112@tcp lock: ffff9dc0565e6600/0xcc1762b626f8abb8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcc1762b626f8abbf expref: -99 pid: 87021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189068.055847:0:26173:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1784189068.055896:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc0762d4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bd553d0d-03e2-4233-b06b-b55bbfa2b954:3640:1870854458062336:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1784189068.055937:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784189068.056003:0:7455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458062336 00000100:00100000:1.0:1784189068.056007:0:7455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458062336 00010000:00010000:1.0:1784189068.056024:0:7455:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9dc081b16200/0xcc1762b626f8abbf lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcc1762b626f8abb8 expref: 11 pid: 87034 timeout: 3410 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784189068.056047:0:7455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2541 00000100:00100000:1.0:1784189068.056061:0:7455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf4262c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bd553d0d-03e2-4233-b06b-b55bbfa2b954+11:3640:x1870854458062336:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1784189068.056072:0:7455:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784189068.056077:0:7455:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9dc081b16200/0xcc1762b626f8abbf lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcc1762b626f8abb8 expref: 11 pid: 87034 timeout: 3410 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189068.056087:0:7455:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9dc081b16200/0xcc1762b626f8abbf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcc1762b626f8abb8 expref: 11 pid: 87034 timeout: 3410 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189068.056100:0:7455:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dc081b16200/0xcc1762b626f8abbf lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcc1762b626f8abb8 expref: 11 pid: 87034 timeout: 3410 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189068.056115:0:7455:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9dc070147800/0xcc1762b626f8abf0 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 87032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189068.056122:0:7455:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dc070147800/0xcc1762b626f8abf0 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 87032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1784189068.056134:0:7455:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001024918s 00010000:00010000:1.0:1784189068.056138:0:7455:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9dc070147800/0xcc1762b626f8abf0 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 87032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189068.056145:0:7455:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9dc070147800/0xcc1762b626f8abf0 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 87032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189068.056152:0:7455:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9dc070147800/0xcc1762b626f8abf0 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 87032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189068.056158:0:7455:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9dc070147800/0xcc1762b626f8abf0 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 87032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189068.056163:0:7455:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc070147800 already unused, calling callback (ffffffffc0b2e230) 00010000:00010000:1.0:1784189068.056173:0:7455:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9dc070147800/0xcc1762b626f8abf0 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 87032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189068.056180:0:7455:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9dc070147800/0xcc1762b626f8abf0 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 87032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189068.056205:0:7455:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9dc070147800/0xcc1762b626f8abf0 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 87032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189068.056215:0:7455:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1784189068.056258:0:26173:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.112@tcp lock: ffff9dc0565e6600/0xcc1762b626f8abb8 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcc1762b626f8abbf expref: -99 pid: 87021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189068.056266:0:26173:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.112@tcp lock: ffff9dc0565e6600/0xcc1762b626f8abb8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcc1762b626f8abbf expref: -99 pid: 87021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189068.056280:0:26173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784189068.056282:0:26173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784189068.056284:0:26173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784189068.056386:0:87021:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc0762d7b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd553d0d-03e2-4233-b06b-b55bbfa2b954:87021:1870854458062080:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1784189068.056397:0:87021:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:0.0:1784189068.056400:0:87021:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1784189068.056401:0:87021:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1784189068.056402:0:87021:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1784189068.056404:0:87021:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1784189068.056405:0:87021:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1784189068.056406:0:87021:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1784189068.056408:0:87021:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1784189068.056409:0:87021:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1784189068.056411:0:87021:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1784189068.056412:0:87021:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1784189068.056423:0:87021:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00010000:00010000:0.0:1784189068.057871:0:87032:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9dc070147800/0xcc1762b626f8abf0 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 87032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189068.057882:0:87032:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9dc070147800/0xcc1762b626f8abf0 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 87032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189068.057899:0:87032:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dc070147800/0xcc1762b626f8abf0 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 87032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784189068.058173:0:7455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf4262c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bd553d0d-03e2-4233-b06b-b55bbfa2b954+10:3640:x1870854458062336:12345-0@lo:103:ldlm_bl.0 Request processed in 2110us (2242us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189068.058184:0:7455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2541 00000100:00100000:2.0:1784189068.060419:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc0762d4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bd553d0d-03e2-4233-b06b-b55bbfa2b954:3640:1870854458062336:0@lo:103:ldlm_bl.0 00000020:00080000:3.0:1784189068.067461:0:87021:0:(update_trans.c:1495:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 73014444062 00000040:01000000:0.0:1784189068.067709:0:87021:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:1.0:1784189068.067916:0:87053:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 73014444062 00000020:00080000:1.0:1784189068.067921:0:87053:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 73014444062 00000040:01000000:3.0:1784189068.071046:0:87054:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:0.0:1784189068.071295:0:87021:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osp-MDT0000 ctxt 16 is initialized 00000100:00100000:0.0:1784189068.071812:0:87055:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc0762d7b80 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:87055:1870854458062464:0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1784189068.071881:0:87055:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784189068.071913:0:87055:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dc0467bde40 going to sleep for 11 seconds 00000100:00100000:1.0:1784189068.072072:0:26492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458062464 00000100:00100000:1.0:1784189068.072080:0:26492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458062464 00000100:00100000:1.0:1784189068.072187:0:26492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3735 00000100:00100000:1.0:1784189068.072199:0:26492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc0762d4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:87055:x1870854458062464:12345-0@lo:1000:lod0000_rec0001.0 00000040:01000000:3.0:1784189068.072241:0:87021:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:3.0:1784189068.072277:0:87021:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1784189068.072278:0:26492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc0762d4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:87055:x1870854458062464:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 81us (398us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189068.072286:0:26492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3735 00000004:00000080:3.0:1784189068.072729:0:87021:0:(mdd_device.c:553:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:3.0:1784189068.072736:0:87021:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:3.0:1784189068.072767:0:87021:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1784189068.073730:0:87021:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:3.0:1784189068.074288:0:87021:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:3.0:1784189068.074349:0:87021:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:3.0:1784189068.074427:0:87021:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1784189068.075142:0:87055:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc0762d7b80 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:87055:1870854458062464:0@lo:1000:lod0000_rec0001.0 00000040:01000000:0.0:1784189068.075177:0:87055:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:0.0:1784189068.075218:0:87055:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc0762d7b80 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:87055:1870854458062592:0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1784189068.075281:0:87055:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784189068.075314:0:87055:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dc0467bde40 going to sleep for 11 seconds 00000040:00080000:2.0:1784189068.075461:0:87054:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1784189068.077500:0:87054:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x20000a810:0x1:0x0] index 261376 count 1 00000004:00080000:2.0:1784189068.077597:0:87054:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000100:00100000:3.0:1784189068.078199:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458062592 00000100:00100000:3.0:1784189068.078208:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458062592 00000100:00100000:3.0:1784189068.078264:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3736 00000100:00100000:3.0:1784189068.078274:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc0762d5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:87055:x1870854458062592:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1784189068.078764:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc0762d5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:87055:x1870854458062592:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 490us (3481us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189068.078773:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3736 00080000:10000000:3.0:1784189068.078913:0:87021:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x4b:0x0] (8/32) registered 00000100:00100000:0.0:1784189068.081204:0:87055:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc0762d7b80 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:87055:1870854458062592:0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1784189068.081397:0:87055:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc05f02ed80 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:87055:1870854458062720:0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1784189068.081454:0:87055:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784189068.081482:0:87055:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dc076067cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1784189068.081832:0:26492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458062720 00000100:00100000:3.0:1784189068.081839:0:26492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458062720 00000100:00100000:3.0:1784189068.081887:0:26492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3737 00000100:00100000:3.0:1784189068.081905:0:26492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc081f82300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:87055:x1870854458062720:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1784189068.081995:0:26492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc081f82300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:87055:x1870854458062720:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 92us (541us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189068.082003:0:26492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3737 00000100:00100000:2.0:1784189068.082072:0:87055:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc05f02ed80 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:87055:1870854458062720:0@lo:1000:lod0000_rec0001.0 00000040:00080000:2.0:1784189068.082128:0:87055:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1784189068.084149:0:87055:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x2400090a4:0x1:0x0] index 261376 count 1 00000004:00080000:2.0:1784189068.084226:0:87055:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osp-MDT0000 retrieved update log, duration 0, retries 0 00000004:00080000:2.0:1784189068.084231:0:87055:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00010000:00080000:0.0:1784189068.085152:0:87021:0:(ldlm_lib.c:3053:target_recovery_init()) RECOVERY: service lustre-MDT0000, 2 recoverable clients, last_transno 98784247812 00010000:00080000:0.0:1784189068.085894:0:87056:0:(ldlm_lib.c:2853:target_recovery_thread()) lustre-MDT0000: started recovery thread pid 87056 00010000:02000000:0.0:1784189068.085909:0:87056:0:(ldlm_lib.c:2335:target_recovery_overseer()) lustre-MDT0000: in recovery but waiting for the first client to connect 00010000:00080000:0.0:1784189068.085912:0:87056:0:(ldlm_lib.c:2545:check_for_recovery_ready()) connected 0 stale 0 max_recoverable_clients 2 abort 0 expired 0 00010000:00080000:0.0:1784189068.085915:0:87056:0:(ldlm_lib.c:2545:check_for_recovery_ready()) connected 0 stale 0 max_recoverable_clients 2 abort 0 expired 0 00000020:01000004:3.0:1784189068.086011:0:87021:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1784189068.086025:0:87021:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.112@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1784189068.086043:0:87021:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=46 00000080:00000004:3.0:1784189068.086060:0:87021:0:(super25.c:181:lustre_fill_super()) /dev/mapper/mds1_flakey: Mount complete 00000020:00000004:3.0:1784189068.086905:0:87021:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1784189068.087173:0:87021:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:0.0:1784189068.584972:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1784189068.585056:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1784189068.585116:0:87026:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436245376 00000100:00100000:0.0:1784189068.585125:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1784189068.585127:0:87026:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436245376 00000100:00100000:1.0:1784189068.585136:0:68287:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436245632 00000100:00100000:1.0:1784189068.585143:0:68287:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436245632 00000100:00100000:0.0:1784189068.585152:0:66169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436245504 00000100:00100000:0.0:1784189068.585155:0:66169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436245504 00000100:00100000:3.0:1784189068.585174:0:87026:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 25 00000100:00100000:0.0:1784189068.585183:0:66169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1060 00000100:00100000:1.0:1784189068.585189:0:68287:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1122 00000100:00100000:0.0:1784189068.585192:0:66169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc0762d7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+6:2396:x1870854436245632:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:1.0:1784189068.585193:0:68287:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc0762d4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2395:x1870854436245504:12345-192.168.203.12@tcp:38:kworker.0 00000100:00100000:3.0:1784189068.585203:0:87026:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc07b228050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:2395:x1870854436245376:12345-192.168.203.12@tcp:250:kworker.0 00010000:00080000:1.0:1784189068.585226:0:68287:0:(ldlm_lib.c:938:target_handle_reconnect()) connect export for UUID 'b90fcc1c-0e69-42a4-a116-a71fec7aeb78' at ffff9dbf430fb800, cookie 0xcc1762b626f8ab41 00010000:00080000:3.0:1784189068.585232:0:87026:0:(ldlm_lib.c:1445:target_handle_connect()) MGS: connection from 9957a2dc-fd88-4a91-bca3-e2b7f365ab0c@192.168.203.12@tcp t0 exp 0000000000000000 cur 3310 last 0 00010000:00080000:1.0:1784189068.585235:0:68287:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from b90fcc1c-0e69-42a4-a116-a71fec7aeb78@192.168.203.12@tcp recovering/t98784247813 exp ffff9dbf430fb800 cur 3310 last 1784189067 00010000:02000400:1.0:1784189068.585246:0:68287:0:(ldlm_lib.c:2036:target_start_recovery_timer()) lustre-MDT0000: Will be in recovery for at least 1:00, or until 2 clients reconnect 00010000:00080000:1.0:1784189068.585252:0:68287:0:(ldlm_lib.c:2100:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 70 seconds 00000004:00100000:1.0:1784189068.585270:0:68287:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00100000:0.0:1784189068.585270:0:66169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc0762d7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+6:2396:x1870854436245632:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 80us (214us total) trans 0 rc 0/0 00000020:00000080:3.0:1784189068.585273:0:87026:0:(genops.c:1406:class_connect()) connect: client 9957a2dc-fd88-4a91-bca3-e2b7f365ab0c, cookie 0xcc1762b626f8abf7 00000100:00100000:0.0:1784189068.585280:0:66169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1060 00000100:00080000:1.0:1784189068.585423:0:68287:0:(import.c:65:import_set_state_nolock()) ffff9dc07b5d1800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1784189068.585465:0:68287:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc0762d4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+6:2395:x1870854436245504:12345-192.168.203.12@tcp:38:kworker.0 Request processed in 268us (339us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189068.585472:0:68287:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1122 00000100:00080000:1.0:1784189068.585494:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1784189068.585827:0:87026:0:(import.c:65:import_set_state_nolock()) ffff9dbf42275000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1784189068.585878:0:87026:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc07b228050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9957a2dc-fd88-4a91-bca3-e2b7f365ab0c+5:2395:x1870854436245376:12345-192.168.203.12@tcp:250:kworker.0 Request processed in 694us (914us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189068.585887:0:87026:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 25 00000100:00100000:0.0:1784189068.591224:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1784189068.591379:0:66945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436239232 00000100:00100000:2.0:1784189068.591389:0:66945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436239232 00000100:00100000:2.0:1784189068.591454:0:66945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1123 00000100:00100000:2.0:1784189068.591465:0:66945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc0762d6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+6:2395:x1870854436239232:12345-192.168.203.12@tcp:36:mcreate.0 00010000:00080000:2.0:1784189068.591484:0:66945:0:(ldlm_lib.c:3228:target_queue_recovery_request()) Next recovery transno: 98784247813, current: 98784247813, replaying 00000100:00100000:2.0:1784189068.591505:0:66945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc0762d6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+6:2395:x1870854436239232:12345-192.168.203.12@tcp:36:mcreate.0 Request processed in 43us (291us total) trans 0 rc 0/-999 00000100:00100000:2.0:1784189068.591523:0:66945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1123 00010000:00080000:0.0:1784189068.591534:0:87056:0:(ldlm_lib.c:2545:check_for_recovery_ready()) connected 1 stale 0 max_recoverable_clients 2 abort 0 expired 0 10000000:01000000:2.0:1784189068.981515:0:6510:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1784189068.981522:0:6510:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff9dc06b3eb800 from 108 10000000:01000000:2.0:1784189068.981528:0:6510:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1784189068.981584:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff9dc04a20ae00/0xcc1762b626f8abfe lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189068.981597:0:6510:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: ffff9dc04a20ae00/0xcc1762b626f8abfe lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189068.981608:0:6510:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: ffff9dc04a20ae00/0xcc1762b626f8abfe lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784189068.981632:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf4262e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458062848:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1784189068.981690:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784189068.981724:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dc04a63b0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1784189068.981919:0:87027:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458062848 00000100:00100000:3.0:1784189068.981935:0:87027:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458062848 00000100:00100000:3.0:1784189068.981984:0:87027:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1784189068.981992:0:87027:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc07b228c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd553d0d-03e2-4233-b06b-b55bbfa2b954+10:6510:x1870854458062848:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784189068.982004:0:87027:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784189068.982017:0:87027:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dc081b16c00/0xcc1762b626f8ac05 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xcc1762b626f8abfe expref: -99 pid: 87027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189068.982058:0:87027:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dc081b16c00/0xcc1762b626f8ac05 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcc1762b626f8abfe expref: 11 pid: 87027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189068.982068:0:87027:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dc081b16c00/0xcc1762b626f8ac05 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcc1762b626f8abfe expref: 11 pid: 87027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189068.982077:0:87027:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc081b16c00, rc 0) 00000100:00100000:3.0:1784189068.982110:0:87027:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc07b228c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd553d0d-03e2-4233-b06b-b55bbfa2b954+11:6510:x1870854458062848:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 119us (419us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189068.982117:0:87027:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1784189068.982263:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf4262e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458062848:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1784189068.982276:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: ffff9dc04a20ae00/0xcc1762b626f8abfe lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc1762b626f8ac05 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189068.982286:0:6510:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: ffff9dc04a20ae00/0xcc1762b626f8abfe lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcc1762b626f8ac05 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784189068.982351:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf4262e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458062976:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1784189068.982379:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784189068.984788:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dc04a63b0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1784189068.990657:0:87027:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458062976 00000100:00100000:3.0:1784189068.990674:0:87027:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458062976 00000100:00100000:1.0:1784189068.990911:0:87034:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1784189068.990934:0:87034:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc07b22b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:bd553d0d-03e2-4233-b06b-b55bbfa2b954+11:6510:x1870854458062976:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1784189068.990960:0:87034:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1784189068.990977:0:87034:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1784189068.990980:0:87034:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 108 00000100:00100000:1.0:1784189068.991120:0:87034:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc07b22b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:bd553d0d-03e2-4233-b06b-b55bbfa2b954+11:6510:x1870854458062976:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 199us (8738us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189068.991258:0:87034:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1784189068.991382:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf4262e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458062976:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1784189068.991446:0:6510:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1784189068.991457:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff9dc04a20ae00/0xcc1762b626f8abfe lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc1762b626f8ac05 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189068.991469:0:6510:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: ffff9dc04a20ae00/0xcc1762b626f8abfe lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc1762b626f8ac05 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784189068.991490:0:6510:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1784189068.991492:0:6510:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9dbf44675800 from 52 10000000:01000000:1.0:1784189068.991495:0:6510:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1784189068.991527:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff9dc0565e7600/0xcc1762b626f8ac0c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189068.991536:0:6510:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: ffff9dc0565e7600/0xcc1762b626f8ac0c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189068.991545:0:6510:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: ffff9dc0565e7600/0xcc1762b626f8ac0c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784189068.991581:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc05ed7ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458063104:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1784189068.991618:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784189068.991649:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dc05085b540 going to sleep for 11 seconds 00000100:00100000:3.0:1784189068.993729:0:87027:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458063104 00000100:00100000:3.0:1784189068.993745:0:87027:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458063104 00000100:00100000:3.0:1784189068.993797:0:87027:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1784189068.993808:0:87027:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc07b22ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd553d0d-03e2-4233-b06b-b55bbfa2b954+11:6510:x1870854458063104:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784189068.993824:0:87027:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784189068.993842:0:87027:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dc081b16600/0xcc1762b626f8ac13 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xcc1762b626f8ac0c expref: -99 pid: 87027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189068.993870:0:87027:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dc081b16600/0xcc1762b626f8ac13 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcc1762b626f8ac0c expref: 12 pid: 87027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189068.993881:0:87027:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dc081b16600/0xcc1762b626f8ac13 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcc1762b626f8ac0c expref: 12 pid: 87027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189068.993889:0:87027:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc081b16600, rc 0) 00000100:00100000:3.0:1784189068.993971:0:87027:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc07b22ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd553d0d-03e2-4233-b06b-b55bbfa2b954+12:6510:x1870854458063104:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 165us (2353us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189068.993986:0:87027:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1784189068.994230:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc05ed7ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458063104:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784189068.994248:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: ffff9dc0565e7600/0xcc1762b626f8ac0c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc1762b626f8ac13 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189068.994258:0:6510:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: ffff9dc0565e7600/0xcc1762b626f8ac0c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xcc1762b626f8ac13 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784189068.994349:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc05ed7ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458063232:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1784189068.994381:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784189068.994400:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dc05085b540 going to sleep for 11 seconds 00000100:00100000:1.0:1784189068.994415:0:87034:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458063232 00000100:00100000:1.0:1784189068.994419:0:87034:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458063232 00000100:00100000:1.0:1784189068.994454:0:87034:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1784189068.994460:0:87034:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc07b22a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:bd553d0d-03e2-4233-b06b-b55bbfa2b954+12:6510:x1870854458063232:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1784189068.994649:0:87034:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc07b22a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:bd553d0d-03e2-4233-b06b-b55bbfa2b954+12:6510:x1870854458063232:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 188us (266us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189068.994656:0:87034:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1784189068.994691:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc05ed7ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458063232:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1784189068.994720:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc05ed7ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458063360:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1784189068.994760:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784189068.994771:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dc05085b540 going to sleep for 11 seconds 00000100:00100000:3.0:1784189068.994846:0:87026:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458063360 00000100:00100000:3.0:1784189068.994851:0:87026:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458063360 00000100:00100000:3.0:1784189068.994884:0:87026:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1784189068.994890:0:87026:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc07b229450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd553d0d-03e2-4233-b06b-b55bbfa2b954+12:6510:x1870854458063360:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1784189068.994977:0:87026:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc07b229450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd553d0d-03e2-4233-b06b-b55bbfa2b954+12:6510:x1870854458063360:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 87us (217us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189068.994984:0:87026:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1784189068.995876:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc05ed7ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458063360:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1784189068.999479:0:87111:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 51 00000020:01000000:1.0:1784189068.999738:0:6510:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 52-51 (rc=0) 10000000:01000000:1.0:1784189068.999761:0:6510:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1784189068.999773:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff9dc0565e7600/0xcc1762b626f8ac0c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc1762b626f8ac13 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189068.999784:0:6510:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: ffff9dc0565e7600/0xcc1762b626f8ac0c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc1762b626f8ac13 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784189068.999794:0:6510:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1784189068.999798:0:6510:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff9dbf44675800 from 105 10000000:01000000:1.0:1784189068.999801:0:6510:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1784189068.999841:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff9dc0565e6a00/0xcc1762b626f8ac1a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189068.999848:0:6510:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: ffff9dc0565e6a00/0xcc1762b626f8ac1a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189068.999858:0:6510:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: ffff9dc0565e6a00/0xcc1762b626f8ac1a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784189068.999892:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc05ed7ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458063488:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1784189068.999967:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784189069.000009:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dc05085b540 going to sleep for 11 seconds 00000100:00100000:3.0:1784189069.000061:0:87028:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458063488 00000100:00100000:3.0:1784189069.000067:0:87028:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458063488 00000100:00100000:3.0:1784189069.000117:0:87028:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1784189069.000272:0:87028:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc07b229850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd553d0d-03e2-4233-b06b-b55bbfa2b954+12:6510:x1870854458063488:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784189069.000288:0:87028:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784189069.000302:0:87028:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dc081b16a00/0xcc1762b626f8ac21 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xcc1762b626f8ac1a expref: -99 pid: 87028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189069.000434:0:87028:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dc081b16a00/0xcc1762b626f8ac21 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcc1762b626f8ac1a expref: 13 pid: 87028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189069.000446:0:87028:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dc081b16a00/0xcc1762b626f8ac21 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcc1762b626f8ac1a expref: 13 pid: 87028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189069.000454:0:87028:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc081b16a00, rc 0) 00000100:00100000:3.0:1784189069.000499:0:87028:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc07b229850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd553d0d-03e2-4233-b06b-b55bbfa2b954+13:6510:x1870854458063488:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 374us (531us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189069.000506:0:87028:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1784189069.000598:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc05ed7ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458063488:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784189069.000611:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: ffff9dc0565e6a00/0xcc1762b626f8ac1a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc1762b626f8ac21 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189069.000619:0:6510:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: ffff9dc0565e6a00/0xcc1762b626f8ac1a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xcc1762b626f8ac21 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784189069.000670:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc05ed7ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458063616:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1784189069.000700:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784189069.000725:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dc05085b540 going to sleep for 11 seconds 00000100:00100000:3.0:1784189069.000824:0:87026:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458063616 00000100:00100000:3.0:1784189069.000829:0:87026:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458063616 00000100:00100000:3.0:1784189069.000866:0:87026:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1784189069.000873:0:87026:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc07b22b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd553d0d-03e2-4233-b06b-b55bbfa2b954+13:6510:x1870854458063616:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1784189069.000887:0:87026:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1784189069.000903:0:87026:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1784189069.000907:0:87026:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/4/3. 20000000:01000000:3.0:1784189069.000910:0:87026:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/4/3. 20000000:01000000:3.0:1784189069.000913:0:87026:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/4/3. 20000000:01000000:3.0:1784189069.000915:0:87026:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 108 00000100:00100000:3.0:1784189069.001010:0:87026:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc07b22b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd553d0d-03e2-4233-b06b-b55bbfa2b954+13:6510:x1870854458063616:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 137us (309us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189069.001018:0:87026:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1784189069.001135:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc05ed7ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458063616:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1784189069.001215:0:6510:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1784189069.001220:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff9dc0565e6a00/0xcc1762b626f8ac1a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc1762b626f8ac21 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189069.001228:0:6510:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: ffff9dc0565e6a00/0xcc1762b626f8ac1a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc1762b626f8ac21 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784189069.001234:0:6510:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:2.0:1784189069.001236:0:6510:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 46 10000000:01000000:2.0:1784189069.001238:0:6510:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:2.0:1784189069.001257:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff9dc04a20b800/0xcc1762b626f8ac28 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189069.001265:0:6510:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: ffff9dc04a20b800/0xcc1762b626f8ac28 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189069.001273:0:6510:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: ffff9dc04a20b800/0xcc1762b626f8ac28 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784189069.001287:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf4262d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458063744:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1784189069.001315:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784189069.001359:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dc04a63bcc0 going to sleep for 11 seconds 00000100:00100000:3.0:1784189069.001458:0:87026:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458063744 00000100:00100000:3.0:1784189069.001463:0:87026:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458063744 00000100:00100000:3.0:1784189069.001494:0:87026:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1784189069.001501:0:87026:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc07b228850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd553d0d-03e2-4233-b06b-b55bbfa2b954+13:6510:x1870854458063744:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784189069.001508:0:87026:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784189069.001517:0:87026:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dc081b17e00/0xcc1762b626f8ac2f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xcc1762b626f8ac28 expref: -99 pid: 87026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189069.001533:0:87026:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dc081b17e00/0xcc1762b626f8ac2f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcc1762b626f8ac28 expref: 14 pid: 87026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189069.001542:0:87026:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dc081b17e00/0xcc1762b626f8ac2f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcc1762b626f8ac28 expref: 14 pid: 87026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189069.001549:0:87026:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc081b17e00, rc 0) 00000100:00100000:3.0:1784189069.001647:0:87026:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc07b228850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd553d0d-03e2-4233-b06b-b55bbfa2b954+14:6510:x1870854458063744:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 146us (330us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189069.001658:0:87026:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1784189069.001769:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf4262d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458063744:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1784189069.001781:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: ffff9dc04a20b800/0xcc1762b626f8ac28 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc1762b626f8ac2f expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189069.001788:0:6510:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: ffff9dc04a20b800/0xcc1762b626f8ac28 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xcc1762b626f8ac2f expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784189069.001854:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf4262d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458063872:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1784189069.001879:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784189069.001900:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dc04a63bcc0 going to sleep for 11 seconds 00000100:00100000:3.0:1784189069.001946:0:87028:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458063872 00000100:00100000:3.0:1784189069.001951:0:87028:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458063872 00000100:00100000:3.0:1784189069.001981:0:87028:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1784189069.001989:0:87028:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc07b22bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd553d0d-03e2-4233-b06b-b55bbfa2b954+14:6510:x1870854458063872:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784189069.002260:0:87028:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc07b22bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd553d0d-03e2-4233-b06b-b55bbfa2b954+14:6510:x1870854458063872:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 271us (380us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189069.002267:0:87028:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1784189069.002361:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf4262d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458063872:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1784189069.002388:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf4262d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458064000:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1784189069.002427:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784189069.002448:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dc04a63bcc0 going to sleep for 11 seconds 00000100:00100000:1.0:1784189069.002501:0:87027:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458064000 00000100:00100000:1.0:1784189069.002506:0:87027:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458064000 00000100:00100000:1.0:1784189069.002539:0:87027:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1784189069.002546:0:87027:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc07b229050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd553d0d-03e2-4233-b06b-b55bbfa2b954+14:6510:x1870854458064000:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1784189069.003407:0:87027:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc07b229050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd553d0d-03e2-4233-b06b-b55bbfa2b954+14:6510:x1870854458064000:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 859us (977us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189069.003416:0:87027:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1784189069.003508:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf4262d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458064000:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1784189069.004558:0:87112:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 64768 count 46 00000020:01000000:1.0:1784189069.005382:0:6510:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 46-45 (rc=0) 10000000:01000000:1.0:1784189069.005410:0:6510:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:1.0:1784189069.005420:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff9dc04a20b800/0xcc1762b626f8ac28 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc1762b626f8ac2f expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189069.005431:0:6510:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: ffff9dc04a20b800/0xcc1762b626f8ac28 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc1762b626f8ac2f expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784189069.005452:0:6510:0:(mgc_request.c:611:do_requeue()) updating log lustre-barrier 10000000:01000000:1.0:1784189069.005455:0:6510:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-barrier-ffff9dbf44675800 from 1 10000000:01000000:1.0:1784189069.005457:0:6510:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:1.0:1784189069.005489:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff9dc0565e6e00/0xcc1762b626f8ac36 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189069.005496:0:6510:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: ffff9dc0565e6e00/0xcc1762b626f8ac36 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189069.005506:0:6510:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: ffff9dc0565e6e00/0xcc1762b626f8ac36 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784189069.005527:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc05ed7f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458064128:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1784189069.009280:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784189069.009344:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dc05085b000 going to sleep for 11 seconds 00000100:00100000:2.0:1784189069.009449:0:87034:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458064128 00000100:00100000:2.0:1784189069.009459:0:87034:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458064128 00000100:00100000:2.0:1784189069.009517:0:87034:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1784189069.009527:0:87034:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc07b228450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:bd553d0d-03e2-4233-b06b-b55bbfa2b954+14:6510:x1870854458064128:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1784189069.009543:0:87034:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784189069.009572:0:87034:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dc04a20aa00/0xcc1762b626f8ac3d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xcc1762b626f8ac36 expref: -99 pid: 87034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189069.009599:0:87034:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dc04a20aa00/0xcc1762b626f8ac3d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcc1762b626f8ac36 expref: 15 pid: 87034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189069.009611:0:87034:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dc04a20aa00/0xcc1762b626f8ac3d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcc1762b626f8ac36 expref: 15 pid: 87034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189069.009620:0:87034:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc04a20aa00, rc 0) 00000100:00100000:2.0:1784189069.009668:0:87034:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc07b228450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:bd553d0d-03e2-4233-b06b-b55bbfa2b954+15:6510:x1870854458064128:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 143us (397us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189069.009683:0:87034:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1784189069.009888:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc05ed7f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458064128:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784189069.009905:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: ffff9dc0565e6e00/0xcc1762b626f8ac36 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc1762b626f8ac3d expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189069.009914:0:6510:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: ffff9dc0565e6e00/0xcc1762b626f8ac36 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xcc1762b626f8ac3d expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784189069.009941:0:6510:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:1.0:1784189069.009946:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff9dc0565e6e00/0xcc1762b626f8ac36 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc1762b626f8ac3d expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189069.009952:0:6510:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: ffff9dc0565e6e00/0xcc1762b626f8ac36 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc1762b626f8ac3d expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784189069.009969:0:6510:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1784189069.009972:0:6510:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9dbf44675800 from 7 10000000:01000000:1.0:1784189069.009974:0:6510:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1784189069.009995:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff9dc0565e6000/0xcc1762b626f8ac44 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189069.010002:0:6510:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: ffff9dc0565e6000/0xcc1762b626f8ac44 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189069.010021:0:6510:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: ffff9dc0565e6000/0xcc1762b626f8ac44 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784189069.010045:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc05ed7f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458064256:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1784189069.010074:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784189069.010103:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dc05085b000 going to sleep for 11 seconds 00000100:00100000:2.0:1784189069.010233:0:87028:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458064256 00000100:00100000:2.0:1784189069.010239:0:87028:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458064256 00000100:00100000:2.0:1784189069.010273:0:87028:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1784189069.010280:0:87028:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc07b22a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd553d0d-03e2-4233-b06b-b55bbfa2b954+15:6510:x1870854458064256:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1784189069.010287:0:87028:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784189069.010296:0:87028:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dc04a20a200/0xcc1762b626f8ac4b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xcc1762b626f8ac44 expref: -99 pid: 87028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189069.010309:0:87028:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dc04a20a200/0xcc1762b626f8ac4b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcc1762b626f8ac44 expref: 16 pid: 87028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189069.010343:0:87028:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dc04a20a200/0xcc1762b626f8ac4b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcc1762b626f8ac44 expref: 16 pid: 87028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189069.010351:0:87028:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc04a20a200, rc 0) 00000100:00100000:2.0:1784189069.010379:0:87028:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc07b22a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd553d0d-03e2-4233-b06b-b55bbfa2b954+16:6510:x1870854458064256:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 99us (303us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189069.010385:0:87028:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1784189069.010594:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc05ed7f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458064256:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784189069.010607:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: ffff9dc0565e6000/0xcc1762b626f8ac44 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc1762b626f8ac4b expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189069.010614:0:6510:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: ffff9dc0565e6000/0xcc1762b626f8ac44 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xcc1762b626f8ac4b expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784189069.010667:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc05ed7f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458064384:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1784189069.010691:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784189069.010717:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dc05085b000 going to sleep for 11 seconds 00000100:00100000:2.0:1784189069.010815:0:87027:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458064384 00000100:00100000:2.0:1784189069.010820:0:87027:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458064384 00000100:00100000:2.0:1784189069.010853:0:87027:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1784189069.010860:0:87027:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc0715af850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd553d0d-03e2-4233-b06b-b55bbfa2b954+16:6510:x1870854458064384:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1784189069.010975:0:87027:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc0715af850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd553d0d-03e2-4233-b06b-b55bbfa2b954+16:6510:x1870854458064384:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 115us (282us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189069.010982:0:87027:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1784189069.011222:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc05ed7f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458064384:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1784189069.011252:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc05ed7f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458064512:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1784189069.011298:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784189069.011343:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dc05085b000 going to sleep for 11 seconds 00000100:00100000:2.0:1784189069.011398:0:87026:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458064512 00000100:00100000:2.0:1784189069.011408:0:87026:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458064512 00000100:00100000:2.0:1784189069.011439:0:87026:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1784189069.011446:0:87026:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc0715adc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd553d0d-03e2-4233-b06b-b55bbfa2b954+16:6510:x1870854458064512:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1784189069.011521:0:87026:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc0715adc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd553d0d-03e2-4233-b06b-b55bbfa2b954+16:6510:x1870854458064512:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 75us (222us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189069.011528:0:87026:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1784189069.011658:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc05ed7f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458064512:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1784189069.012902:0:87114:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:1.0:1784189069.013242:0:6510:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:1.0:1784189069.013266:0:6510:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1784189069.013276:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff9dc0565e6000/0xcc1762b626f8ac44 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc1762b626f8ac4b expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189069.013287:0:6510:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: ffff9dc0565e6000/0xcc1762b626f8ac44 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc1762b626f8ac4b expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784189069.013297:0:6510:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1784189069.013300:0:6510:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9dbf425f7000 from 52 10000000:01000000:1.0:1784189069.013302:0:6510:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1784189069.013361:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff9dc0565e6800/0xcc1762b626f8ac52 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189069.013369:0:6510:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: ffff9dc0565e6800/0xcc1762b626f8ac52 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189069.013378:0:6510:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: ffff9dc0565e6800/0xcc1762b626f8ac52 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784189069.013400:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc05ed7f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458064640:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1784189069.013453:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784189069.013489:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dc05085b000 going to sleep for 11 seconds 00000100:00100000:2.0:1784189069.013555:0:87031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458064640 00000100:00100000:2.0:1784189069.013633:0:87031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458064640 00000100:00100000:2.0:1784189069.013849:0:87031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1784189069.013859:0:87031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc0715acc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:bd553d0d-03e2-4233-b06b-b55bbfa2b954+16:6510:x1870854458064640:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1784189069.013873:0:87031:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784189069.013886:0:87031:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dc04a20b200/0xcc1762b626f8ac59 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xcc1762b626f8ac52 expref: -99 pid: 87031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189069.013908:0:87031:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dc04a20b200/0xcc1762b626f8ac59 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcc1762b626f8ac52 expref: 17 pid: 87031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189069.013917:0:87031:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dc04a20b200/0xcc1762b626f8ac59 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcc1762b626f8ac52 expref: 17 pid: 87031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189069.013935:0:87031:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc04a20b200, rc 0) 00000100:00100000:2.0:1784189069.013974:0:87031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc0715acc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:bd553d0d-03e2-4233-b06b-b55bbfa2b954+17:6510:x1870854458064640:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 117us (519us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189069.013981:0:87031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1784189069.014235:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc05ed7f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458064640:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784189069.014253:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: ffff9dc0565e6800/0xcc1762b626f8ac52 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc1762b626f8ac59 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189069.014275:0:6510:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: ffff9dc0565e6800/0xcc1762b626f8ac52 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xcc1762b626f8ac59 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784189069.014352:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc05ed7f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458064768:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1784189069.014378:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784189069.014401:0:87034:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458064768 00000100:00100000:1.0:1784189069.014405:0:87034:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458064768 00000100:00100000:1.0:1784189069.014435:0:87034:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1784189069.014441:0:87034:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc0715ad850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:bd553d0d-03e2-4233-b06b-b55bbfa2b954+17:6510:x1870854458064768:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1784189069.014539:0:87034:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc0715ad850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:bd553d0d-03e2-4233-b06b-b55bbfa2b954+17:6510:x1870854458064768:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 97us (159us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189069.014546:0:87034:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1784189069.015675:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dc05085b000 going to sleep for 11 seconds 00000100:00100000:1.0:1784189069.015704:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc05ed7f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458064768:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1784189069.015745:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc05ed7f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458064896:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1784189069.015796:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784189069.015824:0:87028:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458064896 00000100:00100000:1.0:1784189069.015829:0:87028:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458064896 00000100:00100000:1.0:1784189069.015864:0:87028:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1784189069.015872:0:87028:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc0715af450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd553d0d-03e2-4233-b06b-b55bbfa2b954+17:6510:x1870854458064896:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1784189069.015972:0:87028:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc0715af450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd553d0d-03e2-4233-b06b-b55bbfa2b954+17:6510:x1870854458064896:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 100us (175us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189069.015979:0:87028:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1784189069.016041:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dc05085b000 going to sleep for 11 seconds 00000100:00100000:1.0:1784189069.016060:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc05ed7f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458064896:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1784189069.022440:0:87115:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 51 00000020:01000000:2.0:1784189069.022532:0:6510:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 52-51 (rc=0) 10000000:01000000:2.0:1784189069.023664:0:6510:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1784189069.023679:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff9dc0565e6800/0xcc1762b626f8ac52 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc1762b626f8ac59 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189069.023699:0:6510:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: ffff9dc0565e6800/0xcc1762b626f8ac52 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc1762b626f8ac59 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784189069.023708:0:6510:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:2.0:1784189069.023711:0:6510:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 11 10000000:01000000:2.0:1784189069.023714:0:6510:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:2.0:1784189069.023747:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff9dc04a20ac00/0xcc1762b626f8ac60 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189069.023755:0:6510:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: ffff9dc04a20ac00/0xcc1762b626f8ac60 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189069.023765:0:6510:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: ffff9dc04a20ac00/0xcc1762b626f8ac60 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784189069.023789:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf4262d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458065024:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1784189069.023845:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784189069.023885:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dc04a63b300 going to sleep for 11 seconds 00000100:00100000:1.0:1784189069.024237:0:87027:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458065024 00000100:00100000:1.0:1784189069.024244:0:87027:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458065024 00000100:00100000:1.0:1784189069.024282:0:87027:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1784189069.024291:0:87027:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc0715ae850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd553d0d-03e2-4233-b06b-b55bbfa2b954+17:6510:x1870854458065024:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784189069.024302:0:87027:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784189069.024315:0:87027:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dc0565e7800/0xcc1762b626f8ac67 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xcc1762b626f8ac60 expref: -99 pid: 87027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189069.024356:0:87027:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dc0565e7800/0xcc1762b626f8ac67 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcc1762b626f8ac60 expref: 18 pid: 87027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189069.024365:0:87027:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dc0565e7800/0xcc1762b626f8ac67 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcc1762b626f8ac60 expref: 18 pid: 87027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189069.024374:0:87027:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc0565e7800, rc 0) 00000100:00100000:1.0:1784189069.024414:0:87027:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc0715ae850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd553d0d-03e2-4233-b06b-b55bbfa2b954+18:6510:x1870854458065024:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 125us (569us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189069.024421:0:87027:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1784189069.026364:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf4262d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458065024:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1784189069.026390:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: ffff9dc04a20ac00/0xcc1762b626f8ac60 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc1762b626f8ac67 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189069.026401:0:6510:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: ffff9dc04a20ac00/0xcc1762b626f8ac60 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xcc1762b626f8ac67 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784189069.026482:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf4262d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458065152:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1784189069.026533:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784189069.026598:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dc04a63b300 going to sleep for 11 seconds 00000100:00100000:3.0:1784189069.026613:0:87034:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458065152 00000100:00100000:3.0:1784189069.026621:0:87034:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458065152 00000100:00100000:3.0:1784189069.026667:0:87034:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1784189069.026681:0:87034:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc0715ae450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:bd553d0d-03e2-4233-b06b-b55bbfa2b954+18:6510:x1870854458065152:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784189069.026834:0:87034:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc0715ae450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:bd553d0d-03e2-4233-b06b-b55bbfa2b954+18:6510:x1870854458065152:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 158us (299us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189069.026843:0:87034:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1784189069.028278:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf4262d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458065152:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1784189069.028347:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf4262d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458065280:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1784189069.028416:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784189069.028460:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dc04a63b300 going to sleep for 11 seconds 00000100:00100000:3.0:1784189069.030480:0:87031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458065280 00000100:00100000:3.0:1784189069.030491:0:87031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458065280 00000100:00100000:3.0:1784189069.030552:0:87031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1784189069.030571:0:87031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc0715ac450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:bd553d0d-03e2-4233-b06b-b55bbfa2b954+18:6510:x1870854458065280:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1784189069.032601:0:87031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc0715ac450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:bd553d0d-03e2-4233-b06b-b55bbfa2b954+18:6510:x1870854458065280:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 2034us (4178us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189069.032616:0:87031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1784189069.035682:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf4262d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458065280:0@lo:503:ll_cfg_requeue.0 00010000:00010000:0.0:1784189069.039439:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1784189069.040765:0:87117:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 64768 count 11 00000020:01000000:2.0:1784189069.047732:0:6510:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 11-10 (rc=0) 10000000:01000000:2.0:1784189069.047774:0:6510:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:2.0:1784189069.047787:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff9dc04a20ac00/0xcc1762b626f8ac60 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc1762b626f8ac67 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189069.047799:0:6510:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: ffff9dc04a20ac00/0xcc1762b626f8ac60 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc1762b626f8ac67 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784189069.047832:0:6510:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1784189069.047836:0:6510:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9dbf425f7000 from 7 10000000:01000000:2.0:1784189069.047839:0:6510:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1784189069.047880:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff9dc04a20a600/0xcc1762b626f8ac6e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189069.047888:0:6510:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: ffff9dc04a20a600/0xcc1762b626f8ac6e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189069.047898:0:6510:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: ffff9dc04a20a600/0xcc1762b626f8ac6e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784189069.047937:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf4262d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458065408:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1784189069.047999:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784189069.048794:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dc04a63bf00 going to sleep for 11 seconds 00000100:00100000:3.0:1784189069.053218:0:87026:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458065408 00000100:00100000:3.0:1784189069.053232:0:87026:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458065408 00000100:00100000:2.0:1784189069.054468:0:87026:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1784189069.054485:0:87026:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc0715af050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd553d0d-03e2-4233-b06b-b55bbfa2b954+18:6510:x1870854458065408:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1784189069.054502:0:87026:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784189069.054522:0:87026:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dc04a20a000/0xcc1762b626f8ac75 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xcc1762b626f8ac6e expref: -99 pid: 87026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189069.054551:0:87026:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dc04a20a000/0xcc1762b626f8ac75 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcc1762b626f8ac6e expref: 19 pid: 87026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189069.054572:0:87026:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dc04a20a000/0xcc1762b626f8ac75 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcc1762b626f8ac6e expref: 19 pid: 87026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189069.054582:0:87026:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc04a20a000, rc 0) 00000100:00100000:2.0:1784189069.054663:0:87026:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc0715af050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd553d0d-03e2-4233-b06b-b55bbfa2b954+19:6510:x1870854458065408:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 183us (6662us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189069.054669:0:87026:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1784189069.054747:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf4262d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458065408:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784189069.054775:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: ffff9dc04a20a600/0xcc1762b626f8ac6e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc1762b626f8ac75 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189069.054785:0:6510:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: ffff9dc04a20a600/0xcc1762b626f8ac6e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xcc1762b626f8ac75 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784189069.054871:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc06bbf3100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458065536:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784189069.054906:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784189069.056018:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dc050f420c0 going to sleep for 11 seconds 00000100:00100000:0.0:1784189069.056222:0:87028:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458065536 00000100:00100000:0.0:1784189069.056230:0:87028:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458065536 00000100:00100000:3.0:1784189069.057728:0:87028:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1784189069.057739:0:87028:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc0715ad450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd553d0d-03e2-4233-b06b-b55bbfa2b954+19:6510:x1870854458065536:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784189069.057895:0:87028:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc0715ad450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd553d0d-03e2-4233-b06b-b55bbfa2b954+19:6510:x1870854458065536:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 157us (2989us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189069.057904:0:87028:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1784189069.057975:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc06bbf3100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458065536:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784189069.058021:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc06bbf3100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458065664:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1784189069.058075:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784189069.058097:0:87031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458065664 00000100:00100000:3.0:1784189069.058102:0:87031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458065664 00000100:00100000:3.0:1784189069.058652:0:87031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1784189069.058662:0:87031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc0715ac050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:bd553d0d-03e2-4233-b06b-b55bbfa2b954+19:6510:x1870854458065664:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1784189069.058742:0:87031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc0715ac050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:bd553d0d-03e2-4233-b06b-b55bbfa2b954+19:6510:x1870854458065664:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 82us (666us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189069.058749:0:87031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1784189069.058784:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dc045243900 going to sleep for 11 seconds 00000100:00100000:3.0:1784189069.058803:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc06bbf3100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458065664:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1784189069.062086:0:87120:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:2.0:1784189069.062470:0:6510:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:2.0:1784189069.062495:0:6510:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1784189069.062507:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff9dc04a20a600/0xcc1762b626f8ac6e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc1762b626f8ac75 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189069.062520:0:6510:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: ffff9dc04a20a600/0xcc1762b626f8ac6e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc1762b626f8ac75 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784189069.062528:0:6510:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1784189069.062531:0:6510:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9dc07b5d6800 from 52 10000000:01000000:2.0:1784189069.062533:0:6510:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1784189069.062628:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff9dc04a20b000/0xcc1762b626f8ac7c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189069.062650:0:6510:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: ffff9dc04a20b000/0xcc1762b626f8ac7c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189069.062660:0:6510:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: ffff9dc04a20b000/0xcc1762b626f8ac7c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784189069.062684:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf4262d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458065792:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1784189069.062745:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784189069.062785:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dc04a63b840 going to sleep for 11 seconds 00000100:00100000:3.0:1784189069.062831:0:87027:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458065792 00000100:00100000:3.0:1784189069.062837:0:87027:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458065792 00000100:00100000:3.0:1784189069.062881:0:87027:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1784189069.062889:0:87027:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc0715ac850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd553d0d-03e2-4233-b06b-b55bbfa2b954+19:6510:x1870854458065792:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784189069.062900:0:87027:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784189069.062912:0:87027:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dc081b16000/0xcc1762b626f8ac83 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xcc1762b626f8ac7c expref: -99 pid: 87027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189069.062943:0:87027:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dc081b16000/0xcc1762b626f8ac83 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcc1762b626f8ac7c expref: 20 pid: 87027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189069.062953:0:87027:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dc081b16000/0xcc1762b626f8ac83 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcc1762b626f8ac7c expref: 20 pid: 87027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189069.062960:0:87027:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc081b16000, rc 0) 00000100:00100000:3.0:1784189069.062994:0:87027:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc0715ac850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd553d0d-03e2-4233-b06b-b55bbfa2b954+20:6510:x1870854458065792:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 105us (249us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189069.063000:0:87027:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1784189069.063194:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf4262d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458065792:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1784189069.063208:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: ffff9dc04a20b000/0xcc1762b626f8ac7c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc1762b626f8ac83 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189069.063217:0:6510:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: ffff9dc04a20b000/0xcc1762b626f8ac7c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xcc1762b626f8ac83 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784189069.063270:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf4262d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458065920:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1784189069.063296:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784189069.063315:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dc04a63b840 going to sleep for 11 seconds 00000100:00100000:3.0:1784189069.063386:0:87028:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458065920 00000100:00100000:3.0:1784189069.063390:0:87028:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458065920 00000100:00100000:3.0:1784189069.063452:0:87028:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1784189069.063458:0:87028:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc0715ad050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd553d0d-03e2-4233-b06b-b55bbfa2b954+20:6510:x1870854458065920:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784189069.063584:0:87028:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc0715ad050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd553d0d-03e2-4233-b06b-b55bbfa2b954+20:6510:x1870854458065920:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 125us (286us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189069.063591:0:87028:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1784189069.065598:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf4262d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458065920:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1784189069.065659:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf4262d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458066048:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1784189069.065725:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784189069.065759:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dc04a63b840 going to sleep for 11 seconds 00000100:00100000:3.0:1784189069.065928:0:87028:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458066048 00000100:00100000:3.0:1784189069.065941:0:87028:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458066048 00000100:00100000:3.0:1784189069.065991:0:87028:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1784189069.065999:0:87028:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc0715ae050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd553d0d-03e2-4233-b06b-b55bbfa2b954+20:6510:x1870854458066048:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1784189069.066286:0:87028:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc0715ae050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd553d0d-03e2-4233-b06b-b55bbfa2b954+20:6510:x1870854458066048:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 288us (560us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189069.066295:0:87028:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1784189069.068901:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf4262d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458066048:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1784189069.085194:0:87122:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 51 00000020:01000000:3.0:1784189069.085357:0:6510:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 52-51 (rc=0) 10000000:01000000:3.0:1784189069.085379:0:6510:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1784189069.085391:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff9dc04a20b000/0xcc1762b626f8ac7c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc1762b626f8ac83 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189069.085403:0:6510:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: ffff9dc04a20b000/0xcc1762b626f8ac7c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc1762b626f8ac83 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784189069.085411:0:6510:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:3.0:1784189069.085414:0:6510:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 14 10000000:01000000:3.0:1784189069.085417:0:6510:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:3.0:1784189069.085453:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff9dc081b16200/0xcc1762b626f8ac8a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189069.085461:0:6510:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: ffff9dc081b16200/0xcc1762b626f8ac8a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189069.085472:0:6510:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: ffff9dc081b16200/0xcc1762b626f8ac8a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784189069.085496:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc06bbf3100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458066176:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1784189069.085556:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784189069.085600:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dc045243cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1784189069.089398:0:87026:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458066176 00000100:00100000:3.0:1784189069.089412:0:87026:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458066176 00000100:00100000:3.0:1784189069.089482:0:87026:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1784189069.089493:0:87026:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc071342450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd553d0d-03e2-4233-b06b-b55bbfa2b954+20:6510:x1870854458066176:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784189069.089509:0:87026:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784189069.089527:0:87026:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dc081b16800/0xcc1762b626f8ac91 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xcc1762b626f8ac8a expref: -99 pid: 87026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189069.089555:0:87026:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dc081b16800/0xcc1762b626f8ac91 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcc1762b626f8ac8a expref: 21 pid: 87026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189069.089566:0:87026:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dc081b16800/0xcc1762b626f8ac91 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcc1762b626f8ac8a expref: 21 pid: 87026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189069.089576:0:87026:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc081b16800, rc 0) 00000100:00100000:3.0:1784189069.089645:0:87026:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc071342450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd553d0d-03e2-4233-b06b-b55bbfa2b954+21:6510:x1870854458066176:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 154us (4088us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189069.089652:0:87026:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1784189069.089833:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc06bbf3100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458066176:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784189069.089851:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: ffff9dc081b16200/0xcc1762b626f8ac8a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc1762b626f8ac91 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189069.089860:0:6510:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: ffff9dc081b16200/0xcc1762b626f8ac8a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0xcc1762b626f8ac91 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784189069.089946:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc06bbf3100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458066304:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784189069.089976:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784189069.090011:0:87028:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458066304 00000100:00100000:3.0:1784189069.090016:0:87028:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458066304 00000100:00100000:3.0:1784189069.090041:0:87028:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1784189069.090047:0:87028:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc071342050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd553d0d-03e2-4233-b06b-b55bbfa2b954+21:6510:x1870854458066304:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784189069.090626:0:87028:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc071342050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd553d0d-03e2-4233-b06b-b55bbfa2b954+21:6510:x1870854458066304:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 577us (648us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189069.090634:0:87028:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1784189069.090677:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dc045243cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1784189069.091915:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc06bbf3100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458066304:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1784189069.092851:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf4262d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458066432:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1784189069.092946:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784189069.092981:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dc04a63b840 going to sleep for 11 seconds 00000100:00100000:1.0:1784189069.094760:0:87034:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458066432 00000100:00100000:1.0:1784189069.094772:0:87034:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458066432 00000100:00100000:1.0:1784189069.094821:0:87034:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1784189069.094830:0:87034:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc043596850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:bd553d0d-03e2-4233-b06b-b55bbfa2b954+21:6510:x1870854458066432:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1784189069.109581:0:87034:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc043596850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:bd553d0d-03e2-4233-b06b-b55bbfa2b954+21:6510:x1870854458066432:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 14744us (16628us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189069.109596:0:87034:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1784189069.113411:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf4262d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458066432:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1784189069.115271:0:87123:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 64768 count 14 00000020:01000000:3.0:1784189069.115429:0:6510:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 14-13 (rc=0) 10000000:01000000:3.0:1784189069.115457:0:6510:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:3.0:1784189069.115468:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff9dc081b16200/0xcc1762b626f8ac8a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc1762b626f8ac91 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189069.115481:0:6510:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: ffff9dc081b16200/0xcc1762b626f8ac8a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc1762b626f8ac91 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784189069.115490:0:6510:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1784189069.115493:0:6510:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9dc07b5d6800 from 7 10000000:01000000:3.0:1784189069.115495:0:6510:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1784189069.115542:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff9dc081b17a00/0xcc1762b626f8ac98 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189069.115550:0:6510:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: ffff9dc081b17a00/0xcc1762b626f8ac98 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189069.115574:0:6510:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: ffff9dc081b17a00/0xcc1762b626f8ac98 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784189069.115597:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc06bbf0a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458066560:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1784189069.115660:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784189069.115703:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dc058ee5180 going to sleep for 11 seconds 00000100:00100000:1.0:1784189069.116206:0:87026:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458066560 00000100:00100000:1.0:1784189069.116215:0:87026:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458066560 00000100:00100000:1.0:1784189069.116267:0:87026:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1784189069.116282:0:87026:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc043597050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd553d0d-03e2-4233-b06b-b55bbfa2b954+21:6510:x1870854458066560:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784189069.116295:0:87026:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784189069.116307:0:87026:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dc0565e7a00/0xcc1762b626f8ac9f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xcc1762b626f8ac98 expref: -99 pid: 87026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189069.116349:0:87026:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dc0565e7a00/0xcc1762b626f8ac9f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcc1762b626f8ac98 expref: 22 pid: 87026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189069.116361:0:87026:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dc0565e7a00/0xcc1762b626f8ac9f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcc1762b626f8ac98 expref: 22 pid: 87026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189069.116370:0:87026:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc0565e7a00, rc 0) 00000100:00100000:1.0:1784189069.116418:0:87026:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc043597050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd553d0d-03e2-4233-b06b-b55bbfa2b954+22:6510:x1870854458066560:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 138us (758us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189069.116427:0:87026:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1784189069.116453:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc06bbf0a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458066560:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784189069.116469:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: ffff9dc081b17a00/0xcc1762b626f8ac98 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc1762b626f8ac9f expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189069.116479:0:6510:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: ffff9dc081b17a00/0xcc1762b626f8ac98 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xcc1762b626f8ac9f expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784189069.116545:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc06bbf0a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458066688:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784189069.116570:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784189069.116599:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dc058ee5180 going to sleep for 11 seconds 00000100:00100000:1.0:1784189069.116689:0:87027:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458066688 00000100:00100000:1.0:1784189069.116694:0:87027:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458066688 00000100:00100000:1.0:1784189069.116723:0:87027:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1784189069.116737:0:87027:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc043595850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd553d0d-03e2-4233-b06b-b55bbfa2b954+22:6510:x1870854458066688:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1784189069.116827:0:87027:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc043595850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd553d0d-03e2-4233-b06b-b55bbfa2b954+22:6510:x1870854458066688:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 98us (256us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189069.116833:0:87027:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1784189069.116992:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc06bbf0a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458066688:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784189069.117017:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc06bbf0a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458066816:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1784189069.117053:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784189069.117101:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dc058ee5180 going to sleep for 11 seconds 00000100:00100000:1.0:1784189069.119475:0:87034:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458066816 00000100:00100000:1.0:1784189069.119487:0:87034:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458066816 00000100:00100000:1.0:1784189069.119789:0:87034:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1784189069.119801:0:87034:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc043597c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:bd553d0d-03e2-4233-b06b-b55bbfa2b954+22:6510:x1870854458066816:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1784189069.119972:0:87034:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc043597c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:bd553d0d-03e2-4233-b06b-b55bbfa2b954+22:6510:x1870854458066816:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 173us (2917us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189069.119987:0:87034:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1784189069.120225:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc06bbf0a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458066816:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1784189069.122690:0:87124:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:2.0:1784189069.122769:0:6510:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:2.0:1784189069.122794:0:6510:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1784189069.122804:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff9dc081b17a00/0xcc1762b626f8ac98 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc1762b626f8ac9f expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189069.122815:0:6510:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: ffff9dc081b17a00/0xcc1762b626f8ac98 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc1762b626f8ac9f expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784189069.122824:0:6510:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:2.0:1784189069.122826:0:6510:0:(mgc_request.c:1801:mgc_process_log()) Process log nodemap-ffff9dc06bb30000 from 1 10000000:01000000:2.0:1784189069.122829:0:6510:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:2.0:1784189069.122867:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff9dc04a20a400/0xcc1762b626f8aca6 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189069.122875:0:6510:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: ffff9dc04a20a400/0xcc1762b626f8aca6 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189069.122884:0:6510:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: ffff9dc04a20a400/0xcc1762b626f8aca6 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784189069.122967:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf4262d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458066944:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1784189069.123200:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784189069.123290:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dc04a63bcc0 going to sleep for 11 seconds 00000100:00100000:1.0:1784189069.123368:0:87034:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458066944 00000100:00100000:1.0:1784189069.123376:0:87034:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458066944 00000100:00100000:0.0:1784189069.124450:0:87034:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1784189069.124463:0:87034:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc043595450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:bd553d0d-03e2-4233-b06b-b55bbfa2b954+22:6510:x1870854458066944:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784189069.124550:0:87034:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784189069.124567:0:87034:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dc070147e00/0xcc1762b626f8acad lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xcc1762b626f8aca6 expref: -99 pid: 87034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189069.124594:0:87034:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dc070147e00/0xcc1762b626f8acad lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcc1762b626f8aca6 expref: 23 pid: 87034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189069.124605:0:87034:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dc070147e00/0xcc1762b626f8acad lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcc1762b626f8aca6 expref: 23 pid: 87034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189069.124614:0:87034:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc070147e00, rc 0) 00000100:00100000:0.0:1784189069.124674:0:87034:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc043595450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:bd553d0d-03e2-4233-b06b-b55bbfa2b954+23:6510:x1870854458066944:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 213us (1473us total) trans 0 rc 0/0 00000100:00100000:0.0:1784189069.124682:0:87034:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1784189069.125353:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf4262d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458066944:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1784189069.125372:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: ffff9dc04a20a400/0xcc1762b626f8aca6 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc1762b626f8acad expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189069.125383:0:6510:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: ffff9dc04a20a400/0xcc1762b626f8aca6 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcc1762b626f8acad expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784189069.125403:0:6510:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:2.0:1784189069.125409:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff9dc04a20a400/0xcc1762b626f8aca6 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc1762b626f8acad expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189069.125416:0:6510:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: ffff9dc04a20a400/0xcc1762b626f8aca6 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc1762b626f8acad expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784189069.125513:0:6510:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:0.0:1784189069.125516:0:6510:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-sptlrpc-ffff9dc06bb30000 from 1 10000000:01000000:0.0:1784189069.125519:0:6510:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1784189069.125544:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff9dc070147800/0xcc1762b626f8acb4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189069.125625:0:6510:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: ffff9dc070147800/0xcc1762b626f8acb4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189069.125635:0:6510:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: ffff9dc070147800/0xcc1762b626f8acb4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784189069.125656:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc0762d4a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458067072:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1784189069.125704:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784189069.125746:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dc050e11cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1784189069.125805:0:87031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458067072 00000100:00100000:3.0:1784189069.125812:0:87031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458067072 00000100:00100000:3.0:1784189069.125859:0:87031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1784189069.125868:0:87031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc043594850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:bd553d0d-03e2-4233-b06b-b55bbfa2b954+23:6510:x1870854458067072:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784189069.125876:0:87031:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784189069.125949:0:87031:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dc081b17200/0xcc1762b626f8acbb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xcc1762b626f8acb4 expref: -99 pid: 87031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189069.125968:0:87031:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dc081b17200/0xcc1762b626f8acbb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcc1762b626f8acb4 expref: 24 pid: 87031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189069.125978:0:87031:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dc081b17200/0xcc1762b626f8acbb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcc1762b626f8acb4 expref: 24 pid: 87031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189069.125987:0:87031:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc081b17200, rc 0) 00000100:00100000:3.0:1784189069.126030:0:87031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc043594850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:bd553d0d-03e2-4233-b06b-b55bbfa2b954+24:6510:x1870854458067072:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 163us (326us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189069.126220:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc0762d4a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458067072:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1784189069.126232:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: ffff9dc070147800/0xcc1762b626f8acb4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc1762b626f8acbb expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189069.126240:0:6510:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: ffff9dc070147800/0xcc1762b626f8acb4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0xcc1762b626f8acbb expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784189069.126299:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf4262d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458067200:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1784189069.126348:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784189069.126368:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dc04a63bcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1784189069.126418:0:87034:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458067200 00000100:00100000:0.0:1784189069.126424:0:87034:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458067200 00000100:00100000:0.0:1784189069.126457:0:87034:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1784189069.126466:0:87034:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc043596450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:bd553d0d-03e2-4233-b06b-b55bbfa2b954+25:6510:x1870854458067200:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1784189069.126542:0:87034:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc043596450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:bd553d0d-03e2-4233-b06b-b55bbfa2b954+25:6510:x1870854458067200:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 78us (193us total) trans 0 rc -2/-2 00000100:00100000:0.0:1784189069.126551:0:87034:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1784189069.126644:0:87031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1784189069.126767:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf4262d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458067200:0@lo:501:ll_cfg_requeue.0 10000000:01000000:2.0:1784189069.126796:0:6510:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1784189069.126803:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff9dc070147800/0xcc1762b626f8acb4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc1762b626f8acbb expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189069.126818:0:6510:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: ffff9dc070147800/0xcc1762b626f8acb4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc1762b626f8acbb expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784189069.359690:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1784189069.359714:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc0762d5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1870854458067328:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1784189069.359784:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784189069.359868:0:9466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458067328 00000100:00100000:3.0:1784189069.359876:0:9466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458067328 00000100:00100000:3.0:1784189069.359953:0:9466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1884 00000100:00100000:3.0:1784189069.359963:0:9466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc0762d4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1870854458067328:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1784189069.359986:0:9466:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 213696 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1784189069.360041:0:9466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc0762d4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1870854458067328:12345-0@lo:13:osp-pre-1-1.0 Request processed in 69us (245us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189069.360049:0:9466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1884 00000100:00100000:3.0:1784189069.360095:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc0762d5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1870854458067328:0@lo:13:osp-pre-1-1.0 00000100:00080000:0.0:1784189069.360554:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1784189069.361171:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1784189069.361184:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc06bbf0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1870854458067456:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1784189069.361230:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784189069.361264:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458067456 00000100:00100000:3.0:1784189069.361269:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458067456 00000100:00100000:3.0:1784189069.361308:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1885 00000100:00100000:3.0:1784189069.361351:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc06bbf3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1870854458067456:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1784189069.361369:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 213696 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1784189069.361406:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc06bbf3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1870854458067456:12345-0@lo:13:osp-pre-0-1.0 Request processed in 56us (175us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189069.361412:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1885 00000100:00080000:3.0:1784189069.361430:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1784189069.361457:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc06bbf0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1870854458067456:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1784189070.063525:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784189070.508953:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1784189070.509249:0:87027:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436245760 00000100:00100000:2.0:1784189070.509260:0:87027:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436245760 00000100:00100000:2.0:1784189070.509414:0:87027:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 61 00000100:00100000:2.0:1784189070.509428:0:87027:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc043595c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9957a2dc-fd88-4a91-bca3-e2b7f365ab0c+5:42415:x1870854436245760:12345-192.168.203.12@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1784189070.509455:0:87027:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784189070.509473:0:87027:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dc04a20bc00/0xcc1762b626f8acc2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xcbfc5de7fe6c3d37 expref: -99 pid: 87027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189070.509501:0:87027:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dc04a20bc00/0xcc1762b626f8acc2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c3d37 expref: 6 pid: 87027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189070.509512:0:87027:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dc04a20bc00/0xcc1762b626f8acc2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c3d37 expref: 6 pid: 87027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189070.509521:0:87027:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc04a20bc00, rc 0) 00000100:00100000:2.0:1784189070.509578:0:87027:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc043595c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9957a2dc-fd88-4a91-bca3-e2b7f365ab0c+6:42415:x1870854436245760:12345-192.168.203.12@tcp:101:ll_cfg_requeue.0 Request processed in 154us (634us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189070.509587:0:87027:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 61 00000100:00100000:1.0:1784189070.519843:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1784189070.519926:0:87034:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436245888 00000100:00100000:3.0:1784189070.519936:0:87034:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436245888 00000100:00100000:3.0:1784189070.520006:0:87034:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 62 00000100:00100000:3.0:1784189070.520019:0:87034:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc043597450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:9957a2dc-fd88-4a91-bca3-e2b7f365ab0c+6:42415:x1870854436245888:12345-192.168.203.12@tcp:256:ll_cfg_requeue.0 20000000:01000000:3.0:1784189070.520055:0:87034:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 16384. 20000000:01000000:3.0:1784189070.520074:0:87034:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1784189070.520078:0:87034:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/4/3. 20000000:01000000:3.0:1784189070.520082:0:87034:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/4/3. 20000000:01000000:3.0:1784189070.520085:0:87034:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/4/3. 20000000:01000000:3.0:1784189070.520088:0:87034:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 108 00000100:00100000:3.0:1784189070.524680:0:87034:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc043597450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:9957a2dc-fd88-4a91-bca3-e2b7f365ab0c+6:42415:x1870854436245888:12345-192.168.203.12@tcp:256:ll_cfg_requeue.0 Request processed in 4654us (4835us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189070.524694:0:87034:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 62 00000100:00100000:1.0:1784189070.539554:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1784189070.539971:0:87026:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436246016 00000100:00100000:3.0:1784189070.539981:0:87026:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436246016 00000100:00100000:3.0:1784189070.540219:0:87026:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 63 00000100:00100000:3.0:1784189070.540230:0:87026:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc043596c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9957a2dc-fd88-4a91-bca3-e2b7f365ab0c+6:42415:x1870854436246016:12345-192.168.203.12@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784189070.540248:0:87026:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784189070.540266:0:87026:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dc081b16e00/0xcc1762b626f8acc9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xcbfc5de7fe6c3d3e expref: -99 pid: 87026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189070.540306:0:87026:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dc081b16e00/0xcc1762b626f8acc9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c3d3e expref: 7 pid: 87026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189070.540343:0:87026:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dc081b16e00/0xcc1762b626f8acc9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c3d3e expref: 7 pid: 87026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189070.540353:0:87026:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc081b16e00, rc 0) 00000100:00100000:3.0:1784189070.540406:0:87026:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc043596c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9957a2dc-fd88-4a91-bca3-e2b7f365ab0c+7:42415:x1870854436246016:12345-192.168.203.12@tcp:101:ll_cfg_requeue.0 Request processed in 177us (860us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189070.540414:0:87026:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 63 00000100:00100000:0.0:1784189070.547310:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1784189070.547546:0:87028:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436246144 00000100:00100000:3.0:1784189070.547557:0:87028:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436246144 00000100:00100000:3.0:1784189070.547644:0:87028:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 64 00000100:00100000:3.0:1784189070.547655:0:87028:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc0762ab450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9957a2dc-fd88-4a91-bca3-e2b7f365ab0c+7:42415:x1870854436246144:12345-192.168.203.12@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784189070.547800:0:87028:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc0762ab450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9957a2dc-fd88-4a91-bca3-e2b7f365ab0c+8:42415:x1870854436246144:12345-192.168.203.12@tcp:501:ll_cfg_requeue.0 Request processed in 146us (500us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189070.547808:0:87028:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 64 00000100:00100000:0.0:1784189070.560640:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1784189070.560736:0:87034:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436246272 00000100:00100000:3.0:1784189070.560746:0:87034:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436246272 00000100:00100000:3.0:1784189070.560802:0:87034:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 65 00000100:00100000:3.0:1784189070.560812:0:87034:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf4649e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:9957a2dc-fd88-4a91-bca3-e2b7f365ab0c+8:42415:x1870854436246272:12345-192.168.203.12@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1784189070.560947:0:87034:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf4649e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:9957a2dc-fd88-4a91-bca3-e2b7f365ab0c+8:42415:x1870854436246272:12345-192.168.203.12@tcp:503:ll_cfg_requeue.0 Request processed in 135us (315us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189070.560955:0:87034:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 65 00000100:00100000:1.0:1784189070.573873:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1784189070.574033:0:87026:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436246400 00000100:00100000:2.0:1784189070.574044:0:87026:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436246400 00000100:00100000:2.0:1784189070.574119:0:87026:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 66 00000100:00100000:2.0:1784189070.574132:0:87026:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf4649c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9957a2dc-fd88-4a91-bca3-e2b7f365ab0c+8:42415:x1870854436246400:12345-192.168.203.12@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1784189070.574157:0:87026:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784189070.574176:0:87026:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dc04a20b600/0xcc1762b626f8acd0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xcbfc5de7fe6c3d45 expref: -99 pid: 87026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189070.574203:0:87026:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dc04a20b600/0xcc1762b626f8acd0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c3d45 expref: 9 pid: 87026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189070.574214:0:87026:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dc04a20b600/0xcc1762b626f8acd0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c3d45 expref: 9 pid: 87026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189070.574223:0:87026:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc04a20b600, rc 0) 00000100:00100000:2.0:1784189070.574281:0:87026:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf4649c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9957a2dc-fd88-4a91-bca3-e2b7f365ab0c+9:42415:x1870854436246400:12345-192.168.203.12@tcp:101:ll_cfg_requeue.0 Request processed in 153us (419us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189070.574289:0:87026:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 66 00000100:00100000:0.0:1784189070.576537:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1784189070.576724:0:87028:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436246528 00000100:00100000:1.0:1784189070.576733:0:87028:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436246528 00000100:00100000:1.0:1784189070.576785:0:87028:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 67 00000100:00100000:1.0:1784189070.576793:0:87028:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf4649e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9957a2dc-fd88-4a91-bca3-e2b7f365ab0c+9:42415:x1870854436246528:12345-192.168.203.12@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1784189070.576936:0:87028:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf4649e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9957a2dc-fd88-4a91-bca3-e2b7f365ab0c+9:42415:x1870854436246528:12345-192.168.203.12@tcp:501:ll_cfg_requeue.0 Request processed in 142us (407us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189070.576944:0:87028:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 67 00000100:00100000:0.0:1784189070.594660:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1784189070.595820:0:87027:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436246656 00000100:00100000:1.0:1784189070.595833:0:87027:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436246656 00000100:00100000:1.0:1784189070.595898:0:87027:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 68 00000100:00100000:1.0:1784189070.595920:0:87027:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf4649f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9957a2dc-fd88-4a91-bca3-e2b7f365ab0c+9:42415:x1870854436246656:12345-192.168.203.12@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1784189070.596333:0:87027:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf4649f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9957a2dc-fd88-4a91-bca3-e2b7f365ab0c+9:42415:x1870854436246656:12345-192.168.203.12@tcp:503:ll_cfg_requeue.0 Request processed in 408us (1664us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189070.596344:0:87027:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 68 00000100:00100000:2.0:1784189070.603116:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1784189070.603228:0:87026:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436246784 00000100:00100000:1.0:1784189070.603237:0:87026:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436246784 00000100:00100000:1.0:1784189070.603294:0:87026:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 69 00000100:00100000:1.0:1784189070.603305:0:87026:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf4649ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9957a2dc-fd88-4a91-bca3-e2b7f365ab0c+9:42415:x1870854436246784:12345-192.168.203.12@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784189070.603339:0:87026:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784189070.603364:0:87026:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dc0565e7e00/0xcc1762b626f8acd7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0xcbfc5de7fe6c3d4c expref: -99 pid: 87026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189070.603393:0:87026:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dc0565e7e00/0xcc1762b626f8acd7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c3d4c expref: 10 pid: 87026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189070.603404:0:87026:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dc0565e7e00/0xcc1762b626f8acd7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c3d4c expref: 10 pid: 87026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189070.603413:0:87026:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc0565e7e00, rc 0) 00000100:00100000:1.0:1784189070.603464:0:87026:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf4649ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9957a2dc-fd88-4a91-bca3-e2b7f365ab0c+10:42415:x1870854436246784:12345-192.168.203.12@tcp:101:ll_cfg_requeue.0 Request processed in 161us (358us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189070.603472:0:87026:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 69 00000100:00100000:0.0:1784189070.605979:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1784189070.606096:0:87034:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436246912 00000100:00100000:3.0:1784189070.606110:0:87034:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436246912 00000100:00100000:3.0:1784189070.606170:0:87034:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 70 00000100:00100000:3.0:1784189070.606180:0:87034:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf46908050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:9957a2dc-fd88-4a91-bca3-e2b7f365ab0c+10:42415:x1870854436246912:12345-192.168.203.12@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784189070.611790:0:87034:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf46908050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:9957a2dc-fd88-4a91-bca3-e2b7f365ab0c+10:42415:x1870854436246912:12345-192.168.203.12@tcp:501:ll_cfg_requeue.0 Request processed in 5106us (5314us total) trans 0 rc -2/-2 00000100:00100000:3.0:1784189070.611807:0:87034:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 70 00010000:00010000:2.0:1784189071.090811:0:7454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784189072.116177:0:26173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1784189072.298636:0:87306:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg312-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1784189073.140052:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1784189073.195217:0:87359:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1784189073.195580:0:87359:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00080000:2.0:1784189073.455492:0:27065:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1784189073.455502:0:27065:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1784189073.455506:0:27065:0:(import.c:65:import_set_state_nolock()) ffff9dbf42271800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1784189073.455517:0:27065:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3310 00000100:00080000:2.0:1784189073.455523:0:27065:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1784189073.455532:0:27065:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9dbf42271800 using connection 192.168.203.112@tcp/0@lo 00000100:00100000:2.0:1784189073.455563:0:27065:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9dbf4262ea00 x1870854458067840/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1784189073.455606:0:27065:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1784189073.455609:0:27065:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00100000:3.0:1784189073.455616:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc05ed7f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1870854458067712:0@lo:41:osp-pre-1-0.0 00000100:00080000:2.0:1784189073.455628:0:27065:0:(import.c:65:import_set_state_nolock()) ffff9dbf425f4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1784189073.455633:0:27065:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3310 00000100:00080000:2.0:1784189073.455637:0:27065:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1784189073.455642:0:27065:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9dbf425f4800 using connection 192.168.203.112@tcp/0@lo 00000100:00100000:2.0:1784189073.455660:0:27065:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9dbf4262d180 x1870854458068096/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1784189073.455681:0:27065:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1784189073.455684:0:27065:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1784189073.455686:0:27065:0:(import.c:65:import_set_state_nolock()) ffff9dbf436c4000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1784189073.455690:0:27065:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3310 00000100:00080000:2.0:1784189073.455693:0:27065:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1784189073.455698:0:27065:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9dbf436c4000 using connection 192.168.203.112@tcp/0@lo 00000100:00100000:2.0:1784189073.455713:0:27065:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9dc05f02ed80 x1870854458068352/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1784189073.455725:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1784189073.455751:0:27065:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1784189073.455756:0:27065:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1784189073.455758:0:27065:0:(import.c:65:import_set_state_nolock()) ffff9dbf43690800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1784189073.455762:0:27065:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3310 00000100:00080000:2.0:1784189073.455764:0:27065:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1784189073.455769:0:27065:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff9dbf43690800 using connection 192.168.203.112@tcp/0@lo 00000100:00100000:2.0:1784189073.455782:0:27065:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9dc080f68e00 x1870854458068736/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1784189073.455787:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf4367d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1870854458068608:0@lo:400:kworker.0 00000100:00080000:2.0:1784189073.455817:0:27065:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1784189073.455821:0:27065:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1784189073.455831:0:27065:0:(import.c:65:import_set_state_nolock()) ffff9dc07a883800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:3.0:1784189073.455832:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1784189073.455843:0:27065:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff9dc07a883800 using connection 192.168.203.112@tcp/0@lo 00000100:00100000:2.0:1784189073.455861:0:27065:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9dc07016dc00 x1870854458069120/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1784189073.455862:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1784189073.455873:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf4262fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3640:1870854458067968:0@lo:400:kworker.0 00000100:00100000:2.0:1784189073.455907:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf4262d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:bd553d0d-03e2-4233-b06b-b55bbfa2b954:3643:1870854458067584:0@lo:400:kworker.0 00000100:00100000:3.0:1784189073.455919:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784189073.455947:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc080f69500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1870854458068864:0@lo:400:kworker.0 00000100:00100000:2.0:1784189073.455956:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784189073.455988:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784189073.455996:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf4367ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1870854458068480:0@lo:400:kworker.0 00000100:00100000:2.0:1784189073.456026:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784189073.456035:0:68287:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458067968 00000100:00100000:3.0:1784189073.456046:0:68287:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458067968 00000100:00100000:2.0:1784189073.456051:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1784189073.456058:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf4262e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3643:1870854458068224:0@lo:400:kworker.0 00000100:00100000:2.0:1784189073.456091:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784189073.456112:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc07016d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1870854458068992:0@lo:400:kworker.0 00000100:00100000:1.0:1784189073.456138:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf4262ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3639:1870854458067840:0@lo:38:kworker.0 00000100:00100000:2.0:1784189073.456139:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784189073.456181:0:23826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458067712 00000100:00100000:2.0:1784189073.456186:0:23826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458067712 00000100:00100000:1.0:1784189073.456191:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784189073.456229:0:23826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3738 00000100:00100000:2.0:1784189073.456240:0:23826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc06bbf0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3640:x1870854458067712:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1784189073.456290:0:23826:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445576704 avail 1299337216 00000100:00100000:2.0:1784189073.456365:0:23826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc06bbf0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3640:x1870854458067712:12345-0@lo:41:osp-pre-1-0.0 Request processed in 126us (643us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189073.456373:0:23826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3738 00000100:00100000:2.0:1784189073.456402:0:26170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458068608 00000100:00100000:2.0:1784189073.456406:0:26170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458068608 00000100:00100000:2.0:1784189073.456434:0:26170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458068864 00000100:00100000:2.0:1784189073.456438:0:26170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458068864 00000100:00100000:2.0:1784189073.456464:0:26170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458068480 00000100:00100000:2.0:1784189073.456467:0:26170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458068480 00000100:00100000:1.0:1784189073.456495:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf4262d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3639:1870854458068096:0@lo:38:kworker.0 00000100:00100000:2.0:1784189073.456502:0:26170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458068992 00000100:00100000:2.0:1784189073.456507:0:26170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458068992 00000100:00100000:1.0:1784189073.456529:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784189073.456538:0:26170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2357 00000100:00100000:2.0:1784189073.456545:0:26170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf43c5dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0001-mdtlov_UUID+5:3640:x1870854458068608:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784189073.456571:0:68287:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458068224 00000100:00100000:3.0:1784189073.456576:0:68287:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458068224 00000100:00100000:3.0:1784189073.456607:0:68287:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458067840 00000100:00100000:3.0:1784189073.456610:0:68287:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458067840 00000100:00100000:3.0:1784189073.456623:0:68287:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1061 00000100:00100000:3.0:1784189073.456630:0:68287:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf43c5e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1870854458067968:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784189073.456673:0:68287:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf43c5e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1870854458067968:12345-0@lo:400:kworker.0 Request processed in 42us (753us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189073.456692:0:68287:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1061 00000100:00100000:2.0:1784189073.456703:0:26170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf43c5dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0001-mdtlov_UUID+5:3640:x1870854458068608:12345-0@lo:400:kworker.0 Request processed in 157us (872us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189073.456710:0:68287:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1062 00000100:00100000:2.0:1784189073.456715:0:26170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2357 00000100:00100000:3.0:1784189073.456723:0:68287:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc07016c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1870854458068224:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784189073.456735:0:26170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2358 00000100:00100000:2.0:1784189073.456744:0:26170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf44c89c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+6:3640:x1870854458068864:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784189073.456769:0:68287:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc07016c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1870854458068224:12345-0@lo:400:kworker.0 Request processed in 48us (677us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189073.456778:0:68287:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1062 00000100:00100000:2.0:1784189073.456785:0:26170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf44c89c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+6:3640:x1870854458068864:12345-0@lo:400:kworker.0 Request processed in 42us (798us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189073.456793:0:26170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2358 00000100:00100000:3.0:1784189073.456797:0:68287:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1124 00000100:00100000:3.0:1784189073.456804:0:68287:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc05ed7c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3639:x1870854458067840:12345-0@lo:38:kworker.0 00000100:00100000:2.0:1784189073.456813:0:26170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2359 00000100:00100000:2.0:1784189073.456821:0:26170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc07016c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0001-mdtlov_UUID+5:3643:x1870854458068480:12345-0@lo:400:kworker.0 00010000:00080000:3.0:1784189073.456833:0:68287:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo recovering/t0 exp 0000000000000000 cur 3315 last 0 00000100:00100000:2.0:1784189073.456852:0:26170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc07016c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0001-mdtlov_UUID+5:3643:x1870854458068480:12345-0@lo:400:kworker.0 Request processed in 30us (824us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189073.456859:0:26170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2359 00000100:00100000:2.0:1784189073.456872:0:26170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2360 00000100:00100000:2.0:1784189073.456879:0:26170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc07016ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+6:3643:x1870854458068992:12345-0@lo:400:kworker.0 00000020:00000080:3.0:1784189073.456884:0:68287:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0xcc1762b626f8acde 00000004:00100000:3.0:1784189073.456918:0:68287:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00100000:2.0:1784189073.456927:0:26170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc07016ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+6:3643:x1870854458068992:12345-0@lo:400:kworker.0 Request processed in 47us (787us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189073.456934:0:26170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2360 00000100:00100000:2.0:1784189073.456958:0:87027:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458067584 00000100:00100000:2.0:1784189073.456962:0:87027:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458067584 00000100:00100000:2.0:1784189073.456996:0:87027:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1784189073.457005:0:87027:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc056555450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd553d0d-03e2-4233-b06b-b55bbfa2b954+24:3643:x1870854458067584:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784189073.457054:0:87027:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc056555450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd553d0d-03e2-4233-b06b-b55bbfa2b954+24:3643:x1870854458067584:12345-0@lo:400:kworker.0 Request processed in 49us (1096us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189073.457062:0:87027:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00080000:3.0:1784189073.457109:0:68287:0:(import.c:65:import_set_state_nolock()) ffff9dbf436c4800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1784189073.457161:0:68287:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc05ed7c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1870854458067840:12345-0@lo:38:kworker.0 Request processed in 356us (971us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189073.457175:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf4262fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3640:1870854458067968:0@lo:400:kworker.0 00000100:00100000:3.0:1784189073.457186:0:68287:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1124 00000100:00100000:2.0:1784189073.457196:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc080f69500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1870854458068864:0@lo:400:kworker.0 00000100:00100000:2.0:1784189073.457210:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf4367d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1870854458068608:0@lo:400:kworker.0 00000100:00080000:3.0:1784189073.457211:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1784189073.457219:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1784189073.457222:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1784189073.457233:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc05ed7f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1870854458067712:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1784189073.457263:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf4262e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3643:1870854458068224:0@lo:400:kworker.0 00000100:00100000:3.0:1784189073.457288:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc07016d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1870854458068992:0@lo:400:kworker.0 00000100:00100000:3.0:1784189073.457297:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf4262d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:bd553d0d-03e2-4233-b06b-b55bbfa2b954:3643:1870854458067584:0@lo:400:kworker.0 00000100:00100000:3.0:1784189073.457307:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf4367ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1870854458068480:0@lo:400:kworker.0 00000100:00100000:1.0:1784189073.457451:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc05f02ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3639:1870854458068352:0@lo:38:kworker.0 00000100:00100000:1.0:1784189073.457481:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784189073.457541:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc080f68e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3639:1870854458068736:0@lo:38:kworker.0 00000100:00100000:1.0:1784189073.457567:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784189073.457586:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc07016dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3639:1870854458069120:0@lo:38:kworker.0 00000100:00100000:1.0:1784189073.457611:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:1.0:1784189073.457642:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dbf4262ea00 x1870854458067840/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1784189098 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1784189073.457656:0:3639:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 24 00000100:00080000:1.0:1784189073.458621:0:3639:0:(import.c:1328:ptlrpc_connect_interpret()) @@@ lustre-MDT0000-lwp-OST0000: lwp recover req@ffff9dbf4262ea00 x1870854458067840/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1784189098 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1784189073.458632:0:3639:0:(import.c:65:import_set_state_nolock()) ffff9dbf42271800 lustre-MDT0000_UUID: changing import state from CONNECTING to RECOVER 00000100:00080000:1.0:1784189073.458639:0:3639:0:(import.c:65:import_set_state_nolock()) ffff9dbf42271800 lustre-MDT0000_UUID: changing import state from RECOVER to FULL 00000100:02000000:1.0:1784189073.458643:0:3639:0:(import.c:1743:ptlrpc_import_recovery_state_machine()) lustre-MDT0000-lwp-OST0000: Connection restored to 0@lo (at 0@lo) 00000100:00100000:1.0:1784189073.458650:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf4262ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3639:1870854458067840:0@lo:38:kworker.0 00000100:00100000:1.0:1784189073.458713:0:66169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458068096 00000100:00100000:1.0:1784189073.458720:0:66169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458068096 00000100:00100000:1.0:1784189073.458768:0:66169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458068736 00000100:00100000:1.0:1784189073.458771:0:66169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458068736 00000100:00100000:1.0:1784189073.458780:0:66169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458069120 00000100:00100000:1.0:1784189073.458783:0:66169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458069120 00000100:00100000:1.0:1784189073.458795:0:66169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1125 00000100:00100000:1.0:1784189073.458803:0:66169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc05ed7f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3639:x1870854458068096:12345-0@lo:38:kworker.0 00010000:00080000:1.0:1784189073.459017:0:66169:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo recovering/t0 exp 0000000000000000 cur 3315 last 0 00000020:00000080:1.0:1784189073.459067:0:66169:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0xcc1762b626f8ace5 00000004:00100000:1.0:1784189073.459092:0:66169:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1784189073.459242:0:66169:0:(import.c:65:import_set_state_nolock()) ffff9dc05ed22000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1784189073.459364:0:66171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1126 00000100:00100000:1.0:1784189073.459369:0:66169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc05ed7f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3639:x1870854458068096:12345-0@lo:38:kworker.0 Request processed in 561us (2837us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189073.459375:0:66171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc05ed7f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3639:x1870854458068736:12345-0@lo:38:kworker.0 00000100:00100000:1.0:1784189073.459382:0:66169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1125 00010000:00080000:2.0:1784189073.459399:0:66171:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0001_UUID@0@lo recovering/t0 exp 0000000000000000 cur 3315 last 0 00000100:00100000:1.0:1784189073.459409:0:66169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1127 00000100:00100000:1.0:1784189073.459415:0:66169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc05ed7ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3639:x1870854458069120:12345-0@lo:38:kworker.0 00010000:00080000:1.0:1784189073.459433:0:66169:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo recovering/t0 exp 0000000000000000 cur 3315 last 0 00000020:00000080:2.0:1784189073.459435:0:66171:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001_UUID, cookie 0xcc1762b626f8acec 00000004:00100000:2.0:1784189073.459444:0:66171:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1784189073.459464:0:66171:0:(import.c:65:import_set_state_nolock()) ffff9dc07a885000 : changing import state from RECOVER to FULL 00000020:00000080:1.0:1784189073.459468:0:66169:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0xcc1762b626f8acf3 00000004:00100000:1.0:1784189073.459478:0:66169:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00100000:2.0:1784189073.459502:0:66171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc05ed7f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1870854458068736:12345-0@lo:38:kworker.0 Request processed in 128us (1932us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189073.459511:0:66171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1126 00000100:00080000:1.0:1784189073.459512:0:66169:0:(import.c:65:import_set_state_nolock()) ffff9dc05ed22800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1784189073.459550:0:66169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc05ed7ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1870854458069120:12345-0@lo:38:kworker.0 Request processed in 133us (1937us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189073.459558:0:66169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1127 00010000:00080000:0.0:1784189073.459783:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dbf4262d180 x1870854458068096/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1784189098 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1784189073.459802:0:3639:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 24 00000100:00080000:0.0:1784189073.460806:0:3639:0:(import.c:1328:ptlrpc_connect_interpret()) @@@ lustre-MDT0000-lwp-OST0001: lwp recover req@ffff9dbf4262d180 x1870854458068096/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1784189098 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1784189073.460818:0:3639:0:(import.c:65:import_set_state_nolock()) ffff9dbf425f4800 lustre-MDT0000_UUID: changing import state from CONNECTING to RECOVER 00000100:00080000:0.0:1784189073.460823:0:3639:0:(import.c:65:import_set_state_nolock()) ffff9dbf425f4800 lustre-MDT0000_UUID: changing import state from RECOVER to FULL 00000100:02000000:0.0:1784189073.460828:0:3639:0:(import.c:1743:ptlrpc_import_recovery_state_machine()) lustre-MDT0000-lwp-OST0001: Connection restored to 0@lo (at 0@lo) 00000100:00100000:0.0:1784189073.460834:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf4262d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3639:1870854458068096:0@lo:38:kworker.0 00000100:00100000:3.0:1784189073.461383:0:26492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458068352 00000100:00100000:3.0:1784189073.461400:0:26492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458068352 00000100:00100000:3.0:1784189073.461561:0:26492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3739 00000100:00100000:3.0:1784189073.461570:0:26492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc05ed7df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3639:x1870854458068352:12345-0@lo:38:kworker.0 00010000:00080000:3.0:1784189073.461605:0:26492:0:(ldlm_lib.c:938:target_handle_reconnect()) connect export for UUID 'lustre-MDT0001-mdtlov_UUID' at ffff9dbf430fc800, cookie 0xcc1762b626f8ab48 00010000:00080000:3.0:1784189073.461611:0:26492:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo recovering/t77309411356 exp ffff9dbf430fc800 cur 3315 last 1784189067 00000004:00100000:3.0:1784189073.461633:0:26492:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1784189073.461665:0:26492:0:(import.c:65:import_set_state_nolock()) ffff9dbf436c2000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1784189073.461759:0:26492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc05ed7df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3639:x1870854458068352:12345-0@lo:38:kworker.0 Request processed in 188us (4277us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189073.461767:0:26492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3739 00010000:00080000:3.0:1784189073.461793:0:87056:0:(ldlm_lib.c:2545:check_for_recovery_ready()) connected 2 stale 0 max_recoverable_clients 2 abort 0 expired 0 00010000:00080000:3.0:1784189073.461800:0:87056:0:(ldlm_lib.c:2683:replay_request_or_update()) Waiting for transno 98784247813 00000020:00080000:3.0:1784189073.461806:0:87056:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1784189073.461810:0:87056:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 2, connected: 2, completed: 0, queue_len: 1, req_transno: 98784247813, next_transno: 98784247813 00010000:00080000:3.0:1784189073.461814:0:87056:0:(ldlm_lib.c:2246:check_for_next_transno()) waking for next (98784247813) 00000020:00080000:3.0:1784189073.461816:0:87056:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1784189073.461827:0:87056:0:(ldlm_lib.c:2747:replay_request_or_update()) @@@ processing x1870854436239232 t98784247813 from 192.168.203.12@tcp req@ffff9dc0762d6680 x1870854436239232/t0(98784247813) o36->b90fcc1c-0e69-42a4-a116-a71fec7aeb78@192.168.203.12@tcp:259/0 lens 528/0 e 0 to 0 dl 1784189079 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'mcreate.0' uid:0 gid:0 projid:4294967295 00010000:00080000:0.0:1784189073.462015:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dc080f68e00 x1870854458068736/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1784189098 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1784189073.462033:0:3639:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0001: connect to target with instance 24 00000100:00080000:0.0:1784189073.466151:0:3639:0:(import.c:1328:ptlrpc_connect_interpret()) @@@ lustre-MDT0000-lwp-MDT0001: lwp recover req@ffff9dc080f68e00 x1870854458068736/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1784189098 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1784189073.466170:0:3639:0:(import.c:65:import_set_state_nolock()) ffff9dbf43690800 lustre-MDT0000_UUID: changing import state from CONNECTING to RECOVER 00000100:00080000:0.0:1784189073.466178:0:3639:0:(import.c:65:import_set_state_nolock()) ffff9dbf43690800 lustre-MDT0000_UUID: changing import state from RECOVER to FULL 00000100:02000000:0.0:1784189073.466183:0:3639:0:(import.c:1743:ptlrpc_import_recovery_state_machine()) lustre-MDT0000-lwp-MDT0001: Connection restored to 0@lo (at 0@lo) 00000100:00100000:0.0:1784189073.466192:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc080f68e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3639:1870854458068736:0@lo:38:kworker.0 00010000:00080000:0.0:1784189073.466251:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dc07016dc00 x1870854458069120/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1784189083 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1784189073.466272:0:3639:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 24 00000100:00080000:0.0:1784189073.466284:0:3639:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:0.0:1784189073.466299:0:3639:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1784189073.466302:0:3639:0:(import.c:65:import_set_state_nolock()) ffff9dc07a883800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1784189073.466307:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc07016dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3639:1870854458069120:0@lo:38:kworker.0 00000100:00080000:0.0:1784189073.466444:0:3639:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-osp-MDT0001: connect to target with instance 24 00000100:00080000:0.0:1784189073.466454:0:3639:0:(import.c:65:import_set_state_nolock()) ffff9dbf436c4000 lustre-MDT0000_UUID: changing import state from CONNECTING to REPLAY 00000100:00080000:0.0:1784189073.466458:0:3639:0:(import.c:1700:ptlrpc_import_recovery_state_machine()) replay requested by lustre-MDT0000_UUID 00000100:00100000:0.0:1784189073.466462:0:3639:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 81604378625 gen 3 00000100:00080000:0.0:1784189073.466466:0:3639:0:(recover.c:53:ptlrpc_replay_next()) import ffff9dbf436c4000 from lustre-MDT0000_UUID committed 81604378625 last 0 00000100:00080000:0.0:1784189073.466470:0:3639:0:(import.c:65:import_set_state_nolock()) ffff9dbf436c4000 lustre-MDT0000_UUID: changing import state from REPLAY to REPLAY_LOCKS 00000004:00080000:3.0:1784189073.469590:0:87056:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 2531us 00000100:00100000:0.0:1784189073.470285:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc05f02ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3639:1870854458068352:0@lo:38:kworker.0 00010000:00080000:3.0:1784189073.470414:0:87377:0:(ldlm_request.c:2972:ldlm_lock_replay_thread()) lock replay thread lustre-MDT0000-osp-MDT0001 to lustre-MDT0000_UUID@0@lo 00010000:00010000:3.0:1784189073.470421:0:87377:0:(ldlm_request.c:2888:ldlm_cancel_unused_locks_for_replay()) Dropping as many unused locks as possible before replay for namespace lustre-MDT0000-osp-MDT0001 (0) 00010000:00010000:3.0:1784189073.470427:0:87377:0:(ldlm_request.c:2901:ldlm_cancel_unused_locks_for_replay()) Canceled 0 unused locks from namespace lustre-MDT0000-osp-MDT0001 00000100:00080000:3.0:1784189073.470867:0:87377:0:(import.c:65:import_set_state_nolock()) ffff9dbf436c4000 lustre-MDT0000_UUID: changing import state from REPLAY_LOCKS to REPLAY_WAIT 00000100:00100000:0.0:1784189073.471119:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc080e61f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3639:1870854458069248:0@lo:400:ldlm_lock_repla.0 00000100:00100000:0.0:1784189073.471207:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784189073.471342:0:23826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458069248 00000100:00100000:3.0:1784189073.471353:0:23826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458069248 00000100:00100000:3.0:1784189073.471423:0:23826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3740 00000100:00100000:3.0:1784189073.471432:0:23826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc0762d5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3639:x1870854458069248:12345-0@lo:400:ldlm_lock_repla.0 00010000:00080000:3.0:1784189073.471456:0:23826:0:(ldlm_lib.c:3137:target_queue_recovery_request()) @@@ queue final req req@ffff9dc0762d5500 x1870854458069248/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:264/0 lens 224/0 e 0 to 0 dl 1784189084 ref 2 fl Interpret:/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784189073.471469:0:23826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc0762d5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3639:x1870854458069248:12345-0@lo:400:ldlm_lock_repla.0 Request processed in 39us (262us total) trans 0 rc 0/-999 00000100:00100000:3.0:1784189073.471477:0:23826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3740 00010000:00010000:0.0:1784189073.504753:0:87056:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc070147c00/0xcc1762b626f8acfa lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 87056 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189073.504785:0:87056:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc070147c00/0xcc1762b626f8acfa lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 87056 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189073.504803:0:87056:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc070147c00/0xcc1762b626f8acfa lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 87056 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189073.504820:0:87056:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc070146a00/0xcc1762b626f8ad01 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x21e7de2f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 87056 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189073.504828:0:87056:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc070146a00/0xcc1762b626f8ad01 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x21e7de2f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 87056 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189073.504835:0:87056:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc070146a00/0xcc1762b626f8ad01 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x21e7de2f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 87056 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189073.505411:0:87056:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc070147c00/0xcc1762b626f8acfa lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 87056 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189073.505424:0:87056:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc070147c00/0xcc1762b626f8acfa lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 87056 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189073.505432:0:87056:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dc070147c00/0xcc1762b626f8acfa lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 87056 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189073.505438:0:87056:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc070147c00 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:0.0:1784189073.505444:0:87056:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc070147c00/0xcc1762b626f8acfa lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 87056 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189073.505452:0:87056:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc070147c00/0xcc1762b626f8acfa lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 87056 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189073.505467:0:87056:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9dc074ae2f00) 00010000:00010000:0.0:1784189073.505470:0:87056:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784189073.505476:0:87056:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dc070147c00/0xcc1762b626f8acfa lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 87056 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189073.505483:0:87056:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc070147c00/0xcc1762b626f8acfa lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 87056 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1784189073.505506:0:87056:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000005e9b8e94 reply state 000000000c728175 transno 98784247813 ns: mdt-lustre-MDT0000_UUID lock: ffff9dc070146a00/0xcc1762b626f8ad01 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x21e7de2f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 87056 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189073.505519:0:87056:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc070146a00/0xcc1762b626f8ad01 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x21e7de2f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 87056 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189073.505525:0:87056:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x21e7de2f (ffff9dc074ae2e00) 00010000:00010000:0.0:1784189073.505536:0:87056:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1784189073.505539:0:87056:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:0.0:1784189073.505690:0:87056:0:(ldlm_lib.c:2100:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 101 seconds 00000020:00080000:0.0:1784189073.505719:0:87056:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:0.0:1784189073.505723:0:87056:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 98784247814 00000020:00080000:0.0:1784189073.505727:0:87056:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:0.0:1784189073.505729:0:87056:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 98784247814 00000100:00100000:3.0:1784189073.509628:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1784189073.510310:0:66171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436239744 00000100:00100000:0.0:1784189073.510350:0:66171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436239744 00000100:00100000:0.0:1784189073.510429:0:66171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1128 00000100:00100000:0.0:1784189073.510443:0:66171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc080e63480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+8:2395:x1870854436239744:12345-192.168.203.12@tcp:36:rm.0 00010000:00080000:0.0:1784189073.510470:0:66171:0:(ldlm_lib.c:3228:target_queue_recovery_request()) Next recovery transno: 98784247814, current: 98784247814, replaying 00000100:00100000:0.0:1784189073.510486:0:66171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc080e63480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+8:2395:x1870854436239744:12345-192.168.203.12@tcp:36:rm.0 Request processed in 47us (875us total) trans 0 rc 0/-999 00000100:00100000:0.0:1784189073.510494:0:66171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1128 00000020:00080000:3.0:1784189073.511157:0:87056:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1784189073.511163:0:87056:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 98784247814, next_transno: 98784247814 00010000:00080000:3.0:1784189073.511169:0:87056:0:(ldlm_lib.c:2246:check_for_next_transno()) waking for next (98784247814) 00000020:00080000:3.0:1784189073.511172:0:87056:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1784189073.511185:0:87056:0:(ldlm_lib.c:2747:replay_request_or_update()) @@@ processing x1870854436239744 t98784247814 from 192.168.203.12@tcp req@ffff9dc080e63480 x1870854436239744/t0(98784247814) o36->b90fcc1c-0e69-42a4-a116-a71fec7aeb78@192.168.203.12@tcp:264/0 lens 512/0 e 0 to 0 dl 1784189084 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'rm.0' uid:0 gid:0 projid:4294967295 00010000:00010000:3.0:1784189073.511303:0:87056:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc081b17400/0xcc1762b626f8ad08 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 87056 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189073.511346:0:87056:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc081b17400/0xcc1762b626f8ad08 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 87056 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189073.511362:0:87056:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc081b17400/0xcc1762b626f8ad08 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 87056 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189073.511378:0:87056:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04a20a800/0xcc1762b626f8ad0f lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x21e7de2f bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 87056 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189073.511388:0:87056:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04a20a800/0xcc1762b626f8ad0f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x21e7de2f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 87056 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189073.511407:0:87056:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04a20a800/0xcc1762b626f8ad0f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x21e7de2f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 87056 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189073.511525:0:87056:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc05ec0c800/0xcc1762b626f8ad16 lrc: 3/0,1 mode: --/EX res: [0x20000a811:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 87056 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189073.511533:0:87056:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc05ec0c800/0xcc1762b626f8ad16 lrc: 3/0,1 mode: EX/EX res: [0x20000a811:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 87056 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189073.511540:0:87056:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc05ec0c800/0xcc1762b626f8ad16 lrc: 3/0,1 mode: EX/EX res: [0x20000a811:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 87056 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1784189073.532496:0:87022:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 98784247813 is committed 00010000:00010000:2.0:1784189073.532598:0:3626:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc070146a00/0xcc1762b626f8ad01 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x21e7de2f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 87056 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189073.532615:0:3626:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc070146a00/0xcc1762b626f8ad01 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x21e7de2f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 87056 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189073.532624:0:3626:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dc070146a00/0xcc1762b626f8ad01 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x21e7de2f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 87056 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189073.532651:0:3626:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc070146a00 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:2.0:1784189073.532657:0:3626:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc070146a00/0xcc1762b626f8ad01 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x21e7de2f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 87056 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189073.532666:0:3626:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc070146a00/0xcc1762b626f8ad01 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x21e7de2f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 87056 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189073.532689:0:3626:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x21e7de2f (ffff9dc074ae2e00) 00010000:00010000:2.0:1784189073.532693:0:3626:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784189073.532699:0:3626:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dc070146a00/0xcc1762b626f8ad01 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x21e7de2f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 87056 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189073.532706:0:3626:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc070146a00/0xcc1762b626f8ad01 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x21e7de2f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 87056 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189073.533087:0:87056:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc05ec0c800/0xcc1762b626f8ad16 lrc: 3/0,1 mode: EX/EX res: [0x20000a811:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 87056 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189073.533098:0:87056:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc05ec0c800/0xcc1762b626f8ad16 lrc: 2/0,0 mode: EX/EX res: [0x20000a811:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 87056 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189073.533105:0:87056:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dc05ec0c800/0xcc1762b626f8ad16 lrc: 3/0,0 mode: EX/EX res: [0x20000a811:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 87056 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189073.533111:0:87056:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc05ec0c800 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:0.0:1784189073.533114:0:87056:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc05ec0c800/0xcc1762b626f8ad16 lrc: 3/0,0 mode: EX/EX res: [0x20000a811:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 87056 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189073.533121:0:87056:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc05ec0c800/0xcc1762b626f8ad16 lrc: 4/0,0 mode: EX/EX res: [0x20000a811:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 87056 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189073.533139:0:87056:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x4:0x0].0x0 (ffff9dc080e5fd00) 00010000:00010000:0.0:1784189073.533141:0:87056:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1784189073.533145:0:87056:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dc05ec0c800/0xcc1762b626f8ad16 lrc: 2/0,0 mode: --/EX res: [0x20000a811:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 87056 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189073.533151:0:87056:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc05ec0c800/0xcc1762b626f8ad16 lrc: 0/0,0 mode: --/EX res: [0x20000a811:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 87056 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189073.533181:0:87056:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc081b17400/0xcc1762b626f8ad08 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 87056 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189073.533188:0:87056:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc081b17400/0xcc1762b626f8ad08 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 87056 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189073.533194:0:87056:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dc081b17400/0xcc1762b626f8ad08 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 87056 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189073.533199:0:87056:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc081b17400 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:0.0:1784189073.533202:0:87056:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc081b17400/0xcc1762b626f8ad08 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 87056 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189073.533209:0:87056:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc081b17400/0xcc1762b626f8ad08 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 87056 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189073.533217:0:87056:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9dc080e5f500) 00010000:00010000:0.0:1784189073.533220:0:87056:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784189073.533223:0:87056:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dc081b17400/0xcc1762b626f8ad08 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 87056 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189073.533229:0:87056:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc081b17400/0xcc1762b626f8ad08 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 87056 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1784189073.533256:0:87056:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000fe0793dd reply state 000000008b063676 transno 98784247814 ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04a20a800/0xcc1762b626f8ad0f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x21e7de2f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 87056 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189073.533270:0:87056:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04a20a800/0xcc1762b626f8ad0f lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x21e7de2f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 87056 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189073.533278:0:87056:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x21e7de2f (ffff9dc074ae2e00) 00010000:00010000:0.0:1784189073.533280:0:87056:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1784189073.533284:0:87056:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:0.0:1784189073.533545:0:87056:0:(ldlm_lib.c:2100:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:0.0:1784189073.533573:0:87056:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:0.0:1784189073.533577:0:87056:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 98784247815 00000020:00080000:0.0:1784189073.533581:0:87056:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:0.0:1784189073.533583:0:87056:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 98784247815 00000100:00100000:0.0:1784189073.544241:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1784189073.547015:0:66170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436240896 00000100:00100000:2.0:1784189073.547038:0:66170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436240896 00000100:00100000:2.0:1784189073.547136:0:66170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1129 00000100:00100000:2.0:1784189073.547150:0:66170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc05f02ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+8:2395:x1870854436240896:12345-192.168.203.12@tcp:101:touch.0 00010000:00080000:2.0:1784189073.547178:0:66170:0:(ldlm_lib.c:3228:target_queue_recovery_request()) Next recovery transno: 98784247815, current: 98784247815, replaying 00000100:00100000:2.0:1784189073.547197:0:66170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc05f02ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+8:2395:x1870854436240896:12345-192.168.203.12@tcp:101:touch.0 Request processed in 50us (2972us total) trans 0 rc 0/-999 00000100:00100000:2.0:1784189073.547206:0:66170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1129 00000020:00080000:0.0:1784189073.547310:0:87056:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:0.0:1784189073.547332:0:87056:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 98784247815, next_transno: 98784247815 00010000:00080000:0.0:1784189073.547338:0:87056:0:(ldlm_lib.c:2246:check_for_next_transno()) waking for next (98784247815) 00000020:00080000:0.0:1784189073.547342:0:87056:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:0.0:1784189073.547355:0:87056:0:(ldlm_lib.c:2747:replay_request_or_update()) @@@ processing x1870854436240896 t98784247815 from 192.168.203.12@tcp req@ffff9dc05f02ed80 x1870854436240896/t0(98784247815) o101->b90fcc1c-0e69-42a4-a116-a71fec7aeb78@192.168.203.12@tcp:264/0 lens 752/0 e 0 to 0 dl 1784189084 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'touch.0' uid:0 gid:0 projid:0 00010000:00010000:0.0:1784189073.547384:0:87056:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784189073.547417:0:87056:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc070147c00/0xcc1762b626f8ad1d lrc: 2/0,0 mode: --/CW res: [0x20000a811:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbfc5de7fe6c3d30 expref: -99 pid: 87056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189073.547722:0:87056:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc070146e00/0xcc1762b626f8ad24 lrc: 3/0,1 mode: --/CW res: [0x20000a811:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 87056 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189073.547761:0:87056:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc070146e00/0xcc1762b626f8ad24 lrc: 3/0,1 mode: CW/CW res: [0x20000a811:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 87056 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189073.547776:0:87056:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc070146e00/0xcc1762b626f8ad24 lrc: 3/0,1 mode: CW/CW res: [0x20000a811:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 87056 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189073.547792:0:87056:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc070147400/0xcc1762b626f8ad2b lrc: 3/0,1 mode: --/PW res: [0x20000a811:0x3:0x0].0xfa0fa5c1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 87056 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189073.547800:0:87056:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc070147400/0xcc1762b626f8ad2b lrc: 3/0,1 mode: PW/PW res: [0x20000a811:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 87056 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189073.547806:0:87056:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc070147400/0xcc1762b626f8ad2b lrc: 3/0,1 mode: PW/PW res: [0x20000a811:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 87056 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1784189073.548373:0:87056:0:(mdt_open.c:504:mdt_mfd_open()) orphan mfd not found, fid = [0x20000a811:0x5:0x0], cookie = 0xcc1762b626f8aaae 00000004:00080000:0.0:1784189073.548378:0:87056:0:(mdt_open.c:508:mdt_mfd_open()) Store old cookie 0xcc1762b626f8aaae in new mfd 00010000:00010000:0.0:1784189073.548390:0:87056:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc070146e00/0xcc1762b626f8ad24 lrc: 3/0,1 mode: CW/CW res: [0x20000a811:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 87056 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189073.548399:0:87056:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc070146e00/0xcc1762b626f8ad24 lrc: 2/0,0 mode: CW/CW res: [0x20000a811:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 87056 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189073.548407:0:87056:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dc070146e00/0xcc1762b626f8ad24 lrc: 3/0,0 mode: CW/CW res: [0x20000a811:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 87056 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189073.548414:0:87056:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc070146e00 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:0.0:1784189073.548419:0:87056:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc070146e00/0xcc1762b626f8ad24 lrc: 3/0,0 mode: CW/CW res: [0x20000a811:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 87056 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189073.548428:0:87056:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc070146e00/0xcc1762b626f8ad24 lrc: 4/0,0 mode: CW/CW res: [0x20000a811:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 87056 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189073.548451:0:87056:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x3:0x0].0x0 (ffff9dc074ae2f00) 00010000:00010000:0.0:1784189073.548454:0:87056:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784189073.548459:0:87056:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dc070146e00/0xcc1762b626f8ad24 lrc: 2/0,0 mode: --/CW res: [0x20000a811:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 87056 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189073.548466:0:87056:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc070146e00/0xcc1762b626f8ad24 lrc: 0/0,0 mode: --/CW res: [0x20000a811:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 87056 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1784189073.548480:0:87056:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000bca5fb8f reply state 000000006a2bd461 transno 98784247815 ns: mdt-lustre-MDT0000_UUID lock: ffff9dc070147400/0xcc1762b626f8ad2b lrc: 3/0,1 mode: PW/PW res: [0x20000a811:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 87056 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189073.548494:0:87056:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc070147400/0xcc1762b626f8ad2b lrc: 3/0,1 mode: TXN/TXN res: [0x20000a811:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 87056 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189073.548501:0:87056:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x3:0x0].0xfa0fa5c1 (ffff9dc074ae2600) 00010000:00010000:0.0:1784189073.548504:0:87056:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1784189073.548506:0:87056:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1784189073.548537:0:87056:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc070147c00/0xcc1762b626f8ad1d lrc: 1/0,0 mode: --/CW res: [0x20000a811:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c3d30 expref: 10 pid: 87056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189073.548549:0:87056:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x3:0x0].0x0 (ffff9dc074ae2f00) 00010000:00010000:0.0:1784189073.548551:0:87056:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784189073.548555:0:87056:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc070147c00/0xcc1762b626f8ad1d lrc: 0/0,0 mode: --/CW res: [0x20000a811:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c3d30 expref: 10 pid: 87056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189073.548570:0:87056:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc070147c00, rc 0) 00010000:00080000:0.0:1784189073.548656:0:87056:0:(ldlm_lib.c:2100:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:0.0:1784189073.548678:0:87056:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:0.0:1784189073.548681:0:87056:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 98784247816 00000020:00080000:0.0:1784189073.548691:0:87056:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:0.0:1784189073.548693:0:87056:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 98784247816 00000100:00100000:1.0:1784189073.571517:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1784189073.571629:0:66945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436241152 00000100:00100000:2.0:1784189073.571642:0:66945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436241152 00000100:00100000:2.0:1784189073.571717:0:66945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1130 00000100:00100000:2.0:1784189073.571729:0:66945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc05ed7f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+10:2395:x1870854436241152:12345-192.168.203.12@tcp:36:touch.0 00010000:00080000:2.0:1784189073.571777:0:66945:0:(ldlm_lib.c:3228:target_queue_recovery_request()) Next recovery transno: 98784247816, current: 98784247816, replaying 00000100:00100000:2.0:1784189073.571804:0:66945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc05ed7f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+10:2395:x1870854436241152:12345-192.168.203.12@tcp:36:touch.0 Request processed in 78us (302us total) trans 0 rc 0/-999 00000100:00100000:2.0:1784189073.571812:0:66945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1130 00000020:00080000:3.0:1784189073.572206:0:87056:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1784189073.572212:0:87056:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 98784247816, next_transno: 98784247816 00010000:00080000:3.0:1784189073.572217:0:87056:0:(ldlm_lib.c:2246:check_for_next_transno()) waking for next (98784247816) 00000020:00080000:3.0:1784189073.572220:0:87056:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1784189073.572233:0:87056:0:(ldlm_lib.c:2747:replay_request_or_update()) @@@ processing x1870854436241152 t98784247816 from 192.168.203.12@tcp req@ffff9dc05ed7f800 x1870854436241152/t0(98784247816) o36->b90fcc1c-0e69-42a4-a116-a71fec7aeb78@192.168.203.12@tcp:264/0 lens 488/0 e 0 to 0 dl 1784189084 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'touch.0' uid:0 gid:0 projid:4294967295 00010000:00010000:3.0:1784189073.572440:0:87056:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc05ec0ce00/0xcc1762b626f8ad39 lrc: 3/0,1 mode: --/PW res: [0x20000a811:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 87056 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189073.572461:0:87056:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc05ec0ce00/0xcc1762b626f8ad39 lrc: 3/0,1 mode: PW/PW res: [0x20000a811:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 87056 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189073.572475:0:87056:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc05ec0ce00/0xcc1762b626f8ad39 lrc: 3/0,1 mode: PW/PW res: [0x20000a811:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 87056 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1784189073.572619:0:87056:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000040fc2dd4 reply state 000000008961154c transno 98784247816 ns: mdt-lustre-MDT0000_UUID lock: ffff9dc05ec0ce00/0xcc1762b626f8ad39 lrc: 3/0,1 mode: PW/PW res: [0x20000a811:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 87056 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189073.572650:0:87056:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc05ec0ce00/0xcc1762b626f8ad39 lrc: 3/0,1 mode: TXN/TXN res: [0x20000a811:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 87056 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189073.572658:0:87056:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x5:0x0].0x0 (ffff9dc080e5fa00) 00010000:00010000:3.0:1784189073.572661:0:87056:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1784189073.572666:0:87056:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:3.0:1784189073.572786:0:87056:0:(ldlm_lib.c:2100:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:3.0:1784189073.572808:0:87056:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1784189073.572811:0:87056:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 98784247817 00000020:00080000:3.0:1784189073.572815:0:87056:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1784189073.572817:0:87056:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 98784247817 00000100:00100000:3.0:1784189073.575481:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1784189073.575591:0:66173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436241536 00000100:00100000:2.0:1784189073.575600:0:66173:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436241536 00000100:00100000:2.0:1784189073.575692:0:66173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 219 00000100:00100000:2.0:1784189073.575702:0:66173:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc05ed98000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+12:2395:x1870854436241536:12345-192.168.203.12@tcp:35:touch.0 00010000:00080000:2.0:1784189073.575721:0:66173:0:(ldlm_lib.c:3228:target_queue_recovery_request()) Next recovery transno: 98784247817, current: 98784247817, replaying 00000100:00100000:2.0:1784189073.575740:0:66173:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc05ed98000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+12:2395:x1870854436241536:12345-192.168.203.12@tcp:35:touch.0 Request processed in 41us (269us total) trans 0 rc 0/-999 00000100:00100000:2.0:1784189073.575748:0:66173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 219 00000020:00080000:3.0:1784189073.575787:0:87056:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1784189073.575792:0:87056:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 98784247817, next_transno: 98784247817 00010000:00080000:3.0:1784189073.575796:0:87056:0:(ldlm_lib.c:2246:check_for_next_transno()) waking for next (98784247817) 00000020:00080000:3.0:1784189073.575799:0:87056:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1784189073.575808:0:87056:0:(ldlm_lib.c:2747:replay_request_or_update()) @@@ processing x1870854436241536 t98784247817 from 192.168.203.12@tcp req@ffff9dc05ed98000 x1870854436241536/t0(98784247817) o35->b90fcc1c-0e69-42a4-a116-a71fec7aeb78@192.168.203.12@tcp:264/0 lens 392/0 e 0 to 0 dl 1784189084 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'touch.0' uid:0 gid:0 projid:0 00010000:00080000:3.0:1784189073.576051:0:87056:0:(ldlm_lib.c:2100:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:3.0:1784189073.576065:0:87056:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1784189073.576068:0:87056:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 98784247818 00000020:00080000:3.0:1784189073.576071:0:87056:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1784189073.576073:0:87056:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 98784247818 00000100:00100000:0.0:1784189073.585540:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1784189073.586071:0:66169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436247040 00000100:00100000:2.0:1784189073.586083:0:66169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436247040 00000100:00100000:2.0:1784189073.586214:0:66169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1063 00000100:00100000:2.0:1784189073.586226:0:66169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf46955f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+13:2395:x1870854436247040:12345-192.168.203.12@tcp:400:ldlm_lock_repla.0 00010000:00080000:2.0:1784189073.586258:0:66169:0:(ldlm_lib.c:3137:target_queue_recovery_request()) @@@ queue final req req@ffff9dbf46955f80 x1870854436247040/t0(0) o400->b90fcc1c-0e69-42a4-a116-a71fec7aeb78@192.168.203.12@tcp:264/0 lens 224/0 e 0 to 0 dl 1784189084 ref 2 fl Interpret:H/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784189073.586284:0:66169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf46955f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+13:2395:x1870854436247040:12345-192.168.203.12@tcp:400:ldlm_lock_repla.0 Request processed in 61us (757us total) trans 0 rc 0/-999 00000100:00100000:2.0:1784189073.586292:0:66169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1063 00000020:00080000:0.0:1784189073.586377:0:87056:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:0.0:1784189073.586382:0:87056:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 2, connected: 2, completed: 2, queue_len: 0, req_transno: 0, next_transno: 98784247818 00010000:00080000:0.0:1784189073.586385:0:87056:0:(ldlm_lib.c:2262:check_for_next_transno()) waking for completed recovery 00000020:00080000:0.0:1784189073.586389:0:87056:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:0.0:1784189073.586397:0:87056:0:(ldlm_lib.c:2452:target_next_replay_lock()) Waiting for lock 00010000:00080000:0.0:1784189073.586399:0:87056:0:(ldlm_lib.c:2285:check_for_next_lock()) waking for completed lock replay 00000001:00000004:0.0:1784189073.586535:0:87056:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 24, last_transno is 103079215104 00000001:00100000:1.0:1784189073.588059:0:87022:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of b90fcc1c-0e69-42a4-a116-a71fec7aeb78 00000001:00100000:1.0:1784189073.588070:0:87022:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000001:00080000:1.0:1784189073.588166:0:87022:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 98784247817 is committed 00000001:00080000:2.0:1784189073.588514:0:87056:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00010000:00080000:2.0:1784189073.588556:0:87056:0:(ldlm_lib.c:1996:target_cancel_recovery_timer()) lustre-MDT0000: cancel recovery timer 00010000:00080000:2.0:1784189073.588570:0:87056:0:(ldlm_lib.c:2940:target_recovery_thread()) @@@ processing final ping from 0@lo: req@ffff9dc0762d5500 x1870854458069248/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:264/0 lens 224/0 e 0 to 0 dl 1784189084 ref 1 fl Complete:/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00080000:2.0:1784189073.588696:0:87056:0:(ldlm_lib.c:2940:target_recovery_thread()) @@@ processing final ping from 192.168.203.12@tcp: req@ffff9dbf46955f80 x1870854436247040/t0(0) o400->b90fcc1c-0e69-42a4-a116-a71fec7aeb78@192.168.203.12@tcp:264/0 lens 224/0 e 0 to 0 dl 1784189084 ref 1 fl Complete:H/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:02000000:2.0:1784189073.588748:0:87056:0:(ldlm_lib.c:1868:target_finish_recovery()) lustre-MDT0000: Recovery over after 0:05, of 2 clients 2 recovered and 0 were evicted. 00010000:00010000:3.0:1784189073.589214:0:3627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04a20a800/0xcc1762b626f8ad0f lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x21e7de2f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 87056 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189073.589292:0:3627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04a20a800/0xcc1762b626f8ad0f lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x21e7de2f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 87056 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189073.589401:0:3627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04a20a800/0xcc1762b626f8ad0f lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x21e7de2f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 87056 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189073.589409:0:3627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc04a20a800 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:3.0:1784189073.589413:0:3627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04a20a800/0xcc1762b626f8ad0f lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x21e7de2f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 87056 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189073.589421:0:3627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04a20a800/0xcc1762b626f8ad0f lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x21e7de2f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 87056 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189073.589438:0:3627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x21e7de2f (ffff9dc074ae2e00) 00010000:00010000:3.0:1784189073.589441:0:3627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784189073.589446:0:3627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04a20a800/0xcc1762b626f8ad0f lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x21e7de2f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 87056 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189073.589453:0:3627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04a20a800/0xcc1762b626f8ad0f lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x21e7de2f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 87056 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189073.589479:0:3627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc070147400/0xcc1762b626f8ad2b lrc: 3/0,1 mode: TXN/TXN res: [0x20000a811:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 87056 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189073.589486:0:3627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc070147400/0xcc1762b626f8ad2b lrc: 2/0,0 mode: TXN/TXN res: [0x20000a811:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 87056 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189073.589492:0:3627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dc070147400/0xcc1762b626f8ad2b lrc: 3/0,0 mode: TXN/TXN res: [0x20000a811:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 87056 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189073.589497:0:3627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc070147400 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:3.0:1784189073.589500:0:3627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc070147400/0xcc1762b626f8ad2b lrc: 3/0,0 mode: TXN/TXN res: [0x20000a811:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 87056 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189073.589518:0:3627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc070147400/0xcc1762b626f8ad2b lrc: 4/0,0 mode: TXN/TXN res: [0x20000a811:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 87056 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189073.589529:0:3627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x3:0x0].0xfa0fa5c1 (ffff9dc074ae2600) 00010000:00010000:3.0:1784189073.589531:0:3627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784189073.589534:0:3627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dc070147400/0xcc1762b626f8ad2b lrc: 2/0,0 mode: --/TXN res: [0x20000a811:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 87056 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189073.589540:0:3627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc070147400/0xcc1762b626f8ad2b lrc: 0/0,0 mode: --/TXN res: [0x20000a811:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 87056 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1784189073.589542:0:3639:0:(import.c:65:import_set_state_nolock()) ffff9dbf436c4000 lustre-MDT0000_UUID: changing import state from REPLAY_WAIT to RECOVER 00000100:00080000:1.0:1784189073.589554:0:3639:0:(client.c:3234:ptlrpc_resend_req()) @@@ going to resend req@ffff9dc080e61f80 x1870854458069248/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1784189089 ref 1 fl Interpret:RQU/2c0/0 rc 0/0 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1784189073.589563:0:3639:0:(client.c:3243:ptlrpc_resend_req()) @@@ it has reply, so skip it req@ffff9dc080e61f80 x1870854458069248/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1784189089 ref 1 fl Interpret:RQU/2c0/0 rc 0/0 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1784189073.589570:0:3639:0:(import.c:65:import_set_state_nolock()) ffff9dbf436c4000 lustre-MDT0000_UUID: changing import state from RECOVER to FULL 00000100:02000000:1.0:1784189073.589585:0:3639:0:(import.c:1743:ptlrpc_import_recovery_state_machine()) lustre-MDT0000-osp-MDT0001: Connection restored to 0@lo (at 0@lo) 00000100:00100000:1.0:1784189073.589590:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc080e61f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3639:1870854458069248:0@lo:400:ldlm_lock_repla.0 00010000:00010000:3.0:1784189073.589622:0:3627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc05ec0ce00/0xcc1762b626f8ad39 lrc: 3/0,1 mode: TXN/TXN res: [0x20000a811:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 87056 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189073.589631:0:3627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc05ec0ce00/0xcc1762b626f8ad39 lrc: 2/0,0 mode: TXN/TXN res: [0x20000a811:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 87056 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189073.589638:0:3627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dc05ec0ce00/0xcc1762b626f8ad39 lrc: 3/0,0 mode: TXN/TXN res: [0x20000a811:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 87056 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189073.589645:0:3627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc05ec0ce00 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:3.0:1784189073.589648:0:3627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc05ec0ce00/0xcc1762b626f8ad39 lrc: 3/0,0 mode: TXN/TXN res: [0x20000a811:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 87056 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189073.589654:0:3627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc05ec0ce00/0xcc1762b626f8ad39 lrc: 4/0,0 mode: TXN/TXN res: [0x20000a811:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 87056 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189073.589664:0:3627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x5:0x0].0x0 (ffff9dc080e5fa00) 00010000:00010000:3.0:1784189073.589668:0:3627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784189073.589672:0:3627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dc05ec0ce00/0xcc1762b626f8ad39 lrc: 2/0,0 mode: --/TXN res: [0x20000a811:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 87056 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189073.589686:0:3627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc05ec0ce00/0xcc1762b626f8ad39 lrc: 0/0,0 mode: --/TXN res: [0x20000a811:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 87056 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784189073.589722:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1784189073.589748:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf46954380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1870854458069376:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1784189073.589831:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784189073.589872:0:26492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458069376 00000100:00100000:3.0:1784189073.589881:0:26492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458069376 00000100:00100000:3.0:1784189073.590480:0:26492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3741 00000100:00100000:3.0:1784189073.590490:0:26492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf46956a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3642:x1870854458069376:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1784189073.590532:0:26492:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445285888 avail 1299046400 00000100:00100000:3.0:1784189073.590608:0:26492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf46956a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3642:x1870854458069376:12345-0@lo:41:osp-pre-0-1.0 Request processed in 120us (777us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189073.590617:0:26492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3741 00000100:00100000:0.0:1784189073.591720:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf46954380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1870854458069376:0@lo:41:osp-pre-0-1.0 00000004:00000080:2.0:1784189073.612201:0:87056:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffae0987dabe10 00100000:10000000:2.0:1784189073.612215:0:87056:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000004:00080000:0.0:1784189073.613906:0:87042:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x280000401:0x45c:0x0] 00000100:00100000:0.0:1784189073.613953:0:87042:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf46954380 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:87042:1870854458069504:0@lo:5:osp-pre-0-0.0 00000100:00100000:0.0:1784189073.614017:0:87042:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784189073.614045:0:87042:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dc050e11180 going to sleep for 11 seconds 00000004:00080000:0.0:1784189073.614058:0:87044:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x2c0000401:0x682:0x0] 00000100:00100000:0.0:1784189073.614076:0:87044:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf46957480 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:87044:1870854458069632:0@lo:5:osp-pre-1-0.0 00000100:00100000:0.0:1784189073.614101:0:87044:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784189073.614118:0:87044:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dc050e11840 going to sleep for 11 seconds 00000100:00100000:0.0:1784189073.614138:0:26159:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458069504 00000100:00100000:0.0:1784189073.614145:0:26159:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458069504 00000100:00100000:0.0:1784189073.614186:0:26159:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458069632 00000100:00100000:0.0:1784189073.614189:0:26159:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458069632 00000100:00100000:0.0:1784189073.614210:0:26159:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4933 00000100:00100000:0.0:1784189073.614225:0:26159:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf46955500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+6:87042:x1870854458069504:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:0.0:1784189073.614253:0:26159:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 1761 -> diff = -645 00002000:02000040:0.0:1784189073.614258:0:26159:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:1117 to 0x280000401:1761) 00000100:00100000:3.0:1784189073.617254:0:26160:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4934 00000100:00100000:3.0:1784189073.617286:0:26160:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf46954700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+6:87044:x1870854458069632:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:3.0:1784189073.617365:0:26160:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 1761 -> diff = -95 00002000:02000040:3.0:1784189073.617372:0:26160:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000401:1667 to 0x2c0000401:1761) 00002000:00010000:0.0:1784189073.625258:0:26159:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6e1:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784189073.625274:0:26159:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003e7567cf/0xcc1762b626f8ad40 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6e1:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189073.625292:0:26159:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6e1:0x0].0x0 since=3315s v=(0 0) 00010000:00010000:0.0:1784189073.625297:0:26159:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6e1:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784189073.625304:0:26159:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003e7567cf/0xcc1762b626f8ad40 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189073.625364:0:26159:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003e7567cf/0xcc1762b626f8ad40 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189073.625376:0:26159:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003e7567cf/0xcc1762b626f8ad40 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189073.625384:0:26159:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003e7567cf/0xcc1762b626f8ad40 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189073.626420:0:26159:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1784189073.626557:0:26159:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6e0:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784189073.626563:0:26159:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006c2923fb/0xcc1762b626f8ad47 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6e0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189073.626575:0:26159:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6e0:0x0].0x0 since=3315s v=(0 0) 00010000:00010000:0.0:1784189073.626591:0:26159:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6e0:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784189073.626597:0:26159:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006c2923fb/0xcc1762b626f8ad47 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189073.626608:0:26159:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006c2923fb/0xcc1762b626f8ad47 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189073.626617:0:26159:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006c2923fb/0xcc1762b626f8ad47 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189073.626624:0:26159:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006c2923fb/0xcc1762b626f8ad47 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189073.626652:0:6501:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1784189073.626660:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003e7567cf/0xcc1762b626f8ad40 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189073.626668:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc070146e00 already unused, calling callback (ffffffffc0b2e230) 00010000:00010000:2.0:1784189073.626673:0:6501:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003e7567cf/0xcc1762b626f8ad40 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189073.626691:0:6501:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003e7567cf/0xcc1762b626f8ad40 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189073.626708:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003e7567cf/0xcc1762b626f8ad40 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189073.626716:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003e7567cf/0xcc1762b626f8ad40 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189073.626735:0:6501:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784189073.626738:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006c2923fb/0xcc1762b626f8ad47 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189073.626757:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc070147600 already unused, calling callback (ffffffffc0b2e230) 00010000:00010000:2.0:1784189073.626761:0:6501:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006c2923fb/0xcc1762b626f8ad47 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189073.626769:0:6501:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006c2923fb/0xcc1762b626f8ad47 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x6e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189073.626779:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006c2923fb/0xcc1762b626f8ad47 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x6e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189073.626787:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784189073.626789:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784189073.626791:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784189073.627097:0:26159:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1784189073.627103:0:26159:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006c2923fb/0xcc1762b626f8ad47 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1784189073.627165:0:26159:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6df:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784189073.627170:0:26159:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006dde6b82/0xcc1762b626f8ad4e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6df:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189073.627178:0:26159:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6df:0x0].0x0 since=3315s v=(0 0) 00010000:00010000:0.0:1784189073.627181:0:26159:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6df:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784189073.627186:0:26159:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006dde6b82/0xcc1762b626f8ad4e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189073.627194:0:26159:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006dde6b82/0xcc1762b626f8ad4e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189073.627208:0:26159:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006dde6b82/0xcc1762b626f8ad4e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189073.627215:0:26159:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006dde6b82/0xcc1762b626f8ad4e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189073.628528:0:7454:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784189073.628540:0:7454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006dde6b82/0xcc1762b626f8ad4e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189073.628797:0:7454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc070147200 already unused, calling callback (ffffffffc0b2e230) 00010000:00010000:2.0:1784189073.628803:0:7454:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006dde6b82/0xcc1762b626f8ad4e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189073.628813:0:7454:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006dde6b82/0xcc1762b626f8ad4e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x6df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189073.628829:0:7454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006dde6b82/0xcc1762b626f8ad4e lrc: 2/0,0 mode: --/PW res: [0x280000401:0x6df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189073.628847:0:7454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784189073.628849:0:7454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784189073.628851:0:7454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1784189073.629168:0:8423:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:0.0:1784189073.629238:0:26159:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1784189073.629245:0:26159:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006dde6b82/0xcc1762b626f8ad4e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1784189073.629374:0:26159:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6de:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784189073.629380:0:26159:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005168a0f1/0xcc1762b626f8ad55 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6de:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189073.629391:0:26159:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6de:0x0].0x0 since=3315s v=(0 0) 00010000:00010000:0.0:1784189073.629396:0:26159:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6de:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784189073.629401:0:26159:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005168a0f1/0xcc1762b626f8ad55 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189073.629412:0:26159:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005168a0f1/0xcc1762b626f8ad55 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189073.629421:0:26159:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005168a0f1/0xcc1762b626f8ad55 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189073.629441:0:26159:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005168a0f1/0xcc1762b626f8ad55 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189073.629594:0:26173:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784189073.629600:0:26173:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005168a0f1/0xcc1762b626f8ad55 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189073.629609:0:26173:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc070146400 already unused, calling callback (ffffffffc0b2e230) 00010000:00010000:2.0:1784189073.629613:0:26173:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005168a0f1/0xcc1762b626f8ad55 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189073.629621:0:26173:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005168a0f1/0xcc1762b626f8ad55 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x6de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189073.629633:0:26173:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005168a0f1/0xcc1762b626f8ad55 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x6de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189073.629642:0:26173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784189073.629644:0:26173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784189073.629645:0:26173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784189073.629749:0:26159:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1784189073.629755:0:26159:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005168a0f1/0xcc1762b626f8ad55 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1784189073.629804:0:26159:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6dd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784189073.629809:0:26159:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000eab8efbc/0xcc1762b626f8ad5c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6dd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189073.629817:0:26159:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6dd:0x0].0x0 since=3315s v=(0 0) 00010000:00010000:0.0:1784189073.629821:0:26159:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6dd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784189073.629826:0:26159:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000eab8efbc/0xcc1762b626f8ad5c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189073.629835:0:26159:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000eab8efbc/0xcc1762b626f8ad5c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189073.629843:0:26159:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000eab8efbc/0xcc1762b626f8ad5c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189073.629851:0:26159:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000eab8efbc/0xcc1762b626f8ad5c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189073.629898:0:6502:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784189073.629905:0:6502:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000eab8efbc/0xcc1762b626f8ad5c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189073.629911:0:6502:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc070147000 already unused, calling callback (ffffffffc0b2e230) 00010000:00010000:1.0:1784189073.629914:0:6502:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000eab8efbc/0xcc1762b626f8ad5c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189073.629933:0:6502:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000eab8efbc/0xcc1762b626f8ad5c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x6dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189073.629944:0:6502:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000eab8efbc/0xcc1762b626f8ad5c lrc: 2/0,0 mode: --/PW res: [0x280000401:0x6dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189073.629951:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784189073.629953:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784189073.629954:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784189073.630036:0:26159:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1784189073.630041:0:26159:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000eab8efbc/0xcc1762b626f8ad5c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1784189073.630095:0:26159:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6dc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784189073.630101:0:26159:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000018e6ca93/0xcc1762b626f8ad63 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6dc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189073.630109:0:26159:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6dc:0x0].0x0 since=3315s v=(0 0) 00010000:00010000:0.0:1784189073.630112:0:26159:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6dc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784189073.630116:0:26159:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000018e6ca93/0xcc1762b626f8ad63 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189073.630125:0:26159:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000018e6ca93/0xcc1762b626f8ad63 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189073.630132:0:26159:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000018e6ca93/0xcc1762b626f8ad63 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189073.630139:0:26159:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000018e6ca93/0xcc1762b626f8ad63 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189073.630174:0:6501:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784189073.630179:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000018e6ca93/0xcc1762b626f8ad63 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189073.630185:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc070146000 already unused, calling callback (ffffffffc0b2e230) 00010000:00010000:2.0:1784189073.630189:0:6501:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000018e6ca93/0xcc1762b626f8ad63 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189073.630202:0:6501:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000018e6ca93/0xcc1762b626f8ad63 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x6dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189073.630213:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000018e6ca93/0xcc1762b626f8ad63 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x6dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189073.630221:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784189073.630223:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784189073.630225:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784189073.630278:0:26159:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1784189073.630283:0:26159:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000018e6ca93/0xcc1762b626f8ad63 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1784189073.630371:0:26159:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6db:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784189073.630376:0:26159:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000006e3ee29/0xcc1762b626f8ad6a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6db:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189073.630383:0:26159:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6db:0x0].0x0 since=3315s v=(0 0) 00010000:00010000:0.0:1784189073.630386:0:26159:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6db:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784189073.630390:0:26159:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000006e3ee29/0xcc1762b626f8ad6a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189073.630398:0:26159:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000006e3ee29/0xcc1762b626f8ad6a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189073.630406:0:26159:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000006e3ee29/0xcc1762b626f8ad6a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189073.630413:0:26159:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000006e3ee29/0xcc1762b626f8ad6a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189073.630480:0:7454:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784189073.630545:0:7454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000006e3ee29/0xcc1762b626f8ad6a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189073.630552:0:7454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc070146c00 already unused, calling callback (ffffffffc0b2e230) 00010000:00010000:2.0:1784189073.630556:0:7454:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000006e3ee29/0xcc1762b626f8ad6a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189073.630563:0:7454:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000006e3ee29/0xcc1762b626f8ad6a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x6db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189073.630575:0:7454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000006e3ee29/0xcc1762b626f8ad6a lrc: 2/0,0 mode: --/PW res: [0x280000401:0x6db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189073.630583:0:7454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784189073.630585:0:7454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784189073.630594:0:7454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784189073.630645:0:26159:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1784189073.630650:0:26159:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000006e3ee29/0xcc1762b626f8ad6a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1784189073.630709:0:26159:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6da:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784189073.630714:0:26159:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000034a0fccf/0xcc1762b626f8ad71 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6da:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189073.630733:0:26159:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6da:0x0].0x0 since=3315s v=(0 0) 00010000:00010000:0.0:1784189073.630736:0:26159:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6da:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784189073.630741:0:26159:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000034a0fccf/0xcc1762b626f8ad71 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189073.630750:0:26159:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000034a0fccf/0xcc1762b626f8ad71 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189073.630757:0:26159:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000034a0fccf/0xcc1762b626f8ad71 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189073.630775:0:26159:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000034a0fccf/0xcc1762b626f8ad71 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189073.630910:0:26173:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784189073.630916:0:26173:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000034a0fccf/0xcc1762b626f8ad71 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189073.630923:0:26173:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc070146800 already unused, calling callback (ffffffffc0b2e230) 00010000:00010000:2.0:1784189073.630926:0:26173:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000034a0fccf/0xcc1762b626f8ad71 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189073.630934:0:26173:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000034a0fccf/0xcc1762b626f8ad71 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x6da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189073.630945:0:26173:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000034a0fccf/0xcc1762b626f8ad71 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x6da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189073.630953:0:26173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784189073.630954:0:26173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784189073.630956:0:26173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784189073.631020:0:26159:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1784189073.631026:0:26159:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000034a0fccf/0xcc1762b626f8ad71 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1784189073.631075:0:26159:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6d9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784189073.631080:0:26159:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c82edde2/0xcc1762b626f8ad78 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6d9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189073.631088:0:26159:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6d9:0x0].0x0 since=3315s v=(0 0) 00010000:00010000:0.0:1784189073.631091:0:26159:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6d9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784189073.631094:0:26159:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c82edde2/0xcc1762b626f8ad78 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189073.631109:0:26159:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c82edde2/0xcc1762b626f8ad78 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189073.631118:0:26159:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c82edde2/0xcc1762b626f8ad78 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189073.631125:0:26159:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c82edde2/0xcc1762b626f8ad78 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189073.631152:0:6502:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784189073.631157:0:6502:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c82edde2/0xcc1762b626f8ad78 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189073.631165:0:6502:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc070147400 already unused, calling callback (ffffffffc0b2e230) 00010000:00010000:1.0:1784189073.631169:0:6502:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c82edde2/0xcc1762b626f8ad78 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189073.631176:0:6502:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c82edde2/0xcc1762b626f8ad78 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x6d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189073.631187:0:6502:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c82edde2/0xcc1762b626f8ad78 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x6d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189073.631194:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784189073.631196:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784189073.631203:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784189073.631253:0:26159:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1784189073.631257:0:26159:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c82edde2/0xcc1762b626f8ad78 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1784189073.631302:0:26159:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6d8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784189073.631307:0:26159:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000008146e3f/0xcc1762b626f8ad7f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6d8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189073.631341:0:26159:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6d8:0x0].0x0 since=3315s v=(0 0) 00010000:00010000:0.0:1784189073.631345:0:26159:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6d8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784189073.631350:0:26159:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000008146e3f/0xcc1762b626f8ad7f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189073.631359:0:26159:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000008146e3f/0xcc1762b626f8ad7f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189073.631378:0:26159:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000008146e3f/0xcc1762b626f8ad7f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189073.631385:0:26159:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000008146e3f/0xcc1762b626f8ad7f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189073.633086:0:6501:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784189073.633099:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000008146e3f/0xcc1762b626f8ad7f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189073.633123:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc070147c00 already unused, calling callback (ffffffffc0b2e230) 00010000:00010000:2.0:1784189073.633128:0:6501:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000008146e3f/0xcc1762b626f8ad7f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189073.633139:0:6501:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000008146e3f/0xcc1762b626f8ad7f lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x6d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189073.633174:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000008146e3f/0xcc1762b626f8ad7f lrc: 2/0,0 mode: --/PW res: [0x280000401:0x6d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189073.633185:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784189073.633187:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784189073.633189:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784189073.633636:0:26159:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1784189073.633643:0:26159:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000008146e3f/0xcc1762b626f8ad7f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1784189073.633772:0:26159:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6d7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784189073.633779:0:26159:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000023bc515f/0xcc1762b626f8ad86 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6d7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189073.633791:0:26159:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6d7:0x0].0x0 since=3315s v=(0 0) 00010000:00010000:0.0:1784189073.633794:0:26159:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6d7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784189073.633800:0:26159:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000023bc515f/0xcc1762b626f8ad86 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189073.633811:0:26159:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000023bc515f/0xcc1762b626f8ad86 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189073.633893:0:7454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784189073.634011:0:26159:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000023bc515f/0xcc1762b626f8ad86 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189073.634032:0:26159:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000023bc515f/0xcc1762b626f8ad86 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189073.634081:0:26159:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1784189073.634126:0:26159:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6d6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784189073.634131:0:26159:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004acab531/0xcc1762b626f8ad8d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6d6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189073.634138:0:26159:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6d6:0x0].0x0 since=3315s v=(0 0) 00010000:00010000:0.0:1784189073.634141:0:26159:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6d6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784189073.634145:0:26159:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004acab531/0xcc1762b626f8ad8d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189073.634154:0:26159:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004acab531/0xcc1762b626f8ad8d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189073.634162:0:26159:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004acab531/0xcc1762b626f8ad8d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189073.634169:0:26159:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004acab531/0xcc1762b626f8ad8d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189073.634368:0:26173:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1784189073.634374:0:26173:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000023bc515f/0xcc1762b626f8ad86 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189073.634382:0:26173:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc070146a00 already unused, calling callback (ffffffffc0b2e230) 00010000:00010000:2.0:1784189073.634387:0:26173:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000023bc515f/0xcc1762b626f8ad86 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189073.634394:0:26173:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000023bc515f/0xcc1762b626f8ad86 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189073.634407:0:26173:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000023bc515f/0xcc1762b626f8ad86 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189073.634415:0:26173:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000023bc515f/0xcc1762b626f8ad86 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189073.634442:0:26173:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784189073.634445:0:26173:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004acab531/0xcc1762b626f8ad8d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189073.634458:0:26173:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc070146200 already unused, calling callback (ffffffffc0b2e230) 00010000:00010000:2.0:1784189073.634462:0:26173:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004acab531/0xcc1762b626f8ad8d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189073.634468:0:26173:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004acab531/0xcc1762b626f8ad8d lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x6d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189073.634479:0:26173:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004acab531/0xcc1762b626f8ad8d lrc: 2/0,0 mode: --/PW res: [0x280000401:0x6d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189073.634492:0:26173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784189073.634494:0:26173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784189073.634496:0:26173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784189073.634609:0:26159:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1784189073.634615:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784189073.634616:0:26159:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004acab531/0xcc1762b626f8ad8d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1784189073.634687:0:26159:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6d5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784189073.634693:0:26159:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cd45e61e/0xcc1762b626f8ad94 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6d5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189073.634703:0:26159:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6d5:0x0].0x0 since=3315s v=(0 0) 00010000:00010000:0.0:1784189073.634706:0:26159:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6d5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784189073.634711:0:26159:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cd45e61e/0xcc1762b626f8ad94 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189073.634720:0:26159:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cd45e61e/0xcc1762b626f8ad94 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189073.634728:0:26159:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cd45e61e/0xcc1762b626f8ad94 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189073.634735:0:26159:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cd45e61e/0xcc1762b626f8ad94 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189073.634784:0:26159:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1784189073.634837:0:26159:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6d4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784189073.634842:0:26159:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000045e176f4/0xcc1762b626f8ad9b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6d4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189073.634850:0:26159:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6d4:0x0].0x0 since=3315s v=(0 0) 00010000:00010000:0.0:1784189073.634853:0:26159:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6d4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784189073.634862:0:26159:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000045e176f4/0xcc1762b626f8ad9b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189073.634871:0:26159:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000045e176f4/0xcc1762b626f8ad9b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189073.634880:0:26159:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000045e176f4/0xcc1762b626f8ad9b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189073.634895:0:26159:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000045e176f4/0xcc1762b626f8ad9b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189073.634927:0:6501:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1784189073.634932:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cd45e61e/0xcc1762b626f8ad94 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189073.634939:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc070146600 already unused, calling callback (ffffffffc0b2e230) 00010000:00010000:2.0:1784189073.634943:0:6501:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cd45e61e/0xcc1762b626f8ad94 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189073.634950:0:6501:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cd45e61e/0xcc1762b626f8ad94 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189073.634961:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cd45e61e/0xcc1762b626f8ad94 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189073.634974:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cd45e61e/0xcc1762b626f8ad94 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189073.634989:0:6501:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784189073.634992:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000045e176f4/0xcc1762b626f8ad9b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189073.634999:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc081b17400 already unused, calling callback (ffffffffc0b2e230) 00010000:00010000:2.0:1784189073.635002:0:6501:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000045e176f4/0xcc1762b626f8ad9b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189073.635010:0:6501:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000045e176f4/0xcc1762b626f8ad9b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x6d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189073.635020:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000045e176f4/0xcc1762b626f8ad9b lrc: 2/0,0 mode: --/PW res: [0x280000401:0x6d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189073.635028:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784189073.635029:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784189073.635031:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784189073.635140:0:26159:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1784189073.635147:0:26159:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000045e176f4/0xcc1762b626f8ad9b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189073.635299:0:7454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1784189073.635389:0:26159:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6d3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784189073.635395:0:26159:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c441b122/0xcc1762b626f8ada2 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6d3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189073.635404:0:26159:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6d3:0x0].0x0 since=3315s v=(0 0) 00010000:00010000:0.0:1784189073.635408:0:26159:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6d3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784189073.635412:0:26159:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c441b122/0xcc1762b626f8ada2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189073.635503:0:26159:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c441b122/0xcc1762b626f8ada2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189073.635525:0:26159:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c441b122/0xcc1762b626f8ada2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189073.635532:0:26159:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c441b122/0xcc1762b626f8ada2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189073.635579:0:26159:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1784189073.635624:0:26159:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6d2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784189073.635630:0:26159:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007dc48d1b/0xcc1762b626f8ada9 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6d2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189073.635638:0:26159:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6d2:0x0].0x0 since=3315s v=(0 0) 00010000:00010000:0.0:1784189073.635641:0:26159:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6d2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784189073.635646:0:26159:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007dc48d1b/0xcc1762b626f8ada9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189073.635655:0:26159:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007dc48d1b/0xcc1762b626f8ada9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189073.635664:0:26159:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007dc48d1b/0xcc1762b626f8ada9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189073.635672:0:26159:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007dc48d1b/0xcc1762b626f8ada9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189073.635721:0:26173:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1784189073.635727:0:26173:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c441b122/0xcc1762b626f8ada2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189073.635734:0:26173:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc04152ca00 already unused, calling callback (ffffffffc0b2e230) 00010000:00010000:2.0:1784189073.635744:0:26173:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c441b122/0xcc1762b626f8ada2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189073.635753:0:26173:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c441b122/0xcc1762b626f8ada2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189073.635765:0:26173:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c441b122/0xcc1762b626f8ada2 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189073.635773:0:26173:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c441b122/0xcc1762b626f8ada2 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189073.635788:0:26173:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784189073.635791:0:26173:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007dc48d1b/0xcc1762b626f8ada9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189073.635798:0:26173:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc04152d000 already unused, calling callback (ffffffffc0b2e230) 00010000:00010000:2.0:1784189073.635801:0:26173:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007dc48d1b/0xcc1762b626f8ada9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189073.635809:0:26173:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007dc48d1b/0xcc1762b626f8ada9 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x6d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189073.635910:0:26173:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007dc48d1b/0xcc1762b626f8ada9 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x6d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189073.635918:0:26173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784189073.635927:0:26173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784189073.635929:0:26173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784189073.635962:0:26159:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1784189073.635968:0:26159:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007dc48d1b/0xcc1762b626f8ada9 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189073.635992:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1784189073.636019:0:26159:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6d1:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784189073.636024:0:26159:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002a207b70/0xcc1762b626f8adb0 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6d1:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189073.636032:0:26159:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6d1:0x0].0x0 since=3315s v=(0 0) 00010000:00010000:0.0:1784189073.636035:0:26159:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6d1:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784189073.636039:0:26159:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002a207b70/0xcc1762b626f8adb0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189073.636047:0:26159:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002a207b70/0xcc1762b626f8adb0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189073.636055:0:26159:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002a207b70/0xcc1762b626f8adb0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189073.636066:0:26159:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002a207b70/0xcc1762b626f8adb0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189073.636110:0:26159:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1784189073.636148:0:26159:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6d0:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784189073.636153:0:26159:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008d9a0db1/0xcc1762b626f8adb7 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6d0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189073.636167:0:26159:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6d0:0x0].0x0 since=3315s v=(0 0) 00010000:00010000:0.0:1784189073.636170:0:26159:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6d0:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784189073.636174:0:26159:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008d9a0db1/0xcc1762b626f8adb7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189073.636182:0:26159:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008d9a0db1/0xcc1762b626f8adb7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189073.636190:0:26159:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008d9a0db1/0xcc1762b626f8adb7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189073.636210:0:26159:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008d9a0db1/0xcc1762b626f8adb7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189073.636286:0:6501:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1784189073.636291:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002a207b70/0xcc1762b626f8adb0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189073.636299:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc04152ce00 already unused, calling callback (ffffffffc0b2e230) 00010000:00010000:2.0:1784189073.636302:0:6501:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002a207b70/0xcc1762b626f8adb0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189073.636310:0:6501:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002a207b70/0xcc1762b626f8adb0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189073.636338:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002a207b70/0xcc1762b626f8adb0 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189073.636345:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002a207b70/0xcc1762b626f8adb0 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189073.636357:0:6501:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784189073.636360:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008d9a0db1/0xcc1762b626f8adb7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189073.636366:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc04152c200 already unused, calling callback (ffffffffc0b2e230) 00010000:00010000:2.0:1784189073.636369:0:6501:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008d9a0db1/0xcc1762b626f8adb7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189073.636385:0:6501:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008d9a0db1/0xcc1762b626f8adb7 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x6d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189073.636394:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008d9a0db1/0xcc1762b626f8adb7 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x6d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189073.636401:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784189073.636403:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784189073.636404:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784189073.636529:0:26159:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1784189073.636535:0:26159:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008d9a0db1/0xcc1762b626f8adb7 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1784189073.636586:0:26159:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6cf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784189073.636590:0:26159:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b9f026b8/0xcc1762b626f8adbe lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6cf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189073.636598:0:26159:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6cf:0x0].0x0 since=3315s v=(0 0) 00010000:00010000:0.0:1784189073.636601:0:26159:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6cf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784189073.636605:0:26159:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b9f026b8/0xcc1762b626f8adbe lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189073.636620:0:26159:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b9f026b8/0xcc1762b626f8adbe lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189073.636629:0:26159:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b9f026b8/0xcc1762b626f8adbe lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189073.636636:0:26159:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b9f026b8/0xcc1762b626f8adbe lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189073.636657:0:26159:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1784189073.636696:0:26159:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6ce:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784189073.636701:0:26159:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000490fcfab/0xcc1762b626f8adc5 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6ce:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189073.636708:0:26159:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6ce:0x0].0x0 since=3315s v=(0 0) 00010000:00010000:0.0:1784189073.636711:0:26159:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6ce:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784189073.636715:0:26159:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000490fcfab/0xcc1762b626f8adc5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189073.636723:0:26159:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000490fcfab/0xcc1762b626f8adc5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189073.636731:0:26159:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000490fcfab/0xcc1762b626f8adc5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189073.636748:0:26159:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000490fcfab/0xcc1762b626f8adc5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189073.636750:0:26173:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784189073.636759:0:26173:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b9f026b8/0xcc1762b626f8adbe lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189073.636765:0:26159:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1784189073.636771:0:26173:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc04152c800 already unused, calling callback (ffffffffc0b2e230) 00010000:00010000:1.0:1784189073.636776:0:26173:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b9f026b8/0xcc1762b626f8adbe lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189073.636785:0:26173:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b9f026b8/0xcc1762b626f8adbe lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189073.636800:0:26173:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b9f026b8/0xcc1762b626f8adbe lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189073.636808:0:26173:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b9f026b8/0xcc1762b626f8adbe lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1784189073.636808:0:26159:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6cd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784189073.636829:0:26173:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784189073.636832:0:26173:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000490fcfab/0xcc1762b626f8adc5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189073.636839:0:26173:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc04152d400 already unused, calling callback (ffffffffc0b2e230) 00010000:00010000:1.0:1784189073.636842:0:26173:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000490fcfab/0xcc1762b626f8adc5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189073.636862:0:26173:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000490fcfab/0xcc1762b626f8adc5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189073.636873:0:26173:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000490fcfab/0xcc1762b626f8adc5 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189073.636881:0:26173:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000490fcfab/0xcc1762b626f8adc5 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189073.636894:0:7454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784189073.636906:0:26173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784189073.636909:0:26173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784189073.636910:0:26173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784189073.636919:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784189073.636922:0:26159:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002a22be6d/0xcc1762b626f8adcc lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6cd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189073.636932:0:26159:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6cd:0x0].0x0 since=3315s v=(0 0) 00010000:00010000:0.0:1784189073.636934:0:26159:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6cd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784189073.636938:0:26159:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002a22be6d/0xcc1762b626f8adcc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189073.636947:0:26159:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002a22be6d/0xcc1762b626f8adcc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189073.636953:0:26159:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002a22be6d/0xcc1762b626f8adcc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189073.636959:0:26159:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002a22be6d/0xcc1762b626f8adcc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189073.636976:0:26159:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1784189073.637012:0:26159:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6cc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784189073.637016:0:26159:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fabc36df/0xcc1762b626f8add3 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6cc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189073.637030:0:26159:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6cc:0x0].0x0 since=3315s v=(0 0) 00010000:00010000:0.0:1784189073.637033:0:26159:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6cc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784189073.637036:0:26159:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fabc36df/0xcc1762b626f8add3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189073.637044:0:26159:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fabc36df/0xcc1762b626f8add3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189073.637052:0:26159:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fabc36df/0xcc1762b626f8add3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189073.637064:0:26159:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fabc36df/0xcc1762b626f8add3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189073.637082:0:26159:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1784189073.637105:0:7454:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1784189073.637112:0:7454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002a22be6d/0xcc1762b626f8adcc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189073.637120:0:7454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc04152d600 already unused, calling callback (ffffffffc0b2e230) 00010000:00010000:1.0:1784189073.637124:0:7454:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002a22be6d/0xcc1762b626f8adcc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1784189073.637127:0:26159:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6cb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784189073.637137:0:26159:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009985685d/0xcc1762b626f8adda lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6cb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189073.637138:0:7454:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002a22be6d/0xcc1762b626f8adcc lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189073.637159:0:26159:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6cb:0x0].0x0 since=3315s v=(0 0) 00010000:00010000:1.0:1784189073.637164:0:7454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002a22be6d/0xcc1762b626f8adcc lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189073.637164:0:26159:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6cb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784189073.637169:0:26159:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009985685d/0xcc1762b626f8adda lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189073.637193:0:7454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002a22be6d/0xcc1762b626f8adcc lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189073.637194:0:26159:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009985685d/0xcc1762b626f8adda lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189073.637220:0:7454:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784189073.637225:0:7454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fabc36df/0xcc1762b626f8add3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189073.637231:0:26159:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009985685d/0xcc1762b626f8adda lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189073.637234:0:7454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc04152c400 already unused, calling callback (ffffffffc0b2e230) 00010000:00010000:1.0:1784189073.637240:0:7454:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fabc36df/0xcc1762b626f8add3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189073.637245:0:26159:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009985685d/0xcc1762b626f8adda lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189073.637255:0:7454:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fabc36df/0xcc1762b626f8add3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189073.637267:0:7454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fabc36df/0xcc1762b626f8add3 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189073.637269:0:26159:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1784189073.637278:0:7454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fabc36df/0xcc1762b626f8add3 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189073.637289:0:7454:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784189073.637294:0:7454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009985685d/0xcc1762b626f8adda lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189073.637300:0:7454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc04152d200 already unused, calling callback (ffffffffc0b2e230) 00010000:00010000:1.0:1784189073.637311:0:7454:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009985685d/0xcc1762b626f8adda lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1784189073.637314:0:26159:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6ca:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784189073.637339:0:7454:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009985685d/0xcc1762b626f8adda lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189073.637347:0:26159:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000091ba7b99/0xcc1762b626f8ade1 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6ca:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189073.637354:0:7454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009985685d/0xcc1762b626f8adda lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189073.637356:0:26159:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6ca:0x0].0x0 since=3315s v=(0 0) 00010000:00010000:0.0:1784189073.637364:0:26159:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6ca:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784189073.637372:0:7454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009985685d/0xcc1762b626f8adda lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189073.637373:0:26159:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000091ba7b99/0xcc1762b626f8ade1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189073.637394:0:26159:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000091ba7b99/0xcc1762b626f8ade1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189073.637396:0:7454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784189073.637400:0:7454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784189073.637402:0:7454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784189073.637405:0:26159:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000091ba7b99/0xcc1762b626f8ade1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189073.637409:0:26173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784189073.637415:0:26159:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000091ba7b99/0xcc1762b626f8ade1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189073.637454:0:26159:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1784189073.637468:0:6502:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784189073.637474:0:6502:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000091ba7b99/0xcc1762b626f8ade1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189073.637491:0:6502:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc04152c600 already unused, calling callback (ffffffffc0b2e230) 00010000:00010000:1.0:1784189073.637494:0:6502:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000091ba7b99/0xcc1762b626f8ade1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1784189073.637497:0:26159:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6c9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784189073.637508:0:26159:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b87c84b6/0xcc1762b626f8ade8 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6c9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189073.637509:0:6502:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000091ba7b99/0xcc1762b626f8ade1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189073.637529:0:6502:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000091ba7b99/0xcc1762b626f8ade1 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189073.637530:0:26159:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6c9:0x0].0x0 since=3315s v=(0 0) 00010000:00010000:0.0:1784189073.637533:0:26159:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6c9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784189073.637540:0:26159:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b87c84b6/0xcc1762b626f8ade8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189073.637548:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784189073.637549:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000091ba7b99/0xcc1762b626f8ade1 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189073.637554:0:26159:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b87c84b6/0xcc1762b626f8ade8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189073.637569:0:26159:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b87c84b6/0xcc1762b626f8ade8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189073.637573:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784189073.637576:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784189073.637579:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784189073.637579:0:26159:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b87c84b6/0xcc1762b626f8ade8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189073.637594:0:26159:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1784189073.637602:0:7454:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784189073.637607:0:7454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b87c84b6/0xcc1762b626f8ade8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189073.637615:0:7454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc04152d800 already unused, calling callback (ffffffffc0b2e230) 00010000:00010000:1.0:1784189073.637619:0:7454:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b87c84b6/0xcc1762b626f8ade8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1784189073.637622:0:26159:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6c8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784189073.637629:0:7454:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b87c84b6/0xcc1762b626f8ade8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189073.637629:0:26159:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ba1d3010/0xcc1762b626f8adef lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6c8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189073.637648:0:26159:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6c8:0x0].0x0 since=3315s v=(0 0) 00010000:00010000:1.0:1784189073.637655:0:7454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b87c84b6/0xcc1762b626f8ade8 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189073.637657:0:26159:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6c8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784189073.637664:0:26159:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ba1d3010/0xcc1762b626f8adef lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189073.637671:0:7454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b87c84b6/0xcc1762b626f8ade8 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189073.637675:0:26159:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ba1d3010/0xcc1762b626f8adef lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189073.637690:0:26159:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ba1d3010/0xcc1762b626f8adef lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189073.637694:0:26159:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ba1d3010/0xcc1762b626f8adef lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189073.637696:0:7454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784189073.637701:0:7454:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784189073.637708:0:26159:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1784189073.637714:0:7454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ba1d3010/0xcc1762b626f8adef lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189073.637722:0:7454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc04152da00 already unused, calling callback (ffffffffc0b2e230) 00010000:00010000:1.0:1784189073.637725:0:7454:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ba1d3010/0xcc1762b626f8adef lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189073.637728:0:26173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784189073.637735:0:7454:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ba1d3010/0xcc1762b626f8adef lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189073.637747:0:7454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ba1d3010/0xcc1762b626f8adef lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189073.637753:0:7454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ba1d3010/0xcc1762b626f8adef lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1784189073.637760:0:26159:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6c7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784189073.637768:0:7454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784189073.637768:0:26159:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fe390215/0xcc1762b626f8adf6 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6c7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189073.637772:0:7454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784189073.637776:0:7454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784189073.637782:0:26159:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6c7:0x0].0x0 since=3315s v=(0 0) 00010000:00010000:0.0:1784189073.637785:0:26159:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6c7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784189073.637789:0:26159:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fe390215/0xcc1762b626f8adf6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189073.637797:0:26159:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fe390215/0xcc1762b626f8adf6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189073.637805:0:26159:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fe390215/0xcc1762b626f8adf6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189073.637870:0:26159:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fe390215/0xcc1762b626f8adf6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189073.637896:0:26159:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1784189073.637934:0:26159:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6c6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784189073.637939:0:26159:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b6a56637/0xcc1762b626f8adfd lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6c6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189073.637947:0:26159:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6c6:0x0].0x0 since=3315s v=(0 0) 00010000:00010000:0.0:1784189073.637949:0:26159:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6c6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784189073.637953:0:26159:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b6a56637/0xcc1762b626f8adfd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189073.637962:0:26159:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b6a56637/0xcc1762b626f8adfd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189073.637970:0:26159:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b6a56637/0xcc1762b626f8adfd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189073.637978:0:26159:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b6a56637/0xcc1762b626f8adfd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189073.637996:0:26159:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1784189073.637997:0:6501:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1784189073.638002:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fe390215/0xcc1762b626f8adf6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189073.638009:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc05ec0ea00 already unused, calling callback (ffffffffc0b2e230) 00010000:00010000:2.0:1784189073.638013:0:6501:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fe390215/0xcc1762b626f8adf6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189073.638021:0:6501:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fe390215/0xcc1762b626f8adf6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1784189073.638028:0:26159:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6c5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1784189073.638032:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fe390215/0xcc1762b626f8adf6 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189073.638032:0:26159:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000099eb736b/0xcc1762b626f8ae04 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6c5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189073.638044:0:26159:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6c5:0x0].0x0 since=3315s v=(0 0) 00010000:00010000:0.0:1784189073.638047:0:26159:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6c5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784189073.638048:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fe390215/0xcc1762b626f8adf6 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189073.638052:0:26159:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000099eb736b/0xcc1762b626f8ae04 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189073.638060:0:26159:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000099eb736b/0xcc1762b626f8ae04 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189073.638061:0:6501:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784189073.638068:0:26159:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000099eb736b/0xcc1762b626f8ae04 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189073.638075:0:26159:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000099eb736b/0xcc1762b626f8ae04 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189073.638089:0:26159:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1784189073.638125:0:26159:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6c4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784189073.638129:0:26159:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000061338346/0xcc1762b626f8ae0b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6c4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189073.638137:0:26159:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6c4:0x0].0x0 since=3315s v=(0 0) 00010000:00010000:0.0:1784189073.638140:0:26159:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6c4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784189073.638143:0:26159:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000061338346/0xcc1762b626f8ae0b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189073.638151:0:26159:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000061338346/0xcc1762b626f8ae0b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189073.638171:0:26159:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000061338346/0xcc1762b626f8ae0b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189073.638177:0:26159:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000061338346/0xcc1762b626f8ae0b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189073.638191:0:26159:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1784189073.638198:0:7454:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1784189073.638202:0:7454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000099eb736b/0xcc1762b626f8ae04 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189073.638209:0:7454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc05ec0ec00 already unused, calling callback (ffffffffc0b2e230) 00010000:00010000:0.0:1784189073.638213:0:7454:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000099eb736b/0xcc1762b626f8ae04 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189073.638221:0:7454:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000099eb736b/0xcc1762b626f8ae04 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189073.638231:0:7454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000099eb736b/0xcc1762b626f8ae04 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189073.638239:0:7454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000099eb736b/0xcc1762b626f8ae04 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189073.638252:0:7454:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784189073.638260:0:7454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000061338346/0xcc1762b626f8ae0b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189073.638265:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b6a56637/0xcc1762b626f8adfd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189073.638267:0:7454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc05ec0fe00 already unused, calling callback (ffffffffc0b2e230) 00010000:00010000:0.0:1784189073.638271:0:7454:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000061338346/0xcc1762b626f8ae0b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189073.638273:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc05ec0ee00 already unused, calling callback (ffffffffc0b2e230) 00010000:00010000:2.0:1784189073.638276:0:6501:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b6a56637/0xcc1762b626f8adfd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189073.638279:0:7454:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000061338346/0xcc1762b626f8ae0b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189073.638284:0:6501:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b6a56637/0xcc1762b626f8adfd lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189073.638290:0:7454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000061338346/0xcc1762b626f8ae0b lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189073.638292:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b6a56637/0xcc1762b626f8adfd lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189073.638298:0:7454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000061338346/0xcc1762b626f8ae0b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189073.638300:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b6a56637/0xcc1762b626f8adfd lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189073.638308:0:7454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784189073.638310:0:7454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784189073.638311:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784189073.638311:0:7454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784189073.638313:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784189073.638314:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784189073.638331:0:26173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1784189073.638369:0:26159:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6c3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784189073.638374:0:26159:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e9a3ca49/0xcc1762b626f8ae12 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6c3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189073.638382:0:26159:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6c3:0x0].0x0 since=3315s v=(0 0) 00010000:00010000:0.0:1784189073.638385:0:26159:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6c3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784189073.638390:0:26159:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e9a3ca49/0xcc1762b626f8ae12 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189073.638392:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784189073.638410:0:26159:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e9a3ca49/0xcc1762b626f8ae12 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189073.638419:0:26159:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e9a3ca49/0xcc1762b626f8ae12 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189073.638426:0:26159:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e9a3ca49/0xcc1762b626f8ae12 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189073.638445:0:26159:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1784189073.638481:0:26159:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6c2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784189073.638487:0:26159:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008cdafd97/0xcc1762b626f8ae19 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6c2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189073.638495:0:7454:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784189073.638495:0:26159:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6c2:0x0].0x0 since=3315s v=(0 0) 00010000:00010000:0.0:1784189073.638499:0:26159:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6c2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784189073.638500:0:7454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e9a3ca49/0xcc1762b626f8ae12 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189073.638503:0:26159:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008cdafd97/0xcc1762b626f8ae19 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189073.638507:0:7454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc05ec0fc00 already unused, calling callback (ffffffffc0b2e230) 00010000:00010000:1.0:1784189073.638511:0:7454:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e9a3ca49/0xcc1762b626f8ae12 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189073.638513:0:26159:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008cdafd97/0xcc1762b626f8ae19 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189073.638521:0:26159:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008cdafd97/0xcc1762b626f8ae19 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189073.638530:0:7454:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e9a3ca49/0xcc1762b626f8ae12 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189073.638538:0:26159:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008cdafd97/0xcc1762b626f8ae19 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189073.638541:0:7454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e9a3ca49/0xcc1762b626f8ae12 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189073.638549:0:7454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e9a3ca49/0xcc1762b626f8ae12 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189073.638558:0:26159:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1784189073.638561:0:7454:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784189073.638564:0:7454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008cdafd97/0xcc1762b626f8ae19 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189073.638570:0:7454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc05ec0e000 already unused, calling callback (ffffffffc0b2e230) 00010000:00010000:1.0:1784189073.638573:0:7454:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008cdafd97/0xcc1762b626f8ae19 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189073.638580:0:7454:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008cdafd97/0xcc1762b626f8ae19 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189073.638589:0:7454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008cdafd97/0xcc1762b626f8ae19 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189073.638595:0:7454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008cdafd97/0xcc1762b626f8ae19 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189073.638617:0:7454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784189073.638618:0:7454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784189073.638620:0:7454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784189073.638876:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:0.0:1784189073.642645:0:26159:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x280000401:1116 00000100:00100000:0.0:1784189073.642788:0:26159:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf46955500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:87042:x1870854458069504:12345-0@lo:5:osp-pre-0-0.0 Request processed in 28560us (28767us total) trans 0 rc 0/0 00000100:00100000:0.0:1784189073.642800:0:26159:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4933 00000100:00100000:2.0:1784189073.642880:0:87042:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf46954380 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:87042:1870854458069504:0@lo:5:osp-pre-0-0.0 00000004:00080000:2.0:1784189073.642930:0:87042:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x280000401:0x6e1:0x0] from OST, last_created [0x280000401:0x6e1:0x0]last_used is [0x280000401:0x45c:0x0] 00000100:00100000:2.0:1784189073.643047:0:87042:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc07016ce00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:87042:1870854458069888:0@lo:5:osp-pre-0-0.0 00000100:00100000:1.0:1784189073.643069:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc07016f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1870854458069760:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1784189073.643081:0:87042:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784189073.643095:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784189073.643104:0:87042:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dc07545b9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1784189073.643121:0:26167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458069888 00000100:00100000:2.0:1784189073.643126:0:26167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458069888 00000100:00100000:2.0:1784189073.643201:0:26167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4935 00000100:00100000:2.0:1784189073.643212:0:26167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc07016ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+5:87042:x1870854458069888:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:2.0:1784189073.643249:0:26167:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000401 at 1762 00002000:00010000:3.0:1784189073.644596:0:26160:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6e1:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784189073.644606:0:26160:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000028810c36/0xcc1762b626f8ae20 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6e1:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189073.644623:0:26160:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6e1:0x0].0x0 since=3315s v=(0 0) 00010000:00010000:3.0:1784189073.644627:0:26160:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6e1:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784189073.644634:0:26160:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000028810c36/0xcc1762b626f8ae20 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189073.644650:0:26160:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000028810c36/0xcc1762b626f8ae20 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189073.644673:0:26160:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000028810c36/0xcc1762b626f8ae20 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784189073.644678:0:26167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc07016ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+6:87042:x1870854458069888:12345-0@lo:5:osp-pre-0-0.0 Request processed in 1465us (1593us total) trans 4294968949 rc 0/0 00010000:00010000:3.0:1784189073.644687:0:26160:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000028810c36/0xcc1762b626f8ae20 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784189073.644693:0:26167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4935 00010000:00010000:3.0:1784189073.644716:0:26160:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1784189073.644787:0:26160:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6e0:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784189073.644792:0:26160:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d574248f/0xcc1762b626f8ae27 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6e0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189073.644800:0:26160:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6e0:0x0].0x0 since=3315s v=(0 0) 00010000:00010000:3.0:1784189073.644803:0:26160:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6e0:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784189073.644806:0:26160:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d574248f/0xcc1762b626f8ae27 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189073.644814:0:26160:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d574248f/0xcc1762b626f8ae27 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189073.644822:0:26160:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d574248f/0xcc1762b626f8ae27 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189073.644828:0:26160:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d574248f/0xcc1762b626f8ae27 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189073.644849:0:26160:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:3.0:1784189073.646499:0:26160:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6df:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784189073.646513:0:26160:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d022a8f3/0xcc1762b626f8ae2e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6df:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189073.646529:0:26160:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6df:0x0].0x0 since=3315s v=(0 0) 00010000:00010000:3.0:1784189073.646534:0:26160:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6df:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784189073.646540:0:26160:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d022a8f3/0xcc1762b626f8ae2e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189073.646553:0:26160:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d022a8f3/0xcc1762b626f8ae2e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189073.646562:0:26160:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d022a8f3/0xcc1762b626f8ae2e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189073.646569:0:26160:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d022a8f3/0xcc1762b626f8ae2e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189073.646597:0:26160:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:3.0:1784189073.646681:0:26160:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6de:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784189073.646686:0:26160:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001f7cbffa/0xcc1762b626f8ae35 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6de:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189073.646693:0:26160:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6de:0x0].0x0 since=3315s v=(0 0) 00010000:00010000:3.0:1784189073.646701:0:26160:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6de:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784189073.646707:0:26160:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001f7cbffa/0xcc1762b626f8ae35 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189073.646717:0:26160:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001f7cbffa/0xcc1762b626f8ae35 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189073.646724:0:26160:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001f7cbffa/0xcc1762b626f8ae35 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189073.646731:0:26160:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001f7cbffa/0xcc1762b626f8ae35 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189073.646746:0:26160:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00002000:00010000:3.0:1784189073.646789:0:26160:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6dd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784189073.646794:0:26160:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005e244d7a/0xcc1762b626f8ae3c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6dd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189073.646801:0:26160:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6dd:0x0].0x0 since=3315s v=(0 0) 00010000:00010000:3.0:1784189073.646804:0:26160:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6dd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784189073.646808:0:26160:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005e244d7a/0xcc1762b626f8ae3c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189073.646817:0:26160:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005e244d7a/0xcc1762b626f8ae3c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189073.646825:0:26160:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005e244d7a/0xcc1762b626f8ae3c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189073.646839:0:26160:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005e244d7a/0xcc1762b626f8ae3c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189073.646848:0:26160:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00002000:00010000:3.0:1784189073.646898:0:26160:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6dc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784189073.646904:0:26160:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000003ce078f/0xcc1762b626f8ae43 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6dc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189073.646912:0:26160:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6dc:0x0].0x0 since=3315s v=(0 0) 00010000:00010000:3.0:1784189073.646915:0:26160:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6dc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784189073.646919:0:26160:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000003ce078f/0xcc1762b626f8ae43 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189073.646928:0:26160:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000003ce078f/0xcc1762b626f8ae43 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189073.646935:0:26160:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000003ce078f/0xcc1762b626f8ae43 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189073.646942:0:26160:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000003ce078f/0xcc1762b626f8ae43 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189073.646951:0:26160:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to regular blp list, 6 blwis in pool 00002000:00010000:3.0:1784189073.646989:0:26160:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6db:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784189073.646994:0:26160:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000cac068a/0xcc1762b626f8ae4a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6db:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189073.647006:0:26160:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6db:0x0].0x0 since=3315s v=(0 0) 00010000:00010000:3.0:1784189073.647009:0:26160:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6db:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784189073.647014:0:26160:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000cac068a/0xcc1762b626f8ae4a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189073.647015:0:7454:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:0.0:1784189073.647026:0:7454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000028810c36/0xcc1762b626f8ae20 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189073.647028:0:26160:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000cac068a/0xcc1762b626f8ae4a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189073.647043:0:7454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc05ec0da00 already unused, calling callback (ffffffffc0b2e230) 00010000:00010000:3.0:1784189073.647048:0:26160:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000cac068a/0xcc1762b626f8ae4a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189073.647049:0:7454:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000028810c36/0xcc1762b626f8ae20 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189073.647072:0:26160:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000cac068a/0xcc1762b626f8ae4a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189073.647074:0:7454:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000028810c36/0xcc1762b626f8ae20 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189073.647092:0:26160:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to regular blp list, 6 blwis in pool 00010000:00010000:0.0:1784189073.647101:0:7454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000028810c36/0xcc1762b626f8ae20 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189073.647109:0:7454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000028810c36/0xcc1762b626f8ae20 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1784189073.647135:0:26160:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6da:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784189073.647142:0:26160:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003b188e95/0xcc1762b626f8ae51 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6da:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189073.647142:0:7454:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:0.0:1784189073.647149:0:7454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d574248f/0xcc1762b626f8ae27 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189073.647157:0:26160:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6da:0x0].0x0 since=3315s v=(0 0) 00010000:00010000:0.0:1784189073.647160:0:7454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc05ec0ce00 already unused, calling callback (ffffffffc0b2e230) 00010000:00010000:3.0:1784189073.647163:0:26160:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6da:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784189073.647167:0:7454:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d574248f/0xcc1762b626f8ae27 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189073.647169:0:26160:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003b188e95/0xcc1762b626f8ae51 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189073.647188:0:7454:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d574248f/0xcc1762b626f8ae27 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189073.647190:0:26160:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003b188e95/0xcc1762b626f8ae51 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189073.647213:0:26160:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003b188e95/0xcc1762b626f8ae51 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189073.647219:0:26160:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003b188e95/0xcc1762b626f8ae51 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189073.647226:0:26160:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to regular blp list, 6 blwis in pool 00002000:00010000:3.0:1784189073.647258:0:26160:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6d9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784189073.647263:0:26160:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006d8f776a/0xcc1762b626f8ae58 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6d9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189073.647270:0:26160:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6d9:0x0].0x0 since=3315s v=(0 0) 00010000:00010000:3.0:1784189073.647272:0:26160:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6d9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784189073.647276:0:26160:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006d8f776a/0xcc1762b626f8ae58 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189073.647284:0:26160:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006d8f776a/0xcc1762b626f8ae58 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189073.647290:0:26160:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006d8f776a/0xcc1762b626f8ae58 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189073.647309:0:26160:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006d8f776a/0xcc1762b626f8ae58 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189073.647312:0:7454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d574248f/0xcc1762b626f8ae27 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189073.647348:0:7454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d574248f/0xcc1762b626f8ae27 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189073.647362:0:26160:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to regular blp list, 7 blwis in pool 00010000:00010000:0.0:1784189073.647369:0:7454:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:0.0:1784189073.647373:0:7454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d022a8f3/0xcc1762b626f8ae2e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189073.647381:0:7454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc05ec0c000 already unused, calling callback (ffffffffc0b2e230) 00010000:00010000:0.0:1784189073.647385:0:7454:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d022a8f3/0xcc1762b626f8ae2e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1784189073.647401:0:26160:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6d8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784189073.647403:0:7454:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d022a8f3/0xcc1762b626f8ae2e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189073.647407:0:26160:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004db4df01/0xcc1762b626f8ae5f lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6d8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189073.647421:0:26160:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6d8:0x0].0x0 since=3315s v=(0 0) 00010000:00010000:0.0:1784189073.647421:0:7454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d022a8f3/0xcc1762b626f8ae2e lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189073.647427:0:26160:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6d8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784189073.647435:0:26160:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004db4df01/0xcc1762b626f8ae5f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189073.647437:0:7454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d022a8f3/0xcc1762b626f8ae2e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189073.647453:0:26160:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004db4df01/0xcc1762b626f8ae5f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189073.647461:0:7454:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:3.0:1784189073.647463:0:26160:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004db4df01/0xcc1762b626f8ae5f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189073.647466:0:7454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001f7cbffa/0xcc1762b626f8ae35 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189073.647480:0:26160:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004db4df01/0xcc1762b626f8ae5f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189073.647482:0:7454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc05ec0c600 already unused, calling callback (ffffffffc0b2e230) 00010000:00010000:0.0:1784189073.647488:0:7454:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001f7cbffa/0xcc1762b626f8ae35 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189073.647496:0:26160:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to regular blp list, 6 blwis in pool 00010000:00010000:0.0:1784189073.647498:0:7454:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001f7cbffa/0xcc1762b626f8ae35 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189073.647510:0:7454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001f7cbffa/0xcc1762b626f8ae35 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189073.647518:0:7454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001f7cbffa/0xcc1762b626f8ae35 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1784189073.647532:0:26160:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6d7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784189073.647538:0:26160:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000021529308/0xcc1762b626f8ae66 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6d7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189073.647542:0:7454:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:3.0:1784189073.647546:0:26160:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6d7:0x0].0x0 since=3315s v=(0 0) 00010000:00010000:0.0:1784189073.647547:0:7454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005e244d7a/0xcc1762b626f8ae3c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189073.647560:0:26160:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6d7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784189073.647561:0:7454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc05ec0c200 already unused, calling callback (ffffffffc0b2e230) 00010000:00010000:0.0:1784189073.647566:0:7454:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005e244d7a/0xcc1762b626f8ae3c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189073.647570:0:26160:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000021529308/0xcc1762b626f8ae66 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189073.647581:0:7454:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005e244d7a/0xcc1762b626f8ae3c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189073.647587:0:26160:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000021529308/0xcc1762b626f8ae66 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189073.647594:0:7454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005e244d7a/0xcc1762b626f8ae3c lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189073.647598:0:26160:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000021529308/0xcc1762b626f8ae66 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189073.647607:0:7454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005e244d7a/0xcc1762b626f8ae3c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189073.647614:0:26160:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000021529308/0xcc1762b626f8ae66 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189073.647624:0:7454:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:3.0:1784189073.647626:0:26160:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00010000:00010000:0.0:1784189073.647629:0:7454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000003ce078f/0xcc1762b626f8ae43 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189073.647637:0:7454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc05ec0de00 already unused, calling callback (ffffffffc0b2e230) 00010000:00010000:0.0:1784189073.647640:0:7454:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000003ce078f/0xcc1762b626f8ae43 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189073.647658:0:7454:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000003ce078f/0xcc1762b626f8ae43 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189073.647668:0:7454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000003ce078f/0xcc1762b626f8ae43 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1784189073.647674:0:26160:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6d6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784189073.647676:0:7454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000003ce078f/0xcc1762b626f8ae43 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189073.647682:0:26160:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006bda6ed5/0xcc1762b626f8ae6d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6d6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189073.647692:0:26160:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6d6:0x0].0x0 since=3315s v=(0 0) 00010000:00010000:0.0:1784189073.647694:0:7454:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:3.0:1784189073.647696:0:26160:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6d6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784189073.647700:0:7454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000cac068a/0xcc1762b626f8ae4a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189073.647702:0:26160:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006bda6ed5/0xcc1762b626f8ae6d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189073.647720:0:7454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc05ec0cc00 already unused, calling callback (ffffffffc0b2e230) 00010000:00010000:0.0:1784189073.647725:0:7454:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000cac068a/0xcc1762b626f8ae4a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189073.647726:0:26160:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006bda6ed5/0xcc1762b626f8ae6d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189073.647742:0:7454:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000cac068a/0xcc1762b626f8ae4a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189073.647745:0:26160:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006bda6ed5/0xcc1762b626f8ae6d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189073.647754:0:7454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000cac068a/0xcc1762b626f8ae4a lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189073.647768:0:26160:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006bda6ed5/0xcc1762b626f8ae6d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189073.647769:0:7454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000cac068a/0xcc1762b626f8ae4a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189073.647791:0:26160:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00010000:00010000:0.0:1784189073.647810:0:7454:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:0.0:1784189073.647814:0:7454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003b188e95/0xcc1762b626f8ae51 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189073.647821:0:7454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc05ec0d800 already unused, calling callback (ffffffffc0b2e230) 00010000:00010000:0.0:1784189073.647824:0:7454:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003b188e95/0xcc1762b626f8ae51 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189073.647831:0:7454:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003b188e95/0xcc1762b626f8ae51 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1784189073.647835:0:26160:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6d5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784189073.647844:0:26160:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008aeccd8e/0xcc1762b626f8ae74 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6d5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189073.647846:0:7454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003b188e95/0xcc1762b626f8ae51 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189073.647860:0:26160:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6d5:0x0].0x0 since=3315s v=(0 0) 00010000:00010000:0.0:1784189073.647862:0:7454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003b188e95/0xcc1762b626f8ae51 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189073.647866:0:26160:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6d5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784189073.647876:0:26160:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008aeccd8e/0xcc1762b626f8ae74 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189073.647883:0:7454:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1784189073.647898:0:7454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006d8f776a/0xcc1762b626f8ae58 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189073.647904:0:7454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc05ec0dc00 already unused, calling callback (ffffffffc0b2e230) 00010000:00010000:0.0:1784189073.647907:0:7454:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006d8f776a/0xcc1762b626f8ae58 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189073.647925:0:7454:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006d8f776a/0xcc1762b626f8ae58 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189073.647935:0:7454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006d8f776a/0xcc1762b626f8ae58 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189073.647942:0:7454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006d8f776a/0xcc1762b626f8ae58 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189073.647955:0:7454:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1784189073.647958:0:7454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004db4df01/0xcc1762b626f8ae5f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189073.647964:0:7454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc05ec0d400 already unused, calling callback (ffffffffc0b2e230) 00010000:00010000:0.0:1784189073.647967:0:7454:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004db4df01/0xcc1762b626f8ae5f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189073.647974:0:7454:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004db4df01/0xcc1762b626f8ae5f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189073.647981:0:7454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004db4df01/0xcc1762b626f8ae5f lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189073.647988:0:7454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004db4df01/0xcc1762b626f8ae5f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189073.648011:0:7454:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1784189073.648014:0:7454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000021529308/0xcc1762b626f8ae66 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189073.648020:0:7454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc05ec0c400 already unused, calling callback (ffffffffc0b2e230) 00010000:00010000:0.0:1784189073.648023:0:7454:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000021529308/0xcc1762b626f8ae66 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189073.648031:0:7454:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000021529308/0xcc1762b626f8ae66 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189073.648041:0:7454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000021529308/0xcc1762b626f8ae66 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189073.648047:0:7454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000021529308/0xcc1762b626f8ae66 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189073.648058:0:7454:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784189073.648060:0:7454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006bda6ed5/0xcc1762b626f8ae6d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189073.648066:0:7454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc05ec0d600 already unused, calling callback (ffffffffc0b2e230) 00010000:00010000:0.0:1784189073.648068:0:7454:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006bda6ed5/0xcc1762b626f8ae6d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189073.648084:0:7454:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006bda6ed5/0xcc1762b626f8ae6d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189073.648093:0:7454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006bda6ed5/0xcc1762b626f8ae6d lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189073.648100:0:7454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006bda6ed5/0xcc1762b626f8ae6d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189073.648646:0:26160:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008aeccd8e/0xcc1762b626f8ae74 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189073.648658:0:26160:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008aeccd8e/0xcc1762b626f8ae74 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189073.648666:0:26160:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008aeccd8e/0xcc1762b626f8ae74 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189073.648676:0:26160:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1784189073.648740:0:7454:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784189073.648745:0:7454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008aeccd8e/0xcc1762b626f8ae74 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189073.648753:0:7454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc05ec0d000 already unused, calling callback (ffffffffc0b2e230) 00010000:00010000:0.0:1784189073.648757:0:7454:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008aeccd8e/0xcc1762b626f8ae74 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189073.648769:0:7454:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008aeccd8e/0xcc1762b626f8ae74 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189073.648781:0:7454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008aeccd8e/0xcc1762b626f8ae74 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189073.648788:0:7454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008aeccd8e/0xcc1762b626f8ae74 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189073.648811:0:7454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784189073.648813:0:7454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784189073.648814:0:7454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784189073.648920:0:87042:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc07016ce00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:87042:1870854458069888:0@lo:5:osp-pre-0-0.0 00000004:00080000:2.0:1784189073.648937:0:87042:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x280000401:0x6e1:0x0]-[0x280000401:0x701:0x0] 00000100:00100000:1.0:1784189073.649117:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458069760 00000100:00100000:1.0:1784189073.649125:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458069760 00000100:00100000:1.0:1784189073.649179:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1886 00000100:00100000:1.0:1784189073.649188:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc05ed7ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3640:x1870854458069760:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1784189073.649211:0:8432:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 212800 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1784189073.649344:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc05ed7ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3640:x1870854458069760:12345-0@lo:13:osp-pre-0-0.0 Request processed in 156us (6246us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189073.649351:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1886 00010000:00010000:1.0:1784189073.650073:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784189073.650082:0:26173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784189073.650087:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784189073.650105:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc07016f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1870854458069760:0@lo:13:osp-pre-0-0.0 00002000:00010000:0.0:1784189073.650574:0:26160:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6d4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784189073.650581:0:26160:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c88020a6/0xcc1762b626f8ae7b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6d4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189073.650595:0:26160:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6d4:0x0].0x0 since=3315s v=(0 0) 00010000:00010000:0.0:1784189073.650599:0:26160:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6d4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784189073.650605:0:26160:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c88020a6/0xcc1762b626f8ae7b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189073.650617:0:26160:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c88020a6/0xcc1762b626f8ae7b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189073.650626:0:26160:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c88020a6/0xcc1762b626f8ae7b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189073.650634:0:26160:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c88020a6/0xcc1762b626f8ae7b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189073.650649:0:26160:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1784189073.650693:0:26160:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6d3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784189073.650698:0:26160:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000033cb6f8/0xcc1762b626f8ae82 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6d3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189073.650718:0:26160:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6d3:0x0].0x0 since=3315s v=(0 0) 00010000:00010000:0.0:1784189073.650721:0:26160:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6d3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784189073.650726:0:26160:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000033cb6f8/0xcc1762b626f8ae82 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189073.650735:0:26160:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000033cb6f8/0xcc1762b626f8ae82 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189073.650742:0:26160:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000033cb6f8/0xcc1762b626f8ae82 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189073.650751:0:26160:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000033cb6f8/0xcc1762b626f8ae82 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189073.650764:0:26160:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:0.0:1784189073.650799:0:26160:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6d2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784189073.650804:0:26160:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005d016393/0xcc1762b626f8ae89 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6d2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189073.650811:0:26160:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6d2:0x0].0x0 since=3315s v=(0 0) 00010000:00010000:0.0:1784189073.650878:0:26160:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6d2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784189073.650884:0:26160:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005d016393/0xcc1762b626f8ae89 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189073.650904:0:26160:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005d016393/0xcc1762b626f8ae89 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189073.650922:0:26160:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005d016393/0xcc1762b626f8ae89 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189073.650928:0:26160:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005d016393/0xcc1762b626f8ae89 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189073.650943:0:26160:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:0.0:1784189073.650989:0:26160:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6d1:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784189073.650995:0:26160:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a43b8460/0xcc1762b626f8ae90 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6d1:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189073.651003:0:26160:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6d1:0x0].0x0 since=3315s v=(0 0) 00010000:00010000:0.0:1784189073.651006:0:26160:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6d1:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784189073.651011:0:26160:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a43b8460/0xcc1762b626f8ae90 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189073.651020:0:26160:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a43b8460/0xcc1762b626f8ae90 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189073.651028:0:26160:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a43b8460/0xcc1762b626f8ae90 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189073.651034:0:26160:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a43b8460/0xcc1762b626f8ae90 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189073.651058:0:26160:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00002000:00010000:0.0:1784189073.651095:0:26160:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6d0:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784189073.651100:0:26160:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004346214e/0xcc1762b626f8ae97 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6d0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189073.651287:0:26160:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6d0:0x0].0x0 since=3315s v=(0 0) 00010000:00010000:0.0:1784189073.651292:0:26160:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6d0:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784189073.651296:0:26160:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004346214e/0xcc1762b626f8ae97 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189073.651307:0:26160:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004346214e/0xcc1762b626f8ae97 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189073.651315:0:26160:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004346214e/0xcc1762b626f8ae97 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189073.651355:0:26160:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004346214e/0xcc1762b626f8ae97 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189073.651365:0:26160:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00002000:00010000:0.0:1784189073.651402:0:26160:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6cf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784189073.651407:0:26160:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fa18a013/0xcc1762b626f8ae9e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6cf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189073.651415:0:26160:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6cf:0x0].0x0 since=3315s v=(0 0) 00010000:00010000:0.0:1784189073.651494:0:26160:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6cf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784189073.651499:0:26160:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fa18a013/0xcc1762b626f8ae9e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189073.651509:0:26160:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fa18a013/0xcc1762b626f8ae9e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189073.651516:0:26160:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fa18a013/0xcc1762b626f8ae9e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189073.651523:0:26160:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fa18a013/0xcc1762b626f8ae9e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189073.651532:0:26160:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to regular blp list, 6 blwis in pool 00002000:00010000:0.0:1784189073.651566:0:26160:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6ce:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784189073.651572:0:26160:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000013d62a94/0xcc1762b626f8aea5 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6ce:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189073.651578:0:26160:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6ce:0x0].0x0 since=3315s v=(0 0) 00010000:00010000:0.0:1784189073.651581:0:26160:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6ce:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784189073.651584:0:26160:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000013d62a94/0xcc1762b626f8aea5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189073.651592:0:26160:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000013d62a94/0xcc1762b626f8aea5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189073.651600:0:26160:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000013d62a94/0xcc1762b626f8aea5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189073.651612:0:26160:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000013d62a94/0xcc1762b626f8aea5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189073.651621:0:26160:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to regular blp list, 7 blwis in pool 00002000:00010000:0.0:1784189073.651654:0:26160:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6cd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784189073.651659:0:26160:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001bd2303a/0xcc1762b626f8aeac lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6cd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189073.651667:0:26160:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6cd:0x0].0x0 since=3315s v=(0 0) 00010000:00010000:0.0:1784189073.651669:0:26160:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6cd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784189073.651674:0:26160:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001bd2303a/0xcc1762b626f8aeac lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189073.651683:0:26160:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001bd2303a/0xcc1762b626f8aeac lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189073.651691:0:26160:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001bd2303a/0xcc1762b626f8aeac lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189073.651698:0:26160:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001bd2303a/0xcc1762b626f8aeac lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189073.651706:0:26160:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/8 locks to regular blp list, 8 blwis in pool 00002000:00010000:0.0:1784189073.651735:0:26160:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6cc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784189073.651740:0:26160:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000aadf9f63/0xcc1762b626f8aeb3 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6cc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189073.651752:0:26160:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6cc:0x0].0x0 since=3315s v=(0 0) 00010000:00010000:0.0:1784189073.651755:0:26160:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6cc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784189073.651759:0:26160:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000aadf9f63/0xcc1762b626f8aeb3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189073.651769:0:26160:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000aadf9f63/0xcc1762b626f8aeb3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189073.651777:0:26160:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000aadf9f63/0xcc1762b626f8aeb3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189073.651785:0:26160:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000aadf9f63/0xcc1762b626f8aeb3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189073.651793:0:26160:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/9 locks to regular blp list, 9 blwis in pool 00002000:00010000:0.0:1784189073.651881:0:26160:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6cb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784189073.651896:0:26160:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dc1a395e/0xcc1762b626f8aeba lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6cb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189073.651904:0:26160:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6cb:0x0].0x0 since=3315s v=(0 0) 00010000:00010000:0.0:1784189073.651908:0:26160:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6cb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784189073.651912:0:26160:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dc1a395e/0xcc1762b626f8aeba lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189073.651920:0:26160:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000dc1a395e/0xcc1762b626f8aeba lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189073.651937:0:26160:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dc1a395e/0xcc1762b626f8aeba lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189073.651945:0:26160:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000dc1a395e/0xcc1762b626f8aeba lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189073.651953:0:26160:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/10 locks to regular blp list, 10 blwis in pool 00002000:00010000:0.0:1784189073.652000:0:26160:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6ca:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784189073.652006:0:26160:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f0ab8488/0xcc1762b626f8aec1 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6ca:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189073.652014:0:26160:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6ca:0x0].0x0 since=3315s v=(0 0) 00010000:00010000:0.0:1784189073.652017:0:26160:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6ca:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784189073.652021:0:26160:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f0ab8488/0xcc1762b626f8aec1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189073.652029:0:26160:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f0ab8488/0xcc1762b626f8aec1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189073.652037:0:26160:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f0ab8488/0xcc1762b626f8aec1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189073.652044:0:26160:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f0ab8488/0xcc1762b626f8aec1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189073.652061:0:26160:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/11 locks to regular blp list, 11 blwis in pool 00002000:00010000:0.0:1784189073.652095:0:26160:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6c9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784189073.652100:0:26160:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d9b1520e/0xcc1762b626f8aec8 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6c9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189073.652281:0:6502:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 10 total in blp. (10 blwis in pool) 00010000:00010000:3.0:1784189073.652289:0:6502:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c88020a6/0xcc1762b626f8ae7b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189073.652305:0:6502:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc05ec0f000 already unused, calling callback (ffffffffc0b2e230) 00010000:00010000:0.0:1784189073.652309:0:26160:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6c9:0x0].0x0 since=3315s v=(0 0) 00010000:00010000:3.0:1784189073.652310:0:6502:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c88020a6/0xcc1762b626f8ae7b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189073.652341:0:26160:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6c9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784189073.652343:0:6502:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c88020a6/0xcc1762b626f8ae7b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189073.652351:0:26160:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d9b1520e/0xcc1762b626f8aec8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189073.652364:0:6502:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c88020a6/0xcc1762b626f8ae7b lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189073.652365:0:26160:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d9b1520e/0xcc1762b626f8aec8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189073.652390:0:26160:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d9b1520e/0xcc1762b626f8aec8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189073.652391:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c88020a6/0xcc1762b626f8ae7b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189073.652409:0:26160:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d9b1520e/0xcc1762b626f8aec8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189073.652427:0:6502:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 10 total in blp. (10 blwis in pool) 00010000:00010000:3.0:1784189073.652431:0:6502:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000033cb6f8/0xcc1762b626f8ae82 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189073.652438:0:6502:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc05ec0e800 already unused, calling callback (ffffffffc0b2e230) 00010000:00010000:3.0:1784189073.652441:0:6502:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000033cb6f8/0xcc1762b626f8ae82 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189073.652449:0:6502:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000033cb6f8/0xcc1762b626f8ae82 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189073.652458:0:6502:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000033cb6f8/0xcc1762b626f8ae82 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189073.652471:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000033cb6f8/0xcc1762b626f8ae82 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189073.652485:0:6502:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 9 total in blp. (9 blwis in pool) 00010000:00010000:3.0:1784189073.652489:0:6502:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005d016393/0xcc1762b626f8ae89 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189073.652493:0:26160:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/11 locks to regular blp list, 11 blwis in pool 00010000:00010000:3.0:1784189073.652500:0:6502:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc05ec0f200 already unused, calling callback (ffffffffc0b2e230) 00010000:00010000:3.0:1784189073.652504:0:6502:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005d016393/0xcc1762b626f8ae89 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189073.652512:0:6502:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005d016393/0xcc1762b626f8ae89 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189073.652524:0:6502:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005d016393/0xcc1762b626f8ae89 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189073.652531:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005d016393/0xcc1762b626f8ae89 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1784189073.652542:0:26160:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6c8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784189073.652544:0:6502:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 8 total in blp. (8 blwis in pool) 00010000:00010000:0.0:1784189073.652550:0:26160:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002a100b32/0xcc1762b626f8aecf lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6c8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189073.652551:0:6502:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a43b8460/0xcc1762b626f8ae90 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189073.652572:0:6502:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc05ec0f800 already unused, calling callback (ffffffffc0b2e230) 00010000:00010000:0.0:1784189073.652572:0:26160:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6c8:0x0].0x0 since=3315s v=(0 0) 00010000:00010000:0.0:1784189073.652584:0:26160:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6c8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784189073.652587:0:6502:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a43b8460/0xcc1762b626f8ae90 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189073.652591:0:26160:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002a100b32/0xcc1762b626f8aecf lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189073.652603:0:6502:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a43b8460/0xcc1762b626f8ae90 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189073.652608:0:26160:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002a100b32/0xcc1762b626f8aecf lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189073.652616:0:6502:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a43b8460/0xcc1762b626f8ae90 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189073.652618:0:26160:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002a100b32/0xcc1762b626f8aecf lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189073.652637:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a43b8460/0xcc1762b626f8ae90 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189073.652638:0:26160:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002a100b32/0xcc1762b626f8aecf lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189073.652660:0:26160:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/9 locks to regular blp list, 9 blwis in pool 00010000:00010000:3.0:1784189073.652665:0:6502:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 8 total in blp. (8 blwis in pool) 00010000:00010000:3.0:1784189073.652670:0:6502:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004346214e/0xcc1762b626f8ae97 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189073.652678:0:6502:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc05ec0fa00 already unused, calling callback (ffffffffc0b2e230) 00010000:00010000:3.0:1784189073.652682:0:6502:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004346214e/0xcc1762b626f8ae97 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189073.652690:0:6502:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004346214e/0xcc1762b626f8ae97 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1784189073.652698:0:26160:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6c7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784189073.652700:0:6502:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004346214e/0xcc1762b626f8ae97 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189073.652706:0:26160:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ad1773fd/0xcc1762b626f8aed6 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6c7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189073.652710:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004346214e/0xcc1762b626f8ae97 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189073.652716:0:26160:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6c7:0x0].0x0 since=3315s v=(0 0) 00010000:00010000:0.0:1784189073.652724:0:26160:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6c7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784189073.652733:0:26160:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ad1773fd/0xcc1762b626f8aed6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189073.652743:0:26160:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ad1773fd/0xcc1762b626f8aed6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189073.652751:0:26160:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ad1773fd/0xcc1762b626f8aed6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189073.652753:0:6502:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 7 total in blp. (7 blwis in pool) 00010000:00010000:3.0:1784189073.652759:0:6502:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fa18a013/0xcc1762b626f8ae9e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189073.652779:0:6502:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc05ec0f600 already unused, calling callback (ffffffffc0b2e230) 00010000:00010000:0.0:1784189073.652780:0:26160:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ad1773fd/0xcc1762b626f8aed6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189073.652784:0:6502:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fa18a013/0xcc1762b626f8ae9e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189073.652796:0:26160:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/8 locks to regular blp list, 8 blwis in pool 00010000:00010000:3.0:1784189073.652799:0:6502:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fa18a013/0xcc1762b626f8ae9e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189073.652812:0:6502:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fa18a013/0xcc1762b626f8ae9e lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189073.652819:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fa18a013/0xcc1762b626f8ae9e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189073.652834:0:6502:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 7 total in blp. (7 blwis in pool) 00002000:00010000:0.0:1784189073.652835:0:26160:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6c6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784189073.652838:0:6502:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000013d62a94/0xcc1762b626f8aea5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189073.652842:0:26160:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000027d7c725/0xcc1762b626f8aedd lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6c6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189073.652853:0:6502:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc05ec0e600 already unused, calling callback (ffffffffc0b2e230) 00010000:00010000:0.0:1784189073.652859:0:26160:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6c6:0x0].0x0 since=3315s v=(0 0) 00010000:00010000:3.0:1784189073.652860:0:6502:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000013d62a94/0xcc1762b626f8aea5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189073.652868:0:26160:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6c6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784189073.652876:0:26160:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000027d7c725/0xcc1762b626f8aedd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189073.652905:0:26160:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000027d7c725/0xcc1762b626f8aedd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189073.652913:0:26160:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000027d7c725/0xcc1762b626f8aedd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189073.652919:0:26160:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000027d7c725/0xcc1762b626f8aedd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189073.652927:0:26160:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/8 locks to regular blp list, 8 blwis in pool 00002000:00010000:0.0:1784189073.652960:0:26160:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6c5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784189073.652965:0:26160:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004cef756d/0xcc1762b626f8aee4 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6c5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189073.652978:0:26160:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6c5:0x0].0x0 since=3315s v=(0 0) 00010000:00010000:0.0:1784189073.652981:0:26160:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6c5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784189073.652985:0:26160:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004cef756d/0xcc1762b626f8aee4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189073.652993:0:26160:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004cef756d/0xcc1762b626f8aee4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189073.653000:0:26160:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004cef756d/0xcc1762b626f8aee4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189073.653006:0:26160:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004cef756d/0xcc1762b626f8aee4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189073.653014:0:26160:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/9 locks to regular blp list, 9 blwis in pool 00010000:00010000:3.0:1784189073.653025:0:6502:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000013d62a94/0xcc1762b626f8aea5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189073.653038:0:6502:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000013d62a94/0xcc1762b626f8aea5 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189073.653045:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000013d62a94/0xcc1762b626f8aea5 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1784189073.653050:0:26160:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6c4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784189073.653057:0:26160:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b9a62591/0xcc1762b626f8aeeb lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6c4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189073.653060:0:6502:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 8 total in blp. (8 blwis in pool) 00010000:00010000:3.0:1784189073.653066:0:6502:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001bd2303a/0xcc1762b626f8aeac lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189073.653068:0:26160:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6c4:0x0].0x0 since=3315s v=(0 0) 00010000:00010000:0.0:1784189073.653076:0:26160:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6c4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784189073.653081:0:6502:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc05ec0f400 already unused, calling callback (ffffffffc0b2e230) 00010000:00010000:0.0:1784189073.653084:0:26160:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b9a62591/0xcc1762b626f8aeeb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189073.653086:0:6502:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001bd2303a/0xcc1762b626f8aeac lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189073.653107:0:6502:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001bd2303a/0xcc1762b626f8aeac lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189073.653116:0:6502:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001bd2303a/0xcc1762b626f8aeac lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189073.653122:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001bd2303a/0xcc1762b626f8aeac lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189073.653144:0:6502:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 7 total in blp. (7 blwis in pool) 00010000:00010000:3.0:1784189073.653147:0:6502:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000aadf9f63/0xcc1762b626f8aeb3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189073.653153:0:6502:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc05ec0e400 already unused, calling callback (ffffffffc0b2e230) 00010000:00010000:3.0:1784189073.653156:0:6502:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000aadf9f63/0xcc1762b626f8aeb3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189073.653164:0:6502:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000aadf9f63/0xcc1762b626f8aeb3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189073.653173:0:6502:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000aadf9f63/0xcc1762b626f8aeb3 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189073.653179:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000aadf9f63/0xcc1762b626f8aeb3 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189073.653189:0:6502:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:3.0:1784189073.653191:0:6502:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000dc1a395e/0xcc1762b626f8aeba lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189073.653197:0:6502:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc05ec0e200 already unused, calling callback (ffffffffc0b2e230) 00010000:00010000:3.0:1784189073.653201:0:6502:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000dc1a395e/0xcc1762b626f8aeba lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189073.653218:0:6502:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000dc1a395e/0xcc1762b626f8aeba lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189073.653227:0:6502:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000dc1a395e/0xcc1762b626f8aeba lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189073.653233:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000dc1a395e/0xcc1762b626f8aeba lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189073.653244:0:6502:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:3.0:1784189073.653248:0:6502:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f0ab8488/0xcc1762b626f8aec1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189073.653254:0:6502:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dbf4369c000 already unused, calling callback (ffffffffc0b2e230) 00010000:00010000:3.0:1784189073.653257:0:6502:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f0ab8488/0xcc1762b626f8aec1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189073.653264:0:6502:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f0ab8488/0xcc1762b626f8aec1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189073.653273:0:6502:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f0ab8488/0xcc1762b626f8aec1 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189073.653280:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f0ab8488/0xcc1762b626f8aec1 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189073.653301:0:6502:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:3.0:1784189073.653304:0:6502:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d9b1520e/0xcc1762b626f8aec8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189073.653310:0:6502:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dbf4369d000 already unused, calling callback (ffffffffc0b2e230) 00010000:00010000:3.0:1784189073.653312:0:6502:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d9b1520e/0xcc1762b626f8aec8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189073.653337:0:6502:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d9b1520e/0xcc1762b626f8aec8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189073.653347:0:6502:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d9b1520e/0xcc1762b626f8aec8 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189073.653354:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d9b1520e/0xcc1762b626f8aec8 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189073.653364:0:6502:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:3.0:1784189073.653367:0:6502:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002a100b32/0xcc1762b626f8aecf lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189073.653372:0:6502:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dbf4369c800 already unused, calling callback (ffffffffc0b2e230) 00010000:00010000:3.0:1784189073.653375:0:6502:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002a100b32/0xcc1762b626f8aecf lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189073.653393:0:6502:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002a100b32/0xcc1762b626f8aecf lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189073.653403:0:6502:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002a100b32/0xcc1762b626f8aecf lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189073.653410:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002a100b32/0xcc1762b626f8aecf lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189073.653421:0:6502:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1784189073.653423:0:6502:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ad1773fd/0xcc1762b626f8aed6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189073.653428:0:6502:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dbf4369d200 already unused, calling callback (ffffffffc0b2e230) 00010000:00010000:3.0:1784189073.653431:0:6502:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ad1773fd/0xcc1762b626f8aed6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189073.653437:0:6502:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ad1773fd/0xcc1762b626f8aed6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189073.653446:0:6502:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ad1773fd/0xcc1762b626f8aed6 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189073.653453:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ad1773fd/0xcc1762b626f8aed6 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189073.653471:0:6502:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1784189073.653474:0:6502:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000027d7c725/0xcc1762b626f8aedd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189073.653480:0:6502:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dbf4369d800 already unused, calling callback (ffffffffc0b2e230) 00010000:00010000:3.0:1784189073.653483:0:6502:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000027d7c725/0xcc1762b626f8aedd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189073.653490:0:6502:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000027d7c725/0xcc1762b626f8aedd lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189073.653497:0:26160:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b9a62591/0xcc1762b626f8aeeb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189073.653501:0:6502:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000027d7c725/0xcc1762b626f8aedd lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189073.653513:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000027d7c725/0xcc1762b626f8aedd lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189073.653533:0:26160:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b9a62591/0xcc1762b626f8aeeb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189073.653537:0:6502:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784189073.653544:0:6502:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004cef756d/0xcc1762b626f8aee4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189073.653547:0:26160:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b9a62591/0xcc1762b626f8aeeb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189073.653564:0:6502:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dbf4369da00 already unused, calling callback (ffffffffc0b2e230) 00010000:00010000:3.0:1784189073.653569:0:6502:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004cef756d/0xcc1762b626f8aee4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189073.653569:0:26160:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1784189073.653591:0:6502:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004cef756d/0xcc1762b626f8aee4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189073.653605:0:6502:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004cef756d/0xcc1762b626f8aee4 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189073.653612:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004cef756d/0xcc1762b626f8aee4 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1784189073.653615:0:26160:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6c3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784189073.653626:0:26160:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b80d0988/0xcc1762b626f8aef2 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6c3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189073.653636:0:6502:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784189073.653636:0:26160:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6c3:0x0].0x0 since=3315s v=(0 0) 00010000:00010000:3.0:1784189073.653643:0:6502:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b9a62591/0xcc1762b626f8aeeb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189073.653643:0:26160:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6c3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784189073.653650:0:26160:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b80d0988/0xcc1762b626f8aef2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189073.653659:0:6502:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dbf4369d600 already unused, calling callback (ffffffffc0b2e230) 00010000:00010000:3.0:1784189073.653667:0:6502:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b9a62591/0xcc1762b626f8aeeb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189073.653667:0:26160:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b80d0988/0xcc1762b626f8aef2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00100000:1.0:1784189073.653680:0:9506:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:0.0:1784189073.653687:0:26160:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b80d0988/0xcc1762b626f8aef2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189073.653689:0:6502:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b9a62591/0xcc1762b626f8aeeb lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189073.653702:0:26160:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b80d0988/0xcc1762b626f8aef2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189073.653709:0:6502:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b9a62591/0xcc1762b626f8aeeb lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189073.653724:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b9a62591/0xcc1762b626f8aeeb lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189073.653731:0:26160:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1784189073.653755:0:6502:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784189073.653760:0:6502:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b80d0988/0xcc1762b626f8aef2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1784189073.653764:0:26160:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6c2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784189073.653772:0:26160:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ba033d24/0xcc1762b626f8aef9 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6c2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189073.653773:0:6502:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dbf4369c600 already unused, calling callback (ffffffffc0b2e230) 00010000:00010000:3.0:1784189073.653779:0:6502:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b80d0988/0xcc1762b626f8aef2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189073.653781:0:26160:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6c2:0x0].0x0 since=3315s v=(0 0) 00010000:00010000:0.0:1784189073.653788:0:26160:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6c2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784189073.653795:0:26160:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ba033d24/0xcc1762b626f8aef9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189073.653797:0:6502:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b80d0988/0xcc1762b626f8aef2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189073.653808:0:26160:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ba033d24/0xcc1762b626f8aef9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189073.653816:0:6502:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b80d0988/0xcc1762b626f8aef2 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189073.653816:0:26160:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ba033d24/0xcc1762b626f8aef9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189073.653840:0:26160:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ba033d24/0xcc1762b626f8aef9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189073.653841:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b80d0988/0xcc1762b626f8aef2 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189073.653863:0:26160:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1784189073.653868:0:6502:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784189073.653873:0:6502:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ba033d24/0xcc1762b626f8aef9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189073.653881:0:6502:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dbf4369d400 already unused, calling callback (ffffffffc0b2e230) 00010000:00010000:3.0:1784189073.653884:0:6502:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ba033d24/0xcc1762b626f8aef9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189073.653915:0:6502:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ba033d24/0xcc1762b626f8aef9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189073.653927:0:6502:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ba033d24/0xcc1762b626f8aef9 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189073.653935:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ba033d24/0xcc1762b626f8aef9 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189073.653951:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784189073.653954:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784189073.653957:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784189073.653965:0:26173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784189073.653972:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:0.0:1784189073.654957:0:26160:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x2c0000401:1666 00000100:00100000:0.0:1784189073.655124:0:26160:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf46954700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+5:87044:x1870854458069632:12345-0@lo:5:osp-pre-1-0.0 Request processed in 37850us (41017us total) trans 0 rc 0/0 00000100:00100000:0.0:1784189073.655134:0:26160:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4934 00000100:00100000:0.0:1784189073.655197:0:87044:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf46957480 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:87044:1870854458069632:0@lo:5:osp-pre-1-0.0 00000004:00080000:0.0:1784189073.655224:0:87044:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x2c0000401:0x6e1:0x0] from OST, last_created [0x2c0000401:0x6e1:0x0]last_used is [0x2c0000401:0x682:0x0] 00000100:00100000:0.0:1784189073.655309:0:87044:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf46956300 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:87044:1870854458070144:0@lo:5:osp-pre-1-0.0 00000100:00100000:3.0:1784189073.655348:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf46957480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1870854458070016:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1784189073.655370:0:87044:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784189073.655392:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784189073.655395:0:87044:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dc0754d6240 going to sleep for 11 seconds 00000100:00100000:0.0:1784189073.655418:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458070144 00000100:00100000:0.0:1784189073.655424:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458070144 00000100:00100000:3.0:1784189073.655433:0:9466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458070016 00000100:00100000:3.0:1784189073.655439:0:9466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458070016 00000100:00100000:0.0:1784189073.655465:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4936 00000100:00100000:0.0:1784189073.655476:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf46957800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:87044:x1870854458070144:12345-0@lo:5:osp-pre-1-0.0 00000100:00100000:3.0:1784189073.655480:0:9466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1887 00000100:00100000:3.0:1784189073.655489:0:9466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc075663b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3641:x1870854458070016:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1784189073.655515:0:9466:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 213696 pending 0 free 3923529728 avail 3692007424 00002000:00080000:0.0:1784189073.655524:0:8429:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000401 at 1762 00000100:00100000:3.0:1784189073.655551:0:9466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc075663b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3641:x1870854458070016:12345-0@lo:13:osp-pre-1-0.0 Request processed in 62us (159us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189073.655559:0:9466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1887 00000100:00100000:3.0:1784189073.655597:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf46957480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1870854458070016:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1784189073.658373:0:7454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784189073.658459:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf46957800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:87044:x1870854458070144:12345-0@lo:5:osp-pre-1-0.0 Request processed in 2981us (3085us total) trans 4294968953 rc 0/0 00000100:00100000:0.0:1784189073.658471:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4936 00000100:00100000:0.0:1784189073.658589:0:87044:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf46956300 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:87044:1870854458070144:0@lo:5:osp-pre-1-0.0 00000004:00080000:0.0:1784189073.658604:0:87044:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x2c0000401:0x6e1:0x0]-[0x2c0000401:0x701:0x0] 00000100:00100000:2.0:1784189073.704242:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1784189073.704281:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1784189073.704405:0:87026:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436247168 00000100:00100000:0.0:1784189073.704416:0:87026:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436247168 00000100:00100000:3.0:1784189073.704462:0:68287:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436247296 00000100:00100000:3.0:1784189073.704467:0:68287:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436247296 00000100:00100000:0.0:1784189073.704484:0:87026:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 72 00000100:00100000:0.0:1784189073.704497:0:87026:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf4649dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9957a2dc-fd88-4a91-bca3-e2b7f365ab0c+10:2399:x1870854436247168:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:3.0:1784189073.704533:0:68287:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1064 00000100:00100000:3.0:1784189073.704542:0:68287:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc07016f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+6:2399:x1870854436247296:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:0.0:1784189073.704567:0:87026:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf4649dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9957a2dc-fd88-4a91-bca3-e2b7f365ab0c+10:2399:x1870854436247168:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 73us (284us total) trans 0 rc 0/0 00000100:00100000:0.0:1784189073.704575:0:87026:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 72 00000100:00100000:3.0:1784189073.704583:0:68287:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc07016f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+6:2399:x1870854436247296:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 41us (350us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189073.704591:0:68287:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1064 00000100:00080000:3.0:1784189073.704615:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000001:00100000:1.0:1784189073.972945:0:75588:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000004:3.0:1784189074.048770:0:87412:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1784189074.049210:0:87412:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1784189074.161062:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784189074.479800:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1784189074.479835:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc07016e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1870854458070272:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1784189074.479950:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784189074.480197:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1784189074.480208:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf46955880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1870854458070400:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1784189074.480240:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784189074.480349:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458070272 00000100:00100000:3.0:1784189074.480359:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458070272 00000100:00100000:2.0:1784189074.480403:0:9466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458070400 00000100:00100000:2.0:1784189074.480415:0:9466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458070400 00000100:00100000:3.0:1784189074.480425:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1888 00000100:00100000:3.0:1784189074.480438:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc080e61f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1870854458070272:12345-0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1784189074.480467:0:9466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1889 00002000:00000024:3.0:1784189074.480470:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 212800 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1784189074.480483:0:9466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf46954000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1870854458070400:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1784189074.480508:0:9466:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 212800 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1784189074.480529:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc080e61f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1870854458070272:12345-0@lo:13:osp-pre-0-1.0 Request processed in 91us (576us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189074.480538:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1888 00000100:00100000:3.0:1784189074.480634:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf46955880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1870854458070400:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1784189074.480716:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc07016e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1870854458070272:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1784189074.480720:0:9466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf46954000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1870854458070400:12345-0@lo:13:osp-pre-1-1.0 Request processed in 240us (475us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189074.480760:0:9466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1889 00010000:00010000:3.0:1784189075.185114:0:26173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784189075.896833:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1784189075.897101:0:66171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436247424 00000100:00100000:0.0:1784189075.897114:0:66171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436247424 00000100:00100000:0.0:1784189075.897254:0:66171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1131 00000100:00100000:0.0:1784189075.897266:0:66171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc075661500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+6:66716:x1870854436247424:12345-192.168.203.12@tcp:101:lfs.0 00010000:00010000:0.0:1784189075.897292:0:66171:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784189075.897387:0:66171:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4369ca00/0xcc1762b626f8af00 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbfc5de7fe6c3d53 expref: -99 pid: 66171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189075.897741:0:66171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4369ce00/0xcc1762b626f8af07 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189075.897759:0:66171:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4369ce00/0xcc1762b626f8af07 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189075.897776:0:66171:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4369ce00/0xcc1762b626f8af07 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784189075.897843:0:66171:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1784189075.897847:0:66171:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1784189075.897908:0:66171:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4369ce00/0xcc1762b626f8af07 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189075.897938:0:66171:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4369ca00/0xcc1762b626f8af00 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c3d53 expref: 8 pid: 66171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189075.897959:0:66171:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4369ce00/0xcc1762b626f8af07 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c3d53 expref: 7 pid: 66171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189075.897968:0:66171:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9dc07135f300) 00010000:00010000:0.0:1784189075.897972:0:66171:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1784189075.897995:0:66171:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dbf4369ce00, rc 0) 00000100:00100000:0.0:1784189075.898079:0:66171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc075661500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+7:66716:x1870854436247424:12345-192.168.203.12@tcp:101:lfs.0 Request processed in 815us (1263us total) trans 0 rc 0/0 00000100:00100000:0.0:1784189075.898087:0:66171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1131 00000100:00080000:3.0:1784189075.898666:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1784189075.909712:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1784189075.909858:0:66170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436247552 00000100:00100000:3.0:1784189075.909877:0:66170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436247552 00000100:00100000:3.0:1784189075.909944:0:66170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1132 00000100:00100000:3.0:1784189075.909956:0:66170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf46957100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+7:66716:x1870854436247552:12345-192.168.203.12@tcp:41:lfs.0 00000004:00000024:3.0:1784189075.910008:0:66170:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445285888 avail 1299046400 00000100:00100000:3.0:1784189075.910093:0:66170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf46957100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+7:66716:x1870854436247552:12345-192.168.203.12@tcp:41:lfs.0 Request processed in 139us (390us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189075.910101:0:66170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1132 00000100:00100000:2.0:1784189075.913813:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1784189075.913949:0:66945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436247680 00000100:00100000:0.0:1784189075.913971:0:66945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436247680 00000100:00100000:0.0:1784189075.914073:0:66945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1133 00000100:00100000:0.0:1784189075.914085:0:66945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc07016d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+6:66716:x1870854436247680:12345-192.168.203.12@tcp:41:lfs.0 00000004:00000024:0.0:1784189075.914136:0:66945:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445576704 avail 1299337216 00000100:00100000:0.0:1784189075.914231:0:66945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc07016d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+6:66716:x1870854436247680:12345-192.168.203.12@tcp:41:lfs.0 Request processed in 148us (432us total) trans 0 rc 0/0 00000100:00100000:0.0:1784189075.914240:0:66945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1133 00000100:00080000:3.0:1784189075.915136:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1784189075.918855:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1784189075.919078:0:26166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436247808 00000100:00100000:3.0:1784189075.919090:0:26166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436247808 00000100:00100000:3.0:1784189075.919143:0:26166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 4937 00000100:00100000:3.0:1784189075.919153:0:26166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf46954a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:0+-99:2395:x1870854436247808:12345-192.168.203.12@tcp:8:lfs.0 00010000:00080000:3.0:1784189075.919196:0:26166:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0000: connection from b90fcc1c-0e69-42a4-a116-a71fec7aeb78@192.168.203.12@tcp t0 exp 0000000000000000 cur 3318 last 0 00000020:00000080:3.0:1784189075.919234:0:26166:0:(genops.c:1406:class_connect()) connect: client b90fcc1c-0e69-42a4-a116-a71fec7aeb78, cookie 0xcc1762b626f8af0e 00002000:00100000:3.0:1784189075.919249:0:26166:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli b90fcc1c-0e69-42a4-a116-a71fec7aeb78/ffff9dbf43d8c800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 21136a2 ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1784189075.919271:0:26166:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:3.0:1784189075.919399:0:26166:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1784189075.919440:0:26166:0:(import.c:65:import_set_state_nolock()) ffff9dc0756a3800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1784189075.919776:0:26166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf46954a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+6:2395:x1870854436247808:12345-192.168.203.12@tcp:8:lfs.0 Request processed in 621us (933us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189075.919792:0:26166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 4937 00000100:00100000:1.0:1784189075.922855:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1784189075.923079:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436247936 00000100:00100000:3.0:1784189075.923090:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436247936 00000100:00100000:3.0:1784189075.923229:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1890 00000100:00100000:3.0:1784189075.923243:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc0505bfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+6:66716:x1870854436247936:12345-192.168.203.12@tcp:13:lfs.0 00002000:00000024:3.0:1784189075.923280:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8650560 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1784189075.923406:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc0505bfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+6:66716:x1870854436247936:12345-192.168.203.12@tcp:13:lfs.0 Request processed in 165us (564us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189075.923435:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1890 00000100:00080000:0.0:1784189075.923506:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1784189075.930800:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1784189075.930941:0:26165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436248064 00000100:00100000:2.0:1784189075.930954:0:26165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436248064 00000100:00100000:2.0:1784189075.931182:0:26165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 4938 00000100:00100000:2.0:1784189075.931193:0:26165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf46954e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:0+-99:2395:x1870854436248064:12345-192.168.203.12@tcp:8:lfs.0 00010000:00080000:2.0:1784189075.931242:0:26165:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0001: connection from b90fcc1c-0e69-42a4-a116-a71fec7aeb78@192.168.203.12@tcp t0 exp 0000000000000000 cur 3318 last 0 00000020:00000080:2.0:1784189075.931284:0:26165:0:(genops.c:1406:class_connect()) connect: client b90fcc1c-0e69-42a4-a116-a71fec7aeb78, cookie 0xcc1762b626f8af15 00002000:00100000:2.0:1784189075.931299:0:26165:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli b90fcc1c-0e69-42a4-a116-a71fec7aeb78/ffff9dbf46d39800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 21136a2 ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1784189075.931348:0:26165:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1784189075.931439:0:26165:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1784189075.931479:0:26165:0:(import.c:65:import_set_state_nolock()) ffff9dc06b3ec800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1784189075.931762:0:26165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf46954e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+6:2395:x1870854436248064:12345-192.168.203.12@tcp:8:lfs.0 Request processed in 559us (965us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189075.931771:0:26165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 4938 00000100:00100000:1.0:1784189075.935753:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1784189075.935897:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436248192 00000100:00100000:0.0:1784189075.935910:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436248192 00000100:00100000:0.0:1784189075.936039:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1891 00000100:00100000:0.0:1784189075.936052:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc0505bce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+6:66716:x1870854436248192:12345-192.168.203.12@tcp:13:lfs.0 00002000:00000024:0.0:1784189075.936084:0:8432:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8650560 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1784189075.936263:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc0505bce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+6:66716:x1870854436248192:12345-192.168.203.12@tcp:13:lfs.0 Request processed in 214us (525us total) trans 0 rc 0/0 00000100:00100000:0.0:1784189075.936272:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1891 00000100:00080000:3.0:1784189075.936366:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1784189076.209151:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784189077.233211:0:7454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784189078.256311:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784189078.575635:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc07016c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3641:1870854458070656:0@lo:400:kworker.0 00000100:00100000:2.0:1784189078.575746:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784189078.575790:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc07016df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1870854458071168:0@lo:400:kworker.0 00000100:00100000:2.0:1784189078.576013:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784189078.576117:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc07016dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1870854458071680:0@lo:400:kworker.0 00000100:00100000:2.0:1784189078.576145:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784189078.576176:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [0->1] 00000100:00100000:2.0:1784189078.576182:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc07016ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:bd553d0d-03e2-4233-b06b-b55bbfa2b954:3641:1870854458070528:0@lo:400:kworker.0 00000100:00100000:2.0:1784189078.576214:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784189078.576270:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc07016f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3641:1870854458071040:0@lo:400:kworker.0 00000100:00100000:2.0:1784189078.576297:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784189078.576342:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc07016e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3641:1870854458071552:0@lo:400:kworker.0 00000100:00100000:2.0:1784189078.576365:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784189078.576383:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf4367d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3641:1870854458072064:0@lo:400:kworker.0 00000100:00100000:2.0:1784189078.576405:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784189078.576593:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc07016d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3643:1870854458070912:0@lo:400:kworker.0 00000100:00100000:1.0:1784189078.576626:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784189078.576647:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc07016f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1870854458071424:0@lo:400:kworker.0 00000100:00100000:1.0:1784189078.576671:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784189078.576691:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf4367ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1870854458071936:0@lo:400:kworker.0 00000100:00100000:1.0:1784189078.576726:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784189078.576771:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc07016fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3642:1870854458070784:0@lo:400:kworker.0 00000100:00100000:2.0:1784189078.576813:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784189078.576826:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc07016e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1870854458071296:0@lo:400:kworker.0 00000100:00100000:2.0:1784189078.576858:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784189078.576879:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc07016d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1870854458071808:0@lo:400:kworker.0 00000100:00100000:2.0:1784189078.576904:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784189078.576940:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1784189078.576948:0:66171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458070656 00000100:00100000:3.0:1784189078.576955:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc0505be680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1870854458072192:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1784189078.576958:0:66171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458070656 00000100:00100000:3.0:1784189078.576999:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784189078.577032:0:66171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458071040 00000100:00100000:3.0:1784189078.577041:0:87034:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458070528 00000100:00100000:3.0:1784189078.577046:0:87034:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458070528 00000100:00100000:2.0:1784189078.577048:0:66171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458071040 00000100:00100000:2.0:1784189078.577075:0:66171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458071552 00000100:00100000:2.0:1784189078.577078:0:66171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458071552 00000100:00100000:3.0:1784189078.577095:0:87034:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1784189078.577097:0:66171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458072064 00000100:00100000:2.0:1784189078.577101:0:66171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458072064 00000100:00100000:3.0:1784189078.577111:0:87034:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf4649fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:bd553d0d-03e2-4233-b06b-b55bbfa2b954+24:3641:x1870854458070528:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784189078.577116:0:66171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458070912 00000100:00100000:2.0:1784189078.577121:0:66171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458070912 00000100:00100000:2.0:1784189078.577137:0:66171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458070784 00000100:00100000:2.0:1784189078.577140:0:66171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458070784 00000100:00100000:2.0:1784189078.577160:0:66171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1065 00000100:00100000:2.0:1784189078.577168:0:66171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc080f68e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1870854458070656:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784189078.577185:0:87034:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf4649fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:bd553d0d-03e2-4233-b06b-b55bbfa2b954+24:3641:x1870854458070528:12345-0@lo:400:kworker.0 Request processed in 77us (968us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189078.577194:0:87034:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1784189078.577216:0:66171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc080f68e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1870854458070656:12345-0@lo:400:kworker.0 Request processed in 49us (1470us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189078.577242:0:66171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1065 00000100:00100000:2.0:1784189078.577263:0:66171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1066 00000100:00100000:3.0:1784189078.577266:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458071168 00000100:00100000:3.0:1784189078.577272:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458071168 00000100:00100000:2.0:1784189078.577272:0:66171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf4262ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1870854458071040:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784189078.577307:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458071680 00000100:00100000:3.0:1784189078.577312:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458071680 00000100:00100000:2.0:1784189078.577314:0:66171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf4262ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1870854458071040:12345-0@lo:400:kworker.0 Request processed in 43us (1015us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189078.577346:0:66171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1066 00000100:00100000:3.0:1784189078.577349:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458072192 00000100:00100000:3.0:1784189078.577353:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458072192 00000100:00100000:2.0:1784189078.577365:0:66171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1067 00000100:00100000:3.0:1784189078.577372:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3742 00000100:00100000:2.0:1784189078.577377:0:66171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf4262d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1870854458071552:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784189078.577384:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc080f69500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3641:x1870854458071168:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784189078.577414:0:66171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf4262d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1870854458071552:12345-0@lo:400:kworker.0 Request processed in 41us (1046us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189078.577420:0:66171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1067 00000100:00100000:3.0:1784189078.577438:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc080f69500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3641:x1870854458071168:12345-0@lo:400:kworker.0 Request processed in 54us (1422us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189078.577446:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3742 00000100:00100000:2.0:1784189078.577450:0:66171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1068 00000100:00100000:2.0:1784189078.577460:0:66171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf4262e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1870854458072064:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784189078.577465:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3743 00000100:00100000:3.0:1784189078.577474:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf4262d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3641:x1870854458071680:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784189078.577493:0:66171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf4262e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1870854458072064:12345-0@lo:400:kworker.0 Request processed in 35us (1086us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189078.577501:0:66171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1068 00000100:00100000:3.0:1784189078.577518:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf4262d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3641:x1870854458071680:12345-0@lo:400:kworker.0 Request processed in 44us (1370us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189078.577519:0:66171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1069 00000100:00100000:2.0:1784189078.577529:0:66171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc0505bdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1870854458070912:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784189078.577538:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3743 00000100:00100000:3.0:1784189078.577559:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3744 00000100:00100000:2.0:1784189078.577567:0:66171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc0505bdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1870854458070912:12345-0@lo:400:kworker.0 Request processed in 40us (939us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189078.577568:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc075662680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3640:x1870854458072192:12345-0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1784189078.577582:0:66171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1069 00000100:00100000:2.0:1784189078.577596:0:66171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1070 00000100:00100000:2.0:1784189078.577604:0:66171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf4262fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1870854458070784:12345-0@lo:400:kworker.0 00000004:00000024:3.0:1784189078.577608:0:8439:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445576704 avail 1299337216 00000100:00100000:2.0:1784189078.577642:0:66171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf4262fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1870854458070784:12345-0@lo:400:kworker.0 Request processed in 38us (839us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189078.577657:0:66171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1070 00000100:00100000:3.0:1784189078.577663:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc075662680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3640:x1870854458072192:12345-0@lo:41:osp-pre-1-0.0 Request processed in 96us (661us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189078.577671:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3744 00000100:00100000:2.0:1784189078.577719:0:26162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458071424 00000100:00100000:2.0:1784189078.577724:0:26162:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458071424 00000100:00100000:3.0:1784189078.577740:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc0505be680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1870854458072192:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1784189078.577758:0:26162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458071936 00000100:00100000:2.0:1784189078.577763:0:26162:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458071936 00000100:00100000:2.0:1784189078.577784:0:26162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458071296 00000100:00100000:2.0:1784189078.577787:0:26162:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458071296 00000100:00100000:2.0:1784189078.577805:0:26162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458071808 00000100:00100000:2.0:1784189078.577807:0:26162:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458071808 00000100:00100000:2.0:1784189078.577828:0:26162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2361 00000100:00100000:2.0:1784189078.577834:0:26162:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc0505be300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:3643:x1870854458071424:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784189078.577881:0:26162:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc0505be300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:3643:x1870854458071424:12345-0@lo:400:kworker.0 Request processed in 47us (1208us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189078.577888:0:26162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2361 00000100:00100000:2.0:1784189078.577903:0:26162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2362 00000100:00100000:2.0:1784189078.577910:0:26162:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc06b98d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+6:3643:x1870854458071936:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784189078.577934:0:26162:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc06b98d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+6:3643:x1870854458071936:12345-0@lo:400:kworker.0 Request processed in 26us (1208us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189078.577941:0:26162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2362 00000100:00100000:2.0:1784189078.577951:0:26162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2363 00000100:00100000:2.0:1784189078.577956:0:26162:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf469b5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:3642:x1870854458071296:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784189078.577981:0:26162:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf469b5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:3642:x1870854458071296:12345-0@lo:400:kworker.0 Request processed in 25us (1132us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189078.577986:0:26162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2363 00000100:00100000:2.0:1784189078.577995:0:26162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2364 00000100:00100000:2.0:1784189078.578000:0:26162:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf469b7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+6:3642:x1870854458071808:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784189078.578035:0:26162:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf469b7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+6:3642:x1870854458071808:12345-0@lo:400:kworker.0 Request processed in 35us (1131us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189078.578041:0:26162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2364 00000100:00080000:2.0:1784189078.578067:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1784189078.578072:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1784189078.578074:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1784189078.578076:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1784189078.578116:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc07016fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3642:1870854458070784:0@lo:400:kworker.0 00000100:00100000:2.0:1784189078.578127:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc07016e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1870854458071296:0@lo:400:kworker.0 00000100:00100000:2.0:1784189078.578139:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc07016d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1870854458071808:0@lo:400:kworker.0 00000100:00100000:1.0:1784189078.582930:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc07016d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3643:1870854458070912:0@lo:400:kworker.0 00000100:00100000:1.0:1784189078.582956:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc07016f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1870854458071424:0@lo:400:kworker.0 00000100:00100000:1.0:1784189078.582972:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf4367ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1870854458071936:0@lo:400:kworker.0 00000100:00100000:0.0:1784189078.583817:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc07016ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:bd553d0d-03e2-4233-b06b-b55bbfa2b954:3641:1870854458070528:0@lo:400:kworker.0 00000100:00100000:0.0:1784189078.583838:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc07016f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3641:1870854458071040:0@lo:400:kworker.0 00000100:00100000:0.0:1784189078.584020:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc07016e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3641:1870854458071552:0@lo:400:kworker.0 00000100:00100000:0.0:1784189078.584046:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf4367d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3641:1870854458072064:0@lo:400:kworker.0 00000100:00100000:0.0:1784189078.584060:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc07016c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3641:1870854458070656:0@lo:400:kworker.0 00000100:00100000:0.0:1784189078.584074:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc07016df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1870854458071168:0@lo:400:kworker.0 00000100:00100000:0.0:1784189078.584087:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc07016dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1870854458071680:0@lo:400:kworker.0 00000100:00100000:1.0:1784189078.823471:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1784189078.823512:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1784189078.823662:0:66171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436248448 00000100:00100000:2.0:1784189078.823673:0:66171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436248448 00000100:00100000:2.0:1784189078.823770:0:66171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1071 00000100:00080000:3.0:1784189078.823786:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1784189078.823787:0:66171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc06b98c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+7:2396:x1870854436248448:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:3.0:1784189078.823994:0:66171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc06b98c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+7:2396:x1870854436248448:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 212us (534us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189078.824005:0:66171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1071 00000100:00100000:1.0:1784189078.824051:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1784189078.824129:0:87028:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436248320 00000100:00100000:3.0:1784189078.824135:0:87028:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436248320 00000100:00100000:1.0:1784189078.824152:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1784189078.824175:0:87028:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 74 00000100:00100000:1.0:1784189078.824182:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1784189078.824187:0:87028:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc056555850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9957a2dc-fd88-4a91-bca3-e2b7f365ab0c+10:2397:x1870854436248320:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:1.0:1784189078.824207:0:68287:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436248576 00000100:00100000:1.0:1784189078.824212:0:68287:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436248576 00000100:00100000:3.0:1784189078.824230:0:87028:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc056555850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9957a2dc-fd88-4a91-bca3-e2b7f365ab0c+10:2397:x1870854436248320:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 46us (178us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189078.824239:0:87028:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 74 00000100:00100000:1.0:1784189078.824256:0:68287:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1072 00000100:00100000:1.0:1784189078.824266:0:68287:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc06b98ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+6:2397:x1870854436248576:12345-192.168.203.12@tcp:400:kworker.0 00000100:00080000:3.0:1784189078.824291:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1784189078.824298:0:68287:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc06b98ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+6:2397:x1870854436248576:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 34us (146us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189078.824307:0:68287:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1072 00000100:00100000:0.0:1784189078.826351:0:14684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436248704 00000100:00100000:0.0:1784189078.826366:0:14684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436248704 00000100:00100000:0.0:1784189078.826428:0:14684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436248832 00000100:00100000:0.0:1784189078.826432:0:14684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436248832 00000100:00100000:0.0:1784189078.826472:0:14684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 2365 00000100:00100000:0.0:1784189078.826484:0:14684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc06b98fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+6:2396:x1870854436248704:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:0.0:1784189078.826580:0:14684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc06b98fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+6:2396:x1870854436248704:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 98us (3065us total) trans 0 rc 0/0 00000100:00100000:0.0:1784189078.826589:0:14684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 2365 00000100:00100000:1.0:1784189078.826598:0:26164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 2366 00000100:00100000:1.0:1784189078.826609:0:26164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc06b98f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+6:2397:x1870854436248832:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:1.0:1784189078.826658:0:26164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc06b98f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+6:2397:x1870854436248832:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 52us (2476us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189078.826666:0:26164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 2366 00000100:00080000:3.0:1784189078.827341:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1784189078.827348:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1784189079.087932:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf46955880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1870854458072320:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1784189079.088047:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784189079.088225:0:23826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458072320 00000100:00100000:0.0:1784189079.088236:0:23826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458072320 00000100:00100000:0.0:1784189079.088307:0:23826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3745 00000100:00100000:0.0:1784189079.088347:0:23826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf469b7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3642:x1870854458072320:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1784189079.088397:0:23826:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445285888 avail 1299046400 00000100:00100000:0.0:1784189079.088470:0:23826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf469b7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3642:x1870854458072320:12345-0@lo:41:osp-pre-0-1.0 Request processed in 153us (422us total) trans 0 rc 0/0 00000100:00100000:0.0:1784189079.088478:0:23826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3745 00000100:00100000:0.0:1784189079.088534:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf46955880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1870854458072320:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1784189079.088882:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1784189079.088893:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf469b4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1870854458072448:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1784189079.088934:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784189079.088982:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458072448 00000100:00100000:2.0:1784189079.088988:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458072448 00000100:00100000:2.0:1784189079.089026:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1892 00000100:00100000:2.0:1784189079.089033:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf469b4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3642:x1870854458072448:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1784189079.089058:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8650560 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1784189079.089098:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf469b4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3642:x1870854458072448:12345-0@lo:13:osp-pre-0-0.0 Request processed in 65us (163us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189079.089112:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1892 00000100:00100000:2.0:1784189079.089155:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf469b4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1870854458072448:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1784189079.092836:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1784189079.092877:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc06b98c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1870854458072576:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1784189079.092984:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784189079.093162:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458072576 00000100:00100000:1.0:1784189079.093173:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458072576 00000100:00100000:1.0:1784189079.093240:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1893 00000100:00100000:1.0:1784189079.093250:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf46955880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3641:x1870854458072576:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1784189079.093287:0:8432:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8650560 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1784189079.093368:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf46955880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3641:x1870854458072576:12345-0@lo:13:osp-pre-1-0.0 Request processed in 118us (383us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189079.093375:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1893 00000100:00100000:0.0:1784189079.094569:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc06b98c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1870854458072576:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1784189079.280008:0:26173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784189079.600816:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1784189079.600858:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf46957480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1870854458072704:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1784189079.600964:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784189079.602664:0:9466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458072704 00000100:00100000:2.0:1784189079.602678:0:9466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458072704 00000100:00100000:2.0:1784189079.602760:0:9466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1894 00000100:00100000:2.0:1784189079.602782:0:9466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf46954380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1870854458072704:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1784189079.602815:0:9466:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8650560 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1784189079.602925:0:9466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf46954380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1870854458072704:12345-0@lo:13:osp-pre-1-1.0 Request processed in 145us (1970us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189079.603068:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc0505be680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1870854458072832:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1784189079.603115:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784189079.603178:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458072832 00000100:00100000:3.0:1784189079.603183:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458072832 00000100:00100000:3.0:1784189079.603214:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1895 00000100:00100000:3.0:1784189079.603221:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf44bc1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1870854458072832:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1784189079.603235:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8650560 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1784189079.603273:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf44bc1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1870854458072832:12345-0@lo:13:osp-pre-0-1.0 Request processed in 51us (157us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189079.603281:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1895 00000100:00100000:3.0:1784189079.603381:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc0505be680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1870854458072832:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1784189079.603479:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf46957480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1870854458072704:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1784189079.603855:0:9466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1894 00000001:00100000:0.0:1784189079.610229:0:8423:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of b90fcc1c-0e69-42a4-a116-a71fec7aeb78 00000001:00080000:0.0:1784189079.610263:0:8423:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294968949 is committed 00000001:00100000:0.0:1784189079.611203:0:9506:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of b90fcc1c-0e69-42a4-a116-a71fec7aeb78 00000001:00080000:0.0:1784189079.611218:0:9506:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294968953 is committed 00010000:00010000:3.0:1784189080.304010:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1784189081.272215:0:87605:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg312-client.virtnet: executing wait_import_state_mount (FULL|IDLE) mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 00010000:00010000:1.0:1784189081.328934:0:7454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784189082.352483:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1784189082.630924:0:87653:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: mdc.lustre-MDT0000-mdc-*.mds_server_uuid in FULL state after 0 sec 00010000:00010000:3.0:1784189083.377533:0:26173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784189083.695655:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf44bc2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3642:1870854458073344:0@lo:400:kworker.0 00000100:00100000:3.0:1784189083.695726:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784189083.695758:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc080f6fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1870854458073856:0@lo:400:kworker.0 00000100:00100000:3.0:1784189083.695783:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784189083.695798:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc056eaca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1870854458074368:0@lo:400:kworker.0 00000100:00100000:3.0:1784189083.695827:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784189083.695849:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [3->2] 00000100:00100000:3.0:1784189083.695855:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf44bc3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bd553d0d-03e2-4233-b06b-b55bbfa2b954:3642:1870854458072960:0@lo:400:kworker.0 00000100:00100000:3.0:1784189083.695882:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784189083.695905:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc0505be680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3642:1870854458073472:0@lo:400:kworker.0 00000100:00100000:3.0:1784189083.695923:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784189083.695937:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc080f6e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3642:1870854458073984:0@lo:400:kworker.0 00000100:00100000:3.0:1784189083.695954:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784189083.695980:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc056eac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3642:1870854458074496:0@lo:400:kworker.0 00000100:00100000:3.0:1784189083.696003:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784189083.696024:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf44bc3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3640:1870854458073088:0@lo:400:kworker.0 00000100:00100000:3.0:1784189083.696045:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784189083.696058:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc080f6c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1870854458073600:0@lo:400:kworker.0 00000100:00100000:3.0:1784189083.696076:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784189083.696090:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc080f6f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1870854458074112:0@lo:400:kworker.0 00000100:00100000:3.0:1784189083.696107:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784189083.696121:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1784189083.696126:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf44bc2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3640:1870854458073216:0@lo:400:kworker.0 00000100:00100000:3.0:1784189083.696143:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784189083.696152:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc080f6e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1870854458073728:0@lo:400:kworker.0 00000100:00100000:3.0:1784189083.696167:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784189083.696179:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc080f6c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1870854458074240:0@lo:400:kworker.0 00000100:00100000:0.0:1784189083.696302:0:26160:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458073856 00000100:00100000:0.0:1784189083.696310:0:26160:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458073856 00000100:00100000:0.0:1784189083.696377:0:26160:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458074368 00000100:00100000:0.0:1784189083.696380:0:26160:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458074368 00000100:00100000:0.0:1784189083.696397:0:26160:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458073728 00000100:00100000:0.0:1784189083.696400:0:26160:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458073728 00000100:00100000:0.0:1784189083.696418:0:26160:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2367 00000100:00100000:0.0:1784189083.696427:0:26160:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc056eaf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:3642:x1870854458073856:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784189083.696476:0:26160:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc056eaf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:3642:x1870854458073856:12345-0@lo:400:kworker.0 Request processed in 50us (692us total) trans 0 rc 0/0 00000100:00100000:0.0:1784189083.696484:0:26160:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2367 00000100:00100000:0.0:1784189083.696499:0:26160:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2368 00000100:00100000:0.0:1784189083.696504:0:26160:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc056eac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+5:3642:x1870854458074368:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784189083.696526:0:26160:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc056eac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+5:3642:x1870854458074368:12345-0@lo:400:kworker.0 Request processed in 22us (699us total) trans 0 rc 0/0 00000100:00100000:0.0:1784189083.696542:0:26160:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2368 00000100:00100000:0.0:1784189083.696553:0:26160:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2369 00000100:00100000:0.0:1784189083.696558:0:26160:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc0477c2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:3640:x1870854458073728:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784189083.696583:0:26160:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc0477c2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:3640:x1870854458073728:12345-0@lo:400:kworker.0 Request processed in 25us (414us total) trans 0 rc 0/0 00000100:00100000:0.0:1784189083.696589:0:26160:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2369 00000100:00080000:0.0:1784189083.696607:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1784189083.696610:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1784189083.696645:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc080f6fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1870854458073856:0@lo:400:kworker.0 00000100:00100000:0.0:1784189083.696654:0:3642:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294968953 gen 2 00000100:00100000:0.0:1784189083.696667:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc056eaca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1870854458074368:0@lo:400:kworker.0 00000100:00100000:0.0:1784189083.696702:0:66171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458073344 00000100:00100000:0.0:1784189083.696705:0:66171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458073344 00000100:00100000:0.0:1784189083.696729:0:66171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458073472 00000100:00100000:0.0:1784189083.696731:0:66171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458073472 00000100:00100000:0.0:1784189083.696742:0:66171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458073984 00000100:00100000:0.0:1784189083.696744:0:66171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458073984 00000100:00100000:0.0:1784189083.696753:0:66171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458074496 00000100:00100000:0.0:1784189083.696755:0:66171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458074496 00000100:00100000:0.0:1784189083.696764:0:66171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458073088 00000100:00100000:0.0:1784189083.696766:0:66171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458073088 00000100:00100000:0.0:1784189083.696776:0:66171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458073216 00000100:00100000:0.0:1784189083.696778:0:66171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458073216 00000100:00100000:0.0:1784189083.696791:0:66171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1073 00000100:00100000:0.0:1784189083.696796:0:66171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc056ead880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3642:x1870854458073344:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784189083.696842:0:66171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc056ead880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3642:x1870854458073344:12345-0@lo:400:kworker.0 Request processed in 45us (1117us total) trans 0 rc 0/0 00000100:00100000:0.0:1784189083.696857:0:66171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1073 00000100:00100000:0.0:1784189083.696870:0:66171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1074 00000100:00100000:0.0:1784189083.696876:0:66171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc056eafb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1870854458073472:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784189083.696902:0:66171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc056eafb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1870854458073472:12345-0@lo:400:kworker.0 Request processed in 27us (978us total) trans 0 rc 0/0 00000100:00100000:0.0:1784189083.696908:0:66171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1074 00000100:00100000:0.0:1784189083.696918:0:66171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1075 00000100:00100000:0.0:1784189083.696923:0:66171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc056eac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1870854458073984:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784189083.696946:0:66171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc056eac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1870854458073984:12345-0@lo:400:kworker.0 Request processed in 23us (991us total) trans 0 rc 0/0 00000100:00100000:0.0:1784189083.696951:0:66171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1075 00000100:00100000:0.0:1784189083.696960:0:66171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1076 00000100:00100000:0.0:1784189083.696966:0:66171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc056ead180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1870854458074496:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784189083.696986:0:66171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc056ead180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1870854458074496:12345-0@lo:400:kworker.0 Request processed in 21us (983us total) trans 0 rc 0/0 00000100:00100000:0.0:1784189083.696992:0:66171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1076 00000100:00100000:0.0:1784189083.697001:0:66171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1077 00000100:00100000:0.0:1784189083.697006:0:66171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc0477c3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1870854458073088:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784189083.697028:0:66171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc0477c3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1870854458073088:12345-0@lo:400:kworker.0 Request processed in 22us (983us total) trans 0 rc 0/0 00000100:00100000:0.0:1784189083.697034:0:66171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1077 00000100:00100000:0.0:1784189083.697043:0:66171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1078 00000100:00100000:0.0:1784189083.697048:0:66171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc0477c0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1870854458073216:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784189083.697069:0:66171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc0477c0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1870854458073216:12345-0@lo:400:kworker.0 Request processed in 21us (925us total) trans 0 rc 0/0 00000100:00100000:0.0:1784189083.697080:0:66171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1078 00000100:00080000:0.0:1784189083.697105:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1784189083.697108:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1784189083.697123:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc0505be680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3642:1870854458073472:0@lo:400:kworker.0 00000100:00100000:0.0:1784189083.697132:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc080f6e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3642:1870854458073984:0@lo:400:kworker.0 00000100:00100000:0.0:1784189083.697141:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc056eac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3642:1870854458074496:0@lo:400:kworker.0 00000100:00100000:0.0:1784189083.697150:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf44bc2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3642:1870854458073344:0@lo:400:kworker.0 00000100:00100000:0.0:1784189083.697181:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458073600 00000100:00100000:0.0:1784189083.697197:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458073600 00000100:00100000:0.0:1784189083.697220:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458074112 00000100:00100000:0.0:1784189083.697223:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458074112 00000100:00100000:0.0:1784189083.697237:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3746 00000100:00100000:0.0:1784189083.697243:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc0477c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3640:x1870854458073600:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784189083.697274:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc0477c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3640:x1870854458073600:12345-0@lo:400:kworker.0 Request processed in 31us (1197us total) trans 0 rc 0/0 00000100:00100000:0.0:1784189083.697281:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3746 00000100:00100000:0.0:1784189083.697291:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3747 00000100:00100000:0.0:1784189083.697296:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc0477c3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3640:x1870854458074112:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784189083.697341:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc0477c3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3640:x1870854458074112:12345-0@lo:400:kworker.0 Request processed in 23us (1211us total) trans 0 rc 0/0 00000100:00100000:0.0:1784189083.697348:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3747 00000100:00100000:2.0:1784189083.697456:0:87031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458072960 00000100:00100000:2.0:1784189083.697461:0:87031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458072960 00000100:00100000:2.0:1784189083.697495:0:87031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1784189083.697503:0:87031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc07037d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:bd553d0d-03e2-4233-b06b-b55bbfa2b954+24:3642:x1870854458072960:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784189083.697538:0:87031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc07037d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:bd553d0d-03e2-4233-b06b-b55bbfa2b954+24:3642:x1870854458072960:12345-0@lo:400:kworker.0 Request processed in 36us (1655us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189083.697544:0:87031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1784189083.697580:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf44bc3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bd553d0d-03e2-4233-b06b-b55bbfa2b954:3642:1870854458072960:0@lo:400:kworker.0 00000100:00100000:3.0:1784189083.697873:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784189083.697906:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf44bc3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3640:1870854458073088:0@lo:400:kworker.0 00000100:00100000:3.0:1784189083.697916:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc080f6c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1870854458073600:0@lo:400:kworker.0 00000100:00100000:3.0:1784189083.697926:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc080f6f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1870854458074112:0@lo:400:kworker.0 00000100:00100000:3.0:1784189083.697943:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc06b98dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1870854458074624:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1784189083.697963:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784189083.698059:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf44bc2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3640:1870854458073216:0@lo:400:kworker.0 00000100:00100000:3.0:1784189083.698071:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc080f6e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1870854458073728:0@lo:400:kworker.0 00000100:00100000:2.0:1784189083.698128:0:26165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458074240 00000100:00100000:2.0:1784189083.698132:0:26165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458074240 00000100:00100000:2.0:1784189083.698174:0:26165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2370 00000100:00100000:2.0:1784189083.698180:0:26165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf444e0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+5:3640:x1870854458074240:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784189083.698222:0:26165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf444e0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+5:3640:x1870854458074240:12345-0@lo:400:kworker.0 Request processed in 42us (350us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189083.698240:0:26165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2370 00000100:00080000:0.0:1784189083.698332:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1784189083.698382:0:3640:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294968949 gen 2 00000100:00100000:3.0:1784189083.698399:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc080f6c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1870854458074240:0@lo:400:kworker.0 00000100:00100000:1.0:1784189083.700438:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458074624 00000100:00100000:1.0:1784189083.700453:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458074624 00000100:00100000:1.0:1784189083.700560:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3748 00000100:00100000:1.0:1784189083.700570:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf444e1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3640:x1870854458074624:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1784189083.700603:0:8439:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445576704 avail 1299337216 00000100:00100000:1.0:1784189083.700686:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf444e1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3640:x1870854458074624:12345-0@lo:41:osp-pre-1-0.0 Request processed in 117us (2720us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189083.700693:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3748 00000100:00100000:3.0:1784189083.700775:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc06b98dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1870854458074624:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1784189083.945126:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1784189083.945176:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1784189083.945217:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1784189083.945253:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1784189083.945289:0:66170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436249088 00000100:00100000:1.0:1784189083.945293:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1784189083.945298:0:66170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436249088 00000100:00100000:1.0:1784189083.945348:0:66171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436249216 00000100:00100000:1.0:1784189083.945352:0:66171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436249216 00000100:00100000:2.0:1784189083.945424:0:26223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436249344 00000100:00100000:2.0:1784189083.945428:0:26223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436249344 00000100:00100000:2.0:1784189083.945459:0:26223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436249472 00000100:00100000:2.0:1784189083.945462:0:26223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436249472 00000100:00100000:2.0:1784189083.945486:0:26223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 2371 00000100:00100000:2.0:1784189083.945496:0:26223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc06b98f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+5:2399:x1870854436249344:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:2.0:1784189083.945575:0:26223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc06b98f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+5:2399:x1870854436249344:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 80us (397us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189083.945582:0:26223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 2371 00000100:00100000:2.0:1784189083.945600:0:26223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 2372 00000100:00100000:2.0:1784189083.945607:0:26223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc06b98ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+5:2399:x1870854436249472:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:2.0:1784189083.945632:0:26223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc06b98ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+5:2399:x1870854436249472:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 26us (337us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189083.945639:0:26223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 2372 00000100:00100000:1.0:1784189083.945820:0:66171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1079 00000100:00100000:1.0:1784189083.945829:0:66171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc06b98ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+6:2399:x1870854436249216:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:1.0:1784189083.945874:0:66171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc06b98ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+6:2399:x1870854436249216:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 46us (619us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189083.945883:0:66171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1079 00000100:00100000:3.0:1784189083.945892:0:87027:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436248960 00000100:00100000:3.0:1784189083.945898:0:87027:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436248960 00000100:00100000:1.0:1784189083.945903:0:66171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1080 00000100:00100000:1.0:1784189083.945912:0:66171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc06b98f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+7:2399:x1870854436249088:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:3.0:1784189083.945939:0:87027:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 76 00000100:00100000:1.0:1784189083.945945:0:66171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc06b98f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+7:2399:x1870854436249088:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 31us (825us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189083.945953:0:87027:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc07037dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9957a2dc-fd88-4a91-bca3-e2b7f365ab0c+10:2399:x1870854436248960:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:1.0:1784189083.945957:0:66171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1080 00000100:00100000:3.0:1784189083.945990:0:87027:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc07037dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9957a2dc-fd88-4a91-bca3-e2b7f365ab0c+10:2399:x1870854436248960:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 41us (772us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189083.946003:0:87027:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 76 00000100:00080000:3.0:1784189083.946103:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1784189083.946108:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1784189083.946111:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1784189083.946113:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1784189084.210051:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1784189084.210073:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf469b4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1870854458074752:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1784189084.210145:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784189084.210255:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458074752 00000100:00100000:1.0:1784189084.210263:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458074752 00000100:00100000:1.0:1784189084.210339:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1896 00000100:00100000:1.0:1784189084.210350:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf444e1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1870854458074752:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1784189084.210380:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8650560 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1784189084.210433:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf444e1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1870854458074752:12345-0@lo:13:osp-pre-0-0.0 Request processed in 85us (287us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189084.210440:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1896 00000100:00100000:2.0:1784189084.210522:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf469b4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1870854458074752:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1784189084.210842:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf469b4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1870854458075008:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1784189084.210874:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784189084.210905:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1784189084.210911:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc06b98e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1870854458074880:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1784189084.210935:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784189084.211002:0:9466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458074880 00000100:00100000:2.0:1784189084.211006:0:9466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458074880 00000100:00100000:2.0:1784189084.211038:0:9466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1897 00000100:00100000:2.0:1784189084.211045:0:9466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc080df2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1870854458074880:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1784189084.211064:0:9466:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8650560 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1784189084.211099:0:9466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc080df2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1870854458074880:12345-0@lo:13:osp-pre-1-0.0 Request processed in 55us (164us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189084.211105:0:9466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1897 00000100:00100000:1.0:1784189084.211160:0:26492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458075008 00000100:00100000:1.0:1784189084.211165:0:26492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458075008 00000100:00100000:1.0:1784189084.211197:0:26492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3749 00000100:00100000:1.0:1784189084.211204:0:26492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf444e1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3643:x1870854458075008:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1784189084.211226:0:26492:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445285888 avail 1299046400 00000100:00100000:1.0:1784189084.211275:0:26492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf444e1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3643:x1870854458075008:12345-0@lo:41:osp-pre-0-1.0 Request processed in 71us (400us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189084.211281:0:26492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3749 00000100:00100000:3.0:1784189084.211393:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc06b98e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1870854458074880:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1784189084.211406:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf469b4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1870854458075008:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1784189084.220217:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1784189084.220345:0:68287:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436249600 00000100:00100000:2.0:1784189084.220368:0:68287:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436249600 00000100:00100000:2.0:1784189084.220432:0:68287:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1134 00000100:00100000:2.0:1784189084.220442:0:68287:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc06b98df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+7:67183:x1870854436249600:12345-192.168.203.12@tcp:41:lfs.0 00000004:00000024:2.0:1784189084.220474:0:68287:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445285888 avail 1299046400 00000100:00100000:2.0:1784189084.220552:0:68287:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc06b98df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+7:67183:x1870854436249600:12345-192.168.203.12@tcp:41:lfs.0 Request processed in 110us (344us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189084.220560:0:68287:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1134 00000100:00100000:3.0:1784189084.222424:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1784189084.222566:0:66171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436249728 00000100:00100000:1.0:1784189084.222574:0:66171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436249728 00000100:00100000:1.0:1784189084.222625:0:66171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1135 00000100:00100000:1.0:1784189084.222634:0:66171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc080df1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+6:67183:x1870854436249728:12345-192.168.203.12@tcp:41:lfs.0 00000004:00000024:1.0:1784189084.222668:0:66171:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445576704 avail 1299337216 00000100:00100000:1.0:1784189084.222730:0:66171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc080df1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+6:67183:x1870854436249728:12345-192.168.203.12@tcp:41:lfs.0 Request processed in 96us (312us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189084.222737:0:66171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1135 00000100:00100000:3.0:1784189084.226111:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1784189084.227113:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436249856 00000100:00100000:0.0:1784189084.227131:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436249856 00000100:00100000:0.0:1784189084.227225:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1898 00000100:00100000:0.0:1784189084.227235:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc080df1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+5:67183:x1870854436249856:12345-192.168.203.12@tcp:13:lfs.0 00002000:00000024:0.0:1784189084.227261:0:8432:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8650560 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1784189084.227343:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc080df1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+5:67183:x1870854436249856:12345-192.168.203.12@tcp:13:lfs.0 Request processed in 110us (1241us total) trans 0 rc 0/0 00000100:00100000:0.0:1784189084.227350:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1898 00000100:00100000:2.0:1784189084.231610:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1784189084.231735:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436249984 00000100:00100000:3.0:1784189084.231745:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436249984 00000100:00100000:3.0:1784189084.231836:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1899 00000100:00100000:3.0:1784189084.231846:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf469b6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+5:67183:x1870854436249984:12345-192.168.203.12@tcp:13:lfs.0 00002000:00000024:3.0:1784189084.231868:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8650560 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1784189084.231941:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf469b6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+5:67183:x1870854436249984:12345-192.168.203.12@tcp:13:lfs.0 Request processed in 96us (340us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189084.231948:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1899 00000100:00100000:3.0:1784189084.267246:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1784189084.267368:0:66170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436250112 00000100:00100000:0.0:1784189084.267377:0:66170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436250112 00000100:00100000:0.0:1784189084.267538:0:66170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1136 00000100:00100000:0.0:1784189084.267549:0:66170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc080df3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+7:67199:x1870854436250112:12345-192.168.203.12@tcp:101:lfs.0 00010000:00010000:0.0:1784189084.267570:0:66170:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784189084.267588:0:66170:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4369da00/0xcc1762b626f8af1c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbfc5de7fe6c3d5a expref: -99 pid: 66170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189084.267647:0:66170:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4369d600/0xcc1762b626f8af23 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189084.267660:0:66170:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4369d600/0xcc1762b626f8af23 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189084.267672:0:66170:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4369d600/0xcc1762b626f8af23 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189084.267685:0:66170:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4369c600/0xcc1762b626f8af2a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189084.267692:0:66170:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4369c600/0xcc1762b626f8af2a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189084.267715:0:66170:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4369c600/0xcc1762b626f8af2a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189084.267798:0:66170:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4369d400/0xcc1762b626f8af31 lrc: 3/1,0 mode: --/PR res: [0x20000a811:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189084.267818:0:66170:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4369d400/0xcc1762b626f8af31 lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0x3:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189084.267826:0:66170:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4369d400/0xcc1762b626f8af31 lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0x3:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784189084.267864:0:66170:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000a811:0x3:0x0]: returning size 4096 00000004:00200000:0.0:1784189084.267867:0:66170:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1784189084.267888:0:66170:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4369d400/0xcc1762b626f8af31 lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0x3:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189084.267910:0:66170:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4369d600/0xcc1762b626f8af23 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189084.267917:0:66170:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4369d600/0xcc1762b626f8af23 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189084.267931:0:66170:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4369d600/0xcc1762b626f8af23 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189084.267937:0:66170:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4369d600/0xcc1762b626f8af23 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189084.267943:0:66170:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dbf4369d600 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:0.0:1784189084.267947:0:66170:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4369d600/0xcc1762b626f8af23 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189084.267961:0:66170:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4369d600/0xcc1762b626f8af23 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189084.267973:0:66170:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9dc07135f300) 00010000:00010000:0.0:1784189084.267975:0:66170:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784189084.267980:0:66170:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4369d600/0xcc1762b626f8af23 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189084.267985:0:66170:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4369d600/0xcc1762b626f8af23 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189084.267998:0:66170:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4369c600/0xcc1762b626f8af2a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189084.268003:0:66170:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4369c600/0xcc1762b626f8af2a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189084.268009:0:66170:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4369c600/0xcc1762b626f8af2a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189084.268014:0:66170:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dbf4369c600 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:0.0:1784189084.268017:0:66170:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4369c600/0xcc1762b626f8af2a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189084.268024:0:66170:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4369c600/0xcc1762b626f8af2a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189084.268030:0:66170:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xef7738bc (ffff9dc07135f600) 00010000:00010000:0.0:1784189084.268033:0:66170:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784189084.268035:0:66170:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4369c600/0xcc1762b626f8af2a lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189084.268050:0:66170:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4369c600/0xcc1762b626f8af2a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189084.268079:0:66170:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4369da00/0xcc1762b626f8af1c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c3d5a expref: 9 pid: 66170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189084.268092:0:66170:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4369d400/0xcc1762b626f8af31 lrc: 3/0,0 mode: PR/PR res: [0x20000a811:0x3:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c3d5a expref: 8 pid: 66170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189084.268098:0:66170:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x3:0x0].0x0 (ffff9dc07135fb00) 00010000:00010000:0.0:1784189084.268101:0:66170:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1784189084.268103:0:66170:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dbf4369d400, rc 0) 00000100:00100000:0.0:1784189084.268161:0:66170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc080df3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+8:67199:x1870854436250112:12345-192.168.203.12@tcp:101:lfs.0 Request processed in 615us (924us total) trans 0 rc 0/0 00000100:00100000:0.0:1784189084.268169:0:66170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1136 00000100:00100000:3.0:1784189084.271117:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1784189084.272079:0:66945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436250368 00000100:00100000:2.0:1784189084.272091:0:66945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436250368 00000100:00100000:2.0:1784189084.272153:0:66945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1137 00000100:00100000:2.0:1784189084.272164:0:66945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc080df3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+8:67199:x1870854436250368:12345-192.168.203.12@tcp:101:lfs.0 00010000:00010000:2.0:1784189084.272183:0:66945:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784189084.272202:0:66945:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0755a5400/0xcc1762b626f8af38 lrc: 2/0,0 mode: --/CR res: [0x20000a811:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbfc5de7fe6c3d61 expref: -99 pid: 66945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189084.272266:0:66945:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0755a4a00/0xcc1762b626f8af3f lrc: 3/1,0 mode: --/CR res: [0x20000a811:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189084.272279:0:66945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0755a4a00/0xcc1762b626f8af3f lrc: 3/1,0 mode: CR/CR res: [0x20000a811:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189084.272290:0:66945:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0755a4a00/0xcc1762b626f8af3f lrc: 3/1,0 mode: CR/CR res: [0x20000a811:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189084.272303:0:66945:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0755a4800/0xcc1762b626f8af46 lrc: 3/1,0 mode: --/PR res: [0x20000a811:0x3:0x0].0xfa0fa5c1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189084.272311:0:66945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0755a4800/0xcc1762b626f8af46 lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189084.272506:0:66945:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0755a4800/0xcc1762b626f8af46 lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189084.272580:0:66945:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0755a4a00/0xcc1762b626f8af3f lrc: 4/1,0 mode: CR/CR res: [0x20000a811:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189084.272587:0:66945:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0755a4a00/0xcc1762b626f8af3f lrc: 4/1,0 mode: CR/CR res: [0x20000a811:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189084.272593:0:66945:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0755a4a00/0xcc1762b626f8af3f lrc: 3/0,0 mode: CR/CR res: [0x20000a811:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189084.272600:0:66945:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0755a4a00/0xcc1762b626f8af3f lrc: 4/0,0 mode: CR/CR res: [0x20000a811:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189084.272606:0:66945:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc0755a4a00 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:2.0:1784189084.272610:0:66945:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0755a4a00/0xcc1762b626f8af3f lrc: 4/0,0 mode: CR/CR res: [0x20000a811:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189084.272618:0:66945:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0755a4a00/0xcc1762b626f8af3f lrc: 5/0,0 mode: CR/CR res: [0x20000a811:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189084.272628:0:66945:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x3:0x0].0x0 (ffff9dc07135fb00) 00010000:00010000:2.0:1784189084.272631:0:66945:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784189084.272635:0:66945:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0755a4a00/0xcc1762b626f8af3f lrc: 3/0,0 mode: --/CR res: [0x20000a811:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189084.272642:0:66945:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0755a4a00/0xcc1762b626f8af3f lrc: 0/0,0 mode: --/CR res: [0x20000a811:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189084.272657:0:66945:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0755a4800/0xcc1762b626f8af46 lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189084.272669:0:66945:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0755a4800/0xcc1762b626f8af46 lrc: 2/0,0 mode: PR/PR res: [0x20000a811:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189084.272675:0:66945:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0755a4800/0xcc1762b626f8af46 lrc: 3/0,0 mode: PR/PR res: [0x20000a811:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189084.272680:0:66945:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc0755a4800 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:2.0:1784189084.272683:0:66945:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0755a4800/0xcc1762b626f8af46 lrc: 3/0,0 mode: PR/PR res: [0x20000a811:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189084.272689:0:66945:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0755a4800/0xcc1762b626f8af46 lrc: 4/0,0 mode: PR/PR res: [0x20000a811:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189084.272696:0:66945:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x3:0x0].0xfa0fa5c1 (ffff9dc082150500) 00010000:00010000:2.0:1784189084.272699:0:66945:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784189084.272701:0:66945:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0755a4800/0xcc1762b626f8af46 lrc: 2/0,0 mode: --/PR res: [0x20000a811:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189084.272707:0:66945:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0755a4800/0xcc1762b626f8af46 lrc: 0/0,0 mode: --/PR res: [0x20000a811:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189084.272738:0:66945:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0755a5400/0xcc1762b626f8af38 lrc: 1/0,0 mode: --/CR res: [0x20000a811:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c3d61 expref: 9 pid: 66945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189084.272748:0:66945:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x3:0x0].0x0 (ffff9dc07135fb00) 00010000:00010000:2.0:1784189084.272750:0:66945:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1784189084.272753:0:66945:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0755a5400/0xcc1762b626f8af38 lrc: 0/0,0 mode: --/CR res: [0x20000a811:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c3d61 expref: 9 pid: 66945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189084.272775:0:66945:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc0755a5400, rc 0) 00000100:00100000:2.0:1784189084.272882:0:66945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc080df3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+8:67199:x1870854436250368:12345-192.168.203.12@tcp:101:lfs.0 Request processed in 719us (1773us total) trans 0 rc 301/301 00000100:00100000:2.0:1784189084.272890:0:66945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1137 00000100:00100000:1.0:1784189084.281966:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1784189084.282042:0:66169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436250624 00000100:00100000:3.0:1784189084.282051:0:66169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436250624 00000100:00100000:3.0:1784189084.282108:0:66169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1138 00000100:00100000:3.0:1784189084.282117:0:66169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc06b98ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+8:67199:x1870854436250624:12345-192.168.203.12@tcp:101:lfs.0 00010000:00010000:3.0:1784189084.282137:0:66169:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784189084.282156:0:66169:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc05ec0d200/0xcc1762b626f8af4d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbfc5de7fe6c3d68 expref: -99 pid: 66169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784189084.282255:0:66169:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000a811:0x3:0x0]: returning size 4096 00010000:00010000:3.0:1784189084.282962:0:66169:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc05ec0d200/0xcc1762b626f8af4d lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c3d68 expref: 10 pid: 66169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189084.282979:0:66169:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9dc07135f300) 00010000:00010000:3.0:1784189084.282982:0:66169:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1784189084.282988:0:66169:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc05ec0d200/0xcc1762b626f8af4d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c3d68 expref: 10 pid: 66169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189084.283021:0:66169:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc05ec0d200, rc 0) 00000100:00100000:3.0:1784189084.283086:0:66169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc06b98ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+9:67199:x1870854436250624:12345-192.168.203.12@tcp:101:lfs.0 Request processed in 970us (1129us total) trans 103079215105 rc 301/301 00000100:00100000:3.0:1784189084.283094:0:66169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1138 00000100:00100000:3.0:1784189084.287607:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1784189084.292561:0:66171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436250752 00000100:00100000:1.0:1784189084.292575:0:66171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436250752 00000100:00100000:1.0:1784189084.292648:0:66171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1139 00000100:00100000:1.0:1784189084.292658:0:66171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc05ed3ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+9:67199:x1870854436250752:12345-192.168.203.12@tcp:34:lfs.0 00010000:00010000:1.0:1784189084.292733:0:66171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0565e7c00/0xcc1762b626f8af5b lrc: 3/1,0 mode: --/CR res: [0x20000a811:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189084.292750:0:66171:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0565e7c00/0xcc1762b626f8af5b lrc: 3/1,0 mode: CR/CR res: [0x20000a811:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189084.292763:0:66171:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0565e7c00/0xcc1762b626f8af5b lrc: 3/1,0 mode: CR/CR res: [0x20000a811:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189084.292778:0:66171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0565e6600/0xcc1762b626f8af62 lrc: 3/1,0 mode: --/PR res: [0x20000a811:0x3:0x0].0xfa0fa5c1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189084.292802:0:66171:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0565e6600/0xcc1762b626f8af62 lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189084.292823:0:66171:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0565e6600/0xcc1762b626f8af62 lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189084.292908:0:66171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0565e6400/0xcc1762b626f8af69 lrc: 3/1,0 mode: --/PR res: [0x20000a811:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189084.292917:0:66171:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0565e6400/0xcc1762b626f8af69 lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189084.292924:0:66171:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0565e6400/0xcc1762b626f8af69 lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784189084.292964:0:66171:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1784189084.292978:0:66171:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0565e6400/0xcc1762b626f8af69 lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189084.292991:0:66171:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0565e7c00/0xcc1762b626f8af5b lrc: 4/1,0 mode: CR/CR res: [0x20000a811:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189084.292997:0:66171:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0565e7c00/0xcc1762b626f8af5b lrc: 4/1,0 mode: CR/CR res: [0x20000a811:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189084.293003:0:66171:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0565e7c00/0xcc1762b626f8af5b lrc: 3/0,0 mode: CR/CR res: [0x20000a811:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189084.293009:0:66171:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0565e7c00/0xcc1762b626f8af5b lrc: 4/0,0 mode: CR/CR res: [0x20000a811:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189084.293015:0:66171:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc0565e7c00 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:1.0:1784189084.293026:0:66171:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0565e7c00/0xcc1762b626f8af5b lrc: 4/0,0 mode: CR/CR res: [0x20000a811:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189084.293034:0:66171:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0565e7c00/0xcc1762b626f8af5b lrc: 5/0,0 mode: CR/CR res: [0x20000a811:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189084.293046:0:66171:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x3:0x0].0x0 (ffff9dc07135fb00) 00010000:00010000:1.0:1784189084.293049:0:66171:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784189084.293054:0:66171:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0565e7c00/0xcc1762b626f8af5b lrc: 3/0,0 mode: --/CR res: [0x20000a811:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189084.293061:0:66171:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0565e7c00/0xcc1762b626f8af5b lrc: 0/0,0 mode: --/CR res: [0x20000a811:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189084.293075:0:66171:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0565e6600/0xcc1762b626f8af62 lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189084.293081:0:66171:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0565e6600/0xcc1762b626f8af62 lrc: 2/0,0 mode: PR/PR res: [0x20000a811:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189084.293087:0:66171:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0565e6600/0xcc1762b626f8af62 lrc: 3/0,0 mode: PR/PR res: [0x20000a811:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189084.293092:0:66171:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc0565e6600 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:1.0:1784189084.293095:0:66171:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0565e6600/0xcc1762b626f8af62 lrc: 3/0,0 mode: PR/PR res: [0x20000a811:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189084.293102:0:66171:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0565e6600/0xcc1762b626f8af62 lrc: 4/0,0 mode: PR/PR res: [0x20000a811:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189084.293111:0:66171:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x3:0x0].0xfa0fa5c1 (ffff9dc0455f8800) 00010000:00010000:1.0:1784189084.293114:0:66171:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784189084.293124:0:66171:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0565e6600/0xcc1762b626f8af62 lrc: 2/0,0 mode: --/PR res: [0x20000a811:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189084.293130:0:66171:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0565e6600/0xcc1762b626f8af62 lrc: 0/0,0 mode: --/PR res: [0x20000a811:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189084.293146:0:66171:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0565e6400/0xcc1762b626f8af69 lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189084.293152:0:66171:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0565e6400/0xcc1762b626f8af69 lrc: 2/0,0 mode: PR/PR res: [0x20000a811:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189084.293158:0:66171:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0565e6400/0xcc1762b626f8af69 lrc: 3/0,0 mode: PR/PR res: [0x20000a811:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189084.293164:0:66171:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc0565e6400 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:1.0:1784189084.293166:0:66171:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0565e6400/0xcc1762b626f8af69 lrc: 3/0,0 mode: PR/PR res: [0x20000a811:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189084.293172:0:66171:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0565e6400/0xcc1762b626f8af69 lrc: 4/0,0 mode: PR/PR res: [0x20000a811:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189084.293180:0:66171:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x5:0x0].0x0 (ffff9dc0455f8000) 00010000:00010000:1.0:1784189084.293182:0:66171:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784189084.293185:0:66171:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0565e6400/0xcc1762b626f8af69 lrc: 2/0,0 mode: --/PR res: [0x20000a811:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189084.293191:0:66171:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0565e6400/0xcc1762b626f8af69 lrc: 0/0,0 mode: --/PR res: [0x20000a811:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784189084.293281:0:66171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc05ed3ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+9:67199:x1870854436250752:12345-192.168.203.12@tcp:34:lfs.0 Request processed in 623us (5680us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189084.293291:0:66171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1139 00000100:00100000:0.0:1784189084.296934:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1784189084.297036:0:66173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436251008 00000100:00100000:2.0:1784189084.297044:0:66173:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436251008 00000100:00100000:2.0:1784189084.297103:0:66173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 220 00000100:00100000:2.0:1784189084.297112:0:66173:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf46956300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+9:67199:x1870854436251008:12345-192.168.203.12@tcp:35:lfs.0 00000100:00100000:2.0:1784189084.297350:0:66173:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf46956300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+10:67199:x1870854436251008:12345-192.168.203.12@tcp:35:lfs.0 Request processed in 207us (393us total) trans 103079215106 rc 0/0 00000100:00100000:2.0:1784189084.297359:0:66173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 220 00010000:00010000:3.0:1784189084.399620:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784189084.719721:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf469b5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1870854458075136:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1784189084.719797:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784189084.719949:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458075136 00000100:00100000:2.0:1784189084.719956:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458075136 00000100:00100000:2.0:1784189084.720014:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1900 00000100:00100000:2.0:1784189084.720023:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc06b98d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1870854458075136:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1784189084.720046:0:8432:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8650560 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1784189084.720107:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc06b98d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1870854458075136:12345-0@lo:13:osp-pre-0-1.0 Request processed in 85us (309us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189084.720114:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1900 00000100:00100000:1.0:1784189084.720241:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf469b5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1870854458075136:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1784189084.720386:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf46957480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1870854458075264:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1784189084.720416:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784189084.720896:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458075264 00000100:00100000:2.0:1784189084.720901:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458075264 00000100:00100000:2.0:1784189084.720935:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1901 00000100:00100000:2.0:1784189084.720942:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf44bc2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1870854458075264:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1784189084.720957:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8650560 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1784189084.721022:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf44bc2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1870854458075264:12345-0@lo:13:osp-pre-1-1.0 Request processed in 80us (604us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189084.721029:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1901 00000100:00100000:1.0:1784189084.721102:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf46957480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1870854458075264:0@lo:13:osp-pre-1-1.0 00010000:00010000:1.0:1784189085.424852:0:7454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784189086.450771:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784189087.471494:0:26173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784189088.497149:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784189088.816739:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc05ed38a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3643:1870854458075520:0@lo:400:kworker.0 00000100:00100000:3.0:1784189088.816847:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784189088.816883:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc05ed3a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1870854458076032:0@lo:400:kworker.0 00000100:00100000:3.0:1784189088.816923:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784189088.816944:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf46900a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1870854458076544:0@lo:400:kworker.0 00000100:00100000:3.0:1784189088.816966:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784189088.816994:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [2->3] 00000100:00100000:3.0:1784189088.817000:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc05ed38700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:bd553d0d-03e2-4233-b06b-b55bbfa2b954:3643:1870854458075392:0@lo:400:kworker.0 00000100:00100000:3.0:1784189088.817030:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784189088.817059:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc05ed39c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3643:1870854458075904:0@lo:400:kworker.0 00000100:00100000:3.0:1784189088.817083:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784189088.817101:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf46902300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3643:1870854458076416:0@lo:400:kworker.0 00000100:00100000:3.0:1784189088.817121:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784189088.817136:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf46902d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3643:1870854458076928:0@lo:400:kworker.0 00000100:00100000:3.0:1784189088.817156:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784189088.817202:0:23826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458076032 00000100:00100000:3.0:1784189088.817211:0:23826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458076032 00000100:00100000:3.0:1784189088.817260:0:23826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458076544 00000100:00100000:3.0:1784189088.817264:0:23826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458076544 00000100:00100000:3.0:1784189088.817291:0:23826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3750 00000100:00100000:3.0:1784189088.817300:0:23826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf46902a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3643:x1870854458076032:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784189088.817391:0:23826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf46902a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3643:x1870854458076032:12345-0@lo:400:kworker.0 Request processed in 91us (466us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189088.817400:0:23826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3750 00000100:00100000:3.0:1784189088.817420:0:23826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3751 00000100:00100000:3.0:1784189088.817427:0:23826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf46900000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3643:x1870854458076544:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784189088.817457:0:23826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf46900000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3643:x1870854458076544:12345-0@lo:400:kworker.0 Request processed in 30us (489us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189088.817462:0:23826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3751 00000100:00100000:3.0:1784189088.817482:0:87026:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458075392 00000100:00100000:3.0:1784189088.817485:0:87026:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458075392 00000100:00100000:3.0:1784189088.817513:0:87026:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1784189088.817520:0:87026:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc07037c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd553d0d-03e2-4233-b06b-b55bbfa2b954+24:3643:x1870854458075392:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784189088.817550:0:87026:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc07037c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd553d0d-03e2-4233-b06b-b55bbfa2b954+24:3643:x1870854458075392:12345-0@lo:400:kworker.0 Request processed in 30us (518us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189088.817556:0:87026:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1784189088.817587:0:68287:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458075520 00000100:00100000:3.0:1784189088.817590:0:68287:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458075520 00000100:00100000:3.0:1784189088.817632:0:68287:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458075904 00000100:00100000:3.0:1784189088.817635:0:68287:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458075904 00000100:00100000:3.0:1784189088.817649:0:68287:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458076416 00000100:00100000:3.0:1784189088.817651:0:68287:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458076416 00000100:00100000:3.0:1784189088.817663:0:68287:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458076928 00000100:00100000:3.0:1784189088.817665:0:68287:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458076928 00000100:00100000:3.0:1784189088.817690:0:68287:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1081 00000100:00100000:3.0:1784189088.817696:0:68287:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf46901500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1870854458075520:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784189088.817727:0:68287:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf46901500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1870854458075520:12345-0@lo:400:kworker.0 Request processed in 31us (881us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189088.817733:0:68287:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1081 00000100:00100000:3.0:1784189088.817746:0:68287:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1082 00000100:00100000:3.0:1784189088.817752:0:68287:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf46903800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1870854458075904:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784189088.817794:0:68287:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf46903800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1870854458075904:12345-0@lo:400:kworker.0 Request processed in 42us (711us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189088.817801:0:68287:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1082 00000100:00100000:3.0:1784189088.817813:0:68287:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1083 00000100:00100000:3.0:1784189088.817819:0:68287:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf46900e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1870854458076416:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784189088.817845:0:68287:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf46900e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1870854458076416:12345-0@lo:400:kworker.0 Request processed in 26us (723us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189088.817851:0:68287:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1083 00000100:00100000:3.0:1784189088.817862:0:68287:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1084 00000100:00100000:3.0:1784189088.817869:0:68287:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf46903b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1870854458076928:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784189088.817895:0:68287:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf46903b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1870854458076928:12345-0@lo:400:kworker.0 Request processed in 26us (738us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189088.817900:0:68287:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1084 00000100:00080000:3.0:1784189088.817930:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1784189088.817935:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1784189088.817972:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc05ed38700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:bd553d0d-03e2-4233-b06b-b55bbfa2b954:3643:1870854458075392:0@lo:400:kworker.0 00000100:00100000:3.0:1784189088.817989:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc05ed39c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3643:1870854458075904:0@lo:400:kworker.0 00000100:00100000:3.0:1784189088.818000:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf46902300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3643:1870854458076416:0@lo:400:kworker.0 00000100:00100000:3.0:1784189088.818021:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf46902d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3643:1870854458076928:0@lo:400:kworker.0 00000100:00100000:3.0:1784189088.818032:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc05ed38a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3643:1870854458075520:0@lo:400:kworker.0 00000100:00100000:3.0:1784189088.818042:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc05ed3a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1870854458076032:0@lo:400:kworker.0 00000100:00100000:3.0:1784189088.818053:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf46900a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1870854458076544:0@lo:400:kworker.0 00000100:00100000:1.0:1784189088.818354:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc05ed38e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3640:1870854458075648:0@lo:400:kworker.0 00000100:00100000:1.0:1784189088.818398:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784189088.818424:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc05ed3b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1870854458076160:0@lo:400:kworker.0 00000100:00100000:1.0:1784189088.818454:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784189088.818476:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf46901880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1870854458076672:0@lo:400:kworker.0 00000100:00100000:1.0:1784189088.818499:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784189088.818524:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1784189088.818531:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc05ed38000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3640:1870854458075776:0@lo:400:kworker.0 00000100:00100000:1.0:1784189088.818554:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784189088.818573:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf46901180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1870854458076288:0@lo:400:kworker.0 00000100:00100000:1.0:1784189088.818595:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784189088.818615:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf46901f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1870854458076800:0@lo:400:kworker.0 00000100:00100000:1.0:1784189088.818638:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784189088.818682:0:66171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458075648 00000100:00100000:1.0:1784189088.818687:0:66171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458075648 00000100:00100000:1.0:1784189088.818731:0:66171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458075776 00000100:00100000:1.0:1784189088.818735:0:66171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458075776 00000100:00100000:1.0:1784189088.818751:0:66171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1085 00000100:00100000:1.0:1784189088.818757:0:66171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc06b98c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1870854458075648:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784189088.818807:0:66171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc06b98c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1870854458075648:12345-0@lo:400:kworker.0 Request processed in 50us (409us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189088.818823:0:66171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1085 00000100:00100000:1.0:1784189088.818839:0:66171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1086 00000100:00100000:1.0:1784189088.818844:0:66171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc06b98c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3640:x1870854458075776:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784189088.818869:0:66171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc06b98c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3640:x1870854458075776:12345-0@lo:400:kworker.0 Request processed in 26us (314us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189088.818874:0:66171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1086 00000100:00100000:1.0:1784189088.818896:0:26171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458076160 00000100:00100000:1.0:1784189088.818899:0:26171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458076160 00000100:00100000:1.0:1784189088.818933:0:26171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458076672 00000100:00100000:1.0:1784189088.818936:0:26171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458076672 00000100:00100000:1.0:1784189088.818951:0:26171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458076288 00000100:00100000:1.0:1784189088.818953:0:26171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458076288 00000100:00100000:1.0:1784189088.818968:0:26171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458076800 00000100:00100000:1.0:1784189088.818970:0:26171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458076800 00000100:00100000:1.0:1784189088.818985:0:26171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2373 00000100:00100000:1.0:1784189088.818990:0:26171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc06b98e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0001-mdtlov_UUID+5:3640:x1870854458076160:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784189088.819017:0:26171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc06b98e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0001-mdtlov_UUID+5:3640:x1870854458076160:12345-0@lo:400:kworker.0 Request processed in 27us (563us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189088.819023:0:26171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2373 00000100:00100000:1.0:1784189088.819032:0:26171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2374 00000100:00100000:1.0:1784189088.819037:0:26171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc06b98dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+5:3640:x1870854458076672:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784189088.819060:0:26171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc06b98dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+5:3640:x1870854458076672:12345-0@lo:400:kworker.0 Request processed in 23us (561us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189088.819066:0:26171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2374 00000100:00100000:1.0:1784189088.819074:0:26171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2375 00000100:00100000:1.0:1784189088.819079:0:26171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf46957480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0001-mdtlov_UUID+5:3640:x1870854458076288:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784189088.819110:0:26171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf46957480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0001-mdtlov_UUID+5:3640:x1870854458076288:12345-0@lo:400:kworker.0 Request processed in 31us (515us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189088.819117:0:26171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2375 00000100:00100000:1.0:1784189088.819126:0:26171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2376 00000100:00100000:1.0:1784189088.819131:0:26171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf4367d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+5:3640:x1870854458076800:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784189088.819149:0:26171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf4367d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+5:3640:x1870854458076800:12345-0@lo:400:kworker.0 Request processed in 19us (511us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189088.819154:0:26171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2376 00000100:00080000:1.0:1784189088.819193:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1784189088.819197:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1784189088.819199:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1784189088.819201:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1784189088.819227:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc05ed38000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3640:1870854458075776:0@lo:400:kworker.0 00000100:00100000:1.0:1784189088.819237:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf46901180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1870854458076288:0@lo:400:kworker.0 00000100:00100000:1.0:1784189088.819245:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf46901f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1870854458076800:0@lo:400:kworker.0 00000100:00100000:1.0:1784189088.819254:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc05ed38e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3640:1870854458075648:0@lo:400:kworker.0 00000100:00100000:1.0:1784189088.819262:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc05ed3b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1870854458076160:0@lo:400:kworker.0 00000100:00100000:1.0:1784189088.819270:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf46901880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1870854458076672:0@lo:400:kworker.0 00000100:00100000:0.0:1784189088.819439:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1784189088.819454:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc06b98e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1870854458077056:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1784189088.819493:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784189088.819698:0:23826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458077056 00000100:00100000:1.0:1784189088.819704:0:23826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458077056 00000100:00100000:1.0:1784189088.819741:0:23826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3752 00000100:00100000:1.0:1784189088.819749:0:23826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf44bc3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3642:x1870854458077056:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1784189088.819794:0:23826:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445576704 avail 1299337216 00000100:00100000:1.0:1784189088.819838:0:23826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf44bc3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3642:x1870854458077056:12345-0@lo:41:osp-pre-1-0.0 Request processed in 89us (344us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189088.819853:0:23826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3752 00000100:00100000:0.0:1784189088.819929:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc06b98e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1870854458077056:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1784189089.072110:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1784189089.072170:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1784189089.072203:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1784189089.072250:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1784189089.072285:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1784189089.072361:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436251648 00000100:00100000:3.0:1784189089.072372:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436251648 00000100:00100000:3.0:1784189089.072441:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436251520 00000100:00100000:3.0:1784189089.072445:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436251520 00000100:00100000:3.0:1784189089.072479:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 2377 00000100:00100000:3.0:1784189089.072491:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf46902300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+5:2396:x1870854436251648:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:3.0:1784189089.072593:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf46902300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+5:2396:x1870854436251648:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 105us (341us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189089.072602:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 2377 00000100:00100000:3.0:1784189089.072621:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 2378 00000100:00100000:3.0:1784189089.072628:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf46902680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+5:2397:x1870854436251520:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:0.0:1784189089.072768:0:87034:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436251136 00000100:00100000:0.0:1784189089.072784:0:87034:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436251136 00000100:00100000:0.0:1784189089.072823:0:87034:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 78 00000100:00100000:0.0:1784189089.072831:0:87034:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc07037f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:9957a2dc-fd88-4a91-bca3-e2b7f365ab0c+10:2396:x1870854436251136:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:0.0:1784189089.072877:0:87034:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc07037f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:9957a2dc-fd88-4a91-bca3-e2b7f365ab0c+10:2396:x1870854436251136:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 47us (707us total) trans 0 rc 0/0 00000100:00100000:0.0:1784189089.072886:0:87034:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 78 00000100:00100000:3.0:1784189089.073375:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf46902680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+5:2397:x1870854436251520:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 28us (369us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189089.073386:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 2378 00000100:00100000:2.0:1784189089.073466:0:66945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436251264 00000100:00100000:2.0:1784189089.073472:0:66945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436251264 00000100:00100000:2.0:1784189089.073517:0:66945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436251392 00000100:00100000:2.0:1784189089.073521:0:66945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436251392 00000100:00100000:2.0:1784189089.073555:0:66945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1087 00000100:00100000:2.0:1784189089.073565:0:66945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf46900a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+10:2397:x1870854436251264:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:2.0:1784189089.073627:0:66945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf46900a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+10:2397:x1870854436251264:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 64us (1531us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189089.073635:0:66945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1087 00000100:00100000:2.0:1784189089.073649:0:66945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1088 00000100:00100000:2.0:1784189089.073784:0:66945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf46902d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+6:2396:x1870854436251392:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:2.0:1784189089.073814:0:66945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf46902d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+6:2396:x1870854436251392:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 159us (1609us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189089.073821:0:66945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1088 00000100:00080000:1.0:1784189089.073894:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1784189089.073899:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1784189089.073902:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1784189089.073906:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1784189089.327687:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1784189089.327734:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf469b7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1870854458077184:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1784189089.327831:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784189089.328045:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf469b6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1870854458077312:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1784189089.328078:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784189089.328111:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458077312 00000100:00100000:2.0:1784189089.328119:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458077312 00000100:00100000:2.0:1784189089.328175:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3753 00000100:00100000:2.0:1784189089.328183:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf469b5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3641:x1870854458077312:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1784189089.328235:0:8439:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445285888 avail 1299046400 00000100:00100000:2.0:1784189089.328281:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf469b5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3641:x1870854458077312:12345-0@lo:41:osp-pre-0-1.0 Request processed in 98us (202us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189089.328295:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3753 00000100:00100000:2.0:1784189089.328374:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf469b6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1870854458077312:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1784189089.328525:0:9466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458077184 00000100:00100000:3.0:1784189089.328530:0:9466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458077184 00000100:00100000:3.0:1784189089.328568:0:9466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1902 00000100:00100000:3.0:1784189089.328574:0:9466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf46903480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1870854458077184:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1784189089.328599:0:9466:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8650560 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1784189089.328637:0:9466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf46903480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1870854458077184:12345-0@lo:13:osp-pre-0-0.0 Request processed in 62us (806us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189089.328643:0:9466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1902 00000100:00100000:3.0:1784189089.328733:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf469b7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1870854458077184:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1784189089.329045:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf44bc3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1870854458077440:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1784189089.329085:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784189089.329158:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458077440 00000100:00100000:2.0:1784189089.329163:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458077440 00000100:00100000:2.0:1784189089.329196:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1903 00000100:00100000:2.0:1784189089.329202:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf4367ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1870854458077440:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1784189089.329339:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8650560 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1784189089.329382:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf4367ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1870854458077440:12345-0@lo:13:osp-pre-1-0.0 Request processed in 180us (296us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189089.329388:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1903 00000100:00100000:1.0:1784189089.329500:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf44bc3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1870854458077440:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1784189089.519718:0:7454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784189089.841565:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1784189089.841599:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf469b6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1870854458077568:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1784189089.841697:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784189089.841756:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf44bc2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1870854458077696:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1784189089.841793:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784189089.841873:0:9466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458077568 00000100:00100000:0.0:1784189089.841884:0:9466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458077568 00000100:00100000:0.0:1784189089.841946:0:9466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458077696 00000100:00100000:0.0:1784189089.841949:0:9466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458077696 00000100:00100000:0.0:1784189089.841968:0:9466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1904 00000100:00100000:0.0:1784189089.841978:0:9466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc071534000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1870854458077568:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1784189089.842007:0:9466:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8650560 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1784189089.842061:0:9466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc071534000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1870854458077568:12345-0@lo:13:osp-pre-0-1.0 Request processed in 84us (363us total) trans 0 rc 0/0 00000100:00100000:0.0:1784189089.842070:0:9466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1904 00000100:00100000:0.0:1784189089.842103:0:9466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1905 00000100:00100000:0.0:1784189089.842111:0:9466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc071534e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1870854458077696:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1784189089.842122:0:9466:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8650560 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1784189089.842152:0:9466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc071534e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1870854458077696:12345-0@lo:13:osp-pre-1-1.0 Request processed in 42us (359us total) trans 0 rc 0/0 00000100:00100000:0.0:1784189089.842158:0:9466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1905 00000100:00100000:1.0:1784189089.842381:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf44bc2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1870854458077696:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1784189089.842418:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf469b6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1870854458077568:0@lo:13:osp-pre-0-1.0 00000001:00080000:0.0:1784189089.844623:0:87022:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 103079215106 is committed 00000001:02000400:0.0:1784189090.416116:0:87848:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == replay-single test 131a: DoM file write lock replay === 04:04:48 (1784189088) 00000100:00100000:3.0:1784189090.509901:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1784189090.510011:0:66170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436251776 00000100:00100000:1.0:1784189090.510025:0:66170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436251776 00000100:00100000:1.0:1784189090.510108:0:66170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1140 00000100:00100000:1.0:1784189090.510121:0:66170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf46900700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+8:67788:x1870854436251776:12345-192.168.203.12@tcp:101:lfs.0 00010000:00010000:1.0:1784189090.510148:0:66170:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784189090.510173:0:66170:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0565e7c00/0xcc1762b626f8af70 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbfc5de7fe6c3d6f expref: -99 pid: 66170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189090.510276:0:66170:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0565e7000/0xcc1762b626f8af77 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189090.510307:0:66170:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0565e7000/0xcc1762b626f8af77 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189090.510340:0:66170:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0565e7000/0xcc1762b626f8af77 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189090.510360:0:66170:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0565e7200/0xcc1762b626f8af7e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc958f637 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189090.510368:0:66170:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0565e7200/0xcc1762b626f8af7e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc958f637 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189090.510375:0:66170:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0565e7200/0xcc1762b626f8af7e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc958f637 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189090.510430:0:66170:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0565e7000/0xcc1762b626f8af77 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189090.510437:0:66170:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0565e7000/0xcc1762b626f8af77 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189090.510444:0:66170:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0565e7000/0xcc1762b626f8af77 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189090.510452:0:66170:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0565e7000/0xcc1762b626f8af77 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189090.510459:0:66170:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc0565e7000 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:1.0:1784189090.510463:0:66170:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0565e7000/0xcc1762b626f8af77 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189090.510471:0:66170:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0565e7000/0xcc1762b626f8af77 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189090.510492:0:66170:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9dc07135f300) 00010000:00010000:1.0:1784189090.510495:0:66170:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784189090.510500:0:66170:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0565e7000/0xcc1762b626f8af77 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189090.510507:0:66170:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0565e7000/0xcc1762b626f8af77 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189090.510521:0:66170:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0565e7200/0xcc1762b626f8af7e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc958f637 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189090.510527:0:66170:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0565e7200/0xcc1762b626f8af7e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc958f637 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189090.510533:0:66170:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0565e7200/0xcc1762b626f8af7e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc958f637 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189090.510538:0:66170:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc0565e7200 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:1.0:1784189090.510542:0:66170:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0565e7200/0xcc1762b626f8af7e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc958f637 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189090.510548:0:66170:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0565e7200/0xcc1762b626f8af7e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc958f637 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189090.510555:0:66170:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xc958f637 (ffff9dc0455f8100) 00010000:00010000:1.0:1784189090.510557:0:66170:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784189090.510560:0:66170:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0565e7200/0xcc1762b626f8af7e lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc958f637 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189090.510566:0:66170:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0565e7200/0xcc1762b626f8af7e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc958f637 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189090.510612:0:66170:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0565e7c00/0xcc1762b626f8af70 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c3d6f expref: 9 pid: 66170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189090.510623:0:66170:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9dc07135f300) 00010000:00010000:1.0:1784189090.510626:0:66170:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784189090.510629:0:66170:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0565e7c00/0xcc1762b626f8af70 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c3d6f expref: 9 pid: 66170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189090.510639:0:66170:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc0565e7c00, rc 0) 00000100:00100000:1.0:1784189090.510799:0:66170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf46900700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+8:67788:x1870854436251776:12345-192.168.203.12@tcp:101:lfs.0 Request processed in 603us (834us total) trans 0 rc 301/301 00000100:00100000:1.0:1784189090.510810:0:66170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1140 00000100:00100000:3.0:1784189090.513157:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1784189090.514568:0:66945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436252032 00000100:00100000:1.0:1784189090.514583:0:66945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436252032 00000100:00100000:1.0:1784189090.514670:0:66945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1141 00000100:00100000:1.0:1784189090.514683:0:66945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf46900380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+8:67788:x1870854436252032:12345-192.168.203.12@tcp:101:lfs.0 00010000:00010000:1.0:1784189090.514711:0:66945:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784189090.514716:0:66945:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1784189090.514750:0:66945:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4369ce00/0xcc1762b626f8af07 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c3d53 expref: 8 pid: 66171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189090.514784:0:66945:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9dc07135f300) 00010000:00010000:1.0:1784189090.514799:0:66945:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1784189090.514821:0:66945:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0565e6c00/0xcc1762b626f8af85 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbfc5de7fe6c3d76 expref: -99 pid: 66945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189090.514970:0:66945:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0565e6600/0xcc1762b626f8af8c lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189090.514986:0:66945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0565e6600/0xcc1762b626f8af8c lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189090.514997:0:66945:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0565e6600/0xcc1762b626f8af8c lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189090.515011:0:66945:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0565e6400/0xcc1762b626f8af93 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xc958f637 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189090.515019:0:66945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0565e6400/0xcc1762b626f8af93 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xc958f637 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189090.515026:0:66945:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0565e6400/0xcc1762b626f8af93 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xc958f637 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189090.518847:0:66945:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0565e6200/0xcc1762b626f8af9a lrc: 3/1,0 mode: --/PR res: [0x20000a811:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189090.518880:0:66945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0565e6200/0xcc1762b626f8af9a lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189090.518895:0:66945:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0565e6200/0xcc1762b626f8af9a lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784189090.518911:0:66945:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000a811:0x6:0x0]: returning size 0 00010000:00010000:1.0:1784189090.518946:0:66945:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0565e6600/0xcc1762b626f8af8c lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189090.518955:0:66945:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0565e6600/0xcc1762b626f8af8c lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189090.518970:0:66945:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0565e6600/0xcc1762b626f8af8c lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189090.518978:0:66945:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0565e6600/0xcc1762b626f8af8c lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189090.518985:0:66945:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc0565e6600 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:1.0:1784189090.518990:0:66945:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0565e6600/0xcc1762b626f8af8c lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189090.518998:0:66945:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0565e6600/0xcc1762b626f8af8c lrc: 5/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189090.519012:0:66945:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9dc0455f8300) 00010000:00010000:1.0:1784189090.519015:0:66945:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784189090.519021:0:66945:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0565e6600/0xcc1762b626f8af8c lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189090.519027:0:66945:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0565e6600/0xcc1762b626f8af8c lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1784189090.519047:0:66945:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000095dda398 reply state 000000004c1df1ee transno 103079215107 ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0565e6400/0xcc1762b626f8af93 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xc958f637 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189090.519059:0:66945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0565e6400/0xcc1762b626f8af93 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xc958f637 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189090.519066:0:66945:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xc958f637 (ffff9dc0455f8500) 00010000:00010000:1.0:1784189090.519069:0:66945:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1784189090.519073:0:66945:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1784189090.519122:0:66945:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0565e6c00/0xcc1762b626f8af85 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c3d76 expref: 10 pid: 66945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189090.519647:0:66945:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0565e6200/0xcc1762b626f8af9a lrc: 3/0,0 mode: PR/PR res: [0x20000a811:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c3d76 expref: 9 pid: 66945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189090.519657:0:66945:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x6:0x0].0x0 (ffff9dc0455f8d00) 00010000:00010000:1.0:1784189090.519660:0:66945:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1784189090.519662:0:66945:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc0565e6200, rc 0) 00000100:00100000:1.0:1784189090.519779:0:66945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf46900380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+10:67788:x1870854436252032:12345-192.168.203.12@tcp:101:lfs.0 Request processed in 5099us (6633us total) trans 103079215107 rc 0/0 00000100:00100000:1.0:1784189090.519789:0:66945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1141 00000100:00100000:3.0:1784189090.527714:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1784189090.527805:0:66169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436252288 00000100:00100000:0.0:1784189090.527819:0:66169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436252288 00000100:00100000:0.0:1784189090.527895:0:66169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1142 00000100:00100000:0.0:1784189090.527908:0:66169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf46903100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+10:67788:x1870854436252288:12345-192.168.203.12@tcp:101:lfs.0 00010000:00010000:0.0:1784189090.527943:0:66169:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784189090.527989:0:66169:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4369da00/0xcc1762b626f8afa8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbfc5de7fe6c3d7d expref: -99 pid: 66169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189090.528131:0:66169:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4369d800/0xcc1762b626f8afaf lrc: 3/0,1 mode: --/EX res: [0x20000a811:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189090.528149:0:66169:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0565e6200/0xcc1762b626f8af9a lrc: 2/0,0 mode: PR/PR res: [0x20000a811:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c3d76 expref: 11 pid: 66945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189090.528160:0:66169:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4369d800/0xcc1762b626f8afaf lrc: 4/0,1 mode: --/EX res: [0x20000a811:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189090.528200:0:66169:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0565e6200/0xcc1762b626f8af9a lrc: 3/0,0 mode: PR/PR res: [0x20000a811:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c3d76 expref: 11 pid: 66945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189090.528214:0:66169:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0565e6200/0xcc1762b626f8af9a lrc: 4/0,0 mode: PR/PR res: [0x20000a811:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c3d76 expref: 11 pid: 66945 timeout: 3432 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784189090.528229:0:66169:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf44bc2a00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:66169:1870854458077824:192.168.203.12@tcp:104: 00000100:00100000:0.0:1784189090.528355:0:66169:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dc0718de240 going to sleep for 11 seconds 00000100:00100000:1.0:1784189090.532551:0:66169:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf44bc2a00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:66169:1870854458077824:192.168.203.12@tcp:104: 00010000:00010000:1.0:1784189090.532597:0:66169:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4369d800/0xcc1762b626f8afaf lrc: 3/0,1 mode: --/EX res: [0x20000a811:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784189090.532772:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1784189090.533194:0:26172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436252416 00000100:00100000:1.0:1784189090.533204:0:26172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436252416 00010000:00010000:1.0:1784189090.533246:0:26172:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0565e6200/0xcc1762b626f8af9a lrc: 4/0,0 mode: PR/PR res: [0x20000a811:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c3d76 expref: 12 pid: 66945 timeout: 3432 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784189090.533290:0:26172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 2542 00000100:00100000:1.0:1784189090.533301:0:26172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf46901880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+12:2396:x1870854436252416:12345-192.168.203.12@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1784189090.533397:0:26172:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784189090.533406:0:26172:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0565e6200/0xcc1762b626f8af9a lrc: 4/0,0 mode: PR/PR res: [0x20000a811:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c3d76 expref: 12 pid: 66945 timeout: 3432 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189090.533420:0:26172:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0565e6200/0xcc1762b626f8af9a lrc: 3/0,0 mode: PR/PR res: [0x20000a811:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c3d76 expref: 12 pid: 66945 timeout: 3432 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189090.533757:0:26172:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0565e6200/0xcc1762b626f8af9a lrc: 0/0,0 mode: --/PR res: [0x20000a811:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c3d76 expref: 12 pid: 66945 timeout: 3432 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189090.533784:0:26172:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x6:0x0].0x0 (ffff9dc0455f8d00) 00010000:00010000:1.0:1784189090.533790:0:26172:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4369d800/0xcc1762b626f8afaf lrc: 3/0,1 mode: --/EX res: [0x20000a811:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189090.533801:0:26172:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4369d800/0xcc1762b626f8afaf lrc: 3/0,1 mode: EX/EX res: [0x20000a811:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189090.533809:0:26172:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4369d800/0xcc1762b626f8afaf lrc: 4/0,1 mode: EX/EX res: [0x20000a811:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189090.533879:0:26172:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784189090.533954:0:26172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf46901880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+11:2396:x1870854436252416:12345-192.168.203.12@tcp:103:ldlm_bl.0 Request processed in 653us (1192us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189090.533962:0:26172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 2542 00010000:00010000:2.0:1784189090.534198:0:66169:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4369d800/0xcc1762b626f8afaf lrc: 3/0,1 mode: EX/EX res: [0x20000a811:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189090.534209:0:66169:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4369d800/0xcc1762b626f8afaf lrc: 3/0,1 mode: EX/EX res: [0x20000a811:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784189090.534233:0:66169:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000a811:0x6:0x0]: returning size 0 00010000:00010000:2.0:1784189090.534809:0:66169:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4369d800/0xcc1762b626f8afaf lrc: 3/0,1 mode: EX/EX res: [0x20000a811:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189090.534820:0:66169:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4369d800/0xcc1762b626f8afaf lrc: 2/0,0 mode: EX/EX res: [0x20000a811:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189090.534828:0:66169:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4369d800/0xcc1762b626f8afaf lrc: 3/0,0 mode: EX/EX res: [0x20000a811:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189090.534835:0:66169:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dbf4369d800 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:2.0:1784189090.534840:0:66169:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4369d800/0xcc1762b626f8afaf lrc: 3/0,0 mode: EX/EX res: [0x20000a811:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189090.534863:0:66169:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4369d800/0xcc1762b626f8afaf lrc: 4/0,0 mode: EX/EX res: [0x20000a811:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189090.534876:0:66169:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x6:0x0].0x0 (ffff9dc0455f8d00) 00010000:00010000:2.0:1784189090.534879:0:66169:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1784189090.534883:0:66169:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4369d800/0xcc1762b626f8afaf lrc: 2/0,0 mode: --/EX res: [0x20000a811:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189090.534894:0:66169:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4369d800/0xcc1762b626f8afaf lrc: 0/0,0 mode: --/EX res: [0x20000a811:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189090.534958:0:66169:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4369da00/0xcc1762b626f8afa8 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c3d7d expref: 11 pid: 66169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189090.534969:0:66169:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9dc071128000) 00010000:00010000:2.0:1784189090.534971:0:66169:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1784189090.534975:0:66169:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4369da00/0xcc1762b626f8afa8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c3d7d expref: 11 pid: 66169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189090.534989:0:66169:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dbf4369da00, rc 0) 00000100:00100000:2.0:1784189090.535048:0:66169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf46903100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+10:67788:x1870854436252288:12345-192.168.203.12@tcp:101:lfs.0 Request processed in 7142us (7344us total) trans 103079215108 rc 301/301 00000100:00100000:2.0:1784189090.535057:0:66169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1142 00000100:00100000:3.0:1784189090.538057:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1784189090.539521:0:66172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436252672 00000100:00100000:2.0:1784189090.539537:0:66172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436252672 00000100:00100000:2.0:1784189090.539629:0:66172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 221 00000100:00100000:2.0:1784189090.539641:0:66172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf46901f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+10:67788:x1870854436252672:12345-192.168.203.12@tcp:35:lfs.0 00000100:00100000:2.0:1784189090.539965:0:66172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf46901f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+11:67788:x1870854436252672:12345-192.168.203.12@tcp:35:lfs.0 Request processed in 324us (1920us total) trans 103079215109 rc 0/0 00000100:00100000:2.0:1784189090.539982:0:66172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 221 00010000:00010000:2.0:1784189090.544540:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784189090.545753:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1784189090.545835:0:66172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436252928 00000100:00100000:2.0:1784189090.545848:0:66172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436252928 00000100:00100000:2.0:1784189090.545922:0:66172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 222 00000100:00100000:2.0:1784189090.545934:0:66172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc045a5d850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+11:67788:x1870854436252928:12345-192.168.203.12@tcp:35:lfs.0 00000100:00100000:2.0:1784189090.546239:0:66172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc045a5d850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+12:67788:x1870854436252928:12345-192.168.203.12@tcp:35:lfs.0 Request processed in 306us (496us total) trans 103079215110 rc 0/0 00000100:00100000:2.0:1784189090.546249:0:66172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 222 00000001:00080000:0.0:1784189091.426097:0:87022:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 103079215110 is committed 00010000:00010000:2.0:1784189091.426191:0:3626:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0565e6400/0xcc1762b626f8af93 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xc958f637 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189091.426206:0:3626:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0565e6400/0xcc1762b626f8af93 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xc958f637 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189091.426215:0:3626:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0565e6400/0xcc1762b626f8af93 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xc958f637 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189091.426222:0:3626:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc0565e6400 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:2.0:1784189091.426227:0:3626:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0565e6400/0xcc1762b626f8af93 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xc958f637 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189091.426236:0:3626:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0565e6400/0xcc1762b626f8af93 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xc958f637 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189091.426262:0:3626:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xc958f637 (ffff9dc0455f8500) 00010000:00010000:2.0:1784189091.426266:0:3626:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784189091.426271:0:3626:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0565e6400/0xcc1762b626f8af93 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xc958f637 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189091.426308:0:3626:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0565e6400/0xcc1762b626f8af93 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xc958f637 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784189091.480056:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1784189091.480161:0:66170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436253056 00000100:00100000:1.0:1784189091.480175:0:66170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436253056 00000100:00100000:1.0:1784189091.480306:0:66170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1143 00000100:00100000:1.0:1784189091.480347:0:66170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf46901180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+7:67797:x1870854436253056:12345-192.168.203.12@tcp:101:lfs.0 00010000:00010000:1.0:1784189091.480382:0:66170:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784189091.480415:0:66170:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0565e7000/0xcc1762b626f8afbd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbfc5de7fe6c3d84 expref: -99 pid: 66170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189091.480505:0:66170:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0565e6400/0xcc1762b626f8afc4 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189091.480534:0:66170:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0565e6400/0xcc1762b626f8afc4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189091.480549:0:66170:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0565e6400/0xcc1762b626f8afc4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784189091.480610:0:66170:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1784189091.480615:0:66170:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1784189091.480705:0:66170:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0565e6400/0xcc1762b626f8afc4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189091.480735:0:66170:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0565e7000/0xcc1762b626f8afbd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c3d84 expref: 9 pid: 66170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189091.480764:0:66170:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0565e6400/0xcc1762b626f8afc4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c3d84 expref: 8 pid: 66170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189091.480774:0:66170:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9dc0455f8300) 00010000:00010000:1.0:1784189091.480777:0:66170:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1784189091.480781:0:66170:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc0565e6400, rc 0) 00000100:00100000:1.0:1784189091.480860:0:66170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf46901180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+8:67797:x1870854436253056:12345-192.168.203.12@tcp:101:lfs.0 Request processed in 544us (818us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189091.480969:0:66170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1143 00000100:00080000:2.0:1784189091.481035:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1784189091.492451:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1784189091.492492:0:66945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436253184 00000100:00100000:1.0:1784189091.492504:0:66945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436253184 00000100:00100000:1.0:1784189091.492578:0:66945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1144 00000100:00100000:1.0:1784189091.492590:0:66945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc071534380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+8:67797:x1870854436253184:12345-192.168.203.12@tcp:41:lfs.0 00000004:00000024:1.0:1784189091.492653:0:66945:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445285888 avail 1299046400 00000100:00100000:1.0:1784189091.492748:0:66945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc071534380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+8:67797:x1870854436253184:12345-192.168.203.12@tcp:41:lfs.0 Request processed in 160us (306us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189091.492770:0:66945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1144 00000100:00100000:3.0:1784189091.495085:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1784189091.497734:0:66169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436253312 00000100:00100000:0.0:1784189091.497767:0:66169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436253312 00000100:00080000:1.0:1784189091.497820:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1784189091.497875:0:66169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1145 00000100:00100000:0.0:1784189091.497887:0:66169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf46901f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+6:67797:x1870854436253312:12345-192.168.203.12@tcp:41:lfs.0 00000004:00000024:0.0:1784189091.497941:0:66169:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445576704 avail 1299337216 00000100:00100000:0.0:1784189091.498056:0:66169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf46901f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+6:67797:x1870854436253312:12345-192.168.203.12@tcp:41:lfs.0 Request processed in 171us (2982us total) trans 0 rc 0/0 00000100:00100000:0.0:1784189091.498084:0:66169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1145 00000100:00100000:1.0:1784189091.505459:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1784189091.505517:0:9466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436253440 00000100:00100000:0.0:1784189091.505529:0:9466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436253440 00000100:00080000:1.0:1784189091.505678:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1784189091.505767:0:9466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1906 00000100:00100000:0.0:1784189091.505781:0:9466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc071535f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+5:67797:x1870854436253440:12345-192.168.203.12@tcp:13:lfs.0 00002000:00000024:1.0:1784189091.505935:0:9466:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8650560 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1784189091.506026:0:9466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc071535f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+5:67797:x1870854436253440:12345-192.168.203.12@tcp:13:lfs.0 Request processed in 248us (579us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189091.506035:0:9466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1906 00000100:00100000:1.0:1784189091.514666:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1784189091.514827:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436253568 00000100:00100000:0.0:1784189091.514909:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436253568 00000100:00100000:0.0:1784189091.515001:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1907 00000100:00100000:0.0:1784189091.515015:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc071534a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+5:67797:x1870854436253568:12345-192.168.203.12@tcp:13:lfs.0 00002000:00000024:0.0:1784189091.515062:0:8432:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8650560 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1784189091.515162:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc071534a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+5:67797:x1870854436253568:12345-192.168.203.12@tcp:13:lfs.0 Request processed in 149us (511us total) trans 0 rc 0/0 00000100:00100000:0.0:1784189091.515171:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1907 00000100:00080000:1.0:1784189091.515235:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1784189091.574069:0:26173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784189091.604595:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1784189091.604704:0:66170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436253824 00000100:00100000:1.0:1784189091.604718:0:66170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436253824 00000100:00100000:1.0:1784189091.605111:0:66170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1146 00000100:00100000:1.0:1784189091.605125:0:66170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf44bc3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+8:67804:x1870854436253824:12345-192.168.203.12@tcp:36:mcreate.0 00010000:00010000:1.0:1784189091.605203:0:66170:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784189091.605241:0:66170:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0565e6400/0xcc1762b626f8afc4 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c3d84 expref: 8 pid: 66170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189091.605262:0:66170:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9dc0455f8300) 00010000:00010000:1.0:1784189091.605278:0:66170:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1784189091.606558:0:66170:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0565e6600/0xcc1762b626f8afcb lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189091.606582:0:66170:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0565e6600/0xcc1762b626f8afcb lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189091.606613:0:66170:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0565e6600/0xcc1762b626f8afcb lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189091.606628:0:66170:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0565e6c00/0xcc1762b626f8afd2 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x21e7de2f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189091.606646:0:66170:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0565e6c00/0xcc1762b626f8afd2 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x21e7de2f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189091.606655:0:66170:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0565e6c00/0xcc1762b626f8afd2 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x21e7de2f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189091.608596:0:66170:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0565e6600/0xcc1762b626f8afcb lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189091.608616:0:66170:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0565e6600/0xcc1762b626f8afcb lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189091.608624:0:66170:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0565e6600/0xcc1762b626f8afcb lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189091.608633:0:66170:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0565e6600/0xcc1762b626f8afcb lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189091.608652:0:66170:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc0565e6600 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:1.0:1784189091.608658:0:66170:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0565e6600/0xcc1762b626f8afcb lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189091.608667:0:66170:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0565e6600/0xcc1762b626f8afcb lrc: 5/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189091.608687:0:66170:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9dc0455f8100) 00010000:00010000:1.0:1784189091.608704:0:66170:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784189091.608711:0:66170:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0565e6600/0xcc1762b626f8afcb lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189091.608719:0:66170:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0565e6600/0xcc1762b626f8afcb lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1784189091.608745:0:66170:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000fddf9c4a reply state 00000000d1789feb transno 103079215111 ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0565e6c00/0xcc1762b626f8afd2 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x21e7de2f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189091.608773:0:66170:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0565e6c00/0xcc1762b626f8afd2 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x21e7de2f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189091.608782:0:66170:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x21e7de2f (ffff9dc0455f8f00) 00010000:00010000:1.0:1784189091.608784:0:66170:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1784189091.608788:0:66170:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1784189091.608949:0:66170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf44bc3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+9:67804:x1870854436253824:12345-192.168.203.12@tcp:36:mcreate.0 Request processed in 3822us (4359us total) trans 103079215111 rc 0/0 00000100:00100000:1.0:1784189091.608960:0:66170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1146 00000100:00100000:3.0:1784189091.629722:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1784189091.630006:0:68287:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436253952 00000100:00100000:1.0:1784189091.630019:0:68287:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436253952 00000100:00100000:1.0:1784189091.630094:0:68287:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1147 00000100:00100000:1.0:1784189091.630106:0:68287:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc05ed3b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+9:67807:x1870854436253952:12345-192.168.203.12@tcp:101:rm.0 00010000:00010000:1.0:1784189091.630140:0:68287:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784189091.630172:0:68287:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0565e6600/0xcc1762b626f8afd9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbfc5de7fe6c3d8b expref: -99 pid: 68287 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189091.630262:0:68287:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0565e6400/0xcc1762b626f8afe0 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189091.630281:0:68287:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0565e6400/0xcc1762b626f8afe0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189091.630300:0:68287:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0565e6400/0xcc1762b626f8afe0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784189091.631032:0:68287:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1784189091.631039:0:68287:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1784189091.631073:0:68287:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0565e6400/0xcc1762b626f8afe0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189091.631110:0:68287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0565e6600/0xcc1762b626f8afd9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c3d8b expref: 11 pid: 68287 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189091.631130:0:68287:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0565e6400/0xcc1762b626f8afe0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c3d8b expref: 10 pid: 68287 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189091.631140:0:68287:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9dc0455f8100) 00010000:00010000:1.0:1784189091.631144:0:68287:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1784189091.631149:0:68287:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc0565e6400, rc 0) 00000100:00100000:1.0:1784189091.631249:0:68287:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc05ed3b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+10:67807:x1870854436253952:12345-192.168.203.12@tcp:101:rm.0 Request processed in 1144us (1534us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189091.631259:0:68287:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1147 00000100:00100000:3.0:1784189091.638541:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1784189091.638588:0:66171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436254080 00000100:00100000:3.0:1784189091.638600:0:66171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436254080 00000100:00100000:3.0:1784189091.638823:0:66171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1148 00000100:00100000:3.0:1784189091.638837:0:66171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc05ed38e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+10:67807:x1870854436254080:12345-192.168.203.12@tcp:101:rm.0 00010000:00010000:3.0:1784189091.639047:0:66171:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784189091.639078:0:66171:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc05ec0d200/0xcc1762b626f8afe7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbfc5de7fe6c3d92 expref: -99 pid: 66171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189091.639169:0:66171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc05ec0ca00/0xcc1762b626f8afee lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189091.639186:0:66171:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc05ec0ca00/0xcc1762b626f8afee lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189091.639199:0:66171:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc05ec0ca00/0xcc1762b626f8afee lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189091.639212:0:66171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc05ec0d000/0xcc1762b626f8aff5 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x21e7de2f bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189091.639218:0:66171:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc05ec0d000/0xcc1762b626f8aff5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x21e7de2f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189091.639224:0:66171:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc05ec0d000/0xcc1762b626f8aff5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x21e7de2f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189091.639344:0:66171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc05ec0d600/0xcc1762b626f8affc lrc: 3/1,0 mode: --/PR res: [0x20000a811:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189091.639352:0:66171:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc05ec0d600/0xcc1762b626f8affc lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189091.639360:0:66171:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc05ec0d600/0xcc1762b626f8affc lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784189091.639415:0:66171:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000a811:0x7:0x0]: returning size 0 00000004:00200000:3.0:1784189091.639420:0:66171:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1784189091.639506:0:66171:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9dc05ec0d600/0xcc1762b626f8affc lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189091.639532:0:66171:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc05ec0d600/0xcc1762b626f8affc lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189091.639543:0:66171:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc05ec0ca00/0xcc1762b626f8afee lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189091.639551:0:66171:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc05ec0ca00/0xcc1762b626f8afee lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189091.639558:0:66171:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc05ec0ca00/0xcc1762b626f8afee lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189091.639566:0:66171:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dc05ec0ca00/0xcc1762b626f8afee lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189091.639573:0:66171:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc05ec0ca00 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:3.0:1784189091.639579:0:66171:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc05ec0ca00/0xcc1762b626f8afee lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189091.639588:0:66171:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc05ec0ca00/0xcc1762b626f8afee lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189091.639603:0:66171:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9dc0455f8100) 00010000:00010000:3.0:1784189091.639607:0:66171:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784189091.639612:0:66171:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dc05ec0ca00/0xcc1762b626f8afee lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189091.639620:0:66171:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc05ec0ca00/0xcc1762b626f8afee lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189091.639634:0:66171:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc05ec0d000/0xcc1762b626f8aff5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x21e7de2f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189091.639722:0:66171:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc05ec0d000/0xcc1762b626f8aff5 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x21e7de2f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189091.639727:0:66171:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dc05ec0d000/0xcc1762b626f8aff5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x21e7de2f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189091.639732:0:66171:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc05ec0d000 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:3.0:1784189091.639735:0:66171:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc05ec0d000/0xcc1762b626f8aff5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x21e7de2f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189091.639741:0:66171:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc05ec0d000/0xcc1762b626f8aff5 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x21e7de2f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189091.639750:0:66171:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x21e7de2f (ffff9dc0455f8f00) 00010000:00010000:3.0:1784189091.639823:0:66171:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784189091.639827:0:66171:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dc05ec0d000/0xcc1762b626f8aff5 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x21e7de2f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189091.639834:0:66171:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc05ec0d000/0xcc1762b626f8aff5 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x21e7de2f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189091.640043:0:66171:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc05ec0d200/0xcc1762b626f8afe7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c3d92 expref: 12 pid: 66171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189091.640058:0:66171:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc05ec0d600/0xcc1762b626f8affc lrc: 3/0,0 mode: PR/PR res: [0x20000a811:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c3d92 expref: 11 pid: 66171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189091.640067:0:66171:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x7:0x0].0x0 (ffff9dc080e5fa00) 00010000:00010000:3.0:1784189091.640070:0:66171:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1784189091.640079:0:66171:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc05ec0d600, rc 0) 00000100:00100000:3.0:1784189091.640160:0:66171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc05ed38e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+11:67807:x1870854436254080:12345-192.168.203.12@tcp:101:rm.0 Request processed in 1326us (1627us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189091.640170:0:66171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1148 00000100:00100000:3.0:1784189091.644072:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1784189091.644837:0:66170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436254336 00000100:00100000:1.0:1784189091.645041:0:66170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436254336 00000100:00100000:1.0:1784189091.645119:0:66170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1149 00000100:00100000:1.0:1784189091.645133:0:66170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc05ed38000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+11:67807:x1870854436254336:12345-192.168.203.12@tcp:36:rm.0 00010000:00010000:1.0:1784189091.645209:0:66170:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:1.0:1784189091.645244:0:66170:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc05ec0d600/0xcc1762b626f8affc lrc: 0/0,0 mode: --/PR res: [0x20000a811:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c3d92 expref: 11 pid: 66171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189091.645291:0:66170:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x7:0x0].0x0 (ffff9dc080e5fa00) 00010000:00010000:1.0:1784189091.645315:0:66170:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0565e6400/0xcc1762b626f8afe0 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c3d8b expref: 10 pid: 68287 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189091.645347:0:66170:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9dc0455f8100) 00010000:00010000:1.0:1784189091.645356:0:66170:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1784189091.645389:0:66170:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0565e6200/0xcc1762b626f8b003 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189091.645402:0:66170:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0565e6200/0xcc1762b626f8b003 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189091.645414:0:66170:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0565e6200/0xcc1762b626f8b003 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189091.646021:0:66170:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0565e7000/0xcc1762b626f8b00a lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x21e7de2f bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189091.646036:0:66170:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0565e7000/0xcc1762b626f8b00a lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x21e7de2f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189091.646045:0:66170:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0565e7000/0xcc1762b626f8b00a lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x21e7de2f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189091.646158:0:66170:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0565e7c00/0xcc1762b626f8b011 lrc: 3/0,1 mode: --/EX res: [0x20000a811:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189091.646167:0:66170:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0565e7c00/0xcc1762b626f8b011 lrc: 3/0,1 mode: EX/EX res: [0x20000a811:0x7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189091.646189:0:66170:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0565e7c00/0xcc1762b626f8b011 lrc: 3/0,1 mode: EX/EX res: [0x20000a811:0x7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189091.646715:0:66170:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0565e7200/0xcc1762b626f8b018 lrc: 3/0,1 mode: --/PW res: [0x20000a811:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189091.646726:0:66170:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0565e7200/0xcc1762b626f8b018 lrc: 3/0,1 mode: PW/PW res: [0x20000a811:0x7:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189091.646736:0:66170:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0565e7200/0xcc1762b626f8b018 lrc: 3/0,1 mode: PW/PW res: [0x20000a811:0x7:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189091.646744:0:66170:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0565e7200/0xcc1762b626f8b018 lrc: 4/0,1 mode: PW/PW res: [0x20000a811:0x7:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189091.646823:0:66170:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0565e7200/0xcc1762b626f8b018 lrc: 4/0,1 mode: PW/PW res: [0x20000a811:0x7:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189091.646833:0:66170:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0565e7200/0xcc1762b626f8b018 lrc: 3/0,0 mode: PW/PW res: [0x20000a811:0x7:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189091.647032:0:66170:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1784189091.647059:0:66170:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0565e7c00/0xcc1762b626f8b011 lrc: 3/0,1 mode: EX/EX res: [0x20000a811:0x7:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189091.647067:0:66170:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0565e7c00/0xcc1762b626f8b011 lrc: 2/0,0 mode: EX/EX res: [0x20000a811:0x7:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189091.647075:0:66170:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0565e7c00/0xcc1762b626f8b011 lrc: 3/0,0 mode: EX/EX res: [0x20000a811:0x7:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189091.647082:0:66170:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc0565e7c00 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:1.0:1784189091.647098:0:66170:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0565e7c00/0xcc1762b626f8b011 lrc: 3/0,0 mode: EX/EX res: [0x20000a811:0x7:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189091.647107:0:66170:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0565e7c00/0xcc1762b626f8b011 lrc: 4/0,0 mode: EX/EX res: [0x20000a811:0x7:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189091.647119:0:66170:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x7:0x0].0x0 (ffff9dc0455f8400) 00010000:00010000:1.0:1784189091.647122:0:66170:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1784189091.647127:0:66170:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0565e7c00/0xcc1762b626f8b011 lrc: 2/0,0 mode: --/EX res: [0x20000a811:0x7:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189091.647135:0:66170:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0565e7c00/0xcc1762b626f8b011 lrc: 0/0,0 mode: --/EX res: [0x20000a811:0x7:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189091.647159:0:66170:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0565e6200/0xcc1762b626f8b003 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189091.647166:0:66170:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0565e6200/0xcc1762b626f8b003 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189091.647172:0:66170:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0565e6200/0xcc1762b626f8b003 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189091.647178:0:66170:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0565e6200/0xcc1762b626f8b003 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189091.647183:0:66170:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc0565e6200 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:1.0:1784189091.647186:0:66170:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0565e6200/0xcc1762b626f8b003 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189091.647192:0:66170:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0565e6200/0xcc1762b626f8b003 lrc: 5/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189091.647212:0:66170:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9dc0455f8300) 00010000:00010000:1.0:1784189091.647215:0:66170:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784189091.647218:0:66170:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0565e6200/0xcc1762b626f8b003 lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189091.647225:0:66170:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0565e6200/0xcc1762b626f8b003 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1784189091.647245:0:66170:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000d4403527 reply state 000000003e232d5d transno 103079215112 ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0565e7000/0xcc1762b626f8b00a lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x21e7de2f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189091.647259:0:66170:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0565e7000/0xcc1762b626f8b00a lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x21e7de2f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189091.647266:0:66170:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x21e7de2f (ffff9dc0455f8f00) 00010000:00010000:1.0:1784189091.647269:0:66170:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1784189091.647272:0:66170:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1784189091.647404:0:66170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc05ed38000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+11:67807:x1870854436254336:12345-192.168.203.12@tcp:36:rm.0 Request processed in 2269us (3342us total) trans 103079215112 rc 0/0 00000100:00100000:1.0:1784189091.647416:0:66170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1149 00010000:00010000:3.0:1784189091.650416:0:6501:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784189091.650518:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0565e7200/0xcc1762b626f8b018 lrc: 2/0,0 mode: PW/PW res: [0x20000a811:0x7:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189091.650533:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc0565e7200 already unused, calling callback (ffffffffc0b2e230) 00010000:00010000:3.0:1784189091.650538:0:6501:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0565e7200/0xcc1762b626f8b018 lrc: 2/0,0 mode: PW/PW res: [0x20000a811:0x7:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189091.650551:0:6501:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0565e7200/0xcc1762b626f8b018 lrc: 3/0,0 mode: PW/PW res: [0x20000a811:0x7:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189091.650574:0:6501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x7:0x0].0x0 (ffff9dc0455f8400) 00010000:00010000:3.0:1784189091.650577:0:6501:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1784189091.650583:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0565e7200/0xcc1762b626f8b018 lrc: 1/0,0 mode: --/PW res: [0x20000a811:0x7:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189091.650591:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0565e7200/0xcc1762b626f8b018 lrc: 0/0,0 mode: --/PW res: [0x20000a811:0x7:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189091.650614:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784189091.650616:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784189091.650619:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784189092.592611:0:7454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784189093.618046:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784189093.935822:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1784189093.935844:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc071537100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1870854458077952:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1784189093.935909:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784189093.935975:0:23826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458077952 00000100:00100000:1.0:1784189093.935983:0:23826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458077952 00000100:00100000:1.0:1784189093.936027:0:23826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3754 00000100:00100000:1.0:1784189093.936036:0:23826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc071537800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3640:x1870854458077952:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1784189093.936068:0:23826:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445576704 avail 1299337216 00000100:00100000:1.0:1784189093.936118:0:23826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc071537800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3640:x1870854458077952:12345-0@lo:41:osp-pre-1-0.0 Request processed in 83us (209us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189093.936126:0:23826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3754 00000100:00100000:1.0:1784189093.936170:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc071537100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1870854458077952:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1784189093.936568:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc071534700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3643:1870854458078208:0@lo:400:kworker.0 00000100:00100000:1.0:1784189093.936598:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784189093.936617:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc080e7f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1870854458078720:0@lo:400:kworker.0 00000100:00100000:1.0:1784189093.936638:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784189093.936655:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc080e7fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1870854458079232:0@lo:400:kworker.0 00000100:00100000:1.0:1784189093.936676:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784189093.936695:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:1.0:1784189093.936701:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc071537100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:bd553d0d-03e2-4233-b06b-b55bbfa2b954:3643:1870854458078080:0@lo:400:kworker.0 00000100:00100000:1.0:1784189093.936724:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784189093.936759:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc080e7df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3643:1870854458078592:0@lo:400:kworker.0 00000100:00100000:1.0:1784189093.936780:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784189093.936796:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc080e7e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3643:1870854458079104:0@lo:400:kworker.0 00000100:00100000:1.0:1784189093.936815:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784189093.936839:0:66169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458078208 00000100:00100000:1.0:1784189093.936844:0:66169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458078208 00000100:00100000:1.0:1784189093.936880:0:66169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458078592 00000100:00100000:1.0:1784189093.936883:0:66169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458078592 00000100:00100000:1.0:1784189093.936899:0:66169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458079104 00000100:00100000:1.0:1784189093.936901:0:66169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458079104 00000100:00100000:1.0:1784189093.936926:0:66169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1089 00000100:00100000:1.0:1784189093.936933:0:66169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc080e7ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1870854458078208:12345-0@lo:400:kworker.0 00010000:00000080:1.0:1784189093.936949:0:66169:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9dc080e7ed80 x1870854458078208/t0(0) o400->lustre-MDT0000-lwp-OST0000_UUID@0@lo:284/0 lens 224/224 e 0 to 0 dl 1784189104 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784189093.936993:0:66169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc080e7ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1870854458078208:12345-0@lo:400:kworker.0 Request processed in 61us (393us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189093.937001:0:66169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1089 00000100:00100000:1.0:1784189093.937015:0:66169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1090 00000100:00100000:1.0:1784189093.937021:0:66169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc080e7f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1870854458078592:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784189093.937047:0:66169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc080e7f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1870854458078592:12345-0@lo:400:kworker.0 Request processed in 27us (265us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189093.937053:0:66169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1090 00000100:00100000:1.0:1784189093.937064:0:66169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1091 00000100:00100000:1.0:1784189093.937069:0:66169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc05edd2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1870854458079104:12345-0@lo:400:kworker.0 00010000:00000080:1.0:1784189093.937078:0:66169:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9dc05edd2300 x1870854458079104/t0(0) o400->lustre-MDT0000-lwp-MDT0001_UUID@0@lo:284/0 lens 224/224 e 0 to 0 dl 1784189104 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784189093.937103:0:66169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc05edd2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1870854458079104:12345-0@lo:400:kworker.0 Request processed in 34us (287us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189093.937108:0:66169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1091 00000100:00100000:1.0:1784189093.937126:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458078720 00000100:00100000:1.0:1784189093.937130:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458078720 00000100:00100000:1.0:1784189093.937153:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3755 00000100:00100000:1.0:1784189093.937158:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc080e7c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3643:x1870854458078720:12345-0@lo:400:kworker.0 00010000:00000080:1.0:1784189093.937169:0:8439:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9dc080e7c700 x1870854458078720/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:284/0 lens 224/224 e 0 to 0 dl 1784189104 ref 1 fl Interpret:/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784189093.937194:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc080e7c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3643:x1870854458078720:12345-0@lo:400:kworker.0 Request processed in 37us (556us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189093.937200:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3755 00000100:00100000:1.0:1784189093.937226:0:26163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458079232 00000100:00100000:1.0:1784189093.937230:0:26163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458079232 00000100:00100000:1.0:1784189093.937256:0:26163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2379 00000100:00100000:1.0:1784189093.937263:0:26163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc080e7c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+5:3643:x1870854458079232:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784189093.937293:0:26163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc080e7c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+5:3643:x1870854458079232:12345-0@lo:400:kworker.0 Request processed in 31us (616us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189093.937301:0:26163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2379 00000100:00100000:1.0:1784189093.937475:0:87028:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458078080 00000100:00100000:1.0:1784189093.937479:0:87028:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458078080 00000100:00100000:1.0:1784189093.937546:0:87028:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1784189093.937553:0:87028:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc07037e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd553d0d-03e2-4233-b06b-b55bbfa2b954+24:3643:x1870854458078080:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784189093.937586:0:87028:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc07037e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd553d0d-03e2-4233-b06b-b55bbfa2b954+24:3643:x1870854458078080:12345-0@lo:400:kworker.0 Request processed in 33us (860us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189093.937591:0:87028:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00080000:0.0:1784189093.939686:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1784189093.939696:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1784189093.939700:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1784189093.939725:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc071536a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3641:1870854458078464:0@lo:400:kworker.0 00000100:00100000:0.0:1784189093.939801:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784189093.939833:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc080e7ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1870854458078976:0@lo:400:kworker.0 00000100:00100000:0.0:1784189093.939854:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784189093.939873:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc080e7c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3641:1870854458079488:0@lo:400:kworker.0 00000100:00100000:0.0:1784189093.939891:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784189093.939912:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:0.0:1784189093.939918:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc071536d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3641:1870854458078336:0@lo:400:kworker.0 00000100:00100000:0.0:1784189093.939949:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784189093.939965:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc080e7dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1870854458078848:0@lo:400:kworker.0 00000100:00100000:0.0:1784189093.939985:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784189093.940002:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc080e7e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1870854458079360:0@lo:400:kworker.0 00000100:00100000:0.0:1784189093.940023:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784189093.940051:0:66170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458078464 00000100:00100000:0.0:1784189093.940058:0:66170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458078464 00000100:00100000:3.0:1784189093.940344:0:26162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458078976 00000100:00100000:3.0:1784189093.940349:0:26162:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458078976 00000100:00100000:3.0:1784189093.940385:0:26162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458078848 00000100:00100000:3.0:1784189093.940389:0:26162:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458078848 00000100:00100000:3.0:1784189093.940409:0:26162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458079360 00000100:00100000:3.0:1784189093.940418:0:26162:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458079360 00000100:00100000:3.0:1784189093.940442:0:26162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2380 00000100:00100000:3.0:1784189093.940449:0:26162:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc06b98e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:3641:x1870854458078976:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784189093.940506:0:26162:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc06b98e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:3641:x1870854458078976:12345-0@lo:400:kworker.0 Request processed in 56us (649us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189093.940514:0:26162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2380 00000100:00100000:3.0:1784189093.940530:0:26162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2381 00000100:00100000:3.0:1784189093.940537:0:26162:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc056eaca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:3641:x1870854458078848:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784189093.940564:0:26162:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc056eaca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:3641:x1870854458078848:12345-0@lo:400:kworker.0 Request processed in 29us (579us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189093.940571:0:26162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2381 00000100:00100000:3.0:1784189093.940581:0:26162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2382 00000100:00100000:3.0:1784189093.940587:0:26162:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc080f6c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+5:3641:x1870854458079360:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784189093.940612:0:26162:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc080f6c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+5:3641:x1870854458079360:12345-0@lo:400:kworker.0 Request processed in 26us (589us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189093.940618:0:26162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2382 00000100:00100000:3.0:1784189093.940642:0:66171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458079488 00000100:00100000:3.0:1784189093.940645:0:66171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458079488 00000100:00100000:3.0:1784189093.940666:0:66171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458078336 00000100:00100000:3.0:1784189093.940668:0:66171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458078336 00000100:00100000:3.0:1784189093.940681:0:66171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1092 00000100:00100000:3.0:1784189093.940686:0:66171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc0505be680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1870854458079488:12345-0@lo:400:kworker.0 00010000:00000080:3.0:1784189093.940698:0:66171:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9dc0505be680 x1870854458079488/t0(0) o400->lustre-MDT0000-lwp-MDT0000_UUID@0@lo:284/0 lens 224/224 e 0 to 0 dl 1784189104 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784189093.940722:0:66171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc0505be680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1870854458079488:12345-0@lo:400:kworker.0 Request processed in 36us (830us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189093.940749:0:66171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1092 00000100:00100000:3.0:1784189093.940762:0:66171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1093 00000100:00100000:3.0:1784189093.940767:0:66171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc056eac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1870854458078336:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784189093.940792:0:66171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc056eac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1870854458078336:12345-0@lo:400:kworker.0 Request processed in 25us (842us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189093.940797:0:66171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1093 00000100:00100000:3.0:1784189093.940828:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc071536d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3641:1870854458078336:0@lo:400:kworker.0 00000100:00100000:3.0:1784189093.940838:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc080e7dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1870854458078848:0@lo:400:kworker.0 00000100:00100000:3.0:1784189093.940847:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc080e7e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1870854458079360:0@lo:400:kworker.0 00000100:00100000:3.0:1784189093.940855:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc080e7ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1870854458078976:0@lo:400:kworker.0 00000100:00100000:3.0:1784189093.940863:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc080e7c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3641:1870854458079488:0@lo:400:kworker.0 00000100:00100000:0.0:1784189093.941235:0:66170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1094 00000100:00100000:0.0:1784189093.941245:0:66170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf44bc2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1870854458078464:12345-0@lo:400:kworker.0 00010000:00000080:0.0:1784189093.941259:0:66170:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9dbf44bc2a00 x1870854458078464/t0(0) o400->lustre-MDT0000-lwp-OST0001_UUID@0@lo:284/0 lens 224/224 e 0 to 0 dl 1784189104 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784189093.941375:0:66170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf44bc2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1870854458078464:12345-0@lo:400:kworker.0 Request processed in 132us (1573us total) trans 0 rc 0/0 00000100:00100000:0.0:1784189093.941382:0:66170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1094 00000100:00080000:0.0:1784189093.941411:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1784189093.941415:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1784189093.941417:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1784189093.941419:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1784189093.941943:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc071537100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:bd553d0d-03e2-4233-b06b-b55bbfa2b954:3643:1870854458078080:0@lo:400:kworker.0 00000100:00100000:2.0:1784189093.941958:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc080e7df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3643:1870854458078592:0@lo:400:kworker.0 00000100:00100000:2.0:1784189093.941969:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc080e7e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3643:1870854458079104:0@lo:400:kworker.0 00000100:00100000:2.0:1784189093.941981:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc071534700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3643:1870854458078208:0@lo:400:kworker.0 00000100:00100000:2.0:1784189093.941991:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc080e7f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1870854458078720:0@lo:400:kworker.0 00000100:00100000:2.0:1784189093.942001:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc080e7fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1870854458079232:0@lo:400:kworker.0 00000100:00100000:3.0:1784189093.942125:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc071536a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3641:1870854458078464:0@lo:400:kworker.0 00000100:00100000:3.0:1784189094.182679:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1784189094.182804:0:87031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436254464 00000100:00100000:2.0:1784189094.182819:0:87031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436254464 00000100:00100000:2.0:1784189094.182937:0:87031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 80 00000100:00100000:2.0:1784189094.182946:0:87031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc07037d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:9957a2dc-fd88-4a91-bca3-e2b7f365ab0c+10:2396:x1870854436254464:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:2.0:1784189094.183021:0:87031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc07037d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:9957a2dc-fd88-4a91-bca3-e2b7f365ab0c+10:2396:x1870854436254464:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 76us (357us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189094.183029:0:87031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 80 00000100:00100000:3.0:1784189094.185560:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1784189094.185600:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1784189094.185629:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1784189094.185668:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1784189094.185705:0:68287:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436254592 00000100:00100000:1.0:1784189094.185719:0:68287:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436254592 00000100:00100000:3.0:1784189094.185752:0:9982:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436254976 00000100:00100000:3.0:1784189094.185761:0:9982:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436254976 00000100:00100000:1.0:1784189094.185806:0:68287:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436254720 00000100:00100000:1.0:1784189094.185814:0:68287:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436254720 00000100:00100000:3.0:1784189094.185821:0:9982:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436254848 00000100:00100000:3.0:1784189094.185836:0:9982:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436254848 00000100:00100000:1.0:1784189094.185860:0:68287:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1095 00000100:00100000:1.0:1784189094.185875:0:68287:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc05ed3a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+11:2397:x1870854436254592:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:3.0:1784189094.185883:0:9982:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 2383 00000100:00100000:3.0:1784189094.185897:0:9982:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc05ed39c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+5:2396:x1870854436254976:12345-192.168.203.12@tcp:400:kworker.0 00010000:00000080:1.0:1784189094.185908:0:68287:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9dc05ed3a680 x1870854436254592/t0(0) o400->b90fcc1c-0e69-42a4-a116-a71fec7aeb78@192.168.203.12@tcp:285/0 lens 224/224 e 0 to 0 dl 1784189105 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784189094.185994:0:68287:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc05ed3a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+11:2397:x1870854436254592:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 121us (444us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189094.185995:0:9982:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc05ed39c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+5:2396:x1870854436254976:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 99us (362us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189094.186024:0:68287:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1095 00000100:00100000:3.0:1784189094.186026:0:9982:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 2383 00000100:00100000:3.0:1784189094.186083:0:9982:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 2384 00000100:00100000:1.0:1784189094.186084:0:68287:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1096 00000100:00100000:3.0:1784189094.186113:0:9982:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc05ed38700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+5:2397:x1870854436254848:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:1.0:1784189094.186114:0:68287:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc05ed38a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+6:2396:x1870854436254720:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:3.0:1784189094.186148:0:9982:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc05ed38700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+5:2397:x1870854436254848:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 49us (478us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189094.186158:0:9982:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 2384 00000100:00100000:1.0:1784189094.186179:0:68287:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc05ed38a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+6:2396:x1870854436254720:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 75us (571us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189094.186189:0:68287:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1096 00000100:00080000:0.0:1784189094.186580:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1784189094.186586:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1784189094.186588:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1784189094.186590:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1784189094.448025:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc080e7fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1870854458079616:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1784189094.448105:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784189094.448230:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1784189094.448240:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf469b6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1870854458079744:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1784189094.448271:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784189094.448425:0:23826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458079744 00000100:00100000:0.0:1784189094.448432:0:23826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458079744 00000100:00100000:0.0:1784189094.448485:0:23826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3756 00000100:00100000:3.0:1784189094.448486:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc080f6e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1870854458079872:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1784189094.448496:0:23826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc05edd3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3643:x1870854458079744:12345-0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1784189094.448519:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00000024:0.0:1784189094.448529:0:23826:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445285888 avail 1299046400 00010000:00000080:0.0:1784189094.448572:0:23826:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9dc05edd3b80 x1870854458079744/t0(0) o41->lustre-MDT0001-mdtlov_UUID@0@lo:285/0 lens 224/368 e 0 to 0 dl 1784189105 ref 1 fl Interpret:/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784189094.448626:0:23826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc05edd3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3643:x1870854458079744:12345-0@lo:41:osp-pre-0-1.0 Request processed in 132us (355us total) trans 0 rc 0/0 00000100:00100000:0.0:1784189094.448634:0:23826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3756 00000100:00100000:1.0:1784189094.448721:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf469b6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1870854458079744:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1784189094.449279:0:9466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458079616 00000100:00100000:2.0:1784189094.449286:0:9466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458079616 00000100:00100000:2.0:1784189094.449764:0:9466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458079872 00000100:00100000:2.0:1784189094.449769:0:9466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458079872 00000100:00100000:1.0:1784189094.449773:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1908 00000100:00100000:1.0:1784189094.449786:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc05edd2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1870854458079616:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1784189094.449812:0:8432:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8650560 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1784189094.449818:0:9466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1909 00000100:00100000:2.0:1784189094.449837:0:9466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc080e7f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1870854458079872:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1784189094.449857:0:9466:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8650560 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1784189094.449865:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc05edd2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1870854458079616:12345-0@lo:13:osp-pre-0-0.0 Request processed in 82us (1758us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189094.449874:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1908 00000100:00100000:1.0:1784189094.449916:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc080e7fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1870854458079616:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1784189094.449971:0:9466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc080e7f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1870854458079872:12345-0@lo:13:osp-pre-1-0.0 Request processed in 135us (1451us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189094.449979:0:9466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1909 00000100:00100000:1.0:1784189094.450205:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc080f6e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1870854458079872:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1784189094.639630:0:26173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784189094.961212:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc080e7e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1870854458080000:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1784189094.961284:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784189094.961366:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458080000 00000100:00100000:3.0:1784189094.961374:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458080000 00000100:00100000:3.0:1784189094.961419:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1910 00000100:00100000:3.0:1784189094.961427:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc080e7df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1870854458080000:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1784189094.961448:0:8432:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8650560 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1784189094.961489:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc080e7df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1870854458080000:12345-0@lo:13:osp-pre-1-1.0 Request processed in 62us (205us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189094.961496:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1910 00000100:00100000:3.0:1784189094.961536:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc080e7e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1870854458080000:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1784189094.962080:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1784189094.962092:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf469b4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1870854458080128:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1784189094.962126:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784189094.962297:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458080128 00000100:00100000:2.0:1784189094.962303:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458080128 00000100:00100000:2.0:1784189094.962399:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1911 00000100:00100000:2.0:1784189094.962408:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc080f6f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1870854458080128:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1784189094.962423:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8650560 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1784189094.962503:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc080f6f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1870854458080128:12345-0@lo:13:osp-pre-0-1.0 Request processed in 96us (375us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189094.962510:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1911 00000100:00100000:0.0:1784189094.962568:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf469b4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1870854458080128:0@lo:13:osp-pre-0-1.0 00010000:00010000:3.0:1784189095.666201:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784189096.687583:0:7454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1784189096.800483:0:88243:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: mds1 REPLAY BARRIER on lustre-MDT0000 00000100:00100000:3.0:1784189096.875184:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1784189096.875363:0:66171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436255104 00000100:00100000:0.0:1784189096.875372:0:66171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436255104 00000100:00080000:2.0:1784189096.875542:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1784189096.875657:0:66171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1150 00000100:00100000:0.0:1784189096.875669:0:66171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc080e7e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+11:67875:x1870854436255104:12345-192.168.203.12@tcp:101:dd.0 00010000:00010000:0.0:1784189096.875688:0:66171:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784189096.875710:0:66171:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4369d600/0xcc1762b626f8b01f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbfc5de7fe6c3d99 expref: -99 pid: 66171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189096.875790:0:66171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4369c600/0xcc1762b626f8b026 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189096.875805:0:66171:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4369c600/0xcc1762b626f8b026 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189096.875817:0:66171:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4369c600/0xcc1762b626f8b026 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784189096.875860:0:66171:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1784189096.875864:0:66171:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1784189096.875905:0:66171:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4369c600/0xcc1762b626f8b026 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189096.875929:0:66171:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4369d600/0xcc1762b626f8b01f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c3d99 expref: 13 pid: 66171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189096.875944:0:66171:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4369c600/0xcc1762b626f8b026 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c3d99 expref: 12 pid: 66171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189096.875953:0:66171:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9dc071128900) 00010000:00010000:0.0:1784189096.875956:0:66171:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1784189096.875961:0:66171:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dbf4369c600, rc 0) 00010000:00000080:0.0:1784189096.875968:0:66171:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9dc080e7e680 x1870854436255104/t0(0) o101->b90fcc1c-0e69-42a4-a116-a71fec7aeb78@192.168.203.12@tcp:287/0 lens 576/688 e 0 to 0 dl 1784189107 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1784189096.876037:0:66171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc080e7e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+12:67875:x1870854436255104:12345-192.168.203.12@tcp:101:dd.0 Request processed in 370us (862us total) trans 0 rc 0/0 00000100:00100000:0.0:1784189096.876044:0:66171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1150 00000100:00100000:3.0:1784189096.882542:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1784189096.882612:0:66169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436255360 00000100:00100000:2.0:1784189096.882621:0:66169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436255360 00000100:00100000:2.0:1784189096.882684:0:66169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1151 00000100:00100000:2.0:1784189096.882695:0:66169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc080e7c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+12:67875:x1870854436255360:12345-192.168.203.12@tcp:101:dd.0 00010000:00010000:2.0:1784189096.882725:0:66169:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784189096.882729:0:66169:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1784189096.882755:0:66169:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4369c600/0xcc1762b626f8b026 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c3d99 expref: 12 pid: 66171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189096.882773:0:66169:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9dc071128900) 00010000:00010000:2.0:1784189096.882783:0:66169:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1784189096.882798:0:66169:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0755a4000/0xcc1762b626f8b02d lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbfc5de7fe6c3da0 expref: -99 pid: 66169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189096.882927:0:66169:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0755a5a00/0xcc1762b626f8b034 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189096.882940:0:66169:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0755a5a00/0xcc1762b626f8b034 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189096.882950:0:66169:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0755a5a00/0xcc1762b626f8b034 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189096.882963:0:66169:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0755a5200/0xcc1762b626f8b03b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc958f637 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189096.882969:0:66169:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0755a5200/0xcc1762b626f8b03b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc958f637 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189096.882975:0:66169:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0755a5200/0xcc1762b626f8b03b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc958f637 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189096.883031:0:66169:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0755a5000/0xcc1762b626f8b042 lrc: 3/0,1 mode: --/PW res: [0x20000a811:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189096.883039:0:66169:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0755a5000/0xcc1762b626f8b042 lrc: 3/0,1 mode: PW/PW res: [0x20000a811:0x6:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189096.883046:0:66169:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0755a5000/0xcc1762b626f8b042 lrc: 3/0,1 mode: PW/PW res: [0x20000a811:0x6:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1784189096.883147:0:66169:0:(mdt_lvb.c:89:mdt_dom_disk_lvbo_update()) res: [0x20000a811:0x6:0x0] updating lvb size from disk: 0 -> 0 00000004:00010000:2.0:1784189096.883151:0:66169:0:(mdt_lvb.c:96:mdt_dom_disk_lvbo_update()) res: [0x20000a811:0x6:0x0] updating lvb mtime from disk: 0 -> 1784189089 00000004:00010000:2.0:1784189096.883154:0:66169:0:(mdt_lvb.c:102:mdt_dom_disk_lvbo_update()) res: [0x20000a811:0x6:0x0] updating lvb atime from disk: 0 -> 1784189089 00000004:00010000:2.0:1784189096.883161:0:66169:0:(mdt_lvb.c:108:mdt_dom_disk_lvbo_update()) res: [0x20000a811:0x6:0x0] updating lvb ctime from disk: 0 -> 1784189089 00000004:00010000:2.0:1784189096.883163:0:66169:0:(mdt_lvb.c:114:mdt_dom_disk_lvbo_update()) res: [0x20000a811:0x6:0x0] updating lvb blocks from disk: 18427282363563114435 -> 0 00002000:00010000:2.0:1784189096.883166:0:66169:0:(mdt_io.c:1550:mdt_lvb2reply()) size 0 00010000:00010000:2.0:1784189096.883173:0:66169:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0755a5a00/0xcc1762b626f8b034 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189096.883180:0:66169:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0755a5a00/0xcc1762b626f8b034 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189096.883186:0:66169:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0755a5a00/0xcc1762b626f8b034 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189096.883192:0:66169:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0755a5a00/0xcc1762b626f8b034 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189096.883198:0:66169:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc0755a5a00 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:2.0:1784189096.883202:0:66169:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0755a5a00/0xcc1762b626f8b034 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189096.883210:0:66169:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0755a5a00/0xcc1762b626f8b034 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189096.883219:0:66169:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9dc082150e00) 00010000:00010000:2.0:1784189096.883221:0:66169:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784189096.883224:0:66169:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0755a5a00/0xcc1762b626f8b034 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189096.883283:0:66169:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0755a5a00/0xcc1762b626f8b034 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189096.883294:0:66169:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0755a5200/0xcc1762b626f8b03b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc958f637 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189096.883309:0:66169:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0755a5200/0xcc1762b626f8b03b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc958f637 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189096.883315:0:66169:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0755a5200/0xcc1762b626f8b03b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc958f637 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189096.883343:0:66169:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc0755a5200 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:2.0:1784189096.883347:0:66169:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0755a5200/0xcc1762b626f8b03b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc958f637 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189096.883352:0:66169:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0755a5200/0xcc1762b626f8b03b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc958f637 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189096.883360:0:66169:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xc958f637 (ffff9dc082150f00) 00010000:00010000:2.0:1784189096.883362:0:66169:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784189096.883365:0:66169:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0755a5200/0xcc1762b626f8b03b lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc958f637 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189096.883370:0:66169:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0755a5200/0xcc1762b626f8b03b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc958f637 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189096.883412:0:66169:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0755a4000/0xcc1762b626f8b02d lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c3da0 expref: 14 pid: 66169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189096.883430:0:66169:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0755a5000/0xcc1762b626f8b042 lrc: 3/0,0 mode: PW/PW res: [0x20000a811:0x6:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c3da0 expref: 13 pid: 66169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189096.883437:0:66169:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x6:0x0].0x0 (ffff9dc082150400) 00010000:00010000:2.0:1784189096.883440:0:66169:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5b 00010000:00010000:2.0:1784189096.883448:0:66169:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc0755a5000, rc 0) 00010000:00000080:2.0:1784189096.883455:0:66169:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9dc080e7c000 x1870854436255360/t103079215113(0) o101->b90fcc1c-0e69-42a4-a116-a71fec7aeb78@192.168.203.12@tcp:287/0 lens 752/824 e 0 to 0 dl 1784189107 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1784189096.883514:0:66169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc080e7c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+13:67875:x1870854436255360:12345-192.168.203.12@tcp:101:dd.0 Request processed in 820us (980us total) trans 103079215113 rc 0/0 00000100:00100000:2.0:1784189096.883521:0:66169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1151 00000001:00080000:1.0:1784189096.888567:0:87022:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 103079215113 is committed 00010000:00010000:3.0:1784189096.888788:0:3627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0565e6c00/0xcc1762b626f8afd2 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x21e7de2f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189096.888810:0:3627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0565e6c00/0xcc1762b626f8afd2 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x21e7de2f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189096.888819:0:3627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0565e6c00/0xcc1762b626f8afd2 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x21e7de2f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189096.888826:0:3627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc0565e6c00 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:3.0:1784189096.888831:0:3627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0565e6c00/0xcc1762b626f8afd2 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x21e7de2f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189096.888838:0:3627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0565e6c00/0xcc1762b626f8afd2 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x21e7de2f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189096.888855:0:3627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x21e7de2f (ffff9dc0455f8f00) 00010000:00010000:3.0:1784189096.888859:0:3627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784189096.888863:0:3627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0565e6c00/0xcc1762b626f8afd2 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x21e7de2f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189096.888870:0:3627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0565e6c00/0xcc1762b626f8afd2 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x21e7de2f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189096.888887:0:3627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0565e7000/0xcc1762b626f8b00a lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x21e7de2f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189096.888893:0:3627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0565e7000/0xcc1762b626f8b00a lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x21e7de2f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189096.888898:0:3627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0565e7000/0xcc1762b626f8b00a lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x21e7de2f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189096.888911:0:3627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc0565e7000 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:3.0:1784189096.888914:0:3627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0565e7000/0xcc1762b626f8b00a lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x21e7de2f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189096.888920:0:3627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0565e7000/0xcc1762b626f8b00a lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x21e7de2f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189096.888929:0:3627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x21e7de2f (ffff9dc0455f8f00) 00010000:00010000:3.0:1784189096.888931:0:3627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784189096.888935:0:3627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0565e7000/0xcc1762b626f8b00a lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x21e7de2f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189096.888940:0:3627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0565e7000/0xcc1762b626f8b00a lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x21e7de2f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784189096.892638:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1784189096.892728:0:66170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436255488 00000100:00100000:0.0:1784189096.892737:0:66170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436255488 00000100:00100000:0.0:1784189096.892788:0:66170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1152 00000100:00100000:0.0:1784189096.892797:0:66170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc080e7ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+8:67875:x1870854436255488:12345-192.168.203.12@tcp:101:dd.0 00010000:00010000:0.0:1784189096.892818:0:66170:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784189096.892836:0:66170:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4369d600/0xcc1762b626f8b050 lrc: 2/0,0 mode: --/PR res: [0x20000a811:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbfc5de7fe6c3da7 expref: -99 pid: 66170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189096.892868:0:66170:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4369ce00/0xcc1762b626f8b057 lrc: 3/1,0 mode: --/PR res: [0x20000a811:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189096.892882:0:66170:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4369ce00/0xcc1762b626f8b057 lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189096.892902:0:66170:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4369ce00/0xcc1762b626f8b057 lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189096.892995:0:66170:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4369d600/0xcc1762b626f8b050 lrc: 0/0,0 mode: --/PR res: [0x20000a811:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c3da7 expref: 10 pid: 66170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189096.893011:0:66170:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4369ce00/0xcc1762b626f8b057 lrc: 3/0,0 mode: PR/PR res: [0x20000a811:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c3da7 expref: 9 pid: 66170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189096.893020:0:66170:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x6:0x0].0x0 (ffff9dc082150400) 00010000:00010000:0.0:1784189096.893023:0:66170:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1784189096.893026:0:66170:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dbf4369ce00, rc 0) 00010000:00000080:0.0:1784189096.893033:0:66170:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9dc080e7ce00 x1870854436255488/t0(0) o101->b90fcc1c-0e69-42a4-a116-a71fec7aeb78@192.168.203.12@tcp:287/0 lens 568/1272 e 0 to 0 dl 1784189107 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1784189096.893087:0:66170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc080e7ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+9:67875:x1870854436255488:12345-192.168.203.12@tcp:101:dd.0 Request processed in 291us (456us total) trans 0 rc 0/0 00000100:00100000:0.0:1784189096.893094:0:66170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1152 00000100:00100000:0.0:1784189096.900113:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1784189096.900338:0:66171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436255744 00000100:00100000:1.0:1784189096.900349:0:66171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436255744 00000100:00100000:1.0:1784189096.900405:0:66171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1153 00000100:00100000:1.0:1784189096.900426:0:66171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc080f6c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+9:67875:x1870854436255744:12345-192.168.203.12@tcp:36:dd.0 00010000:00010000:1.0:1784189096.900563:0:66171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0565e6600/0xcc1762b626f8b05e lrc: 3/0,1 mode: --/PW res: [0x20000a811:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189096.900598:0:66171:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0755a5000/0xcc1762b626f8b042 lrc: 2/0,0 mode: PW/PW res: [0x20000a811:0x6:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c3da0 expref: 9 pid: 66169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189096.900607:0:66171:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0565e6600/0xcc1762b626f8b05e lrc: 4/0,1 mode: --/PW res: [0x20000a811:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189096.900640:0:66171:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0755a5000/0xcc1762b626f8b042 lrc: 3/0,0 mode: PW/PW res: [0x20000a811:0x6:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c3da0 expref: 9 pid: 66169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189096.900653:0:66171:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0755a5000/0xcc1762b626f8b042 lrc: 4/0,0 mode: PW/PW res: [0x20000a811:0x6:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c3da0 expref: 9 pid: 66169 timeout: 3439 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784189096.900666:0:66171:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc05edd0380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:66171:1870854458080256:192.168.203.12@tcp:104: 00000100:00100000:1.0:1784189096.900751:0:66171:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dc076067300 going to sleep for 11 seconds 00000100:00100000:1.0:1784189096.905097:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1784189096.905133:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436255872 00000100:00100000:1.0:1784189096.905142:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436255872 00010000:00010000:1.0:1784189096.905178:0:6500:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0755a5000/0xcc1762b626f8b042 lrc: 5/0,0 mode: PW/PW res: [0x20000a811:0x6:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c3da0 expref: 10 pid: 66169 timeout: 3439 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784189096.905215:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 2543 00000100:00100000:1.0:1784189096.905225:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc0711a5050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+10:2397:x1870854436255872:12345-192.168.203.12@tcp:102:ldlm_bl.0 00010000:00010000:1.0:1784189096.905240:0:6500:0:(ldlm_lockd.c:1655:ldlm_handle_convert0()) ### server-side convert handler START ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0755a5000/0xcc1762b626f8b042 lrc: 5/0,0 mode: PW/PW res: [0x20000a811:0x6:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c3da0 expref: 10 pid: 66169 timeout: 3439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189096.905253:0:6500:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0755a5000/0xcc1762b626f8b042 lrc: 4/0,0 mode: PW/PW res: [0x20000a811:0x6:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c3da0 expref: 10 pid: 66169 timeout: 3439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189096.905270:0:6500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0755a5000/0xcc1762b626f8b042 lrc: 4/0,0 mode: PW/PW res: [0x20000a811:0x6:0x0].0x0 bits 0x59/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c3da0 expref: 10 pid: 66169 timeout: 3439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189096.905279:0:6500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x6:0x0].0x0 (ffff9dc082150400) 00010000:00010000:1.0:1784189096.905282:0:6500:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5b 00010000:00010000:1.0:1784189096.905286:0:6500:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0565e6600/0xcc1762b626f8b05e lrc: 3/0,1 mode: --/PW res: [0x20000a811:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189096.905296:0:6500:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0565e6600/0xcc1762b626f8b05e lrc: 3/0,1 mode: PW/PW res: [0x20000a811:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189096.905304:0:6500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0565e6600/0xcc1762b626f8b05e lrc: 4/0,1 mode: PW/PW res: [0x20000a811:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189096.905348:0:6500:0:(ldlm_lockd.c:1704:ldlm_handle_convert0()) ### server-side convert handler END, rc = 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0755a5000/0xcc1762b626f8b042 lrc: 4/0,0 mode: PW/PW res: [0x20000a811:0x6:0x0].0x0 bits 0x59/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c3da0 expref: 10 pid: 66169 timeout: 3439 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784189096.905404:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc0711a5050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+10:2397:x1870854436255872:12345-192.168.203.12@tcp:102:ldlm_bl.0 Request processed in 180us (316us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189096.905412:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 2543 00000100:00100000:2.0:1784189096.907215:0:66171:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc05edd0380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:66171:1870854458080256:192.168.203.12@tcp:104: 00010000:00010000:2.0:1784189096.907240:0:66171:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0565e6600/0xcc1762b626f8b05e lrc: 3/0,1 mode: PW/PW res: [0x20000a811:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189096.907252:0:66171:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0565e6600/0xcc1762b626f8b05e lrc: 3/0,1 mode: PW/PW res: [0x20000a811:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189096.907258:0:66171:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0565e6600/0xcc1762b626f8b05e lrc: 3/0,1 mode: PW/PW res: [0x20000a811:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1784189096.907415:0:66171:0:(mdt_lvb.c:89:mdt_dom_disk_lvbo_update()) res: [0x20000a811:0x6:0x0] updating lvb size from disk: 0 -> 0 00000004:00010000:2.0:1784189096.907418:0:66171:0:(mdt_lvb.c:96:mdt_dom_disk_lvbo_update()) res: [0x20000a811:0x6:0x0] updating lvb mtime from disk: 1784189089 -> 1784189096 00000004:00010000:2.0:1784189096.907421:0:66171:0:(mdt_lvb.c:102:mdt_dom_disk_lvbo_update()) res: [0x20000a811:0x6:0x0] updating lvb atime from disk: 1784189089 -> 1784189089 00000004:00010000:2.0:1784189096.907423:0:66171:0:(mdt_lvb.c:108:mdt_dom_disk_lvbo_update()) res: [0x20000a811:0x6:0x0] updating lvb ctime from disk: 1784189089 -> 1784189096 00000004:00010000:2.0:1784189096.907425:0:66171:0:(mdt_lvb.c:114:mdt_dom_disk_lvbo_update()) res: [0x20000a811:0x6:0x0] updating lvb blocks from disk: 0 -> 0 00000004:00010000:2.0:1784189096.907432:0:66171:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000c57e5715 reply state 0000000066c07654 transno 103079215114 ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0565e6600/0xcc1762b626f8b05e lrc: 3/0,1 mode: PW/PW res: [0x20000a811:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189096.907564:0:66171:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0565e6600/0xcc1762b626f8b05e lrc: 3/0,1 mode: TXN/TXN res: [0x20000a811:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189096.907573:0:66171:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x6:0x0].0x0 (ffff9dc082150400) 00010000:00010000:2.0:1784189096.907575:0:66171:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1784189096.907650:0:66171:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00000080:2.0:1784189096.907705:0:66171:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9dc080f6c700 x1870854436255744/t103079215114(0) o36->b90fcc1c-0e69-42a4-a116-a71fec7aeb78@192.168.203.12@tcp:287/0 lens 488/456 e 0 to 0 dl 1784189107 ref 1 fl Interpret:/200/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784189096.907786:0:66171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc080f6c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+11:67875:x1870854436255744:12345-192.168.203.12@tcp:36:dd.0 Request processed in 7372us (7682us total) trans 103079215114 rc 0/0 00000100:00100000:2.0:1784189096.907794:0:66171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1153 00000100:00100000:1.0:1784189096.914820:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1784189096.914984:0:66182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436256000 00000100:00100000:2.0:1784189096.914994:0:66182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436256000 00002000:00010000:2.0:1784189096.915030:0:66182:0:(mdt_io.c:271:mdt_punch_hpreq_check()) lustre-MDT0000: refresh DOM lock for [0x20000a811:0x6:0x0] 00002000:00100000:2.0:1784189096.915035:0:66182:0:(mdt_io.c:66:mdt_prolong_dom_lock()) Prolong DOM lock for req ffff9dc05edd1f80 with x1870854436256000 00000100:00100000:2.0:1784189096.915071:0:66182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 0 00000100:00100000:2.0:1784189096.915080:0:66182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc05edd1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_000:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+11:2396:x1870854436256000:12345-192.168.203.12@tcp:10:dd.0 00000004:00010000:2.0:1784189096.915258:0:66182:0:(mdt_lvb.c:89:mdt_dom_disk_lvbo_update()) res: [0x20000a811:0x6:0x0] updating lvb size from disk: 0 -> 0 00000004:00010000:2.0:1784189096.915262:0:66182:0:(mdt_lvb.c:96:mdt_dom_disk_lvbo_update()) res: [0x20000a811:0x6:0x0] updating lvb mtime from disk: 1784189096 -> 1784189096 00000004:00010000:2.0:1784189096.915265:0:66182:0:(mdt_lvb.c:102:mdt_dom_disk_lvbo_update()) res: [0x20000a811:0x6:0x0] updating lvb atime from disk: 1784189089 -> 1784189089 00000004:00010000:2.0:1784189096.915267:0:66182:0:(mdt_lvb.c:108:mdt_dom_disk_lvbo_update()) res: [0x20000a811:0x6:0x0] updating lvb ctime from disk: 1784189096 -> 1784189096 00000004:00010000:2.0:1784189096.915269:0:66182:0:(mdt_lvb.c:114:mdt_dom_disk_lvbo_update()) res: [0x20000a811:0x6:0x0] updating lvb blocks from disk: 0 -> 0 00010000:00000080:2.0:1784189096.915287:0:66182:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9dc05edd1f80 x1870854436256000/t103079215115(0) o10->b90fcc1c-0e69-42a4-a116-a71fec7aeb78@192.168.203.12@tcp:287/0 lens 440/432 e 0 to 0 dl 1784189107 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1784189096.915379:0:66182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc05edd1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_000:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+12:2396:x1870854436256000:12345-192.168.203.12@tcp:10:dd.0 Request processed in 299us (578us total) trans 103079215115 rc 0/0 00000100:00100000:2.0:1784189096.915386:0:66182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 0 00002000:00010000:2.0:1784189096.915389:0:66182:0:(mdt_io.c:271:mdt_punch_hpreq_check()) lustre-MDT0000: refresh DOM lock for [0x20000a811:0x6:0x0] 00002000:00100000:2.0:1784189096.915392:0:66182:0:(mdt_io.c:66:mdt_prolong_dom_lock()) Prolong DOM lock for req ffff9dc05edd1f80 with x1870854436256000 00000100:00100000:1.0:1784189096.924702:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1784189096.924885:0:66172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436256256 00000100:00100000:2.0:1784189096.924895:0:66172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436256256 00000100:00100000:2.0:1784189096.924950:0:66172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 223 00000100:00100000:2.0:1784189096.924959:0:66172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc05edd2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+12:67875:x1870854436256256:12345-192.168.203.12@tcp:35:dd.0 00010000:00000080:2.0:1784189096.925123:0:66172:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9dc05edd2680 x1870854436256256/t103079215116(0) o35->b90fcc1c-0e69-42a4-a116-a71fec7aeb78@192.168.203.12@tcp:287/0 lens 392/456 e 0 to 0 dl 1784189107 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1784189096.925195:0:66172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc05edd2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+13:67875:x1870854436256256:12345-192.168.203.12@tcp:35:dd.0 Request processed in 238us (503us total) trans 103079215116 rc 0/0 00000100:00100000:2.0:1784189096.925203:0:66172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 223 00010000:00010000:3.0:1784189097.712597:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1784189098.442611:0:88340:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:3.0:1784189098.442659:0:88340:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff9dc070147a00/0xcc1762b626f8abd4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc1762b626f8abdb expref: -99 pid: 87021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189098.442673:0:88340:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff9dc070147a00/0xcc1762b626f8abd4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0xcc1762b626f8abdb expref: -99 pid: 87021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189098.442681:0:88340:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff9dc070147a00/0xcc1762b626f8abd4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0xcc1762b626f8abdb expref: -99 pid: 87021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189098.442689:0:88340:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.112@tcp lock: ffff9dc070147a00/0xcc1762b626f8abd4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0xcc1762b626f8abdb expref: -99 pid: 87021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189098.442852:0:88340:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1784189098.442858:0:88340:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:3.0:1784189098.442884:0:88340:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1784189098.442888:0:88340:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:3.0:1784189098.442893:0:88340:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1784189098.442915:0:88340:0:(import.c:65:import_set_state_nolock()) ffff9dc07a883800 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:1.0:1784189098.445686:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc080e7e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3639:1870854458080384:0@lo:39:umount.0 00000100:00100000:1.0:1784189098.445767:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1784189098.447017:0:26173:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784189098.447029:0:26173:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.112@tcp lock: ffff9dc070147a00/0xcc1762b626f8abd4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0xcc1762b626f8abdb expref: -99 pid: 87021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189098.447041:0:26173:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc070147a00 already unused, calling callback (ffffffffc114ac20) 10000000:00010000:0.0:1784189098.447045:0:26173:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.112@tcp lock: ffff9dc070147a00/0xcc1762b626f8abd4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0xcc1762b626f8abdb expref: -99 pid: 87021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189098.447055:0:26173:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.112@tcp lock: ffff9dc070147a00/0xcc1762b626f8abd4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1008400000000 nid: local remote: 0xcc1762b626f8abdb expref: -99 pid: 87021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1784189098.447078:0:26173:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.112@tcp lock: ffff9dc070147a00/0xcc1762b626f8abd4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1009400000000 nid: local remote: 0xcc1762b626f8abdb expref: -99 pid: 87021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784189098.447085:0:26173:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1784189098.447087:0:26173:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:0.0:1784189098.447090:0:26173:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:0.0:1784189098.447128:0:26173:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.112@tcp lock: ffff9dc070147a00/0xcc1762b626f8abd4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0xcc1762b626f8abdb expref: -99 pid: 87021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189098.447134:0:26173:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1784189098.447169:0:26173:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.112@tcp lock: ffff9dc070147a00/0xcc1762b626f8abd4 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0xcc1762b626f8abdb expref: -99 pid: 87021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189098.447177:0:26173:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.112@tcp lock: ffff9dc070147a00/0xcc1762b626f8abd4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0xcc1762b626f8abdb expref: -99 pid: 87021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189098.447191:0:26173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784189098.447193:0:26173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784189098.447195:0:26173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784189098.447209:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc080f6e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:bd553d0d-03e2-4233-b06b-b55bbfa2b954:3643:1870854458080512:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1784189098.447254:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784189098.447313:0:7455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458080512 00000100:00100000:0.0:1784189098.447336:0:7455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458080512 00000100:00100000:0.0:1784189098.447385:0:7455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 689 00000100:00100000:0.0:1784189098.447393:0:7455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc080f6fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bd553d0d-03e2-4233-b06b-b55bbfa2b954+24:3643:x1870854458080512:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1784189098.447405:0:7455:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784189098.447418:0:7455:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dc081b17000/0xcc1762b626f8abdb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xcc1762b626f8abd4 expref: 24 pid: 87031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189098.447439:0:7455:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784189098.447476:0:7455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc080f6fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bd553d0d-03e2-4233-b06b-b55bbfa2b954+23:3643:x1870854458080512:12345-0@lo:103:ldlm_bl.0 Request processed in 83us (222us total) trans 0 rc 0/0 00000100:00100000:0.0:1784189098.447484:0:7455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 689 00000100:00100000:0.0:1784189098.447521:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc080f6e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:bd553d0d-03e2-4233-b06b-b55bbfa2b954:3643:1870854458080512:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1784189098.451578:0:66945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458080384 00000100:00100000:3.0:1784189098.451596:0:66945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458080384 00000100:00100000:2.0:1784189098.451745:0:66945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1154 00000100:00100000:2.0:1784189098.451755:0:66945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc05edd1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1870854458080384:12345-0@lo:39:umount.0 00000020:00000080:2.0:1784189098.451796:0:66945:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xcc1762b626f8acf3 00000100:00080000:2.0:1784189098.451813:0:66945:0:(import.c:65:import_set_state_nolock()) ffff9dc05ed22800 : changing import state from FULL to CLOSED 00010000:00010000:3.0:1784189098.452073:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00000080:2.0:1784189098.452121:0:66945:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9dc05edd1500 x1870854458080384/t0(0) o39->lustre-MDT0000-lwp-MDT0000_UUID@0@lo:289/0 lens 224/224 e 0 to 0 dl 1784189109 ref 1 fl Interpret:/200/0 rc 0/0 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784189098.452989:0:66945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc05edd1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+1:3639:x1870854458080384:12345-0@lo:39:umount.0 Request processed in 1233us (7219us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189098.453000:0:66945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1154 00000020:00000080:2.0:1784189098.453013:0:66945:0:(genops.c:906:class_export_put()) final put ffff9dc05ed23800/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:3.0:1784189098.453095:0:63468:0:(genops.c:865:class_export_destroy()) destroying export ffff9dc05ed23800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000100:00080000:1.0:1784189098.453267:0:3639:0:(import.c:65:import_set_state_nolock()) ffff9dc07a883800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:1.0:1784189098.453290:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc080e7e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3639:1870854458080384:0@lo:39:umount.0 00000100:00080000:0.0:1784189098.453362:0:88340:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1784189098.453366:0:88340:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:0.0:1784189098.453371:0:88340:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:0.0:1784189098.454214:0:88340:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff9dc04a20be00/0xcc1762b626f8aaed lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc1762b626f8aaf4 expref: -99 pid: 87021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189098.454228:0:88340:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff9dc04a20be00/0xcc1762b626f8aaed lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0xcc1762b626f8aaf4 expref: -99 pid: 87021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189098.454235:0:88340:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff9dc04a20be00/0xcc1762b626f8aaed lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0xcc1762b626f8aaf4 expref: -99 pid: 87021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189098.454243:0:88340:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.112@tcp lock: ffff9dc04a20be00/0xcc1762b626f8aaed lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0xcc1762b626f8aaf4 expref: -99 pid: 87021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189098.454514:0:88340:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1784189098.454521:0:88340:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff9dc04a20ae00/0xcc1762b626f8abfe lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc1762b626f8ac05 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189098.454528:0:88340:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff9dc04a20ae00/0xcc1762b626f8abfe lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xcc1762b626f8ac05 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189098.454534:0:88340:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff9dc04a20ae00/0xcc1762b626f8abfe lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xcc1762b626f8ac05 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189098.454552:0:88340:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.112@tcp lock: ffff9dc04a20ae00/0xcc1762b626f8abfe lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xcc1762b626f8ac05 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189098.454569:0:88340:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1784189098.454576:0:88340:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff9dc081b16400/0xcc1762b626f8abc6 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc1762b626f8abcd expref: -99 pid: 87021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189098.454582:0:88340:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff9dc081b16400/0xcc1762b626f8abc6 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xcc1762b626f8abcd expref: -99 pid: 87021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189098.454588:0:88340:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff9dc081b16400/0xcc1762b626f8abc6 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xcc1762b626f8abcd expref: -99 pid: 87021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189098.454594:0:88340:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.112@tcp lock: ffff9dc081b16400/0xcc1762b626f8abc6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xcc1762b626f8abcd expref: -99 pid: 87021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189098.454609:0:88340:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:0.0:1784189098.454622:0:26173:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1784189098.454627:0:26173:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.112@tcp lock: ffff9dc04a20be00/0xcc1762b626f8aaed lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0xcc1762b626f8aaf4 expref: -99 pid: 87021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189098.454634:0:26173:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc04a20be00 already unused, calling callback (ffffffffc114ac20) 10000000:00010000:0.0:1784189098.454637:0:26173:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.112@tcp lock: ffff9dc04a20be00/0xcc1762b626f8aaed lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0xcc1762b626f8aaf4 expref: -99 pid: 87021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189098.454645:0:26173:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.112@tcp lock: ffff9dc04a20be00/0xcc1762b626f8aaed lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1008400000000 nid: local remote: 0xcc1762b626f8aaf4 expref: -99 pid: 87021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1784189098.454651:0:26173:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.112@tcp lock: ffff9dc04a20be00/0xcc1762b626f8aaed lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1009400000000 nid: local remote: 0xcc1762b626f8aaf4 expref: -99 pid: 87021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784189098.454663:0:26173:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1784189098.454666:0:26173:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 00010000:00010000:0.0:1784189098.454698:0:26173:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.112@tcp lock: ffff9dc04a20be00/0xcc1762b626f8aaed lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0xcc1762b626f8aaf4 expref: -99 pid: 87021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189098.454715:0:26173:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1784189098.454739:0:26173:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.112@tcp lock: ffff9dc04a20be00/0xcc1762b626f8aaed lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0xcc1762b626f8aaf4 expref: -99 pid: 87021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189098.454745:0:26173:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.112@tcp lock: ffff9dc04a20be00/0xcc1762b626f8aaed lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0xcc1762b626f8aaf4 expref: -99 pid: 87021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189098.454758:0:26173:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1784189098.454761:0:26173:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.112@tcp lock: ffff9dc04a20ae00/0xcc1762b626f8abfe lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xcc1762b626f8ac05 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189098.454766:0:26173:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc04a20ae00 already unused, calling callback (ffffffffc114ac20) 10000000:00010000:0.0:1784189098.454768:0:26173:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.112@tcp lock: ffff9dc04a20ae00/0xcc1762b626f8abfe lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xcc1762b626f8ac05 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189098.454774:0:26173:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.112@tcp lock: ffff9dc04a20ae00/0xcc1762b626f8abfe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xcc1762b626f8ac05 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1784189098.454779:0:26173:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.112@tcp lock: ffff9dc04a20ae00/0xcc1762b626f8abfe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xcc1762b626f8ac05 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784189098.454784:0:26173:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:0.0:1784189098.454786:0:26173:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:0.0:1784189098.454788:0:26173:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:0.0:1784189098.454809:0:26173:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.112@tcp lock: ffff9dc04a20ae00/0xcc1762b626f8abfe lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xcc1762b626f8ac05 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189098.454815:0:26173:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1784189098.454820:0:26173:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.112@tcp lock: ffff9dc04a20ae00/0xcc1762b626f8abfe lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xcc1762b626f8ac05 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189098.454826:0:26173:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.112@tcp lock: ffff9dc04a20ae00/0xcc1762b626f8abfe lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xcc1762b626f8ac05 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189098.454836:0:26173:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784189098.454839:0:26173:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.112@tcp lock: ffff9dc081b16400/0xcc1762b626f8abc6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xcc1762b626f8abcd expref: -99 pid: 87021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189098.454844:0:26173:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc081b16400 already unused, calling callback (ffffffffc114ac20) 10000000:00010000:0.0:1784189098.454847:0:26173:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.112@tcp lock: ffff9dc081b16400/0xcc1762b626f8abc6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xcc1762b626f8abcd expref: -99 pid: 87021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189098.454853:0:26173:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.112@tcp lock: ffff9dc081b16400/0xcc1762b626f8abc6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0xcc1762b626f8abcd expref: -99 pid: 87021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189098.455064:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1784189098.455102:0:63468:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9dc05ed22800 for lustre-MDT0000 00000100:00100000:2.0:1784189098.455385:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc080f6e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bd553d0d-03e2-4233-b06b-b55bbfa2b954:3640:1870854458080640:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1784189098.455452:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1784189098.455478:0:88340:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff9dc081b17c00/0xcc1762b626f8aadf lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc1762b626f8aae6 expref: -99 pid: 87021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189098.455490:0:88340:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff9dc081b17c00/0xcc1762b626f8aadf lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xcc1762b626f8aae6 expref: -99 pid: 87021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189098.455498:0:88340:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff9dc081b17c00/0xcc1762b626f8aadf lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xcc1762b626f8aae6 expref: -99 pid: 87021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189098.455504:0:7454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784189098.455506:0:88340:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.112@tcp lock: ffff9dc081b17c00/0xcc1762b626f8aadf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xcc1762b626f8aae6 expref: -99 pid: 87021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784189098.455506:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1784189098.455515:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc080f6e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bd553d0d-03e2-4233-b06b-b55bbfa2b954:3640:1870854458080768:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1784189098.455530:0:88340:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1784189098.455536:0:88340:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 10000000:01000000:3.0:1784189098.455540:0:88340:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00000100:00100000:2.0:1784189098.455541:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784189098.455582:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458080640 00010000:00010000:3.0:1784189098.455587:0:6501:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:2.0:1784189098.455589:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458080640 00010000:00010000:3.0:1784189098.455594:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.112@tcp lock: ffff9dc081b17c00/0xcc1762b626f8aadf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xcc1762b626f8aae6 expref: -99 pid: 87021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189098.455609:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc081b17c00 already unused, calling callback (ffffffffc114ac20) 10000000:00010000:3.0:1784189098.455613:0:6501:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.112@tcp lock: ffff9dc081b17c00/0xcc1762b626f8aadf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xcc1762b626f8aae6 expref: -99 pid: 87021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189098.455621:0:6501:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.112@tcp lock: ffff9dc081b17c00/0xcc1762b626f8aadf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xcc1762b626f8aae6 expref: -99 pid: 87021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784189098.455626:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458080768 10000000:00010000:3.0:1784189098.455628:0:6501:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.112@tcp lock: ffff9dc081b17c00/0xcc1762b626f8aadf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xcc1762b626f8aae6 expref: -99 pid: 87021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784189098.455635:0:6501:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 00000100:00100000:2.0:1784189098.455637:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458080768 10000000:01000000:3.0:1784189098.455640:0:6501:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:3.0:1784189098.455642:0:6501:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00000100:00100000:2.0:1784189098.455662:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 690 00010000:00010000:3.0:1784189098.455664:0:6501:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.112@tcp lock: ffff9dc081b17c00/0xcc1762b626f8aadf lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xcc1762b626f8aae6 expref: -99 pid: 87021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784189098.455672:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf469b4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bd553d0d-03e2-4233-b06b-b55bbfa2b954+24:3640:x1870854458080640:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1784189098.455683:0:6499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784189098.455696:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dc081b17800/0xcc1762b626f8aaf4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xcc1762b626f8aaed expref: 24 pid: 87034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189098.455721:0:6499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784189098.455749:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf469b4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bd553d0d-03e2-4233-b06b-b55bbfa2b954+23:3640:x1870854458080640:12345-0@lo:103:ldlm_bl.0 Request processed in 80us (299us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189098.455755:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 690 00000100:00100000:2.0:1784189098.455767:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 691 00000100:00100000:2.0:1784189098.455774:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf469b5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bd553d0d-03e2-4233-b06b-b55bbfa2b954+22:3640:x1870854458080768:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1784189098.455782:0:6499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784189098.455791:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dc081b16c00/0xcc1762b626f8ac05 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xcc1762b626f8abfe expref: 22 pid: 87027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189098.455802:0:6499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784189098.455820:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf469b5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bd553d0d-03e2-4233-b06b-b55bbfa2b954+21:3640:x1870854458080768:12345-0@lo:103:ldlm_bl.0 Request processed in 47us (280us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189098.455825:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 691 00010000:00010000:3.0:1784189098.455913:0:6501:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1784189098.455921:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc080f6e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bd553d0d-03e2-4233-b06b-b55bbfa2b954:3640:1870854458080768:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1784189098.455931:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc080f6e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bd553d0d-03e2-4233-b06b-b55bbfa2b954:3640:1870854458080640:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1784189098.455942:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.112@tcp lock: ffff9dc081b17c00/0xcc1762b626f8aadf lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xcc1762b626f8aae6 expref: -99 pid: 87021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189098.455951:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.112@tcp lock: ffff9dc081b17c00/0xcc1762b626f8aadf lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xcc1762b626f8aae6 expref: -99 pid: 87021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189098.455962:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784189098.455964:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784189098.455966:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1784189098.455982:0:88340:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-MDT0000 00000020:01000000:3.0:1784189098.455986:0:88340:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='FA') 00000020:00000080:3.0:1784189098.455990:0:88340:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:02000400:3.0:1784189098.455996:0:88340:0:(obd_config.c:932:class_cleanup()) Failing over lustre-MDT0000 00000100:00100000:1.0:1784189098.456293:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc080e7dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bd553d0d-03e2-4233-b06b-b55bbfa2b954:3642:1870854458080896:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1784189098.456351:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784189098.456610:0:25703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458080896 00000100:00100000:2.0:1784189098.456615:0:25703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458080896 00000100:00100000:2.0:1784189098.456641:0:25703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 692 00000100:00100000:2.0:1784189098.456646:0:25703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc05edd0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:bd553d0d-03e2-4233-b06b-b55bbfa2b954+21:3642:x1870854458080896:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1784189098.456663:0:25703:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784189098.456673:0:25703:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dc081b17600/0xcc1762b626f8aae6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xcc1762b626f8aadf expref: 21 pid: 87034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189098.456682:0:25703:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784189098.456724:0:25703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc05edd0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:bd553d0d-03e2-4233-b06b-b55bbfa2b954+20:3642:x1870854458080896:12345-0@lo:103:ldlm_bl.0 Request processed in 77us (373us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189098.456731:0:25703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 692 00000100:00100000:1.0:1784189098.456815:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc080e7dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bd553d0d-03e2-4233-b06b-b55bbfa2b954:3642:1870854458080896:0@lo:103:ldlm_bl.0 10000000:00010000:0.0:1784189098.457134:0:26173:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.112@tcp lock: ffff9dc081b16400/0xcc1762b626f8abc6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0xcc1762b626f8abcd expref: -99 pid: 87021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784189098.457142:0:26173:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:0.0:1784189098.457145:0:26173:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:0.0:1784189098.457148:0:26173:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:0.0:1784189098.457170:0:26173:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.112@tcp lock: ffff9dc081b16400/0xcc1762b626f8abc6 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xcc1762b626f8abcd expref: -99 pid: 87021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189098.457237:0:26173:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1784189098.457343:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00010000:00010000:0.0:1784189098.457375:0:26173:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.112@tcp lock: ffff9dc081b16400/0xcc1762b626f8abc6 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xcc1762b626f8abcd expref: -99 pid: 87021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189098.457390:0:26173:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.112@tcp lock: ffff9dc081b16400/0xcc1762b626f8abc6 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xcc1762b626f8abcd expref: -99 pid: 87021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189098.457400:0:26173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784189098.457402:0:26173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784189098.457404:0:26173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784189098.457470:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc080f6e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bd553d0d-03e2-4233-b06b-b55bbfa2b954:3642:1870854458081024:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1784189098.457502:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784189098.457600:0:26172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458081024 00000100:00100000:0.0:1784189098.457605:0:26172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458081024 00000100:00100000:0.0:1784189098.457679:0:26172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 693 00000100:00100000:0.0:1784189098.457687:0:26172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc05edd0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:bd553d0d-03e2-4233-b06b-b55bbfa2b954+20:3642:x1870854458081024:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1784189098.457696:0:26172:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784189098.457718:0:26172:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dc04a20b400/0xcc1762b626f8abcd lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xcc1762b626f8abc6 expref: 20 pid: 87027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189098.457728:0:26172:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784189098.457768:0:26172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc05edd0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:bd553d0d-03e2-4233-b06b-b55bbfa2b954+19:3642:x1870854458081024:12345-0@lo:103:ldlm_bl.0 Request processed in 82us (265us total) trans 0 rc 0/0 00000100:00100000:0.0:1784189098.457774:0:26172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 693 00000100:00100000:2.0:1784189098.457832:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc080f6e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bd553d0d-03e2-4233-b06b-b55bbfa2b954:3642:1870854458081024:0@lo:103:ldlm_bl.0 00000004:00000080:3.0:1784189098.458938:0:88340:0:(mdt_handler.c:8168:mdt_iocontrol()) lustre-MDT0000: cmd=40086672 len=0 karg=0000000000000000 uarg=0000000000000000 00000001:00080000:1.0:1784189098.459433:0:87022:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 103079215116 is committed 00010000:00010000:2.0:1784189098.459475:0:3626:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0565e6600/0xcc1762b626f8b05e lrc: 3/0,1 mode: TXN/TXN res: [0x20000a811:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189098.459486:0:3626:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0565e6600/0xcc1762b626f8b05e lrc: 2/0,0 mode: TXN/TXN res: [0x20000a811:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189098.459494:0:3626:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0565e6600/0xcc1762b626f8b05e lrc: 3/0,0 mode: TXN/TXN res: [0x20000a811:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189098.459500:0:3626:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc0565e6600 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:2.0:1784189098.459505:0:3626:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0565e6600/0xcc1762b626f8b05e lrc: 3/0,0 mode: TXN/TXN res: [0x20000a811:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189098.459513:0:3626:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0565e6600/0xcc1762b626f8b05e lrc: 4/0,0 mode: TXN/TXN res: [0x20000a811:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189098.459530:0:3626:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x6:0x0].0x0 (ffff9dc082150400) 00010000:00010000:2.0:1784189098.459533:0:3626:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784189098.459538:0:3626:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0565e6600/0xcc1762b626f8b05e lrc: 2/0,0 mode: --/TXN res: [0x20000a811:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189098.459556:0:3626:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0565e6600/0xcc1762b626f8b05e lrc: 0/0,0 mode: --/TXN res: [0x20000a811:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00000080:3.0:1784189098.459724:0:88340:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 5/11 00000020:00080000:3.0:1784189098.459731:0:88340:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff9dc07a882800 lustre-MDT0000-lwp-MDT0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1784189098.459737:0:88340:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff9dc05ed20800 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1784189098.459741:0:88340:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff9dc05ed59000 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1784189098.459746:0:88340:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff9dbf430fc800 lustre-MDT0001-mdtlov_UUID 0@lo 5 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1784189098.459752:0:88340:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff9dbf430fb800 b90fcc1c-0e69-42a4-a116-a71fec7aeb78 192.168.203.12@tcp 8 (0 0 3) 0 0 0 0: 0000000000000000 103079215116 stale:0 00000020:00080000:3.0:1784189098.459757:0:88340:0:(genops.c:1574:class_disconnect_exports()) OBD device 13 (ffff9dbf449f3380) has exports, disconnecting them 00000020:00080000:3.0:1784189098.459762:0:88340:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9dc07a882800), last request at 1784189073 00000020:00000080:3.0:1784189098.459768:0:88340:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xcc1762b626f8acec 00000100:00080000:3.0:1784189098.459775:0:88340:0:(import.c:65:import_set_state_nolock()) ffff9dc07a885000 : changing import state from FULL to CLOSED 00000020:00080000:3.0:1784189098.459875:0:88340:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9dc07a882800): rc 0 00000020:00000080:3.0:1784189098.459878:0:88340:0:(genops.c:906:class_export_put()) final put ffff9dc07a882800/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00080000:3.0:1784189098.459896:0:88340:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9dc05ed20800), last request at 1784189093 00000020:00000080:3.0:1784189098.459903:0:88340:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xcc1762b626f8ace5 00000100:00080000:3.0:1784189098.459907:0:88340:0:(import.c:65:import_set_state_nolock()) ffff9dc05ed22000 : changing import state from FULL to CLOSED 00000020:00000080:0.0:1784189098.459935:0:63468:0:(genops.c:865:class_export_destroy()) destroying export ffff9dc07a882800/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000 00000020:00000080:0.0:1784189098.459982:0:63468:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9dc07a885000 for lustre-MDT0000 00010000:00010000:2.0:1784189098.460209:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:3.0:1784189098.460273:0:88340:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9dc05ed20800): rc 0 00000020:00000080:3.0:1784189098.460275:0:88340:0:(genops.c:906:class_export_put()) final put ffff9dc05ed20800/lustre-MDT0000-lwp-OST0001_UUID 00000020:00080000:3.0:1784189098.460342:0:88340:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9dc05ed59000), last request at 1784189093 00000020:00000080:3.0:1784189098.460346:0:88340:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xcc1762b626f8acde 00000100:00080000:3.0:1784189098.460352:0:88340:0:(import.c:65:import_set_state_nolock()) ffff9dbf436c4800 : changing import state from FULL to CLOSED 00010000:00010000:1.0:1784189098.460387:0:7454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1784189098.460434:0:27065:0:(genops.c:865:class_export_destroy()) destroying export ffff9dc05ed20800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000020:00080000:3.0:1784189098.460596:0:88340:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9dc05ed59000): rc 0 00000020:00000080:3.0:1784189098.460599:0:88340:0:(genops.c:906:class_export_put()) final put ffff9dc05ed59000/lustre-MDT0000-lwp-OST0000_UUID 00010000:00010000:2.0:1784189098.460656:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1784189098.461059:0:27065:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9dc05ed22000 for lustre-MDT0000 00000020:00080000:3.0:1784189098.461118:0:88340:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9dbf430fc800), last request at 1784189067 00000020:00000080:3.0:1784189098.461129:0:88340:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xcc1762b626f8ab48 00000100:00080000:3.0:1784189098.461141:0:88340:0:(import.c:65:import_set_state_nolock()) ffff9dbf436c2000 : changing import state from FULL to CLOSED 00000020:00080000:3.0:1784189098.461201:0:88340:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9dbf430fc800): rc 0 00000020:00000080:3.0:1784189098.461203:0:88340:0:(genops.c:906:class_export_put()) final put ffff9dbf430fc800/lustre-MDT0001-mdtlov_UUID 00010000:00010000:1.0:1784189098.461240:0:26173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1784189098.461270:0:27065:0:(genops.c:865:class_export_destroy()) destroying export ffff9dc05ed59000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00000080:0.0:1784189098.461304:0:27065:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9dbf436c4800 for lustre-MDT0000 00000020:00080000:3.0:1784189098.461525:0:88340:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 192.168.203.12@tcp (ffff9dbf430fb800), last request at 1784189096 00000020:00000080:3.0:1784189098.461530:0:88340:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xcc1762b626f8ab41 00000020:00010000:3.0:1784189098.461536:0:88340:0:(genops.c:1942:obd_stale_export_put()) Put export ffff9dbf430fb800: total 1 00000100:00080000:3.0:1784189098.461540:0:88340:0:(import.c:65:import_set_state_nolock()) ffff9dc07b5d1800 : changing import state from FULL to CLOSED 00000020:00080000:3.0:1784189098.461601:0:88340:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 192.168.203.12@tcp (ffff9dbf430fb800): rc 0 00000004:00000080:3.0:1784189098.461608:0:88340:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffae09816ebae0 00000100:00080000:3.0:1784189098.461628:0:88340:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1784189098.461632:0:88340:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 3 00000020:00010000:2.0:1784189098.461748:0:6502:0:(genops.c:1928:obd_stale_export_get()) Get export ffff9dbf430fb800: total 1 00010000:00010000:2.0:1784189098.461813:0:6502:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff9dbf430fb800, canceled 0 locks, left on hash table 3. 00010000:00010000:2.0:1784189098.461848:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4369d400/0xcc1762b626f8af31 lrc: 0/0,0 mode: --/PR res: [0x20000a811:0x3:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c3d5a expref: 4 pid: 66170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189098.461876:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4369ce00/0xcc1762b626f8b057 lrc: 0/0,0 mode: --/PR res: [0x20000a811:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c3da7 expref: 3 pid: 66170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189098.461892:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0755a5000/0xcc1762b626f8b042 lrc: 0/0,0 mode: --/PW res: [0x20000a811:0x6:0x0].0x0 bits 0x59/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c3da0 expref: 2 pid: 66169 timeout: 3439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189098.461907:0:6502:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff9dbf430fb800, canceled 3 locks, left on hash table 0. 00000100:00080000:3.0:1784189098.464503:0:88340:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000100:00080000:3.0:1784189098.464539:0:88340:0:(import.c:65:import_set_state_nolock()) ffff9dbf47268000 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:0.0:1784189098.464791:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc080e7dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3639:1870854458081152:0@lo:39:umount.0 00000100:00100000:0.0:1784189098.464860:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00000080:1.0:1784189098.465530:0:63468:0:(genops.c:865:class_export_destroy()) destroying export ffff9dbf430fc800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000 00000020:00000080:1.0:1784189098.465648:0:63468:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9dbf436c2000 for lustre-MDT0000 00000100:00100000:0.0:1784189098.465843:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458081152 00000100:00100000:0.0:1784189098.465851:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458081152 00000100:00100000:0.0:1784189098.465904:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3757 00000100:00100000:0.0:1784189098.465913:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc080f6e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3639:x1870854458081152:12345-0@lo:39:umount.0 00000020:00000080:0.0:1784189098.465940:0:8439:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xcc1762b626f8ab80 00000100:00080000:0.0:1784189098.465947:0:8439:0:(import.c:65:import_set_state_nolock()) ffff9dc047a82000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1784189098.465965:0:8439:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 19, last_transno is 81604378732 00000100:00100000:0.0:1784189098.466119:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc080f6e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+3:3639:x1870854458081152:12345-0@lo:39:umount.0 Request processed in 206us (1257us total) trans 81604378733 rc 0/0 00000100:00100000:0.0:1784189098.466126:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3757 00000100:00080000:0.0:1784189098.466167:0:3639:0:(import.c:65:import_set_state_nolock()) ffff9dbf47268000 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:0.0:1784189098.466174:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc080e7dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3639:1870854458081152:0@lo:39:umount.0 00000100:00080000:3.0:1784189098.466271:0:88340:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1784189098.466274:0:88340:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294968949 gen 3 00010000:00010000:1.0:1784189098.466395:0:7454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1784189098.466900:0:88340:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:3.0:1784189098.467173:0:88340:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:3.0:1784189098.467196:0:88340:0:(import.c:65:import_set_state_nolock()) ffff9dc0477b2800 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:3.0:1784189098.467217:0:88340:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1784189098.467220:0:88340:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294968953 gen 3 00000004:00080000:3.0:1784189098.467230:0:88340:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:3.0:1784189098.467829:0:88340:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:3.0:1784189098.467844:0:88340:0:(import.c:65:import_set_state_nolock()) ffff9dbf43fc9000 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:3.0:1784189098.467888:0:88340:0:(genops.c:1579:class_disconnect_exports()) OBD device 13 (ffff9dbf449f3380) has no exports 00000020:00080000:3.0:1784189098.469640:0:88340:0:(genops.c:1579:class_disconnect_exports()) OBD device 13 (ffff9dbf449f3380) has no exports 00000100:00100000:0.0:1784189098.470463:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc080e7e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3639:1870854458081280:0@lo:9:umount.0 00000100:00100000:0.0:1784189098.470538:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784189098.470573:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc080e7fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3639:1870854458081408:0@lo:9:umount.0 00000100:00100000:0.0:1784189098.470593:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784189098.470625:0:26164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458081280 00000100:00100000:0.0:1784189098.470632:0:26164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458081280 00000100:00100000:0.0:1784189098.471118:0:26164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458081408 00000100:00100000:0.0:1784189098.471123:0:26164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458081408 00000100:00100000:0.0:1784189098.471153:0:26164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4939 00000100:00100000:0.0:1784189098.471162:0:26164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc080f6e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+5:3639:x1870854458081280:12345-0@lo:9:umount.0 00000020:00000080:0.0:1784189098.471187:0:26164:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xcc1762b626f8aba3 00000100:00080000:0.0:1784189098.471196:0:26164:0:(import.c:65:import_set_state_nolock()) ffff9dbf43fcb000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1784189098.471235:0:26164:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294968949 00000100:00100000:0.0:1784189098.471402:0:26164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc080f6e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+2:3639:x1870854458081280:12345-0@lo:9:umount.0 Request processed in 241us (863us total) trans 0 rc 0/0 00000100:00100000:0.0:1784189098.471427:0:26164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4939 00000100:00100000:0.0:1784189098.471442:0:26164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4940 00000100:00100000:0.0:1784189098.471447:0:26164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc05ed78380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+5:3639:x1870854458081408:12345-0@lo:9:umount.0 00000020:00000080:0.0:1784189098.471458:0:26164:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xcc1762b626f8abb1 00000100:00080000:0.0:1784189098.471463:0:26164:0:(import.c:65:import_set_state_nolock()) ffff9dc0477d3800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1784189098.471490:0:26164:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294968953 00000100:00100000:0.0:1784189098.471568:0:26164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc05ed78380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+2:3639:x1870854458081408:12345-0@lo:9:umount.0 Request processed in 120us (973us total) trans 0 rc 0/0 00000100:00100000:0.0:1784189098.471575:0:26164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4940 00000100:00080000:0.0:1784189098.471596:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1784189098.471600:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1784189098.471614:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1784189098.471641:0:3639:0:(import.c:65:import_set_state_nolock()) ffff9dc0477b2800 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:0.0:1784189098.471652:0:3639:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:0.0:1784189098.471655:0:3639:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1784189098.471658:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc080e7e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3639:1870854458081280:0@lo:9:umount.0 00000100:00080000:0.0:1784189098.471669:0:3639:0:(import.c:65:import_set_state_nolock()) ffff9dbf43fc9000 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00010000:00010000:1.0:1784189098.471978:0:26173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1784189098.472055:0:3639:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:0.0:1784189098.477469:0:3639:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1784189098.477486:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc080e7fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3639:1870854458081408:0@lo:9:umount.0 00000020:00000080:2.0:1784189098.511674:0:6502:0:(genops.c:906:class_export_put()) final put ffff9dbf430fb800/b90fcc1c-0e69-42a4-a116-a71fec7aeb78 00010000:00010000:2.0:1784189098.511698:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784189098.511712:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784189098.511715:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1784189098.512396:0:27065:0:(genops.c:865:class_export_destroy()) destroying export ffff9dbf430fb800/b90fcc1c-0e69-42a4-a116-a71fec7aeb78 for lustre-MDT0000 00000020:00000080:0.0:1784189098.512453:0:27065:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9dc07b5d1800 for lustre-MDT0000 00000020:00000080:3.0:1784189098.529078:0:88340:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xcc1762b626f8ab5d 00000020:00000080:3.0:1784189098.529094:0:88340:0:(genops.c:906:class_export_put()) final put ffff9dc07118d800/lustre-QMT0000_UUID 00000020:01000000:3.0:1784189098.529162:0:88340:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:0.0:1784189098.529200:0:88340:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1784189098.529212:0:88340:0:(obd_config.c:955:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1784189098.529217:0:88340:0:(genops.c:1579:class_disconnect_exports()) OBD device 15 (ffff9dc07547b380) has no exports 00000020:00000080:0.0:1784189098.529658:0:88340:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xcc1762b626f8ab56 00000020:00000080:0.0:1784189098.529665:0:88340:0:(genops.c:906:class_export_put()) final put ffff9dc07118b800/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1784189098.529767:0:63468:0:(genops.c:865:class_export_destroy()) destroying export ffff9dc07118d800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:0.0:1784189098.530539:0:88340:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1784189098.530565:0:88340:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:0.0:1784189098.530568:0:88340:0:(genops.c:906:class_export_put()) final put ffff9dc07118f800/lustre-QMT0000_UUID 00000020:00000080:0.0:1784189098.530571:0:88340:0:(genops.c:865:class_export_destroy()) destroying export ffff9dc07118f800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:0.0:1784189098.530577:0:88340:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00000020:00000080:1.0:1784189098.530761:0:63468:0:(genops.c:865:class_export_destroy()) destroying export ffff9dc07118b800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:0.0:1784189098.531069:0:88340:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9dc081c45540 - data ffff9dc06bd9b798/ffff9dbf43728400 00000020:01000000:0.0:1784189098.531207:0:88340:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9dc0493706c0 - data ffff9dc0704cf000/ffff9dbf448b0000 00000100:00080000:0.0:1784189098.580915:0:88340:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1784189098.580923:0:88340:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:0.0:1784189098.580939:0:88340:0:(client.c:3150:ptlrpc_free_committed()) @@@ free request with old gen req@ffff9dc080e7dc00 x1870854458081152/t81604378733(81604378733) o39->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1784189108 ref 1 fl Complete:RNQU/204/0 rc 0/0 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784189098.580963:0:88340:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:0.0:1784189098.586907:0:88340:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1784189098.586917:0:88340:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294968949 gen 4 00000004:00080000:0.0:1784189098.586948:0:88340:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1784189098.586951:0:88340:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:3.0:1784189098.588339:0:87041:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:3.0:1784189098.588346:0:87041:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x60:0x0] index 1 count 1 00000040:00080000:3.0:1784189098.588380:0:87041:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 24 count 2 00000100:00080000:0.0:1784189098.590553:0:88340:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1784189098.590562:0:88340:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294968953 gen 4 00000004:00080000:0.0:1784189098.590589:0:88340:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1784189098.590592:0:88340:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:2.0:1784189098.591498:0:87043:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:2.0:1784189098.591504:0:87043:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x62:0x0] index 1 count 1 00000040:00080000:2.0:1784189098.591516:0:87043:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 24 count 2 00000020:00000080:3.0:1784189098.593046:0:88340:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xcc1762b626f8ab09 00000020:00000080:3.0:1784189098.593058:0:88340:0:(genops.c:906:class_export_put()) final put ffff9dbf43697000/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1784189098.593691:0:88340:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xcc1762b626f8ab1e 00000020:00000080:3.0:1784189098.593697:0:88340:0:(genops.c:906:class_export_put()) final put ffff9dc0477b6000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:3.0:1784189098.593712:0:88340:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:3.0:1784189098.593717:0:88340:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1784189098.593728:0:88340:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1784189098.593731:0:88340:0:(genops.c:1579:class_disconnect_exports()) OBD device 12 (ffff9dbf449f0000) has no exports 00000004:01000000:3.0:1784189098.593867:0:88340:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:3.0:1784189098.593874:0:88340:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xcc1762b626f8abaa 00000020:00000080:3.0:1784189098.593877:0:88340:0:(genops.c:906:class_export_put()) final put ffff9dc05ed5b800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:3.0:1784189098.593881:0:88340:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:3.0:1784189098.593884:0:88340:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1784189098.593891:0:88340:0:(obd_config.c:955:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1784189098.593893:0:88340:0:(genops.c:1579:class_disconnect_exports()) OBD device 27 (ffff9dc06bb34d40) has no exports 00000020:00000080:3.0:1784189098.593898:0:88340:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xcc1762b626f8ab9c 00000020:00000080:3.0:1784189098.593901:0:88340:0:(genops.c:906:class_export_put()) final put ffff9dbf43d8e000/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1784189098.594046:0:63468:0:(genops.c:865:class_export_destroy()) destroying export ffff9dbf43697000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1784189098.594058:0:63468:0:(genops.c:865:class_export_destroy()) destroying export ffff9dc0477b6000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:00000080:2.0:1784189098.594062:0:63468:0:(genops.c:865:class_export_destroy()) destroying export ffff9dc05ed5b800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:00000080:2.0:1784189098.594066:0:63468:0:(genops.c:865:class_export_destroy()) destroying export ffff9dbf43d8e000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:3.0:1784189098.594509:0:88340:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:3.0:1784189098.594514:0:88340:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1784189098.594517:0:88340:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294968953 gen 5 00000004:00080000:3.0:1784189098.594522:0:88340:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1784189098.594525:0:88340:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1784189098.594596:0:88340:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1784189098.594607:0:88340:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1784189098.594611:0:88340:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xcc1762b626f8ab8e 00000020:00000080:3.0:1784189098.594616:0:88340:0:(genops.c:906:class_export_put()) final put ffff9dc0477b1800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1784189098.595151:0:63468:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9dbf43fc9000 for lustre-OST0001-osc-MDT0000 00000020:00000080:2.0:1784189098.595158:0:63468:0:(genops.c:906:class_export_put()) final put ffff9dc0477b0000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1784189098.595160:0:63468:0:(genops.c:865:class_export_destroy()) destroying export ffff9dc0477b0000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:2.0:1784189098.595165:0:63468:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:01000000:3.0:1784189098.595268:0:88340:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:3.0:1784189098.595273:0:88340:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1784189098.595279:0:88340:0:(obd_config.c:955:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1784189098.595282:0:88340:0:(genops.c:1579:class_disconnect_exports()) OBD device 22 (ffff9dc06bb33380) has no exports 00000020:00000080:3.0:1784189098.595287:0:88340:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xcc1762b626f8ab87 00000020:00000080:3.0:1784189098.595298:0:88340:0:(genops.c:906:class_export_put()) final put ffff9dc0477b1000/lustre-MDT0000-osd_UUID 00010000:01000000:3.0:1784189098.595625:0:88340:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:3.0:1784189098.595628:0:88340:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1784189098.595631:0:88340:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294968949 gen 5 00000004:00080000:3.0:1784189098.595635:0:88340:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1784189098.595637:0:88340:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1784189098.595661:0:88340:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1784189098.595667:0:88340:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000004:01000000:3.0:1784189098.595676:0:88340:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:3.0:1784189098.595681:0:88340:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xcc1762b626f8ab72 00000020:00000080:3.0:1784189098.595684:0:88340:0:(genops.c:906:class_export_put()) final put ffff9dbf43d89000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:3.0:1784189098.595688:0:88340:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osp-MDT0000 (flags='') 00000020:00000080:3.0:1784189098.595691:0:88340:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1784189098.595695:0:88340:0:(obd_config.c:955:class_cleanup()) lustre-MDT0001-osp-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1784189098.595698:0:88340:0:(genops.c:1579:class_disconnect_exports()) OBD device 21 (ffff9dbf431299c0) has no exports 00000020:00000080:3.0:1784189098.595712:0:88340:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xcc1762b626f8ab6b 00000020:00000080:3.0:1784189098.595714:0:88340:0:(genops.c:906:class_export_put()) final put ffff9dc05801e800/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1784189098.596501:0:63468:0:(genops.c:865:class_export_destroy()) destroying export ffff9dc0477b1800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:00000080:2.0:1784189098.596512:0:63468:0:(genops.c:865:class_export_destroy()) destroying export ffff9dc0477b1000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1784189098.596517:0:63468:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9dc0477b2800 for lustre-OST0000-osc-MDT0000 00000020:00000080:2.0:1784189098.596522:0:63468:0:(genops.c:906:class_export_put()) final put ffff9dbf43d8d800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1784189098.596524:0:63468:0:(genops.c:865:class_export_destroy()) destroying export ffff9dbf43d8d800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:2.0:1784189098.596527:0:63468:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1784189098.596580:0:63468:0:(genops.c:865:class_export_destroy()) destroying export ffff9dbf43d89000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:00000080:2.0:1784189098.596585:0:63468:0:(genops.c:865:class_export_destroy()) destroying export ffff9dc05801e800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:2.0:1784189098.596610:0:88340:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0001-osp-MDT0000: client import never connected 00000100:00080000:2.0:1784189098.596613:0:88340:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1784189098.596615:0:88340:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:2.0:1784189098.596619:0:88340:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1784189098.596651:0:88340:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1784189098.596659:0:88340:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1784189098.596682:0:88340:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1784189098.596686:0:88340:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1784189098.596689:0:88340:0:(genops.c:906:class_export_put()) final put ffff9dc058019000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1784189098.596692:0:88340:0:(genops.c:865:class_export_destroy()) destroying export ffff9dc058019000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:2.0:1784189098.596696:0:88340:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1784189098.596762:0:88340:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xcc1762b626f8ab25 00000020:00000080:2.0:1784189098.596768:0:88340:0:(genops.c:906:class_export_put()) final put ffff9dc0477b4000/lustre-MDD0000_UUID 00000020:01000000:2.0:1784189098.596772:0:88340:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:2.0:1784189098.596775:0:88340:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1784189098.596779:0:88340:0:(obd_config.c:955:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1784189098.596791:0:88340:0:(genops.c:1579:class_disconnect_exports()) OBD device 14 (ffff9dbf449f4d40) has no exports 00000020:00000080:2.0:1784189098.596810:0:88340:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1784189098.596814:0:88340:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:2.0:1784189098.596818:0:88340:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xcc1762b626f8ab2c 00000020:00000080:2.0:1784189098.596822:0:88340:0:(genops.c:906:class_export_put()) final put ffff9dc0477b2000/lustre-MDT0000-osd_UUID 00000020:01000004:2.0:1784189098.596827:0:88340:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9dc06b3eb800 from lustre-MDT0000, refs=3 00000020:01000004:2.0:1784189098.596830:0:88340:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9dc06b3eb800 3 00000020:01000004:2.0:1784189098.596833:0:88340:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9dc06b3eb800 from lustre-MDT0000 00000020:00000080:2.0:1784189098.596850:0:88340:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1784189098.596853:0:88340:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:2.0:1784189098.596855:0:88340:0:(genops.c:906:class_export_put()) final put ffff9dbf43691000/lustre-MDT0000_UUID 00000020:00000080:2.0:1784189098.596857:0:88340:0:(genops.c:865:class_export_destroy()) destroying export ffff9dbf43691000/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:2.0:1784189098.596863:0:88340:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:2.0:1784189098.596891:0:88340:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 3 references. 00000020:01000004:2.0:1784189098.596894:0:88340:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:2.0:1784189098.596897:0:88340:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:2.0:1784189098.596900:0:88340:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1784189098.596902:0:88340:0:(obd_config.c:955:class_cleanup()) MGS: forcing exports to disconnect: 2/5 00000020:00080000:2.0:1784189098.596910:0:88340:0:(genops.c:1840:print_export_data()) MGS: ACTIVE ffff9dbf42276800 9957a2dc-fd88-4a91-bca3-e2b7f365ab0c 192.168.203.12@tcp 9 (0 0 4) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1784189098.596916:0:88340:0:(genops.c:1840:print_export_data()) MGS: ACTIVE ffff9dbf4512b000 bd553d0d-03e2-4233-b06b-b55bbfa2b954 0@lo 18 (0 0 13) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1784189098.596920:0:88340:0:(genops.c:1574:class_disconnect_exports()) OBD device 3 (ffff9dc075478000) has exports, disconnecting them 00000020:00080000:2.0:1784189098.596924:0:88340:0:(genops.c:1549:class_disconnect_export_list()) MGS: disconnecting export at 192.168.203.12@tcp (ffff9dbf42276800), last request at 1784189068 00000020:00000080:2.0:1784189098.596942:0:88340:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xcc1762b626f8abf7 00000020:00010000:2.0:1784189098.596946:0:88340:0:(genops.c:1942:obd_stale_export_put()) Put export ffff9dbf42276800: total 2 00000100:00080000:2.0:1784189098.596950:0:88340:0:(import.c:65:import_set_state_nolock()) ffff9dbf42275000 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1784189098.596964:0:88340:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 192.168.203.12@tcp (ffff9dbf42276800): rc 0 00000020:00080000:2.0:1784189098.596967:0:88340:0:(genops.c:1549:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff9dbf4512b000), last request at 1784189067 00000020:00000080:2.0:1784189098.597003:0:88340:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xcc1762b626f8aad8 00000020:00010000:2.0:1784189098.597007:0:88340:0:(genops.c:1942:obd_stale_export_put()) Put export ffff9dbf4512b000: total 2 00000100:00080000:2.0:1784189098.597010:0:88340:0:(import.c:65:import_set_state_nolock()) ffff9dc0756a4000 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1784189098.597017:0:88340:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9dbf4512b000): rc 0 00000020:00080000:2.0:1784189098.597027:0:88340:0:(genops.c:1579:class_disconnect_exports()) OBD device 3 (ffff9dc075478000) has no exports 00000100:00100000:2.0:1784189098.597080:0:87031:0:(service.c:3183:ptlrpc_main()) ll_mgs_0003: service thread [ffff9dc05ed87800:87031] 3 exiting: rc = 0 00000100:00100000:2.0:1784189098.597181:0:87026:0:(service.c:3183:ptlrpc_main()) ll_mgs_0000: service thread [ffff9dc05f221200:87026] 0 exiting: rc = 1 00000020:00010000:0.0:1784189098.597296:0:6501:0:(genops.c:1928:obd_stale_export_get()) Get export ffff9dbf42276800: total 2 00010000:00010000:0.0:1784189098.597300:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784189098.597354:0:6501:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff9dbf42276800, canceled 0 locks, left on hash table 4. 00010000:00010000:0.0:1784189098.597383:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dc081b16e00/0xcc1762b626f8acc9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c3d3e expref: 5 pid: 87026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189098.597398:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dc0565e7e00/0xcc1762b626f8acd7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c3d4c expref: 4 pid: 87026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189098.597409:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dc04a20b600/0xcc1762b626f8acd0 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c3d45 expref: 3 pid: 87026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189098.597431:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dc04a20bc00/0xcc1762b626f8acc2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c3d37 expref: 2 pid: 87027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189098.597440:0:6501:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff9dbf42276800, canceled 4 locks, left on hash table 0. 00000020:00000080:0.0:1784189098.597456:0:6501:0:(genops.c:906:class_export_put()) final put ffff9dbf42276800/9957a2dc-fd88-4a91-bca3-e2b7f365ab0c 00000020:00010000:0.0:1784189098.597459:0:6501:0:(genops.c:1928:obd_stale_export_get()) Get export ffff9dbf4512b000: total 3 00010000:00010000:0.0:1784189098.597473:0:6501:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff9dbf4512b000, canceled 0 locks, left on hash table 13. 00010000:00010000:0.0:1784189098.597485:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dc04a20aa00/0xcc1762b626f8ac3d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xcc1762b626f8ac36 expref: 14 pid: 87034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189098.597499:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dc0565e7a00/0xcc1762b626f8ac9f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xcc1762b626f8ac98 expref: 13 pid: 87026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189098.597510:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dc081b17e00/0xcc1762b626f8ac2f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xcc1762b626f8ac28 expref: 12 pid: 87026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189098.597520:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dc070147e00/0xcc1762b626f8acad lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xcc1762b626f8aca6 expref: 11 pid: 87034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189098.597531:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dc081b17200/0xcc1762b626f8acbb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xcc1762b626f8acb4 expref: 10 pid: 87031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189098.597539:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dc04a20a200/0xcc1762b626f8ac4b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xcc1762b626f8ac44 expref: 9 pid: 87028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189098.597548:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dc04a20b200/0xcc1762b626f8ac59 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xcc1762b626f8ac52 expref: 8 pid: 87031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189098.597557:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dc0565e7800/0xcc1762b626f8ac67 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xcc1762b626f8ac60 expref: 7 pid: 87027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189098.597572:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dc04a20a000/0xcc1762b626f8ac75 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xcc1762b626f8ac6e expref: 6 pid: 87026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189098.597584:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dc081b16800/0xcc1762b626f8ac91 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xcc1762b626f8ac8a expref: 5 pid: 87026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189098.597593:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dc081b16a00/0xcc1762b626f8ac21 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xcc1762b626f8ac1a expref: 4 pid: 87028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189098.597604:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dc081b16000/0xcc1762b626f8ac83 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xcc1762b626f8ac7c expref: 3 pid: 87027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189098.597614:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dc081b16600/0xcc1762b626f8ac13 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xcc1762b626f8ac0c expref: 2 pid: 87027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189098.597622:0:6501:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff9dbf4512b000, canceled 13 locks, left on hash table 0. 00000020:00000080:0.0:1784189098.597632:0:6501:0:(genops.c:906:class_export_put()) final put ffff9dbf4512b000/bd553d0d-03e2-4233-b06b-b55bbfa2b954 00010000:00010000:0.0:1784189098.597635:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784189098.597637:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784189098.597638:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784189098.597661:0:87027:0:(service.c:3183:ptlrpc_main()) ll_mgs_0001: service thread [ffff9dc058f0ee00:87027] 1 exiting: rc = 0 00000100:00100000:0.0:1784189098.597717:0:87034:0:(service.c:3183:ptlrpc_main()) ll_mgs_0004: service thread [ffff9dc041342200:87034] 4 exiting: rc = 0 00000020:00000080:0.0:1784189098.597748:0:63468:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9dbf47268000 for lustre-MDT0001-osp-MDT0000 00000020:00000080:0.0:1784189098.597753:0:63468:0:(genops.c:906:class_export_put()) final put ffff9dc0477b3000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1784189098.597755:0:63468:0:(genops.c:865:class_export_destroy()) destroying export ffff9dc0477b3000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:01000000:0.0:1784189098.597759:0:63468:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osp-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1784189098.597792:0:63468:0:(genops.c:865:class_export_destroy()) destroying export ffff9dc0477b4000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:0.0:1784189098.597795:0:63468:0:(genops.c:906:class_export_put()) final put ffff9dbf43fbc000/lustre-MDD0000_UUID 00000020:00000080:0.0:1784189098.597802:0:63468:0:(genops.c:865:class_export_destroy()) destroying export ffff9dbf43fbc000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:0.0:1784189098.597805:0:63468:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:00000080:0.0:1784189098.597829:0:63468:0:(genops.c:865:class_export_destroy()) destroying export ffff9dc0477b2000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1784189098.597833:0:63468:0:(genops.c:865:class_export_destroy()) destroying export ffff9dbf42276800/9957a2dc-fd88-4a91-bca3-e2b7f365ab0c for MGS 00000020:00000080:0.0:1784189098.597852:0:63468:0:(genops.c:865:class_export_destroy()) destroying export ffff9dbf4512b000/bd553d0d-03e2-4233-b06b-b55bbfa2b954 for MGS 00000020:00000080:0.0:1784189098.597862:0:63468:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9dbf42275000 for MGS 00000020:00000080:0.0:1784189098.597865:0:63468:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9dc0756a4000 for MGS 00010000:00010000:0.0:1784189098.598383:0:7454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784189098.600436:0:87028:0:(service.c:3183:ptlrpc_main()) ll_mgs_0002: service thread [ffff9dbf4375ea00:87028] 2 exiting: rc = 0 00000100:00100000:2.0:1784189098.600583:0:88340:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784189098.600592:0:88340:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784189098.600598:0:88340:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784189098.600604:0:88340:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784189098.600609:0:88340:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784189098.600615:0:88340:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784189098.600621:0:88340:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784189098.600626:0:88340:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784189098.600631:0:88340:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784189098.600637:0:88340:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784189098.600642:0:88340:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784189098.600648:0:88340:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784189098.600653:0:88340:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784189098.600658:0:88340:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784189098.600664:0:88340:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784189098.600669:0:88340:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784189098.600674:0:88340:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784189098.600679:0:88340:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784189098.600683:0:88340:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784189098.600688:0:88340:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784189098.600694:0:88340:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784189098.600712:0:88340:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784189098.600719:0:88340:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784189098.600725:0:88340:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784189098.600729:0:88340:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784189098.600734:0:88340:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784189098.600739:0:88340:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784189098.600745:0:88340:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784189098.600751:0:88340:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784189098.600756:0:88340:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784189098.600761:0:88340:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784189098.600779:0:88340:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784189098.600795:0:88340:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784189098.600802:0:88340:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784189098.600807:0:88340:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784189098.600812:0:88340:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784189098.600818:0:88340:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784189098.600823:0:88340:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784189098.600828:0:88340:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784189098.600834:0:88340:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784189098.600839:0:88340:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784189098.600844:0:88340:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784189098.600850:0:88340:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784189098.600855:0:88340:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784189098.600860:0:88340:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784189098.600865:0:88340:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784189098.600870:0:88340:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784189098.600876:0:88340:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784189098.600881:0:88340:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784189098.600886:0:88340:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784189098.600891:0:88340:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784189098.600897:0:88340:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784189098.600901:0:88340:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784189098.600907:0:88340:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784189098.600912:0:88340:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784189098.600918:0:88340:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784189098.600923:0:88340:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784189098.600930:0:88340:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784189098.600935:0:88340:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784189098.600940:0:88340:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784189098.600947:0:88340:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784189098.600952:0:88340:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784189098.600959:0:88340:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784189098.600965:0:88340:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:01000000:2.0:1784189098.601729:0:88340:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9dc081c45c00 - data ffff9dbf41f87510/ffff9dc07a851800 00000020:01000000:2.0:1784189098.601853:0:88340:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9dbf43d0bcc0 - data ffff9dc0704f3948/ffff9dc0762a9400 00000020:00000080:2.0:1784189098.602246:0:88340:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xcc1762b626f8aad1 00000020:00000080:2.0:1784189098.602255:0:88340:0:(genops.c:906:class_export_put()) final put ffff9dbf45129000/lustre-MDT0000-osd_UUID 00000020:01000004:2.0:1784189098.602272:0:88340:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9dc06b3eb800 from MGS, refs=2 00000020:01000004:2.0:1784189098.602275:0:88340:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9dc06b3eb800 2 00000020:01000004:2.0:1784189098.602278:0:88340:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9dc06b3eb800 from MGS 00000020:00000080:2.0:1784189098.602297:0:88340:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1784189098.602305:0:88340:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:2.0:1784189098.602307:0:88340:0:(genops.c:906:class_export_put()) final put ffff9dbf4512b800/MGS 00000020:00000080:2.0:1784189098.602310:0:88340:0:(genops.c:865:class_export_destroy()) destroying export ffff9dbf4512b800/MGS for MGS 00000020:01000000:2.0:1784189098.602336:0:88340:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:2.0:1784189098.602400:0:88340:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:2.0:1784189098.602403:0:88340:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1784189098.602412:0:88340:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1784189098.602417:0:88340:0:(genops.c:1840:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff9dc075485800 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1784189098.602423:0:88340:0:(genops.c:1574:class_disconnect_exports()) OBD device 28 (ffff9dc07547cd40) has exports, disconnecting them 00000020:00080000:2.0:1784189098.602428:0:88340:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff9dc075485800), last request at 1784189068 00000020:00000080:2.0:1784189098.602431:0:88340:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xcc1762b626f8abe9 00000020:00080000:2.0:1784189098.602440:0:88340:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9dc075485800): rc 0 00000020:00000080:2.0:1784189098.602444:0:88340:0:(genops.c:906:class_export_put()) final put ffff9dc075485800/lustre-MDT0000-lwp-MDT0000 00000020:00000080:0.0:1784189098.604100:0:27065:0:(genops.c:865:class_export_destroy()) destroying export ffff9dbf45129000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1784189098.604114:0:27065:0:(genops.c:865:class_export_destroy()) destroying export ffff9dc075485800/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:0.0:1784189098.612394:0:88340:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:0.0:1784189098.612404:0:88340:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1784189098.612409:0:88340:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:0.0:1784189098.612417:0:88340:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1784189098.612460:0:27065:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9dc07a883800 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:0.0:1784189098.612584:0:88340:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1784189098.612596:0:88340:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:0.0:1784189098.612602:0:88340:0:(genops.c:906:class_export_put()) final put ffff9dc0755b0800/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:0.0:1784189098.612617:0:88340:0:(genops.c:865:class_export_destroy()) destroying export ffff9dc0755b0800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:0.0:1784189098.612628:0:88340:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:0.0:1784189098.612717:0:88340:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9dc06b3eb800 1 00000020:00000080:0.0:1784189098.612723:0:88340:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xcc1762b626f8aac3 00000020:00000080:0.0:1784189098.612729:0:88340:0:(genops.c:906:class_export_put()) final put ffff9dbf4512c000/lustre-MDT0000-osd_UUID 00000020:01000000:0.0:1784189098.612738:0:88340:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:0.0:1784189098.612746:0:27065:0:(genops.c:865:class_export_destroy()) destroying export ffff9dbf4512c000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1784189098.612755:0:88340:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1784189098.612759:0:88340:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1784189098.612762:0:88340:0:(genops.c:1579:class_disconnect_exports()) OBD device 0 (ffff9dc06bb319c0) has no exports 00000020:00000080:1.0:1784189098.690682:0:88340:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1784189098.690695:0:88340:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:1.0:1784189098.690708:0:88340:0:(genops.c:906:class_export_put()) final put ffff9dc06b3e9800/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1784189098.690713:0:88340:0:(genops.c:865:class_export_destroy()) destroying export ffff9dc06b3e9800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:1.0:1784189098.690722:0:88340:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:1.0:1784189098.690830:0:88340:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9dc06b3ed000 00000020:02000400:1.0:1784189098.690890:0:88340:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-MDT0000 complete 00010000:00010000:1.0:1784189098.738965:0:26173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784189099.056552:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc075663800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3642:1870854458081792:0@lo:400:kworker.0 00000100:00100000:1.0:1784189099.056620:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784189099.056648:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc05eddce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1870854458082304:0@lo:400:kworker.0 00000100:00100000:1.0:1784189099.056672:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784189099.056717:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1784189099.056724:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf4262ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3642:1870854458081920:0@lo:400:kworker.0 00000100:00100000:1.0:1784189099.056746:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784189099.056762:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc05edddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1870854458082432:0@lo:400:kworker.0 00000100:00100000:1.0:1784189099.056781:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784189099.056834:0:26166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458082304 00000100:00100000:1.0:1784189099.056840:0:26166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458082304 00000100:00100000:1.0:1784189099.056889:0:26166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458082432 00000100:00100000:1.0:1784189099.056892:0:26166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458082432 00000100:00100000:1.0:1784189099.056911:0:26166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2385 00000100:00100000:1.0:1784189099.056920:0:26166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc05eddea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+5:3642:x1870854458082304:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784189099.057045:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc075660e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3641:1870854458081664:0@lo:400:kworker.0 00000100:00100000:0.0:1784189099.057075:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784189099.057095:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf46901880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1870854458082176:0@lo:400:kworker.0 00000100:00100000:0.0:1784189099.057127:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784189099.057145:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:0.0:1784189099.057150:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc075661880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:bd553d0d-03e2-4233-b06b-b55bbfa2b954:3641:1870854458081536:0@lo:400:kworker.0 00000400:00000100:0.0:1784189099.057167:0:3641:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1870854458081536 offset 0 length 224: 4 00000100:00100000:0.0:1784189099.057187:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf4262c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3641:1870854458082048:0@lo:400:kworker.0 00000100:00100000:0.0:1784189099.057208:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784189099.057223:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc05edded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3641:1870854458082560:0@lo:400:kworker.0 00000100:00100000:0.0:1784189099.057242:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784189099.057260:0:66171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458081792 00000100:00100000:0.0:1784189099.057263:0:66171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458081792 00000100:00100000:0.0:1784189099.057281:0:66171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458081920 00000100:00100000:0.0:1784189099.057282:0:66171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458081920 00000100:00100000:0.0:1784189099.057288:0:66171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458081664 00000100:00100000:0.0:1784189099.057289:0:66171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458081664 00000100:00100000:0.0:1784189099.057293:0:66171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458082048 00000100:00100000:0.0:1784189099.057294:0:66171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458082048 00000100:00100000:0.0:1784189099.057302:0:66171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458082560 00000100:00100000:0.0:1784189099.057303:0:66171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458082560 00000100:00100000:0.0:1784189099.057309:0:66171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1097 00000100:00100000:0.0:1784189099.057313:0:66171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc05eddd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1870854458081792:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784189099.057355:0:66171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc05eddd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1870854458081792:12345-0@lo:400:kworker.0 Request processed in 41us (736us total) trans 0 rc 0/0 00000100:00100000:0.0:1784189099.057360:0:66171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1097 00000100:00100000:0.0:1784189099.057372:0:66171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1098 00000100:00100000:0.0:1784189099.057382:0:66171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc05ed78a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1870854458082048:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784189099.057403:0:66171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc05ed78a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1870854458082048:12345-0@lo:400:kworker.0 Request processed in 21us (196us total) trans 0 rc 0/0 00000100:00100000:0.0:1784189099.057407:0:66171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1098 00000100:00100000:0.0:1784189099.057415:0:66171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1155 00000100:00100000:0.0:1784189099.057418:0:66171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc05eddc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3642:x1870854458081920:12345-0@lo:400:kworker.0 00000020:00080000:0.0:1784189099.057421:0:66171:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:0.0:1784189099.057435:0:66171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc05eddc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3642:x1870854458081920:12345-0@lo:400:kworker.0 Request processed in 17us (690us total) trans 0 rc -107/-107 00000100:00100000:0.0:1784189099.057439:0:66171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1155 00000100:00100000:0.0:1784189099.057444:0:66171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1156 00000100:00100000:0.0:1784189099.057446:0:66171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc05ed7b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3641:x1870854458081664:12345-0@lo:400:kworker.0 00000020:00080000:0.0:1784189099.057449:0:66171:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:0.0:1784189099.057458:0:66171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc05ed7b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3641:x1870854458081664:12345-0@lo:400:kworker.0 Request processed in 11us (384us total) trans 0 rc -107/-107 00000100:00100000:0.0:1784189099.057461:0:66171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1156 00000100:00100000:0.0:1784189099.057466:0:66171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1157 00000100:00100000:0.0:1784189099.057468:0:66171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc05ed7ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3641:x1870854458082560:12345-0@lo:400:kworker.0 00000020:00080000:0.0:1784189099.057470:0:66171:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:0.0:1784189099.057479:0:66171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc05ed7ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3641:x1870854458082560:12345-0@lo:400:kworker.0 Request processed in 10us (237us total) trans 0 rc -107/-107 00000100:00100000:0.0:1784189099.057482:0:66171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1157 00000100:00100000:0.0:1784189099.057492:0:23826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458082176 00000100:00100000:0.0:1784189099.057494:0:23826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458082176 00000100:00100000:0.0:1784189099.057507:0:23826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3758 00000100:00100000:0.0:1784189099.057510:0:23826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc05ed7bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3641:x1870854458082176:12345-0@lo:400:kworker.0 00000020:00080000:0.0:1784189099.057513:0:23826:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:0.0:1784189099.057533:0:23826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc05ed7bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3641:x1870854458082176:12345-0@lo:400:kworker.0 Request processed in 22us (406us total) trans 0 rc -107/-107 00000100:00100000:0.0:1784189099.057537:0:23826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3758 00000100:00100000:0.0:1784189099.057566:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf4262c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3641:1870854458082048:0@lo:400:kworker.0 00000100:00080000:0.0:1784189099.057573:0:3641:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1784189099.057576:0:3641:0:(import.c:65:import_set_state_nolock()) ffff9dbf43690800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:0.0:1784189099.057579:0:3641:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:0.0:1784189099.057583:0:3641:0:(import.c:65:import_set_state_nolock()) ffff9dbf43690800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1784189099.057585:0:3641:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3315 00000100:00080000:0.0:1784189099.057589:0:3641:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff9dbf43690800 using connection 192.168.203.112@tcp/0@lo 00000100:00100000:0.0:1784189099.057606:0:3641:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9dc05ed7aa00 x1870854458082688/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1784189099.057619:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc05edded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3641:1870854458082560:0@lo:400:kworker.0 00000100:00080000:0.0:1784189099.057625:0:3641:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0000 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1784189099.057627:0:3641:0:(import.c:65:import_set_state_nolock()) ffff9dbf42271800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:0.0:1784189099.057629:0:3641:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:0.0:1784189099.057630:0:3641:0:(import.c:65:import_set_state_nolock()) ffff9dbf42271800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1784189099.057632:0:3641:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3315 00000100:00080000:0.0:1784189099.057634:0:3641:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9dbf42271800 using connection 192.168.203.112@tcp/0@lo 00000100:00100000:0.0:1784189099.057640:0:3641:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9dc05ed7b100 x1870854458082816/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1784189099.057645:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc075660e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3641:1870854458081664:0@lo:400:kworker.0 00000100:00080000:0.0:1784189099.057650:0:3641:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-osp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1784189099.057656:0:3641:0:(import.c:65:import_set_state_nolock()) ffff9dbf436c4000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:0.0:1784189099.057658:0:3641:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:0.0:1784189099.057661:0:3641:0:(import.c:65:import_set_state_nolock()) ffff9dbf436c4000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1784189099.057663:0:3641:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3315 00000100:00080000:0.0:1784189099.057665:0:3641:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9dbf436c4000 using connection 192.168.203.112@tcp/0@lo 00000100:00100000:0.0:1784189099.057673:0:3641:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9dc05ed79880 x1870854458082944/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1784189099.057679:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf46901880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1870854458082176:0@lo:400:kworker.0 00000100:00100000:0.0:1784189099.057712:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc05ed7aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3639:1870854458082688:0@lo:38:ptlrpcd_00_01.0 00000100:00100000:0.0:1784189099.057741:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784189099.057757:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc05ed7b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3639:1870854458082816:0@lo:38:ptlrpcd_00_01.0 00000100:00100000:0.0:1784189099.057774:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784189099.057785:0:68287:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458082688 00000100:00100000:0.0:1784189099.057786:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc05ed79880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3639:1870854458082944:0@lo:38:ptlrpcd_00_01.0 00000100:00100000:3.0:1784189099.057789:0:68287:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458082688 00000100:00100000:0.0:1784189099.057803:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784189099.057809:0:68287:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458082816 00000100:00100000:3.0:1784189099.057811:0:68287:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458082816 00000100:00100000:3.0:1784189099.057821:0:68287:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1158 00000100:00100000:3.0:1784189099.057826:0:68287:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf46901880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3639:x1870854458082688:12345-0@lo:38:ptlrpcd_00_01.0 00000100:00100000:0.0:1784189099.057826:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458082944 00000100:00100000:0.0:1784189099.057829:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458082944 00010000:00020000:3.0:1784189099.057843:0:68287:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1784189099.057845:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3759 00000100:00100000:0.0:1784189099.057849:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc05edded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3639:x1870854458082944:12345-0@lo:38:ptlrpcd_00_01.0 00010000:00020000:0.0:1784189099.057858:0:8439:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1784189099.057876:0:68287:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf46901880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3639:x1870854458082688:12345-0@lo:38:ptlrpcd_00_01.0 Request processed in 49us (134us total) trans 0 rc -19/-19 00000100:00100000:0.0:1784189099.057880:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc05edded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3639:x1870854458082944:12345-0@lo:38:ptlrpcd_00_01.0 Request processed in 30us (76us total) trans 0 rc -19/-19 00000100:00100000:3.0:1784189099.057882:0:68287:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1158 00000100:00100000:0.0:1784189099.057885:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3759 00000100:00100000:3.0:1784189099.057894:0:68287:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1159 00000100:00100000:3.0:1784189099.057898:0:68287:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc075660e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3639:x1870854458082816:12345-0@lo:38:ptlrpcd_00_01.0 00010000:00020000:3.0:1784189099.057907:0:68287:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00080000:0.0:1784189099.057909:0:3639:0:(import.c:65:import_set_state_nolock()) ffff9dbf43690800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1784189099.057913:0:3639:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1784189099.057920:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc05ed7aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3639:1870854458082688:0@lo:38:ptlrpcd_00_01.0 00000100:00080000:0.0:1784189099.057930:0:3639:0:(import.c:65:import_set_state_nolock()) ffff9dbf436c4000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1784189099.057933:0:3639:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1784189099.057935:0:68287:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc075660e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3639:x1870854458082816:12345-0@lo:38:ptlrpcd_00_01.0 Request processed in 36us (160us total) trans 0 rc -19/-19 00000100:00100000:0.0:1784189099.057936:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc05ed79880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3639:1870854458082944:0@lo:38:ptlrpcd_00_01.0 00000100:00100000:3.0:1784189099.057941:0:68287:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1159 00000100:00080000:0.0:1784189099.057949:0:3639:0:(import.c:65:import_set_state_nolock()) ffff9dbf42271800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1784189099.057952:0:3639:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1784189099.057961:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2386 00000100:00100000:3.0:1784189099.057969:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc05edaad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3642:x1870854458082432:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784189099.058002:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc05edaad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3642:x1870854458082432:12345-0@lo:400:kworker.0 Request processed in 34us (1219us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189099.058008:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2386 00000100:00100000:0.0:1784189099.058210:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc05ed7b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3639:1870854458082816:0@lo:38:ptlrpcd_00_01.0 00000100:00100000:1.0:1784189099.058510:0:26166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc05eddea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+5:3642:x1870854458082304:12345-0@lo:400:kworker.0 Request processed in 1590us (1835us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189099.058517:0:26166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2385 00000100:00080000:1.0:1784189099.058543:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1784189099.058547:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1784189099.058549:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1784189099.058574:0:3642:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1784189099.058577:0:3642:0:(import.c:65:import_set_state_nolock()) ffff9dbf425f4800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:1.0:1784189099.058580:0:3642:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:1.0:1784189099.058584:0:3642:0:(import.c:65:import_set_state_nolock()) ffff9dbf425f4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1784189099.058587:0:3642:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3315 00000100:00080000:1.0:1784189099.058591:0:3642:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9dbf425f4800 using connection 192.168.203.112@tcp/0@lo 00000100:00100000:1.0:1784189099.058609:0:3642:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9dc05eda9f80 x1870854458083072/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1784189099.058633:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf4262ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3642:1870854458081920:0@lo:400:kworker.0 00000100:00100000:1.0:1784189099.058657:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc05edddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1870854458082432:0@lo:400:kworker.0 00000100:00100000:1.0:1784189099.058667:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc075663800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3642:1870854458081792:0@lo:400:kworker.0 00000100:00100000:1.0:1784189099.058676:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc05eddce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1870854458082304:0@lo:400:kworker.0 00000100:00100000:3.0:1784189099.058735:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc05eda9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3639:1870854458083072:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:3.0:1784189099.058768:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784189099.058904:0:66170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458083072 00000100:00100000:1.0:1784189099.058910:0:66170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458083072 00000100:00100000:1.0:1784189099.058938:0:66170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1160 00000100:00100000:1.0:1784189099.058943:0:66170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc080e7dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3639:x1870854458083072:12345-0@lo:38:ptlrpcd_00_02.0 00010000:00020000:1.0:1784189099.059065:0:66170:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1784189099.059142:0:66170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc080e7dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3639:x1870854458083072:12345-0@lo:38:ptlrpcd_00_02.0 Request processed in 197us (373us total) trans 0 rc -19/-19 00000100:00100000:1.0:1784189099.059150:0:66170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1160 00000100:00080000:3.0:1784189099.059440:0:3639:0:(import.c:65:import_set_state_nolock()) ffff9dbf425f4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1784189099.059445:0:3639:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1784189099.059448:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc05eda9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3639:1870854458083072:0@lo:38:ptlrpcd_00_02.0 00000400:00000100:1.0:1784189099.306466:0:3634:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-192.168.203.12@tcp portal 26 match 1870854436256384 offset 0 length 224: 4 00000100:00100000:1.0:1784189099.306505:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1784189099.306549:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1784189099.306569:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1784189099.306591:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1784189099.306616:0:26162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436256896 00000100:00100000:1.0:1784189099.306625:0:26162:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436256896 00000100:00100000:1.0:1784189099.306674:0:26162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436256768 00000100:00100000:1.0:1784189099.306677:0:26162:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436256768 00000100:00100000:1.0:1784189099.306717:0:26162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 2387 00000100:00100000:1.0:1784189099.306727:0:26162:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc05edaaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+5:2397:x1870854436256896:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:1.0:1784189099.306802:0:26162:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc05edaaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+5:2397:x1870854436256896:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 76us (251us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189099.306809:0:26162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 2387 00000100:00100000:1.0:1784189099.306837:0:26162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 2388 00000100:00100000:1.0:1784189099.306844:0:26162:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc075663800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+5:2397:x1870854436256768:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:1.0:1784189099.306871:0:26162:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc075663800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+5:2397:x1870854436256768:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 27us (279us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189099.306877:0:26162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 2388 00000100:00100000:1.0:1784189099.306898:0:66171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436256640 00000100:00100000:1.0:1784189099.306901:0:66171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436256640 00000100:00100000:1.0:1784189099.306928:0:66171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436256512 00000100:00100000:1.0:1784189099.306931:0:66171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436256512 00000100:00100000:1.0:1784189099.306948:0:66171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1099 00000100:00100000:1.0:1784189099.306955:0:66171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc05eda8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+6:2397:x1870854436256640:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:1.0:1784189099.306983:0:66171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc05eda8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+6:2397:x1870854436256640:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 29us (478us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189099.306990:0:66171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1099 00000100:00100000:1.0:1784189099.307002:0:66171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1161 00000100:00100000:1.0:1784189099.307006:0:66171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc05eda9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2397:x1870854436256512:12345-192.168.203.12@tcp:400:kworker.0 00000020:00080000:1.0:1784189099.307012:0:66171:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-192.168.203.12@tcp 00000100:00100000:1.0:1784189099.307032:0:66171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc05eda9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2397:x1870854436256512:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 24us (462us total) trans 0 rc -107/-107 00000100:00100000:1.0:1784189099.307038:0:66171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1161 00000100:00080000:1.0:1784189099.307057:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1784189099.307063:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1784189099.307065:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1784189099.312378:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1784189099.312461:0:66170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436257024 00000100:00100000:2.0:1784189099.312470:0:66170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436257024 00000100:00100000:2.0:1784189099.312520:0:66170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1162 00000100:00100000:2.0:1784189099.312528:0:66170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc080e7fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2395:x1870854436257024:12345-192.168.203.12@tcp:38:ptlrpcd_00_01.0 00010000:00020000:2.0:1784189099.312550:0:66170:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.203.12@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1784189099.312609:0:66170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc080e7fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2395:x1870854436257024:12345-192.168.203.12@tcp:38:ptlrpcd_00_01.0 Request processed in 80us (241us total) trans 0 rc -19/-19 00000100:00100000:2.0:1784189099.312616:0:66170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1162 00010000:00010000:2.0:1784189099.759819:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784189100.079708:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1784189100.079732:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc080e7e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1870854458083200:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1784189100.079821:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784189100.079933:0:9466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458083200 00000100:00100000:3.0:1784189100.079941:0:9466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458083200 00000100:00100000:2.0:1784189100.080019:0:9466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1912 00000100:00100000:2.0:1784189100.080030:0:9466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf469b7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1870854458083200:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1784189100.080058:0:9466:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8650560 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1784189100.080111:0:9466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf469b7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1870854458083200:12345-0@lo:13:osp-pre-1-1.0 Request processed in 83us (290us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189100.080119:0:9466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1912 00000100:00100000:1.0:1784189100.080314:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc080e7e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1870854458083200:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1784189100.082403:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf469b4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1870854458083328:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1784189100.082478:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784189100.082736:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458083328 00000100:00100000:3.0:1784189100.082743:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458083328 00000100:00100000:3.0:1784189100.082794:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1913 00000100:00100000:3.0:1784189100.082804:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf469b4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1870854458083328:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1784189100.082831:0:8432:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8650560 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1784189100.082890:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf469b4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1870854458083328:12345-0@lo:13:osp-pre-0-1.0 Request processed in 86us (411us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189100.082897:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1913 00000100:00100000:3.0:1784189100.082948:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf469b4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1870854458083328:0@lo:13:osp-pre-0-1.0 00010000:00010000:0.0:1784189100.783483:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784189101.807466:0:7454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784189102.832017:0:26173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1784189103.667282:0:75588:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:3.0:1784189103.667298:0:75588:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 81604378733 is committed 00000020:00000080:3.0:1784189103.667304:0:75588:0:(genops.c:906:class_export_put()) final put ffff9dc047a84800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1784189103.667412:0:63468:0:(genops.c:865:class_export_destroy()) destroying export ffff9dc047a84800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001 00000020:00000080:2.0:1784189103.667475:0:63468:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9dc047a82000 for lustre-MDT0001 00000001:00100000:0.0:1784189103.671209:0:8423:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1784189103.671219:0:8423:0:(genops.c:906:class_export_put()) final put ffff9dbf43fcc000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1784189103.671422:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9dbf43fcc000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:3.0:1784189103.671481:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9dbf43fcb000 for lustre-OST0000 00000001:00100000:0.0:1784189103.671824:0:9506:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1784189103.671829:0:9506:0:(genops.c:906:class_export_put()) final put ffff9dc0477d2000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1784189103.673262:0:63468:0:(genops.c:865:class_export_destroy()) destroying export ffff9dc0477d2000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:2.0:1784189103.674398:0:63468:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9dc0477d3800 for lustre-OST0001 00010000:00010000:2.0:1784189103.856282:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1784189104.175641:0:63468:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1784189104.175655:0:63468:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1784189104.175666:0:63468:0:(import.c:65:import_set_state_nolock()) ffff9dbf42271800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1784189104.175674:0:63468:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3341 00000100:00080000:2.0:1784189104.175680:0:63468:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 5s 00000100:00100000:0.0:1784189104.175690:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00080000:2.0:1784189104.175691:0:63468:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9dbf42271800 using connection 192.168.203.112@tcp/0@lo 00000100:00100000:0.0:1784189104.175709:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf469b6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bd553d0d-03e2-4233-b06b-b55bbfa2b954:3642:1870854458083456:0@lo:400:kworker.0 00000100:00100000:2.0:1784189104.175714:0:63468:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9dbf469b6d80 x1870854458083584/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1784189104.175747:0:63468:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1784189104.175751:0:63468:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1784189104.175752:0:63468:0:(import.c:65:import_set_state_nolock()) ffff9dbf425f4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1784189104.175756:0:63468:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3341 00000400:00000100:0.0:1784189104.175757:0:3642:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1870854458083456 offset 0 length 224: 4 00000100:00080000:2.0:1784189104.175772:0:63468:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1784189104.175776:0:63468:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9dbf425f4800 using connection 192.168.203.112@tcp/0@lo 00000100:00100000:2.0:1784189104.175787:0:63468:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9dbf469b5c00 x1870854458083840/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1784189104.175804:0:63468:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1784189104.175807:0:63468:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1784189104.175809:0:63468:0:(import.c:65:import_set_state_nolock()) ffff9dbf436c4000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1784189104.175813:0:63468:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3341 00000100:00080000:2.0:1784189104.175815:0:63468:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1784189104.175818:0:63468:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9dbf436c4000 using connection 192.168.203.112@tcp/0@lo 00000100:00100000:0.0:1784189104.175820:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf469b4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3641:1870854458083968:0@lo:400:kworker.0 00000100:00100000:2.0:1784189104.175828:0:63468:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9dbf469b4a80 x1870854458084096/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1784189104.175854:0:63468:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1784189104.175857:0:63468:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1784189104.175859:0:63468:0:(import.c:65:import_set_state_nolock()) ffff9dbf43690800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1784189104.175862:0:63468:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3341 00000100:00080000:2.0:1784189104.175864:0:63468:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 5s 00000100:00100000:0.0:1784189104.175865:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1784189104.175868:0:63468:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff9dbf43690800 using connection 192.168.203.112@tcp/0@lo 00000100:00100000:2.0:1784189104.175879:0:63468:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9dc05ed98000 x1870854458084480/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1784189104.175887:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1784189104.175891:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf469b7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3641:1870854458083712:0@lo:400:kworker.0 00000100:00100000:0.0:1784189104.175913:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784189104.175929:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf469b6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3639:1870854458083584:0@lo:38:kworker.0 00000100:00100000:0.0:1784189104.175940:0:66169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458083968 00000100:00100000:0.0:1784189104.175946:0:66169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458083968 00000100:00100000:2.0:1784189104.175955:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784189104.175972:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf469b5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3639:1870854458083840:0@lo:38:kworker.0 00000100:00100000:2.0:1784189104.175991:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784189104.175995:0:66169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458083712 00000100:00100000:0.0:1784189104.175998:0:66169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458083712 00000100:00100000:0.0:1784189104.176011:0:66169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458083584 00000100:00100000:2.0:1784189104.176014:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf469b4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3639:1870854458084096:0@lo:38:kworker.0 00000100:00100000:0.0:1784189104.176019:0:66169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458083584 00000100:00100000:0.0:1784189104.176030:0:66169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458083840 00000100:00100000:0.0:1784189104.176032:0:66169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458083840 00000100:00100000:2.0:1784189104.176037:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784189104.176043:0:66169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1100 00000100:00100000:2.0:1784189104.176051:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc05ed98000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3639:1870854458084480:0@lo:38:kworker.0 00000100:00100000:0.0:1784189104.176051:0:66169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc05eddce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1870854458083968:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784189104.176069:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784189104.176093:0:66945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458084480 00000100:00100000:0.0:1784189104.176095:0:66169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc05eddce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1870854458083968:12345-0@lo:400:kworker.0 Request processed in 45us (229us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189104.176096:0:66945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458084480 00000100:00100000:0.0:1784189104.176103:0:66169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1100 00000100:00100000:2.0:1784189104.176112:0:66945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1101 00000100:00100000:0.0:1784189104.176116:0:66169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1163 00000100:00100000:2.0:1784189104.176119:0:66945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc05edddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1870854458083712:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784189104.176120:0:66169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf46956300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3639:x1870854458083584:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1784189104.176137:0:66169:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1784189104.176181:0:66169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf46956300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3639:x1870854458083584:12345-0@lo:38:kworker.0 Request processed in 58us (224us total) trans 0 rc -19/-19 00000100:00100000:0.0:1784189104.176187:0:66169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1163 00000100:00100000:0.0:1784189104.176199:0:66169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1164 00000100:00100000:0.0:1784189104.176203:0:66169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc07016ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3639:x1870854458083840:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1784189104.176212:0:66169:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1784189104.176234:0:66169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc07016ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3639:x1870854458083840:12345-0@lo:38:kworker.0 Request processed in 30us (242us total) trans 0 rc -19/-19 00000100:00100000:0.0:1784189104.176239:0:66169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1164 00000100:00100000:0.0:1784189104.176250:0:66169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1165 00000100:00100000:0.0:1784189104.176253:0:66169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc07016df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3639:x1870854458084480:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1784189104.176262:0:66169:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1784189104.176284:0:66169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc07016df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3639:x1870854458084480:12345-0@lo:38:kworker.0 Request processed in 29us (213us total) trans 0 rc -19/-19 00000100:00100000:0.0:1784189104.176290:0:66169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1165 00000100:00100000:1.0:1784189104.176302:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc06bbf0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1870854458084352:0@lo:400:kworker.0 00000100:00080000:0.0:1784189104.176337:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1784189104.176350:0:23826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458084096 00000100:00100000:0.0:1784189104.176353:0:23826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458084096 00000100:00100000:1.0:1784189104.176356:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784189104.176371:0:23826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3760 00000100:00100000:1.0:1784189104.176375:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1784189104.176376:0:23826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc07016dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3639:x1870854458084096:12345-0@lo:38:kworker.0 00000100:00100000:1.0:1784189104.176379:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc06bbf1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1870854458084224:0@lo:400:kworker.0 00010000:00020000:0.0:1784189104.176385:0:23826:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1784189104.176400:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784189104.176423:0:23826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc07016dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3639:x1870854458084096:12345-0@lo:38:kworker.0 Request processed in 45us (384us total) trans 0 rc -19/-19 00000100:00100000:1.0:1784189104.176425:0:26165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458084352 00000100:00100000:1.0:1784189104.176428:0:26165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458084352 00000100:00100000:0.0:1784189104.176429:0:23826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3760 00000100:00100000:1.0:1784189104.176457:0:26165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458084224 00000100:00100000:1.0:1784189104.176460:0:26165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458084224 00000100:00100000:0.0:1784189104.176461:0:26169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2389 00000100:00100000:0.0:1784189104.176467:0:26169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc056475880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:3643:x1870854458084352:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784189104.176478:0:26165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2390 00000100:00100000:1.0:1784189104.176484:0:26165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc056475180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0001-mdtlov_UUID+5:3643:x1870854458084224:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784189104.176500:0:26169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc056475880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:3643:x1870854458084352:12345-0@lo:400:kworker.0 Request processed in 34us (144us total) trans 0 rc 0/0 00000100:00100000:0.0:1784189104.176507:0:26169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2389 00000100:00100000:1.0:1784189104.176509:0:26165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc056475180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0001-mdtlov_UUID+5:3643:x1870854458084224:12345-0@lo:400:kworker.0 Request processed in 26us (109us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189104.176513:0:26165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2390 00000100:00080000:1.0:1784189104.176525:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1784189104.176527:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1784189104.176555:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf469b4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3641:1870854458083968:0@lo:400:kworker.0 00000100:00100000:1.0:1784189104.176556:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc06bbf1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1870854458084224:0@lo:400:kworker.0 00000100:00100000:1.0:1784189104.176565:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc06bbf0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1870854458084352:0@lo:400:kworker.0 00000100:00080000:0.0:1784189104.176602:0:3639:0:(import.c:65:import_set_state_nolock()) ffff9dbf42271800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1784189104.176606:0:3639:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1784189104.176609:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf469b6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3639:1870854458083584:0@lo:38:kworker.0 00000100:00080000:0.0:1784189104.176617:0:3639:0:(import.c:65:import_set_state_nolock()) ffff9dbf425f4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1784189104.176620:0:3639:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1784189104.176623:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf469b5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3639:1870854458083840:0@lo:38:kworker.0 00000100:00080000:0.0:1784189104.176629:0:3639:0:(import.c:65:import_set_state_nolock()) ffff9dbf436c4000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1784189104.176632:0:3639:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1784189104.176635:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf469b4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3639:1870854458084096:0@lo:38:kworker.0 00000100:00080000:0.0:1784189104.176641:0:3639:0:(import.c:65:import_set_state_nolock()) ffff9dbf43690800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1784189104.176650:0:3639:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1784189104.176652:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc05ed98000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3639:1870854458084480:0@lo:38:kworker.0 00000100:00100000:2.0:1784189104.176686:0:66945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc05edddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1870854458083712:12345-0@lo:400:kworker.0 Request processed in 567us (771us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189104.176692:0:66945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1101 00000100:00100000:1.0:1784189104.176828:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf469b7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3641:1870854458083712:0@lo:400:kworker.0 00000100:00100000:1.0:1784189104.428104:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1784189104.428219:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000400:00000100:1.0:1784189104.428252:0:3635:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-192.168.203.12@tcp portal 26 match 1870854436257408 offset 0 length 224: 4 00000100:00100000:1.0:1784189104.428282:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1784189104.428311:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1784189104.428372:0:26167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436257920 00000100:00100000:2.0:1784189104.428381:0:26167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436257920 00000100:00100000:2.0:1784189104.428439:0:26167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436257792 00000100:00100000:2.0:1784189104.428442:0:26167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436257792 00000100:00100000:2.0:1784189104.428468:0:26167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 2391 00000100:00100000:2.0:1784189104.428478:0:26167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc06bbf0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+5:2398:x1870854436257920:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:2.0:1784189104.428546:0:26167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc06bbf0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+5:2398:x1870854436257920:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 70us (327us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189104.428555:0:26167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 2391 00000100:00100000:2.0:1784189104.428572:0:26167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 2392 00000100:00100000:2.0:1784189104.428579:0:26167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc06bbf1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+5:2398:x1870854436257792:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:2.0:1784189104.428602:0:26167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc06bbf1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+5:2398:x1870854436257792:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 25us (321us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189104.428609:0:26167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 2392 00000100:00080000:3.0:1784189104.428771:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1784189104.428776:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1784189104.440218:0:66169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436257664 00000100:00100000:0.0:1784189104.440233:0:66169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436257664 00000100:00100000:0.0:1784189104.440353:0:66169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436257536 00000100:00100000:0.0:1784189104.440357:0:66169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436257536 00000100:00100000:0.0:1784189104.440385:0:66169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1102 00000100:00100000:0.0:1784189104.440395:0:66169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc056477480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+6:2398:x1870854436257664:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:0.0:1784189104.440477:0:66169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc056477480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+6:2398:x1870854436257664:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 83us (12381us total) trans 0 rc 0/0 00000100:00100000:0.0:1784189104.440484:0:66169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1102 00000100:00100000:0.0:1784189104.440503:0:66169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1166 00000100:00100000:0.0:1784189104.440507:0:66169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf43f58380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2395:x1870854436257536:12345-192.168.203.12@tcp:38:kworker.0 00010000:00020000:0.0:1784189104.440529:0:66169:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.203.12@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1784189104.440554:0:66169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf43f58380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2395:x1870854436257536:12345-192.168.203.12@tcp:38:kworker.0 Request processed in 45us (12242us total) trans 0 rc -19/-19 00000100:00100000:0.0:1784189104.440559:0:66169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1166 00000100:00080000:3.0:1784189104.440969:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:0.0:1784189104.879486:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784189105.199841:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1784189105.199859:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc080e7e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1870854458084608:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1784189105.199927:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784189105.200113:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458084608 00000100:00100000:3.0:1784189105.200121:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458084608 00000100:00100000:3.0:1784189105.200173:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1914 00000100:00100000:3.0:1784189105.200183:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc05ed98000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1870854458084608:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1784189105.200221:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8650560 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1784189105.200275:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc05ed98000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1870854458084608:12345-0@lo:13:osp-pre-1-1.0 Request processed in 94us (348us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189105.200283:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1914 00000100:00100000:1.0:1784189105.200377:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc080e7e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1870854458084608:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1784189105.200913:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc07016c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1870854458084736:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1784189105.200962:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784189105.201068:0:9466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458084736 00000100:00100000:3.0:1784189105.201073:0:9466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458084736 00000100:00100000:3.0:1784189105.201109:0:9466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1915 00000100:00100000:3.0:1784189105.201116:0:9466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf43f58000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1870854458084736:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1784189105.201134:0:9466:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8650560 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1784189105.203547:0:9466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf43f58000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1870854458084736:12345-0@lo:13:osp-pre-0-1.0 Request processed in 2423us (2575us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189105.203564:0:9466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1915 00000100:00100000:1.0:1784189105.203935:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc07016c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1870854458084736:0@lo:13:osp-pre-0-1.0 00010000:00010000:0.0:1784189105.903575:0:7454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784189106.927481:0:26173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784189107.952434:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784189108.975467:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1784189109.295647:0:63468:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1784189109.295653:0:63468:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1784189109.295657:0:63468:0:(import.c:65:import_set_state_nolock()) ffff9dbf42271800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1784189109.295664:0:63468:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3346 00000100:00080000:2.0:1784189109.295670:0:63468:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1784189109.295676:0:63468:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9dbf42271800 using connection 192.168.203.112@tcp/0@lo 00000100:00100000:2.0:1784189109.295699:0:63468:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9dc07016f100 x1870854458084992/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1784189109.295738:0:63468:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1784189109.295742:0:63468:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1784189109.295743:0:63468:0:(import.c:65:import_set_state_nolock()) ffff9dbf425f4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1784189109.295747:0:63468:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3346 00000100:00080000:2.0:1784189109.295750:0:63468:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1784189109.295753:0:63468:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9dbf425f4800 using connection 192.168.203.112@tcp/0@lo 00000100:00100000:2.0:1784189109.295765:0:63468:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9dc07016f800 x1870854458085248/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1784189109.295776:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc07016f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3639:1870854458084992:0@lo:38:kworker.0 00000100:00080000:2.0:1784189109.295796:0:63468:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1784189109.295801:0:63468:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1784189109.295802:0:63468:0:(import.c:65:import_set_state_nolock()) ffff9dbf436c4000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1784189109.295806:0:63468:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3346 00000100:00080000:2.0:1784189109.295809:0:63468:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1784189109.295813:0:63468:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9dbf436c4000 using connection 192.168.203.112@tcp/0@lo 00000100:00100000:2.0:1784189109.295827:0:63468:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9dc07016d180 x1870854458085504/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1784189109.295847:0:63468:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00100000:3.0:1784189109.295864:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1784189109.295866:0:63468:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1784189109.295868:0:63468:0:(import.c:65:import_set_state_nolock()) ffff9dbf43690800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1784189109.295874:0:63468:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3346 00000100:00080000:2.0:1784189109.295878:0:63468:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1784189109.295882:0:63468:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff9dbf43690800 using connection 192.168.203.112@tcp/0@lo 00000100:00100000:2.0:1784189109.295898:0:63468:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9dc07016c000 x1870854458085888/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1784189109.295922:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc07016f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3639:1870854458085248:0@lo:38:kworker.0 00000100:00100000:2.0:1784189109.295927:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc07016e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1870854458085632:0@lo:400:kworker.0 00000100:00100000:3.0:1784189109.295957:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784189109.295974:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784189109.295978:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc07016d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3639:1870854458085504:0@lo:38:kworker.0 00000100:00100000:2.0:1784189109.296003:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1784189109.296010:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784189109.296013:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc07016d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3641:1870854458085376:0@lo:400:kworker.0 00000100:00100000:3.0:1784189109.296034:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc07016c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3639:1870854458085888:0@lo:38:kworker.0 00000100:00100000:2.0:1784189109.296044:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784189109.296069:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784189109.296118:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc07016e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bd553d0d-03e2-4233-b06b-b55bbfa2b954:3642:1870854458084864:0@lo:400:kworker.0 00000400:00000100:3.0:1784189109.296140:0:3642:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1870854458084864 offset 0 length 224: 4 00000100:00100000:3.0:1784189109.296164:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc07016fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1870854458085760:0@lo:400:kworker.0 00000100:00100000:3.0:1784189109.296190:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784189109.296199:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc07016ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3643:1870854458085120:0@lo:400:kworker.0 00000100:00100000:3.0:1784189109.296237:0:26160:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458085632 00000100:00100000:1.0:1784189109.296239:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784189109.296246:0:26160:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458085632 00000100:00100000:3.0:1784189109.296296:0:26160:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458085760 00000100:00100000:3.0:1784189109.296300:0:26160:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458085760 00000100:00100000:3.0:1784189109.296347:0:26160:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2393 00000100:00100000:3.0:1784189109.296356:0:26160:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc07ab98000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:3641:x1870854458085632:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784189109.296417:0:26160:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc07ab98000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:3641:x1870854458085632:12345-0@lo:400:kworker.0 Request processed in 62us (444us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189109.296424:0:26160:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2393 00000100:00100000:3.0:1784189109.296439:0:26160:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2394 00000100:00100000:3.0:1784189109.296445:0:26160:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc081cd3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:3642:x1870854458085760:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784189109.296475:0:26160:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc081cd3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:3642:x1870854458085760:12345-0@lo:400:kworker.0 Request processed in 30us (284us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189109.296481:0:26160:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2394 00000100:00100000:1.0:1784189109.298218:0:26492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458085504 00000100:00100000:1.0:1784189109.298229:0:26492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458085504 00000100:00100000:1.0:1784189109.298263:0:26492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3761 00000100:00100000:1.0:1784189109.298270:0:26492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc071534700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3639:x1870854458085504:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1784189109.298290:0:26492:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1784189109.298363:0:26492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc071534700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3639:x1870854458085504:12345-0@lo:38:kworker.0 Request processed in 92us (2353us total) trans 0 rc -19/-19 00000100:00100000:1.0:1784189109.298370:0:26492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3761 00000100:00100000:2.0:1784189109.299296:0:66945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458084992 00000100:00100000:3.0:1784189109.299297:0:66170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458085248 00000100:00100000:3.0:1784189109.299335:0:66170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458085248 00000100:00100000:2.0:1784189109.299337:0:66945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458084992 00000100:00100000:3.0:1784189109.299365:0:66170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458085376 00000100:00100000:2.0:1784189109.299369:0:66945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458085888 00000100:00100000:3.0:1784189109.299370:0:66170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458085376 00000100:00100000:2.0:1784189109.299376:0:66945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458085888 00000100:00100000:2.0:1784189109.299388:0:66945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458085120 00000100:00100000:2.0:1784189109.299392:0:66945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458085120 00000100:00100000:3.0:1784189109.299423:0:66170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1103 00000100:00100000:3.0:1784189109.299432:0:66170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc07ab9b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1870854458085376:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784189109.299491:0:66170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc07ab9b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1870854458085376:12345-0@lo:400:kworker.0 Request processed in 62us (3448us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189109.299781:0:66945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1104 00000100:00100000:2.0:1784189109.299793:0:66945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf43f5ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1870854458085120:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784189109.299840:0:66945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf43f5ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1870854458085120:12345-0@lo:400:kworker.0 Request processed in 50us (3601us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189109.299847:0:66945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1104 00000100:00100000:2.0:1784189109.299864:0:66945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1167 00000100:00100000:2.0:1784189109.299868:0:66945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc071536a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3639:x1870854458085248:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1784189109.299883:0:66945:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1784189109.299919:0:66945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc071536a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3639:x1870854458085248:12345-0@lo:38:kworker.0 Request processed in 49us (3963us total) trans 0 rc -19/-19 00000100:00100000:2.0:1784189109.299925:0:66945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1167 00000100:00100000:2.0:1784189109.299938:0:66945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1168 00000100:00100000:2.0:1784189109.299942:0:66945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc080e7e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3639:x1870854458084992:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1784189109.299952:0:66945:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1784189109.299976:0:66945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc080e7e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3639:x1870854458084992:12345-0@lo:38:kworker.0 Request processed in 33us (4116us total) trans 0 rc -19/-19 00000100:00100000:2.0:1784189109.299983:0:66945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1168 00000100:00100000:2.0:1784189109.299994:0:66945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1169 00000100:00100000:2.0:1784189109.299998:0:66945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc071537100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3639:x1870854458085888:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1784189109.300007:0:66945:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1784189109.300031:0:66945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc071537100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3639:x1870854458085888:12345-0@lo:38:kworker.0 Request processed in 31us (3963us total) trans 0 rc -19/-19 00000100:00100000:2.0:1784189109.300037:0:66945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1169 00000100:00100000:2.0:1784189109.300079:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc07016ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3643:1870854458085120:0@lo:400:kworker.0 00000100:00080000:2.0:1784189109.300129:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1784189109.300134:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1784189109.300137:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1784189109.300170:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc07016fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1870854458085760:0@lo:400:kworker.0 00000100:00100000:2.0:1784189109.300195:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc07016d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3641:1870854458085376:0@lo:400:kworker.0 00000100:00100000:2.0:1784189109.300205:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc07016e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1870854458085632:0@lo:400:kworker.0 00000100:00080000:2.0:1784189109.300233:0:3639:0:(import.c:65:import_set_state_nolock()) ffff9dbf425f4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1784189109.300238:0:3639:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1784189109.300248:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc07016f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3639:1870854458085248:0@lo:38:kworker.0 00000100:00080000:2.0:1784189109.300261:0:3639:0:(import.c:65:import_set_state_nolock()) ffff9dbf436c4000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1784189109.300264:0:3639:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1784189109.300266:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc07016d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3639:1870854458085504:0@lo:38:kworker.0 00000100:00080000:2.0:1784189109.300273:0:3639:0:(import.c:65:import_set_state_nolock()) ffff9dbf43690800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1784189109.300276:0:3639:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1784189109.300279:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc07016c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3639:1870854458085888:0@lo:38:kworker.0 00000100:00080000:2.0:1784189109.300287:0:3639:0:(import.c:65:import_set_state_nolock()) ffff9dbf42271800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1784189109.300290:0:3639:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1784189109.300292:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc07016f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3639:1870854458084992:0@lo:38:kworker.0 00000100:00100000:3.0:1784189109.301788:0:66170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1103 00000400:00000100:2.0:1784189109.548374:0:3633:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-192.168.203.12@tcp portal 26 match 1870854436258048 offset 0 length 224: 4 00000100:00100000:2.0:1784189109.548420:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1784189109.548457:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1784189109.548490:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1784189109.548513:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1784189109.548692:0:66945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436258304 00000100:00100000:1.0:1784189109.548697:0:26166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436258432 00000100:00100000:3.0:1784189109.548702:0:66945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436258304 00000100:00100000:1.0:1784189109.548713:0:26166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436258432 00000100:00100000:3.0:1784189109.548780:0:66945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436258176 00000100:00100000:3.0:1784189109.548784:0:66945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436258176 00000100:00100000:3.0:1784189109.548808:0:66945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1105 00000100:00100000:3.0:1784189109.548819:0:66945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc07ab99180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+6:2396:x1870854436258304:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:0.0:1784189109.548824:0:26170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436258560 00000100:00100000:0.0:1784189109.548830:0:26170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436258560 00000100:00100000:3.0:1784189109.548895:0:66945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc07ab99180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+6:2396:x1870854436258304:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 78us (435us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189109.548903:0:66945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1105 00000100:00100000:3.0:1784189109.548920:0:66945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1170 00000100:00100000:3.0:1784189109.548924:0:66945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc07ab98700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2395:x1870854436258176:12345-192.168.203.12@tcp:38:kworker.0 00010000:00020000:3.0:1784189109.548960:0:66945:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.203.12@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1784189109.548989:0:66945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc07ab98700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2395:x1870854436258176:12345-192.168.203.12@tcp:38:kworker.0 Request processed in 63us (475us total) trans 0 rc -19/-19 00000100:00100000:3.0:1784189109.548995:0:66945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1170 00000100:00080000:2.0:1784189109.551168:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1784189109.551177:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1784189109.551181:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1784189109.551790:0:26166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 2395 00000100:00100000:1.0:1784189109.551805:0:26166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc07ab99f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+5:2396:x1870854436258432:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:1.0:1784189109.551885:0:26166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc07ab99f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+5:2396:x1870854436258432:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 85us (3464us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189109.551893:0:26166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 2395 00000100:00100000:0.0:1784189109.552942:0:26170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 2396 00000100:00100000:0.0:1784189109.552967:0:26170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc07ab99500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+5:2396:x1870854436258560:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:0.0:1784189109.553044:0:26170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc07ab99500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+5:2396:x1870854436258560:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 79us (4551us total) trans 0 rc 0/0 00000100:00100000:0.0:1784189109.553051:0:26170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 2396 00010000:00010000:0.0:1784189109.999471:0:7454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784189110.321620:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc071536d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1870854458086016:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1784189110.321690:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784189110.321966:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458086016 00000100:00100000:3.0:1784189110.321973:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458086016 00000100:00100000:3.0:1784189110.322022:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1916 00000100:00100000:3.0:1784189110.322032:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf43f58a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1870854458086016:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1784189110.322071:0:8432:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8650560 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1784189110.322125:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf43f58a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1870854458086016:12345-0@lo:13:osp-pre-1-1.0 Request processed in 94us (434us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189110.322133:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1916 00000100:00100000:1.0:1784189110.322215:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc071536d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1870854458086016:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1784189110.322549:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1784189110.322560:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc07ab99880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1870854458086144:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1784189110.322592:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784189110.322704:0:9466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458086144 00000100:00100000:2.0:1784189110.322710:0:9466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458086144 00000100:00100000:2.0:1784189110.322843:0:9466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1917 00000100:00100000:2.0:1784189110.322852:0:9466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc071536d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1870854458086144:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1784189110.322880:0:9466:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8650560 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1784189110.322926:0:9466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc071536d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1870854458086144:12345-0@lo:13:osp-pre-0-1.0 Request processed in 75us (333us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189110.322946:0:9466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1917 00000100:00100000:0.0:1784189110.323004:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc07ab99880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1870854458086144:0@lo:13:osp-pre-0-1.0 00010000:00010000:1.0:1784189111.024017:0:26173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784189112.048524:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784189113.071409:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784189114.095426:0:7454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1784189114.424348:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1784189114.424357:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1784189114.424362:0:36:0:(import.c:65:import_set_state_nolock()) ffff9dbf42271800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1784189114.424372:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3351 00000100:00080000:3.0:1784189114.424380:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 15s 00000100:00080000:3.0:1784189114.424389:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9dbf42271800 using connection 192.168.203.112@tcp/0@lo 00000100:00100000:3.0:1784189114.424418:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9dc081f81880 x1870854458086400/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1784189114.424460:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1784189114.424464:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1784189114.424466:0:36:0:(import.c:65:import_set_state_nolock()) ffff9dbf425f4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1784189114.424470:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3351 00000100:00080000:3.0:1784189114.424472:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 15s 00000100:00080000:3.0:1784189114.424477:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9dbf425f4800 using connection 192.168.203.112@tcp/0@lo 00000100:00100000:3.0:1784189114.424490:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9dc075f7f100 x1870854458086656/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1784189114.424508:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1784189114.424522:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1784189114.424524:0:36:0:(import.c:65:import_set_state_nolock()) ffff9dbf436c4000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1784189114.424528:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3351 00000100:00080000:3.0:1784189114.424530:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 15s 00000100:00080000:3.0:1784189114.424535:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9dbf436c4000 using connection 192.168.203.112@tcp/0@lo 00000100:00100000:3.0:1784189114.424549:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9dc075f7f480 x1870854458086912/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1784189114.424573:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1784189114.424577:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1784189114.424579:0:36:0:(import.c:65:import_set_state_nolock()) ffff9dbf43690800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1784189114.424592:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3351 00000100:00080000:3.0:1784189114.424595:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 15s 00000100:00080000:3.0:1784189114.424599:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff9dbf43690800 using connection 192.168.203.112@tcp/0@lo 00000100:00100000:3.0:1784189114.424612:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9dbf44fae680 x1870854458087296/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1784189114.424652:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc081f81880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3639:1870854458086400:0@lo:38:kworker.0 00000100:00100000:3.0:1784189114.424743:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784189114.424786:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc075f7f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3639:1870854458086656:0@lo:38:kworker.0 00000100:00100000:3.0:1784189114.424811:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784189114.424828:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc075f7f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3639:1870854458086912:0@lo:38:kworker.0 00000100:00100000:3.0:1784189114.424854:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784189114.424873:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf44fae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3639:1870854458087296:0@lo:38:kworker.0 00000100:00100000:3.0:1784189114.424897:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784189114.424937:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf48599c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3642:1870854458086528:0@lo:400:kworker.0 00000100:00100000:3.0:1784189114.424971:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784189114.424993:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1784189114.424998:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc075f7c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3642:1870854458086784:0@lo:400:kworker.0 00000100:00100000:3.0:1784189114.425019:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784189114.425054:0:66170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458086400 00000100:00100000:3.0:1784189114.425063:0:66170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458086400 00000100:00100000:3.0:1784189114.425092:0:66170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458086656 00000100:00100000:3.0:1784189114.425096:0:66170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458086656 00000100:00100000:3.0:1784189114.425105:0:66170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458087296 00000100:00100000:3.0:1784189114.425108:0:66170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458087296 00000100:00100000:3.0:1784189114.425116:0:66170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458086528 00000100:00100000:3.0:1784189114.425118:0:66170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458086528 00000100:00100000:3.0:1784189114.425154:0:66170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458086784 00000100:00100000:3.0:1784189114.425156:0:66170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458086784 00000100:00100000:3.0:1784189114.425173:0:66170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1106 00000100:00100000:3.0:1784189114.425182:0:66170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc07016c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1870854458086528:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784189114.425240:0:66170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc07016c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1870854458086528:12345-0@lo:400:kworker.0 Request processed in 57us (267us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189114.425247:0:66170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1106 00000100:00100000:3.0:1784189114.425265:0:66170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1107 00000100:00100000:3.0:1784189114.425272:0:66170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc07016d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1870854458086784:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784189114.425300:0:66170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc07016d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1870854458086784:12345-0@lo:400:kworker.0 Request processed in 29us (280us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189114.425307:0:66170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1107 00000100:00100000:3.0:1784189114.425345:0:66170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1171 00000100:00100000:3.0:1784189114.425349:0:66170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc05f02ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3639:x1870854458086400:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1784189114.425372:0:66170:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1784189114.425416:0:66170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc05f02ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3639:x1870854458086400:12345-0@lo:38:kworker.0 Request processed in 65us (674us total) trans 0 rc -19/-19 00000100:00100000:3.0:1784189114.425423:0:66170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1171 00000100:00100000:3.0:1784189114.425436:0:66170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1172 00000100:00100000:3.0:1784189114.425440:0:66170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf43c5dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3639:x1870854458086656:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1784189114.425450:0:66170:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1784189114.425473:0:66170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf43c5dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3639:x1870854458086656:12345-0@lo:38:kworker.0 Request processed in 31us (662us total) trans 0 rc -19/-19 00000100:00100000:3.0:1784189114.425479:0:66170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1172 00000100:00100000:3.0:1784189114.425490:0:66170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1173 00000100:00100000:3.0:1784189114.425494:0:66170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc07016f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3639:x1870854458087296:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1784189114.425503:0:66170:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1784189114.425528:0:66170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc07016f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3639:x1870854458087296:12345-0@lo:38:kworker.0 Request processed in 32us (630us total) trans 0 rc -19/-19 00000100:00100000:3.0:1784189114.425534:0:66170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1173 00000100:00100000:3.0:1784189114.425560:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458086912 00000100:00100000:3.0:1784189114.425565:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458086912 00000100:00100000:3.0:1784189114.425599:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3762 00000100:00100000:3.0:1784189114.425603:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf44c89c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3639:x1870854458086912:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1784189114.425614:0:8439:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1784189114.425642:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf44c89c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3639:x1870854458086912:12345-0@lo:38:kworker.0 Request processed in 37us (787us total) trans 0 rc -19/-19 00000100:00100000:3.0:1784189114.425648:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3762 00000100:00080000:3.0:1784189114.425676:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1784189114.425717:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc075f7c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3642:1870854458086784:0@lo:400:kworker.0 00000100:00100000:3.0:1784189114.425739:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf48599c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3642:1870854458086528:0@lo:400:kworker.0 00000100:00080000:3.0:1784189114.425773:0:3639:0:(import.c:65:import_set_state_nolock()) ffff9dbf42271800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1784189114.425778:0:3639:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1784189114.425781:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc081f81880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3639:1870854458086400:0@lo:38:kworker.0 00000100:00080000:3.0:1784189114.425791:0:3639:0:(import.c:65:import_set_state_nolock()) ffff9dbf425f4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1784189114.425794:0:3639:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1784189114.425797:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc075f7f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3639:1870854458086656:0@lo:38:kworker.0 00000100:00080000:3.0:1784189114.425805:0:3639:0:(import.c:65:import_set_state_nolock()) ffff9dbf436c4000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1784189114.425808:0:3639:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1784189114.425810:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc075f7f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3639:1870854458086912:0@lo:38:kworker.0 00000100:00080000:3.0:1784189114.425817:0:3639:0:(import.c:65:import_set_state_nolock()) ffff9dbf43690800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1784189114.425819:0:3639:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1784189114.425822:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf44fae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3639:1870854458087296:0@lo:38:kworker.0 00000100:00100000:0.0:1784189114.425954:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc075f7c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1870854458087040:0@lo:400:kworker.0 00000100:00100000:0.0:1784189114.425992:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784189114.426014:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1784189114.426020:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc080f6aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bd553d0d-03e2-4233-b06b-b55bbfa2b954:3640:1870854458086272:0@lo:400:kworker.0 00000400:00000100:0.0:1784189114.426036:0:3640:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1870854458086272 offset 0 length 224: 4 00000100:00100000:0.0:1784189114.426056:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf44faea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1870854458087168:0@lo:400:kworker.0 00000100:00100000:0.0:1784189114.426072:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784189114.426138:0:26161:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458087040 00000100:00100000:3.0:1784189114.426143:0:26161:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458087040 00000100:00100000:3.0:1784189114.426186:0:26161:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458087168 00000100:00100000:3.0:1784189114.426189:0:26161:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458087168 00000100:00100000:3.0:1784189114.426211:0:26161:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2397 00000100:00100000:3.0:1784189114.426218:0:26161:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf469b5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:3640:x1870854458087040:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784189114.426259:0:26161:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf469b5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:3640:x1870854458087040:12345-0@lo:400:kworker.0 Request processed in 41us (265us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189114.426266:0:26161:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2397 00000100:00100000:3.0:1784189114.426278:0:26161:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2398 00000100:00100000:3.0:1784189114.426285:0:26161:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf469b7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:3640:x1870854458087168:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784189114.426347:0:26161:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf469b7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:3640:x1870854458087168:12345-0@lo:400:kworker.0 Request processed in 62us (272us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189114.426353:0:26161:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2398 00000100:00100000:3.0:1784189114.426387:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf44faea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1870854458087168:0@lo:400:kworker.0 00000100:00100000:3.0:1784189114.426398:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc075f7c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1870854458087040:0@lo:400:kworker.0 00000100:00080000:0.0:1784189114.426476:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1784189114.426479:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1784189114.665842:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000400:00000100:0.0:1784189114.665875:0:3633:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-192.168.203.12@tcp portal 26 match 1870854436258688 offset 0 length 224: 4 00000100:00100000:3.0:1784189114.666001:0:66170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436258944 00000100:00100000:3.0:1784189114.666010:0:66170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436258944 00000100:00080000:0.0:1784189114.666084:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1784189114.666085:0:66170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1108 00000100:00100000:3.0:1784189114.666095:0:66170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf469b7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+6:2398:x1870854436258944:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:3.0:1784189114.666173:0:66170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf469b7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+6:2398:x1870854436258944:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 79us (349us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189114.666192:0:66170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1108 00000100:00100000:0.0:1784189114.674124:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1784189114.674165:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1784189114.674384:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1784189114.674491:0:26165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436259072 00000100:00100000:1.0:1784189114.674501:0:26165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436259072 00000100:00100000:2.0:1784189114.674526:0:68287:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436258816 00000100:00100000:1.0:1784189114.674562:0:26165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436259200 00000100:00100000:1.0:1784189114.674566:0:26165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436259200 00000100:00100000:2.0:1784189114.674592:0:68287:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436258816 00000100:00100000:1.0:1784189114.674615:0:26165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 4941 00000100:00100000:1.0:1784189114.674625:0:26165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf469b5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+5:2395:x1870854436259072:12345-192.168.203.12@tcp:9:kworker.0 00000100:00100000:2.0:1784189114.674634:0:68287:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1174 00000100:00100000:2.0:1784189114.674641:0:68287:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf469b4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2395:x1870854436258816:12345-192.168.203.12@tcp:38:kworker.0 00000020:00000080:1.0:1784189114.674652:0:26165:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xcc1762b626f8af0e 00010000:00020000:2.0:1784189114.674664:0:68287:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.203.12@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1784189114.674722:0:68287:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf469b4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2395:x1870854436258816:12345-192.168.203.12@tcp:38:kworker.0 Request processed in 80us (606us total) trans 0 rc -19/-19 00000100:00100000:2.0:1784189114.674730:0:68287:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1174 00000100:00080000:1.0:1784189114.674815:0:26165:0:(import.c:65:import_set_state_nolock()) ffff9dc0756a3800 : changing import state from FULL to CLOSED 00000100:00100000:2.0:1784189114.674834:0:26167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 4942 00000100:00100000:2.0:1784189114.674845:0:26167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf469b6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+5:2395:x1870854436259200:12345-192.168.203.12@tcp:9:kworker.0 00000020:00000080:2.0:1784189114.674860:0:26167:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xcc1762b626f8af15 00000001:00000004:1.0:1784189114.674861:0:26165:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294968949 00000100:00080000:2.0:1784189114.674867:0:26167:0:(import.c:65:import_set_state_nolock()) ffff9dc06b3ec800 : changing import state from FULL to CLOSED 00000100:00100000:1.0:1784189114.674977:0:26165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf469b5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+2:2395:x1870854436259072:12345-192.168.203.12@tcp:9:kworker.0 Request processed in 354us (810us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189114.674984:0:26165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 4941 00010000:00010000:1.0:1784189114.675006:0:26173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00000004:2.0:1784189114.675030:0:26167:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294968953 00000100:00100000:2.0:1784189114.675112:0:26167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf469b6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+2:2395:x1870854436259200:12345-192.168.203.12@tcp:9:kworker.0 Request processed in 269us (733us total) trans 0 rc 0/0 00000100:00080000:0.0:1784189114.675115:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1784189114.675121:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1784189114.675125:0:26167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 4942 00010000:00010000:2.0:1784189114.675307:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784189115.120400:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784189115.439573:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1784189115.439808:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf43f58e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1870854458087424:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1784189115.439911:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784189115.440009:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458087424 00000100:00100000:1.0:1784189115.440019:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458087424 00000100:00100000:1.0:1784189115.440141:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1918 00000100:00100000:1.0:1784189115.440153:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc07ab98a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1870854458087424:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1784189115.440184:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 212800 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1784189115.440281:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc07ab98a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1870854458087424:12345-0@lo:13:osp-pre-1-1.0 Request processed in 129us (369us total) trans 0 rc 0/0 00000100:00000400:0.0:1784189115.440285:0:3641:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1784189099/real 1784189099] req@ffff9dc075661880 x1870854458081536/t0(0) o400->MGC192.168.203.112@tcp@0@lo:26/25 lens 224/224 e 0 to 1 dl 1784189115 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784189115.440300:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1918 00000100:00100000:0.0:1784189115.440370:0:3641:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ TIMEOUT-NORESEND: req@ffff9dc075661880 x1870854458081536/t0(0) o400->MGC192.168.203.112@tcp@0@lo:26/25 lens 224/224 e 0 to 1 dl 1784189115 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1784189115.440382:0:3641:0:(import.c:65:import_set_state_nolock()) ffff9dc07110c800 MGS: changing import state from FULL to DISCONN 00000100:02020000:0.0:1784189115.440386:0:3641:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.203.112@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00000100:00080000:0.0:1784189115.440390:0:3641:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.203.112@tcp not replayable, auto-deactivating 00000100:00080000:0.0:1784189115.440392:0:3641:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:0.0:1784189115.440396:0:3641:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9dc075661880 x1870854458081536/t0(0) o400->MGC192.168.203.112@tcp@0@lo:26/25 lens 224/224 e 0 to 1 dl 1784189115 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784189115.440406:0:3641:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9dbf469b6a00 x1870854458083456/t0(0) o400->MGC192.168.203.112@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1784189120 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784189115.440418:0:3641:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9dc07016e300 x1870854458084864/t0(0) o400->MGC192.168.203.112@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1784189125 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784189115.440427:0:3641:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9dc080f6aa00 x1870854458086272/t0(0) o400->MGC192.168.203.112@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1784189130 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 10000000:01000000:0.0:1784189115.440442:0:3641:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:0.0:1784189115.440446:0:3641:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:0.0:1784189115.440447:0:3641:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:0.0:1784189115.440450:0:3641:0:(import.c:418:ptlrpc_pinger_force()) MGS: waking up pinger s:DISCONN 00000100:00100000:0.0:1784189115.440474:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc075661880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:bd553d0d-03e2-4233-b06b-b55bbfa2b954:3641:1870854458081536:0@lo:400:kworker.0 00000100:00100000:0.0:1784189115.440514:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc080f6aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bd553d0d-03e2-4233-b06b-b55bbfa2b954:3640:1870854458086272:0@lo:400:kworker.0 00000100:00080000:2.0:1784189115.442637:0:63468:0:(pinger.c:229:ptlrpc_pinger_process_import()) bd553d0d-03e2-4233-b06b-b55bbfa2b954->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1784189115.442646:0:63468:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:2.0:1784189115.442651:0:63468:0:(import.c:65:import_set_state_nolock()) ffff9dc07110c800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1784189115.442659:0:63468:0:(import.c:510:import_select_connection()) MGC192.168.203.112@tcp: connect to NID 0@lo last attempt 3310 00000100:00080000:2.0:1784189115.442683:0:63468:0:(import.c:624:import_select_connection()) MGC192.168.203.112@tcp: import ffff9dc07110c800 using connection 192.168.203.112@tcp/0@lo 00000100:00100000:2.0:1784189115.442708:0:63468:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9dc07ab9ad80 x1870854458087680/t0(0) o250->MGC192.168.203.112@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1784189115.442740:0:63468:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1784189115.442744:0:63468:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1784189115.442746:0:63468:0:(import.c:65:import_set_state_nolock()) ffff9dbf42271800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1784189115.442753:0:63468:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3356 00000100:00080000:2.0:1784189115.442756:0:63468:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1784189115.442763:0:63468:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9dbf42271800 using connection 192.168.203.112@tcp/0@lo 00000100:00100000:2.0:1784189115.442784:0:63468:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9dc07ab99c00 x1870854458087808/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1784189115.442829:0:63468:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1784189115.442833:0:63468:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1784189115.442836:0:63468:0:(import.c:65:import_set_state_nolock()) ffff9dbf425f4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1784189115.442842:0:63468:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3356 00000100:00080000:2.0:1784189115.442844:0:63468:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1784189115.442850:0:63468:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9dbf425f4800 using connection 192.168.203.112@tcp/0@lo 00000100:00100000:2.0:1784189115.442867:0:63468:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9dc07ab9b800 x1870854458088064/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1784189115.444440:0:63468:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1784189115.444448:0:63468:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1784189115.444451:0:63468:0:(import.c:65:import_set_state_nolock()) ffff9dbf436c4000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1784189115.444458:0:63468:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3356 00000100:00080000:2.0:1784189115.444461:0:63468:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1784189115.444468:0:63468:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9dbf436c4000 using connection 192.168.203.112@tcp/0@lo 00000100:00100000:2.0:1784189115.444510:0:63468:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9dc07ab9bb80 x1870854458088320/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1784189115.444531:0:63468:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1784189115.444534:0:63468:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1784189115.444536:0:63468:0:(import.c:65:import_set_state_nolock()) ffff9dbf43690800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1784189115.444539:0:63468:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3356 00000100:00080000:2.0:1784189115.444541:0:63468:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1784189115.444544:0:63468:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff9dbf43690800 using connection 192.168.203.112@tcp/0@lo 00000100:00100000:2.0:1784189115.444553:0:63468:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9dc07ab9a680 x1870854458088576/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1784189115.444601:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc07ab9ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:bd553d0d-03e2-4233-b06b-b55bbfa2b954:3639:1870854458087680:0@lo:250:kworker.0 00000400:00000100:2.0:1784189115.444647:0:3639:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1870854458087680 offset 0 length 520: 4 00000100:00100000:2.0:1784189115.444681:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc07ab99c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3639:1870854458087808:0@lo:38:kworker.0 00000100:00100000:2.0:1784189115.444712:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784189115.444738:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc07ab9b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3639:1870854458088064:0@lo:38:kworker.0 00000100:00100000:2.0:1784189115.444758:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784189115.444774:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc07ab9bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3639:1870854458088320:0@lo:38:kworker.0 00000100:00100000:2.0:1784189115.444797:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784189115.444812:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc07ab9a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3639:1870854458088576:0@lo:38:kworker.0 00000100:00100000:2.0:1784189115.444829:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784189115.444864:0:66169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458087808 00000100:00100000:2.0:1784189115.444870:0:66169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458087808 00000100:00100000:2.0:1784189115.448671:0:66169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458088064 00000100:00100000:2.0:1784189115.448687:0:66169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458088064 00000100:00100000:2.0:1784189115.448724:0:66169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458088576 00000100:00100000:2.0:1784189115.448742:0:66169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458088576 00000100:00100000:1.0:1784189115.448755:0:68287:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1175 00000100:00100000:1.0:1784189115.448764:0:68287:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc07ab9b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3639:x1870854458087808:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1784189115.448786:0:68287:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1784189115.448880:0:68287:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc07ab9b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3639:x1870854458087808:12345-0@lo:38:kworker.0 Request processed in 114us (4165us total) trans 0 rc -19/-19 00000100:00100000:1.0:1784189115.452058:0:68287:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1175 00000100:00100000:1.0:1784189115.452162:0:66945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1176 00000100:00100000:1.0:1784189115.452171:0:66945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc07ab99880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3639:x1870854458088064:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1784189115.452193:0:66945:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1784189115.452266:0:66945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc07ab99880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3639:x1870854458088064:12345-0@lo:38:kworker.0 Request processed in 93us (7505us total) trans 0 rc -19/-19 00000100:00100000:1.0:1784189115.452272:0:66945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1176 00000100:00100000:1.0:1784189115.452287:0:66945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1177 00000100:00100000:1.0:1784189115.452291:0:66945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc075aa0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3639:x1870854458088576:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1784189115.452301:0:66945:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1784189115.452361:0:66945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc075aa0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3639:x1870854458088576:12345-0@lo:38:kworker.0 Request processed in 68us (7530us total) trans 0 rc -19/-19 00000100:00100000:1.0:1784189115.452367:0:66945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1177 00000100:00080000:1.0:1784189115.452407:0:3639:0:(import.c:65:import_set_state_nolock()) ffff9dbf42271800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1784189115.452412:0:3639:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1784189115.452415:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc07ab99c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3639:1870854458087808:0@lo:38:kworker.0 00000100:00080000:1.0:1784189115.452424:0:3639:0:(import.c:65:import_set_state_nolock()) ffff9dbf425f4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1784189115.452428:0:3639:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1784189115.452431:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc07ab9b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3639:1870854458088064:0@lo:38:kworker.0 00000100:00080000:1.0:1784189115.452452:0:3639:0:(import.c:65:import_set_state_nolock()) ffff9dbf43690800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1784189115.452455:0:3639:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1784189115.452458:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc07ab9a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3639:1870854458088576:0@lo:38:kworker.0 00000100:00100000:1.0:1784189115.452507:0:26492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458088320 00000100:00100000:1.0:1784189115.452525:0:26492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458088320 00000100:00100000:1.0:1784189115.452771:0:26492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3763 00000100:00100000:1.0:1784189115.452779:0:26492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc07ab98000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3639:x1870854458088320:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1784189115.452791:0:26492:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1784189115.452835:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc07ab9a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3640:1870854458087936:0@lo:400:kworker.0 00000100:00100000:1.0:1784189115.452836:0:26492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc07ab98000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3639:x1870854458088320:12345-0@lo:38:kworker.0 Request processed in 54us (8036us total) trans 0 rc -19/-19 00000100:00100000:1.0:1784189115.452856:0:26492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3763 00000100:00080000:1.0:1784189115.452898:0:3639:0:(import.c:65:import_set_state_nolock()) ffff9dbf436c4000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1784189115.452904:0:3639:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1784189115.452908:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc07ab9bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3639:1870854458088320:0@lo:38:kworker.0 00000100:00100000:3.0:1784189115.452927:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784189115.452948:0:68287:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458087936 00000100:00100000:1.0:1784189115.452955:0:68287:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458087936 00000100:00100000:3.0:1784189115.452983:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1784189115.452994:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc07ab98380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3640:1870854458088192:0@lo:400:kworker.0 00000100:00100000:1.0:1784189115.453002:0:68287:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1109 00000100:00100000:1.0:1784189115.453013:0:68287:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc07016f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1870854458087936:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784189115.453042:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784189115.453080:0:68287:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc07016f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1870854458087936:12345-0@lo:400:kworker.0 Request processed in 68us (154us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189115.453087:0:68287:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1109 00000100:00100000:3.0:1784189115.453092:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc07ab9a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3640:1870854458087936:0@lo:400:kworker.0 00000100:00100000:1.0:1784189115.453103:0:68287:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458088192 00000100:00100000:1.0:1784189115.453109:0:68287:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458088192 00000100:00100000:1.0:1784189115.453132:0:68287:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1110 00000100:00100000:1.0:1784189115.453137:0:68287:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc07016e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1870854458088192:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784189115.453158:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc07ab98e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1870854458088448:0@lo:400:kworker.0 00000100:00100000:1.0:1784189115.453178:0:68287:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc07016e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1870854458088192:12345-0@lo:400:kworker.0 Request processed in 38us (137us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189115.453185:0:68287:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1110 00000100:00100000:3.0:1784189115.453208:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784189115.453241:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc07ab9aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1870854458087552:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1784189115.453250:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc07016e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bd553d0d-03e2-4233-b06b-b55bbfa2b954:3642:1870854458084864:0@lo:400:kworker.0 00000100:00100000:3.0:1784189115.453270:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf469b6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bd553d0d-03e2-4233-b06b-b55bbfa2b954:3642:1870854458083456:0@lo:400:kworker.0 00000100:00100000:1.0:1784189115.453289:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784189115.453314:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458088448 00000100:00100000:1.0:1784189115.453381:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf43f58e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1870854458087424:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1784189115.453409:0:9466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458087552 00000100:00100000:1.0:1784189115.453413:0:9466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458087552 00000100:00100000:1.0:1784189115.453611:0:9466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1919 00000100:00100000:1.0:1784189115.453621:0:9466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc07ab9a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1870854458087552:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1784189115.453646:0:9466:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 212800 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1784189115.453649:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458088448 00000100:00100000:1.0:1784189115.453701:0:9466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc07ab9a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3643:x1870854458087552:12345-0@lo:13:osp-pre-0-1.0 Request processed in 80us (410us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189115.453711:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2399 00000100:00100000:1.0:1784189115.453712:0:9466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1919 00000100:00100000:3.0:1784189115.453733:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc07016d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3642:x1870854458088448:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784189115.453765:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc07ab9aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1870854458087552:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1784189115.453822:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc07016d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3642:x1870854458088448:12345-0@lo:400:kworker.0 Request processed in 92us (613us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189115.453832:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2399 00000100:00100000:3.0:1784189115.453874:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc07ab98380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3640:1870854458088192:0@lo:400:kworker.0 00000100:00100000:3.0:1784189115.453900:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc07ab98e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1870854458088448:0@lo:400:kworker.0 00000400:00000100:1.0:1784189115.506209:0:3635:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-192.168.203.12@tcp portal 26 match 1870854436259328 offset 0 length 520: 4 00000100:00100000:1.0:1784189115.506250:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1784189115.506289:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1784189115.506408:0:66945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436259456 00000100:00100000:3.0:1784189115.506417:0:66945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436259456 00000100:00100000:3.0:1784189115.506451:0:66945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436259584 00000100:00100000:3.0:1784189115.506454:0:66945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436259584 00000100:00100000:3.0:1784189115.506484:0:66945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1111 00000100:00100000:3.0:1784189115.506493:0:66945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc07ab9bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+6:2399:x1870854436259584:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:3.0:1784189115.506562:0:66945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc07ab9bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+6:2399:x1870854436259584:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 69us (272us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189115.506570:0:66945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1111 00000100:00100000:3.0:1784189115.506602:0:66945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1178 00000100:00100000:3.0:1784189115.506606:0:66945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc07ab9aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2395:x1870854436259456:12345-192.168.203.12@tcp:38:kworker.0 00010000:00020000:3.0:1784189115.506624:0:66945:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.203.12@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1784189115.506650:0:66945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc07ab9aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2395:x1870854436259456:12345-192.168.203.12@tcp:38:kworker.0 Request processed in 42us (400us total) trans 0 rc -19/-19 00000100:00100000:3.0:1784189115.506656:0:66945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1178 00010000:00010000:0.0:1784189116.144992:0:7454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784189117.168353:0:26173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784189118.193524:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784189119.219466:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784189119.526848:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1784189119.526923:0:66171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436259840 00000100:00100000:2.0:1784189119.526932:0:66171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436259840 00000100:00100000:2.0:1784189119.526997:0:66171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1112 00000100:00100000:2.0:1784189119.527007:0:66171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf469b4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+6:2398:x1870854436259840:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:2.0:1784189119.527073:0:66171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf469b4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+6:2398:x1870854436259840:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 68us (233us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189119.527081:0:66171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1112 00000100:00080000:0.0:1784189119.527215:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1784189119.527408:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1784189119.527479:0:68287:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436259712 00000100:00100000:3.0:1784189119.527484:0:68287:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436259712 00000100:00100000:3.0:1784189119.527596:0:68287:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1179 00000100:00100000:3.0:1784189119.527601:0:68287:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf469b6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2395:x1870854436259712:12345-192.168.203.12@tcp:38:kworker.0 00010000:00020000:3.0:1784189119.527619:0:68287:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.203.12@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1784189119.527654:0:68287:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf469b6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2395:x1870854436259712:12345-192.168.203.12@tcp:38:kworker.0 Request processed in 51us (246us total) trans 0 rc -19/-19 00000100:00100000:3.0:1784189119.527661:0:68287:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1179 00000020:01000004:0.0:1784189119.578836:0:88962:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1784189119.578842:0:88962:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds1_flakey 00000020:01000004:0.0:1784189119.578844:0:88962:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:0.0:1784189119.578967:0:88962:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff9dbf4845c000 00000020:01000004:0.0:1784189119.578982:0:88962:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0000, type=osd-ldiskfs, lsifl=200005, mountfl=0 00000020:01000004:0.0:1784189119.578996:0:88962:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-ldiskfs) 00000020:00000080:0.0:1784189119.579009:0:88962:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff9dbf44d78000) 00000020:00000080:0.0:1784189119.579027:0:88962:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-ldiskfs with refcount 2 00100000:10000000:2.0:1784189119.698408:0:88962:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:2.0:1784189119.699678:0:88962:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:2.0:1784189119.703959:0:88962:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:2.0:1784189119.707507:0:88962:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/32) registered 00100000:10000000:2.0:1784189119.707876:0:88962:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:2.0:1784189119.708141:0:88962:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/32) registered 00100000:10000000:2.0:1784189119.708404:0:88962:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:2.0:1784189119.708715:0:88962:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/32) registered 00100000:10000000:2.0:1784189119.708991:0:88962:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/32) registered 00100000:10000000:2.0:1784189119.709241:0:88962:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:0.0:1784189119.713973:0:88962:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:0.0:1784189119.714454:0:88962:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/32) registered 00100000:10000000:0.0:1784189119.714798:0:88962:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:0.0:1784189119.715015:0:88962:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x9:0x0] (8/32) registered 00100000:10000000:0.0:1784189119.716451:0:88962:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2f:0x0] (24/16) registered 00100000:10000000:0.0:1784189119.716725:0:88962:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:0.0:1784189119.717791:0:88962:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:0.0:1784189119.718019:0:88962:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1e:0x0] (16/1) registered 00100000:10000000:0.0:1784189119.718207:0:88962:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:0.0:1784189119.718459:0:88962:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:0.0:1784189119.718738:0:88962:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:0.0:1784189119.718921:0:88962:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x32:0x0] (24/16) registered 00100000:10000000:0.0:1784189119.719218:0:88962:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x34:0x0] (24/16) registered 00100000:10000000:0.0:1784189119.719724:0:88962:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:0.0:1784189119.720857:0:88962:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:0.0:1784189119.721235:0:88962:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:0.0:1784189119.721452:0:88962:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:0.0:1784189119.721730:0:88962:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:0.0:1784189119.721920:0:88962:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x20:0x0] (16/1) registered 00100000:10000000:0.0:1784189119.722110:0:88962:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x22:0x0] (16/1) registered 00100000:10000000:0.0:1784189119.724675:0:88962:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:0.0:1784189119.725305:0:88962:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:0.0:1784189119.725604:0:88962:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:0.0:1784189119.725936:0:88962:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:0.0:1784189119.726210:0:88962:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:0.0:1784189119.726417:0:88962:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:0.0:1784189119.726720:0:88962:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1f:0x0] (16/1) registered 00100000:10000000:0.0:1784189119.726920:0:88962:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x21:0x0] (16/1) registered 00100000:10000000:0.0:1784189119.727117:0:88962:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x23:0x0] (16/1) registered 00100000:10000000:0.0:1784189119.727568:0:88962:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x33:0x0] (24/16) registered 00100000:10000000:0.0:1784189119.732053:0:88962:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:0.0:1784189119.732866:0:88962:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x31:0x0] (24/16) registered 00100000:10000000:0.0:1784189119.733240:0:88962:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:0.0:1784189119.733526:0:88962:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x30:0x0] (24/16) registered 00100000:10000000:0.0:1784189119.733879:0:88962:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:0.0:1784189119.734135:0:88962:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:2.0:1784189119.741238:0:88962:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2:0x0] (8/32) registered 00100000:10000000:2.0:1784189119.744443:0:88962:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/32) registered 00100000:10000000:2.0:1784189119.745095:0:88962:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/32) registered 00100000:10000000:2.0:1784189119.746036:0:88962:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/32) registered 00100000:10000000:2.0:1784189119.746646:0:88962:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/32) registered 00100000:10000000:2.0:1784189119.746916:0:88962:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/32) registered 00100000:10000000:2.0:1784189119.747128:0:88962:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/32) registered 00080000:01000000:2.0:1784189119.747797:0:88962:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0000: register osd-ldiskfs tunable parameters 00000020:00000080:2.0:1784189119.748012:0:88962:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:2.0:1784189119.748020:0:88962:0:(osd_handler.c:8929:osd_obd_connect()) connect #0 00000020:00000080:2.0:1784189119.748030:0:88962:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xcc1762b626f8b06c 00000020:01000004:2.0:1784189119.748037:0:88962:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0000 on device /dev/mapper/mds1_flakey 00000020:01000000:2.0:1784189119.748050:0:88962:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:2.0:1784189119.748055:0:88962:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9dbf4845c000 from MGS 00000020:01000004:2.0:1784189119.748059:0:88962:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:2.0:1784189119.748069:0:88962:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff9dc075478000) 00000020:00000080:2.0:1784189119.748081:0:88962:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mgs with refcount 2 00000020:01000004:2.0:1784189119.748140:0:88962:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9dbf4845c000 from MGS, refs=2 00080000:01000000:2.0:1784189119.748145:0:88962:0:(osd_handler.c:8929:osd_obd_connect()) connect #1 00000020:00000080:2.0:1784189119.748150:0:88962:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xcc1762b626f8b07a 00010000:00010000:2.0:1784189119.748258:0:88962:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-MGS-3 is initialized 00000040:01000000:2.0:1784189119.752208:0:88962:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 10000000:01000000:2.0:1784189119.753114:0:88966:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:3.0:1784189119.753157:0:88962:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:3.0:1784189119.753192:0:88962:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1784189119.754794:0:88962:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:3.0:1784189119.755036:0:88962:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1784189119.755180:0:88962:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:3.0:1784189119.755186:0:88962:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:3.0:1784189119.757126:0:88962:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:3.0:1784189119.757136:0:88962:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:2.0:1784189119.757497:0:88962:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:2.0:1784189119.757503:0:88962:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:3.0:1784189119.763717:0:88962:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:3.0:1784189119.763742:0:88962:0:(obd_mount.c:392:lustre_start_mgc()) New MGS with live MGC 00000020:01000004:3.0:1784189119.763744:0:88962:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.112@tcp:Set MGC reconnect 2 10000000:01000000:3.0:1784189119.763748:0:88962:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.112@tcp 2/d0:i1:r0:or0:CONNECTING 00000100:00080000:3.0:1784189119.763752:0:88962:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffff9dc07110c800 already not connected (conn 59, was 0): CONNECTING 00000100:00100000:3.0:1784189119.763758:0:88962:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 8s for inflight to error out 00010000:00010000:0.0:1784189120.239741:0:7454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784189120.551072:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1784189120.551113:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1784189120.551205:0:66170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436260096 00000100:00100000:1.0:1784189120.551215:0:66170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436260096 00000100:00100000:1.0:1784189120.551275:0:66170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436259968 00000100:00100000:1.0:1784189120.551278:0:66170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436259968 00000100:00100000:1.0:1784189120.551300:0:66170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1113 00000100:00100000:1.0:1784189120.551309:0:66170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc075aa1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+6:2399:x1870854436260096:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:1.0:1784189120.551415:0:66170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc075aa1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+6:2399:x1870854436260096:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 107us (352us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189120.551423:0:66170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1113 00000100:00100000:1.0:1784189120.551439:0:66170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1180 00000100:00100000:1.0:1784189120.551443:0:66170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc075aa3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2395:x1870854436259968:12345-192.168.203.12@tcp:38:kworker.0 00010000:00020000:1.0:1784189120.551462:0:66170:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.203.12@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1784189120.551500:0:66170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc075aa3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2395:x1870854436259968:12345-192.168.203.12@tcp:38:kworker.0 Request processed in 55us (386us total) trans 0 rc -19/-19 00000100:00100000:1.0:1784189120.551507:0:66170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1180 00000100:00080000:0.0:1784189120.559782:0:63468:0:(pinger.c:229:ptlrpc_pinger_process_import()) bd553d0d-03e2-4233-b06b-b55bbfa2b954->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1784189120.559792:0:63468:0:(pinger.c:247:ptlrpc_pinger_process_import()) bd553d0d-03e2-4233-b06b-b55bbfa2b954->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1784189120.559795:0:63468:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1784189120.559798:0:63468:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1784189120.559801:0:63468:0:(import.c:65:import_set_state_nolock()) ffff9dbf42271800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1784189120.559809:0:63468:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3357 00000100:00080000:0.0:1784189120.559814:0:63468:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1784189120.559822:0:63468:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9dbf42271800 using connection 192.168.203.112@tcp/0@lo 00000100:00100000:0.0:1784189120.559867:0:63468:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9dc080f6aa00 x1870854458088704/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1784189120.559926:0:63468:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1784189120.559930:0:63468:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1784189120.559932:0:63468:0:(import.c:65:import_set_state_nolock()) ffff9dbf425f4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1784189120.559935:0:63468:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3357 00000100:00080000:0.0:1784189120.559938:0:63468:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1784189120.559942:0:63468:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9dbf425f4800 using connection 192.168.203.112@tcp/0@lo 00000100:00100000:0.0:1784189120.559955:0:63468:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9dc05ed7b100 x1870854458088960/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1784189120.559976:0:63468:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1784189120.559979:0:63468:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1784189120.559981:0:63468:0:(import.c:65:import_set_state_nolock()) ffff9dbf436c4000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1784189120.559984:0:63468:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3357 00000100:00080000:0.0:1784189120.559986:0:63468:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1784189120.559990:0:63468:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9dbf436c4000 using connection 192.168.203.112@tcp/0@lo 00000100:00100000:0.0:1784189120.560002:0:63468:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9dc05ed7aa00 x1870854458089216/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1784189120.560024:0:63468:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1784189120.560027:0:63468:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1784189120.560028:0:63468:0:(import.c:65:import_set_state_nolock()) ffff9dbf43690800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1784189120.560032:0:63468:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3357 00000100:00080000:0.0:1784189120.560034:0:63468:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1784189120.560038:0:63468:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff9dbf43690800 using connection 192.168.203.112@tcp/0@lo 00000100:00100000:0.0:1784189120.560057:0:63468:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9dbf4262c380 x1870854458089600/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1784189120.560143:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc05ed78380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3643:1870854458088832:0@lo:400:kworker.0 00000100:00100000:3.0:1784189120.560209:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784189120.560251:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1784189120.560258:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf4262ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1870854458089472:0@lo:400:kworker.0 00000100:00100000:3.0:1784189120.560283:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784189120.560337:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc05ed79880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3640:1870854458089088:0@lo:400:kworker.0 00000100:00100000:3.0:1784189120.560362:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784189120.560380:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1784189120.560393:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf4262f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1870854458089344:0@lo:400:kworker.0 00000100:00100000:3.0:1784189120.560419:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784189120.560446:0:26164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458089472 00000100:00100000:3.0:1784189120.560451:0:26164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458089472 00000100:00100000:3.0:1784189120.560495:0:26164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458089344 00000100:00100000:3.0:1784189120.560498:0:26164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458089344 00000100:00100000:3.0:1784189120.560519:0:26164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2400 00000100:00100000:3.0:1784189120.560527:0:26164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc07016fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0001-mdtlov_UUID+5:3643:x1870854458089472:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784189120.560588:0:26164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc07016fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0001-mdtlov_UUID+5:3643:x1870854458089472:12345-0@lo:400:kworker.0 Request processed in 61us (303us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189120.560596:0:26164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2400 00000100:00100000:3.0:1784189120.560613:0:26164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2401 00000100:00100000:3.0:1784189120.560620:0:26164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc07016c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0001-mdtlov_UUID+5:3640:x1870854458089344:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784189120.560651:0:26164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc07016c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0001-mdtlov_UUID+5:3640:x1870854458089344:12345-0@lo:400:kworker.0 Request processed in 31us (230us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189120.560657:0:26164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2401 00000100:00100000:3.0:1784189120.560710:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf4262f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1870854458089344:0@lo:400:kworker.0 00000100:00100000:3.0:1784189120.560742:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf4262ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1870854458089472:0@lo:400:kworker.0 00000100:00100000:0.0:1784189120.560894:0:66169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458088832 00000100:00100000:0.0:1784189120.560899:0:66169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458088832 00000100:00100000:0.0:1784189120.560937:0:66169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458089088 00000100:00100000:0.0:1784189120.560941:0:66169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458089088 00000100:00100000:0.0:1784189120.560964:0:66169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1114 00000100:00100000:0.0:1784189120.560971:0:66169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc07016e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1870854458088832:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784189120.561008:0:66169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc07016e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1870854458088832:12345-0@lo:400:kworker.0 Request processed in 37us (799us total) trans 0 rc 0/0 00000100:00100000:0.0:1784189120.561014:0:66169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1114 00000100:00100000:0.0:1784189120.561029:0:66169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1115 00000100:00100000:0.0:1784189120.561035:0:66169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc07016ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1870854458089088:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784189120.561066:0:66169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc07016ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1870854458089088:12345-0@lo:400:kworker.0 Request processed in 31us (702us total) trans 0 rc 0/0 00000100:00100000:0.0:1784189120.561072:0:66169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1115 00000100:00080000:0.0:1784189120.561090:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1784189120.561094:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1784189120.561096:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1784189120.561429:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc05ed79880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3640:1870854458089088:0@lo:400:kworker.0 00000100:00100000:3.0:1784189120.561454:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc05ed78380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3643:1870854458088832:0@lo:400:kworker.0 00000100:00100000:1.0:1784189120.561594:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc080f6aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3639:1870854458088704:0@lo:38:kworker.0 00000100:00100000:1.0:1784189120.561637:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784189120.561660:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc05ed7b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3639:1870854458088960:0@lo:38:kworker.0 00000100:00100000:1.0:1784189120.561769:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784189120.561784:0:66169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458088704 00000100:00100000:1.0:1784189120.561786:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc05ed7aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3639:1870854458089216:0@lo:38:kworker.0 00000100:00100000:0.0:1784189120.561788:0:66169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458088704 00000100:00100000:0.0:1784189120.561804:0:66169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458088960 00000100:00100000:0.0:1784189120.561807:0:66169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458088960 00000100:00100000:1.0:1784189120.561809:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784189120.561820:0:66169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1181 00000100:00100000:1.0:1784189120.561822:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf4262c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3639:1870854458089600:0@lo:38:kworker.0 00000100:00100000:0.0:1784189120.561824:0:66169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc07ab9a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3639:x1870854458088704:12345-0@lo:38:kworker.0 00000100:00100000:1.0:1784189120.561841:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00020000:0.0:1784189120.561841:0:66169:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1784189120.561869:0:68287:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458089600 00000100:00100000:0.0:1784189120.561872:0:66169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc07ab9a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3639:x1870854458088704:12345-0@lo:38:kworker.0 Request processed in 47us (235us total) trans 0 rc -19/-19 00000100:00100000:1.0:1784189120.561873:0:68287:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458089600 00000100:00100000:1.0:1784189120.561887:0:68287:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1182 00000100:00100000:1.0:1784189120.561891:0:68287:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc07ab9b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3639:x1870854458088960:12345-0@lo:38:kworker.0 00000100:00100000:0.0:1784189120.561891:0:66169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1181 00000100:00100000:0.0:1784189120.561902:0:66169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1183 00000100:00100000:0.0:1784189120.561906:0:66169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc07ab98e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3639:x1870854458089600:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1784189120.562283:0:66169:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1784189120.562355:0:66169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc07ab98e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3639:x1870854458089600:12345-0@lo:38:kworker.0 Request processed in 446us (511us total) trans 0 rc -19/-19 00000100:00100000:0.0:1784189120.562363:0:66169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1183 00000100:00080000:0.0:1784189120.562406:0:3639:0:(import.c:65:import_set_state_nolock()) ffff9dbf42271800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1784189120.562411:0:3639:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1784189120.562414:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc080f6aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3639:1870854458088704:0@lo:38:kworker.0 00000100:00080000:0.0:1784189120.562423:0:3639:0:(import.c:65:import_set_state_nolock()) ffff9dbf43690800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1784189120.562426:0:3639:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1784189120.562428:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf4262c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3639:1870854458089600:0@lo:38:kworker.0 00000100:00100000:0.0:1784189120.562469:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1784189120.562479:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc075aa0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1870854458089856:0@lo:13:osp-pre-0-1.0 00010000:00020000:1.0:1784189120.562490:0:68287:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1784189120.562505:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784189120.562521:0:68287:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc07ab9b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3639:x1870854458088960:12345-0@lo:38:kworker.0 Request processed in 628us (752us total) trans 0 rc -19/-19 00000100:00100000:1.0:1784189120.562527:0:68287:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1182 00000100:00100000:0.0:1784189120.562548:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458089856 00000100:00100000:0.0:1784189120.562552:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458089856 00000100:00080000:1.0:1784189120.562563:0:3639:0:(import.c:65:import_set_state_nolock()) ffff9dbf425f4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1784189120.562566:0:3639:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1784189120.562569:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc05ed7b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3639:1870854458088960:0@lo:38:kworker.0 00000100:00100000:0.0:1784189120.562577:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1920 00000100:00100000:0.0:1784189120.562583:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf4262c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1870854458089856:12345-0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1784189120.562603:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458089216 00002000:00000024:0.0:1784189120.562604:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 212800 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1784189120.562606:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458089216 00000100:00100000:1.0:1784189120.562626:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3764 00000100:00100000:0.0:1784189120.562637:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf4262c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1870854458089856:12345-0@lo:13:osp-pre-0-1.0 Request processed in 55us (131us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189120.562638:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc07ab99c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3639:x1870854458089216:12345-0@lo:38:kworker.0 00000100:00100000:0.0:1784189120.562643:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1920 00010000:00020000:1.0:1784189120.562649:0:8439:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1784189120.562678:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc07ab99c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3639:x1870854458089216:12345-0@lo:38:kworker.0 Request processed in 38us (867us total) trans 0 rc -19/-19 00000100:00100000:1.0:1784189120.562684:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3764 00000100:00100000:1.0:1784189120.562699:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1784189120.562706:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf4262ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1870854458089728:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1784189120.562730:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784189120.562756:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458089728 00000100:00100000:1.0:1784189120.562759:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458089728 00000100:00100000:1.0:1784189120.562780:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1921 00000100:00100000:1.0:1784189120.562786:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc07ab98380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1870854458089728:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1784189120.562801:0:8432:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 212800 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1784189120.562840:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc07ab98380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1870854458089728:12345-0@lo:13:osp-pre-1-1.0 Request processed in 54us (109us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189120.562846:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1921 00000100:00080000:1.0:1784189120.562871:0:3639:0:(import.c:65:import_set_state_nolock()) ffff9dbf436c4000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1784189120.562875:0:3639:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1784189120.562878:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc05ed7aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3639:1870854458089216:0@lo:38:kworker.0 00000100:00100000:3.0:1784189120.563121:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf4262ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1870854458089728:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1784189120.563158:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc075aa0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1870854458089856:0@lo:13:osp-pre-0-1.0 00000001:00100000:3.0:1784189120.565043:0:9506:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of b90fcc1c-0e69-42a4-a116-a71fec7aeb78 00000020:00000080:3.0:1784189120.565051:0:9506:0:(genops.c:906:class_export_put()) final put ffff9dbf46d39800/b90fcc1c-0e69-42a4-a116-a71fec7aeb78 00000020:00000080:0.0:1784189120.566124:0:63468:0:(genops.c:865:class_export_destroy()) destroying export ffff9dbf46d39800/b90fcc1c-0e69-42a4-a116-a71fec7aeb78 for lustre-OST0001 00000020:00000080:0.0:1784189120.566188:0:63468:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9dc06b3ec800 for lustre-OST0001 00000001:00100000:3.0:1784189120.568951:0:8423:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of b90fcc1c-0e69-42a4-a116-a71fec7aeb78 00000020:00000080:3.0:1784189120.568983:0:8423:0:(genops.c:906:class_export_put()) final put ffff9dbf43d8c800/b90fcc1c-0e69-42a4-a116-a71fec7aeb78 00000020:00000080:2.0:1784189120.569420:0:27065:0:(genops.c:865:class_export_destroy()) destroying export ffff9dbf43d8c800/b90fcc1c-0e69-42a4-a116-a71fec7aeb78 for lustre-OST0000 00000020:00000080:2.0:1784189120.569510:0:27065:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9dc0756a3800 for lustre-OST0000 00010000:00010000:0.0:1784189121.263506:0:26173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784189122.291891:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784189123.311565:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784189124.335488:0:7454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784189125.359935:0:26173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784189125.671218:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1784189125.671262:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1784189125.671303:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1784189125.671485:0:66169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436260480 00000100:00100000:0.0:1784189125.671494:0:66169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436260480 00000100:00100000:0.0:1784189125.671559:0:66169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436260352 00000100:00100000:0.0:1784189125.671562:0:66169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436260352 00000100:00100000:0.0:1784189125.671580:0:66169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1116 00000100:00100000:0.0:1784189125.671588:0:66169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc07016ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+6:2398:x1870854436260480:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:0.0:1784189125.671645:0:66169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc07016ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+6:2398:x1870854436260480:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 59us (436us total) trans 0 rc 0/0 00000100:00100000:0.0:1784189125.671652:0:66169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1116 00000100:00100000:0.0:1784189125.671667:0:66169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1184 00000100:00100000:0.0:1784189125.671671:0:66169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc07016ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2395:x1870854436260352:12345-192.168.203.12@tcp:38:kworker.0 00010000:00020000:0.0:1784189125.671690:0:66169:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.203.12@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1784189125.671708:0:66169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc07016ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2395:x1870854436260352:12345-192.168.203.12@tcp:38:kworker.0 Request processed in 36us (406us total) trans 0 rc -19/-19 00000100:00100000:0.0:1784189125.671714:0:66169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1184 00000100:00080000:1.0:1784189125.671770:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1784189125.674044:0:88967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436260224 00000100:00100000:2.0:1784189125.674058:0:88967:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436260224 00000100:00100000:2.0:1784189125.674110:0:88967:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 0 00000100:00100000:2.0:1784189125.674119:0:88967:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc07037e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:2395:x1870854436260224:12345-192.168.203.12@tcp:250:kworker.0 00010000:00080000:2.0:1784189125.674144:0:88967:0:(ldlm_lib.c:1445:target_handle_connect()) MGS: connection from 9957a2dc-fd88-4a91-bca3-e2b7f365ab0c@192.168.203.12@tcp t0 exp 0000000000000000 cur 3367 last 0 00000020:00000080:2.0:1784189125.674171:0:88967:0:(genops.c:1406:class_connect()) connect: client 9957a2dc-fd88-4a91-bca3-e2b7f365ab0c, cookie 0xcc1762b626f8b081 00000100:00080000:2.0:1784189125.674302:0:88967:0:(import.c:65:import_set_state_nolock()) ffff9dbf43e99800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1784189125.674424:0:88967:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc07037e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9957a2dc-fd88-4a91-bca3-e2b7f365ab0c+5:2395:x1870854436260224:12345-192.168.203.12@tcp:250:kworker.0 Request processed in 304us (3159us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189125.674444:0:88967:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 0 00000100:00100000:1.0:1784189125.679455:0:3639:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1784189115/real 1784189115] req@ffff9dc07ab9ad80 x1870854458087680/t0(0) o250->MGC192.168.203.112@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1784189125 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784189125.679495:0:3639:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9dc07ab9ad80 x1870854458087680/t0(0) o250->MGC192.168.203.112@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1784189125 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1784189125.679542:0:3639:0:(import.c:65:import_set_state_nolock()) ffff9dc07110c800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1784189125.679552:0:3639:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:1.0:1784189125.679562:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc07ab9ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:bd553d0d-03e2-4233-b06b-b55bbfa2b954:3639:1870854458087680:0@lo:250:kworker.0 00000100:00080000:1.0:1784189125.679600:0:27065:0:(pinger.c:229:ptlrpc_pinger_process_import()) bd553d0d-03e2-4233-b06b-b55bbfa2b954->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1784189125.679605:0:27065:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:1.0:1784189125.679607:0:27065:0:(import.c:65:import_set_state_nolock()) ffff9dc07110c800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1784189125.679612:0:27065:0:(import.c:510:import_select_connection()) MGC192.168.203.112@tcp: connect to NID 0@lo last attempt 3357 00000100:00080000:1.0:1784189125.679616:0:27065:0:(import.c:589:import_select_connection()) MGC192.168.203.112@tcp: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1784189125.679622:0:27065:0:(import.c:624:import_select_connection()) MGC192.168.203.112@tcp: import ffff9dc07110c800 using connection 192.168.203.112@tcp/0@lo 00000100:00100000:1.0:1784189125.679648:0:27065:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9dc07ab9ad80 x1870854458089984/t0(0) o250->MGC192.168.203.112@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 10000000:01000000:3.0:1784189125.679659:0:88962:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000100:00080000:1.0:1784189125.679667:0:27065:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1784189125.679671:0:27065:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1784189125.679673:0:27065:0:(import.c:65:import_set_state_nolock()) ffff9dbf42271800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1784189125.679676:0:27065:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3362 00010000:00010000:3.0:1784189125.679677:0:88962:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.112@tcp lock: ffff9dc04a20a400/0xcc1762b626f8aca6 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0xcc1762b626f8acad expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1784189125.679679:0:27065:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1784189125.679686:0:27065:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9dbf42271800 using connection 192.168.203.112@tcp/0@lo 10000000:00010000:3.0:1784189125.679694:0:88962:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.112@tcp lock: ffff9dc04a20a400/0xcc1762b626f8aca6 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0xcc1762b626f8acad expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784189125.679702:0:88962:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00000100:00100000:1.0:1784189125.679705:0:27065:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9dbf43f58e00 x1870854458090112/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00010000:00010000:3.0:1784189125.679715:0:88962:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1784189125.679726:0:88962:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.112@tcp lock: ffff9dc04a20a400/0xcc1762b626f8aca6 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0xcc1762b626f8acad expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1784189125.679745:0:27065:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1784189125.679749:0:27065:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1784189125.679751:0:27065:0:(import.c:65:import_set_state_nolock()) ffff9dbf425f4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:3.0:1784189125.679756:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00080000:1.0:1784189125.679756:0:27065:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3362 00000100:00080000:1.0:1784189125.679760:0:27065:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1784189125.679772:0:27065:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9dbf425f4800 using connection 192.168.203.112@tcp/0@lo 00000100:00100000:3.0:1784189125.679774:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf46434380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3640:1870854458090240:0@lo:400:kworker.0 00000100:00100000:1.0:1784189125.679789:0:27065:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9dbf46435f80 x1870854458090368/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1784189125.679818:0:27065:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1784189125.679822:0:27065:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1784189125.679824:0:27065:0:(import.c:65:import_set_state_nolock()) ffff9dbf436c4000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1784189125.679827:0:27065:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3362 00000100:00080000:1.0:1784189125.679829:0:27065:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1784189125.679834:0:27065:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9dbf436c4000 using connection 192.168.203.112@tcp/0@lo 00000100:00100000:3.0:1784189125.679840:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784189125.679849:0:27065:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9dbf46435180 x1870854458090624/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1784189125.679882:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf46434000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3642:1870854458090496:0@lo:400:kworker.0 00000100:00080000:1.0:1784189125.679884:0:27065:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1784189125.679889:0:27065:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1784189125.679891:0:27065:0:(import.c:65:import_set_state_nolock()) ffff9dbf43690800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1784189125.679894:0:27065:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3362 00000100:00080000:1.0:1784189125.679896:0:27065:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1784189125.679901:0:27065:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff9dbf43690800 using connection 192.168.203.112@tcp/0@lo 00000100:00100000:1.0:1784189125.679914:0:27065:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9dc05ed91f80 x1870854458091008/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1784189125.679921:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784189125.679945:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00020000:1.0:1784189125.679947:0:3639:0:(client.c:1391:ptlrpc_import_delay_req()) @@@ invalidate in flight req@ffff9dc07ab9ad80 x1870854458089984/t0(0) o250->MGC192.168.203.112@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl Rpc:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784189125.679954:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc05ed92a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1870854458090752:0@lo:400:kworker.0 00000100:00100000:3.0:1784189125.679982:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784189125.680009:0:68287:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458090240 00000100:00100000:3.0:1784189125.680015:0:68287:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458090240 00000100:00100000:3.0:1784189125.680064:0:68287:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458090496 00000100:00100000:3.0:1784189125.680067:0:68287:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458090496 00000100:00100000:3.0:1784189125.680086:0:68287:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1117 00000100:00100000:3.0:1784189125.680101:0:68287:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc05ed7aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1870854458090240:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784189125.680144:0:68287:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc05ed7aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1870854458090240:12345-0@lo:400:kworker.0 Request processed in 44us (305us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189125.680152:0:68287:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1117 00000100:00100000:3.0:1784189125.680168:0:68287:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1118 00000100:00100000:3.0:1784189125.680175:0:68287:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc05ed7b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1870854458090496:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784189125.680204:0:68287:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc05ed7b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1870854458090496:12345-0@lo:400:kworker.0 Request processed in 30us (286us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189125.680208:0:68287:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1118 00000100:00080000:3.0:1784189125.680223:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1784189125.680244:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf46434000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3642:1870854458090496:0@lo:400:kworker.0 00010000:00010000:3.0:1784189125.680266:0:88962:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.112@tcp lock: ffff9dc0565e7600/0xcc1762b626f8ac0c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x110e400000000 nid: local remote: 0xcc1762b626f8ac13 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1784189125.680273:0:88962:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.112@tcp lock: ffff9dc0565e7600/0xcc1762b626f8ac0c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x110f400000000 nid: local remote: 0xcc1762b626f8ac13 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784189125.680278:0:88962:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1784189125.680282:0:88962:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1784189125.680286:0:88962:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.112@tcp lock: ffff9dc0565e7600/0xcc1762b626f8ac0c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x590f400000000 nid: local remote: 0xcc1762b626f8ac13 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189125.680295:0:88962:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.112@tcp lock: ffff9dc04a20b800/0xcc1762b626f8ac28 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x110e400000000 nid: local remote: 0xcc1762b626f8ac2f expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1784189125.680301:0:88962:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.112@tcp lock: ffff9dc04a20b800/0xcc1762b626f8ac28 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x110f400000000 nid: local remote: 0xcc1762b626f8ac2f expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784189125.680315:0:88962:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1784189125.680351:0:88962:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1784189125.680356:0:88962:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.112@tcp lock: ffff9dc04a20b800/0xcc1762b626f8ac28 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x590f400000000 nid: local remote: 0xcc1762b626f8ac2f expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189125.680365:0:88962:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.112@tcp lock: ffff9dc0565e6800/0xcc1762b626f8ac52 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x110e400000000 nid: local remote: 0xcc1762b626f8ac59 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1784189125.680371:0:88962:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.112@tcp lock: ffff9dc0565e6800/0xcc1762b626f8ac52 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x110f400000000 nid: local remote: 0xcc1762b626f8ac59 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784189125.680376:0:88962:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1784189125.680379:0:88962:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1784189125.680382:0:88962:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.112@tcp lock: ffff9dc0565e6800/0xcc1762b626f8ac52 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x590f400000000 nid: local remote: 0xcc1762b626f8ac59 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189125.680390:0:88962:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.112@tcp lock: ffff9dc04a20ac00/0xcc1762b626f8ac60 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x110e400000000 nid: local remote: 0xcc1762b626f8ac67 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1784189125.680396:0:88962:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.112@tcp lock: ffff9dc04a20ac00/0xcc1762b626f8ac60 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x110f400000000 nid: local remote: 0xcc1762b626f8ac67 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784189125.680401:0:88962:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1784189125.680404:0:88962:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1784189125.680407:0:88962:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.112@tcp lock: ffff9dc04a20ac00/0xcc1762b626f8ac60 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x590f400000000 nid: local remote: 0xcc1762b626f8ac67 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189125.680415:0:88962:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.112@tcp lock: ffff9dc04a20b000/0xcc1762b626f8ac7c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x110e400000000 nid: local remote: 0xcc1762b626f8ac83 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1784189125.680430:0:88962:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.112@tcp lock: ffff9dc04a20b000/0xcc1762b626f8ac7c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x110f400000000 nid: local remote: 0xcc1762b626f8ac83 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784189125.680436:0:88962:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1784189125.680439:0:88962:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1784189125.680443:0:88962:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.112@tcp lock: ffff9dc04a20b000/0xcc1762b626f8ac7c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x590f400000000 nid: local remote: 0xcc1762b626f8ac83 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189125.680451:0:88962:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.112@tcp lock: ffff9dc081b16200/0xcc1762b626f8ac8a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x110e400000000 nid: local remote: 0xcc1762b626f8ac91 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1784189125.680457:0:88962:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.112@tcp lock: ffff9dc081b16200/0xcc1762b626f8ac8a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x110f400000000 nid: local remote: 0xcc1762b626f8ac91 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784189125.680463:0:88962:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1784189125.680466:0:88962:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1784189125.680469:0:88962:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.112@tcp lock: ffff9dc081b16200/0xcc1762b626f8ac8a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x590f400000000 nid: local remote: 0xcc1762b626f8ac91 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189125.680477:0:88962:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.112@tcp lock: ffff9dc070147800/0xcc1762b626f8acb4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0xcc1762b626f8acbb expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1784189125.680483:0:88962:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.112@tcp lock: ffff9dc070147800/0xcc1762b626f8acb4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0xcc1762b626f8acbb expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784189125.680488:0:88962:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1784189125.680491:0:88962:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1784189125.680494:0:88962:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.112@tcp lock: ffff9dc070147800/0xcc1762b626f8acb4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0xcc1762b626f8acbb expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189125.680527:0:88962:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.112@tcp lock: ffff9dc0565e6a00/0xcc1762b626f8ac1a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0xcc1762b626f8ac21 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1784189125.680533:0:88962:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.112@tcp lock: ffff9dc0565e6a00/0xcc1762b626f8ac1a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0xcc1762b626f8ac21 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784189125.680538:0:88962:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1784189125.680541:0:88962:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1784189125.680545:0:88962:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.112@tcp lock: ffff9dc0565e6a00/0xcc1762b626f8ac1a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0xcc1762b626f8ac21 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189125.680556:0:88962:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.112@tcp lock: ffff9dc0565e6e00/0xcc1762b626f8ac36 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0xcc1762b626f8ac3d expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1784189125.680562:0:88962:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.112@tcp lock: ffff9dc0565e6e00/0xcc1762b626f8ac36 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0xcc1762b626f8ac3d expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784189125.680567:0:88962:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 00010000:00010000:3.0:1784189125.680570:0:88962:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1784189125.680573:0:88962:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.112@tcp lock: ffff9dc0565e6e00/0xcc1762b626f8ac36 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0xcc1762b626f8ac3d expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189125.680583:0:88962:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.112@tcp lock: ffff9dc0565e6000/0xcc1762b626f8ac44 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x110e400000000 nid: local remote: 0xcc1762b626f8ac4b expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1784189125.680589:0:88962:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.112@tcp lock: ffff9dc0565e6000/0xcc1762b626f8ac44 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x110f400000000 nid: local remote: 0xcc1762b626f8ac4b expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784189125.680594:0:88962:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1784189125.680602:0:88962:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1784189125.680607:0:88962:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.112@tcp lock: ffff9dc0565e6000/0xcc1762b626f8ac44 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x590f400000000 nid: local remote: 0xcc1762b626f8ac4b expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189125.680616:0:88962:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.112@tcp lock: ffff9dc04a20a600/0xcc1762b626f8ac6e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x110e400000000 nid: local remote: 0xcc1762b626f8ac75 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1784189125.680622:0:88962:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.112@tcp lock: ffff9dc04a20a600/0xcc1762b626f8ac6e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x110f400000000 nid: local remote: 0xcc1762b626f8ac75 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784189125.680626:0:88962:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1784189125.680629:0:88962:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1784189125.680632:0:88962:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.112@tcp lock: ffff9dc04a20a600/0xcc1762b626f8ac6e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x590f400000000 nid: local remote: 0xcc1762b626f8ac75 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189125.680641:0:88962:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.112@tcp lock: ffff9dc081b17a00/0xcc1762b626f8ac98 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0xcc1762b626f8ac9f expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1784189125.680647:0:88962:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.112@tcp lock: ffff9dc081b17a00/0xcc1762b626f8ac98 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0xcc1762b626f8ac9f expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784189125.680651:0:88962:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1784189125.680653:0:88962:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1784189125.680656:0:88962:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.112@tcp lock: ffff9dc081b17a00/0xcc1762b626f8ac98 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0xcc1762b626f8ac9f expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784189125.680796:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf4262f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1870854458091136:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1784189125.680831:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784189125.680852:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1784189125.680858:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc05ed91880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1870854458090880:0@lo:400:kworker.0 00000100:00100000:0.0:1784189125.680878:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784189125.680931:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458090752 00000100:00100000:2.0:1784189125.680937:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458090752 00000100:00100000:0.0:1784189125.680949:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458091136 00000100:00100000:0.0:1784189125.680954:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458091136 00000100:00100000:2.0:1784189125.680979:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458090880 00000100:00100000:2.0:1784189125.680984:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458090880 00000100:00100000:0.0:1784189125.680995:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1922 00000100:00100000:0.0:1784189125.681004:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf4262ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3641:x1870854458091136:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1784189125.681015:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2402 00000100:00100000:2.0:1784189125.681026:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc05ed78380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1870854458090752:12345-0@lo:400:kworker.0 00002000:00000024:0.0:1784189125.681027:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 212800 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1784189125.681083:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc05ed78380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1870854458090752:12345-0@lo:400:kworker.0 Request processed in 59us (1099us total) trans 0 rc 0/0 00000100:00100000:0.0:1784189125.681086:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf4262ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3641:x1870854458091136:12345-0@lo:13:osp-pre-1-1.0 Request processed in 82us (252us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189125.681096:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2402 00000100:00100000:0.0:1784189125.681098:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1922 00000100:00100000:2.0:1784189125.681119:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2403 00000100:00100000:2.0:1784189125.681128:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc080f6aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1870854458090880:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784189125.681140:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc04a64f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1870854458091264:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1784189125.681161:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc080f6aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1870854458090880:12345-0@lo:400:kworker.0 Request processed in 34us (280us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189125.681169:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2403 00000100:00100000:0.0:1784189125.681174:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784189125.681208:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc05ed92a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1870854458090752:0@lo:400:kworker.0 00000100:00100000:0.0:1784189125.681233:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458091264 00000100:00100000:0.0:1784189125.681237:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458091264 00000100:00100000:0.0:1784189125.681263:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1923 00000100:00100000:0.0:1784189125.681269:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc04a64ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1870854458091264:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1784189125.681285:0:8432:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 212800 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1784189125.681316:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc04a64ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1870854458091264:12345-0@lo:13:osp-pre-0-1.0 Request processed in 47us (144us total) trans 0 rc 0/0 00000100:00100000:0.0:1784189125.681338:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1923 00000100:00080000:2.0:1784189125.681420:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1784189125.681425:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1784189125.681426:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc04a64f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1870854458091264:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1784189125.681462:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc05ed91880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1870854458090880:0@lo:400:kworker.0 00000100:00100000:2.0:1784189125.681481:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf4262f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1870854458091136:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1784189125.681486:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf46434380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3640:1870854458090240:0@lo:400:kworker.0 00000100:00080000:3.0:1784189125.720042:0:88962:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffff9dc07110c800 already not connected (conn 60, was 0): CONNECTING 00000100:00080000:3.0:1784189125.720053:0:88962:0:(recover.c:337:ptlrpc_recover_import()) MGS: recovery started, waiting 20 seconds 00000100:00080000:1.0:1784189125.722344:0:3639:0:(import.c:65:import_set_state_nolock()) ffff9dc07110c800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1784189125.722370:0:3639:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-5) 00000100:00100000:1.0:1784189125.722382:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc07ab9ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:bd553d0d-03e2-4233-b06b-b55bbfa2b954:0:1870854458089984:0@lo:250:kworker.0 00000100:00100000:1.0:1784189125.722416:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf43f58e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3639:1870854458090112:0@lo:38:kworker.0 00000100:00100000:1.0:1784189125.722510:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784189125.722551:0:66171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458090112 00000100:00100000:1.0:1784189125.722558:0:66171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458090112 00000100:00100000:1.0:1784189125.722603:0:66171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1185 00000100:00100000:1.0:1784189125.722610:0:66171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc05ed90000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3639:x1870854458090112:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1784189125.722629:0:66171:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1784189125.722663:0:66171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc05ed90000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3639:x1870854458090112:12345-0@lo:38:kworker.0 Request processed in 52us (164us total) trans 0 rc -19/-19 00000100:00100000:1.0:1784189125.722669:0:66171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1185 00000100:00080000:1.0:1784189125.722703:0:3639:0:(import.c:65:import_set_state_nolock()) ffff9dbf42271800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1784189125.722706:0:3639:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1784189125.722709:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf43f58e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3639:1870854458090112:0@lo:38:kworker.0 00000100:00100000:1.0:1784189125.722716:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf46435f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3639:1870854458090368:0@lo:38:kworker.0 00000100:00100000:1.0:1784189125.722735:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784189125.722751:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf46435180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3639:1870854458090624:0@lo:38:kworker.0 00000100:00100000:1.0:1784189125.722774:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784189125.722792:0:26492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458090624 00000100:00100000:1.0:1784189125.722795:0:26492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458090624 00000100:00100000:1.0:1784189125.722812:0:26492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3765 00000100:00100000:1.0:1784189125.722816:0:26492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc05ed91880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3639:x1870854458090624:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1784189125.722825:0:26492:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1784189125.722845:0:26492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc05ed91880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3639:x1870854458090624:12345-0@lo:38:kworker.0 Request processed in 29us (70us total) trans 0 rc -19/-19 00000100:00100000:1.0:1784189125.722850:0:26492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3765 00000100:00080000:1.0:1784189125.722872:0:3639:0:(import.c:65:import_set_state_nolock()) ffff9dbf436c4000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1784189125.722882:0:3639:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1784189125.722885:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf46435180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3639:1870854458090624:0@lo:38:kworker.0 00000100:00100000:1.0:1784189125.722893:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc05ed91f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3639:1870854458091008:0@lo:38:kworker.0 00000100:00100000:1.0:1784189125.722917:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1784189125.722973:0:27065:0:(pinger.c:229:ptlrpc_pinger_process_import()) bd553d0d-03e2-4233-b06b-b55bbfa2b954->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1784189125.722978:0:27065:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:2.0:1784189125.722980:0:27065:0:(import.c:65:import_set_state_nolock()) ffff9dc07110c800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1784189125.722984:0:27065:0:(import.c:510:import_select_connection()) MGC192.168.203.112@tcp: connect to NID 0@lo last attempt 3367 00000100:00080000:2.0:1784189125.722988:0:27065:0:(import.c:589:import_select_connection()) MGC192.168.203.112@tcp: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1784189125.722993:0:27065:0:(import.c:624:import_select_connection()) MGC192.168.203.112@tcp: import ffff9dc07110c800 using connection 192.168.203.112@tcp/0@lo 00000100:00100000:2.0:1784189125.723024:0:27065:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9dc075aa2d80 x1870854458091392/t0(0) o250->MGC192.168.203.112@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1784189125.723174:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc075aa2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:bd553d0d-03e2-4233-b06b-b55bbfa2b954:3639:1870854458091392:0@lo:250:kworker.0 00000100:00100000:1.0:1784189125.723201:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784189125.723283:0:88969:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458091392 00000100:00100000:2.0:1784189125.723287:0:88969:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458091392 00000100:00100000:2.0:1784189125.723308:0:88969:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1784189125.723312:0:88969:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc07037f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0+-99:3639:x1870854458091392:12345-0@lo:250:kworker.0 00010000:00080000:2.0:1784189125.723346:0:88969:0:(ldlm_lib.c:1445:target_handle_connect()) MGS: connection from bd553d0d-03e2-4233-b06b-b55bbfa2b954@0@lo t0 exp 0000000000000000 cur 3367 last 0 00000020:00000080:2.0:1784189125.723368:0:88969:0:(genops.c:1406:class_connect()) connect: client bd553d0d-03e2-4233-b06b-b55bbfa2b954, cookie 0xcc1762b626f8b088 00000100:00080000:2.0:1784189125.723479:0:88969:0:(import.c:65:import_set_state_nolock()) ffff9dbf43e9f800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1784189125.723530:0:88969:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc07037f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd553d0d-03e2-4233-b06b-b55bbfa2b954+5:3639:x1870854458091392:12345-0@lo:250:kworker.0 Request processed in 216us (328us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189125.723537:0:88969:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1784189125.723569:0:3639:0:(client.c:3112:ptlrpc_free_committed()) MGC192.168.203.112@tcp: committing for last_committed 0 gen 25 00000100:00080000:2.0:1784189125.723575:0:3639:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.203.112@tcp: connect to target with instance 0 00000100:00080000:2.0:1784189125.723581:0:3639:0:(import.c:956:ptlrpc_connect_set_flags()) MGC192.168.203.112@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:2.0:1784189125.723584:0:3639:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:2.0:1784189125.723655:0:3639:0:(import.c:65:import_set_state_nolock()) ffff9dc07110c800 MGS: changing import state from CONNECTING to FULL 10000000:01000000:2.0:1784189125.723658:0:3639:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:2.0:1784189125.723676:0:3639:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:2.0:1784189125.723685:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc075aa2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:bd553d0d-03e2-4233-b06b-b55bbfa2b954:3639:1870854458091392:0@lo:250:kworker.0 00000020:01000000:2.0:1784189125.723712:0:27065:0:(tgt_mount.c:1626:tgt_import_update()) NID #0: 192.168.203.112@tcp 10000000:01000000:2.0:1784189125.723729:0:27065:0:(mgc_request_server.c:464:mgc_set_info_async_server()) NID notify for lustre-OST0000 about 1 new NIDs 00000020:01000004:2.0:1784189125.723732:0:27065:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: req 00000020:01000004:2.0:1784189125.723734:0:27065:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1784189125.723736:0:27065:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1784189125.723737:0:27065:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1784189125.723738:0:27065:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1784189125.723740:0:27065:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1784189125.723741:0:27065:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1784189125.723743:0:27065:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1784189125.723750:0:27065:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:01000000:2.0:1784189125.723780:0:27065:0:(tgt_mount.c:1637:tgt_import_update()) lustre-OST0000: notify about 1 NIDs, rc = 0 10000000:01000000:2.0:1784189125.723787:0:27065:0:(mgc_request_server.c:464:mgc_set_info_async_server()) NID notify for lustre-OST0001 about 1 new NIDs 00000020:01000004:2.0:1784189125.723789:0:27065:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: req 00000020:01000004:2.0:1784189125.723791:0:27065:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1784189125.723792:0:27065:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1784189125.723793:0:27065:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1784189125.723794:0:27065:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1784189125.723795:0:27065:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1784189125.723796:0:27065:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1784189125.723797:0:27065:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1784189125.723798:0:27065:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:01000000:2.0:1784189125.723821:0:27065:0:(tgt_mount.c:1637:tgt_import_update()) lustre-OST0001: notify about 1 NIDs, rc = 0 10000000:01000000:2.0:1784189125.723826:0:27065:0:(mgc_request_server.c:464:mgc_set_info_async_server()) NID notify for lustre-MDT0001 about 1 new NIDs 00000020:01000004:2.0:1784189125.723828:0:27065:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: req 00000020:01000004:2.0:1784189125.723829:0:27065:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1784189125.723831:0:27065:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1784189125.723832:0:27065:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1784189125.723833:0:27065:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1784189125.723834:0:27065:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1784189125.723835:0:27065:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1784189125.723837:0:27065:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1784189125.723837:0:27065:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:01000000:2.0:1784189125.723849:0:27065:0:(tgt_mount.c:1637:tgt_import_update()) lustre-MDT0001: notify about 1 NIDs, rc = 0 00000100:00100000:2.0:1784189125.723875:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc075aa0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:bd553d0d-03e2-4233-b06b-b55bbfa2b954:3643:1870854458091520:0@lo:253:kworker.0 00000100:00100000:2.0:1784189125.723911:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784189125.723942:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc075aa3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:bd553d0d-03e2-4233-b06b-b55bbfa2b954:3641:1870854458091776:0@lo:253:kworker.0 00000100:00100000:2.0:1784189125.723969:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784189125.723983:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1784189125.723988:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc075aa3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:bd553d0d-03e2-4233-b06b-b55bbfa2b954:3641:1870854458091648:0@lo:253:kworker.0 00000100:00100000:2.0:1784189125.724012:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784189125.724033:0:88968:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458091520 00000100:00100000:2.0:1784189125.724038:0:88968:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458091520 00000100:00100000:2.0:1784189125.724060:0:88968:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458091776 00000100:00100000:2.0:1784189125.724063:0:88968:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458091776 00000100:00100000:2.0:1784189125.724084:0:88968:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458091648 00000100:00100000:2.0:1784189125.724087:0:88968:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458091648 00000100:00100000:2.0:1784189125.724098:0:88968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1784189125.724104:0:88968:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf453af050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd553d0d-03e2-4233-b06b-b55bbfa2b954+7:3643:x1870854458091520:12345-0@lo:253:kworker.0 20000000:01000000:2.0:1784189125.724123:0:88968:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 00000100:00100000:2.0:1784189125.724158:0:88969:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1784189125.724164:0:88969:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf453afc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd553d0d-03e2-4233-b06b-b55bbfa2b954+7:3641:x1870854458091776:12345-0@lo:253:kworker.0 20000000:01000000:2.0:1784189125.724176:0:88969:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 00000100:00080000:2.0:1784189125.724212:0:88962:0:(recover.c:348:ptlrpc_recover_import()) MGS: recovery finished FULL, rc = 0 00000020:01000004:2.0:1784189125.724222:0:88962:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:2.0:1784189125.724252:0:88962:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds1_flakey 10000000:01000000:2.0:1784189125.724257:0:88962:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.112@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:2.0:1784189125.724385:0:88962:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.112@tcp ctxt 0 is initialized 00000020:01000004:2.0:1784189125.724412:0:88962:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.203.112@tcp, index=0000, flags=0x20005 00000020:01000004:2.0:1784189125.724417:0:88962:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1784189125.724418:0:88962:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1784189125.724419:0:88962:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1784189125.724420:0:88962:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1784189125.724421:0:88962:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1784189125.724422:0:88962:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1784189125.724424:0:88962:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1784189125.724425:0:88962:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1784189125.724426:0:88962:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1784189125.724427:0:88962:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1784189125.724429:0:88962:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:2.0:1784189125.724432:0:88962:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1784189125.724433:0:88962:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1784189125.724434:0:88962:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1784189125.724435:0:88962:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1784189125.724436:0:88962:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1784189125.724437:0:88962:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1784189125.724438:0:88962:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1784189125.724439:0:88962:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1784189125.724440:0:88962:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1784189125.724446:0:88962:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1784189125.724460:0:88962:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1784189125.724471:0:88962:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc075aa2d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd553d0d-03e2-4233-b06b-b55bbfa2b954:88962:1870854458091904:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1784189125.724518:0:88962:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784189125.724544:0:88967:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 3 min 3 max 32 00000100:00100000:2.0:1784189125.724551:0:88967:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0003' 00000100:00100000:2.0:1784189125.724561:0:88962:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dc07545b300 going to sleep for 11 seconds 00000100:00100000:3.0:1784189125.725095:0:66170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458090368 00000100:00100000:3.0:1784189125.725102:0:66170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458090368 00000100:00100000:3.0:1784189125.725184:0:66170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458091008 00000100:00100000:3.0:1784189125.725195:0:66170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458091008 00000100:00100000:2.0:1784189125.725199:0:88967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458091904 00000100:00100000:2.0:1784189125.725205:0:88967:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458091904 00000100:00100000:3.0:1784189125.725219:0:66170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1186 00000100:00100000:3.0:1784189125.725227:0:66170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc05ed91500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3639:x1870854458090368:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1784189125.725244:0:66170:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 10000000:01000000:2.0:1784189125.725250:0:88972:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00000100:00100000:3.0:1784189125.725294:0:66170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc05ed91500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3639:x1870854458090368:12345-0@lo:38:kworker.0 Request processed in 67us (2556us total) trans 0 rc -19/-19 00000100:00100000:3.0:1784189125.725302:0:66170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1186 00000100:00100000:3.0:1784189125.725336:0:66170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1187 00000100:00100000:3.0:1784189125.725342:0:66170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc05ed92a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3639:x1870854458091008:12345-0@lo:38:kworker.0 20000000:01000000:2.0:1784189125.725351:0:88968:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 108 00010000:00020000:3.0:1784189125.725353:0:66170:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1784189125.725395:0:66170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc05ed92a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3639:x1870854458091008:12345-0@lo:38:kworker.0 Request processed in 52us (2477us total) trans 0 rc -19/-19 00000100:00100000:3.0:1784189125.725403:0:66170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1187 00000100:00080000:3.0:1784189125.725454:0:3639:0:(import.c:65:import_set_state_nolock()) ffff9dbf425f4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1784189125.725471:0:3639:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1784189125.725475:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf46435f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3639:1870854458090368:0@lo:38:kworker.0 00000100:00080000:3.0:1784189125.725488:0:3639:0:(import.c:65:import_set_state_nolock()) ffff9dbf43690800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1784189125.725491:0:3639:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1784189125.725495:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc05ed91f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3639:1870854458091008:0@lo:38:kworker.0 00000100:00100000:0.0:1784189125.725888:0:88973:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1784189125.725895:0:88973:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc06b02bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:bd553d0d-03e2-4233-b06b-b55bbfa2b954+8:3641:x1870854458091648:12345-0@lo:253:kworker.0 20000000:01000000:0.0:1784189125.725917:0:88973:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:2.0:1784189125.726870:0:88974:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:2.0:1784189125.726876:0:88974:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 1 20000000:01000000:2.0:1784189125.726879:0:88974:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:2.0:1784189125.726881:0:88974:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:2.0:1784189125.727100:0:88974:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 20000000:01000000:3.0:1784189125.727271:0:88968:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1784189125.727294:0:88968:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:3.0:1784189125.731085:0:88968:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1784189125.731107:0:88968:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:2.0:1784189125.731282:0:88969:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:3.0:1784189125.731638:0:88968:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf453af050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd553d0d-03e2-4233-b06b-b55bbfa2b954+8:3643:x1870854458091520:12345-0@lo:253:kworker.0 Request processed in 7479us (7671us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189125.731654:0:88968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1784189125.731705:0:88968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1784189125.731714:0:88968:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc06b028450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd553d0d-03e2-4233-b06b-b55bbfa2b954+7:88962:x1870854458091904:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1784189125.732210:0:88972:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1784189125.732222:0:88972:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1784189125.732244:0:88972:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9dbf4369d000/0xcc1762b626f8b08f lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 88972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189125.732261:0:88972:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dbf4369d000/0xcc1762b626f8b08f lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 88972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1784189125.732271:0:88972:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.000049870s 00010000:00010000:0.0:1784189125.732276:0:88972:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9dbf4369d000/0xcc1762b626f8b08f lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 88972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189125.732283:0:88972:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9dbf4369d000/0xcc1762b626f8b08f lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 88972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189125.732291:0:88972:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9dbf4369d000/0xcc1762b626f8b08f lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 88972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189125.732299:0:88972:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9dbf4369d000/0xcc1762b626f8b08f lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 88972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189125.732305:0:88972:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dbf4369d000 already unused, calling callback (ffffffffc0b2e230) 00010000:00010000:0.0:1784189125.732310:0:88972:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9dbf4369d000/0xcc1762b626f8b08f lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 88972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189125.732337:0:88972:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9dbf4369d000/0xcc1762b626f8b08f lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 88972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189125.732349:0:88972:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9dbf4369d000/0xcc1762b626f8b08f lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 88972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189125.732357:0:88972:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9dbf4369d000/0xcc1762b626f8b08f lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 88972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189125.732373:0:88972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dbf4369d000/0xcc1762b626f8b08f lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 88972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1784189125.732477:0:88968:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1784189125.732481:0:88968:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:3.0:1784189125.732484:0:88968:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 20000000:01000000:3.0:1784189125.732490:0:88968:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000020:01000004:2.0:1784189125.732600:0:3643:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: rep 00000020:01000004:2.0:1784189125.732602:0:3643:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1784189125.732603:0:3643:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1784189125.732605:0:3643:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1784189125.732606:0:3643:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1784189125.732608:0:3643:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1784189125.732609:0:3643:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1784189125.732611:0:3643:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1784189125.732613:0:3643:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000100:00100000:2.0:1784189125.732616:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc075aa0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:bd553d0d-03e2-4233-b06b-b55bbfa2b954:3643:1870854458091520:0@lo:253:kworker.0 00000100:00100000:1.0:1784189125.735849:0:88968:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc06b028450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd553d0d-03e2-4233-b06b-b55bbfa2b954+7:88962:x1870854458091904:12345-0@lo:253:mount.lustre.0 Request processed in 4129us (11323us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189125.735866:0:88968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 20000000:01000000:3.0:1784189125.735958:0:88969:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1784189125.735965:0:88969:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 20000000:01000000:1.0:1784189125.736137:0:88973:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:3.0:1784189125.736388:0:88969:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf453afc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd553d0d-03e2-4233-b06b-b55bbfa2b954+6:3641:x1870854458091776:12345-0@lo:253:kworker.0 Request processed in 12223us (12417us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189125.736396:0:88969:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000020:01000004:1.0:1784189125.736468:0:3641:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: rep 00000020:01000004:1.0:1784189125.736471:0:3641:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1784189125.736472:0:3641:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1784189125.736473:0:3641:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1784189125.736474:0:3641:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1784189125.736476:0:3641:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1784189125.736478:0:3641:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1784189125.736479:0:3641:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1784189125.736481:0:3641:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000100:00100000:1.0:1784189125.736484:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc075aa3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:bd553d0d-03e2-4233-b06b-b55bbfa2b954:3641:1870854458091776:0@lo:253:kworker.0 00000100:00100000:0.0:1784189125.736592:0:88962:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc075aa2d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd553d0d-03e2-4233-b06b-b55bbfa2b954:88962:1870854458091904:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1784189125.736607:0:88962:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:0.0:1784189125.736609:0:88962:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1784189125.736611:0:88962:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1784189125.736611:0:88962:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1784189125.736612:0:88962:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1784189125.736613:0:88962:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1784189125.736614:0:88962:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1784189125.736615:0:88962:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1784189125.736617:0:88962:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1784189125.736618:0:88962:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1784189125.736619:0:88962:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1784189125.736635:0:88962:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9dbf4845c000 from lustre-MDT0000 10000000:01000000:0.0:1784189125.736662:0:88962:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:0.0:1784189125.736665:0:88962:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:0.0:1784189125.736674:0:88962:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9dbf4845c000 10000000:01000000:0.0:1784189125.736678:0:88962:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1784189125.736683:0:88962:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff9dbf4845c000 10000000:01000000:0.0:1784189125.736685:0:88962:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:0.0:1784189125.736688:0:88962:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-barrier-ffff9dbf4845c000 from 1 10000000:01000000:0.0:1784189125.736691:0:88962:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:0.0:1784189125.736723:0:88962:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff9dbf4369c000/0xcc1762b626f8b096 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 88962 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189125.736734:0:88962:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: ffff9dbf4369c000/0xcc1762b626f8b096 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 88962 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189125.736743:0:88962:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: ffff9dbf4369c000/0xcc1762b626f8b096 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 88962 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784189125.736777:0:88962:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc04a64f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd553d0d-03e2-4233-b06b-b55bbfa2b954:88962:1870854458092032:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1784189125.736811:0:88962:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784189125.736845:0:88962:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dbf464c2d80 going to sleep for 11 seconds 20000000:01000000:0.0:1784189125.736859:0:88972:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1784189125.736862:0:88972:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1784189125.736876:0:88972:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9dbf4369ce00/0xcc1762b626f8b09d lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 88972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189125.736888:0:88972:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dbf4369ce00/0xcc1762b626f8b09d lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 88972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1784189125.736895:0:88972:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.000049870s 00010000:00010000:0.0:1784189125.736899:0:88972:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9dbf4369ce00/0xcc1762b626f8b09d lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 88972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189125.736905:0:88972:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9dbf4369ce00/0xcc1762b626f8b09d lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 88972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189125.736910:0:88972:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9dbf4369ce00/0xcc1762b626f8b09d lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 88972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189125.736916:0:88972:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9dbf4369ce00/0xcc1762b626f8b09d lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 88972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189125.736922:0:88972:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dbf4369ce00 already unused, calling callback (ffffffffc0b2e230) 00010000:00010000:0.0:1784189125.736926:0:88972:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9dbf4369ce00/0xcc1762b626f8b09d lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 88972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189125.736933:0:88972:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9dbf4369ce00/0xcc1762b626f8b09d lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 88972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189125.736956:0:88972:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9dbf4369ce00/0xcc1762b626f8b09d lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 88972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189125.736964:0:88972:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9dbf4369ce00/0xcc1762b626f8b09d lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 88972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189125.736970:0:88972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dbf4369ce00/0xcc1762b626f8b09d lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 88972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784189125.738528:0:88967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458092032 00000100:00100000:3.0:1784189125.738539:0:88967:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458092032 00000100:00100000:3.0:1784189125.738599:0:88967:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1784189125.738608:0:88967:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc06b02b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd553d0d-03e2-4233-b06b-b55bbfa2b954+6:88962:x1870854458092032:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1784189125.738623:0:88967:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784189125.738641:0:88967:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dc05ec0d200/0xcc1762b626f8b0a4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xcc1762b626f8b096 expref: -99 pid: 88967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189125.738663:0:88967:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dc05ec0d200/0xcc1762b626f8b0a4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcc1762b626f8b096 expref: 7 pid: 88967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189125.738674:0:88967:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dc05ec0d200/0xcc1762b626f8b0a4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcc1762b626f8b096 expref: 7 pid: 88967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189125.738682:0:88967:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc05ec0d200, rc 0) 00000100:00100000:3.0:1784189125.738736:0:88967:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc06b02b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd553d0d-03e2-4233-b06b-b55bbfa2b954+7:88962:x1870854458092032:12345-0@lo:101:mount.lustre.0 Request processed in 129us (1924us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189125.738742:0:88967:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1784189125.739353:0:88962:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc04a64f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd553d0d-03e2-4233-b06b-b55bbfa2b954:88962:1870854458092032:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1784189125.739369:0:88962:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: ffff9dbf4369c000/0xcc1762b626f8b096 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc1762b626f8b0a4 expref: -99 pid: 88962 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189125.739379:0:88962:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: ffff9dbf4369c000/0xcc1762b626f8b096 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcc1762b626f8b0a4 expref: -99 pid: 88962 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784189125.739395:0:88962:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:0.0:1784189125.739404:0:88962:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff9dbf4369c000/0xcc1762b626f8b096 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc1762b626f8b0a4 expref: -99 pid: 88962 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189125.739411:0:88962:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: ffff9dbf4369c000/0xcc1762b626f8b096 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc1762b626f8b0a4 expref: -99 pid: 88962 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784189125.739419:0:88962:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:0.0:1784189125.739423:0:88962:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1784189125.739429:0:88962:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff9dbf4845c000 10000000:01000000:0.0:1784189125.739431:0:88962:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:0.0:1784189125.739435:0:88962:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:0.0:1784189125.739442:0:88962:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1784189125.739463:0:88962:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff9dbf4369d400/0xcc1762b626f8b0ab lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 88962 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189125.739471:0:88962:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: ffff9dbf4369d400/0xcc1762b626f8b0ab lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 88962 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189125.739478:0:88962:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: ffff9dbf4369d400/0xcc1762b626f8b0ab lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 88962 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784189125.739495:0:88962:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc04a64f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd553d0d-03e2-4233-b06b-b55bbfa2b954:88962:1870854458092160:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1784189125.739543:0:88962:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784189125.739570:0:88962:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dbf464c2d80 going to sleep for 11 seconds 00000100:00100000:3.0:1784189125.740624:0:88969:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458092160 00000100:00100000:3.0:1784189125.740634:0:88969:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458092160 00000100:00100000:3.0:1784189125.740673:0:88969:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1784189125.740680:0:88969:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc06b02ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd553d0d-03e2-4233-b06b-b55bbfa2b954+7:88962:x1870854458092160:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1784189125.740691:0:88969:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784189125.740707:0:88969:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dc05ec0d000/0xcc1762b626f8b0b2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xcc1762b626f8b0ab expref: -99 pid: 88969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189125.740728:0:88969:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dc05ec0d000/0xcc1762b626f8b0b2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcc1762b626f8b0ab expref: 8 pid: 88969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189125.740738:0:88969:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dc05ec0d000/0xcc1762b626f8b0b2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcc1762b626f8b0ab expref: 8 pid: 88969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189125.740747:0:88969:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc05ec0d000, rc 0) 00000100:00100000:3.0:1784189125.740794:0:88969:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc06b02ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd553d0d-03e2-4233-b06b-b55bbfa2b954+8:88962:x1870854458092160:12345-0@lo:101:mount.lustre.0 Request processed in 114us (1252us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189125.740800:0:88969:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1784189125.741005:0:88962:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc04a64f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd553d0d-03e2-4233-b06b-b55bbfa2b954:88962:1870854458092160:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1784189125.741021:0:88962:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: ffff9dbf4369d400/0xcc1762b626f8b0ab lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc1762b626f8b0b2 expref: -99 pid: 88962 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189125.741030:0:88962:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: ffff9dbf4369d400/0xcc1762b626f8b0ab lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcc1762b626f8b0b2 expref: -99 pid: 88962 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784189125.741242:0:88962:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc05ed91f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd553d0d-03e2-4233-b06b-b55bbfa2b954:88962:1870854458092288:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1784189125.741272:0:88962:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784189125.741315:0:88962:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dc05876d000 going to sleep for 11 seconds 00000100:00100000:3.0:1784189125.742689:0:88968:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458092288 00000100:00100000:3.0:1784189125.742699:0:88968:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458092288 00000100:00100000:3.0:1784189125.742738:0:88968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1784189125.742746:0:88968:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc06b028c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd553d0d-03e2-4233-b06b-b55bbfa2b954+8:88962:x1870854458092288:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1784189125.742893:0:88968:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc06b028c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd553d0d-03e2-4233-b06b-b55bbfa2b954+9:88962:x1870854458092288:12345-0@lo:501:mount.lustre.0 Request processed in 148us (1620us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189125.742901:0:88968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1784189125.742950:0:88962:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc05ed91f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd553d0d-03e2-4233-b06b-b55bbfa2b954:88962:1870854458092288:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1784189125.742992:0:88962:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc05ed79880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd553d0d-03e2-4233-b06b-b55bbfa2b954:88962:1870854458092416:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1784189125.743049:0:88962:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784189125.743073:0:88962:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dbf45b9b240 going to sleep for 11 seconds 00000100:00100000:3.0:1784189125.743087:0:88969:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458092416 00000100:00100000:3.0:1784189125.743090:0:88969:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458092416 00000100:00100000:3.0:1784189125.743113:0:88969:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1784189125.743118:0:88969:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc06b029850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd553d0d-03e2-4233-b06b-b55bbfa2b954+9:88962:x1870854458092416:12345-0@lo:503:mount.lustre.0 20000000:01000000:1.0:1784189125.744462:0:88973:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1784189125.744479:0:88973:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:0.0:1784189125.744619:0:88972:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1784189125.744623:0:88972:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1784189125.744642:0:88972:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9dbf4369c800/0xcc1762b626f8b0b9 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 88972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189125.744656:0:88972:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dbf4369c800/0xcc1762b626f8b0b9 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 88972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1784189125.744669:0:88972:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.000049870s 00010000:00010000:0.0:1784189125.744673:0:88972:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9dbf4369c800/0xcc1762b626f8b0b9 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 88972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189125.744679:0:88972:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9dbf4369c800/0xcc1762b626f8b0b9 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 88972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189125.744686:0:88972:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9dbf4369c800/0xcc1762b626f8b0b9 lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 88972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189125.744692:0:88972:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9dbf4369c800/0xcc1762b626f8b0b9 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 88972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189125.744721:0:88972:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dbf4369c800 already unused, calling callback (ffffffffc0b2e230) 00010000:00010000:0.0:1784189125.744726:0:88972:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9dbf4369c800/0xcc1762b626f8b0b9 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 88972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189125.744733:0:88972:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9dbf4369c800/0xcc1762b626f8b0b9 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 88972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189125.744746:0:88972:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9dbf4369c800/0xcc1762b626f8b0b9 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 88972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189125.744755:0:88972:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9dbf4369c800/0xcc1762b626f8b0b9 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 88972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189125.744761:0:88972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dbf4369c800/0xcc1762b626f8b0b9 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 88972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784189125.745188:0:88973:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc06b02bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:bd553d0d-03e2-4233-b06b-b55bbfa2b954+9:3641:x1870854458091648:12345-0@lo:253:kworker.0 Request processed in 19291us (21172us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189125.745198:0:88973:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000020:01000004:1.0:1784189125.745254:0:3641:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: rep 00000020:01000004:1.0:1784189125.745256:0:3641:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1784189125.745258:0:3641:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1784189125.745259:0:3641:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1784189125.745260:0:3641:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1784189125.745261:0:3641:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1784189125.745262:0:3641:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1784189125.745264:0:3641:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1784189125.745266:0:3641:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000100:00100000:1.0:1784189125.745269:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc075aa3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:bd553d0d-03e2-4233-b06b-b55bbfa2b954:3641:1870854458091648:0@lo:253:kworker.0 00000100:00100000:0.0:1784189125.751974:0:88969:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc06b029850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd553d0d-03e2-4233-b06b-b55bbfa2b954+8:88962:x1870854458092416:12345-0@lo:503:mount.lustre.0 Request processed in 8845us (8914us total) trans 0 rc 0/0 00000100:00100000:0.0:1784189125.751989:0:88969:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1784189125.752272:0:88962:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc05ed79880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd553d0d-03e2-4233-b06b-b55bbfa2b954:88962:1870854458092416:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1784189125.753965:0:88975:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc05ed79880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bd553d0d-03e2-4233-b06b-b55bbfa2b954:88975:1870854458092544:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1784189125.754053:0:88975:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784189125.754102:0:88975:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dbf45b9be40 going to sleep for 11 seconds 00000100:00100000:0.0:1784189125.754274:0:88968:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458092544 00000100:00100000:0.0:1784189125.754281:0:88968:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458092544 00000100:00100000:0.0:1784189125.754341:0:88968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1784189125.754349:0:88968:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc06b02a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd553d0d-03e2-4233-b06b-b55bbfa2b954+8:88975:x1870854458092544:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1784189125.754978:0:88968:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc06b02a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd553d0d-03e2-4233-b06b-b55bbfa2b954+8:88975:x1870854458092544:12345-0@lo:502:llog_process_th.0 Request processed in 628us (923us total) trans 0 rc 0/0 00000100:00100000:0.0:1784189125.754985:0:88968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1784189125.755124:0:88975:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc05ed79880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bd553d0d-03e2-4233-b06b-b55bbfa2b954:88975:1870854458092544:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1784189125.755152:0:88975:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1784189125.755163:0:88975:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784189125.755165:0:88975:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1784189125.755170:0:88975:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:3.0:1784189125.755173:0:88975:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1784189125.755187:0:88975:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff9dc06bb319c0) 00000020:00000080:3.0:1784189125.755208:0:88975:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type lod with refcount 2 00000020:00000080:3.0:1784189125.755213:0:88975:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00080000:01000000:3.0:1784189125.755286:0:88975:0:(osd_handler.c:8929:osd_obd_connect()) connect #2 00000020:00000080:3.0:1784189125.755293:0:88975:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xcc1762b626f8b0c7 00000020:00000080:3.0:1784189125.755553:0:88975:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:3.0:1784189125.755558:0:88975:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1784189125.755561:0:88975:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784189125.755563:0:88975:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1784189125.755567:0:88975:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1784189125.755570:0:88975:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784189125.755572:0:88975:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:3.0:1784189125.755582:0:88975:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1784189125.756151:0:88975:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff9dc06bb33380) 00000020:00000080:3.0:1784189125.756170:0:88975:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type mdt with refcount 2 00000020:00000080:3.0:1784189125.756177:0:88975:0:(obd_config.c:1470:class_process_config()) processing cmd: cf007 00000020:00000080:3.0:1784189125.756179:0:88975:0:(obd_config.c:1514:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:3.0:1784189125.756181:0:88975:0:(obd_config.c:1148:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:3.0:1784189125.756187:0:88975:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1784189125.756240:0:88975:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9dbf4845c000 from lustre-MDT0000, refs=3 00000020:00000080:3.0:1784189125.756251:0:88975:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff9dc06bb34d40) 00000020:00000080:3.0:1784189125.756260:0:88975:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type mdd with refcount 2 00000004:01000000:3.0:1784189125.756307:0:88975:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:3.0:1784189125.756312:0:88975:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xcc1762b626f8b0dc 00000020:00000080:3.0:1784189125.756447:0:88975:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:3.0:1784189125.756455:0:88975:0:(mdd_device.c:1596:mdd_obd_connect()) connect #0 00000020:00000080:3.0:1784189125.756460:0:88975:0:(genops.c:1406:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0xcc1762b626f8b0e3 00080000:01000000:3.0:1784189125.756466:0:88975:0:(osd_handler.c:8929:osd_obd_connect()) connect #3 00000020:00000080:3.0:1784189125.756470:0:88975:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xcc1762b626f8b0ea 00010000:00010000:2.0:1784189125.860037:0:88975:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-4 is initialized 00000001:00080000:2.0:1784189125.860269:0:88975:0:(tgt_lastrcvd.c:1748:tgt_clients_data_init()) RCVRNG CLIENT uuid: b90fcc1c-0e69-42a4-a116-a71fec7aeb78 idx: 0 lr: 98784247817 srv lr: 103079215104 lx: 0 gen 22 00000001:00080000:2.0:1784189125.860463:0:88975:0:(tgt_lastrcvd.c:1748:tgt_clients_data_init()) RCVRNG CLIENT uuid: lustre-MDT0001-mdtlov_UUID idx: 1 lr: 0 srv lr: 103079215104 lx: 0 gen 21 00000001:00000004:2.0:1784189125.860486:0:88975:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 25, last_transno is 103079215104 00000001:00080000:2.0:1784189125.860647:0:88975:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000001:00080000:2.0:1784189125.860700:0:88975:0:(tgt_lastrcvd.c:2283:tgt_reply_data_init()) lustre-MDT0000: restore reply ffff9dc04811d3c0: xid 1870854436252672, transno 103079215109, client gen 22, slot idx 0 00000001:00080000:2.0:1784189125.860712:0:88975:0:(tgt_lastrcvd.c:2283:tgt_reply_data_init()) lustre-MDT0000: restore reply ffff9dc04811d240: xid 1870854436252928, transno 103079215110, client gen 22, slot idx 1 00000020:00000080:2.0:1784189125.861256:0:88975:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff9dc07547cd40) 00000020:00000080:2.0:1784189125.861276:0:88975:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type qmt with refcount 2 00080000:01000000:2.0:1784189125.861430:0:88975:0:(osd_handler.c:8929:osd_obd_connect()) connect #4 00000020:00000080:2.0:1784189125.861438:0:88975:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xcc1762b626f8b106 00000020:00000080:2.0:1784189125.862132:0:88975:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:2.0:1784189125.868110:0:88975:0:(genops.c:1406:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0xcc1762b626f8b10d 00000020:00000080:2.0:1784189125.869197:0:88975:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:2.0:1784189125.869210:0:88975:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1784189125.869217:0:88975:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784189125.869220:0:88975:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:2.0:1784189125.869224:0:88975:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1784189125.869227:0:88975:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #8 00000020:01000000:2.0:1784189125.869229:0:88975:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1784189125.869231:0:88975:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1784189125.869232:0:88975:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1784189125.869236:0:88975:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784189125.869238:0:88975:0:(obd_config.c:1561:class_process_config()) marker 8 (0x6) lustre sys.timeout 00000020:01000000:2.0:1784189125.869241:0:88975:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1784189125.869246:0:88975:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784189125.869248:0:88975:0:(obd_config.c:1561:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:2.0:1784189125.869253:0:88975:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000004:01000000:2.0:1784189125.869388:0:88975:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:2.0:1784189125.869410:0:88975:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1784189125.869413:0:88975:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784189125.869415:0:88975:0:(obd_config.c:1561:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:2.0:1784189125.869417:0:88975:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1784189125.869421:0:88975:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784189125.869422:0:88975:0:(obd_config.c:1561:class_process_config()) marker 17 (0x1) lustre-MDT0001 add osp 00000020:00000080:2.0:1784189125.869425:0:88975:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1784189125.869430:0:88975:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.203.112@tcp to nid 0x20000c0a8cb70 (192.168.203.112@tcp) 00000020:00000080:2.0:1784189125.869455:0:88975:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1784189125.869475:0:88975:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osp-MDT0000 (ffff9dc07547b380) 00000020:00000080:2.0:1784189125.869493:0:88975:0:(obd_config.c:720:class_attach_name()) OBD: dev 21 attached type osp with refcount 2 00000020:00000080:2.0:1784189125.869511:0:88975:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1784189125.869569:0:88975:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0001-osp-MDT0000: connect to lustre-MDT0000-osd (lustre-MDT0001-osp-MDT0000) 00080000:01000000:2.0:1784189125.869574:0:88975:0:(osd_handler.c:8929:osd_obd_connect()) connect #5 00000020:00000080:2.0:1784189125.869579:0:88975:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xcc1762b626f8b11b 00010000:00080000:2.0:1784189125.869679:0:88975:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9dc06b3ef000@lustre-MDT0001-osp-MDT0000: add connection 192.168.203.112@tcp at head 00010000:00010000:2.0:1784189125.873951:0:88975:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-osp-MDT0000-9 is initialized 00000020:00000080:3.0:1784189125.875429:0:88975:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1784189125.875443:0:88975:0:(obd_config.c:1470:class_process_config()) processing cmd: cf014 00000004:01000000:3.0:1784189125.875480:0:88975:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0001_UUID idx:1 gen:1 00000020:00000080:3.0:1784189125.875514:0:88975:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xcc1762b626f8b122 00000100:00080000:3.0:1784189125.875526:0:88975:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1784189125.875532:0:88975:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff9dc06b3ef000 using connection 192.168.203.112@tcp/0@lo 00000100:00100000:3.0:1784189125.875567:0:88975:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9dc05ed79880 x1870854458092672/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1784189125.875738:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc05ed79880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3639:1870854458092672:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1784189125.875808:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1784189125.875872:0:88975:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000020:01000000:3.0:1784189125.875939:0:88975:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1784189125.875945:0:88975:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784189125.875946:0:88975:0:(obd_config.c:1561:class_process_config()) marker 17 (0x2) lustre-MDT0001 add osp 00000020:01000000:3.0:1784189125.875950:0:88975:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1784189125.875953:0:88975:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #19 00000020:01000000:3.0:1784189125.875955:0:88975:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1784189125.875964:0:88975:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1784189125.875966:0:88975:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1784189125.875969:0:88975:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784189125.875971:0:88975:0:(obd_config.c:1561:class_process_config()) marker 19 (0x6) lustre sys.timeout 00000020:01000000:3.0:1784189125.875977:0:88975:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1784189125.875981:0:88975:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:3.0:1784189125.875985:0:88975:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784189125.875986:0:88975:0:(obd_config.c:1561:class_process_config()) marker 22 (0x1) lustre-OST0000 add osc 00000020:00000080:3.0:1784189125.875990:0:88975:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1784189125.875994:0:88975:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.203.112@tcp to nid 0x20000c0a8cb70 (192.168.203.112@tcp) 00000020:01000000:3.0:1784189125.876014:0:88975:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1784189125.876017:0:88975:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1784189125.876031:0:88975:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff9dc0762999c0) 00000020:00000080:3.0:1784189125.876046:0:88975:0:(obd_config.c:720:class_attach_name()) OBD: dev 22 attached type osp with refcount 2 00000020:00000080:3.0:1784189125.876051:0:88975:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1784189125.876127:0:88975:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:3.0:1784189125.876133:0:88975:0:(osd_handler.c:8929:osd_obd_connect()) connect #6 00000020:00000080:3.0:1784189125.876139:0:88975:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xcc1762b626f8b130 00010000:00080000:3.0:1784189125.876171:0:88975:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9dc05ed59000@lustre-OST0000-osc-MDT0000: add connection 192.168.203.112@tcp at head 00000100:00080000:1.0:1784189125.876293:0:27065:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1784189125.876299:0:27065:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1784189125.876302:0:27065:0:(import.c:65:import_set_state_nolock()) ffff9dbf42271800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1784189125.876307:0:27065:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3367 00000100:00080000:1.0:1784189125.876311:0:27065:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1784189125.876315:0:27065:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9dbf42271800 using connection 192.168.203.112@tcp/0@lo 00000100:00100000:1.0:1784189125.876364:0:27065:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9dbf43f58e00 x1870854458092928/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1784189125.876434:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458092672 00000100:00100000:0.0:1784189125.876442:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458092672 00000100:00100000:0.0:1784189125.876482:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3766 00000100:00100000:0.0:1784189125.876489:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc075aa0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3639:x1870854458092672:12345-0@lo:38:llog_process_th.0 00010000:00010000:3.0:1784189125.876541:0:88975:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-10 is initialized 00010000:00080000:0.0:1784189125.876801:0:8439:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 3368 last 0 00000020:00000080:0.0:1784189125.876830:0:8439:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xcc1762b626f8b137 00000004:00100000:0.0:1784189125.876846:0:8439:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1784189125.876930:0:8439:0:(import.c:65:import_set_state_nolock()) ffff9dbf4512c000 : changing import state from RECOVER to FULL 00000040:01000000:3.0:1784189125.877646:0:88975:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:3.0:1784189125.877669:0:88975:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:3.0:1784189125.877806:0:88975:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0x1:0x2:0x0] first idx 23, last_idx 24 00000040:00080000:3.0:1784189125.878730:0:88975:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1784189125.878762:0:88975:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].25, 64 off9792 00000040:00080000:3.0:1784189125.878913:0:88975:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x64:0x0].1, 64 off8256 00000100:00100000:2.0:1784189125.879040:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf43f58e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3639:1870854458092928:0@lo:38:kworker.0 00000100:00080000:1.0:1784189125.879098:0:27065:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1784189125.879103:0:27065:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1784189125.879106:0:27065:0:(import.c:65:import_set_state_nolock()) ffff9dbf425f4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1784189125.879112:0:27065:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3367 00000100:00100000:2.0:1784189125.879119:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1784189125.879119:0:27065:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1784189125.879137:0:27065:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9dbf425f4800 using connection 192.168.203.112@tcp/0@lo 00000100:00100000:1.0:1784189125.879161:0:27065:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9dbf4693ea00 x1870854458093184/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1784189125.879372:0:27065:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1784189125.879376:0:27065:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1784189125.879378:0:27065:0:(import.c:65:import_set_state_nolock()) ffff9dbf436c4000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1784189125.879383:0:27065:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3367 00000100:00080000:1.0:1784189125.879386:0:27065:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1784189125.879391:0:27065:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9dbf436c4000 using connection 192.168.203.112@tcp/0@lo 00000100:00100000:1.0:1784189125.879405:0:27065:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9dbf4693fb80 x1870854458093440/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1784189125.879416:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc07ab9ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3643:1870854458093056:0@lo:400:kworker.0 00000100:00080000:1.0:1784189125.879430:0:27065:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1784189125.879435:0:27065:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1784189125.879436:0:27065:0:(import.c:65:import_set_state_nolock()) ffff9dbf43690800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1784189125.879440:0:27065:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3367 00000100:00080000:1.0:1784189125.879443:0:27065:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1784189125.879446:0:27065:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff9dbf43690800 using connection 192.168.203.112@tcp/0@lo 00000100:00100000:1.0:1784189125.879459:0:27065:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9dbf4693ed80 x1870854458093824/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1784189125.879470:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784189125.879496:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc05ed91f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bd553d0d-03e2-4233-b06b-b55bbfa2b954:3642:1870854458092800:0@lo:400:kworker.0 00000100:00100000:3.0:1784189125.879524:0:66170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458092928 00000100:00100000:3.0:1784189125.879532:0:66170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458092928 00000100:00100000:1.0:1784189125.879545:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784189125.879562:0:66170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458093056 00000100:00100000:3.0:1784189125.879572:0:66170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458093056 00000100:00100000:3.0:1784189125.879618:0:66170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1119 00000100:00100000:3.0:1784189125.879628:0:66170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf46435f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1870854458093056:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784189125.879644:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf4693e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1870854458093696:0@lo:400:kworker.0 00000100:00100000:3.0:1784189125.879687:0:66170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf46435f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1870854458093056:12345-0@lo:400:kworker.0 Request processed in 60us (219us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189125.879688:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784189125.879698:0:66170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1119 00000100:00100000:3.0:1784189125.879718:0:66170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1188 00000100:00100000:3.0:1784189125.879723:0:66170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc075aa0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3639:x1870854458092928:12345-0@lo:38:kworker.0 00000100:00100000:1.0:1784189125.879747:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf4693c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1870854458093568:0@lo:400:kworker.0 00000100:00100000:3.0:1784189125.879765:0:66170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc075aa0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3639:x1870854458092928:12345-0@lo:38:kworker.0 Request processed in 39us (648us total) trans 0 rc -11/-11 00000100:00100000:3.0:1784189125.879772:0:66170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1188 00000100:00100000:1.0:1784189125.879786:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784189125.879810:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1784189125.879814:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc07ab9ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3643:1870854458093056:0@lo:400:kworker.0 00000100:00100000:1.0:1784189125.879819:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf4693f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3641:1870854458093312:0@lo:400:kworker.0 00000100:00100000:1.0:1784189125.879844:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784189125.879873:0:66945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458093312 00000100:00100000:1.0:1784189125.879877:0:66945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458093312 00000100:00100000:1.0:1784189125.880084:0:66945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1120 00000100:00100000:1.0:1784189125.880093:0:66945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf4693ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1870854458093312:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784189125.880130:0:66945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf4693ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1870854458093312:12345-0@lo:400:kworker.0 Request processed in 39us (286us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189125.880137:0:66945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1120 00000100:00100000:1.0:1784189125.880158:0:88973:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458092800 00000100:00100000:1.0:1784189125.880162:0:88973:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458092800 00000100:00100000:1.0:1784189125.880248:0:88973:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1784189125.880256:0:88973:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc06b02b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:bd553d0d-03e2-4233-b06b-b55bbfa2b954+8:3642:x1870854458092800:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784189125.880292:0:88973:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc06b02b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:bd553d0d-03e2-4233-b06b-b55bbfa2b954+8:3642:x1870854458092800:12345-0@lo:400:kworker.0 Request processed in 37us (747us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189125.880298:0:88973:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1784189125.880381:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc075aa0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3639:x1870854458092672:12345-0@lo:38:llog_process_th.0 Request processed in 3889us (4571us total) trans 0 rc 0/0 00000100:00100000:0.0:1784189125.880392:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3766 00000100:00100000:1.0:1784189125.880426:0:26162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458093696 00000100:00100000:1.0:1784189125.880431:0:26162:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458093696 00000100:00100000:1.0:1784189125.880464:0:26162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458093568 00000100:00100000:1.0:1784189125.880468:0:26162:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458093568 00000100:00100000:1.0:1784189125.880677:0:26162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2404 00000100:00100000:1.0:1784189125.880687:0:26162:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf4693e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:3642:x1870854458093696:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784189125.880695:0:3639:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1784189125.880705:0:3639:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-osp-MDT0000: connect to target with instance 19 00000100:00080000:2.0:1784189125.880713:0:3639:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-osp-MDT0000: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:2.0:1784189125.880719:0:3639:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:2.0:1784189125.880723:0:3639:0:(import.c:65:import_set_state_nolock()) ffff9dc06b3ef000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1784189125.880728:0:26162:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf4693e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:3642:x1870854458093696:12345-0@lo:400:kworker.0 Request processed in 41us (1039us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189125.880735:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc05ed79880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3639:1870854458092672:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1784189125.880738:0:26162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2404 00000100:00100000:2.0:1784189125.880760:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf4693ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3639:1870854458093184:0@lo:38:kworker.0 00000100:00100000:1.0:1784189125.880766:0:26162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2405 00000100:00100000:1.0:1784189125.880774:0:26162:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf4693df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:3641:x1870854458093568:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784189125.880795:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784189125.880815:0:26162:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf4693df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:3641:x1870854458093568:12345-0@lo:400:kworker.0 Request processed in 42us (1031us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189125.880821:0:26162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2405 00000100:00100000:2.0:1784189125.880824:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf4693fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3639:1870854458093440:0@lo:38:kworker.0 00000100:00100000:2.0:1784189125.880856:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784189125.880863:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf4693f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3641:1870854458093312:0@lo:400:kworker.0 00000100:00100000:2.0:1784189125.880881:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf4693ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3639:1870854458093824:0@lo:38:kworker.0 00000100:00100000:2.0:1784189125.880903:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1784189125.880926:0:3639:0:(import.c:65:import_set_state_nolock()) ffff9dbf42271800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1784189125.880931:0:3639:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:2.0:1784189125.880941:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf43f58e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3639:1870854458092928:0@lo:38:kworker.0 00000100:00100000:2.0:1784189125.880970:0:68287:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458093184 00000100:00100000:2.0:1784189125.880975:0:68287:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458093184 00000100:00100000:2.0:1784189125.880993:0:68287:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458093824 00000100:00100000:2.0:1784189125.880995:0:68287:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458093824 00000100:00100000:2.0:1784189125.881010:0:68287:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1189 00000100:00100000:2.0:1784189125.881015:0:68287:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc075aa1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3639:x1870854458093184:12345-0@lo:38:kworker.0 00000100:00100000:0.0:1784189125.883097:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc05ed91f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bd553d0d-03e2-4233-b06b-b55bbfa2b954:3642:1870854458092800:0@lo:400:kworker.0 00000100:00100000:0.0:1784189125.883118:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf4693e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1870854458093696:0@lo:400:kworker.0 00000100:00100000:0.0:1784189125.883144:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1784189125.883152:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc04a64ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1870854458093952:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1784189125.883209:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784189125.883256:0:23826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458093440 00000100:00100000:0.0:1784189125.883262:0:23826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458093440 00000100:00100000:0.0:1784189125.883287:0:23826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458093952 00000100:00100000:0.0:1784189125.883290:0:23826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458093952 00000100:00100000:1.0:1784189125.883333:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf4693c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1870854458093568:0@lo:400:kworker.0 00000100:00100000:0.0:1784189125.883337:0:23826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3767 00000100:00100000:0.0:1784189125.883347:0:23826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc075aa0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3639:x1870854458093440:12345-0@lo:38:kworker.0 00000100:00100000:1.0:1784189125.883378:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3768 00000100:00100000:1.0:1784189125.883388:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc04a64fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3642:x1870854458093952:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1784189125.883418:0:8439:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445576704 avail 1299337216 00000100:00100000:1.0:1784189125.883474:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc04a64fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3642:x1870854458093952:12345-0@lo:41:osp-pre-1-0.0 Request processed in 87us (263us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189125.883482:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3768 00000100:00100000:2.0:1784189125.883541:0:68287:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc075aa1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3639:x1870854458093184:12345-0@lo:38:kworker.0 Request processed in 2523us (2746us total) trans 0 rc -11/-11 00000100:00100000:2.0:1784189125.883550:0:68287:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1189 00000100:00100000:2.0:1784189125.883566:0:68287:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1190 00000100:00100000:2.0:1784189125.883571:0:68287:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc075aa1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3639:x1870854458093824:12345-0@lo:38:kworker.0 00000100:00100000:3.0:1784189125.883640:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc04a64ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1870854458093952:0@lo:41:osp-pre-1-0.0 00000040:00080000:1.0:1784189125.883699:0:88981:0:(llog.c:805:llog_process_thread()) index: 24, lh_last_idx: 25 synced_idx: 0 lgh_last_idx: 25 00000040:00080000:1.0:1784189125.883705:0:88981:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x60:0x0] at index 24 of catalog [0x1:0x2:0x0] 00000040:00080000:1.0:1784189125.883888:0:88981:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0x1:0x2:0x0] first idx 24, last_idx 25 00000040:00080000:1.0:1784189125.883912:0:88981:0:(llog_cat_server.c:902:llog_cat_cleanup()) cancel plain log [0x1:0x60:0x0] at index 24 of catalog [0x1:0x2:0x0] 00000100:00100000:0.0:1784189125.883997:0:23826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc075aa0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3639:x1870854458093440:12345-0@lo:38:kworker.0 Request processed in 650us (3140us total) trans 0 rc -11/-11 00000100:00100000:0.0:1784189125.884005:0:23826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3767 00000040:00080000:1.0:1784189125.884063:0:88981:0:(llog.c:805:llog_process_thread()) index: 25, lh_last_idx: 25 synced_idx: 25 lgh_last_idx: 25 00000040:00080000:1.0:1784189125.884067:0:88981:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x64:0x0] at index 25 of catalog [0x1:0x2:0x0] 00000100:00100000:2.0:1784189125.884114:0:68287:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc075aa1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3639:x1870854458093824:12345-0@lo:38:kworker.0 Request processed in 540us (3208us total) trans 0 rc -11/-11 00000100:00100000:2.0:1784189125.884121:0:68287:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1190 00000100:00080000:2.0:1784189125.884165:0:3639:0:(import.c:65:import_set_state_nolock()) ffff9dbf425f4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1784189125.884171:0:3639:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:2.0:1784189125.884174:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf4693ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3639:1870854458093184:0@lo:38:kworker.0 00000100:00080000:2.0:1784189125.884185:0:3639:0:(import.c:65:import_set_state_nolock()) ffff9dbf436c4000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1784189125.884188:0:3639:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:2.0:1784189125.884191:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf4693fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3639:1870854458093440:0@lo:38:kworker.0 00000100:00080000:2.0:1784189125.884200:0:3639:0:(import.c:65:import_set_state_nolock()) ffff9dbf43690800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1784189125.884203:0:3639:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:2.0:1784189125.884205:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf4693ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3639:1870854458093824:0@lo:38:kworker.0 00000020:00000080:3.0:1784189125.884660:0:88975:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1784189125.884671:0:88975:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1784189125.884706:0:88975:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:3.0:1784189125.884725:0:88975:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xcc1762b626f8b13e 00000100:00080000:3.0:1784189125.884732:0:88975:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1784189125.884737:0:88975:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9dc05ed59000 using connection 192.168.203.112@tcp/0@lo 00000100:00100000:3.0:1784189125.884762:0:88975:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9dbf46435180 x1870854458094080/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1784189125.884783:0:88975:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00100000:2.0:1784189125.884891:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf46435180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3639:1870854458094080:0@lo:8:llog_process_th.0 00000100:00100000:2.0:1784189125.884936:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784189125.884977:0:26168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458094080 00000100:00100000:2.0:1784189125.884982:0:26168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458094080 00000100:00100000:2.0:1784189125.885004:0:26168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4943 00000100:00100000:2.0:1784189125.885009:0:26168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc075aa2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:0+-99:3639:x1870854458094080:12345-0@lo:8:llog_process_th.0 00010000:00080000:2.0:1784189125.885027:0:26168:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 3368 last 0 00000020:00000080:2.0:1784189125.885051:0:26168:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xcc1762b626f8b145 00002000:00100000:2.0:1784189125.885064:0:26168:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff9dc07a8f1800 ocd_connect_flags: 0xa044401443000026 ocd_version: 21136a2 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:2.0:1784189125.885067:0:26168:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:2.0:1784189125.885070:0:26168:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1784189125.885134:0:26168:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1784189125.885152:0:26168:0:(import.c:65:import_set_state_nolock()) ffff9dc07a8f2000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1784189125.885191:0:26168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc075aa2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+6:3639:x1870854458094080:12345-0@lo:8:llog_process_th.0 Request processed in 181us (255us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189125.885198:0:26168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4943 00000100:00100000:2.0:1784189125.885227:0:3639:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1784189125.885233:0:3639:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 1 00000100:00080000:2.0:1784189125.885239:0:3639:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1784189125.885243:0:3639:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:2.0:1784189125.885245:0:3639:0:(import.c:65:import_set_state_nolock()) ffff9dc05ed59000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000020:01000000:3.0:1784189125.885946:0:88975:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1784189125.885952:0:88975:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784189125.885954:0:88975:0:(obd_config.c:1561:class_process_config()) marker 22 (0x2) lustre-OST0000 add osc 00000020:01000000:3.0:1784189125.885957:0:88975:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1784189125.885959:0:88975:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #26 00000020:01000000:3.0:1784189125.885969:0:88975:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1784189125.885971:0:88975:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1784189125.885973:0:88975:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1784189125.885976:0:88975:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784189125.885977:0:88975:0:(obd_config.c:1561:class_process_config()) marker 26 (0x6) lustre sys.timeout 00000020:01000000:3.0:1784189125.885980:0:88975:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1784189125.885984:0:88975:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:3.0:1784189125.885988:0:88975:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784189125.885989:0:88975:0:(obd_config.c:1561:class_process_config()) marker 30 (0x1) lustre-OST0001 add osc 00000020:00000080:3.0:1784189125.885992:0:88975:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1784189125.885996:0:88975:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.203.112@tcp to nid 0x20000c0a8cb70 (192.168.203.112@tcp) 00000020:01000000:3.0:1784189125.886016:0:88975:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1784189125.886018:0:88975:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1784189125.886032:0:88975:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff9dc049be0000) 00000020:00000080:3.0:1784189125.886048:0:88975:0:(obd_config.c:720:class_attach_name()) OBD: dev 27 attached type osp with refcount 2 00000020:00000080:3.0:1784189125.886054:0:88975:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1784189125.886294:0:88975:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:3.0:1784189125.886300:0:88975:0:(osd_handler.c:8929:osd_obd_connect()) connect #7 00000020:00000080:3.0:1784189125.886307:0:88975:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xcc1762b626f8b153 00010000:00080000:3.0:1784189125.886349:0:88975:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9dc0477b0000@lustre-OST0001-osc-MDT0000: add connection 192.168.203.112@tcp at head 00010000:00010000:3.0:1784189125.886567:0:88975:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-11 is initialized 00000040:01000000:3.0:1784189125.886701:0:88975:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:3.0:1784189125.886716:0:88975:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000100:00100000:1.0:1784189125.886757:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf4693c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1870854458094208:0@lo:13:osp-pre-0-0.0 00000040:00080000:3.0:1784189125.886809:0:88975:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0x1:0x5:0x0] first idx 23, last_idx 24 00000100:00100000:1.0:1784189125.886816:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784189125.886861:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458094208 00000100:00100000:1.0:1784189125.886868:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458094208 00000100:00100000:1.0:1784189125.886985:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1924 00000100:00100000:1.0:1784189125.887055:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf4693f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3640:x1870854458094208:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1784189125.887081:0:8432:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 212800 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1784189125.887189:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf4693f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3640:x1870854458094208:12345-0@lo:13:osp-pre-0-0.0 Request processed in 195us (375us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189125.887197:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1924 00000100:00100000:1.0:1784189125.887246:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf4693c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1870854458094208:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1784189125.887286:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000040:00080000:3.0:1784189125.889262:0:88975:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1784189125.889295:0:88975:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].25, 64 off9792 00000040:00080000:3.0:1784189125.889455:0:88975:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x66:0x0].1, 64 off8256 00000004:00080000:2.0:1784189125.889678:0:3639:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1784189125.889690:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf46435180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3639:1870854458094080:0@lo:8:llog_process_th.0 00000004:00080000:1.0:1784189125.889695:0:88981:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1784189125.889742:0:88981:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 3368113422260ns, next at 0ns, rc = 0 00080000:00080000:1.0:1784189125.889748:0:88981:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0000: async commit OSD 00000004:00080000:1.0:1784189125.892341:0:88963:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00000040:00080000:0.0:1784189125.895417:0:88983:0:(llog.c:805:llog_process_thread()) index: 24, lh_last_idx: 25 synced_idx: 0 lgh_last_idx: 25 00000040:00080000:0.0:1784189125.895425:0:88983:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x62:0x0] at index 24 of catalog [0x1:0x5:0x0] 00000040:00080000:0.0:1784189125.895748:0:88983:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0x1:0x5:0x0] first idx 24, last_idx 25 00000040:00080000:0.0:1784189125.895790:0:88983:0:(llog_cat_server.c:902:llog_cat_cleanup()) cancel plain log [0x1:0x62:0x0] at index 24 of catalog [0x1:0x5:0x0] 00000040:00080000:0.0:1784189125.895923:0:88983:0:(llog.c:805:llog_process_thread()) index: 25, lh_last_idx: 25 synced_idx: 25 lgh_last_idx: 25 00000040:00080000:0.0:1784189125.895926:0:88983:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x66:0x0] at index 25 of catalog [0x1:0x5:0x0] 00000020:00000080:0.0:1784189125.897039:0:88975:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1784189125.897053:0:88975:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1784189125.897153:0:88975:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:0.0:1784189125.897178:0:88975:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xcc1762b626f8b15a 00000100:00080000:0.0:1784189125.897189:0:88975:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1784189125.897194:0:88975:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9dc0477b0000 using connection 192.168.203.112@tcp/0@lo 00000100:00100000:0.0:1784189125.897229:0:88975:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9dc04a64f480 x1870854458094336/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1784189125.897291:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc04a64f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3639:1870854458094336:0@lo:8:llog_process_th.0 00000100:00100000:2.0:1784189125.897394:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784189125.897475:0:9982:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458094336 00000100:00100000:1.0:1784189125.897482:0:9982:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458094336 00000100:00100000:1.0:1784189125.897521:0:9982:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4944 00000100:00100000:1.0:1784189125.897529:0:9982:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc075aa1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3639:x1870854458094336:12345-0@lo:8:llog_process_th.0 00010000:00080000:1.0:1784189125.897552:0:9982:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 3368 last 0 00000020:00000080:1.0:1784189125.897575:0:9982:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xcc1762b626f8b161 00002000:00100000:1.0:1784189125.897598:0:9982:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff9dc045665000 ocd_connect_flags: 0xa044401443000026 ocd_version: 21136a2 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:1.0:1784189125.897603:0:9982:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:1.0:1784189125.897605:0:9982:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1784189125.897667:0:9982:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1784189125.897687:0:9982:0:(import.c:65:import_set_state_nolock()) ffff9dc045661800 : changing import state from RECOVER to FULL 00000100:00080000:0.0:1784189125.897818:0:88975:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:0.0:1784189125.897871:0:88975:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1784189125.897876:0:88975:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784189125.897878:0:88975:0:(obd_config.c:1561:class_process_config()) marker 30 (0x2) lustre-OST0001 add osc 00000020:01000000:0.0:1784189125.897882:0:88975:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1784189125.897885:0:88975:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784189125.897886:0:88975:0:(obd_config.c:1561:class_process_config()) marker 35 (0x1) lustre sys.timeout 00000020:00000080:0.0:1784189125.897889:0:88975:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1784189125.897891:0:88975:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1784189125.897893:0:88975:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1784189125.897895:0:88975:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784189125.897896:0:88975:0:(obd_config.c:1561:class_process_config()) marker 35 (0x2) lustre sys.timeout 00000020:01000000:0.0:1784189125.897899:0:88975:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1784189125.897901:0:88975:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784189125.897902:0:88975:0:(obd_config.c:1561:class_process_config()) marker 40 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1784189125.897906:0:88975:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:0.0:1784189125.897932:0:88975:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc04a64d180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bd553d0d-03e2-4233-b06b-b55bbfa2b954:88975:1870854458094464:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1784189125.897982:0:88975:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784189125.898006:0:88968:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458094464 00000100:00100000:0.0:1784189125.898016:0:88968:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458094464 00000100:00100000:0.0:1784189125.898046:0:88968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1784189125.898053:0:88968:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc06b028850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd553d0d-03e2-4233-b06b-b55bbfa2b954+8:88975:x1870854458094464:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1784189125.898153:0:88968:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc06b028850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd553d0d-03e2-4233-b06b-b55bbfa2b954+8:88975:x1870854458094464:12345-0@lo:502:llog_process_th.0 Request processed in 100us (169us total) trans 0 rc 0/0 00000100:00100000:0.0:1784189125.898161:0:88968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1784189125.898205:0:88975:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dc074a76180 going to sleep for 11 seconds 00000100:00100000:0.0:1784189125.898226:0:88975:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc04a64d180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bd553d0d-03e2-4233-b06b-b55bbfa2b954:88975:1870854458094464:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1784189125.898253:0:88975:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1784189125.898256:0:88975:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784189125.898258:0:88975:0:(obd_config.c:1561:class_process_config()) marker 40 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1784189125.898261:0:88975:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 46 count 46 00000100:00100000:1.0:1784189125.899845:0:9982:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc075aa1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3639:x1870854458094336:12345-0@lo:8:llog_process_th.0 Request processed in 2309us (2444us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189125.899856:0:9982:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4944 00000020:01000000:1.0:1784189125.899886:0:88962:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-45 (rc=0) 10000000:01000000:1.0:1784189125.899917:0:88962:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1784189125.899950:0:88962:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff9dbf4369d400/0xcc1762b626f8b0ab lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc1762b626f8b0b2 expref: -99 pid: 88962 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189125.899961:0:88962:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: ffff9dbf4369d400/0xcc1762b626f8b0ab lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc1762b626f8b0b2 expref: -99 pid: 88962 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784189125.899968:0:88962:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff9dbf4845c000 from 1 10000000:01000000:1.0:1784189125.899971:0:88962:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1784189125.900004:0:88962:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff9dc0565e7000/0xcc1762b626f8b168 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 88962 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189125.900012:0:88962:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: ffff9dc0565e7000/0xcc1762b626f8b168 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 88962 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189125.900021:0:88962:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: ffff9dc0565e7000/0xcc1762b626f8b168 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 88962 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784189125.900040:0:88962:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf4693c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd553d0d-03e2-4233-b06b-b55bbfa2b954:88962:1870854458094592:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1784189125.900091:0:88962:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784189125.900123:0:88962:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dc07545b900 going to sleep for 11 seconds 00000100:00100000:3.0:1784189125.900188:0:88973:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458094592 00000100:00100000:3.0:1784189125.900195:0:88973:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458094592 00000100:00100000:3.0:1784189125.900236:0:88973:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1784189125.900245:0:88973:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc06b02a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:bd553d0d-03e2-4233-b06b-b55bbfa2b954+8:88962:x1870854458094592:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1784189125.900256:0:88973:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784189125.900275:0:88973:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dc05ec0ca00/0xcc1762b626f8b16f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xcc1762b626f8b168 expref: -99 pid: 88973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189125.900296:0:88973:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dc05ec0ca00/0xcc1762b626f8b16f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcc1762b626f8b168 expref: 9 pid: 88973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189125.900305:0:88973:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dc05ec0ca00/0xcc1762b626f8b16f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcc1762b626f8b168 expref: 9 pid: 88973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189125.900313:0:88973:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc05ec0ca00, rc 0) 00000100:00100000:3.0:1784189125.900367:0:88973:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc06b02a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:bd553d0d-03e2-4233-b06b-b55bbfa2b954+9:88962:x1870854458094592:12345-0@lo:101:mount.lustre.0 Request processed in 123us (276us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189125.900373:0:88973:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1784189125.900469:0:88962:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf4693c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd553d0d-03e2-4233-b06b-b55bbfa2b954:88962:1870854458094592:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1784189125.900482:0:88962:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: ffff9dc0565e7000/0xcc1762b626f8b168 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc1762b626f8b16f expref: -99 pid: 88962 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189125.900491:0:88962:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: ffff9dc0565e7000/0xcc1762b626f8b168 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcc1762b626f8b16f expref: -99 pid: 88962 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784189125.901067:0:88962:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf4693c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd553d0d-03e2-4233-b06b-b55bbfa2b954:88962:1870854458094720:0@lo:256:mount.lustre.0 00000100:00100000:1.0:1784189125.901108:0:88962:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784189125.901200:0:88962:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dc07545b900 going to sleep for 11 seconds 00000100:00100000:3.0:1784189125.901390:0:88968:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458094720 00000100:00100000:3.0:1784189125.901395:0:88968:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458094720 00000100:00100000:3.0:1784189125.901430:0:88968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1784189125.901436:0:88968:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc06b02a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd553d0d-03e2-4233-b06b-b55bbfa2b954+9:88962:x1870854458094720:12345-0@lo:256:mount.lustre.0 20000000:01000000:3.0:1784189125.901450:0:88968:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:3.0:1784189125.901466:0:88968:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:3.0:1784189125.901470:0:88968:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:3.0:1784189125.901473:0:88968:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:3.0:1784189125.901475:0:88968:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 111 00000100:00100000:3.0:1784189125.901557:0:88968:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc06b02a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd553d0d-03e2-4233-b06b-b55bbfa2b954+9:88962:x1870854458094720:12345-0@lo:256:mount.lustre.0 Request processed in 120us (447us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189125.901564:0:88968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1784189125.901850:0:88962:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf4693c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd553d0d-03e2-4233-b06b-b55bbfa2b954:88962:1870854458094720:0@lo:256:mount.lustre.0 10000000:01000000:1.0:1784189125.903353:0:88962:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1784189125.903373:0:88962:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff9dc0565e7000/0xcc1762b626f8b168 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc1762b626f8b16f expref: -99 pid: 88962 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189125.903385:0:88962:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: ffff9dc0565e7000/0xcc1762b626f8b168 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc1762b626f8b16f expref: -99 pid: 88962 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784189125.903393:0:88962:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9dbf4845c000 from 1 10000000:01000000:1.0:1784189125.903395:0:88962:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1784189125.903427:0:88962:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff9dc0565e6400/0xcc1762b626f8b176 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 88962 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189125.903435:0:88962:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: ffff9dc0565e6400/0xcc1762b626f8b176 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 88962 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189125.903444:0:88962:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: ffff9dc0565e6400/0xcc1762b626f8b176 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 88962 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784189125.903460:0:88962:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf4693c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd553d0d-03e2-4233-b06b-b55bbfa2b954:88962:1870854458094848:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1784189125.903536:0:88962:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784189125.903564:0:88962:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dc07545b900 going to sleep for 11 seconds 00000100:00100000:2.0:1784189125.903996:0:3639:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1784189125.904005:0:3639:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 1 00000100:00080000:2.0:1784189125.904023:0:3639:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1784189125.904028:0:3639:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:2.0:1784189125.904032:0:3639:0:(import.c:65:import_set_state_nolock()) ffff9dc0477b0000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1784189125.904059:0:3639:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1784189125.904066:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc04a64f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3639:1870854458094336:0@lo:8:llog_process_th.0 00000100:00100000:3.0:1784189125.904174:0:88973:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458094848 00000100:00100000:3.0:1784189125.904180:0:88973:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458094848 00000100:00100000:3.0:1784189125.904229:0:88973:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1784189125.904240:0:88973:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc06b02b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:bd553d0d-03e2-4233-b06b-b55bbfa2b954+9:88962:x1870854458094848:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1784189125.904262:0:88973:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784189125.904276:0:88973:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dc05ec0d400/0xcc1762b626f8b17d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xcc1762b626f8b176 expref: -99 pid: 88973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189125.904299:0:88973:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dc05ec0d400/0xcc1762b626f8b17d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcc1762b626f8b176 expref: 10 pid: 88973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189125.904310:0:88973:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dc05ec0d400/0xcc1762b626f8b17d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcc1762b626f8b176 expref: 10 pid: 88973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189125.904345:0:88973:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc05ec0d400, rc 0) 00000100:00100000:3.0:1784189125.904387:0:88973:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc06b02b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:bd553d0d-03e2-4233-b06b-b55bbfa2b954+10:88962:x1870854458094848:12345-0@lo:101:mount.lustre.0 Request processed in 149us (850us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189125.904393:0:88973:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1784189125.904670:0:88962:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf4693c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd553d0d-03e2-4233-b06b-b55bbfa2b954:88962:1870854458094848:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1784189125.904685:0:88962:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: ffff9dc0565e6400/0xcc1762b626f8b176 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc1762b626f8b17d expref: -99 pid: 88962 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189125.904695:0:88962:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: ffff9dc0565e6400/0xcc1762b626f8b176 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcc1762b626f8b17d expref: -99 pid: 88962 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784189125.904771:0:88962:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf4693c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd553d0d-03e2-4233-b06b-b55bbfa2b954:88962:1870854458094976:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1784189125.904800:0:88962:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784189125.904833:0:88962:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dc07545b900 going to sleep for 11 seconds 00000004:00080000:1.0:1784189125.904849:0:88983:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1784189125.904925:0:88983:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 3368128605676ns, next at 0ns, rc = 0 00080000:00080000:1.0:1784189125.904932:0:88983:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00100000:1.0:1784189125.904995:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf4693d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1870854458095104:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1784189125.905028:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784189125.905064:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458095104 00000100:00100000:1.0:1784189125.905068:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458095104 00000100:00100000:1.0:1784189125.905100:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1925 00000100:00100000:1.0:1784189125.905107:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf4693dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3641:x1870854458095104:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1784189125.905122:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 212800 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1784189125.905154:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf4693dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3641:x1870854458095104:12345-0@lo:13:osp-pre-1-0.0 Request processed in 47us (124us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189125.905160:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1925 00000100:00080000:1.0:1784189125.905176:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1784189125.905200:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf4693d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1870854458095104:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1784189125.906616:0:88968:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458094976 00000100:00100000:3.0:1784189125.906627:0:88968:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458094976 00000100:00100000:3.0:1784189125.906668:0:88968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1784189125.906675:0:88968:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf43728450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd553d0d-03e2-4233-b06b-b55bbfa2b954+10:88962:x1870854458094976:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1784189125.906824:0:88968:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf43728450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd553d0d-03e2-4233-b06b-b55bbfa2b954+10:88962:x1870854458094976:12345-0@lo:501:mount.lustre.0 Request processed in 149us (2022us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189125.906832:0:88968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1784189125.906991:0:88962:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf4693c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd553d0d-03e2-4233-b06b-b55bbfa2b954:88962:1870854458094976:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1784189125.907034:0:88962:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc075aa2300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd553d0d-03e2-4233-b06b-b55bbfa2b954:88962:1870854458095232:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1784189125.907081:0:88962:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784189125.907109:0:88962:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dbf45b9be40 going to sleep for 11 seconds 00000004:00080000:1.0:1784189125.907205:0:88963:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000100:00100000:3.0:1784189125.907291:0:88973:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458095232 00000100:00100000:3.0:1784189125.907295:0:88973:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458095232 00000100:00100000:3.0:1784189125.907411:0:88973:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1784189125.907418:0:88973:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf448b3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:bd553d0d-03e2-4233-b06b-b55bbfa2b954+10:88962:x1870854458095232:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1784189125.907512:0:88973:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf448b3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:bd553d0d-03e2-4233-b06b-b55bbfa2b954+10:88962:x1870854458095232:12345-0@lo:503:mount.lustre.0 Request processed in 82us (418us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189125.907528:0:88973:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1784189125.907613:0:88962:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc075aa2300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd553d0d-03e2-4233-b06b-b55bbfa2b954:88962:1870854458095232:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1784189125.907974:0:88985:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf4693d880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bd553d0d-03e2-4233-b06b-b55bbfa2b954:88985:1870854458095360:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1784189125.908014:0:88985:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784189125.909921:0:88985:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dc07545bf00 going to sleep for 11 seconds 00000100:00100000:2.0:1784189125.910032:0:88969:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458095360 00000100:00100000:2.0:1784189125.910040:0:88969:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458095360 00000100:00100000:2.0:1784189125.910099:0:88969:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1784189125.910108:0:88969:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf448b0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd553d0d-03e2-4233-b06b-b55bbfa2b954+10:88985:x1870854458095360:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1784189125.910574:0:88969:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf448b0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd553d0d-03e2-4233-b06b-b55bbfa2b954+10:88985:x1870854458095360:12345-0@lo:502:llog_process_th.0 Request processed in 466us (2559us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189125.910583:0:88969:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1784189125.910655:0:88985:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf4693d880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bd553d0d-03e2-4233-b06b-b55bbfa2b954:88985:1870854458095360:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1784189125.910688:0:88985:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1784189125.910699:0:88985:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784189125.910701:0:88985:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1784189125.910707:0:88985:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9dbf4845c000 00000020:00000080:2.0:1784189125.910710:0:88985:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1784189125.910717:0:88985:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1784189125.910719:0:88985:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784189125.910720:0:88985:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:2.0:1784189125.910722:0:88985:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1784189125.910725:0:88985:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784189125.910731:0:88985:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1784189125.910735:0:88985:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9dbf4845c000 00000020:00000080:2.0:1784189125.910737:0:88985:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1784189125.912384:0:88985:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc075aa1c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bd553d0d-03e2-4233-b06b-b55bbfa2b954:88985:1870854458095488:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1784189125.912453:0:88985:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784189125.912493:0:88969:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458095488 00000100:00100000:2.0:1784189125.912511:0:88969:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458095488 00000100:00100000:2.0:1784189125.912546:0:88969:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1784189125.912553:0:88969:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf448b1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd553d0d-03e2-4233-b06b-b55bbfa2b954+10:88985:x1870854458095488:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1784189125.912638:0:88969:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf448b1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd553d0d-03e2-4233-b06b-b55bbfa2b954+10:88985:x1870854458095488:12345-0@lo:502:llog_process_th.0 Request processed in 85us (185us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189125.912646:0:88969:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1784189125.912686:0:88985:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dc047e1d9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1784189125.912702:0:88985:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc075aa1c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bd553d0d-03e2-4233-b06b-b55bbfa2b954:88985:1870854458095488:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1784189125.912725:0:88985:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1784189125.912731:0:88985:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784189125.912733:0:88985:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:2.0:1784189125.912737:0:88985:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:1.0:1784189125.919715:0:88962:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-6 (rc=0) 10000000:01000000:1.0:1784189125.919758:0:88962:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1784189125.919780:0:88962:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff9dc0565e6400/0xcc1762b626f8b176 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc1762b626f8b17d expref: -99 pid: 88962 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189125.919792:0:88962:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: ffff9dc0565e6400/0xcc1762b626f8b176 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc1762b626f8b17d expref: -99 pid: 88962 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784189125.919852:0:88962:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1784189125.919854:0:88962:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9dbf4845c000 10000000:01000000:1.0:1784189125.919857:0:88962:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9dbf4845c000 10000000:01000000:1.0:1784189125.919861:0:88962:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1784189125.919866:0:88962:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9dbf4845c000 from 1 10000000:01000000:1.0:1784189125.919869:0:88962:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1784189125.919901:0:88962:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff9dc0565e6000/0xcc1762b626f8b184 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 88962 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189125.919910:0:88962:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: ffff9dc0565e6000/0xcc1762b626f8b184 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 88962 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189125.919921:0:88962:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: ffff9dc0565e6000/0xcc1762b626f8b184 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 88962 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784189125.919944:0:88962:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf4693ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd553d0d-03e2-4233-b06b-b55bbfa2b954:88962:1870854458095616:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1784189125.920008:0:88962:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784189125.920053:0:88962:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dc07545b9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1784189125.920131:0:88969:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458095616 00000100:00100000:3.0:1784189125.920137:0:88969:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458095616 00000100:00100000:3.0:1784189125.920185:0:88969:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1784189125.920194:0:88969:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf448b2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd553d0d-03e2-4233-b06b-b55bbfa2b954+10:88962:x1870854458095616:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1784189125.920205:0:88969:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784189125.920218:0:88969:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dc05ec0dc00/0xcc1762b626f8b18b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xcc1762b626f8b184 expref: -99 pid: 88969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189125.920241:0:88969:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dc05ec0dc00/0xcc1762b626f8b18b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcc1762b626f8b184 expref: 11 pid: 88969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189125.920252:0:88969:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dc05ec0dc00/0xcc1762b626f8b18b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcc1762b626f8b184 expref: 11 pid: 88969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189125.920260:0:88969:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc05ec0dc00, rc 0) 00000100:00100000:3.0:1784189125.920299:0:88969:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf448b2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd553d0d-03e2-4233-b06b-b55bbfa2b954+11:88962:x1870854458095616:12345-0@lo:101:mount.lustre.0 Request processed in 106us (291us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189125.920306:0:88969:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1784189125.920379:0:88962:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf4693ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd553d0d-03e2-4233-b06b-b55bbfa2b954:88962:1870854458095616:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1784189125.920393:0:88962:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: ffff9dc0565e6000/0xcc1762b626f8b184 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc1762b626f8b18b expref: -99 pid: 88962 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189125.920401:0:88962:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: ffff9dc0565e6000/0xcc1762b626f8b184 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xcc1762b626f8b18b expref: -99 pid: 88962 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784189125.920449:0:88962:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf46434380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd553d0d-03e2-4233-b06b-b55bbfa2b954:88962:1870854458095744:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1784189125.920482:0:88962:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784189125.920511:0:88962:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dc081c5ccc0 going to sleep for 11 seconds 00000100:00100000:3.0:1784189125.920526:0:88973:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458095744 00000100:00100000:3.0:1784189125.920529:0:88973:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458095744 00000100:00100000:3.0:1784189125.920552:0:88973:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1784189125.920558:0:88973:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf448b3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:bd553d0d-03e2-4233-b06b-b55bbfa2b954+11:88962:x1870854458095744:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1784189125.920731:0:88973:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf448b3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:bd553d0d-03e2-4233-b06b-b55bbfa2b954+11:88962:x1870854458095744:12345-0@lo:501:mount.lustre.0 Request processed in 172us (247us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189125.920738:0:88973:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1784189125.920764:0:88962:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf46434380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd553d0d-03e2-4233-b06b-b55bbfa2b954:88962:1870854458095744:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1784189125.920787:0:88962:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf46434380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd553d0d-03e2-4233-b06b-b55bbfa2b954:88962:1870854458095872:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1784189125.920818:0:88962:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784189125.920829:0:88962:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dc081c5ccc0 going to sleep for 11 seconds 00000100:00100000:3.0:1784189125.920839:0:88973:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458095872 00000100:00100000:3.0:1784189125.920842:0:88973:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458095872 00000100:00100000:3.0:1784189125.920859:0:88973:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1784189125.920864:0:88973:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf448b2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:bd553d0d-03e2-4233-b06b-b55bbfa2b954+11:88962:x1870854458095872:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1784189125.920927:0:88973:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf448b2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:bd553d0d-03e2-4233-b06b-b55bbfa2b954+11:88962:x1870854458095872:12345-0@lo:503:mount.lustre.0 Request processed in 62us (107us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189125.920933:0:88973:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1784189125.920971:0:88962:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf46434380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd553d0d-03e2-4233-b06b-b55bbfa2b954:88962:1870854458095872:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1784189125.927152:0:88988:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf4693c700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bd553d0d-03e2-4233-b06b-b55bbfa2b954:88988:1870854458096000:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1784189125.927234:0:88988:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784189125.928722:0:88988:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dc07545b0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1784189125.929195:0:88973:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458096000 00000100:00100000:3.0:1784189125.929204:0:88973:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458096000 00000100:00100000:3.0:1784189125.929851:0:88973:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1784189125.929863:0:88973:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf448b3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:bd553d0d-03e2-4233-b06b-b55bbfa2b954+11:88988:x1870854458096000:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1784189125.930034:0:88973:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf448b3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:bd553d0d-03e2-4233-b06b-b55bbfa2b954+11:88988:x1870854458096000:12345-0@lo:502:llog_process_th.0 Request processed in 173us (2799us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189125.930041:0:88973:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1784189125.931434:0:88988:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf4693c700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bd553d0d-03e2-4233-b06b-b55bbfa2b954:88988:1870854458096000:0@lo:502:llog_process_th.0 00000020:01000004:2.0:1784189125.931513:0:88988:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:2.0:1784189125.931529:0:88988:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff9dbf449f4d40) 00000020:00000080:2.0:1784189125.931552:0:88988:0:(obd_config.c:720:class_attach_name()) OBD: dev 28 attached type lwp with refcount 2 00000020:01000004:2.0:1784189125.931780:0:88988:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9dbf4845c000 from lustre-MDT0000, refs=4 00000020:01000004:2.0:1784189125.931784:0:88988:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9dbf4845c000 from lustre-MDT0000, refs=4 00000020:01000004:2.0:1784189125.931787:0:88988:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9dbf4845c000 4 00010000:00080000:2.0:1784189125.931812:0:88988:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9dc07118c000@lustre-MDT0000-lwp-MDT0000: add connection 192.168.203.112@tcp at head 00010000:00010000:2.0:1784189125.936789:0:88988:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-12 is initialized 00000020:00000080:2.0:1784189125.936899:0:88988:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:2.0:1784189125.936954:0:88988:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1784189125.936968:0:88988:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0xcc1762b626f8b199 00000100:00080000:2.0:1784189125.936977:0:88988:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1784189125.936983:0:88988:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff9dc07118c000 using connection 192.168.203.112@tcp/0@lo 00000100:00100000:2.0:1784189125.937016:0:88988:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9dc075aa1c00 x1870854458096128/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1784189125.937052:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc075aa1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3639:1870854458096128:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1784189125.937117:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1784189125.937172:0:88988:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1784189125.937357:0:66171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458096128 00000100:00100000:1.0:1784189125.937365:0:66171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458096128 00000100:00100000:1.0:1784189125.937401:0:66171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1191 00000100:00100000:1.0:1784189125.937408:0:66171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc075aa3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3639:x1870854458096128:12345-0@lo:38:llog_process_th.0 00000100:00100000:1.0:1784189125.937458:0:66171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc075aa3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3639:x1870854458096128:12345-0@lo:38:llog_process_th.0 Request processed in 49us (341us total) trans 0 rc -11/-11 00000100:00100000:1.0:1784189125.937465:0:66171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1191 00000100:00100000:2.0:1784189125.937573:0:3639:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1784189125.937580:0:3639:0:(import.c:65:import_set_state_nolock()) ffff9dc07118c000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1784189125.937584:0:3639:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:2.0:1784189125.937655:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc075aa1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3639:1870854458096128:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1784189125.937746:0:88988:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc075aa1c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bd553d0d-03e2-4233-b06b-b55bbfa2b954:88988:1870854458096256:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1784189125.937784:0:88988:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784189125.937809:0:88967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458096256 00000100:00100000:2.0:1784189125.937812:0:88967:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458096256 00000100:00100000:2.0:1784189125.937839:0:88967:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1784189125.937845:0:88967:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf448b2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd553d0d-03e2-4233-b06b-b55bbfa2b954+11:88988:x1870854458096256:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1784189125.937945:0:88967:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf448b2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd553d0d-03e2-4233-b06b-b55bbfa2b954+11:88988:x1870854458096256:12345-0@lo:502:llog_process_th.0 Request processed in 99us (161us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189125.937952:0:88967:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1784189125.937994:0:88988:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dc047e1d9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1784189125.938006:0:88988:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc075aa1c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bd553d0d-03e2-4233-b06b-b55bbfa2b954:88988:1870854458096256:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1784189125.938040:0:88988:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc075aa1c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bd553d0d-03e2-4233-b06b-b55bbfa2b954:88988:1870854458096384:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1784189125.938073:0:88988:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784189125.938093:0:88969:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458096384 00000100:00100000:2.0:1784189125.938097:0:88969:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458096384 00000100:00100000:2.0:1784189125.938120:0:88969:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1784189125.938126:0:88969:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc044984050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd553d0d-03e2-4233-b06b-b55bbfa2b954+11:88988:x1870854458096384:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1784189125.938181:0:88969:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc044984050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd553d0d-03e2-4233-b06b-b55bbfa2b954+11:88988:x1870854458096384:12345-0@lo:502:llog_process_th.0 Request processed in 55us (107us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189125.938189:0:88969:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1784189125.938218:0:88988:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dc047e1d9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1784189125.938230:0:88988:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc075aa1c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bd553d0d-03e2-4233-b06b-b55bbfa2b954:88988:1870854458096384:0@lo:502:llog_process_th.0 00000040:00080000:2.0:1784189125.938247:0:88988:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:3.0:1784189125.938509:0:88962:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:3.0:1784189125.938531:0:88962:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1784189125.938660:0:88962:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff9dc0565e6000/0xcc1762b626f8b184 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc1762b626f8b18b expref: -99 pid: 88962 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189125.938672:0:88962:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: ffff9dc0565e6000/0xcc1762b626f8b184 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc1762b626f8b18b expref: -99 pid: 88962 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1784189125.938726:0:88962:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1784189125.938728:0:88962:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1784189125.938729:0:88962:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1784189125.938730:0:88962:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1784189125.938731:0:88962:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1784189125.938733:0:88962:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1784189125.938734:0:88962:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1784189125.938736:0:88962:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1784189125.938737:0:88962:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1784189125.938739:0:88962:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1784189125.938743:0:88962:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:3.0:1784189125.938745:0:88962:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1784189125.938746:0:88962:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1784189125.938748:0:88962:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1784189125.938749:0:88962:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1784189125.938750:0:88962:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1784189125.938751:0:88962:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1784189125.938752:0:88962:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1784189125.938753:0:88962:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1784189125.938754:0:88962:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1784189125.938755:0:88962:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1784189125.938769:0:88962:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:3.0:1784189125.938779:0:88962:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf46434380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd553d0d-03e2-4233-b06b-b55bbfa2b954:88962:1870854458096512:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1784189125.938819:0:88962:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784189125.938836:0:88962:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dc081c5ce40 going to sleep for 11 seconds 00000100:00100000:2.0:1784189125.939031:0:88967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458096512 00000100:00100000:2.0:1784189125.939036:0:88967:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458096512 00000100:00100000:2.0:1784189125.939071:0:88967:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1784189125.939078:0:88967:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc044987c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd553d0d-03e2-4233-b06b-b55bbfa2b954+11:88962:x1870854458096512:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1784189125.939097:0:88967:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:2.0:1784189125.939109:0:88967:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1784189125.943703:0:88967:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1784189125.943722:0:88967:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:2.0:1784189125.943965:0:88972:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1784189125.943970:0:88972:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1784189125.943993:0:88972:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9dc0755a4c00/0xcc1762b626f8b1a0 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 88972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189125.944015:0:88972:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9dc05ec0ca00/0xcc1762b626f8b16f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcc1762b626f8b168 expref: 11 pid: 88973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784189125.944021:0:88967:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc044987c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd553d0d-03e2-4233-b06b-b55bbfa2b954+11:88962:x1870854458096512:12345-0@lo:253:mount.lustre.0 Request processed in 4942us (5200us total) trans 0 rc 0/0 00010000:00010000:2.0:1784189125.944024:0:88972:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9dc0755a4c00/0xcc1762b626f8b1a0 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 88972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784189125.944030:0:88967:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00010000:2.0:1784189125.944069:0:88972:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9dc05ec0ca00/0xcc1762b626f8b16f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcc1762b626f8b168 expref: 10 pid: 88973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189125.944083:0:88972:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9dc05ec0ca00/0xcc1762b626f8b16f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcc1762b626f8b168 expref: 10 pid: 88973 timeout: 3468 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784189125.944097:0:88972:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc075aa1c00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:88972:1870854458096640:0@lo:104: 00000100:00100000:2.0:1784189125.944131:0:88972:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784189125.944254:0:88972:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dc047e1d9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1784189125.944698:0:88962:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf46434380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd553d0d-03e2-4233-b06b-b55bbfa2b954:88962:1870854458096512:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1784189125.944710:0:88962:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:3.0:1784189125.944713:0:88962:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1784189125.944715:0:88962:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1784189125.944717:0:88962:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1784189125.944718:0:88962:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1784189125.944720:0:88962:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1784189125.944721:0:88962:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1784189125.944722:0:88962:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1784189125.944724:0:88962:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1784189125.944725:0:88962:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1784189125.944727:0:88962:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1784189125.944740:0:88962:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:0.0:1784189125.948079:0:49501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458096640 00000100:00100000:0.0:1784189125.948093:0:49501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458096640 00000100:00100000:0.0:1784189125.949109:0:49501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 309 00000100:00100000:0.0:1784189125.949123:0:49501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc075aa2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:bd553d0d-03e2-4233-b06b-b55bbfa2b954+3:88972:x1870854458096640:12345-0@lo:104: 00010000:00010000:0.0:1784189125.949309:0:49501:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.112@tcp lock: ffff9dc0565e7000/0xcc1762b626f8b168 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xcc1762b626f8b16f expref: -99 pid: 88962 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189125.949423:0:49501:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1784189125.949430:0:49501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc075aa2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:bd553d0d-03e2-4233-b06b-b55bbfa2b954+3:88972:x1870854458096640:12345-0@lo:104: Request processed in 311us (5298us total) trans 0 rc 0/0 00000100:00100000:0.0:1784189125.949437:0:49501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 309 00000100:00100000:2.0:1784189125.949528:0:88972:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc075aa1c00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:88972:1870854458096640:0@lo:104: 00010000:00010000:2.0:1784189125.949783:0:88972:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9dc0755a4c00/0xcc1762b626f8b1a0 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 88972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189125.949822:0:6502:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784189125.949830:0:6502:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.112@tcp lock: ffff9dc0565e7000/0xcc1762b626f8b168 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xcc1762b626f8b16f expref: -99 pid: 88962 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189125.949841:0:6502:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc0565e7000 already unused, calling callback (ffffffffc114ac20) 10000000:00010000:3.0:1784189125.949845:0:6502:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.112@tcp lock: ffff9dc0565e7000/0xcc1762b626f8b168 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xcc1762b626f8b16f expref: -99 pid: 88962 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189125.949852:0:6502:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.112@tcp lock: ffff9dc0565e7000/0xcc1762b626f8b168 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xcc1762b626f8b16f expref: -99 pid: 88962 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1784189125.949858:0:6502:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.112@tcp lock: ffff9dc0565e7000/0xcc1762b626f8b168 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xcc1762b626f8b16f expref: -99 pid: 88962 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784189125.949864:0:6502:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1784189125.949897:0:6502:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.112@tcp lock: ffff9dc0565e7000/0xcc1762b626f8b168 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcc1762b626f8b16f expref: -99 pid: 88962 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189125.949913:0:6502:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1784189125.949939:0:6502:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.112@tcp lock: ffff9dc0565e7000/0xcc1762b626f8b168 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcc1762b626f8b16f expref: -99 pid: 88962 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189125.949945:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.112@tcp lock: ffff9dc0565e7000/0xcc1762b626f8b168 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcc1762b626f8b16f expref: -99 pid: 88962 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189125.949960:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784189125.949961:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784189125.949963:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784189125.949975:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1784189125.949988:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf46434380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:bd553d0d-03e2-4233-b06b-b55bbfa2b954:3643:1870854458096768:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1784189125.950060:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784189125.950102:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458096768 00000100:00100000:2.0:1784189125.950108:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458096768 00010000:00010000:2.0:1784189125.950129:0:6499:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9dc05ec0ca00/0xcc1762b626f8b16f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcc1762b626f8b168 expref: 11 pid: 88973 timeout: 3468 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784189125.950169:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2544 00000100:00100000:2.0:1784189125.950177:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf46434000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bd553d0d-03e2-4233-b06b-b55bbfa2b954+11:3643:x1870854458096768:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1784189125.950188:0:6499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784189125.950194:0:6499:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9dc05ec0ca00/0xcc1762b626f8b16f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcc1762b626f8b168 expref: 11 pid: 88973 timeout: 3468 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189125.950771:0:6499:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9dc05ec0ca00/0xcc1762b626f8b16f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcc1762b626f8b168 expref: 11 pid: 88973 timeout: 3468 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189125.950789:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dc05ec0ca00/0xcc1762b626f8b16f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcc1762b626f8b168 expref: 11 pid: 88973 timeout: 3468 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189125.950813:0:6499:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9dc0755a4c00/0xcc1762b626f8b1a0 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 88972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189125.950821:0:6499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dc0755a4c00/0xcc1762b626f8b1a0 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 88972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1784189125.950836:0:6499:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.006867416s 00010000:00010000:2.0:1784189125.950841:0:6499:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9dc0755a4c00/0xcc1762b626f8b1a0 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 88972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189125.950848:0:6499:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9dc0755a4c00/0xcc1762b626f8b1a0 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 88972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189125.950855:0:6499:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9dc0755a4c00/0xcc1762b626f8b1a0 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 88972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189125.950862:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9dc0755a4c00/0xcc1762b626f8b1a0 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 88972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189125.950867:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc0755a4c00 already unused, calling callback (ffffffffc0b2e230) 00010000:00010000:2.0:1784189125.950871:0:6499:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9dc0755a4c00/0xcc1762b626f8b1a0 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 88972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189125.951481:0:6499:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9dc0755a4c00/0xcc1762b626f8b1a0 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 88972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189125.951513:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9dc0755a4c00/0xcc1762b626f8b1a0 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 88972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189125.951525:0:6499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784189125.951587:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf46434000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bd553d0d-03e2-4233-b06b-b55bbfa2b954+10:3643:x1870854458096768:12345-0@lo:103:ldlm_bl.0 Request processed in 1410us (1526us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189125.951596:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2544 00000100:00100000:2.0:1784189125.951646:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf46434380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:bd553d0d-03e2-4233-b06b-b55bbfa2b954:3643:1870854458096768:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1784189125.953221:0:88972:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9dc0755a4c00/0xcc1762b626f8b1a0 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 88972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189125.953235:0:88972:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9dc0755a4c00/0xcc1762b626f8b1a0 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 88972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189125.953242:0:88972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dc0755a4c00/0xcc1762b626f8b1a0 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 88972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:2.0:1784189125.960804:0:88962:0:(update_trans.c:1495:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 73014444062 00000040:01000000:2.0:1784189125.961523:0:88962:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:1.0:1784189125.961594:0:88993:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 73014444062 00000020:00080000:1.0:1784189125.961598:0:88993:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 73014444062 00000040:01000000:1.0:1784189125.970601:0:88994:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:3.0:1784189125.971228:0:88962:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osp-MDT0000 ctxt 16 is initialized 00000040:00080000:0.0:1784189125.971645:0:88994:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1784189125.973786:0:88995:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf4693c380 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:88995:1870854458096896:0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1784189125.973862:0:88995:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784189125.973902:0:88995:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dc07545bf00 going to sleep for 11 seconds 00000100:00100000:2.0:1784189125.973965:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458096896 00000100:00100000:2.0:1784189125.973973:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458096896 00000100:00100000:2.0:1784189125.974026:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3769 00000100:00100000:2.0:1784189125.974035:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf4693d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:88995:x1870854458096896:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1784189125.974117:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf4693d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:88995:x1870854458096896:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 83us (254us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189125.974123:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3769 00000100:00100000:2.0:1784189125.974161:0:88995:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf4693c380 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:88995:1870854458096896:0@lo:1000:lod0000_rec0001.0 00000040:01000000:2.0:1784189125.974195:0:88995:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:2.0:1784189125.974223:0:88995:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc075aa1c00 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:88995:1870854458097024:0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1784189125.974256:0:88995:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784189125.974277:0:23826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458097024 00000100:00100000:2.0:1784189125.974281:0:23826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458097024 00000100:00100000:2.0:1784189125.974305:0:23826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3770 00000100:00100000:2.0:1784189125.974311:0:23826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc075aa2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:88995:x1870854458097024:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1784189125.974432:0:23826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc075aa2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:88995:x1870854458097024:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 120us (175us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189125.974438:0:23826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3770 00000100:00100000:2.0:1784189125.974457:0:88995:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dbf445d3480 going to sleep for 11 seconds 00000100:00100000:2.0:1784189125.974470:0:88995:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc075aa1c00 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:88995:1870854458097024:0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1784189125.974548:0:88995:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc075aa1c00 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:88995:1870854458097152:0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1784189125.974573:0:88995:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784189125.974740:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458097152 00000100:00100000:2.0:1784189125.974745:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458097152 00000100:00100000:2.0:1784189125.974769:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3771 00000100:00100000:2.0:1784189125.974775:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc075aa3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:88995:x1870854458097152:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1784189125.974817:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc075aa3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:88995:x1870854458097152:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 42us (243us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189125.974822:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3771 00000100:00100000:2.0:1784189125.974838:0:88995:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dc07545bf00 going to sleep for 11 seconds 00000100:00100000:2.0:1784189125.974849:0:88995:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc075aa1c00 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:88995:1870854458097152:0@lo:1000:lod0000_rec0001.0 00000040:00080000:2.0:1784189125.974886:0:88995:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1784189125.976310:0:88994:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x20000a810:0x1:0x0] index 261376 count 1 00000004:00080000:0.0:1784189125.976418:0:88994:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000040:01000000:3.0:1784189125.978454:0:88962:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:3.0:1784189125.978526:0:88962:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:3.0:1784189125.979394:0:88962:0:(mdd_device.c:553:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:3.0:1784189125.979403:0:88962:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:3.0:1784189125.979443:0:88962:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1784189125.980902:0:88995:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x2400090a4:0x1:0x0] index 261376 count 1 00000004:00080000:2.0:1784189125.981508:0:88995:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osp-MDT0000 retrieved update log, duration 0, retries 0 00000004:00080000:2.0:1784189125.981512:0:88995:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000040:00080000:3.0:1784189125.981758:0:88962:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:3.0:1784189125.982905:0:88962:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:3.0:1784189125.983007:0:88962:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:3.0:1784189125.983134:0:88962:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:3.0:1784189125.983804:0:88962:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x4c:0x0] (8/32) registered 00010000:00080000:3.0:1784189125.985838:0:88962:0:(ldlm_lib.c:3053:target_recovery_init()) RECOVERY: service lustre-MDT0000, 2 recoverable clients, last_transno 103079215110 00010000:00080000:3.0:1784189125.986577:0:88996:0:(ldlm_lib.c:2853:target_recovery_thread()) lustre-MDT0000: started recovery thread pid 88996 00010000:02000000:3.0:1784189125.986595:0:88996:0:(ldlm_lib.c:2335:target_recovery_overseer()) lustre-MDT0000: in recovery but waiting for the first client to connect 00010000:00080000:3.0:1784189125.986599:0:88996:0:(ldlm_lib.c:2545:check_for_recovery_ready()) connected 0 stale 0 max_recoverable_clients 2 abort 0 expired 0 00010000:00080000:3.0:1784189125.986603:0:88996:0:(ldlm_lib.c:2545:check_for_recovery_ready()) connected 0 stale 0 max_recoverable_clients 2 abort 0 expired 0 00000020:01000004:2.0:1784189125.986697:0:88962:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1784189125.986711:0:88962:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.112@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1784189125.986728:0:88962:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=46 00000080:00000004:2.0:1784189125.986741:0:88962:0:(super25.c:181:lustre_fill_super()) /dev/mapper/mds1_flakey: Mount complete 00000020:00000004:2.0:1784189125.987560:0:88962:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1784189125.987785:0:88962:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1784189126.384886:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784189127.079689:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1784189127.079798:0:88969:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436260608 00000100:00100000:2.0:1784189127.079807:0:88969:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436260608 00000100:00100000:2.0:1784189127.079867:0:88969:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 27 00000100:00100000:2.0:1784189127.079878:0:88969:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc044984450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9957a2dc-fd88-4a91-bca3-e2b7f365ab0c+5:42415:x1870854436260608:12345-192.168.203.12@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1784189127.079893:0:88969:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784189127.079913:0:88969:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dc0755a5200/0xcc1762b626f8b1a7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xcbfc5de7fe6c3dae expref: -99 pid: 88969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189127.079956:0:88969:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dc0755a5200/0xcc1762b626f8b1a7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c3dae expref: 6 pid: 88969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189127.079967:0:88969:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dc0755a5200/0xcc1762b626f8b1a7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c3dae expref: 6 pid: 88969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189127.079976:0:88969:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc0755a5200, rc 0) 00000100:00100000:2.0:1784189127.080039:0:88969:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc044984450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9957a2dc-fd88-4a91-bca3-e2b7f365ab0c+6:42415:x1870854436260608:12345-192.168.203.12@tcp:101:ll_cfg_requeue.0 Request processed in 162us (357us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189127.080046:0:88969:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 27 10000000:01000000:3.0:1784189127.087520:0:6510:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1784189127.087527:0:6510:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff9dbf4845c000 from 112 10000000:01000000:3.0:1784189127.087533:0:6510:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1784189127.087590:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff9dc05ec0d800/0xcc1762b626f8b1ae lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189127.087603:0:6510:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: ffff9dc05ec0d800/0xcc1762b626f8b1ae lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189127.087614:0:6510:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: ffff9dc05ec0d800/0xcc1762b626f8b1ae lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784189127.087640:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf46434380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458097280:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1784189127.087703:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784189127.087754:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dbf44cb6000 going to sleep for 11 seconds 00000100:00100000:2.0:1784189127.087946:0:88968:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458097280 00000100:00100000:2.0:1784189127.087953:0:88968:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458097280 00000100:00100000:2.0:1784189127.088010:0:88968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1784189127.088019:0:88968:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc044986450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd553d0d-03e2-4233-b06b-b55bbfa2b954+10:6510:x1870854458097280:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1784189127.088032:0:88968:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784189127.088045:0:88968:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dc0755a4000/0xcc1762b626f8b1b5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xcc1762b626f8b1ae expref: -99 pid: 88968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189127.088068:0:88968:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dc0755a4000/0xcc1762b626f8b1b5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcc1762b626f8b1ae expref: 11 pid: 88968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189127.088079:0:88968:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dc0755a4000/0xcc1762b626f8b1b5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcc1762b626f8b1ae expref: 11 pid: 88968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189127.088098:0:88968:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc0755a4000, rc 0) 00000100:00100000:2.0:1784189127.088138:0:88968:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc044986450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd553d0d-03e2-4233-b06b-b55bbfa2b954+11:6510:x1870854458097280:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 119us (434us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189127.088274:0:88968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1784189127.088522:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf46434380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458097280:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784189127.088537:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: ffff9dc05ec0d800/0xcc1762b626f8b1ae lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc1762b626f8b1b5 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189127.088547:0:6510:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: ffff9dc05ec0d800/0xcc1762b626f8b1ae lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcc1762b626f8b1b5 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784189127.088617:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf46434380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458097408:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1784189127.088652:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784189127.088680:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dbf44cb6000 going to sleep for 11 seconds 00000100:00100000:2.0:1784189127.089186:0:88969:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458097408 00000100:00100000:2.0:1784189127.089191:0:88969:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458097408 00000100:00100000:2.0:1784189127.089227:0:88969:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1784189127.089235:0:88969:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc044984850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd553d0d-03e2-4233-b06b-b55bbfa2b954+11:6510:x1870854458097408:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1784189127.089251:0:88969:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1784189127.089267:0:88969:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1784189127.089270:0:88969:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 112 00000100:00100000:2.0:1784189127.089391:0:88969:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc044984850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd553d0d-03e2-4233-b06b-b55bbfa2b954+11:6510:x1870854458097408:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 155us (737us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189127.089398:0:88969:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1784189127.089415:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf46434380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458097408:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1784189127.089474:0:6510:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1784189127.089481:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff9dc05ec0d800/0xcc1762b626f8b1ae lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc1762b626f8b1b5 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189127.089501:0:6510:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: ffff9dc05ec0d800/0xcc1762b626f8b1ae lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc1762b626f8b1b5 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784189127.089510:0:6510:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1784189127.089513:0:6510:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9dbf44675800 from 52 10000000:01000000:0.0:1784189127.089515:0:6510:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1784189127.089538:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff9dbf4369d800/0xcc1762b626f8b1bc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189127.089546:0:6510:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: ffff9dbf4369d800/0xcc1762b626f8b1bc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189127.089554:0:6510:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: ffff9dbf4369d800/0xcc1762b626f8b1bc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784189127.089569:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc04a64d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458097536:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1784189127.089602:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784189127.089633:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dc075770540 going to sleep for 11 seconds 00000100:00100000:2.0:1784189127.090076:0:88968:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458097536 00000100:00100000:2.0:1784189127.090081:0:88968:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458097536 00000100:00100000:2.0:1784189127.090113:0:88968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1784189127.090121:0:88968:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc044984c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd553d0d-03e2-4233-b06b-b55bbfa2b954+11:6510:x1870854458097536:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1784189127.090130:0:88968:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784189127.090142:0:88968:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dc0755a5a00/0xcc1762b626f8b1c3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xcc1762b626f8b1bc expref: -99 pid: 88968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189127.090161:0:88968:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dc0755a5a00/0xcc1762b626f8b1c3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcc1762b626f8b1bc expref: 12 pid: 88968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189127.090170:0:88968:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dc0755a5a00/0xcc1762b626f8b1c3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcc1762b626f8b1bc expref: 12 pid: 88968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189127.090177:0:88968:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc0755a5a00, rc 0) 00000100:00100000:2.0:1784189127.090284:0:88968:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc044984c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd553d0d-03e2-4233-b06b-b55bbfa2b954+12:6510:x1870854458097536:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 163us (680us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189127.090298:0:88968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1784189127.090357:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1784189127.090761:0:88969:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436260736 00000100:00100000:2.0:1784189127.090766:0:88969:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436260736 00000100:00100000:2.0:1784189127.090801:0:88969:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 31 00000100:00100000:2.0:1784189127.090809:0:88969:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc044986c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9957a2dc-fd88-4a91-bca3-e2b7f365ab0c+6:42415:x1870854436260736:12345-192.168.203.12@tcp:256:ll_cfg_requeue.0 20000000:01000000:2.0:1784189127.090821:0:88969:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 16384. 20000000:01000000:2.0:1784189127.090835:0:88969:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1784189127.090839:0:88969:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/4/3. 20000000:01000000:2.0:1784189127.090842:0:88969:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/4/3. 20000000:01000000:2.0:1784189127.090845:0:88969:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/4/3. 20000000:01000000:2.0:1784189127.090847:0:88969:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 112 00000100:00100000:3.0:1784189127.092570:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc04a64d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458097536:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784189127.092594:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: ffff9dbf4369d800/0xcc1762b626f8b1bc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc1762b626f8b1c3 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189127.092606:0:6510:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: ffff9dbf4369d800/0xcc1762b626f8b1bc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xcc1762b626f8b1c3 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784189127.092691:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf46435180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458097664:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784189127.092744:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784189127.092797:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dbf44cb6c00 going to sleep for 11 seconds 00000100:00100000:0.0:1784189127.092826:0:88967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458097664 00000100:00100000:0.0:1784189127.092833:0:88967:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458097664 00000100:00100000:0.0:1784189127.092934:0:88967:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1784189127.092944:0:88967:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc044987050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd553d0d-03e2-4233-b06b-b55bbfa2b954+12:6510:x1870854458097664:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1784189127.093135:0:88967:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc044987050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd553d0d-03e2-4233-b06b-b55bbfa2b954+12:6510:x1870854458097664:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 192us (390us total) trans 0 rc 0/0 00000100:00100000:0.0:1784189127.093143:0:88967:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1784189127.093298:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf46435180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458097664:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784189127.093350:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf46435180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458097792:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1784189127.093387:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784189127.093414:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dbf44cb6c00 going to sleep for 11 seconds 00000100:00100000:0.0:1784189127.093525:0:88973:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458097792 00000100:00100000:0.0:1784189127.093530:0:88973:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458097792 00000100:00100000:0.0:1784189127.093562:0:88973:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1784189127.093569:0:88973:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc044985450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:bd553d0d-03e2-4233-b06b-b55bbfa2b954+12:6510:x1870854458097792:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1784189127.093972:0:88973:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc044985450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:bd553d0d-03e2-4233-b06b-b55bbfa2b954+12:6510:x1870854458097792:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 402us (583us total) trans 0 rc 0/0 00000100:00100000:0.0:1784189127.093980:0:88973:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1784189127.094125:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf46435180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458097792:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1784189127.095304:0:89057:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 51 00000020:01000000:3.0:1784189127.095757:0:6510:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 52-51 (rc=0) 10000000:01000000:3.0:1784189127.095783:0:6510:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1784189127.095793:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff9dbf4369d800/0xcc1762b626f8b1bc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc1762b626f8b1c3 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189127.095865:0:6510:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: ffff9dbf4369d800/0xcc1762b626f8b1bc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc1762b626f8b1c3 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784189127.095952:0:6510:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1784189127.095955:0:6510:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff9dbf44675800 from 109 10000000:01000000:3.0:1784189127.095958:0:6510:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1784189127.095991:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff9dc05ec0cc00/0xcc1762b626f8b1ca lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189127.095999:0:6510:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: ffff9dc05ec0cc00/0xcc1762b626f8b1ca lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189127.096008:0:6510:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: ffff9dc05ec0cc00/0xcc1762b626f8b1ca lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784189127.096030:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf46435180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458097920:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1784189127.096144:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784189127.096234:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dbf44cb6c00 going to sleep for 11 seconds 00000100:00100000:2.0:1784189127.096476:0:88968:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458097920 00000100:00100000:2.0:1784189127.096483:0:88968:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458097920 00000100:00100000:2.0:1784189127.096567:0:88968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1784189127.096576:0:88968:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc075393850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd553d0d-03e2-4233-b06b-b55bbfa2b954+12:6510:x1870854458097920:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1784189127.096596:0:88968:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784189127.096616:0:88968:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dc0755a4600/0xcc1762b626f8b1d1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xcc1762b626f8b1ca expref: -99 pid: 88968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189127.096638:0:88968:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dc0755a4600/0xcc1762b626f8b1d1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcc1762b626f8b1ca expref: 13 pid: 88968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189127.096648:0:88968:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dc0755a4600/0xcc1762b626f8b1d1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcc1762b626f8b1ca expref: 13 pid: 88968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189127.096659:0:88968:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc0755a4600, rc 0) 00000100:00100000:2.0:1784189127.096977:0:88968:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc075393850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd553d0d-03e2-4233-b06b-b55bbfa2b954+13:6510:x1870854458097920:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 401us (832us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189127.096996:0:88968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1784189127.099215:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf46435180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458097920:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784189127.099242:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: ffff9dc05ec0cc00/0xcc1762b626f8b1ca lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc1762b626f8b1d1 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189127.099254:0:6510:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: ffff9dc05ec0cc00/0xcc1762b626f8b1ca lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xcc1762b626f8b1d1 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784189127.099345:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf46435180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458098048:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1784189127.099405:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784189127.099435:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dbf44cb6c00 going to sleep for 11 seconds 00000100:00100000:1.0:1784189127.099533:0:88973:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458098048 00000100:00100000:1.0:1784189127.099539:0:88973:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458098048 00000100:00100000:1.0:1784189127.099593:0:88973:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1784189127.099612:0:88973:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc075393c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:bd553d0d-03e2-4233-b06b-b55bbfa2b954+13:6510:x1870854458098048:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1784189127.099632:0:88973:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1784189127.099648:0:88973:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1784189127.099653:0:88973:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/4/3. 20000000:01000000:1.0:1784189127.099656:0:88973:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/4/3. 20000000:01000000:1.0:1784189127.099659:0:88973:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/4/3. 20000000:01000000:1.0:1784189127.099661:0:88973:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 112 00000100:00100000:1.0:1784189127.099732:0:88973:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc075393c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:bd553d0d-03e2-4233-b06b-b55bbfa2b954+13:6510:x1870854458098048:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 131us (326us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189127.099740:0:88973:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1784189127.100209:0:88969:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc044986c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9957a2dc-fd88-4a91-bca3-e2b7f365ab0c+6:42415:x1870854436260736:12345-192.168.203.12@tcp:256:ll_cfg_requeue.0 Request processed in 9398us (9851us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189127.100226:0:88969:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 31 00000100:00100000:3.0:1784189127.104028:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf46435180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458098048:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1784189127.104135:0:6510:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1784189127.104152:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff9dc05ec0cc00/0xcc1762b626f8b1ca lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc1762b626f8b1d1 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189127.104163:0:6510:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: ffff9dc05ec0cc00/0xcc1762b626f8b1ca lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc1762b626f8b1d1 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784189127.104172:0:6510:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:3.0:1784189127.104174:0:6510:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 46 10000000:01000000:3.0:1784189127.104177:0:6510:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:3.0:1784189127.104209:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff9dc05ec0de00/0xcc1762b626f8b1d8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189127.104217:0:6510:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: ffff9dc05ec0de00/0xcc1762b626f8b1d8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189127.104225:0:6510:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: ffff9dc05ec0de00/0xcc1762b626f8b1d8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784189127.104244:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf46435180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458098176:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1784189127.104304:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784189127.104398:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dbf44cb6c00 going to sleep for 11 seconds 00000100:00100000:3.0:1784189127.107427:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1784189127.107473:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1784189127.107544:0:66169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436260864 00000100:00100000:2.0:1784189127.107554:0:66169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436260864 00000100:00100000:2.0:1784189127.107607:0:66169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1192 00000100:00100000:2.0:1784189127.107615:0:66169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf46434380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2395:x1870854436260864:12345-192.168.203.12@tcp:38:ll_cfg_requeue.0 00010000:00080000:2.0:1784189127.107645:0:66169:0:(ldlm_lib.c:938:target_handle_reconnect()) connect export for UUID 'b90fcc1c-0e69-42a4-a116-a71fec7aeb78' at ffff9dbf43e9f000, cookie 0xcc1762b626f8b0f1 00010000:00080000:2.0:1784189127.107651:0:66169:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from b90fcc1c-0e69-42a4-a116-a71fec7aeb78@192.168.203.12@tcp recovering/t103079215111 exp ffff9dbf43e9f000 cur 3369 last 1784189125 00010000:02000400:2.0:1784189127.107659:0:66169:0:(ldlm_lib.c:2036:target_start_recovery_timer()) lustre-MDT0000: Will be in recovery for at least 1:00, or until 2 clients reconnect 00010000:00080000:2.0:1784189127.107664:0:66169:0:(ldlm_lib.c:2100:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 70 seconds 00000004:00100000:2.0:1784189127.107682:0:66169:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:2.0:1784189127.107824:0:66169:0:(import.c:65:import_set_state_nolock()) ffff9dc047a86800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1784189127.107903:0:66169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf46434380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+6:2395:x1870854436260864:12345-192.168.203.12@tcp:38:ll_cfg_requeue.0 Request processed in 287us (483us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189127.107912:0:66169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1192 00000100:00100000:0.0:1784189127.110805:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1784189127.110886:0:66945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436253824 00000100:00100000:3.0:1784189127.110895:0:66945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436253824 00000100:00100000:3.0:1784189127.110959:0:66945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1193 00000100:00100000:3.0:1784189127.110969:0:66945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc04a64e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+6:2395:x1870854436253824:12345-192.168.203.12@tcp:36:mcreate.0 00010000:00080000:3.0:1784189127.110987:0:66945:0:(ldlm_lib.c:3228:target_queue_recovery_request()) Next recovery transno: 103079215111, current: 103079215111, replaying 00000100:00100000:3.0:1784189127.111001:0:66945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc04a64e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+6:2395:x1870854436253824:12345-192.168.203.12@tcp:36:mcreate.0 Request processed in 34us (205us total) trans 0 rc 0/-999 00000100:00100000:3.0:1784189127.111021:0:66945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1193 00010000:00080000:3.0:1784189127.111039:0:88996:0:(ldlm_lib.c:2545:check_for_recovery_ready()) connected 1 stale 0 max_recoverable_clients 2 abort 0 expired 0 00000100:00100000:1.0:1784189127.111447:0:88973:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458098176 00000100:00100000:1.0:1784189127.111453:0:88973:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458098176 00000100:00100000:1.0:1784189127.111506:0:88973:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436260992 00000100:00100000:1.0:1784189127.111511:0:88973:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436260992 00000100:00100000:1.0:1784189127.111545:0:88973:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1784189127.111555:0:88973:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc075392850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:bd553d0d-03e2-4233-b06b-b55bbfa2b954+13:6510:x1870854458098176:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784189127.111568:0:88973:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784189127.111588:0:88973:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dc0565e7e00/0xcc1762b626f8b1df lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xcc1762b626f8b1d8 expref: -99 pid: 88973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784189127.111607:0:88968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 37 00010000:00010000:1.0:1784189127.111616:0:88973:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dc0565e7e00/0xcc1762b626f8b1df lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcc1762b626f8b1d8 expref: 14 pid: 88973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784189127.111619:0:88968:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc075392c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9957a2dc-fd88-4a91-bca3-e2b7f365ab0c+6:42415:x1870854436260992:12345-192.168.203.12@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784189127.111635:0:88973:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dc0565e7e00/0xcc1762b626f8b1df lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcc1762b626f8b1d8 expref: 14 pid: 88973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189127.111641:0:88968:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784189127.111651:0:88968:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dbf4369c600/0xcc1762b626f8b1e6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xcbfc5de7fe6c3db5 expref: -99 pid: 88968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189127.111657:0:88973:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc0565e7e00, rc 0) 00010000:00010000:0.0:1784189127.111673:0:88968:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dbf4369c600/0xcc1762b626f8b1e6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c3db5 expref: 7 pid: 88968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189127.111684:0:88968:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dbf4369c600/0xcc1762b626f8b1e6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c3db5 expref: 7 pid: 88968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189127.111691:0:88968:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dbf4369c600, rc 0) 00000100:00100000:0.0:1784189127.111736:0:88968:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc075392c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9957a2dc-fd88-4a91-bca3-e2b7f365ab0c+7:42415:x1870854436260992:12345-192.168.203.12@tcp:101:ll_cfg_requeue.0 Request processed in 120us (4261us total) trans 0 rc 0/0 00000100:00100000:0.0:1784189127.111756:0:88968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 37 00000100:00100000:1.0:1784189127.111832:0:88973:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc075392850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:bd553d0d-03e2-4233-b06b-b55bbfa2b954+14:6510:x1870854458098176:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 278us (7525us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189127.111841:0:88973:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1784189127.111855:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf46435180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458098176:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784189127.111877:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: ffff9dc05ec0de00/0xcc1762b626f8b1d8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc1762b626f8b1df expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189127.111887:0:6510:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: ffff9dc05ec0de00/0xcc1762b626f8b1d8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xcc1762b626f8b1df expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784189127.111974:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc04a64d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458098304:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1784189127.112003:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784189127.112025:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dc0749d5e40 going to sleep for 11 seconds 00000100:00100000:2.0:1784189127.113012:0:88969:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458098304 00000100:00100000:2.0:1784189127.113021:0:88969:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458098304 00000100:00100000:2.0:1784189127.113137:0:88969:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1784189127.113148:0:88969:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc075392450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd553d0d-03e2-4233-b06b-b55bbfa2b954+14:6510:x1870854458098304:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1784189127.114419:0:88969:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc075392450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd553d0d-03e2-4233-b06b-b55bbfa2b954+14:6510:x1870854458098304:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 1269us (2409us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189127.114430:0:88969:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1784189127.114675:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc04a64d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458098304:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1784189127.114731:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf4693f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458098432:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1784189127.114783:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784189127.115115:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dbf42629540 going to sleep for 11 seconds 00000100:00100000:1.0:1784189127.115255:0:88967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458098432 00000100:00100000:1.0:1784189127.115261:0:88967:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458098432 00000100:00100000:1.0:1784189127.115310:0:88967:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1784189127.115338:0:88967:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc075391050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd553d0d-03e2-4233-b06b-b55bbfa2b954+14:6510:x1870854458098432:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1784189127.118435:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1784189127.118944:0:88968:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436261120 00000100:00100000:2.0:1784189127.118953:0:88968:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436261120 00000100:00100000:2.0:1784189127.119004:0:88968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 40 00000100:00100000:2.0:1784189127.119013:0:88968:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc075391c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9957a2dc-fd88-4a91-bca3-e2b7f365ab0c+7:42415:x1870854436261120:12345-192.168.203.12@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1784189127.119159:0:88968:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc075391c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9957a2dc-fd88-4a91-bca3-e2b7f365ab0c+8:42415:x1870854436261120:12345-192.168.203.12@tcp:501:ll_cfg_requeue.0 Request processed in 145us (730us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189127.119168:0:88968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 40 00000100:00100000:0.0:1784189127.120471:0:88967:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc075391050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd553d0d-03e2-4233-b06b-b55bbfa2b954+14:6510:x1870854458098432:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 5148us (5683us total) trans 0 rc 0/0 00000100:00100000:0.0:1784189127.120483:0:88967:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1784189127.120857:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf4693f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458098432:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1784189127.122037:0:89058:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 64768 count 46 00000100:00100000:2.0:1784189127.123094:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000020:01000000:0.0:1784189127.123366:0:6510:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 46-45 (rc=0) 10000000:01000000:0.0:1784189127.123401:0:6510:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:0.0:1784189127.123410:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff9dc05ec0de00/0xcc1762b626f8b1d8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc1762b626f8b1df expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189127.123422:0:6510:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: ffff9dc05ec0de00/0xcc1762b626f8b1d8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc1762b626f8b1df expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784189127.123431:0:6510:0:(mgc_request.c:611:do_requeue()) updating log lustre-barrier 10000000:01000000:0.0:1784189127.123433:0:6510:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-barrier-ffff9dbf44675800 from 1 10000000:01000000:0.0:1784189127.123436:0:6510:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:0.0:1784189127.123468:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff9dbf4369c400/0xcc1762b626f8b1ed lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189127.123502:0:6510:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: ffff9dbf4369c400/0xcc1762b626f8b1ed lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189127.123514:0:6510:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: ffff9dbf4369c400/0xcc1762b626f8b1ed lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784189127.123537:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc04a64f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458098560:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1784189127.123593:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784189127.123739:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dc0749d5c00 going to sleep for 11 seconds 00000100:00100000:1.0:1784189127.124079:0:88973:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436261248 00000100:00100000:1.0:1784189127.124086:0:88973:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436261248 00000100:00100000:1.0:1784189127.124140:0:88973:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458098560 00000100:00100000:1.0:1784189127.124143:0:88973:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458098560 00000100:00100000:1.0:1784189127.124169:0:88973:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 41 00000100:00100000:1.0:1784189127.124177:0:88973:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc075390850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:9957a2dc-fd88-4a91-bca3-e2b7f365ab0c+8:42415:x1870854436261248:12345-192.168.203.12@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1784189127.124302:0:88973:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc075390850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:9957a2dc-fd88-4a91-bca3-e2b7f365ab0c+8:42415:x1870854436261248:12345-192.168.203.12@tcp:503:ll_cfg_requeue.0 Request processed in 125us (1213us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189127.124310:0:88973:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 41 00000100:00100000:1.0:1784189127.124360:0:88973:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1784189127.124366:0:88973:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc075391450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:bd553d0d-03e2-4233-b06b-b55bbfa2b954+14:6510:x1870854458098560:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784189127.124373:0:88973:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784189127.124387:0:88973:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dc0565e6600/0xcc1762b626f8b1f4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xcc1762b626f8b1ed expref: -99 pid: 88973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189127.124407:0:88973:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dc0565e6600/0xcc1762b626f8b1f4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcc1762b626f8b1ed expref: 15 pid: 88973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189127.124418:0:88973:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dc0565e6600/0xcc1762b626f8b1f4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcc1762b626f8b1ed expref: 15 pid: 88973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189127.124425:0:88973:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc0565e6600, rc 0) 00000100:00100000:1.0:1784189127.124460:0:88973:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc075391450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:bd553d0d-03e2-4233-b06b-b55bbfa2b954+15:6510:x1870854458098560:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 94us (866us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189127.124472:0:88973:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1784189127.126903:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc04a64f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458098560:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784189127.126931:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: ffff9dbf4369c400/0xcc1762b626f8b1ed lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc1762b626f8b1f4 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189127.126943:0:6510:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: ffff9dbf4369c400/0xcc1762b626f8b1ed lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xcc1762b626f8b1f4 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784189127.126964:0:6510:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:1.0:1784189127.126969:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff9dbf4369c400/0xcc1762b626f8b1ed lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc1762b626f8b1f4 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189127.126976:0:6510:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: ffff9dbf4369c400/0xcc1762b626f8b1ed lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc1762b626f8b1f4 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784189127.126985:0:6510:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1784189127.126988:0:6510:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9dbf44675800 from 7 10000000:01000000:1.0:1784189127.126991:0:6510:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1784189127.127030:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff9dc0565e7c00/0xcc1762b626f8b1fb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189127.127038:0:6510:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: ffff9dc0565e7c00/0xcc1762b626f8b1fb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189127.127047:0:6510:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: ffff9dc0565e7c00/0xcc1762b626f8b1fb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784189127.127068:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf4693f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458098688:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1784189127.127124:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784189127.127173:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dbf42629900 going to sleep for 11 seconds 00000100:00100000:1.0:1784189127.127192:0:88973:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458098688 00000100:00100000:1.0:1784189127.127198:0:88973:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458098688 00000100:00100000:1.0:1784189127.127240:0:88973:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1784189127.127249:0:88973:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc075390450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:bd553d0d-03e2-4233-b06b-b55bbfa2b954+15:6510:x1870854458098688:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784189127.127259:0:88973:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784189127.127272:0:88973:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dc0565e6200/0xcc1762b626f8b202 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xcc1762b626f8b1fb expref: -99 pid: 88973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189127.127291:0:88973:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dc0565e6200/0xcc1762b626f8b202 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcc1762b626f8b1fb expref: 16 pid: 88973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189127.127299:0:88973:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dc0565e6200/0xcc1762b626f8b202 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcc1762b626f8b1fb expref: 16 pid: 88973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189127.127307:0:88973:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc0565e6200, rc 0) 00000100:00100000:1.0:1784189127.127366:0:88973:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc075390450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:bd553d0d-03e2-4233-b06b-b55bbfa2b954+16:6510:x1870854458098688:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 117us (241us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189127.127372:0:88973:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1784189127.127409:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf4693f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458098688:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784189127.127420:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: ffff9dc0565e7c00/0xcc1762b626f8b1fb lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc1762b626f8b202 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189127.127427:0:6510:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: ffff9dc0565e7c00/0xcc1762b626f8b1fb lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xcc1762b626f8b202 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784189127.127477:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf4693f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458098816:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1784189127.127513:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784189127.127545:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dbf42629900 going to sleep for 11 seconds 00000100:00100000:1.0:1784189127.127560:0:88973:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458098816 00000100:00100000:1.0:1784189127.127564:0:88973:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458098816 00000100:00100000:1.0:1784189127.127588:0:88973:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1784189127.127594:0:88973:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc075390050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:bd553d0d-03e2-4233-b06b-b55bbfa2b954+16:6510:x1870854458098816:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1784189127.127705:0:88973:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc075390050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:bd553d0d-03e2-4233-b06b-b55bbfa2b954+16:6510:x1870854458098816:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 110us (190us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189127.127712:0:88973:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1784189127.128354:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf4693f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458098816:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1784189127.128393:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc075aa1c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458098944:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1784189127.128444:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784189127.128464:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dbf4457bb40 going to sleep for 11 seconds 00000100:00100000:3.0:1784189127.128574:0:88969:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458098944 00000100:00100000:3.0:1784189127.128590:0:88969:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458098944 00000100:00100000:3.0:1784189127.128629:0:88969:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1784189127.128636:0:88969:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf423b4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd553d0d-03e2-4233-b06b-b55bbfa2b954+16:6510:x1870854458098944:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1784189127.128735:0:88969:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf423b4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd553d0d-03e2-4233-b06b-b55bbfa2b954+16:6510:x1870854458098944:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 98us (290us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189127.128744:0:88969:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1784189127.128763:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc075aa1c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458098944:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1784189127.129770:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000040:00080000:2.0:1784189127.129846:0:89059:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:3.0:1784189127.130635:0:6510:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:3.0:1784189127.130662:0:6510:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1784189127.130672:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff9dc0565e7c00/0xcc1762b626f8b1fb lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc1762b626f8b202 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189127.130684:0:6510:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: ffff9dc0565e7c00/0xcc1762b626f8b1fb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc1762b626f8b202 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784189127.130694:0:6510:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1784189127.130697:0:6510:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9dbf425f7000 from 52 10000000:01000000:3.0:1784189127.130700:0:6510:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1784189127.130737:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff9dc05ec0c200/0xcc1762b626f8b209 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189127.130745:0:6510:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: ffff9dc05ec0c200/0xcc1762b626f8b209 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189127.130755:0:6510:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: ffff9dc05ec0c200/0xcc1762b626f8b209 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784189127.130785:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf46435180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458099072:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1784189127.130831:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784189127.134083:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dbf44cb6f00 going to sleep for 11 seconds 00000100:00100000:0.0:1784189127.135916:0:88967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436261376 00000100:00100000:0.0:1784189127.135929:0:88967:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436261376 00000100:00100000:0.0:1784189127.136034:0:88967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458099072 00000100:00100000:0.0:1784189127.136037:0:88967:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458099072 00000100:00100000:3.0:1784189127.137983:0:88969:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 46 00000100:00100000:3.0:1784189127.138112:0:88969:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf423b7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9957a2dc-fd88-4a91-bca3-e2b7f365ab0c+8:42415:x1870854436261376:12345-192.168.203.12@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784189127.138130:0:88969:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784189127.138150:0:88969:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dc05ec0c600/0xcc1762b626f8b210 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xcbfc5de7fe6c3dbc expref: -99 pid: 88969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189127.138181:0:88969:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dc05ec0c600/0xcc1762b626f8b210 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c3dbc expref: 9 pid: 88969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189127.138192:0:88969:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dc05ec0c600/0xcc1762b626f8b210 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c3dbc expref: 9 pid: 88969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189127.138200:0:88969:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc05ec0c600, rc 0) 00000100:00100000:3.0:1784189127.138333:0:88969:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf423b7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9957a2dc-fd88-4a91-bca3-e2b7f365ab0c+9:42415:x1870854436261376:12345-192.168.203.12@tcp:101:ll_cfg_requeue.0 Request processed in 322us (8549us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189127.138341:0:88968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1784189127.138353:0:88969:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 46 00000100:00100000:2.0:1784189127.138357:0:88968:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc071b3f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd553d0d-03e2-4233-b06b-b55bbfa2b954+16:6510:x1870854458099072:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1784189127.138367:0:88968:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784189127.138379:0:88968:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dc0755a4400/0xcc1762b626f8b217 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xcc1762b626f8b209 expref: -99 pid: 88968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189127.138396:0:88968:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dc0755a4400/0xcc1762b626f8b217 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcc1762b626f8b209 expref: 17 pid: 88968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189127.138406:0:88968:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dc0755a4400/0xcc1762b626f8b217 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcc1762b626f8b209 expref: 17 pid: 88968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189127.138413:0:88968:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc0755a4400, rc 0) 00000100:00100000:2.0:1784189127.138477:0:88968:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc071b3f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd553d0d-03e2-4233-b06b-b55bbfa2b954+17:6510:x1870854458099072:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 126us (7645us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189127.138512:0:88968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1784189127.138553:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf46435180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458099072:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784189127.138634:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: ffff9dc05ec0c200/0xcc1762b626f8b209 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc1762b626f8b217 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189127.138644:0:6510:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: ffff9dc05ec0c200/0xcc1762b626f8b209 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xcc1762b626f8b217 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784189127.138828:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf46435180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458099200:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784189127.138859:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784189127.138903:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dbf44cb6f00 going to sleep for 11 seconds 00000100:00100000:2.0:1784189127.139119:0:88973:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458099200 00000100:00100000:2.0:1784189127.139125:0:88973:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458099200 00000100:00100000:2.0:1784189127.139162:0:88973:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1784189127.139168:0:88973:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc071b3ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:bd553d0d-03e2-4233-b06b-b55bbfa2b954+17:6510:x1870854458099200:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1784189127.139271:0:88973:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc071b3ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:bd553d0d-03e2-4233-b06b-b55bbfa2b954+17:6510:x1870854458099200:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 102us (411us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189127.139278:0:88973:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1784189127.139357:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf46435180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458099200:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784189127.139386:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf46435180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458099328:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1784189127.139424:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784189127.143365:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dbf44cb6f00 going to sleep for 11 seconds 00000100:00100000:1.0:1784189127.143538:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1784189127.146823:0:88967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458099328 00000100:00100000:0.0:1784189127.146837:0:88967:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458099328 00000100:00100000:2.0:1784189127.146935:0:88968:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436261504 00000100:00100000:2.0:1784189127.146941:0:88968:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436261504 00000100:00100000:1.0:1784189127.146990:0:88969:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1784189127.147016:0:88969:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc071b3fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd553d0d-03e2-4233-b06b-b55bbfa2b954+17:6510:x1870854458099328:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1784189127.147203:0:88967:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 50 00000100:00100000:0.0:1784189127.147212:0:88967:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc071b3f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9957a2dc-fd88-4a91-bca3-e2b7f365ab0c+9:42415:x1870854436261504:12345-192.168.203.12@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1784189127.147387:0:88967:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc071b3f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9957a2dc-fd88-4a91-bca3-e2b7f365ab0c+9:42415:x1870854436261504:12345-192.168.203.12@tcp:501:ll_cfg_requeue.0 Request processed in 175us (3852us total) trans 0 rc 0/0 00000100:00100000:0.0:1784189127.147396:0:88967:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 50 00000100:00100000:1.0:1784189127.147757:0:88969:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc071b3fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd553d0d-03e2-4233-b06b-b55bbfa2b954+17:6510:x1870854458099328:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 756us (8331us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189127.147765:0:88969:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1784189127.147850:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf46435180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458099328:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1784189127.148731:0:89060:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 51 00000020:01000000:0.0:1784189127.149033:0:6510:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 52-51 (rc=0) 10000000:01000000:0.0:1784189127.149059:0:6510:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1784189127.149069:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff9dc05ec0c200/0xcc1762b626f8b209 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc1762b626f8b217 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189127.149080:0:6510:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: ffff9dc05ec0c200/0xcc1762b626f8b209 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc1762b626f8b217 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784189127.149102:0:6510:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:0.0:1784189127.149105:0:6510:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 11 10000000:01000000:0.0:1784189127.149107:0:6510:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:0.0:1784189127.149161:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff9dbf4369c200/0xcc1762b626f8b21e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189127.149169:0:6510:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: ffff9dbf4369c200/0xcc1762b626f8b21e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189127.149178:0:6510:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: ffff9dbf4369c200/0xcc1762b626f8b21e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784189127.149199:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc04a64ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458099456:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1784189127.149252:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784189127.149351:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dc0749d5540 going to sleep for 11 seconds 00000100:00100000:2.0:1784189127.152117:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1784189127.153256:0:88969:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458099456 00000100:00100000:1.0:1784189127.153268:0:88969:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458099456 00000100:00100000:1.0:1784189127.153377:0:88969:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436261632 00000100:00100000:1.0:1784189127.153381:0:88969:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436261632 00000100:00100000:0.0:1784189127.153613:0:88968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1784189127.153625:0:88968:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc071b3c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd553d0d-03e2-4233-b06b-b55bbfa2b954+17:6510:x1870854458099456:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784189127.153642:0:88968:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784189127.153660:0:88968:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dbf4369ca00/0xcc1762b626f8b225 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xcc1762b626f8b21e expref: -99 pid: 88968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189127.153685:0:88968:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dbf4369ca00/0xcc1762b626f8b225 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcc1762b626f8b21e expref: 18 pid: 88968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189127.153697:0:88968:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dbf4369ca00/0xcc1762b626f8b225 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcc1762b626f8b21e expref: 18 pid: 88968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189127.153704:0:88968:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dbf4369ca00, rc 0) 00000100:00100000:0.0:1784189127.153876:0:88968:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc071b3c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd553d0d-03e2-4233-b06b-b55bbfa2b954+18:6510:x1870854458099456:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 253us (4622us total) trans 0 rc 0/0 00000100:00100000:0.0:1784189127.153884:0:88968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1784189127.153920:0:88968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 52 00000100:00100000:0.0:1784189127.153928:0:88968:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc07b22d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9957a2dc-fd88-4a91-bca3-e2b7f365ab0c+9:42415:x1870854436261632:12345-192.168.203.12@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1784189127.154035:0:88968:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc07b22d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9957a2dc-fd88-4a91-bca3-e2b7f365ab0c+9:42415:x1870854436261632:12345-192.168.203.12@tcp:503:ll_cfg_requeue.0 Request processed in 107us (1926us total) trans 0 rc 0/0 00000100:00100000:0.0:1784189127.154043:0:88968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 52 00000100:00100000:3.0:1784189127.154252:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc04a64ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458099456:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784189127.154270:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: ffff9dbf4369c200/0xcc1762b626f8b21e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc1762b626f8b225 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189127.154281:0:6510:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: ffff9dbf4369c200/0xcc1762b626f8b21e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xcc1762b626f8b225 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784189127.154382:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf46435180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458099584:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784189127.154417:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784189127.154832:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dbf44cb6540 going to sleep for 11 seconds 00000100:00100000:2.0:1784189127.154906:0:88973:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458099584 00000100:00100000:2.0:1784189127.154912:0:88973:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458099584 00000100:00100000:2.0:1784189127.154955:0:88973:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1784189127.154963:0:88973:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc07b22d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:bd553d0d-03e2-4233-b06b-b55bbfa2b954+18:6510:x1870854458099584:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1784189127.155091:0:88973:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc07b22d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:bd553d0d-03e2-4233-b06b-b55bbfa2b954+18:6510:x1870854458099584:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 129us (673us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189127.155098:0:88973:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1784189127.156178:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf46435180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458099584:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784189127.156229:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf46435180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458099712:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1784189127.156290:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784189127.156343:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dbf44cb6540 going to sleep for 11 seconds 00000100:00100000:1.0:1784189127.156423:0:88969:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458099712 00000100:00100000:1.0:1784189127.156428:0:88969:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458099712 00000100:00100000:1.0:1784189127.156456:0:88969:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1784189127.156464:0:88969:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc07b22e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd553d0d-03e2-4233-b06b-b55bbfa2b954+18:6510:x1870854458099712:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1784189127.157312:0:88969:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc07b22e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd553d0d-03e2-4233-b06b-b55bbfa2b954+18:6510:x1870854458099712:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 846us (1019us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189127.157364:0:88969:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1784189127.157558:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf46435180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458099712:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1784189127.159080:0:89061:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 64768 count 11 00000020:01000000:1.0:1784189127.167239:0:6510:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 11-10 (rc=0) 10000000:01000000:1.0:1784189127.167278:0:6510:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:1.0:1784189127.167290:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff9dbf4369c200/0xcc1762b626f8b21e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc1762b626f8b225 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189127.167332:0:6510:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: ffff9dbf4369c200/0xcc1762b626f8b21e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc1762b626f8b225 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784189127.167343:0:6510:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1784189127.167345:0:6510:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9dbf425f7000 from 7 10000000:01000000:1.0:1784189127.167348:0:6510:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1784189127.167383:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff9dc0565e6c00/0xcc1762b626f8b22c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189127.167391:0:6510:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: ffff9dc0565e6c00/0xcc1762b626f8b22c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189127.167401:0:6510:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: ffff9dc0565e6c00/0xcc1762b626f8b22c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784189127.167423:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf4693f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458099840:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1784189127.167482:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784189127.167530:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dbf42629900 going to sleep for 11 seconds 00000100:00100000:3.0:1784189127.167600:0:88967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458099840 00000100:00100000:3.0:1784189127.167607:0:88967:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458099840 00000100:00100000:3.0:1784189127.167652:0:88967:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1784189127.167660:0:88967:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc07b22f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd553d0d-03e2-4233-b06b-b55bbfa2b954+18:6510:x1870854458099840:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784189127.167671:0:88967:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784189127.167684:0:88967:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dc05ec0c000/0xcc1762b626f8b233 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xcc1762b626f8b22c expref: -99 pid: 88967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189127.167705:0:88967:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dc05ec0c000/0xcc1762b626f8b233 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcc1762b626f8b22c expref: 19 pid: 88967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189127.167715:0:88967:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dc05ec0c000/0xcc1762b626f8b233 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcc1762b626f8b22c expref: 19 pid: 88967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189127.167724:0:88967:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc05ec0c000, rc 0) 00000100:00100000:3.0:1784189127.167771:0:88967:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc07b22f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd553d0d-03e2-4233-b06b-b55bbfa2b954+19:6510:x1870854458099840:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 110us (287us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189127.167777:0:88967:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1784189127.167899:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf4693f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458099840:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784189127.167913:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: ffff9dc0565e6c00/0xcc1762b626f8b22c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc1762b626f8b233 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189127.167922:0:6510:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: ffff9dc0565e6c00/0xcc1762b626f8b22c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xcc1762b626f8b233 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784189127.167976:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf4693f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458099968:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1784189127.168001:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784189127.168036:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dbf42629900 going to sleep for 11 seconds 00000100:00100000:2.0:1784189127.168076:0:88969:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458099968 00000100:00100000:2.0:1784189127.168081:0:88969:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458099968 00000100:00100000:2.0:1784189127.168117:0:88969:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1784189127.168125:0:88969:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf46d2ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd553d0d-03e2-4233-b06b-b55bbfa2b954+19:6510:x1870854458099968:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1784189127.168243:0:88969:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf46d2ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd553d0d-03e2-4233-b06b-b55bbfa2b954+19:6510:x1870854458099968:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 118us (240us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189127.168250:0:88969:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1784189127.168341:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf4693f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458099968:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784189127.168370:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf46435180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458100096:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1784189127.168409:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784189127.168424:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dbf44cb6180 going to sleep for 11 seconds 00000100:00100000:1.0:1784189127.168708:0:88968:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458100096 00000100:00100000:1.0:1784189127.168713:0:88968:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458100096 00000100:00100000:1.0:1784189127.168748:0:88968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1784189127.168755:0:88968:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc06b882050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd553d0d-03e2-4233-b06b-b55bbfa2b954+19:6510:x1870854458100096:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1784189127.168845:0:88968:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc06b882050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd553d0d-03e2-4233-b06b-b55bbfa2b954+19:6510:x1870854458100096:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 90us (435us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189127.168852:0:88968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1784189127.168968:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf46435180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458100096:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1784189127.169929:0:89062:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:1.0:1784189127.170076:0:6510:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:1.0:1784189127.170112:0:6510:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1784189127.170121:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff9dc0565e6c00/0xcc1762b626f8b22c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc1762b626f8b233 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189127.170131:0:6510:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: ffff9dc0565e6c00/0xcc1762b626f8b22c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc1762b626f8b233 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784189127.170139:0:6510:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1784189127.170142:0:6510:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9dc07b5d6800 from 52 10000000:01000000:1.0:1784189127.170144:0:6510:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1784189127.170180:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff9dc0565e7400/0xcc1762b626f8b23a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189127.170188:0:6510:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: ffff9dc0565e7400/0xcc1762b626f8b23a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189127.170198:0:6510:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: ffff9dc0565e7400/0xcc1762b626f8b23a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784189127.170216:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf4693c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458100224:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1784189127.170267:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784189127.170309:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dc0429cfe40 going to sleep for 11 seconds 00000100:00100000:2.0:1784189127.170393:0:88969:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458100224 00000100:00100000:2.0:1784189127.170400:0:88969:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458100224 00000100:00100000:2.0:1784189127.170446:0:88969:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1784189127.170454:0:88969:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc052943450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd553d0d-03e2-4233-b06b-b55bbfa2b954+19:6510:x1870854458100224:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1784189127.170464:0:88969:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784189127.170476:0:88969:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dc0755a4c00/0xcc1762b626f8b241 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xcc1762b626f8b23a expref: -99 pid: 88969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189127.170509:0:88969:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dc0755a4c00/0xcc1762b626f8b241 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcc1762b626f8b23a expref: 20 pid: 88969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189127.170520:0:88969:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dc0755a4c00/0xcc1762b626f8b241 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcc1762b626f8b23a expref: 20 pid: 88969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189127.170529:0:88969:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc0755a4c00, rc 0) 00000100:00100000:2.0:1784189127.170568:0:88969:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc052943450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd553d0d-03e2-4233-b06b-b55bbfa2b954+20:6510:x1870854458100224:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 115us (301us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189127.170579:0:88969:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1784189127.170974:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf4693c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458100224:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784189127.170988:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: ffff9dc0565e7400/0xcc1762b626f8b23a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc1762b626f8b241 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189127.170998:0:6510:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: ffff9dc0565e7400/0xcc1762b626f8b23a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xcc1762b626f8b241 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784189127.171054:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf4693c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458100352:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1784189127.171083:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784189127.171110:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dc0429cfe40 going to sleep for 11 seconds 00000100:00100000:1.0:1784189127.171124:0:88968:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458100352 00000100:00100000:1.0:1784189127.171128:0:88968:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458100352 00000100:00100000:1.0:1784189127.171157:0:88968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1784189127.171164:0:88968:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc07b5c0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd553d0d-03e2-4233-b06b-b55bbfa2b954+20:6510:x1870854458100352:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1784189127.172112:0:88968:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc07b5c0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd553d0d-03e2-4233-b06b-b55bbfa2b954+20:6510:x1870854458100352:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 943us (1022us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189127.172123:0:88968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1784189127.172412:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1784189127.172586:0:88969:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436261760 00000100:00100000:2.0:1784189127.172590:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf4693c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458100352:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1784189127.172593:0:88969:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436261760 00000100:00100000:1.0:1784189127.172691:0:88969:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 60 00000100:00100000:1.0:1784189127.172701:0:88969:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc05f284850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9957a2dc-fd88-4a91-bca3-e2b7f365ab0c+9:42415:x1870854436261760:12345-192.168.203.12@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784189127.172713:0:88969:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784189127.172730:0:88969:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dc0565e7a00/0xcc1762b626f8b248 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xcbfc5de7fe6c3dc3 expref: -99 pid: 88969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189127.172753:0:88969:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dc0565e7a00/0xcc1762b626f8b248 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c3dc3 expref: 10 pid: 88969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784189127.172775:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc075aa1c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458100480:0@lo:503:ll_cfg_requeue.0 00010000:00010000:1.0:1784189127.172781:0:88969:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dc0565e7a00/0xcc1762b626f8b248 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c3dc3 expref: 10 pid: 88969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189127.172791:0:88969:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc0565e7a00, rc 0) 00000100:00100000:2.0:1784189127.172839:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784189127.172846:0:88969:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc05f284850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9957a2dc-fd88-4a91-bca3-e2b7f365ab0c+10:42415:x1870854436261760:12345-192.168.203.12@tcp:101:ll_cfg_requeue.0 Request processed in 146us (435us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189127.172858:0:88969:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 60 00000100:00100000:2.0:1784189127.174081:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dc0429cfe40 going to sleep for 11 seconds 00000100:00100000:1.0:1784189127.174253:0:88969:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458100480 00000100:00100000:1.0:1784189127.174260:0:88969:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458100480 00000100:00100000:1.0:1784189127.174300:0:88969:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1784189127.174307:0:88969:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc05f284450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd553d0d-03e2-4233-b06b-b55bbfa2b954+20:6510:x1870854458100480:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1784189127.174426:0:88969:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc05f284450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd553d0d-03e2-4233-b06b-b55bbfa2b954+20:6510:x1870854458100480:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 119us (1587us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189127.174433:0:88969:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1784189127.174538:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc075aa1c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458100480:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1784189127.175971:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000040:00080000:2.0:1784189127.175998:0:89063:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 51 00000020:01000000:2.0:1784189127.176053:0:6510:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 52-51 (rc=0) 10000000:01000000:2.0:1784189127.176075:0:6510:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1784189127.176085:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff9dc0565e7400/0xcc1762b626f8b23a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc1762b626f8b241 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189127.176101:0:6510:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: ffff9dc0565e7400/0xcc1762b626f8b23a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc1762b626f8b241 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784189127.176108:0:88967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436261888 10000000:01000000:2.0:1784189127.176110:0:6510:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:2.0:1784189127.176113:0:6510:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 14 00000100:00100000:3.0:1784189127.176114:0:88967:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436261888 10000000:01000000:2.0:1784189127.176115:0:6510:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00000100:00100000:3.0:1784189127.176147:0:88967:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 62 00000100:00100000:3.0:1784189127.176155:0:88967:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc05f287c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9957a2dc-fd88-4a91-bca3-e2b7f365ab0c+10:42415:x1870854436261888:12345-192.168.203.12@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784189127.176250:0:88967:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc05f287c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9957a2dc-fd88-4a91-bca3-e2b7f365ab0c+10:42415:x1870854436261888:12345-192.168.203.12@tcp:501:ll_cfg_requeue.0 Request processed in 94us (282us total) trans 0 rc -2/-2 00000100:00100000:3.0:1784189127.176258:0:88967:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 62 00010000:00010000:2.0:1784189127.176658:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff9dc0755a4800/0xcc1762b626f8b24f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189127.176669:0:6510:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: ffff9dc0755a4800/0xcc1762b626f8b24f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189127.176742:0:6510:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: ffff9dc0755a4800/0xcc1762b626f8b24f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784189127.176764:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc075aa1c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458100608:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1784189127.176800:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784189127.176833:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dc0429cfe40 going to sleep for 11 seconds 00000100:00100000:0.0:1784189127.177107:0:88968:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458100608 00000100:00100000:0.0:1784189127.177113:0:88968:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458100608 00000100:00100000:0.0:1784189127.177221:0:88968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1784189127.177231:0:88968:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc049313450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd553d0d-03e2-4233-b06b-b55bbfa2b954+20:6510:x1870854458100608:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784189127.177241:0:88968:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784189127.177255:0:88968:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dbf4369de00/0xcc1762b626f8b256 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xcc1762b626f8b24f expref: -99 pid: 88968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189127.177380:0:88968:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dbf4369de00/0xcc1762b626f8b256 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcc1762b626f8b24f expref: 21 pid: 88968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189127.177391:0:88968:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dbf4369de00/0xcc1762b626f8b256 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcc1762b626f8b24f expref: 21 pid: 88968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189127.177400:0:88968:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dbf4369de00, rc 0) 00000100:00100000:0.0:1784189127.177439:0:88968:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc049313450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd553d0d-03e2-4233-b06b-b55bbfa2b954+21:6510:x1870854458100608:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 211us (638us total) trans 0 rc 0/0 00000100:00100000:0.0:1784189127.177446:0:88968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1784189127.177466:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc075aa1c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458100608:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1784189127.177481:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: ffff9dc0755a4800/0xcc1762b626f8b24f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc1762b626f8b256 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189127.177501:0:6510:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: ffff9dc0755a4800/0xcc1762b626f8b24f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0xcc1762b626f8b256 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784189127.177558:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc075aa1c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458100736:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1784189127.177662:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784189127.177782:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dc0429cfe40 going to sleep for 11 seconds 00000100:00100000:3.0:1784189127.177822:0:88967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458100736 00000100:00100000:3.0:1784189127.177827:0:88967:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458100736 00000100:00100000:2.0:1784189127.178759:0:88973:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1784189127.178915:0:88973:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc07037e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:bd553d0d-03e2-4233-b06b-b55bbfa2b954+21:6510:x1870854458100736:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1784189127.179071:0:88973:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc07037e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:bd553d0d-03e2-4233-b06b-b55bbfa2b954+21:6510:x1870854458100736:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 163us (1408us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189127.179078:0:88973:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1784189127.179235:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc075aa1c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458100736:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784189127.179276:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf46435180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458100864:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1784189127.179400:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784189127.179530:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dbf44cb66c0 going to sleep for 11 seconds 00000100:00100000:1.0:1784189127.179707:0:88969:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458100864 00000100:00100000:1.0:1784189127.179713:0:88969:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458100864 00000100:00100000:1.0:1784189127.179789:0:88969:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1784189127.179797:0:88969:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc07037f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd553d0d-03e2-4233-b06b-b55bbfa2b954+21:6510:x1870854458100864:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1784189127.180835:0:88969:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc07037f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd553d0d-03e2-4233-b06b-b55bbfa2b954+21:6510:x1870854458100864:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 1036us (1431us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189127.180845:0:88969:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1784189127.180865:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf46435180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458100864:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1784189127.181963:0:89064:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 64768 count 14 00000020:01000000:2.0:1784189127.182188:0:6510:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 14-13 (rc=0) 10000000:01000000:2.0:1784189127.182212:0:6510:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:2.0:1784189127.182223:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff9dc0755a4800/0xcc1762b626f8b24f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc1762b626f8b256 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189127.182235:0:6510:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: ffff9dc0755a4800/0xcc1762b626f8b24f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc1762b626f8b256 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784189127.182244:0:6510:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1784189127.182247:0:6510:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9dc07b5d6800 from 7 10000000:01000000:2.0:1784189127.182249:0:6510:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1784189127.182351:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff9dc0755a5000/0xcc1762b626f8b25d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189127.182361:0:6510:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: ffff9dc0755a5000/0xcc1762b626f8b25d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189127.182371:0:6510:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: ffff9dc0755a5000/0xcc1762b626f8b25d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784189127.182395:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc075aa2d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458100992:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1784189127.182541:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784189127.182574:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dc0715a39c0 going to sleep for 11 seconds 00000100:00100000:0.0:1784189127.185986:0:88967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458100992 00000100:00100000:0.0:1784189127.186002:0:88967:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458100992 00000100:00100000:0.0:1784189127.186135:0:88967:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1784189127.186146:0:88967:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf453af050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd553d0d-03e2-4233-b06b-b55bbfa2b954+21:6510:x1870854458100992:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784189127.186163:0:88967:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784189127.186181:0:88967:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dbf4369dc00/0xcc1762b626f8b264 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xcc1762b626f8b25d expref: -99 pid: 88967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189127.186207:0:88967:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dbf4369dc00/0xcc1762b626f8b264 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcc1762b626f8b25d expref: 22 pid: 88967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189127.186219:0:88967:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dbf4369dc00/0xcc1762b626f8b264 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcc1762b626f8b25d expref: 22 pid: 88967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189127.186228:0:88967:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dbf4369dc00, rc 0) 00000100:00100000:0.0:1784189127.186306:0:88967:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf453af050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd553d0d-03e2-4233-b06b-b55bbfa2b954+22:6510:x1870854458100992:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 161us (3846us total) trans 0 rc 0/0 00000100:00100000:0.0:1784189127.186315:0:88967:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1784189127.186370:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc075aa2d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458100992:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1784189127.186392:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: ffff9dc0755a5000/0xcc1762b626f8b25d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc1762b626f8b264 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189127.186403:0:6510:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: ffff9dc0755a5000/0xcc1762b626f8b25d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xcc1762b626f8b264 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784189127.186594:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc075aa2d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458101120:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1784189127.186627:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784189127.186668:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dc0715a39c0 going to sleep for 11 seconds 00000100:00100000:0.0:1784189127.186687:0:88968:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458101120 00000100:00100000:0.0:1784189127.186692:0:88968:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458101120 00000100:00100000:0.0:1784189127.186774:0:88968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1784189127.186782:0:88968:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc06b028450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd553d0d-03e2-4233-b06b-b55bbfa2b954+22:6510:x1870854458101120:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1784189127.186905:0:88968:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc06b028450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd553d0d-03e2-4233-b06b-b55bbfa2b954+22:6510:x1870854458101120:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 124us (277us total) trans 0 rc 0/0 00000100:00100000:0.0:1784189127.186912:0:88968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1784189127.186963:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc075aa2d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458101120:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1784189127.186991:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc075aa2d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458101248:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1784189127.187032:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784189127.190100:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dc0715a39c0 going to sleep for 11 seconds 00000100:00100000:1.0:1784189127.191408:0:88969:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458101248 00000100:00100000:1.0:1784189127.191418:0:88969:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458101248 00000100:00100000:1.0:1784189127.191479:0:88969:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1784189127.191603:0:88969:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf453afc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd553d0d-03e2-4233-b06b-b55bbfa2b954+22:6510:x1870854458101248:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1784189127.191977:0:88969:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf453afc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd553d0d-03e2-4233-b06b-b55bbfa2b954+22:6510:x1870854458101248:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 488us (4942us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189127.191986:0:88969:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1784189127.192171:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc075aa2d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458101248:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1784189127.194064:0:89065:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:3.0:1784189127.194304:0:6510:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:3.0:1784189127.194348:0:6510:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1784189127.194359:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff9dc0755a5000/0xcc1762b626f8b25d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc1762b626f8b264 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189127.194370:0:6510:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: ffff9dc0755a5000/0xcc1762b626f8b25d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc1762b626f8b264 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784189127.194379:0:6510:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:3.0:1784189127.194381:0:6510:0:(mgc_request.c:1801:mgc_process_log()) Process log nodemap-ffff9dc06bb30000 from 1 10000000:01000000:3.0:1784189127.194394:0:6510:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:3.0:1784189127.194429:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff9dc05ec0ce00/0xcc1762b626f8b26b lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189127.194448:0:6510:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: ffff9dc05ec0ce00/0xcc1762b626f8b26b lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189127.194464:0:6510:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: ffff9dc05ec0ce00/0xcc1762b626f8b26b lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784189127.194496:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf46435180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458101376:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1784189127.194554:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784189127.194599:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dbf44cb6180 going to sleep for 11 seconds 00000100:00100000:0.0:1784189127.195689:0:88973:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458101376 00000100:00100000:0.0:1784189127.195699:0:88973:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458101376 00000100:00100000:0.0:1784189127.195749:0:88973:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1784189127.195763:0:88973:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc06b02b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:bd553d0d-03e2-4233-b06b-b55bbfa2b954+22:6510:x1870854458101376:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784189127.195776:0:88973:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784189127.195790:0:88973:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dbf4369cc00/0xcc1762b626f8b272 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xcc1762b626f8b26b expref: -99 pid: 88973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189127.195812:0:88973:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dbf4369cc00/0xcc1762b626f8b272 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcc1762b626f8b26b expref: 23 pid: 88973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189127.195821:0:88973:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dbf4369cc00/0xcc1762b626f8b272 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcc1762b626f8b26b expref: 23 pid: 88973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189127.195830:0:88973:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dbf4369cc00, rc 0) 00000100:00100000:0.0:1784189127.195894:0:88973:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc06b02b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:bd553d0d-03e2-4233-b06b-b55bbfa2b954+23:6510:x1870854458101376:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 132us (1339us total) trans 0 rc 0/0 00000100:00100000:0.0:1784189127.195900:0:88973:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1784189127.195944:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf46435180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458101376:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784189127.195959:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: ffff9dc05ec0ce00/0xcc1762b626f8b26b lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc1762b626f8b272 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189127.195968:0:6510:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: ffff9dc05ec0ce00/0xcc1762b626f8b26b lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcc1762b626f8b272 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784189127.195984:0:6510:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:0.0:1784189127.195988:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff9dc05ec0ce00/0xcc1762b626f8b26b lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc1762b626f8b272 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189127.195995:0:6510:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: ffff9dc05ec0ce00/0xcc1762b626f8b26b lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc1762b626f8b272 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784189127.196011:0:6510:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:0.0:1784189127.196014:0:6510:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-sptlrpc-ffff9dc06bb30000 from 1 10000000:01000000:0.0:1784189127.196016:0:6510:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1784189127.196034:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff9dbf4369d600/0xcc1762b626f8b279 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189127.196041:0:6510:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: ffff9dbf4369d600/0xcc1762b626f8b279 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189127.196048:0:6510:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: ffff9dbf4369d600/0xcc1762b626f8b279 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784189127.196062:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc04a64f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458101504:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1784189127.196087:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784189127.196106:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dc0713f2a80 going to sleep for 11 seconds 00000100:00100000:3.0:1784189127.196566:0:88967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458101504 00000100:00100000:3.0:1784189127.196572:0:88967:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458101504 00000100:00100000:3.0:1784189127.196736:0:88967:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1784189127.196744:0:88967:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc06b02ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd553d0d-03e2-4233-b06b-b55bbfa2b954+23:6510:x1870854458101504:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784189127.196753:0:88967:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784189127.196763:0:88967:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dc05ec0da00/0xcc1762b626f8b280 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0xcc1762b626f8b279 expref: -99 pid: 88967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189127.196777:0:88967:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dc05ec0da00/0xcc1762b626f8b280 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcc1762b626f8b279 expref: 24 pid: 88967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189127.196785:0:88967:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dc05ec0da00/0xcc1762b626f8b280 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcc1762b626f8b279 expref: 24 pid: 88967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189127.196792:0:88967:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc05ec0da00, rc 0) 00000100:00100000:3.0:1784189127.196832:0:88967:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc06b02ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd553d0d-03e2-4233-b06b-b55bbfa2b954+24:6510:x1870854458101504:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 88us (743us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189127.196846:0:88967:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1784189127.196855:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc04a64f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458101504:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1784189127.196867:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: ffff9dbf4369d600/0xcc1762b626f8b279 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc1762b626f8b280 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189127.196887:0:6510:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: ffff9dbf4369d600/0xcc1762b626f8b279 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0xcc1762b626f8b280 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784189127.196951:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc075aa3b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458101632:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1784189127.196982:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784189127.199677:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dc0715a3480 going to sleep for 11 seconds 00000100:00100000:1.0:1784189127.200237:0:88968:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458101632 00000100:00100000:1.0:1784189127.200246:0:88968:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458101632 00000100:00100000:1.0:1784189127.200309:0:88968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1784189127.200335:0:88968:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc06b028c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd553d0d-03e2-4233-b06b-b55bbfa2b954+24:6510:x1870854458101632:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1784189127.200447:0:88968:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc06b028c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd553d0d-03e2-4233-b06b-b55bbfa2b954+24:6510:x1870854458101632:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 130us (3463us total) trans 0 rc -2/-2 00000100:00100000:1.0:1784189127.200455:0:88968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1784189127.201443:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc075aa3b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458101632:0@lo:501:ll_cfg_requeue.0 10000000:01000000:2.0:1784189127.201551:0:6510:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1784189127.201571:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff9dbf4369d600/0xcc1762b626f8b279 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc1762b626f8b280 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189127.201582:0:6510:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: ffff9dbf4369d600/0xcc1762b626f8b279 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc1762b626f8b280 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189127.407452:0:7454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784189128.435816:0:26173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784189129.455507:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1784189129.842905:0:89247:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg312-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1784189130.484410:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1784189130.609799:0:89300:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1784189130.610332:0:89300:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:0.0:1784189130.799431:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc04a64f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1870854458101760:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1784189130.799509:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784189130.802061:0:9466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458101760 00000100:00100000:1.0:1784189130.802074:0:9466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458101760 00000100:00100000:1.0:1784189130.802131:0:9466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1926 00000100:00100000:1.0:1784189130.802140:0:9466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc04a64ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1870854458101760:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1784189130.802169:0:9466:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 212800 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1784189130.802244:0:9466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc04a64ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1870854458101760:12345-0@lo:13:osp-pre-0-1.0 Request processed in 104us (2734us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189130.802252:0:9466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1926 00000100:00080000:1.0:1784189130.802401:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1784189130.802446:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc04a64f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1870854458101760:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1784189130.803385:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc04a64f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1870854458101888:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1784189130.803435:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784189130.803500:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458101888 00000100:00100000:1.0:1784189130.803506:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458101888 00000100:00100000:1.0:1784189130.803542:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1927 00000100:00100000:1.0:1784189130.803549:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf4693c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1870854458101888:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1784189130.803573:0:8432:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 212800 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1784189130.803609:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf4693c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1870854458101888:12345-0@lo:13:osp-pre-1-1.0 Request processed in 60us (173us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189130.803615:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1927 00000100:00080000:1.0:1784189130.803633:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1784189130.803662:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc04a64f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1870854458101888:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1784189131.055668:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1784189131.055728:0:68287:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436262144 00000100:00100000:2.0:1784189131.055737:0:68287:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436262144 00000100:00100000:2.0:1784189131.055806:0:68287:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1121 00000100:00100000:2.0:1784189131.055818:0:68287:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc04a64d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+6:2397:x1870854436262144:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:0.0:1784189131.055866:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1784189131.055890:0:68287:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc04a64d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+6:2397:x1870854436262144:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 75us (231us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189131.055897:0:68287:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1121 00000100:00080000:1.0:1784189131.056130:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1784189131.056144:0:88968:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436262016 00000100:00100000:1.0:1784189131.056148:0:88968:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436262016 00000100:00100000:1.0:1784189131.056186:0:88968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 72 00000100:00100000:1.0:1784189131.056192:0:88968:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc06b02bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9957a2dc-fd88-4a91-bca3-e2b7f365ab0c+10:2397:x1870854436262016:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:1.0:1784189131.056224:0:88968:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc06b02bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9957a2dc-fd88-4a91-bca3-e2b7f365ab0c+10:2397:x1870854436262016:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 32us (358us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189131.056231:0:88968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 72 00000100:00100000:3.0:1784189131.311798:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1784189131.311824:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf46435180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1870854458102016:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1784189131.311891:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784189131.311948:0:26492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458102016 00000100:00100000:3.0:1784189131.311957:0:26492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458102016 00000100:00100000:3.0:1784189131.312007:0:26492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3772 00000100:00100000:3.0:1784189131.312015:0:26492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc07ab9ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3640:x1870854458102016:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1784189131.312127:0:26492:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445576704 avail 1299337216 00000100:00100000:3.0:1784189131.312175:0:26492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc07ab9ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3640:x1870854458102016:12345-0@lo:41:osp-pre-1-0.0 Request processed in 159us (284us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189131.312182:0:26492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3772 00000100:00100000:3.0:1784189131.312228:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf46435180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1870854458102016:0@lo:41:osp-pre-1-0.0 00000100:00080000:3.0:1784189131.315108:0:89010:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1784189131.315115:0:89010:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1784189131.315118:0:89010:0:(import.c:65:import_set_state_nolock()) ffff9dbf42271800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1784189131.315130:0:89010:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9dbf42271800 using connection 192.168.203.112@tcp/0@lo 00000100:00100000:3.0:1784189131.315153:0:89010:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9dbf44faea00 x1870854458102272/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1784189131.315176:0:89010:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1784189131.315179:0:89010:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1784189131.315180:0:89010:0:(import.c:65:import_set_state_nolock()) ffff9dbf425f4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1784189131.315185:0:89010:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9dbf425f4800 using connection 192.168.203.112@tcp/0@lo 00000100:00100000:3.0:1784189131.315196:0:89010:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9dc081f81880 x1870854458102528/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1784189131.315231:0:89010:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1784189131.315234:0:89010:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1784189131.315236:0:89010:0:(import.c:65:import_set_state_nolock()) ffff9dbf436c4000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1784189131.315240:0:89010:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9dbf436c4000 using connection 192.168.203.112@tcp/0@lo 00000100:00100000:3.0:1784189131.315252:0:89010:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9dc075f7c000 x1870854458102784/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1784189131.315259:0:89010:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1784189131.315262:0:89010:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1784189131.315263:0:89010:0:(import.c:65:import_set_state_nolock()) ffff9dbf43690800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1784189131.315267:0:89010:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff9dbf43690800 using connection 192.168.203.112@tcp/0@lo 00000100:00100000:3.0:1784189131.315278:0:89010:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9dc075f7f480 x1870854458102912/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1784189131.315300:0:89010:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1784189131.315303:0:89010:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1784189131.315304:0:89010:0:(import.c:65:import_set_state_nolock()) ffff9dc07118c000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1784189131.315308:0:89010:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff9dc07118c000 using connection 192.168.203.112@tcp/0@lo 00000100:00100000:3.0:1784189131.315340:0:89010:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9dc0505be300 x1870854458103296/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1784189131.315370:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf44fae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3643:1870854458102400:0@lo:400:kworker.0 00000100:00100000:3.0:1784189131.315431:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784189131.315481:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1784189131.315487:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf46435180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:bd553d0d-03e2-4233-b06b-b55bbfa2b954:3643:1870854458102144:0@lo:400:kworker.0 00000100:00100000:3.0:1784189131.315515:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784189131.315556:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc075f7c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1870854458103168:0@lo:400:kworker.0 00000100:00100000:3.0:1784189131.315599:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784189131.315625:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc075f7f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1870854458103040:0@lo:400:kworker.0 00000100:00100000:3.0:1784189131.315651:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784189131.315669:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1784189131.315674:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf48599c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3641:1870854458102656:0@lo:400:kworker.0 00000100:00100000:3.0:1784189131.315693:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784189131.315721:0:66170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458102400 00000100:00100000:3.0:1784189131.315728:0:66170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458102400 00000100:00100000:3.0:1784189131.315775:0:66170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458102656 00000100:00100000:3.0:1784189131.315779:0:66170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458102656 00000100:00100000:3.0:1784189131.315803:0:66170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1122 00000100:00100000:3.0:1784189131.315811:0:66170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc0477c2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1870854458102400:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784189131.315856:0:66170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc0477c2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1870854458102400:12345-0@lo:400:kworker.0 Request processed in 46us (424us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189131.315864:0:66170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1122 00000100:00100000:3.0:1784189131.315880:0:66170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1123 00000100:00100000:3.0:1784189131.315887:0:66170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc07b5e3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1870854458102656:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784189131.315918:0:66170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc07b5e3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1870854458102656:12345-0@lo:400:kworker.0 Request processed in 32us (224us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189131.315925:0:66170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1123 00000100:00100000:3.0:1784189131.315944:0:26167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458103168 00000100:00100000:3.0:1784189131.315947:0:26167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458103168 00000100:00100000:3.0:1784189131.315972:0:26167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458103040 00000100:00100000:3.0:1784189131.315975:0:26167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458103040 00000100:00100000:3.0:1784189131.315993:0:26167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2406 00000100:00100000:3.0:1784189131.315999:0:26167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc07b5e3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+6:3643:x1870854458103168:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784189131.316040:0:26167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc07b5e3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+6:3643:x1870854458103168:12345-0@lo:400:kworker.0 Request processed in 41us (440us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189131.316047:0:26167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2406 00000100:00100000:3.0:1784189131.316058:0:26167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2407 00000100:00100000:3.0:1784189131.316064:0:26167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc07b5e0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+6:3641:x1870854458103040:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784189131.316089:0:26167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc07b5e0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+6:3641:x1870854458103040:12345-0@lo:400:kworker.0 Request processed in 26us (438us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189131.316095:0:26167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2407 00000100:00080000:3.0:1784189131.316115:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1784189131.316119:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1784189131.316121:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1784189131.316155:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf48599c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3641:1870854458102656:0@lo:400:kworker.0 00000100:00100000:3.0:1784189131.316164:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc075f7f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1870854458103040:0@lo:400:kworker.0 00000100:00100000:3.0:1784189131.316191:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc075f7c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1870854458103168:0@lo:400:kworker.0 00000100:00100000:3.0:1784189131.316199:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf44fae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3643:1870854458102400:0@lo:400:kworker.0 00000100:00100000:3.0:1784189131.316228:0:88969:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458102144 00000100:00100000:3.0:1784189131.316231:0:88969:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458102144 00000100:00100000:3.0:1784189131.316252:0:88969:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1784189131.316257:0:88969:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc06b029850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd553d0d-03e2-4233-b06b-b55bbfa2b954+24:3643:x1870854458102144:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784189131.316287:0:88969:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc06b029850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd553d0d-03e2-4233-b06b-b55bbfa2b954+24:3643:x1870854458102144:12345-0@lo:400:kworker.0 Request processed in 29us (771us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189131.316293:0:88969:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1784189131.316343:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf46435180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:bd553d0d-03e2-4233-b06b-b55bbfa2b954:3643:1870854458102144:0@lo:400:kworker.0 00000100:00100000:2.0:1784189131.316688:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf44faea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3639:1870854458102272:0@lo:38:kworker.0 00000100:00100000:2.0:1784189131.316731:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784189131.316749:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc081f81880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3639:1870854458102528:0@lo:38:kworker.0 00000100:00100000:2.0:1784189131.316767:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784189131.316779:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc075f7c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3639:1870854458102784:0@lo:38:kworker.0 00000100:00100000:2.0:1784189131.316797:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784189131.316809:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc075f7f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3639:1870854458102912:0@lo:38:kworker.0 00000100:00100000:2.0:1784189131.316825:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784189131.316835:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc0505be300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3639:1870854458103296:0@lo:38:kworker.0 00000100:00100000:2.0:1784189131.316850:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784189131.316872:0:66169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458102272 00000100:00100000:2.0:1784189131.316882:0:66169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458102272 00000100:00100000:2.0:1784189131.316900:0:66169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458102528 00000100:00100000:2.0:1784189131.316902:0:66169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458102528 00000100:00100000:2.0:1784189131.316910:0:66169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458102912 00000100:00100000:2.0:1784189131.316912:0:66169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458102912 00000100:00100000:2.0:1784189131.316919:0:66169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458103296 00000100:00100000:2.0:1784189131.316921:0:66169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458103296 00000100:00100000:2.0:1784189131.316933:0:66169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1194 00000100:00100000:2.0:1784189131.316938:0:66169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc075aa3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3639:x1870854458102272:12345-0@lo:38:kworker.0 00010000:00080000:2.0:1784189131.316962:0:66169:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo recovering/t0 exp 0000000000000000 cur 3373 last 0 00000020:00000080:2.0:1784189131.316998:0:66169:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0xcc1762b626f8b287 00000004:00100000:2.0:1784189131.317013:0:66169:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1784189131.317137:0:66169:0:(import.c:65:import_set_state_nolock()) ffff9dc047a80000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1784189131.317172:0:66169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc075aa3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1870854458102272:12345-0@lo:38:kworker.0 Request processed in 232us (440us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189131.317179:0:66169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1194 00000100:00100000:2.0:1784189131.317193:0:66169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1195 00000100:00100000:2.0:1784189131.317196:0:66169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc075aa0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3639:x1870854458102528:12345-0@lo:38:kworker.0 00010000:00080000:2.0:1784189131.317208:0:66169:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo recovering/t0 exp 0000000000000000 cur 3373 last 0 00000020:00000080:2.0:1784189131.317227:0:66169:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0xcc1762b626f8b28e 00000004:00100000:2.0:1784189131.317232:0:66169:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1784189131.317244:0:66169:0:(import.c:65:import_set_state_nolock()) ffff9dc047a84000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1784189131.317266:0:66169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc075aa0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3639:x1870854458102528:12345-0@lo:38:kworker.0 Request processed in 68us (498us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189131.317271:0:66169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1195 00000100:00100000:2.0:1784189131.317282:0:66169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1196 00000100:00100000:2.0:1784189131.317285:0:66169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc075aa1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3639:x1870854458102912:12345-0@lo:38:kworker.0 00010000:00080000:2.0:1784189131.317304:0:66169:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0001_UUID@0@lo recovering/t0 exp 0000000000000000 cur 3373 last 0 00000020:00000080:2.0:1784189131.317344:0:66169:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001_UUID, cookie 0xcc1762b626f8b295 00000004:00100000:2.0:1784189131.317350:0:66169:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1784189131.317361:0:66169:0:(import.c:65:import_set_state_nolock()) ffff9dc047a87800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1784189131.317384:0:66169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc075aa1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1870854458102912:12345-0@lo:38:kworker.0 Request processed in 97us (558us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189131.317390:0:66169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1196 00000100:00100000:2.0:1784189131.317402:0:66169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1197 00000100:00100000:2.0:1784189131.317405:0:66169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf43f58e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3639:x1870854458103296:12345-0@lo:38:kworker.0 00010000:00080000:2.0:1784189131.317415:0:66169:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo recovering/t0 exp 0000000000000000 cur 3373 last 0 00000020:00000080:2.0:1784189131.317433:0:66169:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0xcc1762b626f8b29c 00000004:00100000:2.0:1784189131.317437:0:66169:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1784189131.317447:0:66169:0:(import.c:65:import_set_state_nolock()) ffff9dc047a82000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1784189131.317483:0:66169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf43f58e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1870854458103296:12345-0@lo:38:kworker.0 Request processed in 76us (631us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189131.317488:0:66169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1197 00000100:00100000:2.0:1784189131.317506:0:23826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458102784 00000100:00100000:2.0:1784189131.317509:0:23826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458102784 00000100:00100000:2.0:1784189131.317527:0:23826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3773 00000100:00100000:2.0:1784189131.317531:0:23826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc075aa2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3639:x1870854458102784:12345-0@lo:38:kworker.0 00010000:00080000:2.0:1784189131.317543:0:23826:0:(ldlm_lib.c:938:target_handle_reconnect()) connect export for UUID 'lustre-MDT0001-mdtlov_UUID' at ffff9dbf43e9e000, cookie 0xcc1762b626f8b0f8 00010000:00080000:2.0:1784189131.317546:0:23826:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo recovering/t77309411356 exp ffff9dbf43e9e000 cur 3373 last 1784189125 00000004:00100000:2.0:1784189131.317554:0:23826:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1784189131.317565:0:23826:0:(import.c:65:import_set_state_nolock()) ffff9dc047a84800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1784189131.317739:0:23826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc075aa2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3639:x1870854458102784:12345-0@lo:38:kworker.0 Request processed in 206us (939us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189131.317750:0:23826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3773 00010000:00080000:2.0:1784189131.317782:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dbf44faea00 x1870854458102272/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1784189156 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1784189131.317795:0:3639:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 25 00010000:00080000:1.0:1784189131.318771:0:88996:0:(ldlm_lib.c:2545:check_for_recovery_ready()) connected 2 stale 0 max_recoverable_clients 2 abort 0 expired 0 00010000:00080000:1.0:1784189131.318778:0:88996:0:(ldlm_lib.c:2683:replay_request_or_update()) Waiting for transno 103079215111 00000020:00080000:1.0:1784189131.318785:0:88996:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1784189131.318790:0:88996:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 2, connected: 2, completed: 0, queue_len: 1, req_transno: 103079215111, next_transno: 103079215111 00010000:00080000:1.0:1784189131.318794:0:88996:0:(ldlm_lib.c:2246:check_for_next_transno()) waking for next (103079215111) 00000020:00080000:1.0:1784189131.318796:0:88996:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1784189131.318807:0:88996:0:(ldlm_lib.c:2747:replay_request_or_update()) @@@ processing x1870854436253824 t103079215111 from 192.168.203.12@tcp req@ffff9dc04a64e300 x1870854436253824/t0(103079215111) o36->b90fcc1c-0e69-42a4-a116-a71fec7aeb78@192.168.203.12@tcp:318/0 lens 528/0 e 0 to 0 dl 1784189138 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'mcreate.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1784189131.325262:0:3639:0:(import.c:1328:ptlrpc_connect_interpret()) @@@ lustre-MDT0000-lwp-OST0000: lwp recover req@ffff9dbf44faea00 x1870854458102272/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1784189156 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1784189131.325277:0:3639:0:(import.c:65:import_set_state_nolock()) ffff9dbf42271800 lustre-MDT0000_UUID: changing import state from CONNECTING to RECOVER 00000100:00080000:2.0:1784189131.325283:0:3639:0:(import.c:65:import_set_state_nolock()) ffff9dbf42271800 lustre-MDT0000_UUID: changing import state from RECOVER to FULL 00000100:02000000:2.0:1784189131.325288:0:3639:0:(import.c:1743:ptlrpc_import_recovery_state_machine()) lustre-MDT0000-lwp-OST0000: Connection restored to 0@lo (at 0@lo) 00000004:00080000:0.0:1784189131.327653:0:88996:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 8771us 00000100:00100000:2.0:1784189131.346354:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf44faea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3639:1870854458102272:0@lo:38:kworker.0 00010000:00080000:2.0:1784189131.346396:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dc081f81880 x1870854458102528/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1784189156 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1784189131.346413:0:3639:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 25 00000100:00080000:2.0:1784189131.349159:0:3639:0:(import.c:1328:ptlrpc_connect_interpret()) @@@ lustre-MDT0000-lwp-OST0001: lwp recover req@ffff9dc081f81880 x1870854458102528/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1784189156 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1784189131.349173:0:3639:0:(import.c:65:import_set_state_nolock()) ffff9dbf425f4800 lustre-MDT0000_UUID: changing import state from CONNECTING to RECOVER 00000100:00080000:2.0:1784189131.349178:0:3639:0:(import.c:65:import_set_state_nolock()) ffff9dbf425f4800 lustre-MDT0000_UUID: changing import state from RECOVER to FULL 00000100:02000000:2.0:1784189131.349183:0:3639:0:(import.c:1743:ptlrpc_import_recovery_state_machine()) lustre-MDT0000-lwp-OST0001: Connection restored to 0@lo (at 0@lo) 00000100:00100000:2.0:1784189131.349190:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc081f81880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3639:1870854458102528:0@lo:38:kworker.0 00000100:00080000:2.0:1784189131.349235:0:3639:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-osp-MDT0001: connect to target with instance 25 00000100:00080000:2.0:1784189131.349253:0:3639:0:(import.c:65:import_set_state_nolock()) ffff9dbf436c4000 lustre-MDT0000_UUID: changing import state from CONNECTING to REPLAY 00000100:00080000:2.0:1784189131.349258:0:3639:0:(import.c:1700:ptlrpc_import_recovery_state_machine()) replay requested by lustre-MDT0000_UUID 00000100:00100000:2.0:1784189131.349260:0:3639:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 81604378625 gen 3 00000100:00080000:2.0:1784189131.349272:0:3639:0:(recover.c:53:ptlrpc_replay_next()) import ffff9dbf436c4000 from lustre-MDT0000_UUID committed 81604378625 last 0 00000100:00080000:2.0:1784189131.349276:0:3639:0:(import.c:65:import_set_state_nolock()) ffff9dbf436c4000 lustre-MDT0000_UUID: changing import state from REPLAY to REPLAY_LOCKS 00000100:00100000:3.0:1784189131.351015:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc075f7c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3639:1870854458102784:0@lo:38:kworker.0 00010000:00080000:3.0:1784189131.351058:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dc075f7f480 x1870854458102912/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1784189156 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1784189131.351073:0:3639:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0001: connect to target with instance 25 00010000:00080000:1.0:1784189131.354036:0:89339:0:(ldlm_request.c:2972:ldlm_lock_replay_thread()) lock replay thread lustre-MDT0000-osp-MDT0001 to lustre-MDT0000_UUID@0@lo 00010000:00010000:1.0:1784189131.354044:0:89339:0:(ldlm_request.c:2888:ldlm_cancel_unused_locks_for_replay()) Dropping as many unused locks as possible before replay for namespace lustre-MDT0000-osp-MDT0001 (0) 00010000:00010000:1.0:1784189131.354049:0:89339:0:(ldlm_request.c:2901:ldlm_cancel_unused_locks_for_replay()) Canceled 0 unused locks from namespace lustre-MDT0000-osp-MDT0001 00000100:00080000:1.0:1784189131.355026:0:89339:0:(import.c:65:import_set_state_nolock()) ffff9dbf436c4000 lustre-MDT0000_UUID: changing import state from REPLAY_LOCKS to REPLAY_WAIT 00000100:00080000:3.0:1784189131.355224:0:3639:0:(import.c:1328:ptlrpc_connect_interpret()) @@@ lustre-MDT0000-lwp-MDT0001: lwp recover req@ffff9dc075f7f480 x1870854458102912/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1784189156 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1784189131.355235:0:3639:0:(import.c:65:import_set_state_nolock()) ffff9dbf43690800 lustre-MDT0000_UUID: changing import state from CONNECTING to RECOVER 00000100:00080000:3.0:1784189131.355240:0:3639:0:(import.c:65:import_set_state_nolock()) ffff9dbf43690800 lustre-MDT0000_UUID: changing import state from RECOVER to FULL 00000100:02000000:3.0:1784189131.355245:0:3639:0:(import.c:1743:ptlrpc_import_recovery_state_machine()) lustre-MDT0000-lwp-MDT0001: Connection restored to 0@lo (at 0@lo) 00000100:00100000:3.0:1784189131.355252:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc075f7f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3639:1870854458102912:0@lo:38:kworker.0 00010000:00080000:3.0:1784189131.355362:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dc0505be300 x1870854458103296/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1784189141 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1784189131.355378:0:3639:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 25 00000100:00080000:3.0:1784189131.355387:0:3639:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:3.0:1784189131.355392:0:3639:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1784189131.355394:0:3639:0:(import.c:65:import_set_state_nolock()) ffff9dc07118c000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1784189131.355398:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc0505be300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3639:1870854458103296:0@lo:38:kworker.0 00000100:00100000:2.0:1784189131.355695:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc07b5e3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3639:1870854458103424:0@lo:400:ldlm_lock_repla.0 00000100:00100000:2.0:1784189131.355760:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784189131.355972:0:26492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458103424 00000100:00100000:3.0:1784189131.355978:0:26492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458103424 00000100:00100000:3.0:1784189131.356029:0:26492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3774 00000100:00100000:3.0:1784189131.356038:0:26492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc05ed79880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3639:x1870854458103424:12345-0@lo:400:ldlm_lock_repla.0 00010000:00080000:3.0:1784189131.356055:0:26492:0:(ldlm_lib.c:3137:target_queue_recovery_request()) @@@ queue final req req@ffff9dc05ed79880 x1870854458103424/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:322/0 lens 224/0 e 0 to 0 dl 1784189142 ref 2 fl Interpret:/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784189131.356064:0:26492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc05ed79880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3639:x1870854458103424:12345-0@lo:400:ldlm_lock_repla.0 Request processed in 29us (305us total) trans 0 rc 0/-999 00000100:00100000:3.0:1784189131.356091:0:26492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3774 00010000:00010000:0.0:1784189131.361277:0:88996:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4369c800/0xcc1762b626f8b2a3 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 88996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189131.361301:0:88996:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4369c800/0xcc1762b626f8b2a3 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 88996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189131.361981:0:88996:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4369c800/0xcc1762b626f8b2a3 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 88996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189131.362001:0:88996:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4369ce00/0xcc1762b626f8b2aa lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x21e7de2f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 88996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189131.362010:0:88996:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4369ce00/0xcc1762b626f8b2aa lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x21e7de2f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 88996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189131.362018:0:88996:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4369ce00/0xcc1762b626f8b2aa lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x21e7de2f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 88996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189131.364380:0:88996:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4369c800/0xcc1762b626f8b2a3 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 88996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189131.364393:0:88996:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4369c800/0xcc1762b626f8b2a3 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 88996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189131.364400:0:88996:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4369c800/0xcc1762b626f8b2a3 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 88996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189131.365496:0:88996:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dbf4369c800 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:0.0:1784189131.365506:0:88996:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4369c800/0xcc1762b626f8b2a3 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 88996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189131.365516:0:88996:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4369c800/0xcc1762b626f8b2a3 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 88996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189131.365533:0:88996:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9dc071128a00) 00010000:00010000:0.0:1784189131.365536:0:88996:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784189131.365541:0:88996:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4369c800/0xcc1762b626f8b2a3 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 88996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189131.365779:0:88996:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4369c800/0xcc1762b626f8b2a3 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 88996 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1784189131.365803:0:88996:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000007cdd9d36 reply state 00000000b357ce02 transno 103079215111 ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4369ce00/0xcc1762b626f8b2aa lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x21e7de2f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 88996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189131.365816:0:88996:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4369ce00/0xcc1762b626f8b2aa lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x21e7de2f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 88996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189131.365824:0:88996:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x21e7de2f (ffff9dc071128b00) 00010000:00010000:0.0:1784189131.365826:0:88996:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1784189131.365829:0:88996:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:0.0:1784189131.365972:0:88996:0:(ldlm_lib.c:2100:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 101 seconds 00000020:00080000:0.0:1784189131.365995:0:88996:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:0.0:1784189131.366000:0:88996:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 103079215112 00000020:00080000:0.0:1784189131.366005:0:88996:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:0.0:1784189131.366007:0:88996:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 103079215112 00000001:00080000:2.0:1784189131.366070:0:88963:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 103079215111 is committed 00010000:00010000:2.0:1784189131.366103:0:3627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4369ce00/0xcc1762b626f8b2aa lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x21e7de2f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 88996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189131.366113:0:3627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4369ce00/0xcc1762b626f8b2aa lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x21e7de2f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 88996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189131.366121:0:3627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4369ce00/0xcc1762b626f8b2aa lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x21e7de2f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 88996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189131.366127:0:3627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dbf4369ce00 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:2.0:1784189131.366131:0:3627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4369ce00/0xcc1762b626f8b2aa lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x21e7de2f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 88996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189131.366137:0:3627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4369ce00/0xcc1762b626f8b2aa lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x21e7de2f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 88996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189131.366149:0:3627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x21e7de2f (ffff9dc071128b00) 00010000:00010000:2.0:1784189131.366152:0:3627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784189131.366155:0:3627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4369ce00/0xcc1762b626f8b2aa lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x21e7de2f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 88996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189131.366161:0:3627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4369ce00/0xcc1762b626f8b2aa lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x21e7de2f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 88996 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784189131.369145:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1784189131.369213:0:66169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436254336 00000100:00100000:2.0:1784189131.369231:0:66169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436254336 00000100:00100000:2.0:1784189131.369348:0:66169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1198 00000100:00100000:2.0:1784189131.369359:0:66169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc04a64f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+6:2395:x1870854436254336:12345-192.168.203.12@tcp:36:rm.0 00010000:00080000:2.0:1784189131.369377:0:66169:0:(ldlm_lib.c:3228:target_queue_recovery_request()) Next recovery transno: 103079215112, current: 103079215112, replaying 00000100:00100000:2.0:1784189131.369392:0:66169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc04a64f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+6:2395:x1870854436254336:12345-192.168.203.12@tcp:36:rm.0 Request processed in 37us (255us total) trans 0 rc 0/-999 00000100:00100000:2.0:1784189131.369399:0:66169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1198 00000020:00080000:0.0:1784189131.370424:0:88996:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:0.0:1784189131.370430:0:88996:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 103079215112, next_transno: 103079215112 00010000:00080000:0.0:1784189131.370436:0:88996:0:(ldlm_lib.c:2246:check_for_next_transno()) waking for next (103079215112) 00000020:00080000:0.0:1784189131.370439:0:88996:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:0.0:1784189131.370449:0:88996:0:(ldlm_lib.c:2747:replay_request_or_update()) @@@ processing x1870854436254336 t103079215112 from 192.168.203.12@tcp req@ffff9dc04a64f480 x1870854436254336/t0(103079215112) o36->b90fcc1c-0e69-42a4-a116-a71fec7aeb78@192.168.203.12@tcp:322/0 lens 512/0 e 0 to 0 dl 1784189142 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'rm.0' uid:0 gid:0 projid:4294967295 00010000:00010000:0.0:1784189131.370544:0:88996:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4369d000/0xcc1762b626f8b2b1 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 88996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189131.370560:0:88996:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4369d000/0xcc1762b626f8b2b1 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 88996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189131.370591:0:88996:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4369d000/0xcc1762b626f8b2b1 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 88996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189131.370607:0:88996:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4369da00/0xcc1762b626f8b2b8 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x21e7de2f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 88996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189131.370615:0:88996:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4369da00/0xcc1762b626f8b2b8 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x21e7de2f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 88996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189131.370622:0:88996:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4369da00/0xcc1762b626f8b2b8 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x21e7de2f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 88996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189131.370705:0:88996:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4369d200/0xcc1762b626f8b2bf lrc: 3/0,1 mode: --/EX res: [0x20000a811:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 88996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189131.370713:0:88996:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4369d200/0xcc1762b626f8b2bf lrc: 3/0,1 mode: EX/EX res: [0x20000a811:0x7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 88996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189131.370720:0:88996:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4369d200/0xcc1762b626f8b2bf lrc: 3/0,1 mode: EX/EX res: [0x20000a811:0x7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 88996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189131.370934:0:88996:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4369d200/0xcc1762b626f8b2bf lrc: 3/0,1 mode: EX/EX res: [0x20000a811:0x7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 88996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189131.370943:0:88996:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4369d200/0xcc1762b626f8b2bf lrc: 2/0,0 mode: EX/EX res: [0x20000a811:0x7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 88996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189131.370950:0:88996:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4369d200/0xcc1762b626f8b2bf lrc: 3/0,0 mode: EX/EX res: [0x20000a811:0x7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 88996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189131.370957:0:88996:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dbf4369d200 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:0.0:1784189131.370961:0:88996:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4369d200/0xcc1762b626f8b2bf lrc: 3/0,0 mode: EX/EX res: [0x20000a811:0x7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 88996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189131.370975:0:88996:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4369d200/0xcc1762b626f8b2bf lrc: 4/0,0 mode: EX/EX res: [0x20000a811:0x7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 88996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189131.370988:0:88996:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x7:0x0].0x0 (ffff9dc071128e00) 00010000:00010000:0.0:1784189131.370991:0:88996:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1784189131.370995:0:88996:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4369d200/0xcc1762b626f8b2bf lrc: 2/0,0 mode: --/EX res: [0x20000a811:0x7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 88996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189131.371001:0:88996:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4369d200/0xcc1762b626f8b2bf lrc: 0/0,0 mode: --/EX res: [0x20000a811:0x7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 88996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189131.371021:0:88996:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4369d000/0xcc1762b626f8b2b1 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 88996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189131.371028:0:88996:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4369d000/0xcc1762b626f8b2b1 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 88996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189131.371034:0:88996:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4369d000/0xcc1762b626f8b2b1 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 88996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189131.371040:0:88996:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dbf4369d000 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:0.0:1784189131.371043:0:88996:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4369d000/0xcc1762b626f8b2b1 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 88996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189131.371049:0:88996:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4369d000/0xcc1762b626f8b2b1 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 88996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189131.371056:0:88996:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9dc071128500) 00010000:00010000:0.0:1784189131.371059:0:88996:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784189131.371062:0:88996:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4369d000/0xcc1762b626f8b2b1 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 88996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189131.371079:0:88996:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4369d000/0xcc1762b626f8b2b1 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 88996 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1784189131.371091:0:88996:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000018b23ac0 reply state 00000000ad035c05 transno 103079215112 ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4369da00/0xcc1762b626f8b2b8 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x21e7de2f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 88996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189131.371103:0:88996:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4369da00/0xcc1762b626f8b2b8 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x21e7de2f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 88996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189131.371110:0:88996:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x21e7de2f (ffff9dc071128400) 00010000:00010000:0.0:1784189131.371112:0:88996:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1784189131.371115:0:88996:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:0.0:1784189131.371192:0:88996:0:(ldlm_lib.c:2100:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:0.0:1784189131.371208:0:88996:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:0.0:1784189131.371210:0:88996:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 103079215113 00000020:00080000:0.0:1784189131.371214:0:88996:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:0.0:1784189131.371216:0:88996:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 103079215113 00000100:00100000:3.0:1784189131.376226:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1784189131.376587:0:66945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436255744 00000100:00100000:1.0:1784189131.376596:0:66945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436255744 00000100:00100000:1.0:1784189131.376651:0:66945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1199 00000100:00100000:1.0:1784189131.376661:0:66945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc07b5e0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+8:2395:x1870854436255744:12345-192.168.203.12@tcp:36:dd.0 00010000:00080000:1.0:1784189131.376681:0:66945:0:(ldlm_lib.c:3228:target_queue_recovery_request()) Next recovery transno: 103079215113, current: 103079215114, replaying 00000100:00100000:1.0:1784189131.376697:0:66945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc07b5e0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+8:2395:x1870854436255744:12345-192.168.203.12@tcp:36:dd.0 Request processed in 39us (480us total) trans 0 rc 0/-999 00000100:00100000:1.0:1784189131.376704:0:66945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1199 00000020:00080000:1.0:1784189131.376731:0:88996:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1784189131.376734:0:88996:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 103079215114, next_transno: 103079215113 00010000:00080000:1.0:1784189131.376739:0:88996:0:(ldlm_lib.c:2258:check_for_next_transno()) lustre-MDT0000: waking for gap in transno, VBR is OFF (skip: 103079215113, ql: 1, comp: 1, conn: 2, next: 103079215114, next_update 0 last_committed: 103079215111) 00000020:00080000:1.0:1784189131.376744:0:88996:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1784189131.376753:0:88996:0:(ldlm_lib.c:2747:replay_request_or_update()) @@@ processing x1870854436255744 t103079215114 from 192.168.203.12@tcp req@ffff9dc07b5e0000 x1870854436255744/t0(103079215114) o36->b90fcc1c-0e69-42a4-a116-a71fec7aeb78@192.168.203.12@tcp:322/0 lens 488/0 e 0 to 0 dl 1784189142 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:4294967295 00010000:00010000:1.0:1784189131.376957:0:88996:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0565e6a00/0xcc1762b626f8b2c6 lrc: 3/0,1 mode: --/PW res: [0x20000a811:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 88996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189131.376973:0:88996:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0565e6a00/0xcc1762b626f8b2c6 lrc: 3/0,1 mode: PW/PW res: [0x20000a811:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 88996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189131.377001:0:88996:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0565e6a00/0xcc1762b626f8b2c6 lrc: 3/0,1 mode: PW/PW res: [0x20000a811:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 88996 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1784189131.377115:0:88996:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000e98d51dc reply state 00000000d7a37665 transno 103079215114 ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0565e6a00/0xcc1762b626f8b2c6 lrc: 3/0,1 mode: PW/PW res: [0x20000a811:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 88996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189131.377127:0:88996:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0565e6a00/0xcc1762b626f8b2c6 lrc: 3/0,1 mode: TXN/TXN res: [0x20000a811:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 88996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189131.377135:0:88996:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x6:0x0].0x0 (ffff9dc0455f8300) 00010000:00010000:1.0:1784189131.377138:0:88996:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1784189131.377141:0:88996:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:1.0:1784189131.377243:0:88996:0:(ldlm_lib.c:2100:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:1.0:1784189131.377258:0:88996:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1784189131.377260:0:88996:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 103079215115 00000020:00080000:1.0:1784189131.377264:0:88996:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1784189131.377266:0:88996:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 103079215115 00000100:00100000:1.0:1784189131.382484:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1784189131.382586:0:66182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436256000 00000100:00100000:2.0:1784189131.382596:0:66182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436256000 00000100:00100000:2.0:1784189131.382667:0:66182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1 00000100:00100000:2.0:1784189131.382677:0:66182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf4693ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_000:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+10:2395:x1870854436256000:12345-192.168.203.12@tcp:10:dd.0 00010000:00080000:2.0:1784189131.382695:0:66182:0:(ldlm_lib.c:3228:target_queue_recovery_request()) Next recovery transno: 103079215115, current: 103079215115, replaying 00000100:00100000:2.0:1784189131.382717:0:66182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf4693ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_000:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+10:2395:x1870854436256000:12345-192.168.203.12@tcp:10:dd.0 Request processed in 41us (243us total) trans 0 rc 0/-999 00000100:00100000:2.0:1784189131.382724:0:66182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1 00000020:00080000:3.0:1784189131.382915:0:88996:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1784189131.382920:0:88996:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 103079215115, next_transno: 103079215115 00010000:00080000:3.0:1784189131.382924:0:88996:0:(ldlm_lib.c:2246:check_for_next_transno()) waking for next (103079215115) 00000020:00080000:3.0:1784189131.382927:0:88996:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1784189131.382935:0:88996:0:(ldlm_lib.c:2747:replay_request_or_update()) @@@ processing x1870854436256000 t103079215115 from 192.168.203.12@tcp req@ffff9dbf4693ce00 x1870854436256000/t0(103079215115) o10->b90fcc1c-0e69-42a4-a116-a71fec7aeb78@192.168.203.12@tcp:322/0 lens 440/0 e 0 to 0 dl 1784189142 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:3.0:1784189131.383196:0:88996:0:(ldlm_lib.c:2100:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:3.0:1784189131.383211:0:88996:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1784189131.383213:0:88996:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 103079215116 00000020:00080000:3.0:1784189131.383216:0:88996:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1784189131.383218:0:88996:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 103079215116 00000100:00100000:1.0:1784189131.392351:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1784189131.392415:0:66171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436262272 00000100:00100000:3.0:1784189131.392423:0:66171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436262272 00000100:00100000:3.0:1784189131.392490:0:66171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1200 00000100:00100000:3.0:1784189131.392498:0:66171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf4693d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+11:2395:x1870854436262272:12345-192.168.203.12@tcp:101:ldlm_lock_repla.0 00010000:00080000:3.0:1784189131.392519:0:66171:0:(ldlm_lib.c:3187:target_queue_recovery_request()) @@@ queue lock replay req req@ffff9dbf4693d880 x1870854436262272/t0(0) o101->b90fcc1c-0e69-42a4-a116-a71fec7aeb78@192.168.203.12@tcp:322/0 lens 328/0 e 0 to 0 dl 1784189142 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784189131.392538:0:66171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf4693d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+11:2395:x1870854436262272:12345-192.168.203.12@tcp:101:ldlm_lock_repla.0 Request processed in 42us (196us total) trans 0 rc 0/-999 00000100:00100000:3.0:1784189131.392551:0:66171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1200 00000020:00080000:2.0:1784189131.392749:0:88996:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1784189131.392754:0:88996:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 2, connected: 2, completed: 2, queue_len: 0, req_transno: 0, next_transno: 103079215116 00010000:00080000:2.0:1784189131.392757:0:88996:0:(ldlm_lib.c:2262:check_for_next_transno()) waking for completed recovery 00000020:00080000:2.0:1784189131.392760:0:88996:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1784189131.392766:0:88996:0:(ldlm_lib.c:2452:target_next_replay_lock()) Waiting for lock 00010000:00080000:2.0:1784189131.392768:0:88996:0:(ldlm_lib.c:2282:check_for_next_lock()) waking for next lock 00010000:00080000:2.0:1784189131.392775:0:88996:0:(ldlm_lib.c:2888:target_recovery_thread()) @@@ processing lock from 192.168.203.12@tcp: req@ffff9dbf4693d880 x1870854436262272/t0(0) o101->b90fcc1c-0e69-42a4-a116-a71fec7aeb78@192.168.203.12@tcp:322/0 lens 328/0 e 0 to 0 dl 1784189142 ref 1 fl Complete:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00010000:2.0:1784189131.392794:0:88996:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784189131.392820:0:88996:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0755a5600/0xcc1762b626f8b2cd lrc: 2/0,0 mode: --/PW res: [0x20000a811:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbfc5de7fe6c3da0 expref: -99 pid: 88996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189131.392863:0:88996:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0755a5600/0xcc1762b626f8b2cd lrc: 3/0,0 mode: PW/PW res: [0x20000a811:0x6:0x0].0x0 bits 0x59/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c3da0 expref: 12 pid: 88996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189131.392877:0:88996:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0755a5600/0xcc1762b626f8b2cd lrc: 3/0,0 mode: PW/PW res: [0x20000a811:0x6:0x0].0x0 bits 0x59/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c3da0 expref: 12 pid: 88996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189131.392887:0:88996:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc0755a5600, rc 0) 00010000:00080000:2.0:1784189131.392948:0:88996:0:(ldlm_lib.c:2100:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00010000:00080000:2.0:1784189131.392959:0:88996:0:(ldlm_lib.c:2452:target_next_replay_lock()) Waiting for lock 00000100:00100000:2.0:1784189131.410127:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1784189131.410161:0:66169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436262400 00000100:00100000:2.0:1784189131.410171:0:66169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436262400 00000100:00100000:2.0:1784189131.410230:0:66169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1124 00000100:00100000:2.0:1784189131.410241:0:66169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf4262f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+12:2395:x1870854436262400:12345-192.168.203.12@tcp:400:ptlrpcd_rcv.0 00010000:00080000:2.0:1784189131.410261:0:66169:0:(ldlm_lib.c:3137:target_queue_recovery_request()) @@@ queue final req req@ffff9dbf4262f100 x1870854436262400/t0(0) o400->b90fcc1c-0e69-42a4-a116-a71fec7aeb78@192.168.203.12@tcp:322/0 lens 224/0 e 0 to 0 dl 1784189142 ref 2 fl Interpret:H/2c0/ffffffff rc 0/-1 job:'ptlrpcd_rcv.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784189131.410277:0:66169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf4262f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+12:2395:x1870854436262400:12345-192.168.203.12@tcp:400:ptlrpcd_rcv.0 Request processed in 40us (158us total) trans 0 rc 0/-999 00000100:00100000:2.0:1784189131.410284:0:66169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1124 00010000:00080000:2.0:1784189131.410298:0:88996:0:(ldlm_lib.c:2285:check_for_next_lock()) waking for completed lock replay 00000001:00000004:2.0:1784189131.410419:0:88996:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 25, last_transno is 107374182400 00000001:00100000:3.0:1784189131.417174:0:88963:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of b90fcc1c-0e69-42a4-a116-a71fec7aeb78 00000001:00100000:3.0:1784189131.417183:0:88963:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000001:00080000:3.0:1784189131.417269:0:88963:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 103079215115 is committed 00000001:00080000:0.0:1784189131.417647:0:88996:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00010000:00080000:0.0:1784189131.417688:0:88996:0:(ldlm_lib.c:1996:target_cancel_recovery_timer()) lustre-MDT0000: cancel recovery timer 00010000:00080000:0.0:1784189131.417703:0:88996:0:(ldlm_lib.c:2940:target_recovery_thread()) @@@ processing final ping from 0@lo: req@ffff9dc05ed79880 x1870854458103424/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:322/0 lens 224/0 e 0 to 0 dl 1784189142 ref 1 fl Complete:/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00080000:0.0:1784189131.417822:0:88996:0:(ldlm_lib.c:2940:target_recovery_thread()) @@@ processing final ping from 192.168.203.12@tcp: req@ffff9dbf4262f100 x1870854436262400/t0(0) o400->b90fcc1c-0e69-42a4-a116-a71fec7aeb78@192.168.203.12@tcp:322/0 lens 224/0 e 0 to 0 dl 1784189142 ref 1 fl Complete:H/2c0/ffffffff rc 0/-1 job:'ptlrpcd_rcv.0' uid:0 gid:0 projid:4294967295 00010000:02000000:0.0:1784189131.417881:0:88996:0:(ldlm_lib.c:1868:target_finish_recovery()) lustre-MDT0000: Recovery over after 0:04, of 2 clients 2 recovered and 0 were evicted. 00000100:00080000:3.0:1784189131.418732:0:3639:0:(import.c:65:import_set_state_nolock()) ffff9dbf436c4000 lustre-MDT0000_UUID: changing import state from REPLAY_WAIT to RECOVER 00000100:00080000:3.0:1784189131.418743:0:3639:0:(client.c:3234:ptlrpc_resend_req()) @@@ going to resend req@ffff9dc07b5e3480 x1870854458103424/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1784189147 ref 1 fl Interpret:RQU/2c0/0 rc 0/0 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1784189131.418753:0:3639:0:(client.c:3243:ptlrpc_resend_req()) @@@ it has reply, so skip it req@ffff9dc07b5e3480 x1870854458103424/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1784189147 ref 1 fl Interpret:RQU/2c0/0 rc 0/0 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1784189131.418760:0:3639:0:(import.c:65:import_set_state_nolock()) ffff9dbf436c4000 lustre-MDT0000_UUID: changing import state from RECOVER to FULL 00000100:02000000:3.0:1784189131.418774:0:3639:0:(import.c:1743:ptlrpc_import_recovery_state_machine()) lustre-MDT0000-osp-MDT0001: Connection restored to 0@lo (at 0@lo) 00000100:00100000:3.0:1784189131.418779:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc07b5e3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3639:1870854458103424:0@lo:400:ldlm_lock_repla.0 00000100:00100000:3.0:1784189131.418851:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc07b5e3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1870854458103552:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1784189131.418900:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1784189131.424009:0:3627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4369da00/0xcc1762b626f8b2b8 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x21e7de2f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 88996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189131.424027:0:3627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4369da00/0xcc1762b626f8b2b8 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x21e7de2f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 88996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189131.424046:0:3627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4369da00/0xcc1762b626f8b2b8 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x21e7de2f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 88996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189131.424053:0:3627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dbf4369da00 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:2.0:1784189131.424058:0:3627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4369da00/0xcc1762b626f8b2b8 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x21e7de2f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 88996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189131.424066:0:3627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4369da00/0xcc1762b626f8b2b8 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x21e7de2f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 88996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189131.424083:0:3627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x21e7de2f (ffff9dc071128400) 00010000:00010000:2.0:1784189131.424086:0:3627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784189131.424091:0:3627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4369da00/0xcc1762b626f8b2b8 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x21e7de2f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 88996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189131.424098:0:3627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4369da00/0xcc1762b626f8b2b8 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x21e7de2f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 88996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189131.424123:0:3627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0565e6a00/0xcc1762b626f8b2c6 lrc: 3/0,1 mode: TXN/TXN res: [0x20000a811:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 88996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189131.424129:0:3627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0565e6a00/0xcc1762b626f8b2c6 lrc: 2/0,0 mode: TXN/TXN res: [0x20000a811:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 88996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189131.424134:0:3627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0565e6a00/0xcc1762b626f8b2c6 lrc: 3/0,0 mode: TXN/TXN res: [0x20000a811:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 88996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189131.424139:0:3627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc0565e6a00 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:2.0:1784189131.424142:0:3627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0565e6a00/0xcc1762b626f8b2c6 lrc: 3/0,0 mode: TXN/TXN res: [0x20000a811:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 88996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189131.424158:0:3627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0565e6a00/0xcc1762b626f8b2c6 lrc: 4/0,0 mode: TXN/TXN res: [0x20000a811:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 88996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189131.424167:0:3627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x6:0x0].0x0 (ffff9dc0455f8300) 00010000:00010000:2.0:1784189131.424169:0:3627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784189131.424172:0:3627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0565e6a00/0xcc1762b626f8b2c6 lrc: 2/0,0 mode: --/TXN res: [0x20000a811:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 88996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189131.424178:0:3627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0565e6a00/0xcc1762b626f8b2c6 lrc: 0/0,0 mode: --/TXN res: [0x20000a811:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 88996 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784189131.424217:0:23826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458103552 00000100:00100000:2.0:1784189131.424226:0:23826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458103552 00000100:00100000:2.0:1784189131.426636:0:23826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3775 00000100:00100000:2.0:1784189131.426655:0:23826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc07b5e1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3643:x1870854458103552:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1784189131.426693:0:23826:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 28672 pending 0 free 1445285888 avail 1299046400 00000100:00100000:2.0:1784189131.426774:0:23826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc07b5e1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3643:x1870854458103552:12345-0@lo:41:osp-pre-0-1.0 Request processed in 126us (7873us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189131.426781:0:23826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3775 00000100:00100000:2.0:1784189131.430861:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc07b5e3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1870854458103552:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1784189131.434297:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1784189131.434360:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1784189131.434395:0:66184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436257152 00000100:00100000:1.0:1784189131.434404:0:66184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436257152 00002000:00100000:1.0:1784189131.434520:0:66184:0:(mdt_io.c:150:mdt_rw_hpreq_check()) @@@ lustre-MDT0000 mdt_io00_002: refresh rw locks for [0x20000a811:0x6:0x0] req@ffff9dbf4693ed80 x1870854436257152/t0(0) o4->b90fcc1c-0e69-42a4-a116-a71fec7aeb78@192.168.203.12@tcp:322/0 lens 496/0 e 0 to 0 dl 1784189142 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1784189131.434532:0:66184:0:(mdt_io.c:66:mdt_prolong_dom_lock()) Prolong DOM lock for req ffff9dbf4693ed80 with x1870854436257152 00002000:00010000:1.0:1784189131.434653:0:66184:0:(mdt_io.c:38:mdt_dom_resource_prolong()) ### DOM lock to prolong ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0755a5600/0xcc1762b626f8b2cd lrc: 2/0,0 mode: PW/PW res: [0x20000a811:0x6:0x0].0x0 bits 0x59/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c3da0 expref: 7 pid: 88996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784189131.434705:0:66184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 2 00000100:00100000:1.0:1784189131.434715:0:66184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf4693ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_002:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+7:0:x1870854436257152:12345-192.168.203.12@tcp:4:dd.0 00000100:00100000:3.0:1784189131.435263:0:66170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436257280 00000100:00100000:3.0:1784189131.435269:0:66170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436257280 00000100:00100000:3.0:1784189131.435308:0:66170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1201 00000100:00100000:3.0:1784189131.435315:0:66170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf4693c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+10:0:x1870854436257280:12345-192.168.203.12@tcp:16:kworker.0 00000100:00100000:3.0:1784189131.437103:0:66184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf4693ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_002:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+10:0:x1870854436257152:12345-192.168.203.12@tcp:4:dd.0 Request processed in 2381us (2733us total) trans 107374182401 rc 0/0 00000100:00100000:3.0:1784189131.437120:0:66184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 2 00002000:00100000:3.0:1784189131.437132:0:66184:0:(mdt_io.c:150:mdt_rw_hpreq_check()) @@@ lustre-MDT0000 mdt_io00_002: refresh rw locks for [0x20000a811:0x6:0x0] req@ffff9dbf4693ed80 x1870854436257152/t107374182401(0) o4->b90fcc1c-0e69-42a4-a116-a71fec7aeb78@192.168.203.12@tcp:322/0 lens 496/448 e 0 to 0 dl 1784189142 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1784189131.437142:0:66184:0:(mdt_io.c:66:mdt_prolong_dom_lock()) Prolong DOM lock for req ffff9dbf4693ed80 with x1870854436257152 00002000:00010000:3.0:1784189131.437151:0:66184:0:(mdt_io.c:38:mdt_dom_resource_prolong()) ### DOM lock to prolong ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0755a5600/0xcc1762b626f8b2cd lrc: 2/0,0 mode: PW/PW res: [0x20000a811:0x6:0x0].0x0 bits 0x59/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c3da0 expref: 10 pid: 88996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1784189131.439687:0:88963:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 107374182401 is committed 00000100:00100000:1.0:1784189131.439901:0:66170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf4693c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+7:0:x1870854436257280:12345-192.168.203.12@tcp:16:kworker.0 Request processed in 4580us (5606us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189131.439912:0:66170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1201 00000004:00000080:0.0:1784189131.444116:0:88996:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffae09886cbe10 00100000:10000000:0.0:1784189131.444128:0:88996:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000004:00080000:3.0:1784189131.446090:0:88984:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x2c0000401:0x682:0x0] 00000100:00100000:3.0:1784189131.446138:0:88984:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc07b5e2d80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:88984:1870854458103680:0@lo:5:osp-pre-1-0.0 00000100:00100000:3.0:1784189131.446201:0:88984:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784189131.446238:0:88984:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dc045d06900 going to sleep for 11 seconds 00000100:00100000:2.0:1784189131.447809:0:26160:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458103680 00000100:00100000:2.0:1784189131.447820:0:26160:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458103680 00000100:00100000:2.0:1784189131.447869:0:26160:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4945 00000100:00100000:2.0:1784189131.447877:0:26160:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc07b5e0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+6:88984:x1870854458103680:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:2.0:1784189131.447906:0:26160:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 1793 -> diff = -127 00002000:02000040:2.0:1784189131.447911:0:26160:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000401:1667 to 0x2c0000401:1793) 00000004:00080000:1.0:1784189131.448433:0:88982:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x280000401:0x45c:0x0] 00000100:00100000:0.0:1784189131.449118:0:88982:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc04a64f800 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:88982:1870854458103808:0@lo:5:osp-pre-0-0.0 00000100:00100000:0.0:1784189131.450378:0:88982:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784189131.450412:0:88982:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dbf464c2d80 going to sleep for 11 seconds 00000100:00100000:0.0:1784189131.450439:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458103808 00000100:00100000:0.0:1784189131.450445:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458103808 00000100:00100000:0.0:1784189131.450496:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4946 00000100:00100000:0.0:1784189131.450504:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc05ed91f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:88982:x1870854458103808:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:0.0:1784189131.450533:0:8429:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 1793 -> diff = -677 00002000:02000040:0.0:1784189131.450537:0:8429:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:1117 to 0x280000401:1793) 00002000:00010000:2.0:1784189131.460901:0:26160:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x701:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1784189131.460924:0:26160:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000b6eacba/0xcc1762b626f8b2d4 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x701:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189131.460942:0:26160:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x701:0x0].0x0 since=3373s v=(0 0) 00010000:00010000:2.0:1784189131.460948:0:26160:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x701:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784189131.460954:0:26160:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000b6eacba/0xcc1762b626f8b2d4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x701:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189131.460972:0:26160:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000b6eacba/0xcc1762b626f8b2d4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x701:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189131.460983:0:26160:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000b6eacba/0xcc1762b626f8b2d4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x701:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189131.460991:0:26160:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000b6eacba/0xcc1762b626f8b2d4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x701:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189131.462036:0:26160:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1784189131.462492:0:7454:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784189131.462501:0:7454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000b6eacba/0xcc1762b626f8b2d4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x701:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189131.462513:0:7454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc0755a4e00 already unused, calling callback (ffffffffc0b2e230) 00010000:00010000:2.0:1784189131.462519:0:7454:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000b6eacba/0xcc1762b626f8b2d4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x701:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189131.462529:0:7454:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000b6eacba/0xcc1762b626f8b2d4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x701:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1784189131.464157:0:26160:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x700:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784189131.464169:0:26160:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d9facf87/0xcc1762b626f8b2db lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x700:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189131.464185:0:26160:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x700:0x0].0x0 since=3373s v=(0 0) 00010000:00010000:3.0:1784189131.464190:0:26160:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x700:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784189131.464197:0:26160:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d9facf87/0xcc1762b626f8b2db lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x700:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189131.464212:0:26160:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d9facf87/0xcc1762b626f8b2db lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x700:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189131.464222:0:26160:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d9facf87/0xcc1762b626f8b2db lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x700:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189131.464230:0:26160:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d9facf87/0xcc1762b626f8b2db lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x700:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189131.464255:0:26160:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1784189131.464354:0:26160:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6ff:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784189131.464359:0:26160:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cff61a26/0xcc1762b626f8b2e2 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6ff:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189131.464378:0:26160:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6ff:0x0].0x0 since=3373s v=(0 0) 00010000:00010000:3.0:1784189131.464382:0:26160:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6ff:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784189131.464387:0:26160:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cff61a26/0xcc1762b626f8b2e2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189131.464396:0:26160:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cff61a26/0xcc1762b626f8b2e2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189131.464405:0:26160:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cff61a26/0xcc1762b626f8b2e2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189131.464412:0:26160:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000cff61a26/0xcc1762b626f8b2e2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189131.464431:0:26160:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1784189131.464469:0:26173:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1784189131.464480:0:26173:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d9facf87/0xcc1762b626f8b2db lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x700:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1784189131.464487:0:26160:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6fe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784189131.464488:0:26173:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc05ec0ca00 already unused, calling callback (ffffffffc0b2e230) 00010000:00010000:3.0:1784189131.464491:0:26160:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006bda6ed5/0xcc1762b626f8b2e9 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6fe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189131.464493:0:26173:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d9facf87/0xcc1762b626f8b2db lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x700:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189131.464499:0:26160:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6fe:0x0].0x0 since=3373s v=(0 0) 00010000:00010000:3.0:1784189131.464502:0:26160:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6fe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784189131.464505:0:26160:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006bda6ed5/0xcc1762b626f8b2e9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189131.464505:0:26173:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d9facf87/0xcc1762b626f8b2db lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x700:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189131.464514:0:26160:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006bda6ed5/0xcc1762b626f8b2e9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189131.464524:0:26173:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d9facf87/0xcc1762b626f8b2db lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x700:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189131.464532:0:26160:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006bda6ed5/0xcc1762b626f8b2e9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189131.464538:0:26160:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006bda6ed5/0xcc1762b626f8b2e9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189131.464558:0:26160:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1784189131.464599:0:26173:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d9facf87/0xcc1762b626f8b2db lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x700:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189131.464619:0:26173:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1784189131.464629:0:26173:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000cff61a26/0xcc1762b626f8b2e2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189131.464636:0:26173:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc05ec0c800 already unused, calling callback (ffffffffc0b2e230) 00010000:00010000:1.0:1784189131.464639:0:26173:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000cff61a26/0xcc1762b626f8b2e2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189131.464647:0:26173:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000cff61a26/0xcc1762b626f8b2e2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189131.464657:0:26173:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000cff61a26/0xcc1762b626f8b2e2 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189131.464663:0:26173:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cff61a26/0xcc1762b626f8b2e2 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189131.464675:0:26173:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784189131.464678:0:26173:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006bda6ed5/0xcc1762b626f8b2e9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189131.464683:0:26173:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc05ec0d600 already unused, calling callback (ffffffffc0b2e230) 00010000:00010000:1.0:1784189131.464686:0:26173:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006bda6ed5/0xcc1762b626f8b2e9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189131.464693:0:26173:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006bda6ed5/0xcc1762b626f8b2e9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189131.464715:0:26173:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006bda6ed5/0xcc1762b626f8b2e9 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189131.464722:0:26173:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006bda6ed5/0xcc1762b626f8b2e9 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189131.464786:0:7454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000b6eacba/0xcc1762b626f8b2d4 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x701:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189131.464794:0:7454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000b6eacba/0xcc1762b626f8b2d4 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x701:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1784189131.465336:0:26160:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6fd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784189131.465342:0:26160:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000051238ad7/0xcc1762b626f8b2f0 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6fd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189131.465352:0:26160:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6fd:0x0].0x0 since=3373s v=(0 0) 00010000:00010000:3.0:1784189131.465355:0:26160:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6fd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784189131.465359:0:26160:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000051238ad7/0xcc1762b626f8b2f0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189131.465367:0:26160:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000051238ad7/0xcc1762b626f8b2f0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189131.465374:0:26160:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000051238ad7/0xcc1762b626f8b2f0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189131.465380:0:26160:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000051238ad7/0xcc1762b626f8b2f0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189131.465401:0:26160:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1784189131.465442:0:26160:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6fc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784189131.465448:0:26160:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009d2fcfa0/0xcc1762b626f8b2f7 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6fc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189131.465467:0:26160:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6fc:0x0].0x0 since=3373s v=(0 0) 00010000:00010000:3.0:1784189131.465472:0:26160:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6fc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784189131.465476:0:26160:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009d2fcfa0/0xcc1762b626f8b2f7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189131.465485:0:26160:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009d2fcfa0/0xcc1762b626f8b2f7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189131.465493:0:26160:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009d2fcfa0/0xcc1762b626f8b2f7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189131.465502:0:26160:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009d2fcfa0/0xcc1762b626f8b2f7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189131.465510:0:26160:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:3.0:1784189131.465544:0:26160:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6fb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784189131.465555:0:26160:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cf75c475/0xcc1762b626f8b2fe lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6fb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189131.465564:0:26160:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6fb:0x0].0x0 since=3373s v=(0 0) 00010000:00010000:3.0:1784189131.465582:0:26160:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6fb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784189131.465588:0:26160:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cf75c475/0xcc1762b626f8b2fe lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189131.465598:0:26160:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cf75c475/0xcc1762b626f8b2fe lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189131.465607:0:26160:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cf75c475/0xcc1762b626f8b2fe lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189131.465615:0:26160:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000cf75c475/0xcc1762b626f8b2fe lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189131.465623:0:26160:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:3.0:1784189131.465659:0:26160:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6fa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784189131.465665:0:26160:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c24bc63e/0xcc1762b626f8b305 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6fa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189131.465673:0:26160:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6fa:0x0].0x0 since=3373s v=(0 0) 00010000:00010000:3.0:1784189131.465676:0:26160:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6fa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784189131.465680:0:26160:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c24bc63e/0xcc1762b626f8b305 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189131.465689:0:26160:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c24bc63e/0xcc1762b626f8b305 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189131.465697:0:26160:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c24bc63e/0xcc1762b626f8b305 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189131.465711:0:26160:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c24bc63e/0xcc1762b626f8b305 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189131.465719:0:26160:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00002000:00010000:3.0:1784189131.465753:0:26160:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6f9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784189131.465759:0:26160:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d66bdbcc/0xcc1762b626f8b30c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6f9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189131.465767:0:26160:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6f9:0x0].0x0 since=3373s v=(0 0) 00010000:00010000:3.0:1784189131.465770:0:26160:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6f9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784189131.465774:0:26160:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d66bdbcc/0xcc1762b626f8b30c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189131.465784:0:26160:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d66bdbcc/0xcc1762b626f8b30c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189131.465792:0:26160:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d66bdbcc/0xcc1762b626f8b30c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189131.465800:0:26160:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d66bdbcc/0xcc1762b626f8b30c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189131.465809:0:26160:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00002000:00010000:3.0:1784189131.465840:0:26160:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6f8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784189131.465845:0:26160:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c6b3e208/0xcc1762b626f8b313 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6f8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189131.465858:0:26160:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6f8:0x0].0x0 since=3373s v=(0 0) 00010000:00010000:3.0:1784189131.465861:0:26160:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6f8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784189131.465865:0:26160:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c6b3e208/0xcc1762b626f8b313 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189131.465874:0:26160:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c6b3e208/0xcc1762b626f8b313 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189131.465882:0:26160:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c6b3e208/0xcc1762b626f8b313 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189131.465889:0:26160:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c6b3e208/0xcc1762b626f8b313 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189131.465897:0:26160:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to regular blp list, 6 blwis in pool 00002000:00010000:3.0:1784189131.465931:0:26160:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6f7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784189131.465936:0:26160:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000456ffdbd/0xcc1762b626f8b31a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6f7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189131.465943:0:26160:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6f7:0x0].0x0 since=3373s v=(0 0) 00010000:00010000:3.0:1784189131.465946:0:26160:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6f7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784189131.465950:0:26160:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000456ffdbd/0xcc1762b626f8b31a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189131.465957:0:26160:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000456ffdbd/0xcc1762b626f8b31a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189131.465975:0:26160:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000456ffdbd/0xcc1762b626f8b31a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189131.465982:0:26160:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000456ffdbd/0xcc1762b626f8b31a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189131.465990:0:26160:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to regular blp list, 7 blwis in pool 00002000:00010000:3.0:1784189131.466029:0:26160:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6f6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784189131.466035:0:26160:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009430fa1b/0xcc1762b626f8b321 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6f6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189131.466042:0:26160:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6f6:0x0].0x0 since=3373s v=(0 0) 00010000:00010000:3.0:1784189131.466045:0:26160:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6f6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784189131.466049:0:26160:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009430fa1b/0xcc1762b626f8b321 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189131.466057:0:26160:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009430fa1b/0xcc1762b626f8b321 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189131.466064:0:26160:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009430fa1b/0xcc1762b626f8b321 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189131.466071:0:26160:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009430fa1b/0xcc1762b626f8b321 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189131.466088:0:26160:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/8 locks to regular blp list, 8 blwis in pool 00002000:00010000:3.0:1784189131.466122:0:26160:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6f5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784189131.466127:0:26160:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000041e819fd/0xcc1762b626f8b328 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6f5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189131.466134:0:26160:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6f5:0x0].0x0 since=3373s v=(0 0) 00010000:00010000:3.0:1784189131.466137:0:26160:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6f5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784189131.466141:0:26160:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000041e819fd/0xcc1762b626f8b328 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189131.466149:0:26160:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000041e819fd/0xcc1762b626f8b328 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189131.466157:0:26160:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000041e819fd/0xcc1762b626f8b328 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189131.466164:0:26160:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000041e819fd/0xcc1762b626f8b328 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189131.466171:0:26160:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/9 locks to regular blp list, 9 blwis in pool 00002000:00010000:3.0:1784189131.466200:0:26160:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6f4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784189131.466204:0:26160:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f87d4f57/0xcc1762b626f8b32f lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6f4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189131.466211:0:26160:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6f4:0x0].0x0 since=3373s v=(0 0) 00010000:00010000:3.0:1784189131.466219:0:26160:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6f4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784189131.466223:0:26160:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f87d4f57/0xcc1762b626f8b32f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189131.466232:0:26160:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f87d4f57/0xcc1762b626f8b32f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189131.466241:0:26160:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f87d4f57/0xcc1762b626f8b32f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189131.466249:0:26160:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f87d4f57/0xcc1762b626f8b32f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189131.466257:0:26160:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/10 locks to regular blp list, 10 blwis in pool 00002000:00010000:3.0:1784189131.466291:0:26160:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6f3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784189131.466297:0:26160:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000a3ed8d4/0xcc1762b626f8b336 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6f3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189131.466305:0:26160:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6f3:0x0].0x0 since=3373s v=(0 0) 00010000:00010000:3.0:1784189131.466308:0:26160:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6f3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784189131.466312:0:26160:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000a3ed8d4/0xcc1762b626f8b336 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189131.466350:0:26160:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000a3ed8d4/0xcc1762b626f8b336 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189131.466359:0:26160:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000a3ed8d4/0xcc1762b626f8b336 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189131.466372:0:26160:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000a3ed8d4/0xcc1762b626f8b336 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189131.466381:0:26160:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/11 locks to regular blp list, 11 blwis in pool 00002000:00010000:3.0:1784189131.466415:0:26160:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6f2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784189131.466420:0:26160:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003341b3a2/0xcc1762b626f8b33d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6f2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189131.466428:0:26160:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6f2:0x0].0x0 since=3373s v=(0 0) 00010000:00010000:3.0:1784189131.466432:0:26160:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6f2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784189131.466435:0:26160:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003341b3a2/0xcc1762b626f8b33d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189131.466445:0:26160:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003341b3a2/0xcc1762b626f8b33d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189131.466453:0:26160:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003341b3a2/0xcc1762b626f8b33d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189131.466474:0:26160:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003341b3a2/0xcc1762b626f8b33d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189131.466483:0:26160:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/12 locks to regular blp list, 12 blwis in pool 00002000:00010000:3.0:1784189131.466516:0:26160:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6f1:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784189131.466521:0:26160:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005850ddb8/0xcc1762b626f8b344 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6f1:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189131.466533:0:26160:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6f1:0x0].0x0 since=3373s v=(0 0) 00010000:00010000:3.0:1784189131.466535:0:26160:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6f1:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784189131.466540:0:26160:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005850ddb8/0xcc1762b626f8b344 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189131.466548:0:26160:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005850ddb8/0xcc1762b626f8b344 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189131.466556:0:26160:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005850ddb8/0xcc1762b626f8b344 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189131.466562:0:26160:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005850ddb8/0xcc1762b626f8b344 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189131.466569:0:26160:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/13 locks to regular blp list, 13 blwis in pool 00002000:00010000:3.0:1784189131.466601:0:26160:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6f0:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784189131.466605:0:26160:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000039fec00f/0xcc1762b626f8b34b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6f0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189131.466612:0:26160:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6f0:0x0].0x0 since=3373s v=(0 0) 00010000:00010000:3.0:1784189131.466615:0:26160:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6f0:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784189131.466619:0:26160:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000039fec00f/0xcc1762b626f8b34b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189131.466626:0:26160:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000039fec00f/0xcc1762b626f8b34b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189131.466644:0:26160:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000039fec00f/0xcc1762b626f8b34b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189131.466650:0:26160:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000039fec00f/0xcc1762b626f8b34b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189131.466658:0:26160:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/14 locks to regular blp list, 14 blwis in pool 00002000:00010000:3.0:1784189131.466689:0:26160:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6ef:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784189131.466694:0:26160:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d93d2bda/0xcc1762b626f8b352 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6ef:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189131.466701:0:26160:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6ef:0x0].0x0 since=3373s v=(0 0) 00010000:00010000:3.0:1784189131.466704:0:26160:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6ef:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784189131.466708:0:26160:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d93d2bda/0xcc1762b626f8b352 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189131.466716:0:26160:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d93d2bda/0xcc1762b626f8b352 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189131.466723:0:26160:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d93d2bda/0xcc1762b626f8b352 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189131.466731:0:26160:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d93d2bda/0xcc1762b626f8b352 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189131.466750:0:26160:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/15 locks to regular blp list, 15 blwis in pool 00002000:00010000:3.0:1784189131.466786:0:26160:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6ee:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784189131.466791:0:26160:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000b9d4674/0xcc1762b626f8b359 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6ee:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189131.466798:0:26160:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6ee:0x0].0x0 since=3373s v=(0 0) 00010000:00010000:3.0:1784189131.466801:0:26160:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6ee:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784189131.466805:0:26160:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000b9d4674/0xcc1762b626f8b359 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189131.466814:0:26160:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000b9d4674/0xcc1762b626f8b359 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189131.466821:0:26160:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000b9d4674/0xcc1762b626f8b359 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189131.466830:0:26160:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000b9d4674/0xcc1762b626f8b359 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189131.466838:0:26160:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/16 locks to regular blp list, 16 blwis in pool 00002000:00010000:3.0:1784189131.466867:0:26160:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6ed:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784189131.466871:0:26160:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bd7d33cb/0xcc1762b626f8b360 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6ed:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189131.466879:0:26160:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6ed:0x0].0x0 since=3373s v=(0 0) 00010000:00010000:3.0:1784189131.466886:0:26160:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6ed:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784189131.466890:0:26160:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bd7d33cb/0xcc1762b626f8b360 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189131.466899:0:26160:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bd7d33cb/0xcc1762b626f8b360 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189131.466907:0:26160:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bd7d33cb/0xcc1762b626f8b360 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189131.466913:0:26160:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000bd7d33cb/0xcc1762b626f8b360 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189131.466920:0:26160:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/17 locks to regular blp list, 17 blwis in pool 00002000:00010000:3.0:1784189131.466952:0:26160:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6ec:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784189131.466957:0:26160:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c2da6eae/0xcc1762b626f8b367 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6ec:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189131.466964:0:26160:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6ec:0x0].0x0 since=3373s v=(0 0) 00010000:00010000:3.0:1784189131.466966:0:26160:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6ec:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784189131.466970:0:26160:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c2da6eae/0xcc1762b626f8b367 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189131.466978:0:26160:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c2da6eae/0xcc1762b626f8b367 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189131.466985:0:26160:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c2da6eae/0xcc1762b626f8b367 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189131.466998:0:26160:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c2da6eae/0xcc1762b626f8b367 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189131.467005:0:26160:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/18 locks to regular blp list, 18 blwis in pool 00002000:00010000:3.0:1784189131.467041:0:26160:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6eb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784189131.467046:0:26160:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b7722a60/0xcc1762b626f8b36e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6eb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189131.467054:0:26160:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6eb:0x0].0x0 since=3373s v=(0 0) 00010000:00010000:3.0:1784189131.467056:0:26160:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6eb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784189131.467060:0:26160:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b7722a60/0xcc1762b626f8b36e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189131.467069:0:26160:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b7722a60/0xcc1762b626f8b36e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189131.467077:0:26160:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b7722a60/0xcc1762b626f8b36e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189131.467084:0:26160:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b7722a60/0xcc1762b626f8b36e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189131.467093:0:26160:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/19 locks to regular blp list, 19 blwis in pool 00002000:00010000:3.0:1784189131.467121:0:26160:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6ea:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784189131.467125:0:26160:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b0b2f133/0xcc1762b626f8b375 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6ea:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189131.467138:0:26160:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6ea:0x0].0x0 since=3373s v=(0 0) 00010000:00010000:3.0:1784189131.467141:0:26160:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6ea:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784189131.467145:0:26160:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b0b2f133/0xcc1762b626f8b375 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189131.467153:0:26160:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b0b2f133/0xcc1762b626f8b375 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189131.467161:0:26160:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b0b2f133/0xcc1762b626f8b375 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189131.467168:0:26160:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b0b2f133/0xcc1762b626f8b375 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189131.467175:0:26160:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/20 locks to regular blp list, 20 blwis in pool 00002000:00010000:3.0:1784189131.467206:0:26160:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6e9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784189131.467210:0:26160:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009088e939/0xcc1762b626f8b37c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6e9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189131.467217:0:26160:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6e9:0x0].0x0 since=3373s v=(0 0) 00010000:00010000:3.0:1784189131.467220:0:26160:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6e9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784189131.467224:0:26160:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009088e939/0xcc1762b626f8b37c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189131.467232:0:26160:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009088e939/0xcc1762b626f8b37c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189131.467250:0:26160:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009088e939/0xcc1762b626f8b37c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189131.467257:0:26160:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009088e939/0xcc1762b626f8b37c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189131.467264:0:26160:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/21 locks to regular blp list, 21 blwis in pool 00002000:00010000:3.0:1784189131.467296:0:26160:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6e8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784189131.467301:0:26160:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f0defe11/0xcc1762b626f8b383 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6e8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189131.467308:0:26160:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6e8:0x0].0x0 since=3373s v=(0 0) 00010000:00010000:3.0:1784189131.467311:0:26160:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6e8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784189131.467315:0:26160:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f0defe11/0xcc1762b626f8b383 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189131.467348:0:26160:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f0defe11/0xcc1762b626f8b383 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189131.467357:0:26160:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f0defe11/0xcc1762b626f8b383 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189131.467364:0:26160:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f0defe11/0xcc1762b626f8b383 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189131.467383:0:26160:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/22 locks to regular blp list, 22 blwis in pool 00002000:00010000:3.0:1784189131.467420:0:26160:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6e7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784189131.467425:0:26160:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008953f819/0xcc1762b626f8b38a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6e7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189131.467433:0:26160:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6e7:0x0].0x0 since=3373s v=(0 0) 00010000:00010000:3.0:1784189131.467436:0:26160:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6e7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784189131.467439:0:26160:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008953f819/0xcc1762b626f8b38a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189131.467447:0:26160:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008953f819/0xcc1762b626f8b38a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189131.467454:0:26160:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008953f819/0xcc1762b626f8b38a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189131.467827:0:7454:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 21 total in blp. (21 blwis in pool) 00010000:00010000:2.0:1784189131.467834:0:7454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000051238ad7/0xcc1762b626f8b2f0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189131.467843:0:7454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc04a20a600 already unused, calling callback (ffffffffc0b2e230) 00010000:00010000:2.0:1784189131.467847:0:7454:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000051238ad7/0xcc1762b626f8b2f0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189131.467856:0:7454:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000051238ad7/0xcc1762b626f8b2f0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189131.467873:0:7454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000051238ad7/0xcc1762b626f8b2f0 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189131.467881:0:7454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000051238ad7/0xcc1762b626f8b2f0 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189131.467897:0:7454:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 20 total in blp. (20 blwis in pool) 00010000:00010000:2.0:1784189131.467900:0:7454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009d2fcfa0/0xcc1762b626f8b2f7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189131.467915:0:7454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc04a20b000 already unused, calling callback (ffffffffc0b2e230) 00010000:00010000:2.0:1784189131.467918:0:7454:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009d2fcfa0/0xcc1762b626f8b2f7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189131.467925:0:7454:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009d2fcfa0/0xcc1762b626f8b2f7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189131.467937:0:7454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009d2fcfa0/0xcc1762b626f8b2f7 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189131.467945:0:7454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009d2fcfa0/0xcc1762b626f8b2f7 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189131.467958:0:7454:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 19 total in blp. (19 blwis in pool) 00010000:00010000:2.0:1784189131.467962:0:7454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000cf75c475/0xcc1762b626f8b2fe lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189131.467968:0:7454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc04a20ac00 already unused, calling callback (ffffffffc0b2e230) 00010000:00010000:2.0:1784189131.467971:0:7454:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000cf75c475/0xcc1762b626f8b2fe lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189131.467979:0:7454:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000cf75c475/0xcc1762b626f8b2fe lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189131.467988:0:7454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000cf75c475/0xcc1762b626f8b2fe lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189131.468001:0:7454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cf75c475/0xcc1762b626f8b2fe lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189131.468015:0:7454:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 18 total in blp. (18 blwis in pool) 00010000:00010000:2.0:1784189131.468019:0:7454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c24bc63e/0xcc1762b626f8b305 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189131.468025:0:7454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc04a20b800 already unused, calling callback (ffffffffc0b2e230) 00010000:00010000:2.0:1784189131.468029:0:7454:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c24bc63e/0xcc1762b626f8b305 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189131.468037:0:7454:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c24bc63e/0xcc1762b626f8b305 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189131.468048:0:7454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c24bc63e/0xcc1762b626f8b305 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189131.468055:0:7454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c24bc63e/0xcc1762b626f8b305 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189131.468066:0:7454:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 17 total in blp. (17 blwis in pool) 00010000:00010000:2.0:1784189131.468070:0:7454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d66bdbcc/0xcc1762b626f8b30c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189131.468077:0:7454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc04a20a400 already unused, calling callback (ffffffffc0b2e230) 00010000:00010000:2.0:1784189131.468085:0:7454:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d66bdbcc/0xcc1762b626f8b30c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189131.468093:0:7454:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d66bdbcc/0xcc1762b626f8b30c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189131.468104:0:7454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d66bdbcc/0xcc1762b626f8b30c lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189131.468111:0:7454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d66bdbcc/0xcc1762b626f8b30c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189131.468123:0:7454:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 16 total in blp. (16 blwis in pool) 00010000:00010000:2.0:1784189131.468126:0:7454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c6b3e208/0xcc1762b626f8b313 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189131.468131:0:7454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc04a20ba00 already unused, calling callback (ffffffffc0b2e230) 00010000:00010000:2.0:1784189131.468135:0:7454:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c6b3e208/0xcc1762b626f8b313 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189131.468141:0:7454:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c6b3e208/0xcc1762b626f8b313 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189131.468148:0:7454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c6b3e208/0xcc1762b626f8b313 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189131.468154:0:7454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c6b3e208/0xcc1762b626f8b313 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189131.468173:0:7454:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 15 total in blp. (15 blwis in pool) 00010000:00010000:2.0:1784189131.468177:0:7454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000456ffdbd/0xcc1762b626f8b31a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189131.468184:0:7454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc04a20a000 already unused, calling callback (ffffffffc0b2e230) 00010000:00010000:2.0:1784189131.468187:0:7454:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000456ffdbd/0xcc1762b626f8b31a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189131.468194:0:7454:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000456ffdbd/0xcc1762b626f8b31a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189131.468204:0:7454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000456ffdbd/0xcc1762b626f8b31a lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189131.468212:0:7454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000456ffdbd/0xcc1762b626f8b31a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189131.468223:0:7454:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 14 total in blp. (14 blwis in pool) 00010000:00010000:2.0:1784189131.468227:0:7454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009430fa1b/0xcc1762b626f8b321 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189131.468233:0:7454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc04a20b200 already unused, calling callback (ffffffffc0b2e230) 00010000:00010000:2.0:1784189131.468237:0:7454:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009430fa1b/0xcc1762b626f8b321 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189131.468255:0:7454:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009430fa1b/0xcc1762b626f8b321 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189131.468266:0:7454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009430fa1b/0xcc1762b626f8b321 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189131.468274:0:7454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009430fa1b/0xcc1762b626f8b321 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189131.468287:0:7454:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 13 total in blp. (13 blwis in pool) 00010000:00010000:2.0:1784189131.468290:0:7454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000041e819fd/0xcc1762b626f8b328 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189131.468297:0:7454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc04a20a200 already unused, calling callback (ffffffffc0b2e230) 00010000:00010000:2.0:1784189131.468300:0:7454:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000041e819fd/0xcc1762b626f8b328 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189131.468308:0:7454:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000041e819fd/0xcc1762b626f8b328 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189131.468335:0:7454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000041e819fd/0xcc1762b626f8b328 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189131.468343:0:7454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000041e819fd/0xcc1762b626f8b328 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189131.468369:0:7454:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 12 total in blp. (12 blwis in pool) 00010000:00010000:2.0:1784189131.468372:0:7454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f87d4f57/0xcc1762b626f8b32f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189131.468379:0:7454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc04a20aa00 already unused, calling callback (ffffffffc0b2e230) 00010000:00010000:2.0:1784189131.468382:0:7454:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f87d4f57/0xcc1762b626f8b32f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189131.468390:0:7454:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f87d4f57/0xcc1762b626f8b32f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189131.468400:0:7454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f87d4f57/0xcc1762b626f8b32f lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189131.468407:0:7454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f87d4f57/0xcc1762b626f8b32f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189131.468419:0:7454:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 11 total in blp. (11 blwis in pool) 00010000:00010000:2.0:1784189131.468423:0:7454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000a3ed8d4/0xcc1762b626f8b336 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189131.468429:0:7454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc04a20bc00 already unused, calling callback (ffffffffc0b2e230) 00010000:00010000:2.0:1784189131.468433:0:7454:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000a3ed8d4/0xcc1762b626f8b336 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189131.468451:0:7454:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000a3ed8d4/0xcc1762b626f8b336 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189131.468474:0:7454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000a3ed8d4/0xcc1762b626f8b336 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189131.468481:0:7454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000a3ed8d4/0xcc1762b626f8b336 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189131.468494:0:7454:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 10 total in blp. (10 blwis in pool) 00010000:00010000:2.0:1784189131.468498:0:7454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003341b3a2/0xcc1762b626f8b33d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189131.468504:0:7454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc04a20b600 already unused, calling callback (ffffffffc0b2e230) 00010000:00010000:2.0:1784189131.468507:0:7454:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003341b3a2/0xcc1762b626f8b33d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189131.468515:0:7454:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003341b3a2/0xcc1762b626f8b33d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189131.468525:0:7454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003341b3a2/0xcc1762b626f8b33d lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189131.468532:0:7454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003341b3a2/0xcc1762b626f8b33d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189131.468555:0:7454:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 9 total in blp. (9 blwis in pool) 00010000:00010000:2.0:1784189131.468559:0:7454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005850ddb8/0xcc1762b626f8b344 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189131.468565:0:7454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc04a20b400 already unused, calling callback (ffffffffc0b2e230) 00010000:00010000:2.0:1784189131.468569:0:7454:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005850ddb8/0xcc1762b626f8b344 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189131.468655:0:7454:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005850ddb8/0xcc1762b626f8b344 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189131.468667:0:7454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005850ddb8/0xcc1762b626f8b344 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189131.468674:0:7454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005850ddb8/0xcc1762b626f8b344 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189131.468688:0:7454:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 8 total in blp. (8 blwis in pool) 00010000:00010000:2.0:1784189131.468691:0:7454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000039fec00f/0xcc1762b626f8b34b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189131.468698:0:7454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc04a20ae00 already unused, calling callback (ffffffffc0b2e230) 00010000:00010000:2.0:1784189131.468701:0:7454:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000039fec00f/0xcc1762b626f8b34b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189131.468719:0:7454:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000039fec00f/0xcc1762b626f8b34b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189131.468731:0:7454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000039fec00f/0xcc1762b626f8b34b lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189131.468737:0:7454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000039fec00f/0xcc1762b626f8b34b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189131.468750:0:7454:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 7 total in blp. (7 blwis in pool) 00010000:00010000:2.0:1784189131.468754:0:7454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d93d2bda/0xcc1762b626f8b352 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189131.468759:0:7454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc04a20be00 already unused, calling callback (ffffffffc0b2e230) 00010000:00010000:2.0:1784189131.468762:0:7454:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d93d2bda/0xcc1762b626f8b352 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189131.468769:0:7454:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d93d2bda/0xcc1762b626f8b352 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189131.468777:0:7454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d93d2bda/0xcc1762b626f8b352 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189131.468783:0:7454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d93d2bda/0xcc1762b626f8b352 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189131.468805:0:7454:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:2.0:1784189131.468809:0:7454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000b9d4674/0xcc1762b626f8b359 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189131.468814:0:7454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc04a20a800 already unused, calling callback (ffffffffc0b2e230) 00010000:00010000:2.0:1784189131.468817:0:7454:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000b9d4674/0xcc1762b626f8b359 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189131.468824:0:7454:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000b9d4674/0xcc1762b626f8b359 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189131.468834:0:7454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000b9d4674/0xcc1762b626f8b359 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189131.468840:0:7454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000b9d4674/0xcc1762b626f8b359 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189131.468851:0:7454:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:2.0:1784189131.468854:0:7454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000bd7d33cb/0xcc1762b626f8b360 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189131.468859:0:7454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc058f66a00 already unused, calling callback (ffffffffc0b2e230) 00010000:00010000:2.0:1784189131.468862:0:7454:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000bd7d33cb/0xcc1762b626f8b360 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189131.468880:0:7454:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000bd7d33cb/0xcc1762b626f8b360 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189131.468890:0:7454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000bd7d33cb/0xcc1762b626f8b360 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189131.468896:0:7454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bd7d33cb/0xcc1762b626f8b360 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189131.468908:0:7454:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:2.0:1784189131.468911:0:7454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c2da6eae/0xcc1762b626f8b367 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189131.468917:0:7454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc058f66e00 already unused, calling callback (ffffffffc0b2e230) 00010000:00010000:2.0:1784189131.468919:0:7454:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c2da6eae/0xcc1762b626f8b367 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189131.468926:0:7454:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c2da6eae/0xcc1762b626f8b367 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189131.468934:0:7454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c2da6eae/0xcc1762b626f8b367 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189131.468940:0:7454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c2da6eae/0xcc1762b626f8b367 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189131.468961:0:7454:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1784189131.468964:0:7454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b7722a60/0xcc1762b626f8b36e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189131.468971:0:7454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc058f67a00 already unused, calling callback (ffffffffc0b2e230) 00010000:00010000:2.0:1784189131.468973:0:7454:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b7722a60/0xcc1762b626f8b36e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189131.468980:0:7454:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b7722a60/0xcc1762b626f8b36e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189131.468989:0:7454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b7722a60/0xcc1762b626f8b36e lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189131.468995:0:7454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b7722a60/0xcc1762b626f8b36e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189131.469006:0:7454:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1784189131.469009:0:7454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b0b2f133/0xcc1762b626f8b375 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189131.469014:0:7454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc058f67e00 already unused, calling callback (ffffffffc0b2e230) 00010000:00010000:2.0:1784189131.469017:0:7454:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b0b2f133/0xcc1762b626f8b375 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189131.469035:0:7454:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b0b2f133/0xcc1762b626f8b375 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189131.469045:0:7454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b0b2f133/0xcc1762b626f8b375 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189131.469052:0:7454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b0b2f133/0xcc1762b626f8b375 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189131.469063:0:7454:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1784189131.469067:0:7454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009088e939/0xcc1762b626f8b37c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189131.469073:0:7454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc058f67c00 already unused, calling callback (ffffffffc0b2e230) 00010000:00010000:2.0:1784189131.469075:0:7454:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009088e939/0xcc1762b626f8b37c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189131.469082:0:7454:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009088e939/0xcc1762b626f8b37c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189131.469091:0:7454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009088e939/0xcc1762b626f8b37c lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189131.469099:0:7454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009088e939/0xcc1762b626f8b37c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189131.469121:0:7454:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784189131.469124:0:7454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f0defe11/0xcc1762b626f8b383 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189131.469130:0:7454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc058f66800 already unused, calling callback (ffffffffc0b2e230) 00010000:00010000:2.0:1784189131.469134:0:7454:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f0defe11/0xcc1762b626f8b383 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189131.469141:0:7454:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f0defe11/0xcc1762b626f8b383 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189131.469151:0:7454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f0defe11/0xcc1762b626f8b383 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189131.469158:0:7454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f0defe11/0xcc1762b626f8b383 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189131.469169:0:7454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784189131.469171:0:7454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784189131.469173:0:7454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784189131.469359:0:26160:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008953f819/0xcc1762b626f8b38a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189131.469380:0:26160:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1784189131.469499:0:26160:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6e6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784189131.469506:0:26160:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000091484d86/0xcc1762b626f8b391 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6e6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189131.469517:0:26160:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6e6:0x0].0x0 since=3373s v=(0 0) 00010000:00010000:3.0:1784189131.469528:0:26160:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6e6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784189131.469536:0:26160:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000091484d86/0xcc1762b626f8b391 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189131.469549:0:26160:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000091484d86/0xcc1762b626f8b391 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189131.469558:0:26160:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000091484d86/0xcc1762b626f8b391 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189131.469565:0:26160:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000091484d86/0xcc1762b626f8b391 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189131.469587:0:26160:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:3.0:1784189131.469628:0:26160:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6e5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784189131.469633:0:26160:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002c372dcd/0xcc1762b626f8b398 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6e5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189131.469641:0:26160:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6e5:0x0].0x0 since=3373s v=(0 0) 00010000:00010000:3.0:1784189131.469644:0:26160:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6e5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784189131.469648:0:26160:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002c372dcd/0xcc1762b626f8b398 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189131.469657:0:26160:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002c372dcd/0xcc1762b626f8b398 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189131.469666:0:26160:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002c372dcd/0xcc1762b626f8b398 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189131.469679:0:26160:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002c372dcd/0xcc1762b626f8b398 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189131.469687:0:26160:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:3.0:1784189131.469724:0:26160:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6e4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784189131.469730:0:26160:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c616f61f/0xcc1762b626f8b39f lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6e4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189131.469737:0:26160:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6e4:0x0].0x0 since=3373s v=(0 0) 00010000:00010000:3.0:1784189131.469740:0:26160:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6e4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784189131.469743:0:26160:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c616f61f/0xcc1762b626f8b39f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189131.469751:0:26160:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c616f61f/0xcc1762b626f8b39f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189131.469759:0:26160:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c616f61f/0xcc1762b626f8b39f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189131.469765:0:26160:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c616f61f/0xcc1762b626f8b39f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189131.469773:0:26160:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00002000:00010000:3.0:1784189131.469822:0:26160:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6e3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784189131.469827:0:26160:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000087630e62/0xcc1762b626f8b3a6 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6e3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189131.469840:0:26160:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6e3:0x0].0x0 since=3373s v=(0 0) 00010000:00010000:3.0:1784189131.469843:0:26160:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6e3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784189131.469847:0:26160:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000087630e62/0xcc1762b626f8b3a6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189131.469856:0:26160:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000087630e62/0xcc1762b626f8b3a6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189131.469864:0:26160:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000087630e62/0xcc1762b626f8b3a6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189131.469872:0:26160:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000087630e62/0xcc1762b626f8b3a6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189131.469880:0:26160:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00002000:00010000:3.0:1784189131.469917:0:26160:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6e2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784189131.469921:0:26160:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009d1fdfd7/0xcc1762b626f8b3ad lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6e2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189131.469929:0:26160:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6e2:0x0].0x0 since=3373s v=(0 0) 00010000:00010000:3.0:1784189131.469932:0:26160:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6e2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784189131.469936:0:26160:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009d1fdfd7/0xcc1762b626f8b3ad lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189131.469944:0:26160:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009d1fdfd7/0xcc1762b626f8b3ad lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189131.469963:0:26160:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009d1fdfd7/0xcc1762b626f8b3ad lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189131.469970:0:26160:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009d1fdfd7/0xcc1762b626f8b3ad lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189131.469979:0:26160:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to regular blp list, 6 blwis in pool 00010000:00010000:1.0:1784189131.470525:0:26173:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:1.0:1784189131.470531:0:26173:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008953f819/0xcc1762b626f8b38a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189131.470541:0:26173:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc058f66400 already unused, calling callback (ffffffffc0b2e230) 00010000:00010000:1.0:1784189131.470545:0:26173:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008953f819/0xcc1762b626f8b38a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189131.470554:0:26173:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008953f819/0xcc1762b626f8b38a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189131.470569:0:26173:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008953f819/0xcc1762b626f8b38a lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189131.470577:0:26173:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008953f819/0xcc1762b626f8b38a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00080000:3.0:1784189131.470580:0:26160:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x2c0000401:1666 00010000:00010000:1.0:1784189131.470592:0:26173:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:1.0:1784189131.470595:0:26173:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000091484d86/0xcc1762b626f8b391 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189131.470608:0:26173:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc058f67600 already unused, calling callback (ffffffffc0b2e230) 00010000:00010000:1.0:1784189131.470611:0:26173:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000091484d86/0xcc1762b626f8b391 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189131.470617:0:26173:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000091484d86/0xcc1762b626f8b391 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189131.470626:0:26173:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000091484d86/0xcc1762b626f8b391 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189131.470632:0:26173:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000091484d86/0xcc1762b626f8b391 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189131.470643:0:26173:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:1.0:1784189131.470646:0:26173:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002c372dcd/0xcc1762b626f8b398 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189131.470651:0:26173:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc058f66000 already unused, calling callback (ffffffffc0b2e230) 00010000:00010000:1.0:1784189131.470654:0:26173:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002c372dcd/0xcc1762b626f8b398 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189131.470660:0:26173:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002c372dcd/0xcc1762b626f8b398 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784189131.470664:0:26160:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc07b5e0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+6:88984:x1870854458103680:12345-0@lo:5:osp-pre-1-0.0 Request processed in 22784us (24459us total) trans 0 rc 0/0 00010000:00010000:1.0:1784189131.470669:0:26173:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002c372dcd/0xcc1762b626f8b398 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784189131.470674:0:26160:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4945 00010000:00010000:1.0:1784189131.470681:0:26173:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002c372dcd/0xcc1762b626f8b398 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189131.470692:0:26173:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1784189131.470695:0:26173:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c616f61f/0xcc1762b626f8b39f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189131.470701:0:26173:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc058f66c00 already unused, calling callback (ffffffffc0b2e230) 00010000:00010000:1.0:1784189131.470703:0:26173:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c616f61f/0xcc1762b626f8b39f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189131.470710:0:26173:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c616f61f/0xcc1762b626f8b39f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189131.470718:0:26173:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c616f61f/0xcc1762b626f8b39f lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784189131.470725:0:88984:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc07b5e2d80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:88984:1870854458103680:0@lo:5:osp-pre-1-0.0 00010000:00010000:1.0:1784189131.470726:0:26173:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c616f61f/0xcc1762b626f8b39f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189131.470735:0:26173:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1784189131.470738:0:26173:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000087630e62/0xcc1762b626f8b3a6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1784189131.470739:0:88984:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x2c0000401:0x701:0x0] from OST, last_created [0x2c0000401:0x701:0x0]last_used is [0x2c0000401:0x682:0x0] 00010000:00010000:1.0:1784189131.470745:0:26173:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc058f66600 already unused, calling callback (ffffffffc0b2e230) 00010000:00010000:1.0:1784189131.470752:0:26173:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000087630e62/0xcc1762b626f8b3a6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189131.470759:0:26173:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000087630e62/0xcc1762b626f8b3a6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189131.470768:0:26173:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000087630e62/0xcc1762b626f8b3a6 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189131.470774:0:26173:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000087630e62/0xcc1762b626f8b3a6 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189131.470786:0:26173:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784189131.470789:0:26173:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009d1fdfd7/0xcc1762b626f8b3ad lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189131.470794:0:26173:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc058f67400 already unused, calling callback (ffffffffc0b2e230) 00000100:00100000:3.0:1784189131.470797:0:88984:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc07b5e3480 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:88984:1870854458104064:0@lo:5:osp-pre-1-0.0 00010000:00010000:1.0:1784189131.470798:0:26173:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009d1fdfd7/0xcc1762b626f8b3ad lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189131.470804:0:26173:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009d1fdfd7/0xcc1762b626f8b3ad lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189131.470812:0:26173:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009d1fdfd7/0xcc1762b626f8b3ad lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189131.470818:0:26173:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009d1fdfd7/0xcc1762b626f8b3ad lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784189131.470828:0:88984:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1784189131.470836:0:26173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784189131.470838:0:26173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784189131.470840:0:26173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784189131.470847:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784189131.470848:0:88984:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dbf422f46c0 going to sleep for 11 seconds 00000100:00100000:3.0:1784189131.470862:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc07b5e2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1870854458103936:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1784189131.470885:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784189131.470911:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458103936 00000100:00100000:1.0:1784189131.470918:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458103936 00000100:00100000:3.0:1784189131.470920:0:26160:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458104064 00000100:00100000:3.0:1784189131.470923:0:26160:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458104064 00000100:00100000:3.0:1784189131.470949:0:26160:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4947 00000100:00100000:1.0:1784189131.470949:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1928 00000100:00100000:3.0:1784189131.470956:0:26160:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc0505be300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+7:88984:x1870854458104064:12345-0@lo:5:osp-pre-1-0.0 00000100:00100000:1.0:1784189131.470956:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc081f81880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3640:x1870854458103936:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1784189131.470974:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 212800 pending 0 free 3923529728 avail 3692007424 00002000:00080000:3.0:1784189131.470985:0:26160:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000401 at 1794 00000100:00100000:1.0:1784189131.471010:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc081f81880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3640:x1870854458103936:12345-0@lo:13:osp-pre-1-0.0 Request processed in 54us (124us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189131.471016:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1928 00000100:00100000:1.0:1784189131.471049:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc07b5e2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1870854458103936:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1784189131.472384:0:7454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784189131.473083:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1784189131.473105:0:8429:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x701:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784189131.473114:0:8429:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d9b1520e/0xcc1762b626f8b3b4 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x701:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189131.473129:0:8429:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x701:0x0].0x0 since=3373s v=(0 0) 00010000:00010000:0.0:1784189131.473133:0:8429:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x701:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784189131.473139:0:8429:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d9b1520e/0xcc1762b626f8b3b4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x701:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189131.473154:0:8429:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d9b1520e/0xcc1762b626f8b3b4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x701:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189131.473163:0:8429:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d9b1520e/0xcc1762b626f8b3b4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x701:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189131.473170:0:8429:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d9b1520e/0xcc1762b626f8b3b4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x701:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189131.473196:0:8429:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1784189131.473201:0:26173:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784189131.473207:0:26173:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d9b1520e/0xcc1762b626f8b3b4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x701:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189131.473214:0:26173:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dbf4369d000 already unused, calling callback (ffffffffc0b2e230) 00010000:00010000:2.0:1784189131.473225:0:26173:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d9b1520e/0xcc1762b626f8b3b4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x701:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189131.473234:0:26173:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d9b1520e/0xcc1762b626f8b3b4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x701:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189131.473248:0:26173:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d9b1520e/0xcc1762b626f8b3b4 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x701:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189131.473256:0:26173:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d9b1520e/0xcc1762b626f8b3b4 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x701:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189131.473272:0:26173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784189131.473274:0:26173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784189131.473276:0:26173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1784189131.473282:0:8429:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x700:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784189131.473287:0:8429:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ad1773fd/0xcc1762b626f8b3bb lrc: 3/0,1 mode: --/PW res: [0x280000401:0x700:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189131.473295:0:8429:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x700:0x0].0x0 since=3373s v=(0 0) 00010000:00010000:0.0:1784189131.473298:0:8429:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x700:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784189131.473302:0:8429:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ad1773fd/0xcc1762b626f8b3bb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x700:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189131.473311:0:8429:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ad1773fd/0xcc1762b626f8b3bb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x700:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189131.473350:0:8429:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ad1773fd/0xcc1762b626f8b3bb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x700:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189131.473358:0:8429:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ad1773fd/0xcc1762b626f8b3bb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x700:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189131.473387:0:8429:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1784189131.473393:0:6501:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784189131.473397:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ad1773fd/0xcc1762b626f8b3bb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x700:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189131.473403:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dbf4369d200 already unused, calling callback (ffffffffc0b2e230) 00010000:00010000:0.0:1784189131.473411:0:6501:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ad1773fd/0xcc1762b626f8b3bb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x700:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189131.473420:0:6501:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ad1773fd/0xcc1762b626f8b3bb lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x700:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189131.473430:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ad1773fd/0xcc1762b626f8b3bb lrc: 1/0,0 mode: --/PW res: [0x280000401:0x700:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189131.473436:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ad1773fd/0xcc1762b626f8b3bb lrc: 0/0,0 mode: --/PW res: [0x280000401:0x700:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189131.473448:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784189131.473449:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784189131.473451:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1784189131.474348:0:8429:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6ff:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784189131.474356:0:8429:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003b91f60d/0xcc1762b626f8b3c2 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6ff:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189131.474368:0:8429:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6ff:0x0].0x0 since=3373s v=(0 0) 00010000:00010000:1.0:1784189131.474372:0:8429:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6ff:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784189131.474377:0:8429:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003b91f60d/0xcc1762b626f8b3c2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189131.474387:0:8429:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003b91f60d/0xcc1762b626f8b3c2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189131.474407:0:8429:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003b91f60d/0xcc1762b626f8b3c2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189131.474414:0:8429:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003b91f60d/0xcc1762b626f8b3c2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189131.474428:0:8429:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1784189131.474436:0:7454:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784189131.474441:0:7454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003b91f60d/0xcc1762b626f8b3c2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189131.474448:0:7454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc0565e7200 already unused, calling callback (ffffffffc0b2e230) 00010000:00010000:1.0:1784189131.474452:0:7454:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003b91f60d/0xcc1762b626f8b3c2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189131.474470:0:7454:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003b91f60d/0xcc1762b626f8b3c2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189131.474483:0:7454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003b91f60d/0xcc1762b626f8b3c2 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189131.474490:0:7454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003b91f60d/0xcc1762b626f8b3c2 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189131.474503:0:7454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784189131.474511:0:7454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784189131.474513:0:7454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1784189131.474562:0:8429:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6fe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784189131.474568:0:8429:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d1a99062/0xcc1762b626f8b3c9 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6fe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189131.474576:0:8429:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6fe:0x0].0x0 since=3373s v=(0 0) 00010000:00010000:1.0:1784189131.474579:0:8429:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6fe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784189131.474583:0:8429:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d1a99062/0xcc1762b626f8b3c9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189131.474593:0:8429:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d1a99062/0xcc1762b626f8b3c9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189131.474600:0:8429:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d1a99062/0xcc1762b626f8b3c9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189131.474606:0:8429:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d1a99062/0xcc1762b626f8b3c9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189131.474623:0:8429:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1784189131.474660:0:8429:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6fd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784189131.474665:0:8429:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fefded14/0xcc1762b626f8b3d0 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6fd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189131.474672:0:8429:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6fd:0x0].0x0 since=3373s v=(0 0) 00010000:00010000:1.0:1784189131.474675:0:8429:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6fd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784189131.474679:0:8429:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fefded14/0xcc1762b626f8b3d0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189131.474694:0:8429:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fefded14/0xcc1762b626f8b3d0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189131.474702:0:8429:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fefded14/0xcc1762b626f8b3d0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00100000:3.0:1784189131.474707:0:9506:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:1.0:1784189131.474709:0:8429:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fefded14/0xcc1762b626f8b3d0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189131.474720:0:8429:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1784189131.474726:0:26173:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1784189131.474730:0:26173:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d1a99062/0xcc1762b626f8b3c9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189131.474736:0:26173:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc0565e6a00 already unused, calling callback (ffffffffc0b2e230) 00010000:00010000:1.0:1784189131.474739:0:26173:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d1a99062/0xcc1762b626f8b3c9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189131.474746:0:26173:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d1a99062/0xcc1762b626f8b3c9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189131.474756:0:26173:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d1a99062/0xcc1762b626f8b3c9 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189131.474763:0:26173:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d1a99062/0xcc1762b626f8b3c9 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189131.474779:0:26173:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784189131.474782:0:26173:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fefded14/0xcc1762b626f8b3d0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189131.474789:0:26173:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc0565e7800 already unused, calling callback (ffffffffc0b2e230) 00010000:00010000:1.0:1784189131.474792:0:26173:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fefded14/0xcc1762b626f8b3d0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189131.474798:0:26173:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fefded14/0xcc1762b626f8b3d0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189131.474807:0:26173:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fefded14/0xcc1762b626f8b3d0 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189131.474814:0:26173:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fefded14/0xcc1762b626f8b3d0 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189131.474823:0:26173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784189131.474824:0:26173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784189131.474826:0:26173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1784189131.474865:0:8429:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6fc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784189131.474871:0:8429:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000070c36b38/0xcc1762b626f8b3d7 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6fc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189131.474880:0:8429:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6fc:0x0].0x0 since=3373s v=(0 0) 00010000:00010000:1.0:1784189131.474888:0:8429:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6fc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784189131.474894:0:8429:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000070c36b38/0xcc1762b626f8b3d7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189131.474903:0:8429:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000070c36b38/0xcc1762b626f8b3d7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189131.474911:0:8429:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000070c36b38/0xcc1762b626f8b3d7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189131.474919:0:8429:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000070c36b38/0xcc1762b626f8b3d7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189131.474933:0:8429:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1784189131.474940:0:6501:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784189131.474945:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000070c36b38/0xcc1762b626f8b3d7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189131.474952:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc0565e7600 already unused, calling callback (ffffffffc0b2e230) 00010000:00010000:1.0:1784189131.474956:0:6501:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000070c36b38/0xcc1762b626f8b3d7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189131.474963:0:6501:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000070c36b38/0xcc1762b626f8b3d7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189131.474974:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000070c36b38/0xcc1762b626f8b3d7 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189131.474992:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000070c36b38/0xcc1762b626f8b3d7 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189131.475005:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784189131.475007:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784189131.475008:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1784189131.475049:0:8429:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6fb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784189131.475054:0:8429:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a7eb9d01/0xcc1762b626f8b3de lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6fb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189131.475063:0:8429:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6fb:0x0].0x0 since=3373s v=(0 0) 00010000:00010000:1.0:1784189131.475065:0:8429:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6fb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784189131.475070:0:8429:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a7eb9d01/0xcc1762b626f8b3de lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189131.475080:0:8429:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a7eb9d01/0xcc1762b626f8b3de lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189131.475088:0:8429:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a7eb9d01/0xcc1762b626f8b3de lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189131.475095:0:8429:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a7eb9d01/0xcc1762b626f8b3de lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189131.475106:0:8429:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1784189131.475112:0:7454:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784189131.475121:0:7454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a7eb9d01/0xcc1762b626f8b3de lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189131.475128:0:7454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc0565e6800 already unused, calling callback (ffffffffc0b2e230) 00010000:00010000:1.0:1784189131.475131:0:7454:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a7eb9d01/0xcc1762b626f8b3de lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189131.475139:0:7454:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a7eb9d01/0xcc1762b626f8b3de lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189131.475149:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784189131.475150:0:7454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a7eb9d01/0xcc1762b626f8b3de lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189131.475157:0:7454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a7eb9d01/0xcc1762b626f8b3de lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189131.475169:0:7454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784189131.475170:0:7454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784189131.475172:0:7454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1784189131.475213:0:8429:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6fa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784189131.475218:0:8429:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000da3166f3/0xcc1762b626f8b3e5 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6fa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189131.475226:0:8429:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6fa:0x0].0x0 since=3373s v=(0 0) 00010000:00010000:1.0:1784189131.475229:0:8429:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6fa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784189131.475233:0:8429:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000da3166f3/0xcc1762b626f8b3e5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189131.475254:0:8429:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000da3166f3/0xcc1762b626f8b3e5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189131.475262:0:8429:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000da3166f3/0xcc1762b626f8b3e5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189131.475269:0:8429:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000da3166f3/0xcc1762b626f8b3e5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189131.475290:0:8429:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1784189131.475354:0:8429:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6f9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784189131.475360:0:8429:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000a795375/0xcc1762b626f8b3ec lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6f9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189131.475368:0:8429:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6f9:0x0].0x0 since=3373s v=(0 0) 00010000:00010000:1.0:1784189131.475371:0:8429:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6f9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784189131.475376:0:8429:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000a795375/0xcc1762b626f8b3ec lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189131.475384:0:8429:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000a795375/0xcc1762b626f8b3ec lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189131.475392:0:8429:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000a795375/0xcc1762b626f8b3ec lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189131.475411:0:8429:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000a795375/0xcc1762b626f8b3ec lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189131.475424:0:8429:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1784189131.475432:0:6501:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1784189131.475436:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000da3166f3/0xcc1762b626f8b3e5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189131.475442:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc0565e6e00 already unused, calling callback (ffffffffc0b2e230) 00010000:00010000:1.0:1784189131.475446:0:6501:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000da3166f3/0xcc1762b626f8b3e5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189131.475454:0:6501:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000da3166f3/0xcc1762b626f8b3e5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189131.475479:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000da3166f3/0xcc1762b626f8b3e5 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189131.475487:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000da3166f3/0xcc1762b626f8b3e5 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189131.475502:0:6501:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784189131.475505:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000a795375/0xcc1762b626f8b3ec lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189131.475524:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc0565e7000 already unused, calling callback (ffffffffc0b2e230) 00010000:00010000:1.0:1784189131.475527:0:6501:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000a795375/0xcc1762b626f8b3ec lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189131.475535:0:6501:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000a795375/0xcc1762b626f8b3ec lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189131.475546:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000a795375/0xcc1762b626f8b3ec lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189131.475553:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000a795375/0xcc1762b626f8b3ec lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189131.475565:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784189131.475567:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784189131.475568:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1784189131.475608:0:8429:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6f8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784189131.475613:0:8429:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006c76bcb1/0xcc1762b626f8b3f3 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6f8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189131.475621:0:8429:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6f8:0x0].0x0 since=3373s v=(0 0) 00010000:00010000:1.0:1784189131.475623:0:8429:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6f8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784189131.475627:0:8429:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006c76bcb1/0xcc1762b626f8b3f3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189131.475636:0:8429:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006c76bcb1/0xcc1762b626f8b3f3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189131.475650:0:8429:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006c76bcb1/0xcc1762b626f8b3f3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189131.475657:0:8429:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006c76bcb1/0xcc1762b626f8b3f3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189131.475671:0:8429:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1784189131.475677:0:6502:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784189131.475681:0:6502:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006c76bcb1/0xcc1762b626f8b3f3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189131.475688:0:6502:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc07116fe00 already unused, calling callback (ffffffffc0b2e230) 00010000:00010000:1.0:1784189131.475691:0:6502:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006c76bcb1/0xcc1762b626f8b3f3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189131.475699:0:6502:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006c76bcb1/0xcc1762b626f8b3f3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189131.475710:0:6502:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006c76bcb1/0xcc1762b626f8b3f3 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189131.475717:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006c76bcb1/0xcc1762b626f8b3f3 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189131.475729:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784189131.475736:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784189131.475737:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1784189131.475775:0:8429:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6f7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784189131.475780:0:8429:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d638fecc/0xcc1762b626f8b3fa lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6f7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189131.475788:0:8429:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6f7:0x0].0x0 since=3373s v=(0 0) 00010000:00010000:1.0:1784189131.475791:0:8429:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6f7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784189131.475795:0:8429:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d638fecc/0xcc1762b626f8b3fa lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189131.475803:0:8429:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d638fecc/0xcc1762b626f8b3fa lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189131.475811:0:8429:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d638fecc/0xcc1762b626f8b3fa lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189131.475818:0:8429:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d638fecc/0xcc1762b626f8b3fa lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189131.475828:0:8429:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1784189131.475833:0:7454:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784189131.475836:0:7454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d638fecc/0xcc1762b626f8b3fa lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189131.475843:0:7454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc07116f600 already unused, calling callback (ffffffffc0b2e230) 00010000:00010000:1.0:1784189131.475846:0:7454:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d638fecc/0xcc1762b626f8b3fa lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189131.475851:0:26173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784189131.475863:0:7454:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d638fecc/0xcc1762b626f8b3fa lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189131.475874:0:7454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d638fecc/0xcc1762b626f8b3fa lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189131.475881:0:7454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d638fecc/0xcc1762b626f8b3fa lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189131.475894:0:7454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784189131.475895:0:7454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784189131.475897:0:7454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1784189131.475933:0:8429:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6f6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784189131.475937:0:8429:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000022fa77b/0xcc1762b626f8b401 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6f6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189131.475944:0:8429:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6f6:0x0].0x0 since=3373s v=(0 0) 00010000:00010000:1.0:1784189131.475947:0:8429:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6f6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784189131.475950:0:8429:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000022fa77b/0xcc1762b626f8b401 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189131.475958:0:8429:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000022fa77b/0xcc1762b626f8b401 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189131.475965:0:8429:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000022fa77b/0xcc1762b626f8b401 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189131.475977:0:8429:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000022fa77b/0xcc1762b626f8b401 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189131.475988:0:8429:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1784189131.475995:0:6501:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784189131.475998:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000022fa77b/0xcc1762b626f8b401 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189131.476005:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc07116f000 already unused, calling callback (ffffffffc0b2e230) 00010000:00010000:1.0:1784189131.476008:0:6501:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000022fa77b/0xcc1762b626f8b401 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189131.476016:0:6501:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000022fa77b/0xcc1762b626f8b401 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189131.476026:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000022fa77b/0xcc1762b626f8b401 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189131.476033:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000022fa77b/0xcc1762b626f8b401 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189131.476046:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784189131.476047:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784189131.476049:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1784189131.476089:0:8429:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6f5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784189131.476101:0:8429:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000006c4aa/0xcc1762b626f8b408 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6f5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189131.476109:0:8429:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6f5:0x0].0x0 since=3373s v=(0 0) 00010000:00010000:1.0:1784189131.476112:0:8429:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6f5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784189131.476116:0:8429:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000006c4aa/0xcc1762b626f8b408 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189131.476125:0:8429:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000006c4aa/0xcc1762b626f8b408 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189131.476133:0:8429:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000006c4aa/0xcc1762b626f8b408 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189131.476140:0:8429:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000006c4aa/0xcc1762b626f8b408 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189131.476151:0:8429:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1784189131.476157:0:6502:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784189131.476161:0:6502:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000006c4aa/0xcc1762b626f8b408 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189131.476168:0:6502:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc07116e400 already unused, calling callback (ffffffffc0b2e230) 00010000:00010000:1.0:1784189131.476171:0:6502:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000006c4aa/0xcc1762b626f8b408 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189131.476177:0:6502:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000006c4aa/0xcc1762b626f8b408 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189131.476194:0:6502:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000006c4aa/0xcc1762b626f8b408 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00100000:3.0:1784189131.476198:0:8423:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:1.0:1784189131.476201:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000006c4aa/0xcc1762b626f8b408 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189131.476212:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784189131.476214:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784189131.476216:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1784189131.476256:0:8429:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6f4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784189131.476261:0:8429:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d7af1b89/0xcc1762b626f8b40f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6f4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189131.476269:0:8429:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6f4:0x0].0x0 since=3373s v=(0 0) 00010000:00010000:1.0:1784189131.476272:0:8429:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6f4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784189131.476276:0:8429:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d7af1b89/0xcc1762b626f8b40f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189131.476285:0:8429:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d7af1b89/0xcc1762b626f8b40f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189131.476293:0:8429:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d7af1b89/0xcc1762b626f8b40f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189131.476300:0:8429:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d7af1b89/0xcc1762b626f8b40f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189131.476336:0:8429:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1784189131.476366:0:26173:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784189131.476371:0:26173:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d7af1b89/0xcc1762b626f8b40f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1784189131.476374:0:8429:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6f3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784189131.476379:0:26173:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc07116f800 already unused, calling callback (ffffffffc0b2e230) 00010000:00010000:1.0:1784189131.476379:0:8429:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000033b48b6c/0xcc1762b626f8b416 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6f3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189131.476383:0:26173:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d7af1b89/0xcc1762b626f8b40f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189131.476386:0:8429:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6f3:0x0].0x0 since=3373s v=(0 0) 00010000:00010000:1.0:1784189131.476390:0:8429:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6f3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784189131.476391:0:26173:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d7af1b89/0xcc1762b626f8b40f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189131.476394:0:8429:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000033b48b6c/0xcc1762b626f8b416 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189131.476403:0:8429:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000033b48b6c/0xcc1762b626f8b416 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189131.476404:0:26173:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d7af1b89/0xcc1762b626f8b40f lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189131.476412:0:26173:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d7af1b89/0xcc1762b626f8b40f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189131.476412:0:8429:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000033b48b6c/0xcc1762b626f8b416 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189131.476420:0:8429:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000033b48b6c/0xcc1762b626f8b416 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189131.476424:0:26173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784189131.476426:0:26173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784189131.476430:0:8429:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000020:00000004:0.0:1784189131.477231:0:89353:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1784189131.477485:0:89353:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00002000:00010000:0.0:1784189131.477891:0:8429:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6f2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784189131.477899:0:8429:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002a100b32/0xcc1762b626f8b41d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6f2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189131.477913:0:8429:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6f2:0x0].0x0 since=3373s v=(0 0) 00010000:00010000:0.0:1784189131.477917:0:8429:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6f2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784189131.477923:0:8429:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002a100b32/0xcc1762b626f8b41d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189131.477936:0:8429:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002a100b32/0xcc1762b626f8b41d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189131.477959:0:8429:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002a100b32/0xcc1762b626f8b41d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189131.477968:0:8429:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002a100b32/0xcc1762b626f8b41d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189131.478419:0:7454:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1784189131.478427:0:7454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000033b48b6c/0xcc1762b626f8b416 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189131.478437:0:7454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc07116e200 already unused, calling callback (ffffffffc0b2e230) 00010000:00010000:3.0:1784189131.478446:0:26173:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784189131.478449:0:7454:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000033b48b6c/0xcc1762b626f8b416 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189131.478454:0:26173:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002a100b32/0xcc1762b626f8b41d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189131.478471:0:7454:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000033b48b6c/0xcc1762b626f8b416 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189131.478486:0:26173:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dbf4369c800 already unused, calling callback (ffffffffc0b2e230) 00010000:00010000:3.0:1784189131.478498:0:26173:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002a100b32/0xcc1762b626f8b41d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189131.478501:0:7454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000033b48b6c/0xcc1762b626f8b416 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189131.478518:0:26173:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002a100b32/0xcc1762b626f8b41d lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x6f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189131.478519:0:7454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000033b48b6c/0xcc1762b626f8b416 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189131.478544:0:26173:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002a100b32/0xcc1762b626f8b41d lrc: 2/0,0 mode: --/PW res: [0x280000401:0x6f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189131.478549:0:7454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784189131.478553:0:7454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784189131.478557:0:7454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784189131.478594:0:26173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784189131.478597:0:26173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784189131.478600:0:26173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784189131.478747:0:8429:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1784189131.478753:0:8429:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002a100b32/0xcc1762b626f8b41d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1784189131.478838:0:8429:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6f1:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784189131.478843:0:8429:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004cef756d/0xcc1762b626f8b424 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6f1:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189131.478852:0:8429:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6f1:0x0].0x0 since=3373s v=(0 0) 00010000:00010000:0.0:1784189131.478855:0:8429:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6f1:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784189131.478860:0:8429:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004cef756d/0xcc1762b626f8b424 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189131.478870:0:8429:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004cef756d/0xcc1762b626f8b424 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189131.478877:0:8429:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004cef756d/0xcc1762b626f8b424 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189131.478902:0:8429:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004cef756d/0xcc1762b626f8b424 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189131.478938:0:8429:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1784189131.478979:0:8429:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6f0:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784189131.478984:0:8429:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008cc5f086/0xcc1762b626f8b42b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6f0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189131.478993:0:8429:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6f0:0x0].0x0 since=3373s v=(0 0) 00010000:00010000:0.0:1784189131.478997:0:8429:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6f0:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784189131.479001:0:8429:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008cc5f086/0xcc1762b626f8b42b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189131.479010:0:8429:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008cc5f086/0xcc1762b626f8b42b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189131.479017:0:8429:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008cc5f086/0xcc1762b626f8b42b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189131.479024:0:8429:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008cc5f086/0xcc1762b626f8b42b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189131.479026:0:6502:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784189131.479031:0:6502:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004cef756d/0xcc1762b626f8b424 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189131.479035:0:8429:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1784189131.479039:0:6502:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dbf4369da00 already unused, calling callback (ffffffffc0b2e230) 00010000:00010000:2.0:1784189131.479042:0:6502:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004cef756d/0xcc1762b626f8b424 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189131.479050:0:6502:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004cef756d/0xcc1762b626f8b424 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189131.479061:0:6502:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004cef756d/0xcc1762b626f8b424 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1784189131.479069:0:8429:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6ef:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784189131.479074:0:8429:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dc1a395e/0xcc1762b626f8b432 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6ef:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189131.479076:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004cef756d/0xcc1762b626f8b424 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189131.479086:0:8429:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6ef:0x0].0x0 since=3373s v=(0 0) 00010000:00010000:0.0:1784189131.479089:0:8429:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6ef:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784189131.479091:0:6502:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784189131.479093:0:8429:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dc1a395e/0xcc1762b626f8b432 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189131.479095:0:6502:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008cc5f086/0xcc1762b626f8b42b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189131.479102:0:6502:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dbf4369ce00 already unused, calling callback (ffffffffc0b2e230) 00010000:00010000:0.0:1784189131.479103:0:8429:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000dc1a395e/0xcc1762b626f8b432 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189131.479105:0:6502:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008cc5f086/0xcc1762b626f8b42b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189131.479111:0:8429:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dc1a395e/0xcc1762b626f8b432 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189131.479113:0:6502:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008cc5f086/0xcc1762b626f8b42b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189131.479119:0:8429:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000dc1a395e/0xcc1762b626f8b432 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189131.479123:0:6502:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008cc5f086/0xcc1762b626f8b42b lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189131.479129:0:8429:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1784189131.479130:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008cc5f086/0xcc1762b626f8b42b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189131.479140:0:6502:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784189131.479143:0:6502:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000dc1a395e/0xcc1762b626f8b432 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189131.479149:0:6502:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc05ec0e200 already unused, calling callback (ffffffffc0b2e230) 00010000:00010000:2.0:1784189131.479157:0:6502:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000dc1a395e/0xcc1762b626f8b432 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1784189131.479161:0:8429:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6ee:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1784189131.479165:0:6502:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000dc1a395e/0xcc1762b626f8b432 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189131.479166:0:8429:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000aadf9f63/0xcc1762b626f8b439 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6ee:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189131.479174:0:8429:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6ee:0x0].0x0 since=3373s v=(0 0) 00010000:00010000:2.0:1784189131.479176:0:6502:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000dc1a395e/0xcc1762b626f8b432 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189131.479177:0:8429:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6ee:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784189131.479181:0:8429:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000aadf9f63/0xcc1762b626f8b439 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189131.479184:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dc1a395e/0xcc1762b626f8b432 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189131.479190:0:8429:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000aadf9f63/0xcc1762b626f8b439 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189131.479196:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784189131.479197:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784189131.479199:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784189131.479207:0:8429:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000aadf9f63/0xcc1762b626f8b439 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189131.479214:0:8429:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000aadf9f63/0xcc1762b626f8b439 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189131.479231:0:8429:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1784189131.479259:0:6502:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784189131.479264:0:6502:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000aadf9f63/0xcc1762b626f8b439 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1784189131.479268:0:8429:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6ed:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1784189131.479270:0:6502:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc05ec0e400 already unused, calling callback (ffffffffc0b2e230) 00010000:00010000:0.0:1784189131.479273:0:8429:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001bd2303a/0xcc1762b626f8b440 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6ed:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189131.479274:0:6502:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000aadf9f63/0xcc1762b626f8b439 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189131.479281:0:8429:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6ed:0x0].0x0 since=3373s v=(0 0) 00010000:00010000:2.0:1784189131.479282:0:6502:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000aadf9f63/0xcc1762b626f8b439 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189131.479284:0:8429:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6ed:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784189131.479289:0:8429:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001bd2303a/0xcc1762b626f8b440 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189131.479292:0:6502:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000aadf9f63/0xcc1762b626f8b439 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189131.479298:0:8429:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001bd2303a/0xcc1762b626f8b440 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189131.479305:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000aadf9f63/0xcc1762b626f8b439 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189131.479306:0:8429:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001bd2303a/0xcc1762b626f8b440 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189131.479313:0:8429:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001bd2303a/0xcc1762b626f8b440 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189131.479335:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784189131.479337:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784189131.479339:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784189131.479369:0:8429:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1784189131.479426:0:8429:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6ec:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784189131.479432:0:8429:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000013d62a94/0xcc1762b626f8b447 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6ec:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189131.479444:0:8429:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6ec:0x0].0x0 since=3373s v=(0 0) 00010000:00010000:0.0:1784189131.479447:0:8429:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6ec:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784189131.479455:0:8429:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000013d62a94/0xcc1762b626f8b447 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189131.479473:0:8429:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000013d62a94/0xcc1762b626f8b447 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189131.479482:0:6502:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784189131.479486:0:6502:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001bd2303a/0xcc1762b626f8b440 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189131.479486:0:8429:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000013d62a94/0xcc1762b626f8b447 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189131.479494:0:6502:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc05ec0f400 already unused, calling callback (ffffffffc0b2e230) 00010000:00010000:0.0:1784189131.479494:0:8429:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000013d62a94/0xcc1762b626f8b447 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189131.479498:0:6502:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001bd2303a/0xcc1762b626f8b440 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189131.479505:0:6502:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001bd2303a/0xcc1762b626f8b440 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189131.479506:0:8429:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1784189131.479516:0:6502:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001bd2303a/0xcc1762b626f8b440 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189131.479523:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001bd2303a/0xcc1762b626f8b440 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189131.479536:0:6502:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784189131.479539:0:6502:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000013d62a94/0xcc1762b626f8b447 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189131.479604:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784189131.479609:0:7454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1784189131.479634:0:8429:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6eb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784189131.479639:0:8429:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fa18a013/0xcc1762b626f8b44e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6eb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189131.479647:0:8429:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6eb:0x0].0x0 since=3373s v=(0 0) 00010000:00010000:0.0:1784189131.479656:0:8429:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6eb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784189131.479661:0:8429:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fa18a013/0xcc1762b626f8b44e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189131.479670:0:8429:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fa18a013/0xcc1762b626f8b44e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189131.479679:0:6502:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc05ec0e600 already unused, calling callback (ffffffffc0b2e230) 00010000:00010000:0.0:1784189131.479679:0:8429:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fa18a013/0xcc1762b626f8b44e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189131.479682:0:6502:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000013d62a94/0xcc1762b626f8b447 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189131.479687:0:8429:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fa18a013/0xcc1762b626f8b44e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189131.479691:0:6502:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000013d62a94/0xcc1762b626f8b447 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189131.479701:0:6502:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000013d62a94/0xcc1762b626f8b447 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189131.479709:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000013d62a94/0xcc1762b626f8b447 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189131.479722:0:6502:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784189131.479725:0:6502:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fa18a013/0xcc1762b626f8b44e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189131.479731:0:6502:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc05ec0f600 already unused, calling callback (ffffffffc0b2e230) 00010000:00010000:2.0:1784189131.479734:0:6502:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fa18a013/0xcc1762b626f8b44e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189131.479742:0:6502:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fa18a013/0xcc1762b626f8b44e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x6eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189131.479751:0:6502:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fa18a013/0xcc1762b626f8b44e lrc: 2/0,0 mode: --/PW res: [0x280000401:0x6eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189131.479765:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784189131.479766:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784189131.479785:0:8429:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1784189131.479789:0:8429:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fa18a013/0xcc1762b626f8b44e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1784189131.479857:0:8429:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6ea:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784189131.479863:0:8429:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004346214e/0xcc1762b626f8b455 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6ea:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189131.479875:0:8429:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6ea:0x0].0x0 since=3373s v=(0 0) 00010000:00010000:0.0:1784189131.479878:0:8429:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6ea:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784189131.479885:0:8429:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004346214e/0xcc1762b626f8b455 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189131.479893:0:8429:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004346214e/0xcc1762b626f8b455 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189131.479915:0:8429:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004346214e/0xcc1762b626f8b455 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189131.479922:0:8429:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004346214e/0xcc1762b626f8b455 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189131.480403:0:6501:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784189131.480409:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004346214e/0xcc1762b626f8b455 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189131.480418:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc05ec0fa00 already unused, calling callback (ffffffffc0b2e230) 00010000:00010000:1.0:1784189131.480422:0:6501:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004346214e/0xcc1762b626f8b455 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189131.480431:0:6501:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004346214e/0xcc1762b626f8b455 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x6ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189131.480466:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004346214e/0xcc1762b626f8b455 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x6ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189131.480476:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784189131.480477:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784189131.480479:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784189131.480536:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784189131.483468:0:8429:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1784189131.483481:0:8429:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004346214e/0xcc1762b626f8b455 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1784189131.483600:0:8429:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6e9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784189131.483607:0:8429:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a43b8460/0xcc1762b626f8b45c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6e9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189131.483620:0:8429:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6e9:0x0].0x0 since=3373s v=(0 0) 00010000:00010000:0.0:1784189131.483626:0:8429:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6e9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784189131.483632:0:8429:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a43b8460/0xcc1762b626f8b45c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189131.483645:0:8429:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a43b8460/0xcc1762b626f8b45c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189131.483655:0:8429:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a43b8460/0xcc1762b626f8b45c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189131.483676:0:8429:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a43b8460/0xcc1762b626f8b45c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189131.483695:0:8429:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1784189131.483706:0:6501:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784189131.483711:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a43b8460/0xcc1762b626f8b45c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189131.483718:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc05ec0f800 already unused, calling callback (ffffffffc0b2e230) 00010000:00010000:0.0:1784189131.483723:0:6501:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a43b8460/0xcc1762b626f8b45c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189131.483732:0:6501:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a43b8460/0xcc1762b626f8b45c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189131.483747:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a43b8460/0xcc1762b626f8b45c lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189131.483755:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a43b8460/0xcc1762b626f8b45c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189131.483767:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784189131.483769:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784189131.483771:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1784189131.483811:0:8429:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6e8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784189131.483822:0:8429:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005d016393/0xcc1762b626f8b463 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6e8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189131.483830:0:8429:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6e8:0x0].0x0 since=3373s v=(0 0) 00010000:00010000:0.0:1784189131.483833:0:8429:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6e8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784189131.483838:0:8429:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005d016393/0xcc1762b626f8b463 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189131.483847:0:8429:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005d016393/0xcc1762b626f8b463 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189131.483854:0:8429:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005d016393/0xcc1762b626f8b463 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189131.483860:0:8429:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005d016393/0xcc1762b626f8b463 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189131.483874:0:8429:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1784189131.483881:0:6502:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784189131.483885:0:6502:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005d016393/0xcc1762b626f8b463 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189131.483893:0:6502:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc05ec0f200 already unused, calling callback (ffffffffc0b2e230) 00010000:00010000:0.0:1784189131.483896:0:6502:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005d016393/0xcc1762b626f8b463 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189131.483904:0:6502:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005d016393/0xcc1762b626f8b463 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189131.483923:0:6502:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005d016393/0xcc1762b626f8b463 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189131.483930:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005d016393/0xcc1762b626f8b463 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189131.483943:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784189131.483944:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784189131.483946:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1784189131.483986:0:8429:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6e7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784189131.483991:0:8429:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000033cb6f8/0xcc1762b626f8b46a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6e7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189131.483998:0:8429:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6e7:0x0].0x0 since=3373s v=(0 0) 00010000:00010000:0.0:1784189131.484001:0:8429:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6e7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784189131.484005:0:8429:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000033cb6f8/0xcc1762b626f8b46a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189131.484013:0:8429:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000033cb6f8/0xcc1762b626f8b46a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189131.484021:0:8429:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000033cb6f8/0xcc1762b626f8b46a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189131.484028:0:8429:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000033cb6f8/0xcc1762b626f8b46a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189131.484049:0:8429:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1784189131.484056:0:6501:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784189131.484060:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000033cb6f8/0xcc1762b626f8b46a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189131.484067:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc05ec0e800 already unused, calling callback (ffffffffc0b2e230) 00010000:00010000:0.0:1784189131.484070:0:6501:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000033cb6f8/0xcc1762b626f8b46a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189131.484078:0:6501:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000033cb6f8/0xcc1762b626f8b46a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189131.484088:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000033cb6f8/0xcc1762b626f8b46a lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189131.484095:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000033cb6f8/0xcc1762b626f8b46a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189131.484106:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784189131.484108:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784189131.484109:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1784189131.484144:0:8429:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6e6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784189131.484149:0:8429:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c88020a6/0xcc1762b626f8b471 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6e6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189131.484156:0:8429:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6e6:0x0].0x0 since=3373s v=(0 0) 00010000:00010000:0.0:1784189131.484163:0:8429:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6e6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784189131.484167:0:8429:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c88020a6/0xcc1762b626f8b471 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189131.484174:0:8429:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c88020a6/0xcc1762b626f8b471 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189131.484182:0:8429:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c88020a6/0xcc1762b626f8b471 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189131.484189:0:8429:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c88020a6/0xcc1762b626f8b471 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189131.484199:0:8429:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1784189131.484205:0:6502:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784189131.484208:0:6502:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c88020a6/0xcc1762b626f8b471 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189131.484214:0:6502:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc05ec0f000 already unused, calling callback (ffffffffc0b2e230) 00010000:00010000:0.0:1784189131.484217:0:6502:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c88020a6/0xcc1762b626f8b471 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189131.484223:0:6502:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c88020a6/0xcc1762b626f8b471 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189131.484232:0:6502:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c88020a6/0xcc1762b626f8b471 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189131.484247:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c88020a6/0xcc1762b626f8b471 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189131.484259:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784189131.484261:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784189131.484262:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1784189131.484298:0:8429:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6e5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784189131.484303:0:8429:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b6a56637/0xcc1762b626f8b478 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6e5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189131.484310:0:8429:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6e5:0x0].0x0 since=3373s v=(0 0) 00010000:00010000:0.0:1784189131.484313:0:8429:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6e5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784189131.484339:0:8429:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b6a56637/0xcc1762b626f8b478 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189131.484349:0:8429:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b6a56637/0xcc1762b626f8b478 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189131.484357:0:8429:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b6a56637/0xcc1762b626f8b478 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189131.484363:0:8429:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b6a56637/0xcc1762b626f8b478 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189131.484384:0:8429:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1784189131.484420:0:8429:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6e4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784189131.484430:0:8429:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fe390215/0xcc1762b626f8b47f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6e4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189131.484438:0:8429:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6e4:0x0].0x0 since=3373s v=(0 0) 00010000:00010000:0.0:1784189131.484441:0:8429:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6e4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784189131.484444:0:8429:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fe390215/0xcc1762b626f8b47f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189131.484453:0:8429:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fe390215/0xcc1762b626f8b47f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189131.484472:0:8429:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fe390215/0xcc1762b626f8b47f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189131.484479:0:8429:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fe390215/0xcc1762b626f8b47f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189131.484492:0:8429:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1784189131.484499:0:6502:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1784189131.484502:0:6502:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b6a56637/0xcc1762b626f8b478 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189131.484508:0:6502:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc05ec0ee00 already unused, calling callback (ffffffffc0b2e230) 00010000:00010000:0.0:1784189131.484511:0:6502:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b6a56637/0xcc1762b626f8b478 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189131.484518:0:6502:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b6a56637/0xcc1762b626f8b478 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189131.484535:0:6502:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b6a56637/0xcc1762b626f8b478 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189131.484541:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b6a56637/0xcc1762b626f8b478 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189131.484553:0:6502:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784189131.484556:0:6502:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fe390215/0xcc1762b626f8b47f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189131.484561:0:6502:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc05ec0ea00 already unused, calling callback (ffffffffc0b2e230) 00010000:00010000:0.0:1784189131.484564:0:6502:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fe390215/0xcc1762b626f8b47f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189131.484570:0:6502:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fe390215/0xcc1762b626f8b47f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189131.484579:0:6502:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fe390215/0xcc1762b626f8b47f lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189131.484586:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fe390215/0xcc1762b626f8b47f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189131.484597:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784189131.484598:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784189131.484605:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1784189131.484645:0:8429:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6e3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784189131.484650:0:8429:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008cdafd97/0xcc1762b626f8b486 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6e3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189131.484658:0:8429:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6e3:0x0].0x0 since=3373s v=(0 0) 00010000:00010000:0.0:1784189131.484661:0:8429:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6e3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784189131.484664:0:8429:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008cdafd97/0xcc1762b626f8b486 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189131.484672:0:8429:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008cdafd97/0xcc1762b626f8b486 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189131.484679:0:8429:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008cdafd97/0xcc1762b626f8b486 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189131.484685:0:8429:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008cdafd97/0xcc1762b626f8b486 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189131.484696:0:8429:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1784189131.484702:0:6502:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784189131.484706:0:6502:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008cdafd97/0xcc1762b626f8b486 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189131.484712:0:6502:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc05ec0e000 already unused, calling callback (ffffffffc0b2e230) 00010000:00010000:0.0:1784189131.484715:0:6502:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008cdafd97/0xcc1762b626f8b486 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189131.484732:0:6502:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008cdafd97/0xcc1762b626f8b486 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189131.484743:0:6502:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008cdafd97/0xcc1762b626f8b486 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189131.484749:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008cdafd97/0xcc1762b626f8b486 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189131.484761:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784189131.484763:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784189131.484764:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1784189131.484807:0:8429:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6e2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784189131.484812:0:8429:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e9a3ca49/0xcc1762b626f8b48d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6e2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189131.484820:0:8429:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6e2:0x0].0x0 since=3373s v=(0 0) 00010000:00010000:0.0:1784189131.484822:0:8429:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6e2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784189131.484827:0:8429:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e9a3ca49/0xcc1762b626f8b48d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189131.484833:0:8429:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e9a3ca49/0xcc1762b626f8b48d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189131.484840:0:8429:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e9a3ca49/0xcc1762b626f8b48d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189131.484853:0:8429:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e9a3ca49/0xcc1762b626f8b48d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189131.484865:0:8429:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1784189131.484872:0:6502:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784189131.484875:0:6502:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e9a3ca49/0xcc1762b626f8b48d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189131.484881:0:6502:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc05ec0fc00 already unused, calling callback (ffffffffc0b2e230) 00010000:00010000:0.0:1784189131.484884:0:6502:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e9a3ca49/0xcc1762b626f8b48d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189131.484890:0:6502:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e9a3ca49/0xcc1762b626f8b48d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189131.484900:0:6502:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e9a3ca49/0xcc1762b626f8b48d lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189131.484906:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e9a3ca49/0xcc1762b626f8b48d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189131.484918:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784189131.484919:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784189131.484921:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784189131.485938:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784189131.487365:0:7454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784189131.487516:0:26173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1784189131.487741:0:9506:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294968954 is committed 00000100:00100000:2.0:1784189131.487926:0:26160:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc0505be300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+5:88984:x1870854458104064:12345-0@lo:5:osp-pre-1-0.0 Request processed in 16966us (17092us total) trans 4294968954 rc 0/0 00000100:00100000:2.0:1784189131.487937:0:26160:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4947 00000100:00100000:2.0:1784189131.487981:0:88984:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294968954 gen 2 00000100:00100000:2.0:1784189131.487988:0:88984:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc07b5e3480 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:88984:1870854458104064:0@lo:5:osp-pre-1-0.0 00000004:00080000:2.0:1784189131.488001:0:88984:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x2c0000401:0x701:0x0]-[0x2c0000401:0x721:0x0] 00002000:00080000:0.0:1784189131.495030:0:8429:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x280000401:1116 00000100:00100000:0.0:1784189131.495133:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc05ed91f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:88982:x1870854458103808:12345-0@lo:5:osp-pre-0-0.0 Request processed in 44625us (44754us total) trans 0 rc 0/0 00000100:00100000:0.0:1784189131.495143:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4946 00000100:00100000:1.0:1784189131.495260:0:88982:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc04a64f800 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:88982:1870854458103808:0@lo:5:osp-pre-0-0.0 00000004:00080000:1.0:1784189131.495274:0:88982:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x280000401:0x701:0x0] from OST, last_created [0x280000401:0x701:0x0]last_used is [0x280000401:0x45c:0x0] 00000100:00100000:2.0:1784189131.495369:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1784189131.495386:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf4693fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1870854458104192:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1784189131.495399:0:88982:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf4693ea00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:88982:1870854458104320:0@lo:5:osp-pre-0-0.0 00000100:00100000:0.0:1784189131.495447:0:88982:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784189131.495450:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784189131.495489:0:88982:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dc0754c8300 going to sleep for 11 seconds 00000100:00100000:1.0:1784189131.495765:0:26170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458104320 00000100:00100000:1.0:1784189131.495772:0:26170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458104320 00000100:00100000:1.0:1784189131.495820:0:26170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4948 00000100:00100000:1.0:1784189131.495829:0:26170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf464ac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+5:88982:x1870854458104320:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:1.0:1784189131.495870:0:26170:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000401 at 1794 00000100:00100000:1.0:1784189131.497234:0:26170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf464ac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+6:88982:x1870854458104320:12345-0@lo:5:osp-pre-0-0.0 Request processed in 1404us (1788us total) trans 4294968950 rc 0/0 00000100:00100000:1.0:1784189131.497243:0:26170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4948 00000100:00100000:1.0:1784189131.497275:0:9466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458104192 00000100:00100000:1.0:1784189131.497280:0:9466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458104192 00000100:00100000:1.0:1784189131.497313:0:9466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1929 00000100:00100000:0.0:1784189131.498474:0:88982:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf4693ea00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:88982:1870854458104320:0@lo:5:osp-pre-0-0.0 00000004:00080000:0.0:1784189131.498491:0:88982:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x280000401:0x701:0x0]-[0x280000401:0x721:0x0] 00000100:00100000:1.0:1784189131.499020:0:9466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc07b5b0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3640:x1870854458104192:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1784189131.499047:0:9466:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 211904 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1784189131.499123:0:9466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc07b5b0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3640:x1870854458104192:12345-0@lo:13:osp-pre-0-0.0 Request processed in 115us (3680us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189131.499148:0:9466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1929 00000100:00100000:2.0:1784189131.500873:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf4693fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1870854458104192:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1784189131.503969:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1784189131.831663:0:75588:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:1.0:1784189132.071561:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1784189132.071663:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1784189132.071994:0:88968:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436262528 00000100:00100000:2.0:1784189132.072002:0:88968:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436262528 00000100:00100000:3.0:1784189132.072228:0:68287:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436262656 00000100:00100000:3.0:1784189132.072233:0:68287:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436262656 00000100:00100000:2.0:1784189132.072292:0:88968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 74 00000100:00100000:2.0:1784189132.072303:0:88968:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc06b02a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9957a2dc-fd88-4a91-bca3-e2b7f365ab0c+10:2396:x1870854436262528:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:2.0:1784189132.072445:0:88968:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc06b02a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9957a2dc-fd88-4a91-bca3-e2b7f365ab0c+10:2396:x1870854436262528:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 144us (893us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189132.072463:0:88968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 74 00000100:00100000:1.0:1784189132.072677:0:66169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1125 00000100:00100000:1.0:1784189132.072686:0:66169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf4693e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+7:2396:x1870854436262656:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:1.0:1784189132.072759:0:66169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf4693e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+7:2396:x1870854436262656:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 74us (1095us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189132.072766:0:66169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1125 00000100:00100000:3.0:1784189132.075975:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1784189132.080588:0:66945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436262784 00000100:00100000:2.0:1784189132.080631:0:66945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436262784 00000100:00100000:2.0:1784189132.080729:0:66945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1126 00000100:00100000:2.0:1784189132.080742:0:66945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf46435180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+6:2396:x1870854436262784:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:2.0:1784189132.080867:0:66945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf46435180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+6:2396:x1870854436262784:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 126us (4903us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189132.080876:0:66945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1126 00010000:00010000:2.0:1784189132.527909:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784189133.506226:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1784189133.508608:0:66170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436262912 00000100:00100000:1.0:1784189133.508899:0:66170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436262912 00000100:00100000:1.0:1784189133.509191:0:66170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1202 00000100:00100000:1.0:1784189133.509204:0:66170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf44faea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+7:68198:x1870854436262912:12345-192.168.203.12@tcp:101:lfs.0 00010000:00010000:1.0:1784189133.509232:0:66170:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784189133.509263:0:66170:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc07116f000/0xcc1762b626f8b494 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbfc5de7fe6c3dca expref: -99 pid: 66170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189133.509371:0:66170:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc07116f600/0xcc1762b626f8b49b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189133.509389:0:66170:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc07116f600/0xcc1762b626f8b49b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189133.509403:0:66170:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc07116f600/0xcc1762b626f8b49b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784189133.511203:0:66170:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1784189133.511216:0:66170:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1784189133.511294:0:66170:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9dc07116f600/0xcc1762b626f8b49b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189133.511353:0:66170:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc07116f000/0xcc1762b626f8b494 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c3dca expref: 9 pid: 66170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189133.511379:0:66170:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc07116f600/0xcc1762b626f8b49b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c3dca expref: 8 pid: 66170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189133.511389:0:66170:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9dc0630a6700) 00010000:00010000:1.0:1784189133.511392:0:66170:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1784189133.511397:0:66170:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc07116f600, rc 0) 00000100:00100000:1.0:1784189133.511901:0:66170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf44faea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+8:68198:x1870854436262912:12345-192.168.203.12@tcp:101:lfs.0 Request processed in 2696us (5685us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189133.511912:0:66170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1202 00000100:00080000:3.0:1784189133.515279:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1784189133.518005:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1784189133.518584:0:68287:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436263040 00000100:00100000:1.0:1784189133.518601:0:68287:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436263040 00000100:00100000:1.0:1784189133.518871:0:68287:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1203 00000100:00100000:1.0:1784189133.518883:0:68287:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf44fae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+8:68198:x1870854436263040:12345-192.168.203.12@tcp:41:lfs.0 00000004:00000024:1.0:1784189133.518935:0:68287:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445281792 avail 1299042304 00000100:00100000:1.0:1784189133.519097:0:68287:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf44fae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+8:68198:x1870854436263040:12345-192.168.203.12@tcp:41:lfs.0 Request processed in 150us (1039us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189133.519106:0:68287:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1203 00000100:00100000:0.0:1784189133.524006:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1784189133.532926:0:66945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436263168 00000100:00100000:2.0:1784189133.532948:0:66945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436263168 00000100:00080000:0.0:1784189133.533135:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1784189133.533287:0:66945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1204 00000100:00100000:2.0:1784189133.533305:0:66945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf464ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+6:68198:x1870854436263168:12345-192.168.203.12@tcp:41:lfs.0 00000004:00000024:2.0:1784189133.533378:0:66945:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445576704 avail 1299337216 00000100:00100000:2.0:1784189133.533496:0:66945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf464ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+6:68198:x1870854436263168:12345-192.168.203.12@tcp:41:lfs.0 Request processed in 198us (9503us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189133.533505:0:66945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1204 00000100:00100000:3.0:1784189133.545480:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1784189133.545846:0:26162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436263296 00000100:00100000:1.0:1784189133.545859:0:26162:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436263296 00000100:00100000:1.0:1784189133.545916:0:26162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 4949 00000100:00100000:1.0:1784189133.545925:0:26162:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc075f7f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:0+-99:2395:x1870854436263296:12345-192.168.203.12@tcp:8:lfs.0 00010000:00080000:1.0:1784189133.545970:0:26162:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0000: connection from b90fcc1c-0e69-42a4-a116-a71fec7aeb78@192.168.203.12@tcp t0 exp 0000000000000000 cur 3375 last 0 00000020:00000080:1.0:1784189133.546085:0:26162:0:(genops.c:1406:class_connect()) connect: client b90fcc1c-0e69-42a4-a116-a71fec7aeb78, cookie 0xcc1762b626f8b4a2 00002000:00100000:1.0:1784189133.546100:0:26162:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli b90fcc1c-0e69-42a4-a116-a71fec7aeb78/ffff9dc075656800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 21136a2 ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1784189133.546123:0:26162:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:1.0:1784189133.546203:0:26162:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1784189133.546240:0:26162:0:(import.c:65:import_set_state_nolock()) ffff9dc075654800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1784189133.546422:0:26162:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc075f7f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+6:2395:x1870854436263296:12345-192.168.203.12@tcp:8:lfs.0 Request processed in 495us (954us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189133.546431:0:26162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 4949 00010000:00010000:1.0:1784189133.555576:0:7454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784189133.559961:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1784189133.561879:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436263424 00000100:00100000:1.0:1784189133.561899:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436263424 00000100:00100000:1.0:1784189133.562042:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1930 00000100:00100000:1.0:1784189133.562054:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc07b5b1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+6:68198:x1870854436263424:12345-192.168.203.12@tcp:13:lfs.0 00002000:00000024:1.0:1784189133.562091:0:8432:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8649664 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1784189133.562193:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc07b5b1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+6:68198:x1870854436263424:12345-192.168.203.12@tcp:13:lfs.0 Request processed in 140us (2245us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189133.562202:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1930 00000100:00080000:0.0:1784189133.562734:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1784189133.568285:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1784189133.568452:0:26171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436263552 00000100:00100000:3.0:1784189133.568467:0:26171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436263552 00000100:00100000:3.0:1784189133.568519:0:26171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 4950 00000100:00100000:3.0:1784189133.568674:0:26171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf464ad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:0+-99:2395:x1870854436263552:12345-192.168.203.12@tcp:8:lfs.0 00010000:00080000:3.0:1784189133.568726:0:26171:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0001: connection from b90fcc1c-0e69-42a4-a116-a71fec7aeb78@192.168.203.12@tcp t0 exp 0000000000000000 cur 3375 last 0 00000020:00000080:3.0:1784189133.568767:0:26171:0:(genops.c:1406:class_connect()) connect: client b90fcc1c-0e69-42a4-a116-a71fec7aeb78, cookie 0xcc1762b626f8b4a9 00002000:00100000:3.0:1784189133.568784:0:26171:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli b90fcc1c-0e69-42a4-a116-a71fec7aeb78/ffff9dbf42275000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 21136a2 ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1784189133.568827:0:26171:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:3.0:1784189133.568923:0:26171:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1784189133.568962:0:26171:0:(import.c:65:import_set_state_nolock()) ffff9dbf42276800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1784189133.569355:0:26171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf464ad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+6:2395:x1870854436263552:12345-192.168.203.12@tcp:8:lfs.0 Request processed in 784us (1042us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189133.569367:0:26171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 4950 00000100:00100000:3.0:1784189133.581209:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1784189133.581631:0:9466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436263680 00000100:00100000:1.0:1784189133.581644:0:9466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436263680 00000100:00100000:1.0:1784189133.581734:0:9466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1931 00000100:00100000:1.0:1784189133.581747:0:9466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc07b872450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+6:68198:x1870854436263680:12345-192.168.203.12@tcp:13:lfs.0 00002000:00000024:1.0:1784189133.581783:0:9466:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8649664 pending 0 free 3923529728 avail 3692007424 00000100:00080000:0.0:1784189133.581951:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1784189133.581992:0:9466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc07b872450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+6:68198:x1870854436263680:12345-192.168.203.12@tcp:13:lfs.0 Request processed in 248us (797us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189133.582002:0:9466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1931 00010000:00010000:3.0:1784189134.575590:0:26173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784189135.146757:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1784189135.146800:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1784189135.146834:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1784189135.146870:0:26223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436264064 00000100:00100000:0.0:1784189135.146879:0:26223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436264064 00000100:00100000:0.0:1784189135.146935:0:26223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436263936 00000100:00100000:0.0:1784189135.146938:0:26223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436263936 00000100:00100000:0.0:1784189135.146962:0:26223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 4951 00000100:00100000:0.0:1784189135.146983:0:26223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf464adf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+6:2399:x1870854436264064:12345-192.168.203.12@tcp:17:kworker.0 00000100:00100000:0.0:1784189135.147074:0:26223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf464adf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+6:2399:x1870854436264064:12345-192.168.203.12@tcp:17:kworker.0 Request processed in 103us (272us total) trans 0 rc 0/0 00000100:00100000:0.0:1784189135.147081:0:26223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 4951 00000100:00100000:0.0:1784189135.147098:0:26223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 4952 00000100:00100000:0.0:1784189135.147105:0:26223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc05edd7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+6:2399:x1870854436263936:12345-192.168.203.12@tcp:17:kworker.0 00000100:00100000:1.0:1784189135.147148:0:66170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436263808 00000100:00100000:1.0:1784189135.147152:0:66170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436263808 00000100:00100000:0.0:1784189135.147164:0:26223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc05edd7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+6:2399:x1870854436263936:12345-192.168.203.12@tcp:17:kworker.0 Request processed in 59us (329us total) trans 0 rc 0/0 00000100:00100000:0.0:1784189135.147171:0:26223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 4952 00000100:00080000:0.0:1784189135.147187:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1784189135.147192:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1784189135.147194:0:66170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1205 00000100:00080000:0.0:1784189135.147194:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1784189135.147202:0:66170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf464ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+6:2399:x1870854436263808:12345-192.168.203.12@tcp:17:kworker.0 00000100:00100000:1.0:1784189135.147238:0:66170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf464ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+6:2399:x1870854436263808:12345-192.168.203.12@tcp:17:kworker.0 Request processed in 38us (491us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189135.147244:0:66170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1205 00010000:00010000:2.0:1784189135.601467:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784189135.920606:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf4693f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1870854458104448:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1784189135.920673:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784189135.920723:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458104448 00000100:00100000:1.0:1784189135.920729:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458104448 00000100:00100000:3.0:1784189135.922461:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1784189135.922479:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc075f7c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1870854458104576:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1784189135.922532:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784189135.922569:0:9466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458104576 00000100:00100000:3.0:1784189135.922575:0:9466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458104576 00000100:00100000:0.0:1784189135.922896:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1932 00000100:00100000:0.0:1784189135.922906:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf4693dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1870854458104448:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1784189135.922929:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8649664 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1784189135.922978:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf4693dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1870854458104448:12345-0@lo:13:osp-pre-1-1.0 Request processed in 73us (2305us total) trans 0 rc 0/0 00000100:00100000:0.0:1784189135.922986:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1932 00000100:00100000:2.0:1784189135.923556:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf4693f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1870854458104448:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1784189135.925588:0:9466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1933 00000100:00100000:3.0:1784189135.925601:0:9466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc075f7c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1870854458104576:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1784189135.925626:0:9466:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8649664 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1784189135.925698:0:9466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc075f7c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1870854458104576:12345-0@lo:13:osp-pre-0-1.0 Request processed in 99us (3164us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189135.925705:0:9466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1933 00000100:00100000:3.0:1784189135.925775:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc075f7c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1870854458104576:0@lo:13:osp-pre-0-1.0 00000100:00080000:1.0:1784189135.926638:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1784189135.926644:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1784189136.434485:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc075f7c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1870854458104704:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1784189136.434552:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784189136.434616:0:26492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458104704 00000100:00100000:3.0:1784189136.434622:0:26492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458104704 00000100:00100000:3.0:1784189136.434663:0:26492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3776 00000100:00100000:3.0:1784189136.434671:0:26492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc075f7f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3640:x1870854458104704:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1784189136.434726:0:26492:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445576704 avail 1299337216 00000100:00100000:3.0:1784189136.434767:0:26492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc075f7f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3640:x1870854458104704:12345-0@lo:41:osp-pre-1-0.0 Request processed in 97us (216us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189136.434775:0:26492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3776 00000100:00100000:3.0:1784189136.434826:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc075f7c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1870854458104704:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1784189136.437015:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf4859aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3642:1870854458104960:0@lo:400:kworker.0 00000100:00100000:3.0:1784189136.437072:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784189136.437109:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf46954000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1870854458105472:0@lo:400:kworker.0 00000100:00100000:3.0:1784189136.437134:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784189136.437151:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf46954700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3642:1870854458105984:0@lo:400:kworker.0 00000100:00100000:3.0:1784189136.437170:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784189136.437194:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1784189136.437200:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf48599c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3642:1870854458105088:0@lo:400:kworker.0 00000100:00100000:3.0:1784189136.437221:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784189136.437236:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf46955880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3642:1870854458105600:0@lo:400:kworker.0 00000100:00100000:3.0:1784189136.437257:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784189136.437290:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458105472 00000100:00100000:3.0:1784189136.437297:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458105472 00000100:00100000:3.0:1784189136.437356:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3777 00000100:00100000:3.0:1784189136.437365:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf46954a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3642:x1870854458105472:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784189136.437431:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf46954a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3642:x1870854458105472:12345-0@lo:400:kworker.0 Request processed in 57us (286us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189136.437439:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3777 00000100:00100000:3.0:1784189136.437460:0:68287:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458104960 00000100:00100000:3.0:1784189136.437464:0:68287:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458104960 00000100:00100000:3.0:1784189136.437511:0:68287:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458105984 00000100:00100000:3.0:1784189136.437514:0:68287:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458105984 00000100:00100000:3.0:1784189136.437527:0:68287:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458105088 00000100:00100000:3.0:1784189136.437529:0:68287:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458105088 00000100:00100000:3.0:1784189136.437541:0:68287:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458105600 00000100:00100000:3.0:1784189136.437544:0:68287:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458105600 00000100:00100000:3.0:1784189136.437556:0:68287:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1127 00000100:00100000:3.0:1784189136.437561:0:68287:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf46957800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3642:x1870854458104960:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784189136.437593:0:68287:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf46957800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3642:x1870854458104960:12345-0@lo:400:kworker.0 Request processed in 31us (520us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189136.437599:0:68287:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1127 00000100:00100000:3.0:1784189136.437610:0:68287:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1128 00000100:00100000:3.0:1784189136.437616:0:68287:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf46954e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1870854458105984:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784189136.437642:0:68287:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf46954e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1870854458105984:12345-0@lo:400:kworker.0 Request processed in 27us (471us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189136.437648:0:68287:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1128 00000100:00100000:3.0:1784189136.437660:0:68287:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1129 00000100:00100000:3.0:1784189136.437666:0:68287:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf46957480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1870854458105088:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784189136.437689:0:68287:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf46957480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1870854458105088:12345-0@lo:400:kworker.0 Request processed in 24us (468us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189136.437695:0:68287:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1129 00000100:00100000:3.0:1784189136.437705:0:68287:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1130 00000100:00100000:3.0:1784189136.437711:0:68287:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf4367ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1870854458105600:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784189136.437736:0:68287:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf4367ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1870854458105600:12345-0@lo:400:kworker.0 Request processed in 25us (477us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189136.437740:0:68287:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1130 00000100:00080000:3.0:1784189136.437761:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1784189136.437771:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1784189136.437783:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc075f7c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:bd553d0d-03e2-4233-b06b-b55bbfa2b954:3641:1870854458104832:0@lo:400:kworker.0 00000100:00100000:3.0:1784189136.437813:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784189136.437837:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf444e0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3641:1870854458105344:0@lo:400:kworker.0 00000100:00100000:3.0:1784189136.437857:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784189136.437872:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf46955500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1870854458105856:0@lo:400:kworker.0 00000100:00100000:3.0:1784189136.437893:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784189136.437912:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1784189136.437918:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf444e1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3641:1870854458105216:0@lo:400:kworker.0 00000100:00100000:3.0:1784189136.437938:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784189136.437954:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf46954380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1870854458105728:0@lo:400:kworker.0 00000100:00100000:3.0:1784189136.437975:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784189136.437998:0:88969:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458104832 00000100:00100000:3.0:1784189136.438002:0:88969:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458104832 00000100:00100000:3.0:1784189136.438026:0:88969:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1784189136.438032:0:88969:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc06b02b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd553d0d-03e2-4233-b06b-b55bbfa2b954+24:3641:x1870854458104832:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784189136.438062:0:88969:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc06b02b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd553d0d-03e2-4233-b06b-b55bbfa2b954+24:3641:x1870854458104832:12345-0@lo:400:kworker.0 Request processed in 30us (249us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189136.438068:0:88969:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1784189136.438096:0:14684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458105856 00000100:00100000:3.0:1784189136.438099:0:14684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458105856 00000100:00100000:3.0:1784189136.438125:0:14684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458105728 00000100:00100000:3.0:1784189136.438128:0:14684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458105728 00000100:00100000:3.0:1784189136.438146:0:14684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2408 00000100:00100000:3.0:1784189136.438151:0:14684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf4367c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3641:x1870854458105856:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784189136.438178:0:14684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf4367c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3641:x1870854458105856:12345-0@lo:400:kworker.0 Request processed in 27us (285us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189136.438190:0:14684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2408 00000100:00100000:3.0:1784189136.438202:0:14684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2409 00000100:00100000:3.0:1784189136.438208:0:14684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf46903480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3641:x1870854458105728:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784189136.438234:0:14684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf46903480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3641:x1870854458105728:12345-0@lo:400:kworker.0 Request processed in 27us (258us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189136.438240:0:14684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2409 00000100:00100000:3.0:1784189136.438267:0:66171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458105344 00000100:00100000:3.0:1784189136.438270:0:66171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458105344 00000100:00100000:3.0:1784189136.438291:0:66171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458105216 00000100:00100000:3.0:1784189136.438294:0:66171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458105216 00000100:00100000:3.0:1784189136.438308:0:66171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1131 00000100:00100000:3.0:1784189136.438314:0:66171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf4367ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1870854458105344:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784189136.438363:0:66171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf4367ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1870854458105344:12345-0@lo:400:kworker.0 Request processed in 48us (504us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189136.438368:0:66171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1131 00000100:00100000:3.0:1784189136.438380:0:66171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1132 00000100:00100000:3.0:1784189136.438386:0:66171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf4367d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1870854458105216:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784189136.438413:0:66171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf4367d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1870854458105216:12345-0@lo:400:kworker.0 Request processed in 27us (473us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189136.439226:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf48599c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3642:1870854458105088:0@lo:400:kworker.0 00000100:00100000:2.0:1784189136.439240:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf46955880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3642:1870854458105600:0@lo:400:kworker.0 00000100:00100000:2.0:1784189136.439250:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf4859aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3642:1870854458104960:0@lo:400:kworker.0 00000100:00100000:2.0:1784189136.439260:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf46954000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1870854458105472:0@lo:400:kworker.0 00000100:00100000:2.0:1784189136.439270:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf46954700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3642:1870854458105984:0@lo:400:kworker.0 00000100:00080000:2.0:1784189136.439338:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1784189136.439342:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1784189136.439344:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1784189136.439347:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1784189136.439365:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf444e1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3641:1870854458105216:0@lo:400:kworker.0 00000100:00100000:2.0:1784189136.439377:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf46954380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1870854458105728:0@lo:400:kworker.0 00000100:00100000:2.0:1784189136.439398:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc075f7c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:bd553d0d-03e2-4233-b06b-b55bbfa2b954:3641:1870854458104832:0@lo:400:kworker.0 00000100:00100000:2.0:1784189136.439408:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf444e0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3641:1870854458105344:0@lo:400:kworker.0 00000100:00100000:2.0:1784189136.439416:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf46955500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1870854458105856:0@lo:400:kworker.0 00000100:00100000:3.0:1784189136.444142:0:66171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1132 00000100:00100000:1.0:1784189136.445120:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1784189136.445139:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf4693c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1870854458106112:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1784189136.445207:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784189136.445250:0:26492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458106112 00000100:00100000:1.0:1784189136.445257:0:26492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458106112 00000100:00100000:1.0:1784189136.445299:0:26492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3778 00000100:00100000:1.0:1784189136.445308:0:26492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf4693f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3642:x1870854458106112:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1784189136.445358:0:26492:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445281792 avail 1299042304 00000100:00100000:1.0:1784189136.445407:0:26492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf4693f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3642:x1870854458106112:12345-0@lo:41:osp-pre-0-1.0 Request processed in 100us (200us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189136.445414:0:26492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3778 00000100:00100000:1.0:1784189136.445468:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf4693c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1870854458106112:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1784189136.626596:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784189136.944124:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf4693c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1870854458106240:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1784189136.944188:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784189136.944228:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1784189136.944233:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc07b5b2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1870854458106368:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1784189136.944251:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784189136.944287:0:9466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458106240 00000100:00100000:2.0:1784189136.944292:0:9466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458106240 00000100:00100000:2.0:1784189136.944343:0:9466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458106368 00000100:00100000:2.0:1784189136.944345:0:9466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458106368 00000100:00100000:2.0:1784189136.944359:0:9466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1934 00000100:00100000:2.0:1784189136.944366:0:9466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc07b5b1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3640:x1870854458106240:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1784189136.944391:0:9466:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8649664 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1784189136.944437:0:9466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc07b5b1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3640:x1870854458106240:12345-0@lo:13:osp-pre-0-0.0 Request processed in 71us (248us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189136.944444:0:9466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1934 00000100:00100000:2.0:1784189136.944473:0:9466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1935 00000100:00100000:2.0:1784189136.944479:0:9466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc07b5b0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1870854458106368:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1784189136.944496:0:9466:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8649664 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1784189136.944525:0:9466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc07b5b0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1870854458106368:12345-0@lo:13:osp-pre-1-0.0 Request processed in 46us (273us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189136.944532:0:9466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1935 00000100:00100000:2.0:1784189136.944578:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc07b5b2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1870854458106368:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1784189136.944594:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf4693c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1870854458106240:0@lo:13:osp-pre-0-0.0 00000001:00100000:3.0:1784189136.956068:0:8423:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of b90fcc1c-0e69-42a4-a116-a71fec7aeb78 00000001:00080000:3.0:1784189136.956085:0:8423:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294968950 is committed 00000100:00100000:2.0:1784189137.193044:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1784189137.193135:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1784189137.193176:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1784189137.193208:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1784189137.193258:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1784189137.193286:0:66945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436264448 00000100:00100000:2.0:1784189137.193295:0:66945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436264448 00000100:00100000:2.0:1784189137.193372:0:66945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436264320 00000100:00100000:2.0:1784189137.193375:0:66945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436264320 00000100:00100000:2.0:1784189137.193408:0:66945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1133 00000100:00100000:2.0:1784189137.193428:0:66945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc07b5b2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+6:2398:x1870854436264448:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:2.0:1784189137.193502:0:66945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc07b5b2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+6:2398:x1870854436264448:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 84us (365us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189137.193510:0:66945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1133 00000100:00100000:2.0:1784189137.193526:0:66945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1134 00000100:00100000:2.0:1784189137.193533:0:66945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc07b5b1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+8:2398:x1870854436264320:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:2.0:1784189137.193574:0:66945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc07b5b1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+8:2398:x1870854436264320:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 41us (365us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189137.193591:0:66945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1134 00000100:00100000:2.0:1784189137.193614:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436264704 00000100:00100000:2.0:1784189137.193618:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436264704 00000100:00100000:2.0:1784189137.193640:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436264576 00000100:00100000:2.0:1784189137.193642:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436264576 00000100:00100000:2.0:1784189137.193659:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 2410 00000100:00100000:2.0:1784189137.193665:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc07b5b3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+6:2398:x1870854436264704:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:2.0:1784189137.193689:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc07b5b3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+6:2398:x1870854436264704:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 25us (514us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189137.193696:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 2410 00000100:00100000:2.0:1784189137.193706:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 2411 00000100:00100000:2.0:1784189137.193711:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc07b5b1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+5:2398:x1870854436264576:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:2.0:1784189137.193730:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc07b5b1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+5:2398:x1870854436264576:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 19us (472us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189137.193736:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 2411 00000100:00080000:2.0:1784189137.193749:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1784189137.193752:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1784189137.193755:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1784189137.193757:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1784189137.194373:0:88967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436264192 00000100:00100000:0.0:1784189137.194380:0:88967:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436264192 00000100:00100000:0.0:1784189137.194434:0:88967:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 76 00000100:00100000:0.0:1784189137.194443:0:88967:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc06b028850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9957a2dc-fd88-4a91-bca3-e2b7f365ab0c+10:2398:x1870854436264192:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:0.0:1784189137.194489:0:88967:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc06b028850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9957a2dc-fd88-4a91-bca3-e2b7f365ab0c+10:2398:x1870854436264192:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 44us (1450us total) trans 0 rc 0/0 00000100:00100000:0.0:1784189137.194497:0:88967:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 76 00010000:00010000:1.0:1784189137.648578:0:7454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1784189137.976015:0:9506:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of b90fcc1c-0e69-42a4-a116-a71fec7aeb78 00010000:00010000:3.0:1784189138.675863:0:26173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1784189139.429950:0:89546:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg312-client.virtnet: executing wait_import_state_mount (FULL|IDLE) mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 00010000:00010000:2.0:1784189139.701928:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784189140.721247:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784189141.042015:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1784189141.042052:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf4693fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1870854458106496:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1784189141.042142:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784189141.042203:0:9466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458106496 00000100:00100000:1.0:1784189141.042212:0:9466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458106496 00000100:00100000:1.0:1784189141.042295:0:9466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1936 00000100:00100000:1.0:1784189141.042308:0:9466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf4693c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1870854458106496:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1784189141.042374:0:9466:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8649664 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1784189141.042439:0:9466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf4693c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1870854458106496:12345-0@lo:13:osp-pre-1-1.0 Request processed in 133us (295us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189141.042448:0:9466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1936 00000100:00080000:1.0:1784189141.042476:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1784189141.042521:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf4693fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1870854458106496:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1784189141.047065:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1784189141.047099:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf4693fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1870854458106624:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1784189141.047202:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784189141.047429:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458106624 00000100:00100000:1.0:1784189141.047441:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458106624 00000100:00100000:1.0:1784189141.047520:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1937 00000100:00100000:1.0:1784189141.047531:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf46902300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1870854458106624:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1784189141.047566:0:8432:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8649664 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1784189141.047625:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf46902300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1870854458106624:12345-0@lo:13:osp-pre-0-1.0 Request processed in 96us (423us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189141.047633:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1937 00000100:00100000:1.0:1784189141.047690:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf4693fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1870854458106624:0@lo:13:osp-pre-0-1.0 00000100:00080000:3.0:1784189141.047749:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:02000400:3.0:1784189141.170489:0:89594:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: mdc.lustre-MDT0000-mdc-*.mds_server_uuid in FULL state after 0 sec 00000100:00100000:3.0:1784189141.553877:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1784189141.553918:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf4693fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1870854458106752:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1784189141.554035:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784189141.554103:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458106752 00000100:00100000:3.0:1784189141.554112:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458106752 00000100:00100000:3.0:1784189141.554180:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3779 00000100:00100000:3.0:1784189141.554191:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf46902680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3641:x1870854458106752:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1784189141.554237:0:8438:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445281792 avail 1299042304 00000100:00100000:0.0:1784189141.558059:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc080e7df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3643:1870854458107136:0@lo:400:kworker.0 00000100:00100000:2.0:1784189141.558107:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc05edd4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:bd553d0d-03e2-4233-b06b-b55bbfa2b954:3641:1870854458106880:0@lo:400:kworker.0 00000100:00100000:1.0:1784189141.558523:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc080e7f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3642:1870854458107008:0@lo:400:kworker.0 00000100:00100000:0.0:1784189141.563671:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784189141.563770:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc06b98fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1870854458107648:0@lo:400:kworker.0 00000100:00100000:0.0:1784189141.566670:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784189141.566765:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf4693f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1870854458108160:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1784189141.566834:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784189141.566931:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458107648 00000100:00100000:0.0:1784189141.566941:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458107648 00000100:00100000:0.0:1784189141.567012:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458108160 00000100:00100000:0.0:1784189141.567016:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458108160 00000100:00100000:0.0:1784189141.567037:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3780 00000100:00100000:0.0:1784189141.567046:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc06b98dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3643:x1870854458107648:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784189141.567116:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc06b98dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3643:x1870854458107648:12345-0@lo:400:kworker.0 Request processed in 71us (458us total) trans 0 rc 0/0 00000100:00100000:0.0:1784189141.567124:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3780 00000100:00100000:0.0:1784189141.567144:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3781 00000100:00100000:0.0:1784189141.567150:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc06b98e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3643:x1870854458108160:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1784189141.567179:0:8439:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445576704 avail 1299337216 00000100:00100000:0.0:1784189141.567210:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc06b98e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3643:x1870854458108160:12345-0@lo:41:osp-pre-1-0.0 Request processed in 60us (375us total) trans 0 rc 0/0 00000100:00100000:0.0:1784189141.567216:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3781 00000100:00100000:0.0:1784189141.567242:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc080e7c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3640:1870854458107264:0@lo:400:kworker.0 00000100:00100000:0.0:1784189141.567278:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784189141.567301:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc06b98f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1870854458107776:0@lo:400:kworker.0 00000100:00100000:0.0:1784189141.567350:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784189141.567589:0:66945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458107136 00000100:00100000:0.0:1784189141.567595:0:66945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458107136 00000100:00100000:0.0:1784189141.567653:0:66945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458107264 00000100:00100000:0.0:1784189141.567657:0:66945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458107264 00000100:00100000:0.0:1784189141.567681:0:66945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1135 00000100:00100000:0.0:1784189141.567689:0:66945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc06b98e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1870854458107136:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784189141.567728:0:66945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc06b98e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1870854458107136:12345-0@lo:400:kworker.0 Request processed in 40us (4069us total) trans 0 rc 0/0 00000100:00100000:0.0:1784189141.567749:0:66945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1135 00000100:00100000:0.0:1784189141.567762:0:66945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1136 00000100:00100000:0.0:1784189141.567768:0:66945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc056eaea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3640:x1870854458107264:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784189141.567804:0:66945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc056eaea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3640:x1870854458107264:12345-0@lo:400:kworker.0 Request processed in 35us (525us total) trans 0 rc 0/0 00000100:00100000:0.0:1784189141.567810:0:66945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1136 00000100:00100000:0.0:1784189141.567830:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458107776 00000100:00100000:0.0:1784189141.567833:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458107776 00000100:00100000:0.0:1784189141.567979:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2412 00000100:00100000:0.0:1784189141.567996:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc056eaf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3640:x1870854458107776:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784189141.568034:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc056eaf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3640:x1870854458107776:12345-0@lo:400:kworker.0 Request processed in 49us (683us total) trans 0 rc 0/0 00000100:00100000:0.0:1784189141.568041:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2412 00000100:00080000:0.0:1784189141.568059:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1784189141.568063:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1784189141.568065:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1784189141.568112:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc080e7c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3640:1870854458107264:0@lo:400:kworker.0 00000100:00100000:0.0:1784189141.568123:0:3640:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294968950 gen 2 00000100:00100000:0.0:1784189141.568140:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc06b98f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1870854458107776:0@lo:400:kworker.0 00000100:00100000:0.0:1784189141.568287:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf4693f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1870854458108160:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1784189141.568301:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc080e7df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3643:1870854458107136:0@lo:400:kworker.0 00000100:00100000:0.0:1784189141.568312:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc06b98fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1870854458107648:0@lo:400:kworker.0 00000100:00100000:2.0:1784189141.568709:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784189141.568767:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc06b98d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3641:1870854458107392:0@lo:400:kworker.0 00000100:00100000:2.0:1784189141.568824:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784189141.568853:0:66169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458107392 00000100:00100000:2.0:1784189141.568858:0:66169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458107392 00000100:00100000:2.0:1784189141.568899:0:66169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1137 00000100:00100000:2.0:1784189141.568906:0:66169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc07b5b0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1870854458107392:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784189141.568942:0:66169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc07b5b0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1870854458107392:12345-0@lo:400:kworker.0 Request processed in 36us (117us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189141.568949:0:66169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1137 00000100:00080000:2.0:1784189141.568966:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1784189141.568988:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc06b98d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3641:1870854458107392:0@lo:400:kworker.0 00000100:00100000:2.0:1784189141.568997:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc06b98f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1870854458107904:0@lo:400:kworker.0 00000100:00100000:3.0:1784189141.569687:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf46902680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3641:x1870854458106752:12345-0@lo:41:osp-pre-0-1.0 Request processed in 15493us (15648us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189141.569700:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3779 00000100:00100000:2.0:1784189141.569728:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784189141.569778:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf4693fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1870854458106752:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1784189141.569784:0:26170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458107904 00000100:00100000:3.0:1784189141.569789:0:26170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458107904 00000100:00080000:2.0:1784189141.569821:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1784189141.569829:0:26170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2413 00000100:00100000:3.0:1784189141.569835:0:26170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc07b5b2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+5:3641:x1870854458107904:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784189141.569936:0:88969:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458106880 00000100:00100000:0.0:1784189141.569941:0:88969:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458106880 00000100:00100000:3.0:1784189141.570109:0:88973:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1784189141.570118:0:88973:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc06b02a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:bd553d0d-03e2-4233-b06b-b55bbfa2b954+24:3641:x1870854458106880:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784189141.570166:0:88973:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc06b02a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:bd553d0d-03e2-4233-b06b-b55bbfa2b954+24:3641:x1870854458106880:12345-0@lo:400:kworker.0 Request processed in 50us (1458us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189141.570173:0:88973:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1784189141.570544:0:26170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc07b5b2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+5:3641:x1870854458107904:12345-0@lo:400:kworker.0 Request processed in 708us (814us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189141.570552:0:26170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2413 00000100:00100000:3.0:1784189141.571224:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc05edd4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:bd553d0d-03e2-4233-b06b-b55bbfa2b954:3641:1870854458106880:0@lo:400:kworker.0 00000100:00100000:3.0:1784189141.571242:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc06b98f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1870854458107904:0@lo:400:kworker.0 00000100:00100000:1.0:1784189141.574539:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784189141.574736:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc06b98d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3642:1870854458107520:0@lo:400:kworker.0 00000100:00100000:1.0:1784189141.574774:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784189141.574902:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc06b98ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3642:1870854458108032:0@lo:400:kworker.0 00000100:00100000:1.0:1784189141.574935:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784189141.575004:0:66170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458107008 00000100:00100000:0.0:1784189141.575029:0:66170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458107008 00000100:00080000:3.0:1784189141.575108:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1784189141.575118:0:66170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458107520 00000100:00100000:0.0:1784189141.575121:0:66170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458107520 00000100:00100000:0.0:1784189141.575160:0:66170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1138 00000100:00100000:0.0:1784189141.575169:0:66170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf4693fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3642:x1870854458107008:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784189141.575233:0:66170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf4693fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3642:x1870854458107008:12345-0@lo:400:kworker.0 Request processed in 65us (705us total) trans 0 rc 0/0 00000100:00100000:0.0:1784189141.575242:0:66170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1138 00000100:00100000:0.0:1784189141.575272:0:66170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1139 00000100:00100000:0.0:1784189141.575278:0:66170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf4693f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1870854458107520:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784189141.575305:0:66170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf4693f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1870854458107520:12345-0@lo:400:kworker.0 Request processed in 27us (530us total) trans 0 rc 0/0 00000100:00100000:0.0:1784189141.575311:0:66170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1139 00000100:00100000:3.0:1784189141.575937:0:66171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458108032 00000100:00100000:3.0:1784189141.575943:0:66171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458108032 00000100:00100000:1.0:1784189141.575958:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc080e7f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3642:1870854458107008:0@lo:400:kworker.0 00000100:00100000:1.0:1784189141.575969:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc06b98d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3642:1870854458107520:0@lo:400:kworker.0 00000100:00100000:3.0:1784189141.575985:0:66171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1140 00000100:00100000:3.0:1784189141.576002:0:66171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf4693ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1870854458108032:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784189141.576052:0:66171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf4693ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1870854458108032:12345-0@lo:400:kworker.0 Request processed in 52us (1116us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189141.576059:0:66171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1140 00000100:00100000:1.0:1784189141.576426:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc06b98ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3642:1870854458108032:0@lo:400:kworker.0 00010000:00010000:1.0:1784189141.743743:0:7454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784189142.065352:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc05edd4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1870854458108416:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1784189142.065457:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784189142.065515:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1784189142.065522:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf4693c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1870854458108288:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1784189142.065545:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784189142.065744:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458108416 00000100:00100000:1.0:1784189142.065754:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458108416 00000100:00100000:1.0:1784189142.065812:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458108288 00000100:00100000:1.0:1784189142.065816:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458108288 00000100:00100000:1.0:1784189142.065837:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1938 00000100:00100000:1.0:1784189142.065862:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc05eddea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1870854458108416:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1784189142.065894:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8649664 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1784189142.065955:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc05eddea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1870854458108416:12345-0@lo:13:osp-pre-1-0.0 Request processed in 96us (498us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189142.065963:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1938 00000100:00100000:1.0:1784189142.065984:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1939 00000100:00100000:1.0:1784189142.065990:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc075662d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1870854458108288:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1784189142.066002:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8649664 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1784189142.066030:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc075662d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1870854458108288:12345-0@lo:13:osp-pre-0-0.0 Request processed in 40us (484us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189142.066036:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1939 00000100:00100000:3.0:1784189142.066257:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf4693c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1870854458108288:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1784189142.066275:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc05edd4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1870854458108416:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1784189142.312806:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1784189142.312907:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1784189142.312956:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1784189142.312988:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1784189142.313050:0:88967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436264832 00000100:00100000:0.0:1784189142.313062:0:88967:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436264832 00000100:00100000:0.0:1784189142.313131:0:88967:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 78 00000100:00100000:0.0:1784189142.313143:0:88967:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc06b02a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9957a2dc-fd88-4a91-bca3-e2b7f365ab0c+10:2396:x1870854436264832:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:0.0:1784189142.313255:0:88967:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc06b02a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9957a2dc-fd88-4a91-bca3-e2b7f365ab0c+10:2396:x1870854436264832:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 112us (297us total) trans 0 rc 0/0 00000100:00100000:0.0:1784189142.313264:0:88967:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 78 00000100:00100000:1.0:1784189142.315284:0:26169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436265216 00000100:00100000:1.0:1784189142.315304:0:26169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436265216 00000100:00100000:1.0:1784189142.315443:0:26169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 2414 00000100:00100000:1.0:1784189142.315456:0:26169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc07b5b2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+5:2396:x1870854436265216:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:1.0:1784189142.315586:0:26169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc07b5b2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+5:2396:x1870854436265216:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 133us (2677us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189142.315594:0:26169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 2414 00000100:00080000:0.0:1784189142.316314:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1784189142.325944:0:66945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436264960 00000100:00100000:3.0:1784189142.325964:0:66945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436264960 00000100:00100000:2.0:1784189142.326038:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1784189142.326090:0:26171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436265344 00000100:00100000:2.0:1784189142.326094:0:26171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436265344 00000100:00100000:3.0:1784189142.326193:0:66171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436265088 00000100:00100000:3.0:1784189142.326198:0:66171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436265088 00000100:00100000:2.0:1784189142.326277:0:26171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 2415 00000100:00100000:2.0:1784189142.326290:0:26171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc07b5b0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+5:2396:x1870854436265344:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:2.0:1784189142.326433:0:26171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc07b5b0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+5:2396:x1870854436265344:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 145us (400us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189142.326442:0:26171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 2415 00000100:00100000:2.0:1784189142.327000:0:66945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1141 00000100:00100000:2.0:1784189142.327011:0:66945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc07b5b3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+8:2396:x1870854436264960:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:2.0:1784189142.327065:0:66945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc07b5b3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+8:2396:x1870854436264960:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 56us (14273us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189142.327073:0:66945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1141 00000100:00080000:0.0:1784189142.331032:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1784189142.331047:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1784189142.331051:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1784189142.333768:0:66171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1142 00000100:00100000:3.0:1784189142.333794:0:66171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc07b5b0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+6:2396:x1870854436265088:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:3.0:1784189142.335132:0:66171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc07b5b0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+6:2396:x1870854436265088:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 1335us (22129us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189142.335148:0:66171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1142 00010000:00010000:3.0:1784189142.767734:0:26173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784189143.087767:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1784189143.087940:0:66169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436265472 00000100:00100000:3.0:1784189143.087964:0:66169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436265472 00000100:00100000:3.0:1784189143.088040:0:66169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1206 00000100:00100000:3.0:1784189143.088053:0:66169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc07b5b2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+8:68665:x1870854436265472:12345-192.168.203.12@tcp:41:lfs.0 00000004:00000024:3.0:1784189143.088105:0:66169:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445281792 avail 1299042304 00000100:00100000:3.0:1784189143.088204:0:66169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc07b5b2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+8:68665:x1870854436265472:12345-192.168.203.12@tcp:41:lfs.0 Request processed in 154us (453us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189143.088213:0:66169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1206 00000100:00100000:2.0:1784189143.093172:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1784189143.098411:0:66170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436265600 00000100:00100000:0.0:1784189143.098432:0:66170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436265600 00000100:00100000:0.0:1784189143.098539:0:66170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1207 00000100:00100000:0.0:1784189143.098567:0:66170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc07b5b1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+6:68665:x1870854436265600:12345-192.168.203.12@tcp:41:lfs.0 00000004:00000024:0.0:1784189143.098619:0:66170:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445576704 avail 1299337216 00000100:00100000:0.0:1784189143.098731:0:66170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc07b5b1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+6:68665:x1870854436265600:12345-192.168.203.12@tcp:41:lfs.0 Request processed in 166us (5575us total) trans 0 rc 0/0 00000100:00100000:0.0:1784189143.098740:0:66170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1207 00000100:00100000:1.0:1784189143.107398:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1784189143.108922:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436265728 00000100:00100000:2.0:1784189143.108940:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436265728 00000100:00100000:2.0:1784189143.109043:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1940 00000100:00100000:2.0:1784189143.109058:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf4693c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+5:68665:x1870854436265728:12345-192.168.203.12@tcp:13:lfs.0 00002000:00000024:2.0:1784189143.109104:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8649664 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1784189143.109215:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf4693c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+5:68665:x1870854436265728:12345-192.168.203.12@tcp:13:lfs.0 Request processed in 162us (1830us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189143.109235:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1940 00000100:00100000:1.0:1784189143.117460:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1784189143.117554:0:9466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436265856 00000100:00100000:2.0:1784189143.117568:0:9466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436265856 00000100:00100000:2.0:1784189143.117642:0:9466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1941 00000100:00100000:2.0:1784189143.117653:0:9466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc0477c0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+5:68665:x1870854436265856:12345-192.168.203.12@tcp:13:lfs.0 00002000:00000024:2.0:1784189143.117699:0:9466:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8649664 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1784189143.117802:0:9466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc0477c0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+5:68665:x1870854436265856:12345-192.168.203.12@tcp:13:lfs.0 Request processed in 150us (355us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189143.117823:0:9466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1941 00000100:00100000:0.0:1784189143.172255:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1784189143.174878:0:66171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436266112 00000100:00100000:3.0:1784189143.174900:0:66171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436266112 00000100:00100000:3.0:1784189143.175177:0:66171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1208 00000100:00100000:3.0:1784189143.175192:0:66171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc056eac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+8:68681:x1870854436266112:12345-192.168.203.12@tcp:101:cat.0 00010000:00010000:3.0:1784189143.175221:0:66171:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784189143.175255:0:66171:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc058f66200/0xcc1762b626f8b4b0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbfc5de7fe6c3dd1 expref: -99 pid: 66171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189143.176565:0:66171:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0755a5600/0xcc1762b626f8b2cd lrc: 3/0,0 mode: PW/PW res: [0x20000a811:0x6:0x0].0x0 bits 0x59/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c3da0 expref: 9 pid: 88996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189143.176603:0:66171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc058f67200/0xcc1762b626f8b4b7 lrc: 3/1,0 mode: --/PR res: [0x20000a811:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189143.176623:0:66171:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc058f67200/0xcc1762b626f8b4b7 lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189143.177105:0:66171:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc058f67200/0xcc1762b626f8b4b7 lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189143.177261:0:66171:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc058f67200/0xcc1762b626f8b4b7 lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189143.177290:0:66171:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc058f67200/0xcc1762b626f8b4b7 lrc: 2/0,0 mode: PR/PR res: [0x20000a811:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189143.177297:0:66171:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dc058f67200/0xcc1762b626f8b4b7 lrc: 3/0,0 mode: PR/PR res: [0x20000a811:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189143.177303:0:66171:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc058f67200 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:3.0:1784189143.177308:0:66171:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc058f67200/0xcc1762b626f8b4b7 lrc: 3/0,0 mode: PR/PR res: [0x20000a811:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189143.177345:0:66171:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc058f67200/0xcc1762b626f8b4b7 lrc: 4/0,0 mode: PR/PR res: [0x20000a811:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189143.177362:0:66171:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x6:0x0].0x0 (ffff9dc0455f8300) 00010000:00010000:3.0:1784189143.177365:0:66171:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784189143.177380:0:66171:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dc058f67200/0xcc1762b626f8b4b7 lrc: 2/0,0 mode: --/PR res: [0x20000a811:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189143.177387:0:66171:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc058f67200/0xcc1762b626f8b4b7 lrc: 0/0,0 mode: --/PR res: [0x20000a811:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189143.177469:0:66171:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc058f66200/0xcc1762b626f8b4b0 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c3dd1 expref: 10 pid: 66171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189143.177481:0:66171:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9dc0630a6700) 00010000:00010000:3.0:1784189143.177483:0:66171:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1784189143.177487:0:66171:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc058f66200/0xcc1762b626f8b4b0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c3dd1 expref: 10 pid: 66171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189143.177498:0:66171:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc058f66200, rc 0) 00000100:00100000:3.0:1784189143.177682:0:66171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc056eac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+9:68681:x1870854436266112:12345-192.168.203.12@tcp:101:cat.0 Request processed in 2492us (5440us total) trans 107374182402 rc 301/301 00000100:00100000:3.0:1784189143.177692:0:66171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1208 00000100:00100000:3.0:1784189143.193102:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1784189143.193246:0:66945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436266240 00000100:00100000:2.0:1784189143.193260:0:66945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436266240 00000100:00100000:2.0:1784189143.193395:0:66945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1209 00000100:00100000:2.0:1784189143.193407:0:66945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc075661f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+9:68681:x1870854436266240:12345-192.168.203.12@tcp:101:cat.0 00010000:00010000:2.0:1784189143.193440:0:66945:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784189143.193481:0:66945:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0755a5c00/0xcc1762b626f8b4c5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbfc5de7fe6c3dd8 expref: -99 pid: 66945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189143.193577:0:66945:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0755a4200/0xcc1762b626f8b4cc lrc: 3/1,0 mode: --/PR res: [0x20000a811:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189143.193595:0:66945:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0755a5600/0xcc1762b626f8b2cd lrc: 2/0,0 mode: PW/PW res: [0x20000a811:0x6:0x0].0x0 bits 0x59/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c3da0 expref: 10 pid: 88996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189143.193604:0:66945:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0755a4200/0xcc1762b626f8b4cc lrc: 4/1,0 mode: --/PR res: [0x20000a811:0x6:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189143.193651:0:66945:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0755a5600/0xcc1762b626f8b2cd lrc: 3/0,0 mode: PW/PW res: [0x20000a811:0x6:0x0].0x0 bits 0x59/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c3da0 expref: 10 pid: 88996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189143.193667:0:66945:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0755a5600/0xcc1762b626f8b2cd lrc: 4/0,0 mode: PW/PW res: [0x20000a811:0x6:0x0].0x0 bits 0x59/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c3da0 expref: 10 pid: 88996 timeout: 3485 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784189143.193683:0:66945:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc07b5b3800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:66945:1870854458108544:192.168.203.12@tcp:104: 00000100:00100000:2.0:1784189143.193791:0:66945:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dbf464c2a80 going to sleep for 11 seconds 00000100:00100000:0.0:1784189143.198059:0:66945:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc07b5b3800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:66945:1870854458108544:192.168.203.12@tcp:104: 00010000:00010000:0.0:1784189143.198102:0:66945:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0755a4200/0xcc1762b626f8b4cc lrc: 3/1,0 mode: --/PR res: [0x20000a811:0x6:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784189143.201721:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1784189143.201840:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436266368 00000100:00100000:1.0:1784189143.201858:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436266368 00010000:00010000:1.0:1784189143.201910:0:6500:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0755a5600/0xcc1762b626f8b2cd lrc: 4/0,0 mode: PW/PW res: [0x20000a811:0x6:0x0].0x0 bits 0x59/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c3da0 expref: 11 pid: 88996 timeout: 3485 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784189143.201967:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 2545 00000100:00100000:1.0:1784189143.201979:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc0711a4450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+11:2396:x1870854436266368:12345-192.168.203.12@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1784189143.202008:0:6500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000004:00010000:1.0:1784189143.202036:0:6500:0:(mdt_lvb.c:89:mdt_dom_disk_lvbo_update()) res: [0x20000a811:0x6:0x0] updating lvb size from disk: 0 -> 8 00000004:00010000:1.0:1784189143.202041:0:6500:0:(mdt_lvb.c:96:mdt_dom_disk_lvbo_update()) res: [0x20000a811:0x6:0x0] updating lvb mtime from disk: 0 -> 1784189096 00000004:00010000:1.0:1784189143.202044:0:6500:0:(mdt_lvb.c:102:mdt_dom_disk_lvbo_update()) res: [0x20000a811:0x6:0x0] updating lvb atime from disk: 0 -> 1784189089 00000004:00010000:1.0:1784189143.202046:0:6500:0:(mdt_lvb.c:108:mdt_dom_disk_lvbo_update()) res: [0x20000a811:0x6:0x0] updating lvb ctime from disk: 0 -> 1784189096 00010000:00010000:1.0:1784189143.202052:0:6500:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0755a5600/0xcc1762b626f8b2cd lrc: 4/0,0 mode: PW/PW res: [0x20000a811:0x6:0x0].0x0 bits 0x59/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c3da0 expref: 11 pid: 88996 timeout: 3485 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189143.202069:0:6500:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0755a5600/0xcc1762b626f8b2cd lrc: 3/0,0 mode: PW/PW res: [0x20000a811:0x6:0x0].0x0 bits 0x59/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c3da0 expref: 11 pid: 88996 timeout: 3485 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189143.202099:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0755a5600/0xcc1762b626f8b2cd lrc: 0/0,0 mode: --/PW res: [0x20000a811:0x6:0x0].0x0 bits 0x59/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c3da0 expref: 11 pid: 88996 timeout: 3485 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189143.202144:0:6500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x6:0x0].0x0 (ffff9dc0455f8300) 00010000:00010000:1.0:1784189143.202151:0:6500:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0755a4200/0xcc1762b626f8b4cc lrc: 3/1,0 mode: --/PR res: [0x20000a811:0x6:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189143.202167:0:6500:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0755a4200/0xcc1762b626f8b4cc lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0x6:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189143.202176:0:6500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0755a4200/0xcc1762b626f8b4cc lrc: 4/1,0 mode: PR/PR res: [0x20000a811:0x6:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189143.202218:0:6500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784189143.202291:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc0711a4450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+10:2396:x1870854436266368:12345-192.168.203.12@tcp:103:ldlm_bl.0 Request processed in 314us (585us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189143.202301:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 2545 00010000:00010000:2.0:1784189143.202799:0:66945:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0755a4200/0xcc1762b626f8b4cc lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0x6:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189143.202818:0:66945:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0755a4200/0xcc1762b626f8b4cc lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0x6:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784189143.202892:0:66945:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1784189143.202922:0:66945:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0755a4200/0xcc1762b626f8b4cc lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0x6:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189143.202958:0:66945:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0755a5c00/0xcc1762b626f8b4c5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c3dd8 expref: 10 pid: 66945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189143.202977:0:66945:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0755a4200/0xcc1762b626f8b4cc lrc: 3/0,0 mode: PR/PR res: [0x20000a811:0x6:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c3dd8 expref: 9 pid: 66945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189143.202985:0:66945:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x6:0x0].0x0 (ffff9dc0455f8300) 00010000:00010000:2.0:1784189143.203231:0:66945:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1784189143.203236:0:66945:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc0755a4200, rc 0) 00000100:00100000:2.0:1784189143.203293:0:66945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc075661f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+9:68681:x1870854436266240:12345-192.168.203.12@tcp:101:cat.0 Request processed in 9888us (10206us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189143.203302:0:66945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1209 00000100:00100000:3.0:1784189143.212833:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1784189143.213006:0:68287:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436266496 00000100:00100000:2.0:1784189143.213021:0:68287:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436266496 00000100:00100000:2.0:1784189143.213114:0:68287:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1210 00000100:00100000:2.0:1784189143.213128:0:68287:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc075663b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+9:68681:x1870854436266496:12345-192.168.203.12@tcp:101:cat.0 00010000:00010000:2.0:1784189143.213158:0:68287:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784189143.213188:0:68287:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0755a5c00/0xcc1762b626f8b4d3 lrc: 2/0,0 mode: --/CR res: [0x20000a811:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbfc5de7fe6c3ddf expref: -99 pid: 68287 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189143.213302:0:68287:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0755a5c00/0xcc1762b626f8b4d3 lrc: 3/0,0 mode: CR/CR res: [0x20000a811:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c3ddf expref: 10 pid: 68287 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189143.213384:0:68287:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0755a5c00/0xcc1762b626f8b4d3 lrc: 3/0,0 mode: CR/CR res: [0x20000a811:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c3ddf expref: 10 pid: 68287 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189143.213408:0:68287:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x6:0x0].0x0 (ffff9dc0455f8300) 00010000:00010000:2.0:1784189143.213411:0:68287:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1784189143.213417:0:68287:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc0755a5c00, rc 0) 00000100:00100000:2.0:1784189143.213558:0:68287:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc075663b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+10:68681:x1870854436266496:12345-192.168.203.12@tcp:101:cat.0 Request processed in 433us (743us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189143.213567:0:68287:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1210 00000100:00100000:1.0:1784189143.241795:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1784189143.242045:0:66171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436266624 00000100:00100000:3.0:1784189143.242058:0:66171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436266624 00000100:00100000:3.0:1784189143.242189:0:66171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1211 00000100:00100000:3.0:1784189143.242203:0:66171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc0477c0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+10:2399:x1870854436266624:12345-192.168.203.12@tcp:101:cat.0 00010000:00010000:3.0:1784189143.242229:0:66171:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784189143.242256:0:66171:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc058f66200/0xcc1762b626f8b4da lrc: 2/0,0 mode: --/PR res: [0x20000a811:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbfc5de7fe6c3de6 expref: -99 pid: 66171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189143.242304:0:66171:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc058f66200/0xcc1762b626f8b4da lrc: 3/0,0 mode: PR/PR res: [0x20000a811:0x6:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c3de6 expref: 11 pid: 66171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1784189143.242401:0:66171:0:(mdt_lvb.c:89:mdt_dom_disk_lvbo_update()) res: [0x20000a811:0x6:0x0] updating lvb size from disk: 8 -> 8 00000004:00010000:3.0:1784189143.242405:0:66171:0:(mdt_lvb.c:96:mdt_dom_disk_lvbo_update()) res: [0x20000a811:0x6:0x0] updating lvb mtime from disk: 1784189096 -> 1784189096 00000004:00010000:3.0:1784189143.242408:0:66171:0:(mdt_lvb.c:102:mdt_dom_disk_lvbo_update()) res: [0x20000a811:0x6:0x0] updating lvb atime from disk: 1784189089 -> 1784189089 00000004:00010000:3.0:1784189143.242410:0:66171:0:(mdt_lvb.c:108:mdt_dom_disk_lvbo_update()) res: [0x20000a811:0x6:0x0] updating lvb ctime from disk: 1784189096 -> 1784189096 00000004:00010000:3.0:1784189143.242413:0:66171:0:(mdt_lvb.c:114:mdt_dom_disk_lvbo_update()) res: [0x20000a811:0x6:0x0] updating lvb blocks from disk: 18427282363563114435 -> 8 00002000:00010000:3.0:1784189143.242418:0:66171:0:(mdt_io.c:1550:mdt_lvb2reply()) size 8 00010000:00010000:3.0:1784189143.242428:0:66171:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc058f66200/0xcc1762b626f8b4da lrc: 3/0,0 mode: PR/PR res: [0x20000a811:0x6:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c3de6 expref: 11 pid: 66171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189143.242444:0:66171:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x6:0x0].0x0 (ffff9dc0455f8300) 00010000:00010000:3.0:1784189143.242464:0:66171:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1784189143.242470:0:66171:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc058f66200, rc 0) 00000100:00100000:3.0:1784189143.242544:0:66171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc0477c0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+11:2399:x1870854436266624:12345-192.168.203.12@tcp:101:cat.0 Request processed in 344us (763us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189143.242552:0:66171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1211 00000100:00100000:2.0:1784189143.257505:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1784189143.257893:0:66182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436266752 00000100:00100000:1.0:1784189143.257908:0:66182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436266752 00002000:00100000:1.0:1784189143.257986:0:66182:0:(mdt_io.c:150:mdt_rw_hpreq_check()) @@@ lustre-MDT0000 mdt_io00_000: refresh rw locks for [0x20000a811:0x6:0x0] req@ffff9dc07b5b3100 x1870854436266752/t0(0) o3->b90fcc1c-0e69-42a4-a116-a71fec7aeb78@192.168.203.12@tcp:334/0 lens 488/0 e 0 to 0 dl 1784189154 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1784189143.257999:0:66182:0:(mdt_io.c:66:mdt_prolong_dom_lock()) Prolong DOM lock for req ffff9dc07b5b3100 with x1870854436266752 00000100:00100000:1.0:1784189143.258047:0:66182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 3 00000100:00100000:1.0:1784189143.258057:0:66182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc07b5b3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_000:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+11:2397:x1870854436266752:12345-192.168.203.12@tcp:3:cat.0 00000100:00100000:0.0:1784189143.271823:0:66182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc07b5b3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_000:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+11:2397:x1870854436266752:12345-192.168.203.12@tcp:3:cat.0 Request processed in 13755us (14320us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1784189143.271841:0:66182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 3 00002000:00100000:0.0:1784189143.271851:0:66182:0:(mdt_io.c:150:mdt_rw_hpreq_check()) @@@ lustre-MDT0000 mdt_io00_000: refresh rw locks for [0x20000a811:0x6:0x0] req@ffff9dc07b5b3100 x1870854436266752/t0(0) o3->b90fcc1c-0e69-42a4-a116-a71fec7aeb78@192.168.203.12@tcp:334/0 lens 488/4536 e 0 to 0 dl 1784189154 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1784189143.271862:0:66182:0:(mdt_io.c:66:mdt_prolong_dom_lock()) Prolong DOM lock for req ffff9dc07b5b3100 with x1870854436266752 00000100:00100000:1.0:1784189143.277693:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1784189143.277947:0:66173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436267008 00000100:00100000:0.0:1784189143.277956:0:66173:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436267008 00000100:00100000:0.0:1784189143.278018:0:66173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 224 00000100:00100000:0.0:1784189143.278028:0:66173:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf46434000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+11:68681:x1870854436267008:12345-192.168.203.12@tcp:35:cat.0 00000100:00100000:0.0:1784189143.278283:0:66173:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf46434000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+12:68681:x1870854436267008:12345-192.168.203.12@tcp:35:cat.0 Request processed in 256us (596us total) trans 107374182403 rc 0/0 00000100:00100000:0.0:1784189143.278291:0:66173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 224 00010000:00010000:2.0:1784189143.793358:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784189144.817938:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784189145.843945:0:7454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784189146.163171:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf43c5ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1870854458108672:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1784189146.163242:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784189146.163312:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1784189146.163337:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc080f68700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1870854458108800:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1784189146.163375:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784189146.163414:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458108672 00000100:00100000:1.0:1784189146.163421:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458108672 00000100:00100000:1.0:1784189146.163483:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458108800 00000100:00100000:1.0:1784189146.163486:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458108800 00000100:00100000:1.0:1784189146.163506:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1942 00000100:00100000:1.0:1784189146.163514:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc080f69180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1870854458108672:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1784189146.163539:0:8432:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8649664 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1784189146.163913:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc080f69180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1870854458108672:12345-0@lo:13:osp-pre-0-1.0 Request processed in 399us (669us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189146.163921:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1942 00000100:00100000:1.0:1784189146.163938:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1943 00000100:00100000:1.0:1784189146.163945:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf44fad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1870854458108800:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1784189146.163960:0:8432:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8649664 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1784189146.163989:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf44fad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1870854458108800:12345-0@lo:13:osp-pre-1-1.0 Request processed in 44us (613us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189146.163995:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1943 00000100:00100000:1.0:1784189146.164048:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc080f68700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1870854458108800:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1784189146.164063:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf43c5ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1870854458108672:0@lo:13:osp-pre-0-1.0 00000100:00080000:1.0:1784189146.168390:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1784189146.168399:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1784189146.671465:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc056eaca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1870854458108928:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1784189146.671529:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784189146.671588:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458108928 00000100:00100000:0.0:1784189146.671594:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458108928 00000100:00100000:0.0:1784189146.671640:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3782 00000100:00100000:0.0:1784189146.671648:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc06b98ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3640:x1870854458108928:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1784189146.671679:0:8439:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445576704 avail 1299337216 00000100:00100000:0.0:1784189146.671719:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc06b98ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3640:x1870854458108928:12345-0@lo:41:osp-pre-1-0.0 Request processed in 72us (189us total) trans 0 rc 0/0 00000100:00100000:0.0:1784189146.671726:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3782 00000100:00100000:0.0:1784189146.671770:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc056eaca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1870854458108928:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1784189146.673238:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc07b5b0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3642:1870854458109184:0@lo:400:kworker.0 00000100:00100000:2.0:1784189146.673280:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784189146.673302:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf444e1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1870854458109696:0@lo:400:kworker.0 00000100:00100000:2.0:1784189146.673339:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784189146.673363:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf46954000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3642:1870854458110208:0@lo:400:kworker.0 00000100:00100000:2.0:1784189146.673382:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784189146.673399:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1784189146.673404:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc07b5b1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3642:1870854458109312:0@lo:400:kworker.0 00000100:00100000:2.0:1784189146.673421:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784189146.673445:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf46955500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3642:1870854458109824:0@lo:400:kworker.0 00000100:00100000:0.0:1784189146.673557:0:26492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458109696 00000100:00100000:0.0:1784189146.673563:0:26492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458109696 00000100:00100000:0.0:1784189146.673603:0:26492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3783 00000100:00100000:0.0:1784189146.673612:0:26492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf4859aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3642:x1870854458109696:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784189146.673654:0:26492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf4859aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3642:x1870854458109696:12345-0@lo:400:kworker.0 Request processed in 43us (314us total) trans 0 rc 0/0 00000100:00100000:0.0:1784189146.673661:0:26492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3783 00000100:00100000:0.0:1784189146.673685:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc07b5b3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:bd553d0d-03e2-4233-b06b-b55bbfa2b954:3641:1870854458109056:0@lo:400:kworker.0 00000100:00100000:0.0:1784189146.673711:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784189146.673814:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf444e0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3641:1870854458109568:0@lo:400:kworker.0 00000100:00100000:0.0:1784189146.673837:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784189146.673853:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf46954700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1870854458110080:0@lo:400:kworker.0 00000100:00100000:0.0:1784189146.673878:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784189146.673895:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1784189146.673900:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc075f7c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3641:1870854458109440:0@lo:400:kworker.0 00000100:00100000:0.0:1784189146.673921:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784189146.673936:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf46954380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1870854458109952:0@lo:400:kworker.0 00000100:00100000:0.0:1784189146.673963:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784189146.673988:0:88973:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458109056 00000100:00100000:0.0:1784189146.673992:0:88973:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458109056 00000100:00100000:0.0:1784189146.674017:0:88973:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1784189146.674023:0:88973:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc06b02b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:bd553d0d-03e2-4233-b06b-b55bbfa2b954+24:3641:x1870854458109056:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784189146.675156:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784189146.675194:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf444e1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1870854458109696:0@lo:400:kworker.0 00000100:00100000:2.0:1784189146.675209:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1784189146.675220:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc075661880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1870854458110336:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1784189146.675244:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784189146.675279:0:66945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458109184 00000100:00100000:2.0:1784189146.675283:0:66945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458109184 00000100:00100000:2.0:1784189146.675356:0:66945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458110208 00000100:00100000:2.0:1784189146.675360:0:66945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458110208 00000100:00100000:2.0:1784189146.675373:0:66945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458109312 00000100:00100000:2.0:1784189146.675375:0:66945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458109312 00000100:00100000:2.0:1784189146.675386:0:66945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458109568 00000100:00100000:2.0:1784189146.675388:0:66945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458109568 00000100:00100000:2.0:1784189146.675401:0:66945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458109440 00000100:00100000:2.0:1784189146.675403:0:66945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458109440 00000100:00100000:2.0:1784189146.675413:0:66945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458109824 00000100:00100000:2.0:1784189146.675415:0:66945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458109824 00000100:00100000:2.0:1784189146.675428:0:66945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1143 00000100:00100000:2.0:1784189146.675446:0:66945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf46955880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3642:x1870854458109184:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784189146.675602:0:88973:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc06b02b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:bd553d0d-03e2-4233-b06b-b55bbfa2b954+24:3641:x1870854458109056:12345-0@lo:400:kworker.0 Request processed in 1578us (1889us total) trans 0 rc 0/0 00000100:00100000:0.0:1784189146.675609:0:88973:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1784189146.675639:0:66170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1144 00000100:00100000:0.0:1784189146.675645:0:66170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf48599c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1870854458110208:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784189146.675674:0:66170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf48599c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1870854458110208:12345-0@lo:400:kworker.0 Request processed in 29us (2291us total) trans 0 rc 0/0 00000100:00100000:0.0:1784189146.675679:0:66170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1144 00000100:00100000:0.0:1784189146.675692:0:66170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1145 00000100:00100000:0.0:1784189146.675697:0:66170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc050541880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1870854458109312:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784189146.675717:0:66170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc050541880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1870854458109312:12345-0@lo:400:kworker.0 Request processed in 21us (2295us total) trans 0 rc 0/0 00000100:00100000:0.0:1784189146.675722:0:66170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1145 00000100:00100000:3.0:1784189146.676244:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458110336 00000100:00100000:3.0:1784189146.676250:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458110336 00000100:00100000:3.0:1784189146.676283:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3784 00000100:00100000:3.0:1784189146.676290:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc050543b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3642:x1870854458110336:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1784189146.676315:0:8439:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445281792 avail 1299042304 00000100:00100000:3.0:1784189146.676376:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc050543b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3642:x1870854458110336:12345-0@lo:41:osp-pre-0-1.0 Request processed in 86us (1131us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189146.676382:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3784 00000100:00100000:0.0:1784189146.677579:0:66170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1146 00000100:00100000:0.0:1784189146.677593:0:66170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc06b98d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1870854458109568:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784189146.677646:0:66170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc06b98d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1870854458109568:12345-0@lo:400:kworker.0 Request processed in 59us (3808us total) trans 0 rc 0/0 00000100:00100000:0.0:1784189146.677653:0:66170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1146 00000100:00100000:0.0:1784189146.677671:0:66170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1147 00000100:00100000:0.0:1784189146.677677:0:66170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc06b98d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1870854458109440:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784189146.677718:0:66170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc06b98d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1870854458109440:12345-0@lo:400:kworker.0 Request processed in 41us (3796us total) trans 0 rc 0/0 00000100:00100000:0.0:1784189146.677724:0:66170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1147 00000100:00100000:0.0:1784189146.677736:0:66170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1148 00000100:00100000:0.0:1784189146.677743:0:66170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc050540700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1870854458109824:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784189146.677772:0:66170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc050540700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1870854458109824:12345-0@lo:400:kworker.0 Request processed in 30us (2618us total) trans 0 rc 0/0 00000100:00100000:0.0:1784189146.677777:0:66170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1148 00000100:00100000:0.0:1784189146.677798:0:26223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458110080 00000100:00100000:0.0:1784189146.677803:0:26223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458110080 00000100:00100000:0.0:1784189146.677832:0:26223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458109952 00000100:00100000:0.0:1784189146.677835:0:26223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458109952 00000100:00100000:0.0:1784189146.677852:0:26223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2416 00000100:00100000:0.0:1784189146.677857:0:26223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc06b98f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0000-mdtlov_UUID+5:3641:x1870854458110080:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784189146.677883:0:26223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc06b98f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0000-mdtlov_UUID+5:3641:x1870854458110080:12345-0@lo:400:kworker.0 Request processed in 26us (4005us total) trans 0 rc 0/0 00000100:00100000:0.0:1784189146.677888:0:26223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2416 00000100:00100000:0.0:1784189146.677898:0:26223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2417 00000100:00100000:0.0:1784189146.677902:0:26223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc06b98fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0000-mdtlov_UUID+5:3641:x1870854458109952:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784189146.677922:0:26223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc06b98fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0000-mdtlov_UUID+5:3641:x1870854458109952:12345-0@lo:400:kworker.0 Request processed in 20us (3959us total) trans 0 rc 0/0 00000100:00100000:0.0:1784189146.677927:0:26223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2417 00000100:00100000:0.0:1784189146.677979:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc075f7c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3641:1870854458109440:0@lo:400:kworker.0 00000100:00100000:0.0:1784189146.677989:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf46954380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1870854458109952:0@lo:400:kworker.0 00000100:00100000:0.0:1784189146.677998:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc07b5b3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:bd553d0d-03e2-4233-b06b-b55bbfa2b954:3641:1870854458109056:0@lo:400:kworker.0 00000100:00100000:0.0:1784189146.678015:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf444e0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3641:1870854458109568:0@lo:400:kworker.0 00000100:00100000:0.0:1784189146.678023:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf46954700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1870854458110080:0@lo:400:kworker.0 00000100:00100000:2.0:1784189146.678154:0:66945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf46955880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3642:x1870854458109184:12345-0@lo:400:kworker.0 Request processed in 2710us (4872us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189146.678161:0:66945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1143 00000100:00080000:2.0:1784189146.678188:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1784189146.678192:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1784189146.678194:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1784189146.678196:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1784189146.679892:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc075661880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1870854458110336:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1784189146.679906:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc07b5b1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3642:1870854458109312:0@lo:400:kworker.0 00000100:00100000:0.0:1784189146.679917:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf46955500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3642:1870854458109824:0@lo:400:kworker.0 00000100:00100000:0.0:1784189146.679928:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc07b5b0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3642:1870854458109184:0@lo:400:kworker.0 00000100:00100000:0.0:1784189146.679946:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf46954000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3642:1870854458110208:0@lo:400:kworker.0 00010000:00010000:2.0:1784189146.871205:0:26173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784189147.183916:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc075663800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1870854458110464:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1784189147.183983:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784189147.184104:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458110464 00000100:00100000:2.0:1784189147.184112:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458110464 00000100:00100000:2.0:1784189147.184168:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1944 00000100:00100000:2.0:1784189147.184192:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc06b98f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1870854458110464:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1784189147.184213:0:8432:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8649664 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1784189147.184259:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc06b98f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1870854458110464:12345-0@lo:13:osp-pre-1-0.0 Request processed in 70us (276us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189147.184267:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1944 00000100:00100000:1.0:1784189147.184270:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf44faca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1870854458110592:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1784189147.184298:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784189147.184308:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc075663800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1870854458110464:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1784189147.184354:0:9466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458110592 00000100:00100000:1.0:1784189147.184364:0:9466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458110592 00000100:00100000:1.0:1784189147.184398:0:9466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1945 00000100:00100000:1.0:1784189147.184405:0:9466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf44faf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1870854458110592:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1784189147.184425:0:9466:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8649664 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1784189147.184572:0:9466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf44faf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1870854458110592:12345-0@lo:13:osp-pre-0-0.0 Request processed in 166us (271us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189147.184579:0:9466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1945 00000100:00100000:0.0:1784189147.184854:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf44faca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1870854458110592:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1784189147.439942:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1784189147.439989:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1784189147.440167:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1784189147.440198:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1784189147.440219:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1784189147.440300:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436267648 00000100:00100000:3.0:1784189147.440309:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436267648 00000100:00100000:2.0:1784189147.440390:0:66170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436267392 00000100:00100000:2.0:1784189147.440395:0:66170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436267392 00000100:00100000:3.0:1784189147.440409:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436267520 00000100:00100000:3.0:1784189147.440412:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436267520 00000100:00100000:2.0:1784189147.440423:0:66170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436267264 00000100:00100000:2.0:1784189147.440425:0:66170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436267264 00000100:00100000:3.0:1784189147.440434:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 2418 00000100:00100000:3.0:1784189147.440444:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf43c5ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+5:2398:x1870854436267648:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:2.0:1784189147.440444:0:66170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1149 00000100:00100000:2.0:1784189147.440449:0:66170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf44faca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+6:2398:x1870854436267392:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:0.0:1784189147.440532:0:88967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436267136 00000100:00100000:0.0:1784189147.440536:0:88967:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436267136 00000100:00100000:0.0:1784189147.440564:0:88967:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 80 00000100:00100000:0.0:1784189147.440572:0:88967:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf43728450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9957a2dc-fd88-4a91-bca3-e2b7f365ab0c+10:2398:x1870854436267136:12345-192.168.203.12@tcp:400:kworker.0 00000100:00080000:1.0:1784189147.440623:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1784189147.440628:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1784189147.440630:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1784189147.440632:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1784189147.440657:0:66171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1150 00000100:00100000:1.0:1784189147.440666:0:66171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc080f68700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+12:2398:x1870854436267264:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:2.0:1784189147.440725:0:66170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf44faca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+6:2398:x1870854436267392:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 274us (734us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189147.440733:0:66170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1149 00000100:00100000:2.0:1784189147.440760:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 2419 00000100:00100000:2.0:1784189147.440766:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc05f02c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+5:2398:x1870854436267520:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:3.0:1784189147.447357:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf43c5ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+5:2398:x1870854436267648:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 6890us (7166us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189147.447374:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 2418 00000100:00100000:0.0:1784189147.447968:0:88967:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf43728450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9957a2dc-fd88-4a91-bca3-e2b7f365ab0c+10:2398:x1870854436267136:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 7392us (8032us total) trans 0 rc 0/0 00000100:00100000:0.0:1784189147.447979:0:88967:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 80 00000100:00100000:1.0:1784189147.456391:0:66171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc080f68700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+12:2398:x1870854436267264:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 15715us (16180us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189147.456408:0:66171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1150 00000100:00100000:2.0:1784189147.470566:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc05f02c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+5:2398:x1870854436267520:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 29787us (30332us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189147.470580:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 2419 00010000:00010000:1.0:1784189147.887506:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1784189148.726835:0:88963:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 107374182403 is committed 00010000:00010000:2.0:1784189148.911675:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784189149.936693:0:7454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1784189150.397244:0:89789:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: SKIP: replay-single test_131b skipping excluded test 131b 00010000:00010000:2.0:1784189150.960097:0:26173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784189151.279642:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc05f02d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1870854458110720:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1784189151.279731:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784189151.279833:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458110720 00000100:00100000:1.0:1784189151.279841:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458110720 00000100:00100000:1.0:1784189151.279898:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1946 00000100:00100000:1.0:1784189151.279909:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc07b5b0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1870854458110720:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1784189151.279937:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8649664 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1784189151.279995:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc07b5b0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1870854458110720:12345-0@lo:13:osp-pre-0-1.0 Request processed in 88us (263us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189151.280002:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1946 00000100:00080000:0.0:1784189151.280117:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1784189151.280156:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc05f02d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1870854458110720:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1784189151.280540:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1784189151.280550:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc050542680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1870854458110848:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1784189151.280592:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784189151.280947:0:9466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458110848 00000100:00100000:2.0:1784189151.280953:0:9466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458110848 00000100:00100000:2.0:1784189151.280999:0:9466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1947 00000100:00100000:2.0:1784189151.281016:0:9466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc07b5b1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1870854458110848:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1784189151.281038:0:9466:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8649664 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1784189151.281076:0:9466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc07b5b1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1870854458110848:12345-0@lo:13:osp-pre-1-1.0 Request processed in 62us (483us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189151.281083:0:9466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1947 00000100:00080000:0.0:1784189151.281142:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1784189151.281167:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc050542680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1870854458110848:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1784189151.791608:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1784189151.791637:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc050541180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:bd553d0d-03e2-4233-b06b-b55bbfa2b954:3641:1870854458110976:0@lo:400:kworker.0 00000100:00100000:2.0:1784189151.791735:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784189151.791806:0:88973:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458110976 00000100:00100000:2.0:1784189151.791815:0:88973:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458110976 00000100:00100000:2.0:1784189151.791876:0:88973:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1784189151.791886:0:88973:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf448b3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:bd553d0d-03e2-4233-b06b-b55bbfa2b954+24:3641:x1870854458110976:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784189151.791946:0:88973:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf448b3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:bd553d0d-03e2-4233-b06b-b55bbfa2b954+24:3641:x1870854458110976:12345-0@lo:400:kworker.0 Request processed in 61us (211us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189151.791955:0:88973:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1784189151.792016:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc050541180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:bd553d0d-03e2-4233-b06b-b55bbfa2b954:3641:1870854458110976:0@lo:400:kworker.0 00000100:00100000:2.0:1784189151.792058:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc050541180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3641:1870854458111104:0@lo:400:kworker.0 00000100:00100000:2.0:1784189151.792087:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784189151.792120:0:66169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458111104 00000100:00100000:2.0:1784189151.792124:0:66169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458111104 00000100:00100000:2.0:1784189151.792167:0:66169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1151 00000100:00100000:2.0:1784189151.792173:0:66169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc050542d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1870854458111104:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784189151.792209:0:66169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc050542d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1870854458111104:12345-0@lo:400:kworker.0 Request processed in 37us (121us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189151.792215:0:66169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1151 00000100:00080000:2.0:1784189151.792247:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1784189151.792295:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc050541180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3641:1870854458111104:0@lo:400:kworker.0 00000100:00100000:2.0:1784189151.792372:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc050541180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3642:1870854458111232:0@lo:400:kworker.0 00000100:00100000:2.0:1784189151.792399:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784189151.792431:0:66945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458111232 00000100:00100000:2.0:1784189151.792435:0:66945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458111232 00000100:00100000:2.0:1784189151.792468:0:66945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1152 00000100:00100000:2.0:1784189151.792474:0:66945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc050541f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1870854458111232:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784189151.792510:0:66945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc050541f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1870854458111232:12345-0@lo:400:kworker.0 Request processed in 35us (109us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189151.792517:0:66945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1152 00000100:00080000:2.0:1784189151.792532:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1784189151.792551:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc050541180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3642:1870854458111232:0@lo:400:kworker.0 00000100:00100000:2.0:1784189151.792583:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1784189151.792590:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc050541180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3642:1870854458111360:0@lo:400:kworker.0 00000100:00100000:2.0:1784189151.792615:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784189151.792685:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1784189151.792694:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc050540380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3641:1870854458111488:0@lo:400:kworker.0 00000100:00100000:3.0:1784189151.792722:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1784189151.792725:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784189151.792736:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc075661880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1870854458111744:0@lo:400:kworker.0 00000100:00100000:2.0:1784189151.792750:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc075663800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1870854458111616:0@lo:400:kworker.0 00000100:00100000:3.0:1784189151.792784:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784189151.792791:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784189151.792830:0:26492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458111616 00000100:00100000:2.0:1784189151.792835:0:26492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458111616 00000100:00100000:3.0:1784189151.792863:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc05edaad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1870854458111872:0@lo:400:kworker.0 00000100:00100000:2.0:1784189151.792875:0:26492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3785 00000100:00100000:2.0:1784189151.792882:0:26492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc050541c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3641:x1870854458111616:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784189151.792908:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784189151.792936:0:26492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc050541c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3641:x1870854458111616:12345-0@lo:400:kworker.0 Request processed in 54us (145us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189151.792950:0:26492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3785 00000100:00100000:2.0:1784189151.792976:0:26163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458111744 00000100:00100000:2.0:1784189151.792981:0:26163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458111744 00000100:00100000:3.0:1784189151.792989:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1784189151.792998:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc06bbf3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1870854458112256:0@lo:400:kworker.0 00000100:00100000:2.0:1784189151.793014:0:26163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458111872 00000100:00100000:2.0:1784189151.793018:0:26163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458111872 00000100:00100000:3.0:1784189151.793028:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784189151.793193:0:26161:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458112256 00000100:00100000:3.0:1784189151.793198:0:26161:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458112256 00000100:00100000:3.0:1784189151.793235:0:26161:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2420 00000100:00100000:3.0:1784189151.793242:0:26161:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc05edd4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:3643:x1870854458111744:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784189151.793281:0:26161:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc05edd4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:3643:x1870854458111744:12345-0@lo:400:kworker.0 Request processed in 39us (497us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189151.793288:0:26161:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2420 00000100:00100000:3.0:1784189151.793300:0:26161:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2421 00000100:00100000:3.0:1784189151.793316:0:26161:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc05edaaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:3643:x1870854458111872:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784189151.793369:0:26161:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc05edaaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:3643:x1870854458111872:12345-0@lo:400:kworker.0 Request processed in 64us (462us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189151.793375:0:26161:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2421 00000100:00100000:3.0:1784189151.793385:0:26161:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2422 00000100:00100000:3.0:1784189151.793390:0:26161:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc06bbf3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+5:3643:x1870854458112256:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784189151.793410:0:26161:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc06bbf3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+5:3643:x1870854458112256:12345-0@lo:400:kworker.0 Request processed in 20us (383us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189151.793415:0:26161:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2422 00000100:00100000:3.0:1784189151.793454:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc06bbf3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1870854458112256:0@lo:400:kworker.0 00000100:00100000:3.0:1784189151.793464:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc05edaad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1870854458111872:0@lo:400:kworker.0 00000100:00100000:3.0:1784189151.793472:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc075661880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1870854458111744:0@lo:400:kworker.0 00000100:00100000:3.0:1784189151.793525:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc06bbf3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1870854458112384:0@lo:400:kworker.0 00000100:00100000:3.0:1784189151.793549:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784189151.793651:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc056475880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3640:1870854458112000:0@lo:400:kworker.0 00000100:00100000:1.0:1784189151.793688:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784189151.793709:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc06bbf0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3640:1870854458112512:0@lo:400:kworker.0 00000100:00100000:1.0:1784189151.793730:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784189151.793747:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1784189151.793752:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc056475180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1870854458112128:0@lo:400:kworker.0 00000100:00100000:1.0:1784189151.793779:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784189151.793812:0:66171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458111360 00000100:00100000:1.0:1784189151.793816:0:66171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458111360 00000100:00100000:0.0:1784189151.795233:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1784189151.795252:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc07b5b3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1870854458112640:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1784189151.795635:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784189151.798203:0:26163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458112384 00000100:00100000:2.0:1784189151.798221:0:26163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458112384 00000100:00100000:3.0:1784189151.800640:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458112128 00000100:00100000:3.0:1784189151.800704:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458112128 00000100:00100000:3.0:1784189151.800770:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458112640 00000100:00100000:3.0:1784189151.800774:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458112640 00000100:00100000:3.0:1784189151.800796:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3786 00000100:00100000:3.0:1784189151.800806:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc07cb4e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3640:x1870854458112128:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784189151.800957:0:66171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458111488 00000100:00100000:1.0:1784189151.800963:0:66171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458111488 00000100:00100000:1.0:1784189151.800993:0:66171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458112000 00000100:00100000:1.0:1784189151.800997:0:66171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458112000 00000100:00100000:1.0:1784189151.801010:0:66171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458112512 00000100:00100000:1.0:1784189151.801013:0:66171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458112512 00000100:00100000:1.0:1784189151.801027:0:66171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1153 00000100:00100000:1.0:1784189151.801036:0:66171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc050542300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3642:x1870854458111360:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784189151.801112:0:66171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc050542300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3642:x1870854458111360:12345-0@lo:400:kworker.0 Request processed in 77us (8497us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189151.801120:0:66171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1153 00000100:00100000:1.0:1784189151.801141:0:66171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1154 00000100:00100000:1.0:1784189151.801147:0:66171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc050540a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1870854458111488:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784189151.801179:0:66171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc050540a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1870854458111488:12345-0@lo:400:kworker.0 Request processed in 32us (8456us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189151.801206:0:66171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1154 00000100:00100000:1.0:1784189151.801218:0:66171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1155 00000100:00100000:1.0:1784189151.801224:0:66171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc05f02e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1870854458112000:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784189151.801264:0:66171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc05f02e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1870854458112000:12345-0@lo:400:kworker.0 Request processed in 40us (7575us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189151.801343:0:66171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1155 00000100:00100000:1.0:1784189151.801357:0:66171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1156 00000100:00100000:1.0:1784189151.801370:0:66171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc05f02dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1870854458112512:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784189151.801476:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3787 00000100:00100000:2.0:1784189151.801500:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf46954000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3640:x1870854458112640:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1784189151.801543:0:8438:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445576704 avail 1299337216 00000100:00100000:2.0:1784189151.801617:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf46954000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3640:x1870854458112640:12345-0@lo:41:osp-pre-1-0.0 Request processed in 129us (5988us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189151.801625:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3787 00000100:00100000:2.0:1784189151.801653:0:26160:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2423 00000100:00100000:2.0:1784189151.801660:0:26160:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc06bbf2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+5:3643:x1870854458112384:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784189151.801683:0:66171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc05f02dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1870854458112512:12345-0@lo:400:kworker.0 Request processed in 317us (7948us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189151.801693:0:66171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1156 00000100:00100000:2.0:1784189151.801719:0:26160:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc06bbf2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+5:3643:x1870854458112384:12345-0@lo:400:kworker.0 Request processed in 56us (8165us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189151.801728:0:26160:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2423 00000100:00080000:2.0:1784189151.801771:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1784189151.801777:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1784189151.801779:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1784189151.801782:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1784189151.801848:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc07b5b3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1870854458112640:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1784189151.806486:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc050541180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3642:1870854458111360:0@lo:400:kworker.0 00000100:00100000:2.0:1784189151.806522:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf46955500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1870854458112768:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1784189151.806584:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784189151.806637:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458112768 00000100:00100000:2.0:1784189151.806642:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458112768 00000100:00100000:2.0:1784189151.806692:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3788 00000100:00100000:2.0:1784189151.806700:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc050541180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3642:x1870854458112768:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1784189151.806734:0:8438:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445281792 avail 1299042304 00000100:00100000:2.0:1784189151.806777:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc050541180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3642:x1870854458112768:12345-0@lo:41:osp-pre-0-1.0 Request processed in 77us (192us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189151.806784:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3788 00000100:00100000:2.0:1784189151.806823:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf46955500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1870854458112768:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1784189151.806850:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc075663800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1870854458111616:0@lo:400:kworker.0 00000100:00100000:2.0:1784189151.806862:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc050540380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3641:1870854458111488:0@lo:400:kworker.0 00000100:00100000:2.0:1784189151.809187:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc06bbf3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1870854458112384:0@lo:400:kworker.0 00000100:00100000:1.0:1784189151.812103:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc056475880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3640:1870854458112000:0@lo:400:kworker.0 00000100:00100000:0.0:1784189151.812207:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc06bbf0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3640:1870854458112512:0@lo:400:kworker.0 00000100:00100000:3.0:1784189151.813161:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc07cb4e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3640:x1870854458112128:12345-0@lo:400:kworker.0 Request processed in 12350us (19373us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189151.813178:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3786 00000100:00100000:1.0:1784189151.813745:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc056475180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1870854458112128:0@lo:400:kworker.0 00010000:00010000:1.0:1784189151.983610:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1784189152.168984:0:89838:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == replay-single test 132a: PFL new component instantiate replay ========================================================== 04:05:49 (1784189149) 00000100:00100000:3.0:1784189152.303555:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1784189152.303580:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf46954700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1870854458112896:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1784189152.303651:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784189152.304378:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458112896 00000100:00100000:0.0:1784189152.304387:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458112896 00000100:00100000:0.0:1784189152.304441:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1948 00000100:00100000:0.0:1784189152.304450:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc06bbf1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1870854458112896:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1784189152.304481:0:8432:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8649664 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1784189152.304534:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc06bbf1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1870854458112896:12345-0@lo:13:osp-pre-0-0.0 Request processed in 84us (882us total) trans 0 rc 0/0 00000100:00100000:0.0:1784189152.304542:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1948 00000100:00100000:0.0:1784189152.304587:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf46954700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1870854458112896:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1784189152.304625:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc06bbf3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1870854458113024:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1784189152.304654:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784189152.304684:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458113024 00000100:00100000:0.0:1784189152.304688:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458113024 00000100:00100000:0.0:1784189152.304710:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1949 00000100:00100000:0.0:1784189152.304716:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf46954700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1870854458113024:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1784189152.304726:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8649664 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1784189152.304767:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf46954700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1870854458113024:12345-0@lo:13:osp-pre-1-0.0 Request processed in 51us (112us total) trans 0 rc 0/0 00000100:00100000:0.0:1784189152.304773:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1949 00000100:00100000:0.0:1784189152.304814:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc06bbf3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1870854458113024:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1784189152.485652:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1784189152.485743:0:66171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436267776 00000100:00100000:1.0:1784189152.485752:0:66171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436267776 00000100:00100000:1.0:1784189152.485824:0:66171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1212 00000100:00100000:1.0:1784189152.485834:0:66171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc06bbf1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+10:69405:x1870854436267776:12345-192.168.203.12@tcp:101:lfs.0 00010000:00010000:1.0:1784189152.485852:0:66171:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784189152.485871:0:66171:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc07116f400/0xcc1762b626f8b4e1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbfc5de7fe6c3ded expref: -99 pid: 66171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189152.485931:0:66171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc07116ec00/0xcc1762b626f8b4e8 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189152.485957:0:66171:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc07116ec00/0xcc1762b626f8b4e8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189152.485968:0:66171:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc07116ec00/0xcc1762b626f8b4e8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189152.485982:0:66171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc07116e000/0xcc1762b626f8b4ef lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189152.485989:0:66171:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc07116e000/0xcc1762b626f8b4ef lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189152.485996:0:66171:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc07116e000/0xcc1762b626f8b4ef lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189152.486035:0:66171:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc07116ec00/0xcc1762b626f8b4e8 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189152.486041:0:66171:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc07116ec00/0xcc1762b626f8b4e8 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189152.486047:0:66171:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc07116ec00/0xcc1762b626f8b4e8 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189152.486054:0:66171:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dc07116ec00/0xcc1762b626f8b4e8 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189152.486060:0:66171:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc07116ec00 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:1.0:1784189152.486065:0:66171:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc07116ec00/0xcc1762b626f8b4e8 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189152.486072:0:66171:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc07116ec00/0xcc1762b626f8b4e8 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189152.486088:0:66171:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9dc0630a6700) 00010000:00010000:1.0:1784189152.486091:0:66171:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784189152.486095:0:66171:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dc07116ec00/0xcc1762b626f8b4e8 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189152.486101:0:66171:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc07116ec00/0xcc1762b626f8b4e8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189152.486114:0:66171:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc07116e000/0xcc1762b626f8b4ef lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189152.486120:0:66171:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc07116e000/0xcc1762b626f8b4ef lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189152.486125:0:66171:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dc07116e000/0xcc1762b626f8b4ef lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189152.486130:0:66171:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc07116e000 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:1.0:1784189152.486134:0:66171:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc07116e000/0xcc1762b626f8b4ef lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189152.486151:0:66171:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc07116e000/0xcc1762b626f8b4ef lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189152.486158:0:66171:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xae972c0d (ffff9dc07fa37300) 00010000:00010000:1.0:1784189152.486160:0:66171:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784189152.486163:0:66171:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dc07116e000/0xcc1762b626f8b4ef lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189152.486168:0:66171:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc07116e000/0xcc1762b626f8b4ef lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189152.486206:0:66171:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc07116f400/0xcc1762b626f8b4e1 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c3ded expref: 11 pid: 66171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189152.486216:0:66171:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9dc0630a6700) 00010000:00010000:1.0:1784189152.486218:0:66171:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784189152.486221:0:66171:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc07116f400/0xcc1762b626f8b4e1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c3ded expref: 11 pid: 66171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189152.486230:0:66171:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc07116f400, rc 0) 00000100:00100000:1.0:1784189152.486285:0:66171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc06bbf1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+10:69405:x1870854436267776:12345-192.168.203.12@tcp:101:lfs.0 Request processed in 453us (641us total) trans 0 rc 301/301 00000100:00100000:1.0:1784189152.486292:0:66171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1212 00000100:00080000:2.0:1784189152.486964:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1784189152.488373:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1784189152.488568:0:66945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436268032 00000100:00100000:2.0:1784189152.488576:0:66945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436268032 00000100:00100000:2.0:1784189152.488629:0:66945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1213 00000100:00100000:2.0:1784189152.488638:0:66945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf46954380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+10:69405:x1870854436268032:12345-192.168.203.12@tcp:101:lfs.0 00010000:00010000:2.0:1784189152.488654:0:66945:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784189152.488656:0:66945:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1784189152.488676:0:66945:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc07116f600/0xcc1762b626f8b49b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c3dca expref: 10 pid: 66170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189152.488692:0:66945:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9dc0630a6700) 00010000:00010000:2.0:1784189152.488701:0:66945:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1784189152.488715:0:66945:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0755a4e00/0xcc1762b626f8b4f6 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbfc5de7fe6c3df4 expref: -99 pid: 66945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189152.488819:0:66945:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0755a5600/0xcc1762b626f8b4fd lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189152.488831:0:66945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0755a5600/0xcc1762b626f8b4fd lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189152.488840:0:66945:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0755a5600/0xcc1762b626f8b4fd lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189152.488853:0:66945:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0755a5400/0xcc1762b626f8b504 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xae972c0d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189152.488860:0:66945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0755a5400/0xcc1762b626f8b504 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189152.488867:0:66945:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0755a5400/0xcc1762b626f8b504 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189152.489240:0:66945:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0755a5e00/0xcc1762b626f8b50b lrc: 3/1,0 mode: --/PR res: [0x20000a811:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189152.489250:0:66945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0755a5e00/0xcc1762b626f8b50b lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189152.489257:0:66945:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0755a5e00/0xcc1762b626f8b50b lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784189152.489267:0:66945:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000a811:0x9:0x0]: returning size 0 00010000:00010000:2.0:1784189152.489286:0:66945:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0755a5600/0xcc1762b626f8b4fd lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189152.489293:0:66945:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0755a5600/0xcc1762b626f8b4fd lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189152.489524:0:66945:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0755a5600/0xcc1762b626f8b4fd lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189152.489532:0:66945:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0755a5600/0xcc1762b626f8b4fd lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189152.489538:0:66945:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc0755a5600 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:2.0:1784189152.489542:0:66945:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0755a5600/0xcc1762b626f8b4fd lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189152.489549:0:66945:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0755a5600/0xcc1762b626f8b4fd lrc: 5/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189152.489559:0:66945:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9dc04a2a5100) 00010000:00010000:2.0:1784189152.489561:0:66945:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784189152.489564:0:66945:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0755a5600/0xcc1762b626f8b4fd lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189152.489571:0:66945:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0755a5600/0xcc1762b626f8b4fd lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1784189152.489584:0:66945:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000e334ba6e reply state 00000000884ad2e9 transno 107374182404 ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0755a5400/0xcc1762b626f8b504 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189152.489595:0:66945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0755a5400/0xcc1762b626f8b504 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189152.489601:0:66945:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xae972c0d (ffff9dc04a2a5000) 00010000:00010000:2.0:1784189152.489604:0:66945:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1784189152.489606:0:66945:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1784189152.491871:0:66945:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0755a4e00/0xcc1762b626f8b4f6 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c3df4 expref: 12 pid: 66945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189152.491906:0:66945:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0755a5e00/0xcc1762b626f8b50b lrc: 3/0,0 mode: PR/PR res: [0x20000a811:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c3df4 expref: 11 pid: 66945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189152.491917:0:66945:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x9:0x0].0x0 (ffff9dc04a2a5300) 00010000:00010000:3.0:1784189152.491920:0:66945:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1784189152.491923:0:66945:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc0755a5e00, rc 0) 00000100:00100000:3.0:1784189152.492034:0:66945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf46954380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+12:69405:x1870854436268032:12345-192.168.203.12@tcp:101:lfs.0 Request processed in 3396us (3665us total) trans 107374182404 rc 0/0 00000100:00100000:3.0:1784189152.492056:0:66945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1213 00000100:00100000:0.0:1784189152.503726:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1784189152.506204:0:68287:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436268288 00000100:00100000:3.0:1784189152.506217:0:68287:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436268288 00000100:00100000:3.0:1784189152.506284:0:68287:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1214 00000100:00100000:3.0:1784189152.506294:0:68287:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf46956a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+12:69405:x1870854436268288:12345-192.168.203.12@tcp:101:lfs.0 00010000:00010000:3.0:1784189152.506653:0:68287:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784189152.506677:0:68287:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc058f67800/0xcc1762b626f8b519 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbfc5de7fe6c3dfb expref: -99 pid: 68287 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189152.506782:0:68287:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc058f67200/0xcc1762b626f8b520 lrc: 3/0,1 mode: --/EX res: [0x20000a811:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189152.506795:0:68287:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0755a5e00/0xcc1762b626f8b50b lrc: 2/0,0 mode: PR/PR res: [0x20000a811:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c3df4 expref: 13 pid: 66945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189152.506803:0:68287:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc058f67200/0xcc1762b626f8b520 lrc: 4/0,1 mode: --/EX res: [0x20000a811:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189152.506834:0:68287:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0755a5e00/0xcc1762b626f8b50b lrc: 3/0,0 mode: PR/PR res: [0x20000a811:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c3df4 expref: 13 pid: 66945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189152.506847:0:68287:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0755a5e00/0xcc1762b626f8b50b lrc: 4/0,0 mode: PR/PR res: [0x20000a811:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c3df4 expref: 13 pid: 66945 timeout: 3494 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784189152.506859:0:68287:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc06bbf0000 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:68287:1870854458113152:192.168.203.12@tcp:104: 00000100:00100000:3.0:1784189152.506937:0:68287:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dc06bb569c0 going to sleep for 11 seconds 00000100:00100000:3.0:1784189152.514169:0:68287:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc06bbf0000 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:68287:1870854458113152:192.168.203.12@tcp:104: 00010000:00010000:3.0:1784189152.514212:0:68287:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9dc058f67200/0xcc1762b626f8b520 lrc: 3/0,1 mode: --/EX res: [0x20000a811:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784189152.516794:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1784189152.517228:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436268416 00000100:00100000:2.0:1784189152.517248:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436268416 00010000:00010000:2.0:1784189152.517287:0:6499:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0755a5e00/0xcc1762b626f8b50b lrc: 4/0,0 mode: PR/PR res: [0x20000a811:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c3df4 expref: 14 pid: 66945 timeout: 3494 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784189152.517357:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 2546 00000100:00100000:2.0:1784189152.517368:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf46954a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+14:2396:x1870854436268416:12345-192.168.203.12@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1784189152.517382:0:6499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784189152.517397:0:6499:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0755a5e00/0xcc1762b626f8b50b lrc: 4/0,0 mode: PR/PR res: [0x20000a811:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c3df4 expref: 14 pid: 66945 timeout: 3494 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189152.517412:0:6499:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0755a5e00/0xcc1762b626f8b50b lrc: 3/0,0 mode: PR/PR res: [0x20000a811:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c3df4 expref: 14 pid: 66945 timeout: 3494 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189152.517444:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0755a5e00/0xcc1762b626f8b50b lrc: 0/0,0 mode: --/PR res: [0x20000a811:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c3df4 expref: 14 pid: 66945 timeout: 3494 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189152.517743:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x9:0x0].0x0 (ffff9dc04a2a5300) 00010000:00010000:2.0:1784189152.517750:0:6499:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9dc058f67200/0xcc1762b626f8b520 lrc: 3/0,1 mode: --/EX res: [0x20000a811:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189152.517759:0:6499:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc058f67200/0xcc1762b626f8b520 lrc: 3/0,1 mode: EX/EX res: [0x20000a811:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189152.517765:0:6499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc058f67200/0xcc1762b626f8b520 lrc: 4/0,1 mode: EX/EX res: [0x20000a811:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189152.517795:0:6499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784189152.517853:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf46954a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+13:2396:x1870854436268416:12345-192.168.203.12@tcp:103:ldlm_bl.0 Request processed in 486us (1066us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189152.517871:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 2546 00010000:00010000:3.0:1784189152.517936:0:68287:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9dc058f67200/0xcc1762b626f8b520 lrc: 3/0,1 mode: EX/EX res: [0x20000a811:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189152.517945:0:68287:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc058f67200/0xcc1762b626f8b520 lrc: 3/0,1 mode: EX/EX res: [0x20000a811:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784189152.517963:0:68287:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000a811:0x9:0x0]: returning size 0 00000004:00080000:3.0:1784189152.518093:0:68287:0:(osp_internal.h:570:osp_update_last_fid()) Gap in objids: start=[0x2c0000401:0x683:0x0], count =127 00000004:00080000:3.0:1784189152.518100:0:68287:0:(osp_object.c:1645:osp_create()) Writing gap [0x2c0000401:0x683:0x0]+127 in llog 00000004:00080000:3.0:1784189152.518133:0:68287:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x702:0x0], index 1: 0 00010000:00010000:3.0:1784189152.518245:0:68287:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc058f67200/0xcc1762b626f8b520 lrc: 3/0,1 mode: EX/EX res: [0x20000a811:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189152.518254:0:68287:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc058f67200/0xcc1762b626f8b520 lrc: 2/0,0 mode: EX/EX res: [0x20000a811:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189152.518261:0:68287:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dc058f67200/0xcc1762b626f8b520 lrc: 3/0,0 mode: EX/EX res: [0x20000a811:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189152.518267:0:68287:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc058f67200 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:3.0:1784189152.518271:0:68287:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc058f67200/0xcc1762b626f8b520 lrc: 3/0,0 mode: EX/EX res: [0x20000a811:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189152.518278:0:68287:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc058f67200/0xcc1762b626f8b520 lrc: 4/0,0 mode: EX/EX res: [0x20000a811:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189152.518287:0:68287:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x9:0x0].0x0 (ffff9dc04a2a5300) 00010000:00010000:3.0:1784189152.518289:0:68287:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1784189152.518313:0:68287:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dc058f67200/0xcc1762b626f8b520 lrc: 2/0,0 mode: --/EX res: [0x20000a811:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189152.518354:0:68287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc058f67200/0xcc1762b626f8b520 lrc: 0/0,0 mode: --/EX res: [0x20000a811:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189152.518423:0:68287:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc058f67800/0xcc1762b626f8b519 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c3dfb expref: 13 pid: 68287 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189152.518440:0:68287:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9dbf47362500) 00010000:00010000:3.0:1784189152.518442:0:68287:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1784189152.518446:0:68287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc058f67800/0xcc1762b626f8b519 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c3dfb expref: 13 pid: 68287 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189152.518772:0:68287:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc058f67800, rc 0) 00000100:00100000:3.0:1784189152.518811:0:68287:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf46956a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+12:69405:x1870854436268288:12345-192.168.203.12@tcp:101:lfs.0 Request processed in 12517us (15094us total) trans 107374182405 rc 301/301 00000100:00100000:3.0:1784189152.518819:0:68287:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1214 00000100:00100000:1.0:1784189152.523939:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1784189152.524235:0:66172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436268672 00000100:00100000:2.0:1784189152.524245:0:66172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436268672 00000100:00100000:2.0:1784189152.524314:0:66172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 225 00000100:00100000:2.0:1784189152.524358:0:66172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc05f02f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+12:69405:x1870854436268672:12345-192.168.203.12@tcp:35:lfs.0 00000100:00100000:2.0:1784189152.524656:0:66172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc05f02f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+13:69405:x1870854436268672:12345-192.168.203.12@tcp:35:lfs.0 Request processed in 300us (724us total) trans 107374182406 rc 0/0 00000100:00100000:2.0:1784189152.524665:0:66172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 225 00000100:00100000:1.0:1784189152.529354:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1784189152.529901:0:66172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436268928 00000100:00100000:2.0:1784189152.529910:0:66172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436268928 00000100:00100000:2.0:1784189152.529969:0:66172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 226 00000100:00100000:2.0:1784189152.529980:0:66172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc05f02ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+13:69405:x1870854436268928:12345-192.168.203.12@tcp:35:lfs.0 00000100:00100000:2.0:1784189152.530181:0:66172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc05f02ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+14:69405:x1870854436268928:12345-192.168.203.12@tcp:35:lfs.0 Request processed in 202us (887us total) trans 107374182407 rc 0/0 00000100:00100000:2.0:1784189152.530189:0:66172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 226 00000100:00100000:0.0:1784189152.560726:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1784189152.560829:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1784189152.560853:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1784189152.560895:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1784189152.560926:0:26171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436269312 00000100:00100000:0.0:1784189152.560934:0:26171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436269312 00000100:00100000:0.0:1784189152.560998:0:26171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436269440 00000100:00100000:0.0:1784189152.561001:0:26171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436269440 00000100:00100000:0.0:1784189152.561030:0:26171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 2424 00000100:00100000:0.0:1784189152.561039:0:26171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf46955500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+5:2399:x1870854436269312:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:0.0:1784189152.561098:0:26171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf46955500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+5:2399:x1870854436269312:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 61us (270us total) trans 0 rc 0/0 00000100:00100000:0.0:1784189152.561106:0:26171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 2424 00000100:00100000:0.0:1784189152.561120:0:26171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 2425 00000100:00100000:0.0:1784189152.561125:0:26171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc056475880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+5:2399:x1870854436269440:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:0.0:1784189152.561143:0:26171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc056475880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+5:2399:x1870854436269440:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 18us (248us total) trans 0 rc 0/0 00000100:00100000:0.0:1784189152.561149:0:26171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 2425 00000100:00080000:0.0:1784189152.561167:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1784189152.561182:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1784189152.561411:0:66171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436269184 00000100:00100000:2.0:1784189152.561421:0:66171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436269184 00000100:00100000:2.0:1784189152.561470:0:66171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1157 00000100:00100000:2.0:1784189152.561477:0:66171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc056475180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+6:2399:x1870854436269184:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:2.0:1784189152.561510:0:66171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc056475180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+6:2399:x1870854436269184:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 34us (656us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189152.561516:0:66171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1157 00000100:00080000:0.0:1784189152.563688:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1784189152.566670:0:88968:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436269056 00000100:00100000:3.0:1784189152.566685:0:88968:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436269056 00000100:00100000:3.0:1784189152.566738:0:88968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 82 00000100:00100000:3.0:1784189152.566748:0:88968:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf448b0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9957a2dc-fd88-4a91-bca3-e2b7f365ab0c+10:2399:x1870854436269056:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:3.0:1784189152.566823:0:88968:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf448b0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9957a2dc-fd88-4a91-bca3-e2b7f365ab0c+10:2399:x1870854436269056:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 76us (6108us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189152.566830:0:88968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 82 00010000:00010000:1.0:1784189153.010811:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1784189153.474775:0:88963:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 107374182407 is committed 00010000:00010000:2.0:1784189153.474796:0:3626:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0755a5400/0xcc1762b626f8b504 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189153.474826:0:3626:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0755a5400/0xcc1762b626f8b504 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189153.474834:0:3626:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0755a5400/0xcc1762b626f8b504 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189153.474841:0:3626:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc0755a5400 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:2.0:1784189153.474846:0:3626:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0755a5400/0xcc1762b626f8b504 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189153.474854:0:3626:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0755a5400/0xcc1762b626f8b504 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189153.474869:0:3626:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xae972c0d (ffff9dc04a2a5000) 00010000:00010000:2.0:1784189153.474873:0:3626:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784189153.474877:0:3626:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0755a5400/0xcc1762b626f8b504 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189153.474883:0:3626:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0755a5400/0xcc1762b626f8b504 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784189153.589900:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1784189153.608560:0:66945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436269568 00000100:00100000:1.0:1784189153.608574:0:66945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436269568 00000100:00100000:1.0:1784189153.608644:0:66945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1215 00000100:00100000:1.0:1784189153.608655:0:66945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc07b5b3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+9:69422:x1870854436269568:12345-192.168.203.12@tcp:101:lfs.0 00010000:00010000:1.0:1784189153.608678:0:66945:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784189153.608703:0:66945:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc07116e400/0xcc1762b626f8b52e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbfc5de7fe6c3e02 expref: -99 pid: 66945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189153.608767:0:66945:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc07116e200/0xcc1762b626f8b535 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189153.608780:0:66945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc07116e200/0xcc1762b626f8b535 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189153.608797:0:66945:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc07116e200/0xcc1762b626f8b535 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784189153.608838:0:66945:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1784189153.608841:0:66945:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1784189153.608858:0:66945:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9dc07116e200/0xcc1762b626f8b535 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189153.608879:0:66945:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc07116e400/0xcc1762b626f8b52e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c3e02 expref: 11 pid: 66945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189153.608893:0:66945:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc07116e200/0xcc1762b626f8b535 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c3e02 expref: 10 pid: 66945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189153.608900:0:66945:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9dc07fa37300) 00010000:00010000:1.0:1784189153.608903:0:66945:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1784189153.608908:0:66945:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc07116e200, rc 0) 00000100:00100000:1.0:1784189153.608965:0:66945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc07b5b3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+10:69422:x1870854436269568:12345-192.168.203.12@tcp:101:lfs.0 Request processed in 312us (19073us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189153.608972:0:66945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1215 00000100:00100000:1.0:1784189153.613772:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1784189153.614192:0:68287:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436269696 00000100:00100000:2.0:1784189153.614202:0:68287:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436269696 00000100:00100000:2.0:1784189153.614304:0:68287:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1216 00000100:00100000:2.0:1784189153.614315:0:68287:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc05f02c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+10:69422:x1870854436269696:12345-192.168.203.12@tcp:41:lfs.0 00000004:00000024:2.0:1784189153.614367:0:68287:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445281792 avail 1299042304 00000100:00100000:2.0:1784189153.614438:0:68287:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc05f02c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+10:69422:x1870854436269696:12345-192.168.203.12@tcp:41:lfs.0 Request processed in 124us (674us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189153.614455:0:68287:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1216 00000100:00100000:0.0:1784189153.619667:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1784189153.637752:0:66171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436269824 00000100:00100000:1.0:1784189153.637765:0:66171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436269824 00000100:00100000:1.0:1784189153.637860:0:66171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1217 00000100:00100000:1.0:1784189153.637871:0:66171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc075f7df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+6:69422:x1870854436269824:12345-192.168.203.12@tcp:41:lfs.0 00000004:00000024:1.0:1784189153.637910:0:66171:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445576704 avail 1299337216 00000100:00100000:1.0:1784189153.637979:0:66171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc075f7df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+6:69422:x1870854436269824:12345-192.168.203.12@tcp:41:lfs.0 Request processed in 111us (18321us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189153.637997:0:66171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1217 00000100:00100000:0.0:1784189153.654781:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1784189153.654856:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436269952 00000100:00100000:2.0:1784189153.654866:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436269952 00000100:00100000:2.0:1784189153.654923:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1950 00000100:00100000:2.0:1784189153.654934:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc075f7fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+5:69422:x1870854436269952:12345-192.168.203.12@tcp:13:lfs.0 00002000:00000024:2.0:1784189153.654965:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8649664 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1784189153.655035:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc075f7fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+5:69422:x1870854436269952:12345-192.168.203.12@tcp:13:lfs.0 Request processed in 103us (264us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189153.655043:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1950 00000100:00100000:1.0:1784189153.664598:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1784189153.664730:0:9466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436270080 00000100:00100000:3.0:1784189153.664739:0:9466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436270080 00000100:00100000:3.0:1784189153.664803:0:9466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1951 00000100:00100000:3.0:1784189153.664814:0:9466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc05f02f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+5:69422:x1870854436270080:12345-192.168.203.12@tcp:13:lfs.0 00002000:00000024:3.0:1784189153.664845:0:9466:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8649664 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1784189153.664913:0:9466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc05f02f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+5:69422:x1870854436270080:12345-192.168.203.12@tcp:13:lfs.0 Request processed in 101us (325us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189153.664921:0:9466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1951 00000100:00100000:3.0:1784189153.775549:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1784189153.775910:0:66170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436270336 00000100:00100000:1.0:1784189153.775920:0:66170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436270336 00000100:00100000:1.0:1784189153.775983:0:66170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1218 00000100:00100000:1.0:1784189153.775993:0:66170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc06bbf0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+10:69429:x1870854436270336:12345-192.168.203.12@tcp:36:mcreate.0 00010000:00010000:1.0:1784189153.776049:0:66170:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784189153.776080:0:66170:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc07116e200/0xcc1762b626f8b535 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c3e02 expref: 10 pid: 66945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189153.776101:0:66170:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9dc07fa37300) 00010000:00010000:1.0:1784189153.776113:0:66170:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1784189153.776241:0:66170:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc05ec0ec00/0xcc1762b626f8b53c lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189153.776257:0:66170:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc05ec0ec00/0xcc1762b626f8b53c lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189153.776268:0:66170:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc05ec0ec00/0xcc1762b626f8b53c lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189153.776281:0:66170:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc05ec0fe00/0xcc1762b626f8b543 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x21e7de2f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189153.776307:0:66170:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc05ec0fe00/0xcc1762b626f8b543 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x21e7de2f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189153.776313:0:66170:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc05ec0fe00/0xcc1762b626f8b543 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x21e7de2f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189153.776749:0:66170:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc05ec0ec00/0xcc1762b626f8b53c lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189153.776758:0:66170:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc05ec0ec00/0xcc1762b626f8b53c lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189153.776765:0:66170:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc05ec0ec00/0xcc1762b626f8b53c lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189153.776772:0:66170:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dc05ec0ec00/0xcc1762b626f8b53c lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189153.776778:0:66170:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc05ec0ec00 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:1.0:1784189153.776783:0:66170:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc05ec0ec00/0xcc1762b626f8b53c lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189153.776790:0:66170:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc05ec0ec00/0xcc1762b626f8b53c lrc: 5/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189153.776823:0:66170:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9dc071128400) 00010000:00010000:1.0:1784189153.776826:0:66170:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784189153.776830:0:66170:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dc05ec0ec00/0xcc1762b626f8b53c lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189153.776838:0:66170:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc05ec0ec00/0xcc1762b626f8b53c lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1784189153.776852:0:66170:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000c831517b reply state 000000005a170343 transno 107374182408 ns: mdt-lustre-MDT0000_UUID lock: ffff9dc05ec0fe00/0xcc1762b626f8b543 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x21e7de2f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189153.776862:0:66170:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc05ec0fe00/0xcc1762b626f8b543 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x21e7de2f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189153.776869:0:66170:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x21e7de2f (ffff9dc071128000) 00010000:00010000:1.0:1784189153.776871:0:66170:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1784189153.776874:0:66170:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1784189153.776953:0:66170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc06bbf0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+11:69429:x1870854436270336:12345-192.168.203.12@tcp:36:mcreate.0 Request processed in 961us (1413us total) trans 107374182408 rc 0/0 00000100:00100000:1.0:1784189153.776961:0:66170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1218 00000100:00100000:3.0:1784189153.800124:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1784189153.800231:0:66169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436270464 00000100:00100000:0.0:1784189153.800241:0:66169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436270464 00000100:00100000:0.0:1784189153.800311:0:66169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1219 00000100:00100000:0.0:1784189153.800356:0:66169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc06bbf0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+11:69432:x1870854436270464:12345-192.168.203.12@tcp:101:rm.0 00010000:00010000:0.0:1784189153.800377:0:66169:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784189153.800398:0:66169:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc05ec0f600/0xcc1762b626f8b54a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbfc5de7fe6c3e09 expref: -99 pid: 66169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189153.800476:0:66169:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc05ec0fa00/0xcc1762b626f8b551 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189153.800490:0:66169:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc05ec0fa00/0xcc1762b626f8b551 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189153.800503:0:66169:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc05ec0fa00/0xcc1762b626f8b551 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784189153.800548:0:66169:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1784189153.800551:0:66169:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1784189153.800568:0:66169:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9dc05ec0fa00/0xcc1762b626f8b551 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189153.800589:0:66169:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc05ec0f600/0xcc1762b626f8b54a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c3e09 expref: 13 pid: 66169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189153.800606:0:66169:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc05ec0fa00/0xcc1762b626f8b551 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c3e09 expref: 12 pid: 66169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189153.800615:0:66169:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9dc071128700) 00010000:00010000:0.0:1784189153.800617:0:66169:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1784189153.800620:0:66169:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc05ec0fa00, rc 0) 00000100:00100000:0.0:1784189153.800746:0:66169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc06bbf0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+12:69432:x1870854436270464:12345-192.168.203.12@tcp:101:rm.0 Request processed in 425us (630us total) trans 0 rc 0/0 00000100:00100000:0.0:1784189153.800753:0:66169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1219 00000100:00100000:1.0:1784189153.804961:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1784189153.805083:0:68287:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436270592 00000100:00100000:2.0:1784189153.805092:0:68287:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436270592 00000100:00100000:2.0:1784189153.805190:0:68287:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1220 00000100:00100000:2.0:1784189153.805200:0:68287:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc05f02df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+12:69432:x1870854436270592:12345-192.168.203.12@tcp:101:rm.0 00010000:00010000:2.0:1784189153.805220:0:68287:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784189153.805239:0:68287:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0755a4e00/0xcc1762b626f8b558 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbfc5de7fe6c3e10 expref: -99 pid: 68287 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189153.805314:0:68287:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0755a5e00/0xcc1762b626f8b55f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189153.805359:0:68287:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0755a5e00/0xcc1762b626f8b55f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189153.805371:0:68287:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0755a5e00/0xcc1762b626f8b55f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189153.805396:0:68287:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0755a5400/0xcc1762b626f8b566 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x21e7de2f bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189153.805411:0:68287:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0755a5400/0xcc1762b626f8b566 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x21e7de2f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189153.805450:0:68287:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0755a5400/0xcc1762b626f8b566 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x21e7de2f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189153.805524:0:68287:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0755a5600/0xcc1762b626f8b56d lrc: 3/1,0 mode: --/PR res: [0x20000a811:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189153.805532:0:68287:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0755a5600/0xcc1762b626f8b56d lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0xa:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189153.805539:0:68287:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0755a5600/0xcc1762b626f8b56d lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0xa:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784189153.805718:0:68287:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000a811:0xa:0x0]: returning size 0 00000004:00200000:2.0:1784189153.805722:0:68287:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1784189153.805743:0:68287:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0755a5600/0xcc1762b626f8b56d lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0xa:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189153.805755:0:68287:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0755a5600/0xcc1762b626f8b56d lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0xa:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189153.805764:0:68287:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0755a5e00/0xcc1762b626f8b55f lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189153.805770:0:68287:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0755a5e00/0xcc1762b626f8b55f lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189153.805776:0:68287:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0755a5e00/0xcc1762b626f8b55f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189153.805783:0:68287:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0755a5e00/0xcc1762b626f8b55f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189153.805799:0:68287:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc0755a5e00 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:2.0:1784189153.805804:0:68287:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0755a5e00/0xcc1762b626f8b55f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189153.805811:0:68287:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0755a5e00/0xcc1762b626f8b55f lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189153.805822:0:68287:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9dc071128700) 00010000:00010000:2.0:1784189153.805825:0:68287:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784189153.805831:0:68287:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0755a5e00/0xcc1762b626f8b55f lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189153.805837:0:68287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0755a5e00/0xcc1762b626f8b55f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189153.805853:0:68287:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0755a5400/0xcc1762b626f8b566 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x21e7de2f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189153.805859:0:68287:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0755a5400/0xcc1762b626f8b566 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x21e7de2f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189153.805864:0:68287:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0755a5400/0xcc1762b626f8b566 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x21e7de2f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189153.805869:0:68287:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc0755a5400 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:2.0:1784189153.805872:0:68287:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0755a5400/0xcc1762b626f8b566 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x21e7de2f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189153.805879:0:68287:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0755a5400/0xcc1762b626f8b566 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x21e7de2f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189153.805897:0:68287:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x21e7de2f (ffff9dc071128000) 00010000:00010000:2.0:1784189153.805899:0:68287:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784189153.805902:0:68287:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0755a5400/0xcc1762b626f8b566 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x21e7de2f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189153.805908:0:68287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0755a5400/0xcc1762b626f8b566 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x21e7de2f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189153.805933:0:68287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0755a4e00/0xcc1762b626f8b558 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c3e10 expref: 14 pid: 68287 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189153.805948:0:68287:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0755a5600/0xcc1762b626f8b56d lrc: 3/0,0 mode: PR/PR res: [0x20000a811:0xa:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c3e10 expref: 13 pid: 68287 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189153.805956:0:68287:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0xa:0x0].0x0 (ffff9dc080e5f900) 00010000:00010000:2.0:1784189153.805958:0:68287:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784189153.805961:0:68287:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc0755a5600, rc 0) 00000100:00100000:2.0:1784189153.806018:0:68287:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc05f02df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+13:69432:x1870854436270592:12345-192.168.203.12@tcp:101:rm.0 Request processed in 819us (1065us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189153.806026:0:68287:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1220 00000100:00100000:3.0:1784189153.810756:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1784189153.810892:0:66170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436270848 00000100:00100000:1.0:1784189153.810902:0:66170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436270848 00000100:00100000:1.0:1784189153.810959:0:66170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1221 00000100:00100000:1.0:1784189153.810969:0:66170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc06bbf1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+13:69432:x1870854436270848:12345-192.168.203.12@tcp:36:rm.0 00010000:00010000:1.0:1784189153.811023:0:66170:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:1.0:1784189153.811049:0:66170:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0755a5600/0xcc1762b626f8b56d lrc: 0/0,0 mode: --/PR res: [0x20000a811:0xa:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c3e10 expref: 13 pid: 68287 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189153.811088:0:66170:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0xa:0x0].0x0 (ffff9dc080e5f900) 00010000:00010000:1.0:1784189153.811106:0:66170:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc05ec0fa00/0xcc1762b626f8b551 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c3e09 expref: 12 pid: 66169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189153.811114:0:66170:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9dc071128700) 00010000:00010000:1.0:1784189153.811120:0:66170:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1784189153.811142:0:66170:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc07116e200/0xcc1762b626f8b574 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189153.811153:0:66170:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc07116e200/0xcc1762b626f8b574 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189153.811162:0:66170:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc07116e200/0xcc1762b626f8b574 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189153.811173:0:66170:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc07116e400/0xcc1762b626f8b57b lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x21e7de2f bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189153.811180:0:66170:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc07116e400/0xcc1762b626f8b57b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x21e7de2f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189153.811186:0:66170:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc07116e400/0xcc1762b626f8b57b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x21e7de2f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189153.811259:0:66170:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc07116f800/0xcc1762b626f8b582 lrc: 3/0,1 mode: --/EX res: [0x20000a811:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189153.811267:0:66170:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc07116f800/0xcc1762b626f8b582 lrc: 3/0,1 mode: EX/EX res: [0x20000a811:0xa:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189153.811284:0:66170:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc07116f800/0xcc1762b626f8b582 lrc: 3/0,1 mode: EX/EX res: [0x20000a811:0xa:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189153.812062:0:66170:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc07116f000/0xcc1762b626f8b589 lrc: 3/0,1 mode: --/PW res: [0x20000a811:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189153.812074:0:66170:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc07116f000/0xcc1762b626f8b589 lrc: 3/0,1 mode: PW/PW res: [0x20000a811:0xa:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189153.812082:0:66170:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc07116f000/0xcc1762b626f8b589 lrc: 3/0,1 mode: PW/PW res: [0x20000a811:0xa:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189153.812089:0:66170:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc07116f000/0xcc1762b626f8b589 lrc: 4/0,1 mode: PW/PW res: [0x20000a811:0xa:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189153.812095:0:66170:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc07116f000/0xcc1762b626f8b589 lrc: 4/0,1 mode: PW/PW res: [0x20000a811:0xa:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189153.812102:0:66170:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc07116f000/0xcc1762b626f8b589 lrc: 3/0,0 mode: PW/PW res: [0x20000a811:0xa:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189153.812285:0:66170:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1784189153.812340:0:66170:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc07116f800/0xcc1762b626f8b582 lrc: 3/0,1 mode: EX/EX res: [0x20000a811:0xa:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189153.812348:0:66170:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc07116f800/0xcc1762b626f8b582 lrc: 2/0,0 mode: EX/EX res: [0x20000a811:0xa:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189153.812355:0:66170:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dc07116f800/0xcc1762b626f8b582 lrc: 3/0,0 mode: EX/EX res: [0x20000a811:0xa:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189153.812361:0:66170:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc07116f800 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:1.0:1784189153.812373:0:66170:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc07116f800/0xcc1762b626f8b582 lrc: 3/0,0 mode: EX/EX res: [0x20000a811:0xa:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189153.812393:0:66170:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc07116f800/0xcc1762b626f8b582 lrc: 4/0,0 mode: EX/EX res: [0x20000a811:0xa:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189153.812412:0:66170:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0xa:0x0].0x0 (ffff9dc07fa37800) 00010000:00010000:1.0:1784189153.812415:0:66170:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1784189153.812419:0:66170:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dc07116f800/0xcc1762b626f8b582 lrc: 2/0,0 mode: --/EX res: [0x20000a811:0xa:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189153.812425:0:66170:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc07116f800/0xcc1762b626f8b582 lrc: 0/0,0 mode: --/EX res: [0x20000a811:0xa:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189153.812559:0:66170:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc07116e200/0xcc1762b626f8b574 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189153.812623:0:66170:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc07116e200/0xcc1762b626f8b574 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189153.812630:0:66170:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc07116e200/0xcc1762b626f8b574 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189153.812636:0:66170:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dc07116e200/0xcc1762b626f8b574 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189153.812641:0:66170:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc07116e200 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:1.0:1784189153.812644:0:66170:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc07116e200/0xcc1762b626f8b574 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189153.812650:0:66170:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc07116e200/0xcc1762b626f8b574 lrc: 5/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189153.812669:0:66170:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9dc07fa37300) 00010000:00010000:1.0:1784189153.812672:0:66170:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784189153.812675:0:66170:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dc07116e200/0xcc1762b626f8b574 lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189153.812681:0:66170:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc07116e200/0xcc1762b626f8b574 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1784189153.812696:0:66170:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000164112b2 reply state 00000000645a99c8 transno 107374182409 ns: mdt-lustre-MDT0000_UUID lock: ffff9dc07116e400/0xcc1762b626f8b57b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x21e7de2f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189153.812707:0:66170:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc07116e400/0xcc1762b626f8b57b lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x21e7de2f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189153.812713:0:66170:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x21e7de2f (ffff9dc071128000) 00010000:00010000:1.0:1784189153.812715:0:66170:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1784189153.812718:0:66170:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1784189153.812788:0:66170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc06bbf1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+13:69432:x1870854436270848:12345-192.168.203.12@tcp:36:rm.0 Request processed in 1819us (2037us total) trans 107374182409 rc 0/0 00000100:00100000:1.0:1784189153.812796:0:66170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1221 00010000:00010000:0.0:1784189153.815057:0:7454:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784189153.815069:0:7454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dc07116f000/0xcc1762b626f8b589 lrc: 2/0,0 mode: PW/PW res: [0x20000a811:0xa:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189153.815094:0:7454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc07116f000 already unused, calling callback (ffffffffc0b2e230) 00010000:00010000:0.0:1784189153.815099:0:7454:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc07116f000/0xcc1762b626f8b589 lrc: 2/0,0 mode: PW/PW res: [0x20000a811:0xa:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189153.815107:0:7454:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc07116f000/0xcc1762b626f8b589 lrc: 3/0,0 mode: PW/PW res: [0x20000a811:0xa:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189153.815120:0:7454:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0xa:0x0].0x0 (ffff9dc07fa37800) 00010000:00010000:0.0:1784189153.815123:0:7454:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1784189153.815128:0:7454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dc07116f000/0xcc1762b626f8b589 lrc: 1/0,0 mode: --/PW res: [0x20000a811:0xa:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189153.815134:0:7454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc07116f000/0xcc1762b626f8b589 lrc: 0/0,0 mode: --/PW res: [0x20000a811:0xa:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189153.815153:0:7454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784189153.815155:0:7454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784189153.815157:0:7454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784189154.032136:0:26173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784189155.059611:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784189156.082407:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784189156.400931:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1784189156.400959:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc075f7f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1870854458113280:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1784189156.401047:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784189156.401100:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458113280 00000100:00100000:0.0:1784189156.401109:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458113280 00000100:00100000:0.0:1784189156.401168:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1952 00000100:00100000:0.0:1784189156.401177:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc075f7c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1870854458113280:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1784189156.401212:0:8432:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8649664 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1784189156.401255:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc075f7c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1870854458113280:12345-0@lo:13:osp-pre-0-1.0 Request processed in 79us (208us total) trans 0 rc 0/0 00000100:00100000:0.0:1784189156.401262:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1952 00000100:00080000:0.0:1784189156.401307:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1784189156.401367:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc075f7f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1870854458113280:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1784189156.402068:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1784189156.402082:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc050540380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1870854458113408:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1784189156.402139:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784189156.402174:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458113408 00000100:00100000:2.0:1784189156.402179:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458113408 00000100:00100000:2.0:1784189156.402214:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1953 00000100:00100000:2.0:1784189156.402232:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc050540000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1870854458113408:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1784189156.402257:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8649664 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1784189156.402305:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc050540000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1870854458113408:12345-0@lo:13:osp-pre-1-1.0 Request processed in 75us (165us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189156.402312:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1953 00000100:00100000:2.0:1784189156.402379:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc050540380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1870854458113408:0@lo:13:osp-pre-1-1.0 00000100:00080000:0.0:1784189156.404253:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1784189156.912115:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc075f7f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1870854458113536:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1784189156.912225:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784189156.912337:0:23826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458113536 00000100:00100000:0.0:1784189156.912347:0:23826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458113536 00000100:00100000:0.0:1784189156.912411:0:23826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3789 00000100:00100000:0.0:1784189156.912422:0:23826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc056eaca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3643:x1870854458113536:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1784189156.912468:0:23826:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445281792 avail 1299042304 00010000:00000080:0.0:1784189156.912487:0:23826:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9dc056eaca80 x1870854458113536/t0(0) o41->lustre-MDT0001-mdtlov_UUID@0@lo:347/0 lens 224/368 e 0 to 0 dl 1784189167 ref 1 fl Interpret:/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784189156.912535:0:23826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc056eaca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3643:x1870854458113536:12345-0@lo:41:osp-pre-0-1.0 Request processed in 115us (311us total) trans 0 rc 0/0 00000100:00100000:0.0:1784189156.912543:0:23826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3789 00000100:00100000:0.0:1784189156.912609:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc075f7f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1870854458113536:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1784189156.916901:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1784189156.916931:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc050540380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1870854458113664:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1784189156.917026:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784189156.917083:0:26492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458113664 00000100:00100000:2.0:1784189156.917091:0:26492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458113664 00000100:00100000:2.0:1784189156.917163:0:26492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3790 00000100:00100000:2.0:1784189156.917174:0:26492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc050540e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3641:x1870854458113664:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1784189156.917231:0:26492:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445576704 avail 1299337216 00000100:00100000:2.0:1784189156.917293:0:26492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc050540e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3641:x1870854458113664:12345-0@lo:41:osp-pre-1-0.0 Request processed in 120us (267us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189156.917301:0:26492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3790 00000100:00100000:2.0:1784189156.917390:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc050540380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1870854458113664:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1784189156.923708:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc050543100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3642:1870854458113920:0@lo:400:kworker.0 00000100:00100000:1.0:1784189156.923761:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc050543480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3640:1870854458114176:0@lo:400:kworker.0 00000100:00100000:1.0:1784189156.923857:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784189156.923906:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc050541c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3640:1870854458114688:0@lo:400:kworker.0 00000100:00100000:1.0:1784189156.923932:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784189156.923962:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1784189156.923968:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc050540380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bd553d0d-03e2-4233-b06b-b55bbfa2b954:3640:1870854458113792:0@lo:400:kworker.0 00000100:00100000:1.0:1784189156.924001:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784189156.924050:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc050542a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3640:1870854458114304:0@lo:400:kworker.0 00000100:00100000:1.0:1784189156.924089:0:66945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458114176 00000100:00100000:1.0:1784189156.924097:0:66945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458114176 00000100:00100000:0.0:1784189156.924336:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784189156.930294:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc050543800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1870854458114432:0@lo:400:kworker.0 00000100:00100000:0.0:1784189156.930400:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784189156.930423:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf444e1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1870854458114944:0@lo:400:kworker.0 00000100:00100000:0.0:1784189156.930448:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784189156.930482:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1784189156.930490:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc050541500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3642:1870854458114048:0@lo:400:kworker.0 00000100:00100000:0.0:1784189156.930519:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784189156.932184:0:66945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458114688 00000100:00100000:1.0:1784189156.932202:0:66945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458114688 00000100:00100000:1.0:1784189156.932263:0:88973:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458113792 00000100:00100000:1.0:1784189156.932278:0:88973:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458113792 00000100:00100000:1.0:1784189156.932381:0:88973:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1784189156.932394:0:88973:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf448b1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:bd553d0d-03e2-4233-b06b-b55bbfa2b954+24:3640:x1870854458113792:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784189156.932502:0:88973:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf448b1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:bd553d0d-03e2-4233-b06b-b55bbfa2b954+24:3640:x1870854458113792:12345-0@lo:400:kworker.0 Request processed in 110us (8499us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189156.932511:0:88973:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00080000:1.0:1784189156.932554:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1784189156.932572:0:68287:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458113920 00000100:00100000:1.0:1784189156.932576:0:68287:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458113920 00000100:00100000:1.0:1784189156.932614:0:68287:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1158 00000100:00100000:1.0:1784189156.932621:0:68287:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc05f02d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3640:x1870854458114176:12345-0@lo:400:kworker.0 00010000:00000080:1.0:1784189156.932640:0:68287:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9dc05f02d500 x1870854458114176/t0(0) o400->lustre-MDT0000-lwp-OST0001_UUID@0@lo:347/0 lens 224/224 e 0 to 0 dl 1784189167 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784189156.932671:0:68287:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc05f02d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3640:x1870854458114176:12345-0@lo:400:kworker.0 Request processed in 50us (8816us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189156.932678:0:68287:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1158 00000100:00100000:1.0:1784189156.932692:0:68287:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1159 00000100:00100000:1.0:1784189156.932698:0:68287:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc075f7f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3642:x1870854458113920:12345-0@lo:400:kworker.0 00010000:00000080:1.0:1784189156.932708:0:68287:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9dc075f7f100 x1870854458113920/t0(0) o400->lustre-MDT0000-lwp-OST0000_UUID@0@lo:347/0 lens 224/224 e 0 to 0 dl 1784189167 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784189156.932735:0:68287:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc075f7f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3642:x1870854458113920:12345-0@lo:400:kworker.0 Request processed in 38us (8415us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189156.932758:0:68287:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1159 00000100:00080000:1.0:1784189156.932773:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1784189156.932814:0:66945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1160 00000100:00100000:1.0:1784189156.932820:0:66945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc0762d4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1870854458114688:12345-0@lo:400:kworker.0 00010000:00000080:1.0:1784189156.932833:0:66945:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9dc0762d4700 x1870854458114688/t0(0) o400->lustre-MDT0000-lwp-MDT0001_UUID@0@lo:347/0 lens 224/224 e 0 to 0 dl 1784189167 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784189156.932867:0:66945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc0762d4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1870854458114688:12345-0@lo:400:kworker.0 Request processed in 47us (8935us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189156.932874:0:66945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1160 00000100:00100000:0.0:1784189156.933675:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc050543b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1870854458114560:0@lo:400:kworker.0 00000100:00100000:0.0:1784189156.933726:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784189156.933747:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf444e1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3642:1870854458115072:0@lo:400:kworker.0 00000100:00100000:0.0:1784189156.933773:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784189156.933817:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc050543100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3642:1870854458113920:0@lo:400:kworker.0 00000100:00100000:0.0:1784189156.933857:0:9982:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458114432 00000100:00100000:0.0:1784189156.933863:0:9982:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458114432 00000100:00100000:0.0:1784189156.933901:0:9982:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458114944 00000100:00100000:0.0:1784189156.933905:0:9982:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458114944 00000100:00100000:0.0:1784189156.933935:0:9982:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458114560 00000100:00100000:0.0:1784189156.933937:0:9982:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458114560 00000100:00100000:0.0:1784189156.933956:0:9982:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2426 00000100:00100000:0.0:1784189156.933962:0:9982:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc080e7c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3642:x1870854458114432:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784189156.934010:0:9982:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc080e7c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3642:x1870854458114432:12345-0@lo:400:kworker.0 Request processed in 48us (3611us total) trans 0 rc 0/0 00000100:00100000:0.0:1784189156.934016:0:9982:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2426 00000100:00100000:0.0:1784189156.934032:0:9982:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2427 00000100:00100000:0.0:1784189156.934038:0:9982:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc080e7f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3642:x1870854458114944:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784189156.934126:0:9982:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc080e7f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3642:x1870854458114944:12345-0@lo:400:kworker.0 Request processed in 88us (3677us total) trans 0 rc 0/0 00000100:00100000:0.0:1784189156.934133:0:9982:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2427 00000100:00100000:0.0:1784189156.934146:0:9982:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2428 00000100:00100000:0.0:1784189156.934265:0:9982:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc080e7c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3642:x1870854458114560:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784189156.934311:0:9982:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc080e7c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3642:x1870854458114560:12345-0@lo:400:kworker.0 Request processed in 158us (584us total) trans 0 rc 0/0 00000100:00100000:0.0:1784189156.934340:0:9982:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2428 00000100:00100000:0.0:1784189156.934380:0:66170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458114048 00000100:00100000:0.0:1784189156.934385:0:66170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458114048 00000100:00100000:0.0:1784189156.934414:0:66170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458115072 00000100:00100000:0.0:1784189156.934417:0:66170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458115072 00000100:00100000:0.0:1784189156.934436:0:66170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1161 00000100:00100000:0.0:1784189156.934442:0:66170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc080e7df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1870854458114048:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784189156.934478:0:66170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc080e7df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1870854458114048:12345-0@lo:400:kworker.0 Request processed in 36us (3957us total) trans 0 rc 0/0 00000100:00100000:0.0:1784189156.934484:0:66170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1161 00000100:00100000:0.0:1784189156.934496:0:66170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1162 00000100:00100000:0.0:1784189156.934501:0:66170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc080f6d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1870854458115072:12345-0@lo:400:kworker.0 00010000:00000080:0.0:1784189156.934514:0:66170:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9dc080f6d880 x1870854458115072/t0(0) o400->lustre-MDT0000-lwp-MDT0000_UUID@0@lo:347/0 lens 224/224 e 0 to 0 dl 1784189167 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784189156.934541:0:66170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc080f6d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1870854458115072:12345-0@lo:400:kworker.0 Request processed in 40us (767us total) trans 0 rc 0/0 00000100:00100000:0.0:1784189156.934546:0:66170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1162 00000100:00080000:0.0:1784189156.934564:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1784189156.934568:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1784189156.934583:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784189156.934609:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc050542680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1870854458114816:0@lo:400:kworker.0 00000100:00100000:0.0:1784189156.934635:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784189156.934667:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc050543480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3640:1870854458114176:0@lo:400:kworker.0 00000100:00100000:0.0:1784189156.934682:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc050541c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3640:1870854458114688:0@lo:400:kworker.0 00000100:00100000:0.0:1784189156.934703:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc050540380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bd553d0d-03e2-4233-b06b-b55bbfa2b954:3640:1870854458113792:0@lo:400:kworker.0 00000100:00100000:0.0:1784189156.934718:0:66170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458114304 00000100:00100000:0.0:1784189156.934722:0:66170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458114304 00000100:00100000:0.0:1784189156.934756:0:66170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1163 00000100:00100000:0.0:1784189156.934762:0:66170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc080f6ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1870854458114304:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784189156.934796:0:66170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc080f6ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1870854458114304:12345-0@lo:400:kworker.0 Request processed in 35us (212us total) trans 0 rc 0/0 00000100:00100000:0.0:1784189156.934803:0:66170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1163 00000100:00080000:0.0:1784189156.934816:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1784189156.934835:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc050542a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3640:1870854458114304:0@lo:400:kworker.0 00000100:00100000:0.0:1784189156.934859:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc050541500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3642:1870854458114048:0@lo:400:kworker.0 00000100:00100000:0.0:1784189156.934869:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc050543b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1870854458114560:0@lo:400:kworker.0 00000100:00100000:0.0:1784189156.934879:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf444e1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3642:1870854458115072:0@lo:400:kworker.0 00000100:00100000:0.0:1784189156.934891:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc050543800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1870854458114432:0@lo:400:kworker.0 00000100:00100000:0.0:1784189156.934901:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf444e1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1870854458114944:0@lo:400:kworker.0 00000100:00100000:3.0:1784189156.935390:0:26159:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458114816 00000100:00100000:3.0:1784189156.935395:0:26159:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458114816 00000100:00100000:3.0:1784189156.935434:0:26159:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2429 00000100:00100000:3.0:1784189156.935441:0:26159:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc080f6c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3640:x1870854458114816:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784189156.935487:0:26159:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc080f6c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3640:x1870854458114816:12345-0@lo:400:kworker.0 Request processed in 46us (851us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189156.935494:0:26159:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2429 00000100:00100000:3.0:1784189156.935530:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc050542680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1870854458114816:0@lo:400:kworker.0 00000100:00080000:0.0:1784189156.937437:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1784189157.104506:0:7454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784189157.424462:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1784189157.424484:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc080f6e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1870854458115200:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1784189157.424548:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784189157.424995:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1784189157.425006:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc06bbf3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1870854458115328:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1784189157.425046:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784189157.425075:0:9466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458115200 00000100:00100000:3.0:1784189157.425081:0:9466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458115200 00000100:00100000:3.0:1784189157.425120:0:9466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458115328 00000100:00100000:3.0:1784189157.425123:0:9466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458115328 00000100:00100000:3.0:1784189157.425138:0:9466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1954 00000100:00100000:3.0:1784189157.425145:0:9466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc080f6fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1870854458115200:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1784189157.425165:0:9466:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8649664 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1784189157.425210:0:9466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc080f6fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1870854458115200:12345-0@lo:13:osp-pre-0-0.0 Request processed in 65us (661us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189157.425218:0:9466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1954 00000100:00100000:3.0:1784189157.425236:0:9466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1955 00000100:00100000:3.0:1784189157.425242:0:9466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc06bbf0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1870854458115328:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1784189157.425252:0:9466:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8649664 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1784189157.425295:0:9466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc06bbf0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1870854458115328:12345-0@lo:13:osp-pre-1-0.0 Request processed in 53us (249us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189157.425301:0:9466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1955 00000100:00100000:3.0:1784189157.425359:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc06bbf3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1870854458115328:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1784189157.425486:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc080f6e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1870854458115200:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1784189157.679178:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1784189157.679292:0:88968:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436270976 00000100:00100000:0.0:1784189157.679306:0:88968:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436270976 00000100:00100000:0.0:1784189157.679411:0:88968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 84 00000100:00100000:0.0:1784189157.679422:0:88968:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf448b2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9957a2dc-fd88-4a91-bca3-e2b7f365ab0c+10:2397:x1870854436270976:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:0.0:1784189157.679520:0:88968:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf448b2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9957a2dc-fd88-4a91-bca3-e2b7f365ab0c+10:2397:x1870854436270976:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 99us (357us total) trans 0 rc 0/0 00000100:00100000:0.0:1784189157.679543:0:88968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 84 00000100:00100000:3.0:1784189157.681793:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1784189157.681912:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1784189157.681931:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1784189157.681949:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1784189157.681979:0:26160:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436271488 00000100:00100000:3.0:1784189157.681987:0:26160:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436271488 00000100:00100000:3.0:1784189157.682037:0:26160:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436271360 00000100:00100000:3.0:1784189157.682040:0:26160:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436271360 00000100:00100000:3.0:1784189157.682063:0:26160:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 2430 00000100:00100000:3.0:1784189157.682130:0:26160:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc06bbf3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+5:2397:x1870854436271488:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:3.0:1784189157.682193:0:26160:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc06bbf3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+5:2397:x1870854436271488:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 76us (280us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189157.682201:0:26160:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 2430 00000100:00100000:3.0:1784189157.682219:0:26160:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 2431 00000100:00100000:3.0:1784189157.682225:0:26160:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf425fad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+5:2397:x1870854436271360:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:3.0:1784189157.682259:0:26160:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf425fad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+5:2397:x1870854436271360:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 34us (309us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189157.682282:0:26160:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 2431 00000100:00100000:0.0:1784189157.682416:0:66170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436271232 00000100:00100000:0.0:1784189157.682421:0:66170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436271232 00000100:00100000:0.0:1784189157.682466:0:66170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436271104 00000100:00100000:0.0:1784189157.682469:0:66170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436271104 00000100:00100000:0.0:1784189157.682493:0:66170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1164 00000100:00100000:0.0:1784189157.682499:0:66170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc06bbf3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+6:2397:x1870854436271232:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:0.0:1784189157.682528:0:66170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc06bbf3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+6:2397:x1870854436271232:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 29us (743us total) trans 0 rc 0/0 00000100:00100000:0.0:1784189157.682533:0:66170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1164 00000100:00100000:0.0:1784189157.682546:0:66170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1165 00000100:00100000:0.0:1784189157.682551:0:66170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf4367f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+13:2397:x1870854436271104:12345-192.168.203.12@tcp:400:kworker.0 00010000:00000080:0.0:1784189157.682568:0:66170:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9dbf4367f480 x1870854436271104/t0(0) o400->b90fcc1c-0e69-42a4-a116-a71fec7aeb78@192.168.203.12@tcp:348/0 lens 224/224 e 0 to 0 dl 1784189168 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784189157.682589:0:66170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf4367f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+13:2397:x1870854436271104:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 38us (657us total) trans 0 rc 0/0 00000100:00100000:0.0:1784189157.682595:0:66170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1165 00000100:00080000:0.0:1784189157.682613:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1784189157.682616:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1784189157.682619:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1784189157.682620:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1784189158.131102:0:26173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784189159.158754:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1784189159.984117:0:88963:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 107374182409 is committed 00010000:00010000:2.0:1784189159.984659:0:3627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc05ec0fe00/0xcc1762b626f8b543 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x21e7de2f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189159.984672:0:3627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc05ec0fe00/0xcc1762b626f8b543 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x21e7de2f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189159.984680:0:3627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dc05ec0fe00/0xcc1762b626f8b543 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x21e7de2f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189159.984703:0:3627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc05ec0fe00 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:2.0:1784189159.984709:0:3627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc05ec0fe00/0xcc1762b626f8b543 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x21e7de2f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189159.984717:0:3627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc05ec0fe00/0xcc1762b626f8b543 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x21e7de2f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189159.984737:0:3627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x21e7de2f (ffff9dc071128000) 00010000:00010000:2.0:1784189159.984741:0:3627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784189159.984746:0:3627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dc05ec0fe00/0xcc1762b626f8b543 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x21e7de2f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189159.984753:0:3627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc05ec0fe00/0xcc1762b626f8b543 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x21e7de2f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189159.984783:0:3627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc07116e400/0xcc1762b626f8b57b lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x21e7de2f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189159.984789:0:3627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc07116e400/0xcc1762b626f8b57b lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x21e7de2f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189159.984795:0:3627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dc07116e400/0xcc1762b626f8b57b lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x21e7de2f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189159.984801:0:3627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc07116e400 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:2.0:1784189159.984804:0:3627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc07116e400/0xcc1762b626f8b57b lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x21e7de2f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189159.984811:0:3627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc07116e400/0xcc1762b626f8b57b lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x21e7de2f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189159.984830:0:3627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x21e7de2f (ffff9dc071128000) 00010000:00010000:2.0:1784189159.984833:0:3627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784189159.984836:0:3627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dc07116e400/0xcc1762b626f8b57b lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x21e7de2f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189159.984842:0:3627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc07116e400/0xcc1762b626f8b57b lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x21e7de2f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:02000400:2.0:1784189160.042109:0:90233:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: mds1 REPLAY BARRIER on lustre-MDT0000 00010000:00010000:1.0:1784189160.179733:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784189160.200061:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1784189160.200144:0:66171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436271616 00000100:00100000:2.0:1784189160.200154:0:66171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436271616 00000100:00100000:2.0:1784189160.200234:0:66171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1222 00000100:00100000:2.0:1784189160.200259:0:66171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf425f8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+9:69499:x1870854436271616:12345-192.168.203.12@tcp:101:dd.0 00010000:00010000:2.0:1784189160.200279:0:66171:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784189160.200302:0:66171:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0755a5800/0xcc1762b626f8b590 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbfc5de7fe6c3e17 expref: -99 pid: 66171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1784189160.200549:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1784189160.200662:0:66171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0755a4e00/0xcc1762b626f8b597 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189160.200676:0:66171:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0755a4e00/0xcc1762b626f8b597 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189160.200687:0:66171:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0755a4e00/0xcc1762b626f8b597 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784189160.200727:0:66171:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1784189160.200731:0:66171:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1784189160.200753:0:66171:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0755a4e00/0xcc1762b626f8b597 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189160.200792:0:66171:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0755a5800/0xcc1762b626f8b590 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c3e17 expref: 11 pid: 66171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189160.200809:0:66171:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0755a4e00/0xcc1762b626f8b597 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c3e17 expref: 10 pid: 66171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189160.200817:0:66171:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9dc080e5fa00) 00010000:00010000:2.0:1784189160.200820:0:66171:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1784189160.200824:0:66171:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc0755a4e00, rc 0) 00010000:00000080:2.0:1784189160.200831:0:66171:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9dbf425f8e00 x1870854436271616/t0(0) o101->b90fcc1c-0e69-42a4-a116-a71fec7aeb78@192.168.203.12@tcp:351/0 lens 576/688 e 0 to 0 dl 1784189171 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1784189160.200898:0:66171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf425f8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+10:69499:x1870854436271616:12345-192.168.203.12@tcp:101:dd.0 Request processed in 655us (845us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189160.200905:0:66171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1222 00000100:00100000:3.0:1784189160.207418:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1784189160.207493:0:66169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436271872 00000100:00100000:0.0:1784189160.207505:0:66169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436271872 00000100:00100000:0.0:1784189160.207576:0:66169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1223 00000100:00100000:0.0:1784189160.207587:0:66169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf425fb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+10:69499:x1870854436271872:12345-192.168.203.12@tcp:101:dd.0 00010000:00010000:0.0:1784189160.207615:0:66169:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784189160.207618:0:66169:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1784189160.207644:0:66169:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0755a4e00/0xcc1762b626f8b597 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c3e17 expref: 10 pid: 66171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189160.207665:0:66169:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9dc080e5fa00) 00010000:00010000:0.0:1784189160.207678:0:66169:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1784189160.207762:0:66169:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc07116fc00/0xcc1762b626f8b59e lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbfc5de7fe6c3e1e expref: -99 pid: 66169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189160.207900:0:66169:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc07116fe00/0xcc1762b626f8b5a5 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189160.207913:0:66169:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc07116fe00/0xcc1762b626f8b5a5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189160.207924:0:66169:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc07116fe00/0xcc1762b626f8b5a5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189160.207936:0:66169:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc07116f800/0xcc1762b626f8b5ac lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189160.207943:0:66169:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc07116f800/0xcc1762b626f8b5ac lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189160.207960:0:66169:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc07116f800/0xcc1762b626f8b5ac lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189160.208019:0:66169:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc07116e200/0xcc1762b626f8b5b3 lrc: 3/1,0 mode: --/PR res: [0x20000a811:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189160.208027:0:66169:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc07116e200/0xcc1762b626f8b5b3 lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189160.208033:0:66169:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc07116e200/0xcc1762b626f8b5b3 lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784189160.208042:0:66169:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000a811:0x9:0x0]: returning size 0 00010000:00010000:1.0:1784189160.208120:0:66169:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc07116fe00/0xcc1762b626f8b5a5 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189160.208128:0:66169:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc07116fe00/0xcc1762b626f8b5a5 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189160.208133:0:66169:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc07116fe00/0xcc1762b626f8b5a5 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189160.208140:0:66169:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dc07116fe00/0xcc1762b626f8b5a5 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189160.208145:0:66169:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc07116fe00 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:1.0:1784189160.208149:0:66169:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc07116fe00/0xcc1762b626f8b5a5 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189160.208156:0:66169:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc07116fe00/0xcc1762b626f8b5a5 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189160.208173:0:66169:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9dc07fa37c00) 00010000:00010000:1.0:1784189160.208176:0:66169:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784189160.208180:0:66169:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dc07116fe00/0xcc1762b626f8b5a5 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189160.208186:0:66169:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc07116fe00/0xcc1762b626f8b5a5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189160.208195:0:66169:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc07116f800/0xcc1762b626f8b5ac lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189160.208201:0:66169:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc07116f800/0xcc1762b626f8b5ac lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189160.208206:0:66169:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dc07116f800/0xcc1762b626f8b5ac lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189160.208211:0:66169:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc07116f800 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:1.0:1784189160.208214:0:66169:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc07116f800/0xcc1762b626f8b5ac lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189160.208219:0:66169:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc07116f800/0xcc1762b626f8b5ac lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189160.208225:0:66169:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xae972c0d (ffff9dc07fa37400) 00010000:00010000:1.0:1784189160.208228:0:66169:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784189160.208230:0:66169:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dc07116f800/0xcc1762b626f8b5ac lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189160.208236:0:66169:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc07116f800/0xcc1762b626f8b5ac lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189160.208294:0:66169:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc07116fc00/0xcc1762b626f8b59e lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c3e1e expref: 12 pid: 66169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189160.208311:0:66169:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc07116e200/0xcc1762b626f8b5b3 lrc: 3/0,0 mode: PR/PR res: [0x20000a811:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c3e1e expref: 11 pid: 66169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189160.208359:0:66169:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x9:0x0].0x0 (ffff9dc07fa37500) 00010000:00010000:1.0:1784189160.208362:0:66169:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1784189160.208364:0:66169:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc07116e200, rc 0) 00010000:00000080:1.0:1784189160.208371:0:66169:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9dbf425fb480 x1870854436271872/t107374182410(0) o101->b90fcc1c-0e69-42a4-a116-a71fec7aeb78@192.168.203.12@tcp:351/0 lens 776/848 e 0 to 0 dl 1784189171 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1784189160.208432:0:66169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf425fb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+11:69499:x1870854436271872:12345-192.168.203.12@tcp:101:dd.0 Request processed in 846us (1022us total) trans 107374182410 rc 0/0 00000100:00100000:1.0:1784189160.208440:0:66169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1223 00000100:00100000:1.0:1784189160.220445:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1784189160.220522:0:68287:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436272000 00000100:00100000:3.0:1784189160.220532:0:68287:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436272000 00000100:00100000:3.0:1784189160.220586:0:68287:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1224 00000100:00100000:3.0:1784189160.220595:0:68287:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc0762d5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+11:69499:x1870854436272000:12345-192.168.203.12@tcp:101:dd.0 00010000:00010000:3.0:1784189160.220616:0:68287:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784189160.220636:0:68287:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc058f67200/0xcc1762b626f8b5c1 lrc: 2/0,0 mode: --/PR res: [0x20000a811:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbfc5de7fe6c3e25 expref: -99 pid: 68287 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189160.220668:0:68287:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc058f67800/0xcc1762b626f8b5c8 lrc: 3/1,0 mode: --/PR res: [0x20000a811:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189160.220681:0:68287:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc058f67800/0xcc1762b626f8b5c8 lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189160.220692:0:68287:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc058f67800/0xcc1762b626f8b5c8 lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189160.220796:0:68287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc058f67200/0xcc1762b626f8b5c1 lrc: 0/0,0 mode: --/PR res: [0x20000a811:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c3e25 expref: 13 pid: 68287 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189160.220815:0:68287:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc058f67800/0xcc1762b626f8b5c8 lrc: 3/0,0 mode: PR/PR res: [0x20000a811:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c3e25 expref: 12 pid: 68287 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189160.220835:0:68287:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x9:0x0].0x0 (ffff9dc07fa37500) 00010000:00010000:3.0:1784189160.220838:0:68287:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1784189160.220842:0:68287:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc058f67800, rc 0) 00010000:00000080:3.0:1784189160.220850:0:68287:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9dc0762d5f80 x1870854436272000/t0(0) o101->b90fcc1c-0e69-42a4-a116-a71fec7aeb78@192.168.203.12@tcp:351/0 lens 568/1344 e 0 to 0 dl 1784189171 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1784189160.220909:0:68287:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc0762d5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+12:69499:x1870854436272000:12345-192.168.203.12@tcp:101:dd.0 Request processed in 314us (472us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189160.220916:0:68287:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1224 00000100:00100000:0.0:1784189160.248569:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1784189160.248675:0:66171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436272256 00000100:00100000:2.0:1784189160.248685:0:66171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436272256 00000100:00100000:2.0:1784189160.248737:0:66171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1225 00000100:00100000:2.0:1784189160.248745:0:66171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc080f6e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+12:69499:x1870854436272256:12345-192.168.203.12@tcp:36:dd.0 00010000:00010000:2.0:1784189160.248792:0:66171:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784189160.248817:0:66171:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc07116e200/0xcc1762b626f8b5b3 lrc: 0/0,0 mode: --/PR res: [0x20000a811:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c3e1e expref: 12 pid: 66169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189160.248836:0:66171:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x9:0x0].0x0 (ffff9dc07fa37500) 00010000:00010000:2.0:1784189160.248840:0:66171:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1784189160.251570:0:66171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0755a5400/0xcc1762b626f8b5cf lrc: 3/0,1 mode: --/PW res: [0x20000a811:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189160.251601:0:66171:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0755a5400/0xcc1762b626f8b5cf lrc: 3/0,1 mode: PW/PW res: [0x20000a811:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189160.251613:0:66171:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0755a5400/0xcc1762b626f8b5cf lrc: 3/0,1 mode: PW/PW res: [0x20000a811:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1784189160.251667:0:66171:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 107374182411 00000004:00010000:2.0:1784189160.251689:0:66171:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000000596a8ec reply state 0000000013aca6a5 transno 107374182412 ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0755a5400/0xcc1762b626f8b5cf lrc: 3/0,1 mode: PW/PW res: [0x20000a811:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189160.251702:0:66171:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0755a5400/0xcc1762b626f8b5cf lrc: 3/0,1 mode: TXN/TXN res: [0x20000a811:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189160.251709:0:66171:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x9:0x0].0x0 (ffff9dc07fa37500) 00010000:00010000:2.0:1784189160.251712:0:66171:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1784189160.251716:0:66171:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00000080:2.0:1784189160.251763:0:66171:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9dc080f6e300 x1870854436272256/t107374182412(0) o36->b90fcc1c-0e69-42a4-a116-a71fec7aeb78@192.168.203.12@tcp:351/0 lens 488/456 e 0 to 0 dl 1784189171 ref 1 fl Interpret:/200/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784189160.251840:0:66171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc080f6e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+14:69499:x1870854436272256:12345-192.168.203.12@tcp:36:dd.0 Request processed in 3094us (3278us total) trans 107374182412 rc 0/0 00000100:00100000:2.0:1784189160.251849:0:66171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1225 00000020:00080000:2.0:1784189160.251855:0:66171:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1784189160.261832:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1784189160.261916:0:66169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436272384 00000100:00100000:1.0:1784189160.261927:0:66169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436272384 00000100:00100000:1.0:1784189160.261992:0:66169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1226 00000100:00100000:1.0:1784189160.262003:0:66169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc080f6f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+14:69499:x1870854436272384:12345-192.168.203.12@tcp:101:dd.0 00010000:00010000:1.0:1784189160.262027:0:66169:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784189160.262049:0:66169:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc07116f800/0xcc1762b626f8b5d6 lrc: 2/0,0 mode: --/CR res: [0x20000a811:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbfc5de7fe6c3e2c expref: -99 pid: 66169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189160.262105:0:66169:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc07116f800/0xcc1762b626f8b5d6 lrc: 3/0,0 mode: CR/CR res: [0x20000a811:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c3e2c expref: 15 pid: 66169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189160.262145:0:66169:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc07116f800/0xcc1762b626f8b5d6 lrc: 3/0,0 mode: CR/CR res: [0x20000a811:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c3e2c expref: 15 pid: 66169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189160.262167:0:66169:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x9:0x0].0x0 (ffff9dc07fa37500) 00010000:00010000:1.0:1784189160.262170:0:66169:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1784189160.262174:0:66169:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc07116f800, rc 0) 00010000:00000080:1.0:1784189160.262193:0:66169:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9dc080f6f800 x1870854436272384/t0(0) o101->b90fcc1c-0e69-42a4-a116-a71fec7aeb78@192.168.203.12@tcp:351/0 lens 376/584 e 0 to 0 dl 1784189171 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1784189160.262266:0:66169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc080f6f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+15:69499:x1870854436272384:12345-192.168.203.12@tcp:101:dd.0 Request processed in 265us (442us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189160.262273:0:66169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1226 00000100:00100000:1.0:1784189160.271037:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1784189160.271112:0:66170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436272640 00000100:00100000:3.0:1784189160.271122:0:66170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436272640 00000100:00100000:3.0:1784189160.271186:0:66170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1227 00000100:00100000:3.0:1784189160.271196:0:66170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc0762d5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+15:69499:x1870854436272640:12345-192.168.203.12@tcp:101:dd.0 00010000:00010000:3.0:1784189160.271216:0:66170:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784189160.271219:0:66170:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1784189160.271253:0:66170:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc07116f800/0xcc1762b626f8b5d6 lrc: 0/0,0 mode: --/CR res: [0x20000a811:0x9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c3e2c expref: 15 pid: 66169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189160.271273:0:66170:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x9:0x0].0x0 (ffff9dc07fa37500) 00010000:00010000:3.0:1784189160.271278:0:66170:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1784189160.271292:0:66170:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc058f67200/0xcc1762b626f8b5dd lrc: 2/0,0 mode: --/EX res: [0x20000a811:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbfc5de7fe6c3e33 expref: -99 pid: 66170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189160.271503:0:66170:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0755a5e00/0xcc1762b626f8b5e4 lrc: 3/0,1 mode: --/EX res: [0x20000a811:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189160.271520:0:66170:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0755a5e00/0xcc1762b626f8b5e4 lrc: 3/0,1 mode: EX/EX res: [0x20000a811:0x9:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189160.271530:0:66170:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0755a5e00/0xcc1762b626f8b5e4 lrc: 3/0,1 mode: EX/EX res: [0x20000a811:0x9:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1784189160.271651:0:66170:0:(osp_internal.h:570:osp_update_last_fid()) Gap in objids: start=[0x280000401:0x45d:0x0], count =677 00000004:00080000:2.0:1784189160.271660:0:66170:0:(osp_object.c:1645:osp_create()) Writing gap [0x280000401:0x45d:0x0]+677 in llog 00000004:00080000:2.0:1784189160.271684:0:66170:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x702:0x0], index 0: 0 00000004:00080000:2.0:1784189160.271692:0:66170:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x703:0x0], index 1: 0 00010000:00010000:2.0:1784189160.271781:0:66170:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0755a5e00/0xcc1762b626f8b5e4 lrc: 3/0,0 mode: CR/CR res: [0x20000a811:0x9:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c3e33 expref: 17 pid: 66170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189160.271790:0:66170:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x9:0x0].0x0 (ffff9dc07fa37500) 00010000:00010000:2.0:1784189160.271792:0:66170:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:2.0:1784189160.271802:0:66170:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc058f67200/0xcc1762b626f8b5dd lrc: 0/0,0 mode: --/EX res: [0x20000a811:0x9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c3e33 expref: 17 pid: 66170 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189160.271817:0:66170:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0755a5e00/0xcc1762b626f8b5e4 lrc: 3/0,0 mode: CR/CR res: [0x20000a811:0x9:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c3e33 expref: 16 pid: 66170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189160.271846:0:66170:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x9:0x0].0x0 (ffff9dc07fa37500) 00010000:00010000:2.0:1784189160.271849:0:66170:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:2.0:1784189160.271852:0:66170:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc0755a5e00, rc 0) 00010000:00000080:2.0:1784189160.271861:0:66170:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9dc0762d5500 x1870854436272640/t107374182413(0) o101->b90fcc1c-0e69-42a4-a116-a71fec7aeb78@192.168.203.12@tcp:351/0 lens 376/608 e 0 to 0 dl 1784189171 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1784189160.271931:0:66170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc0762d5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+16:69499:x1870854436272640:12345-192.168.203.12@tcp:101:dd.0 Request processed in 735us (902us total) trans 107374182413 rc 0/0 00000100:00100000:2.0:1784189160.271939:0:66170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1227 00000100:00100000:0.0:1784189160.279546:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1784189160.280231:0:26162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436272768 00000100:00100000:2.0:1784189160.280241:0:26162:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436272768 00000100:00080000:0.0:1784189160.280335:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1784189160.280345:0:26162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 4953 00000100:00100000:2.0:1784189160.280363:0:26162:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc080f6c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+5:69499:x1870854436272768:12345-192.168.203.12@tcp:101:dd.0 00010000:00010000:2.0:1784189160.280380:0:26162:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784189160.280399:0:26162:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000090219bd6/0xcc1762b626f8b5eb lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x702:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xcbfc5de7fe6c3e3a expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1784189160.280428:0:26162:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x702:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1784189160.280450:0:26162:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x702:0x0].0x0 since=3402s v=(0 0) 00010000:00010000:2.0:1784189160.280454:0:26162:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x702:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784189160.280463:0:26162:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000090219bd6/0xcc1762b626f8b5eb lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x702:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c3e3a expref: 6 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189160.280479:0:26162:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000090219bd6/0xcc1762b626f8b5eb lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x702:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c3e3a expref: 6 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189160.280491:0:26162:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc0755a5800, rc 0) 00000100:00100000:2.0:1784189160.280551:0:26162:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc080f6c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+6:69499:x1870854436272768:12345-192.168.203.12@tcp:101:dd.0 Request processed in 190us (1014us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189160.280559:0:26162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 4953 00000100:00100000:3.0:1784189160.283235:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1784189160.283363:0:26163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436272896 00000100:00100000:2.0:1784189160.283373:0:26163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436272896 00000100:00080000:0.0:1784189160.283441:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1784189160.283448:0:26163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 4954 00000100:00100000:2.0:1784189160.283460:0:26163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf43c5d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+5:69499:x1870854436272896:12345-192.168.203.12@tcp:101:dd.0 00010000:00010000:2.0:1784189160.283477:0:26163:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784189160.283497:0:26163:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000b6eacba/0xcc1762b626f8b5f2 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x702:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xcbfc5de7fe6c3e41 expref: -99 pid: 26163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1784189160.283538:0:26163:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x702:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1784189160.283559:0:26163:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x702:0x0].0x0 since=3402s v=(0 0) 00010000:00010000:2.0:1784189160.283564:0:26163:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x702:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784189160.283572:0:26163:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000b6eacba/0xcc1762b626f8b5f2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x702:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c3e41 expref: 6 pid: 26163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189160.283589:0:26163:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000000b6eacba/0xcc1762b626f8b5f2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x702:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c3e41 expref: 6 pid: 26163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189160.283600:0:26163:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc0755a4e00, rc 0) 00000100:00100000:2.0:1784189160.283654:0:26163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf43c5d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+6:69499:x1870854436272896:12345-192.168.203.12@tcp:101:dd.0 Request processed in 197us (429us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189160.283661:0:26163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 4954 00000100:00100000:0.0:1784189160.285787:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1784189160.285874:0:26165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436273024 00000100:00100000:2.0:1784189160.285883:0:26165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436273024 00000100:00100000:2.0:1784189160.285932:0:26165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 4955 00000100:00100000:2.0:1784189160.285941:0:26165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc080f6e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+6:69499:x1870854436273024:12345-192.168.203.12@tcp:101:dd.0 00010000:00010000:2.0:1784189160.285958:0:26165:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784189160.285976:0:26165:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e88c95bf/0xcc1762b626f8b5f9 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x703:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xcbfc5de7fe6c3e48 expref: -99 pid: 26165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1784189160.285999:0:26165:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x703:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1784189160.286018:0:26165:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x703:0x0].0x0 since=3402s v=(0 0) 00010000:00010000:2.0:1784189160.286023:0:26165:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x703:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784189160.286043:0:26165:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e88c95bf/0xcc1762b626f8b5f9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x703:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c3e48 expref: 7 pid: 26165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189160.286060:0:26165:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000e88c95bf/0xcc1762b626f8b5f9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x703:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c3e48 expref: 7 pid: 26165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189160.286074:0:26165:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc0755a5600, rc 0) 00000100:00100000:2.0:1784189160.286125:0:26165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc080f6e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+7:69499:x1870854436273024:12345-192.168.203.12@tcp:101:dd.0 Request processed in 185us (345us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189160.286132:0:26165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 4955 00000100:00100000:3.0:1784189160.291060:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1784189160.291151:0:24833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436273152 00000100:00100000:2.0:1784189160.291161:0:24833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436273152 00002000:00010000:2.0:1784189160.291195:0:24833:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/1794 (1048576->18446744073709551615) 00002000:00100000:2.0:1784189160.291200:0:24833:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9dbf43c5d880 with x1870854436273152 ext(1048576->18446744073709551615) 00002000:00010000:2.0:1784189160.291213:0:24833:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9dbf43c5d880. 00000100:00100000:2.0:1784189160.291259:0:24833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1000 00000100:00100000:2.0:1784189160.291270:0:24833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf43c5d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+6:2396:x1870854436273152:12345-192.168.203.12@tcp:10:dd.0 00002000:00010000:2.0:1784189160.291513:0:24833:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x702:0x0] updating lvb size from disk: 0 -> 1048576 00002000:00010000:2.0:1784189160.291517:0:24833:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x702:0x0] updating lvb mtime from disk: 0 -> 1784189159 00002000:00010000:2.0:1784189160.291519:0:24833:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x702:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1784189160.291522:0:24833:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x702:0x0] updating lvb ctime from disk: 0 -> 1784189159 00002000:00010000:2.0:1784189160.291524:0:24833:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x702:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:2.0:1784189160.291581:0:24833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf43c5d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+7:2396:x1870854436273152:12345-192.168.203.12@tcp:10:dd.0 Request processed in 312us (528us total) trans 4294968951 rc 0/0 00000100:00100000:2.0:1784189160.291589:0:24833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1000 00002000:00010000:2.0:1784189160.291592:0:24833:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/1794 (1048576->18446744073709551615) 00002000:00100000:2.0:1784189160.291607:0:24833:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9dbf43c5d880 with x1870854436273152 ext(1048576->18446744073709551615) 00002000:00010000:2.0:1784189160.291613:0:24833:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9dbf43c5d880. 00000100:00100000:3.0:1784189160.294924:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1784189160.295185:0:25599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436273280 00000100:00100000:0.0:1784189160.295195:0:25599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436273280 00002000:00010000:0.0:1784189160.295232:0:25599:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/1795 (0->18446744073709551615) 00002000:00100000:0.0:1784189160.295237:0:25599:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9dbf43c5ed80 with x1870854436273280 ext(0->18446744073709551615) 00002000:00010000:0.0:1784189160.295257:0:25599:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9dbf43c5ed80. 00000100:00100000:0.0:1784189160.295291:0:25599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1001 00000100:00100000:0.0:1784189160.295301:0:25599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf43c5ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+7:2396:x1870854436273280:12345-192.168.203.12@tcp:10:dd.0 00002000:00010000:0.0:1784189160.295504:0:25599:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x703:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1784189160.295508:0:25599:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x703:0x0] updating lvb mtime from disk: 0 -> 1784189159 00002000:00010000:0.0:1784189160.295510:0:25599:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x703:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1784189160.295512:0:25599:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x703:0x0] updating lvb ctime from disk: 0 -> 1784189159 00002000:00010000:0.0:1784189160.295515:0:25599:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x703:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1784189160.295576:0:25599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf43c5ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+8:2396:x1870854436273280:12345-192.168.203.12@tcp:10:dd.0 Request processed in 276us (662us total) trans 4294968955 rc 0/0 00000100:00100000:0.0:1784189160.295596:0:25599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1001 00002000:00010000:0.0:1784189160.295601:0:25599:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/1795 (0->18446744073709551615) 00002000:00100000:0.0:1784189160.295604:0:25599:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9dbf43c5ed80 with x1870854436273280 ext(0->18446744073709551615) 00002000:00010000:0.0:1784189160.295610:0:25599:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9dbf43c5ed80. 00000100:00100000:0.0:1784189160.360396:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1784189160.360487:0:66173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436273536 00000100:00100000:3.0:1784189160.360497:0:66173:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436273536 00000100:00100000:3.0:1784189160.360561:0:66173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 227 00000100:00100000:3.0:1784189160.360572:0:66173:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc050542680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+16:69499:x1870854436273536:12345-192.168.203.12@tcp:35:dd.0 00010000:00000080:3.0:1784189160.360801:0:66173:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9dc050542680 x1870854436273536/t107374182414(0) o35->b90fcc1c-0e69-42a4-a116-a71fec7aeb78@192.168.203.12@tcp:351/0 lens 392/456 e 0 to 0 dl 1784189171 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1784189160.360868:0:66173:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc050542680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+17:69499:x1870854436273536:12345-192.168.203.12@tcp:35:dd.0 Request processed in 297us (479us total) trans 107374182414 rc 0/0 00000100:00100000:3.0:1784189160.360877:0:66173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 227 00000100:00100000:3.0:1784189160.409498:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1784189160.409616:0:66945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436273664 00000100:00100000:2.0:1784189160.409626:0:66945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436273664 00000100:00100000:2.0:1784189160.409689:0:66945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1228 00000100:00100000:2.0:1784189160.409711:0:66945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf43c5fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+17:69500:x1870854436273664:12345-192.168.203.12@tcp:101:lfs.0 00010000:00010000:2.0:1784189160.409731:0:66945:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784189160.409751:0:66945:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4369ce00/0xcc1762b626f8b600 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbfc5de7fe6c3e4f expref: -99 pid: 66945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189160.409822:0:66945:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4369da00/0xcc1762b626f8b607 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189160.409835:0:66945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4369da00/0xcc1762b626f8b607 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189160.409846:0:66945:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4369da00/0xcc1762b626f8b607 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784189160.409882:0:66945:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1784189160.409886:0:66945:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1784189160.409903:0:66945:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4369da00/0xcc1762b626f8b607 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189160.409924:0:66945:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4369ce00/0xcc1762b626f8b600 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c3e4f expref: 19 pid: 66945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189160.409943:0:66945:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4369da00/0xcc1762b626f8b607 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c3e4f expref: 18 pid: 66945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189160.409987:0:66945:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9dc080e5f400) 00010000:00010000:2.0:1784189160.409990:0:66945:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1784189160.409993:0:66945:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dbf4369da00, rc 0) 00010000:00000080:2.0:1784189160.410002:0:66945:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9dbf43c5fb80 x1870854436273664/t0(0) o101->b90fcc1c-0e69-42a4-a116-a71fec7aeb78@192.168.203.12@tcp:351/0 lens 576/688 e 0 to 0 dl 1784189171 ref 1 fl Interpret:/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1784189160.410060:0:66945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf43c5fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+18:69500:x1870854436273664:12345-192.168.203.12@tcp:101:lfs.0 Request processed in 353us (570us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189160.410067:0:66945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1228 00000100:00100000:0.0:1784189160.416779:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1784189160.417052:0:68287:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436273920 00000100:00100000:2.0:1784189160.417062:0:68287:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436273920 00000100:00100000:2.0:1784189160.417126:0:68287:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1229 00000100:00100000:2.0:1784189160.417136:0:68287:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc050543800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+18:69500:x1870854436273920:12345-192.168.203.12@tcp:101:lfs.0 00010000:00010000:2.0:1784189160.417154:0:68287:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784189160.417174:0:68287:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4369ce00/0xcc1762b626f8b60e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbfc5de7fe6c3e56 expref: -99 pid: 68287 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189160.417251:0:68287:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4369c800/0xcc1762b626f8b615 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189160.417265:0:68287:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4369c800/0xcc1762b626f8b615 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189160.417276:0:68287:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4369c800/0xcc1762b626f8b615 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189160.417290:0:68287:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4369d200/0xcc1762b626f8b61c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189160.417311:0:68287:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4369d200/0xcc1762b626f8b61c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189160.417352:0:68287:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4369d200/0xcc1762b626f8b61c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189160.417425:0:68287:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4369c800/0xcc1762b626f8b615 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189160.417432:0:68287:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4369c800/0xcc1762b626f8b615 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189160.417438:0:68287:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4369c800/0xcc1762b626f8b615 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189160.417444:0:68287:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4369c800/0xcc1762b626f8b615 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189160.417450:0:68287:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dbf4369c800 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:2.0:1784189160.417453:0:68287:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4369c800/0xcc1762b626f8b615 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189160.417459:0:68287:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4369c800/0xcc1762b626f8b615 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189160.417471:0:68287:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9dc080e5f400) 00010000:00010000:2.0:1784189160.417474:0:68287:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784189160.417478:0:68287:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4369c800/0xcc1762b626f8b615 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189160.417484:0:68287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4369c800/0xcc1762b626f8b615 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189160.417503:0:68287:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4369d200/0xcc1762b626f8b61c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189160.417509:0:68287:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4369d200/0xcc1762b626f8b61c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189160.417515:0:68287:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4369d200/0xcc1762b626f8b61c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189160.417520:0:68287:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dbf4369d200 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:2.0:1784189160.417524:0:68287:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4369d200/0xcc1762b626f8b61c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189160.417529:0:68287:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4369d200/0xcc1762b626f8b61c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189160.417537:0:68287:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xae972c0d (ffff9dc080e5fe00) 00010000:00010000:2.0:1784189160.417539:0:68287:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784189160.417541:0:68287:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4369d200/0xcc1762b626f8b61c lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189160.417547:0:68287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4369d200/0xcc1762b626f8b61c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189160.417579:0:68287:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4369ce00/0xcc1762b626f8b60e lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c3e56 expref: 19 pid: 68287 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189160.417589:0:68287:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9dc080e5f400) 00010000:00010000:2.0:1784189160.417591:0:68287:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1784189160.417601:0:68287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4369ce00/0xcc1762b626f8b60e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c3e56 expref: 19 pid: 68287 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189160.417610:0:68287:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dbf4369ce00, rc 0) 00010000:00000080:2.0:1784189160.417617:0:68287:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9dc050543800 x1870854436273920/t0(0) o101->b90fcc1c-0e69-42a4-a116-a71fec7aeb78@192.168.203.12@tcp:351/0 lens 800/608 e 0 to 0 dl 1784189171 ref 1 fl Interpret:/600/0 rc 301/0 job:'lfs.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1784189160.417674:0:68287:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc050543800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+18:69500:x1870854436273920:12345-192.168.203.12@tcp:101:lfs.0 Request processed in 540us (904us total) trans 0 rc 301/301 00000100:00100000:2.0:1784189160.417681:0:68287:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1229 00000100:00100000:0.0:1784189160.421883:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1784189160.422192:0:66170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436274048 00000100:00100000:2.0:1784189160.422202:0:66170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436274048 00000100:00100000:2.0:1784189160.422273:0:66170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1230 00000100:00100000:2.0:1784189160.422283:0:66170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc050543b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+18:69500:x1870854436274048:12345-192.168.203.12@tcp:34:lfs.0 00010000:00010000:2.0:1784189160.422375:0:66170:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4369d000/0xcc1762b626f8b623 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189160.422391:0:66170:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4369d000/0xcc1762b626f8b623 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189160.422403:0:66170:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4369d000/0xcc1762b626f8b623 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189160.422418:0:66170:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04a20a800/0xcc1762b626f8b62a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189160.422425:0:66170:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04a20a800/0xcc1762b626f8b62a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189160.422432:0:66170:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04a20a800/0xcc1762b626f8b62a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189160.422515:0:66170:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04a20be00/0xcc1762b626f8b631 lrc: 3/1,0 mode: --/PR res: [0x20000a811:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189160.422525:0:66170:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04a20be00/0xcc1762b626f8b631 lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189160.422532:0:66170:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04a20be00/0xcc1762b626f8b631 lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784189160.422575:0:66170:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000a811:0x9:0x0]: returning size 2097152 00000004:00200000:2.0:1784189160.422579:0:66170:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1784189160.422590:0:66170:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04a20be00/0xcc1762b626f8b631 lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189160.422603:0:66170:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4369d000/0xcc1762b626f8b623 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189160.422610:0:66170:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4369d000/0xcc1762b626f8b623 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189160.422616:0:66170:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4369d000/0xcc1762b626f8b623 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189160.422622:0:66170:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4369d000/0xcc1762b626f8b623 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189160.422628:0:66170:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dbf4369d000 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:2.0:1784189160.422632:0:66170:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4369d000/0xcc1762b626f8b623 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189160.422639:0:66170:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4369d000/0xcc1762b626f8b623 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189160.422656:0:66170:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9dc080e5f400) 00010000:00010000:2.0:1784189160.422658:0:66170:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784189160.422663:0:66170:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4369d000/0xcc1762b626f8b623 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189160.422669:0:66170:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4369d000/0xcc1762b626f8b623 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189160.422682:0:66170:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04a20a800/0xcc1762b626f8b62a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189160.422688:0:66170:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04a20a800/0xcc1762b626f8b62a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189160.422693:0:66170:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04a20a800/0xcc1762b626f8b62a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189160.422699:0:66170:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc04a20a800 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:2.0:1784189160.422702:0:66170:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04a20a800/0xcc1762b626f8b62a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189160.422708:0:66170:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04a20a800/0xcc1762b626f8b62a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189160.422714:0:66170:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xae972c0d (ffff9dc080e5f000) 00010000:00010000:2.0:1784189160.422717:0:66170:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784189160.422720:0:66170:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04a20a800/0xcc1762b626f8b62a lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189160.422725:0:66170:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04a20a800/0xcc1762b626f8b62a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189160.422750:0:66170:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04a20be00/0xcc1762b626f8b631 lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189160.422756:0:66170:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04a20be00/0xcc1762b626f8b631 lrc: 2/0,0 mode: PR/PR res: [0x20000a811:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189160.422762:0:66170:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04a20be00/0xcc1762b626f8b631 lrc: 3/0,0 mode: PR/PR res: [0x20000a811:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189160.422767:0:66170:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc04a20be00 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:2.0:1784189160.422769:0:66170:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04a20be00/0xcc1762b626f8b631 lrc: 3/0,0 mode: PR/PR res: [0x20000a811:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189160.422775:0:66170:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04a20be00/0xcc1762b626f8b631 lrc: 4/0,0 mode: PR/PR res: [0x20000a811:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189160.422781:0:66170:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x9:0x0].0x0 (ffff9dc07fa37500) 00010000:00010000:2.0:1784189160.422784:0:66170:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784189160.422786:0:66170:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04a20be00/0xcc1762b626f8b631 lrc: 2/0,0 mode: --/PR res: [0x20000a811:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189160.422792:0:66170:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04a20be00/0xcc1762b626f8b631 lrc: 0/0,0 mode: --/PR res: [0x20000a811:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00000080:2.0:1784189160.422811:0:66170:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9dc050543b80 x1870854436274048/t0(0) o34->b90fcc1c-0e69-42a4-a116-a71fec7aeb78@192.168.203.12@tcp:351/0 lens 472/728 e 0 to 0 dl 1784189171 ref 1 fl Interpret:/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1784189160.422865:0:66170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc050543b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+18:69500:x1870854436274048:12345-192.168.203.12@tcp:34:lfs.0 Request processed in 583us (992us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189160.422873:0:66170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1230 00000100:00100000:3.0:1784189160.456065:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1784189160.456599:0:66169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436274304 00000100:00100000:1.0:1784189160.456609:0:66169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436274304 00000100:00100000:1.0:1784189160.456674:0:66169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1231 00000100:00100000:1.0:1784189160.456683:0:66169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf43c5c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+18:69502:x1870854436274304:12345-192.168.203.12@tcp:101:md5sum.0 00010000:00010000:1.0:1784189160.456703:0:66169:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784189160.456721:0:66169:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc07116fe00/0xcc1762b626f8b638 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbfc5de7fe6c3e5d expref: -99 pid: 66169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189160.456788:0:66169:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc07116f000/0xcc1762b626f8b63f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189160.456802:0:66169:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc07116f000/0xcc1762b626f8b63f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189160.456813:0:66169:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc07116f000/0xcc1762b626f8b63f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189160.456841:0:66169:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc07116f800/0xcc1762b626f8b646 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189160.456849:0:66169:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc07116f800/0xcc1762b626f8b646 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189160.456855:0:66169:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc07116f800/0xcc1762b626f8b646 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189160.457090:0:66169:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc07116e200/0xcc1762b626f8b64d lrc: 3/1,0 mode: --/PR res: [0x20000a811:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189160.457101:0:66169:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc07116e200/0xcc1762b626f8b64d lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189160.457108:0:66169:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc07116e200/0xcc1762b626f8b64d lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784189160.457118:0:66169:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000a811:0x9:0x0]: returning size 2097152 00010000:00010000:1.0:1784189160.457185:0:66169:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc07116f000/0xcc1762b626f8b63f lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189160.457191:0:66169:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc07116f000/0xcc1762b626f8b63f lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189160.457195:0:66169:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc07116f000/0xcc1762b626f8b63f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189160.457199:0:66169:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dc07116f000/0xcc1762b626f8b63f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189160.457202:0:66169:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc07116f000 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:1.0:1784189160.457209:0:66169:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc07116f000/0xcc1762b626f8b63f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189160.457214:0:66169:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc07116f000/0xcc1762b626f8b63f lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189160.457476:0:66169:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9dc080e5f400) 00010000:00010000:1.0:1784189160.457480:0:66169:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784189160.457484:0:66169:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dc07116f000/0xcc1762b626f8b63f lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189160.457491:0:66169:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc07116f000/0xcc1762b626f8b63f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189160.457504:0:66169:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc07116f800/0xcc1762b626f8b646 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189160.457511:0:66169:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc07116f800/0xcc1762b626f8b646 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189160.457516:0:66169:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dc07116f800/0xcc1762b626f8b646 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189160.457521:0:66169:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc07116f800 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:1.0:1784189160.457524:0:66169:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc07116f800/0xcc1762b626f8b646 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189160.457529:0:66169:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc07116f800/0xcc1762b626f8b646 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189160.457537:0:66169:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xae972c0d (ffff9dc07fa37c00) 00010000:00010000:1.0:1784189160.457539:0:66169:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784189160.457549:0:66169:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dc07116f800/0xcc1762b626f8b646 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189160.457556:0:66169:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc07116f800/0xcc1762b626f8b646 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189160.457613:0:66169:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc07116fe00/0xcc1762b626f8b638 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c3e5d expref: 21 pid: 66169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189160.457628:0:66169:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc07116e200/0xcc1762b626f8b64d lrc: 3/0,0 mode: PR/PR res: [0x20000a811:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c3e5d expref: 20 pid: 66169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189160.457635:0:66169:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x9:0x0].0x0 (ffff9dc07fa37500) 00010000:00010000:1.0:1784189160.457637:0:66169:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1784189160.457639:0:66169:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc07116e200, rc 0) 00010000:00000080:1.0:1784189160.457646:0:66169:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9dbf43c5c000 x1870854436274304/t107374182415(0) o101->b90fcc1c-0e69-42a4-a116-a71fec7aeb78@192.168.203.12@tcp:351/0 lens 800/872 e 0 to 0 dl 1784189171 ref 1 fl Interpret:/600/0 rc 0/0 job:'md5sum.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1784189160.457754:0:66169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf43c5c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+20:69502:x1870854436274304:12345-192.168.203.12@tcp:101:md5sum.0 Request processed in 1071us (1698us total) trans 107374182415 rc 0/0 00000100:00100000:1.0:1784189160.457763:0:66169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1231 00000100:00100000:0.0:1784189160.466525:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1784189160.466836:0:24843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436274432 00000100:00100000:2.0:1784189160.466859:0:24843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436274432 00002000:00100000:2.0:1784189160.467037:0:24843:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x702:0x0] (0->32767) req@ffff9dc050541500 x1870854436274432/t0(0) o3->b90fcc1c-0e69-42a4-a116-a71fec7aeb78@192.168.203.12@tcp:351/0 lens 488/0 e 0 to 0 dl 1784189171 ref 1 fl New:/600/ffffffff rc 0/-1 job:'md5sum.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1784189160.467048:0:24843:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9dc050541500 with x1870854436274432 ext(0->32767) 00002000:00010000:2.0:1784189160.467053:0:24843:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9dc050541500 00000100:00100000:2.0:1784189160.467139:0:24843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1002 00000100:00100000:2.0:1784189160.467151:0:24843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc050541500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+8:2399:x1870854436274432:12345-192.168.203.12@tcp:3:md5sum.0 00000100:00100000:3.0:1784189160.470157:0:24843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc050541500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+8:2399:x1870854436274432:12345-192.168.203.12@tcp:3:md5sum.0 Request processed in 3000us (3631us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189160.470171:0:24843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1002 00002000:00100000:3.0:1784189160.470183:0:24843:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x702:0x0] (0->32767) req@ffff9dc050541500 x1870854436274432/t0(0) o3->b90fcc1c-0e69-42a4-a116-a71fec7aeb78@192.168.203.12@tcp:351/0 lens 488/440 e 0 to 0 dl 1784189171 ref 1 fl Complete:/600/0 rc 0/0 job:'md5sum.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1784189160.470193:0:24843:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9dc050541500 with x1870854436274432 ext(0->32767) 00002000:00010000:3.0:1784189160.470199:0:24843:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9dc050541500 00000100:00100000:3.0:1784189160.479162:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1784189160.480005:0:24846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436274560 00000100:00100000:1.0:1784189160.480016:0:24846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436274560 00002000:00100000:1.0:1784189160.480063:0:24846:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x702:0x0] (32768->1048575) req@ffff9dc080e61f80 x1870854436274560/t0(0) o3->b90fcc1c-0e69-42a4-a116-a71fec7aeb78@192.168.203.12@tcp:351/0 lens 488/0 e 0 to 0 dl 1784189171 ref 1 fl New:/600/ffffffff rc 0/-1 job:'md5sum.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1784189160.480074:0:24846:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9dc080e61f80 with x1870854436274560 ext(32768->1048575) 00002000:00010000:1.0:1784189160.480080:0:24846:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9dc080e61f80 00000100:00100000:1.0:1784189160.480157:0:24846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1003 00000100:00100000:1.0:1784189160.480167:0:24846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc080e61f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+8:2397:x1870854436274560:12345-192.168.203.12@tcp:3:md5sum.0 00000100:00100000:2.0:1784189160.487429:0:24846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc080e61f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+8:2397:x1870854436274560:12345-192.168.203.12@tcp:3:md5sum.0 Request processed in 7255us (8266us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189160.487443:0:24846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1003 00002000:00100000:2.0:1784189160.487522:0:24846:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x702:0x0] (32768->1048575) req@ffff9dc080e61f80 x1870854436274560/t0(0) o3->b90fcc1c-0e69-42a4-a116-a71fec7aeb78@192.168.203.12@tcp:351/0 lens 488/440 e 0 to 0 dl 1784189171 ref 1 fl Complete:/600/0 rc 0/0 job:'md5sum.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1784189160.487532:0:24846:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9dc080e61f80 with x1870854436274560 ext(32768->1048575) 00002000:00010000:2.0:1784189160.487538:0:24846:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9dc080e61f80 00000100:00100000:2.0:1784189160.516631:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1784189160.516909:0:66173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436274816 00000100:00100000:3.0:1784189160.516920:0:66173:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436274816 00000100:00100000:3.0:1784189160.516972:0:66173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 228 00000100:00100000:3.0:1784189160.516982:0:66173:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc045a5c450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+20:69502:x1870854436274816:12345-192.168.203.12@tcp:35:md5sum.0 00010000:00000080:3.0:1784189160.517197:0:66173:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9dc045a5c450 x1870854436274816/t107374182416(0) o35->b90fcc1c-0e69-42a4-a116-a71fec7aeb78@192.168.203.12@tcp:351/0 lens 392/456 e 0 to 0 dl 1784189171 ref 1 fl Interpret:/600/0 rc 0/0 job:'md5sum.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1784189160.517288:0:66173:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc045a5c450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+21:69502:x1870854436274816:12345-192.168.203.12@tcp:35:md5sum.0 Request processed in 308us (663us total) trans 107374182416 rc 0/0 00000100:00100000:3.0:1784189160.517295:0:66173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 228 00000100:00100000:1.0:1784189160.541774:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1784189160.541850:0:66171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436274944 00000100:00100000:0.0:1784189160.541860:0:66171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436274944 00000100:00100000:0.0:1784189160.541920:0:66171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1232 00000100:00100000:0.0:1784189160.541930:0:66171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc0762d4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+21:69504:x1870854436274944:12345-192.168.203.12@tcp:34:lfs.0 00010000:00010000:0.0:1784189160.542000:0:66171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc05ec0f800/0xcc1762b626f8b65b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189160.542015:0:66171:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc05ec0f800/0xcc1762b626f8b65b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189160.542026:0:66171:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc05ec0f800/0xcc1762b626f8b65b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189160.542039:0:66171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc05ec0f600/0xcc1762b626f8b662 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189160.542046:0:66171:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc05ec0f600/0xcc1762b626f8b662 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189160.542052:0:66171:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc05ec0f600/0xcc1762b626f8b662 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189160.542140:0:66171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc05ec0fa00/0xcc1762b626f8b669 lrc: 3/1,0 mode: --/PR res: [0x20000a811:0x9:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189160.542150:0:66171:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc05ec0fa00/0xcc1762b626f8b669 lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189160.542157:0:66171:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc05ec0fa00/0xcc1762b626f8b669 lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784189160.542193:0:66171:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000a811:0x9:0x0]: returning size 2097152 00000004:00200000:0.0:1784189160.542197:0:66171:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1784189160.542211:0:66171:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9dc05ec0fa00/0xcc1762b626f8b669 lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189160.542224:0:66171:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc05ec0f800/0xcc1762b626f8b65b lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189160.542231:0:66171:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc05ec0f800/0xcc1762b626f8b65b lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189160.542237:0:66171:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc05ec0f800/0xcc1762b626f8b65b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189160.542255:0:66171:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dc05ec0f800/0xcc1762b626f8b65b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189160.542261:0:66171:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc05ec0f800 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:0.0:1784189160.542265:0:66171:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc05ec0f800/0xcc1762b626f8b65b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189160.542273:0:66171:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc05ec0f800/0xcc1762b626f8b65b lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189160.542291:0:66171:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9dc080e5f400) 00010000:00010000:0.0:1784189160.542294:0:66171:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784189160.542300:0:66171:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dc05ec0f800/0xcc1762b626f8b65b lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189160.542307:0:66171:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc05ec0f800/0xcc1762b626f8b65b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189160.544704:0:66171:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc05ec0f600/0xcc1762b626f8b662 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189160.544719:0:66171:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc05ec0f600/0xcc1762b626f8b662 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189160.544727:0:66171:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dc05ec0f600/0xcc1762b626f8b662 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189160.544733:0:66171:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc05ec0f600 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:0.0:1784189160.544737:0:66171:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc05ec0f600/0xcc1762b626f8b662 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189160.544743:0:66171:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc05ec0f600/0xcc1762b626f8b662 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189160.544759:0:66171:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xae972c0d (ffff9dc071128100) 00010000:00010000:0.0:1784189160.544761:0:66171:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784189160.544765:0:66171:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dc05ec0f600/0xcc1762b626f8b662 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189160.544770:0:66171:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc05ec0f600/0xcc1762b626f8b662 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189160.544878:0:66171:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc05ec0fa00/0xcc1762b626f8b669 lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189160.544885:0:66171:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc05ec0fa00/0xcc1762b626f8b669 lrc: 2/0,0 mode: PR/PR res: [0x20000a811:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189160.544891:0:66171:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dc05ec0fa00/0xcc1762b626f8b669 lrc: 3/0,0 mode: PR/PR res: [0x20000a811:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189160.544895:0:66171:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc05ec0fa00 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:0.0:1784189160.544898:0:66171:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc05ec0fa00/0xcc1762b626f8b669 lrc: 3/0,0 mode: PR/PR res: [0x20000a811:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189160.544903:0:66171:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc05ec0fa00/0xcc1762b626f8b669 lrc: 4/0,0 mode: PR/PR res: [0x20000a811:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189160.544910:0:66171:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x9:0x0].0x0 (ffff9dc07fa37500) 00010000:00010000:0.0:1784189160.544913:0:66171:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784189160.544916:0:66171:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dc05ec0fa00/0xcc1762b626f8b669 lrc: 2/0,0 mode: --/PR res: [0x20000a811:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189160.544922:0:66171:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc05ec0fa00/0xcc1762b626f8b669 lrc: 0/0,0 mode: --/PR res: [0x20000a811:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00000080:0.0:1784189160.544948:0:66171:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9dc0762d4a80 x1870854436274944/t0(0) o34->b90fcc1c-0e69-42a4-a116-a71fec7aeb78@192.168.203.12@tcp:351/0 lens 472/728 e 0 to 0 dl 1784189171 ref 1 fl Interpret:/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1784189160.545139:0:66171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc0762d4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+21:69504:x1870854436274944:12345-192.168.203.12@tcp:34:lfs.0 Request processed in 3209us (3371us total) trans 0 rc 0/0 00000100:00100000:0.0:1784189160.545148:0:66171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1232 00010000:00010000:3.0:1784189161.200697:0:7454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784189161.520459:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf444e0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1870854458115456:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1784189161.520530:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784189161.520589:0:9466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458115456 00000100:00100000:2.0:1784189161.520596:0:9466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458115456 00000100:00100000:2.0:1784189161.520648:0:9466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1956 00000100:00100000:2.0:1784189161.520657:0:9466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf444e1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1870854458115456:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1784189161.520685:0:9466:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8649664 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1784189161.520726:0:9466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf444e1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1870854458115456:12345-0@lo:13:osp-pre-1-1.0 Request processed in 70us (196us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189161.520732:0:9466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1956 00000100:00080000:2.0:1784189161.520762:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1784189161.520796:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf444e0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1870854458115456:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1784189161.526315:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1784189161.526354:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf444e0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1870854458115584:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1784189161.526418:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784189161.526464:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458115584 00000100:00100000:2.0:1784189161.526472:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458115584 00000100:00100000:2.0:1784189161.526516:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1957 00000100:00100000:2.0:1784189161.526526:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf444e1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1870854458115584:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1784189161.526555:0:8432:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8649664 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1784189161.526596:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf444e1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1870854458115584:12345-0@lo:13:osp-pre-0-1.0 Request processed in 71us (178us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189161.526603:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1957 00000100:00080000:2.0:1784189161.526623:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1784189161.526658:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf444e0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1870854458115584:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1784189162.031771:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1784189162.031793:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf444e0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1870854458115712:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1784189162.031858:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784189162.031901:0:23826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458115712 00000100:00100000:2.0:1784189162.031908:0:23826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458115712 00000100:00100000:2.0:1784189162.031950:0:23826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3791 00000100:00100000:2.0:1784189162.031970:0:23826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf444e1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3641:x1870854458115712:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1784189162.032004:0:23826:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445576704 avail 1299337216 00000100:00100000:2.0:1784189162.032048:0:23826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf444e1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3641:x1870854458115712:12345-0@lo:41:osp-pre-1-0.0 Request processed in 90us (189us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189162.032055:0:23826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3791 00000100:00100000:2.0:1784189162.032109:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf444e0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1870854458115712:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1784189162.032278:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1784189162.032288:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf46434000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1870854458115840:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1784189162.032338:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784189162.032715:0:26492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458115840 00000100:00100000:3.0:1784189162.032721:0:26492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458115840 00000100:00100000:3.0:1784189162.032757:0:26492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3792 00000100:00100000:3.0:1784189162.032765:0:26492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc05f02f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3640:x1870854458115840:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1784189162.032784:0:26492:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445281792 avail 1299042304 00010000:00000080:3.0:1784189162.032797:0:26492:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9dc05f02f800 x1870854458115840/t0(0) o41->lustre-MDT0001-mdtlov_UUID@0@lo:353/0 lens 224/368 e 0 to 0 dl 1784189173 ref 1 fl Interpret:/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784189162.032830:0:26492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc05f02f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3640:x1870854458115840:12345-0@lo:41:osp-pre-0-1.0 Request processed in 67us (513us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189162.032837:0:26492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3792 00000100:00100000:3.0:1784189162.032867:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf46434000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1870854458115840:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1784189162.033079:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc05edd3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3641:1870854458116352:0@lo:400:kworker.0 00000100:00100000:1.0:1784189162.033112:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784189162.033132:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf469b7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3641:1870854458116864:0@lo:400:kworker.0 00000100:00100000:1.0:1784189162.033150:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784189162.033169:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:1.0:1784189162.033174:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc05edd2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3641:1870854458116224:0@lo:400:kworker.0 00000100:00100000:1.0:1784189162.033192:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784189162.033220:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc05edd2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1870854458116736:0@lo:400:kworker.0 00000100:00100000:1.0:1784189162.033252:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784189162.033267:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf469b5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3641:1870854458117248:0@lo:400:kworker.0 00000100:00100000:1.0:1784189162.033287:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784189162.033311:0:66945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458116352 00000100:00100000:1.0:1784189162.033315:0:66945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458116352 00000100:00100000:2.0:1784189162.033710:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc05ed7df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bd553d0d-03e2-4233-b06b-b55bbfa2b954:3642:1870854458115968:0@lo:400:kworker.0 00000100:00100000:2.0:1784189162.033744:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784189162.033772:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc05edd0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3642:1870854458116480:0@lo:400:kworker.0 00000100:00100000:2.0:1784189162.033793:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784189162.033810:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf469b5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1870854458116992:0@lo:400:kworker.0 00000100:00100000:2.0:1784189162.033831:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784189162.033849:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:2.0:1784189162.033855:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc05ed7ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3642:1870854458116096:0@lo:400:kworker.0 00000100:00100000:2.0:1784189162.033875:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784189162.033885:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc05edd0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1870854458116608:0@lo:400:kworker.0 00000100:00100000:2.0:1784189162.033902:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784189162.033917:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf469b4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1870854458117120:0@lo:400:kworker.0 00000100:00100000:2.0:1784189162.033937:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784189162.034057:0:66945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458116864 00000100:00100000:1.0:1784189162.034061:0:66945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458116864 00000100:00100000:1.0:1784189162.034072:0:66945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458116224 00000100:00100000:1.0:1784189162.034075:0:66945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458116224 00000100:00100000:1.0:1784189162.034086:0:66945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458117248 00000100:00100000:1.0:1784189162.034088:0:66945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458117248 00000100:00100000:1.0:1784189162.034097:0:66945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458116480 00000100:00100000:1.0:1784189162.034099:0:66945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458116480 00000100:00100000:1.0:1784189162.034110:0:66945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458116096 00000100:00100000:1.0:1784189162.034112:0:66945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458116096 00000100:00100000:1.0:1784189162.034125:0:66945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1166 00000100:00100000:1.0:1784189162.034131:0:66945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf469b4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1870854458116352:12345-0@lo:400:kworker.0 00010000:00000080:1.0:1784189162.034159:0:66945:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9dbf469b4000 x1870854458116352/t0(0) o400->lustre-MDT0000-lwp-OST0001_UUID@0@lo:353/0 lens 224/224 e 0 to 0 dl 1784189173 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784189162.034213:0:66945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf469b4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1870854458116352:12345-0@lo:400:kworker.0 Request processed in 81us (1100us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189162.034220:0:66945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1166 00000100:00100000:1.0:1784189162.034245:0:66945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1167 00000100:00100000:1.0:1784189162.034251:0:66945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf469b6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1870854458116864:12345-0@lo:400:kworker.0 00010000:00000080:1.0:1784189162.034261:0:66945:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9dbf469b6300 x1870854458116864/t0(0) o400->lustre-MDT0000-lwp-MDT0001_UUID@0@lo:353/0 lens 224/224 e 0 to 0 dl 1784189173 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784189162.034286:0:66945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf469b6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1870854458116864:12345-0@lo:400:kworker.0 Request processed in 36us (1135us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189162.034292:0:66945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1167 00000100:00100000:1.0:1784189162.034305:0:66945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1168 00000100:00100000:1.0:1784189162.034310:0:66945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf469b7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1870854458116224:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784189162.035558:0:66945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf469b7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1870854458116224:12345-0@lo:400:kworker.0 Request processed in 1242us (2359us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189162.035570:0:66945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1168 00000100:00100000:1.0:1784189162.035593:0:66945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1169 00000100:00100000:1.0:1784189162.035601:0:66945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc05ed9b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1870854458117248:12345-0@lo:400:kworker.0 00010000:00000080:1.0:1784189162.035616:0:66945:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9dc05ed9b800 x1870854458117248/t0(0) o400->lustre-MDT0000-lwp-MDT0000_UUID@0@lo:353/0 lens 224/224 e 0 to 0 dl 1784189173 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784189162.035640:0:66945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc05ed9b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1870854458117248:12345-0@lo:400:kworker.0 Request processed in 41us (2353us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189162.035647:0:66945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1169 00000100:00100000:1.0:1784189162.035659:0:66945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1170 00000100:00100000:1.0:1784189162.035665:0:66945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf444e0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1870854458116480:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784189162.036901:0:66170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1171 00000100:00100000:0.0:1784189162.036919:0:66170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc07faa9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3642:x1870854458116096:12345-0@lo:400:kworker.0 00010000:00000080:0.0:1784189162.036935:0:66170:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9dc07faa9180 x1870854458116096/t0(0) o400->lustre-MDT0000-lwp-OST0000_UUID@0@lo:353/0 lens 224/224 e 0 to 0 dl 1784189173 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784189162.038905:0:26167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458116736 00000100:00100000:3.0:1784189162.038917:0:26167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458116736 00000100:00100000:3.0:1784189162.038983:0:26167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458116992 00000100:00100000:3.0:1784189162.038987:0:26167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458116992 00000100:00100000:3.0:1784189162.039008:0:26167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458116608 00000100:00100000:3.0:1784189162.039011:0:26167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458116608 00000100:00100000:3.0:1784189162.039024:0:26167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458117120 00000100:00100000:3.0:1784189162.039027:0:26167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458117120 00000100:00100000:3.0:1784189162.039062:0:26167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2432 00000100:00100000:3.0:1784189162.039069:0:26167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf469b4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0001-mdtlov_UUID+5:3641:x1870854458116736:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784189162.040762:0:14684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2433 00000100:00100000:2.0:1784189162.040782:0:14684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc07faab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3642:x1870854458116992:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784189162.040880:0:66945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf444e0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1870854458116480:12345-0@lo:400:kworker.0 Request processed in 5213us (7083us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189162.040890:0:66945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1170 00000100:00100000:1.0:1784189162.040929:0:88973:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458115968 00000100:00100000:1.0:1784189162.040935:0:88973:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458115968 00000100:00100000:1.0:1784189162.040979:0:88973:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1784189162.040986:0:88973:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf448b3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:bd553d0d-03e2-4233-b06b-b55bbfa2b954+24:3642:x1870854458115968:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784189162.041075:0:26167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf469b4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0001-mdtlov_UUID+5:3641:x1870854458116736:12345-0@lo:400:kworker.0 Request processed in 2005us (7821us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189162.041084:0:26167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2432 00000100:00100000:3.0:1784189162.041099:0:26167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2434 00000100:00100000:3.0:1784189162.041117:0:26167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc07faab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0001-mdtlov_UUID+5:3642:x1870854458116608:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784189162.046494:0:66170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc07faa9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3642:x1870854458116096:12345-0@lo:400:kworker.0 Request processed in 9569us (12607us total) trans 0 rc 0/0 00000100:00100000:0.0:1784189162.046509:0:66170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1171 00000100:00100000:0.0:1784189162.046567:0:26168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2435 00000100:00100000:0.0:1784189162.046583:0:26168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc07faa9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+5:3642:x1870854458117120:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784189162.046650:0:26168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc07faa9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+5:3642:x1870854458117120:12345-0@lo:400:kworker.0 Request processed in 75us (12712us total) trans 0 rc 0/0 00000100:00100000:0.0:1784189162.046656:0:26168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2435 00000100:00080000:0.0:1784189162.046702:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1784189162.046707:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1784189162.046710:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1784189162.046712:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1784189162.046747:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc05edd2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3641:1870854458116224:0@lo:400:kworker.0 00000100:00100000:0.0:1784189162.046762:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc05edd2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1870854458116736:0@lo:400:kworker.0 00000100:00100000:0.0:1784189162.046773:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf469b5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3641:1870854458117248:0@lo:400:kworker.0 00000100:00100000:0.0:1784189162.046783:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc05edd3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3641:1870854458116352:0@lo:400:kworker.0 00000100:00100000:0.0:1784189162.046794:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf469b7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3641:1870854458116864:0@lo:400:kworker.0 00000100:00100000:0.0:1784189162.046845:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc05ed7ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3642:1870854458116096:0@lo:400:kworker.0 00000100:00100000:1.0:1784189162.047270:0:88973:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf448b3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:bd553d0d-03e2-4233-b06b-b55bbfa2b954+24:3642:x1870854458115968:12345-0@lo:400:kworker.0 Request processed in 6282us (13523us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189162.047279:0:88973:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1784189162.048679:0:26167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc07faab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0001-mdtlov_UUID+5:3642:x1870854458116608:12345-0@lo:400:kworker.0 Request processed in 7557us (14769us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189162.048692:0:26167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2434 00000100:00100000:0.0:1784189162.050351:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc05edd0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1870854458116608:0@lo:400:kworker.0 00000100:00100000:1.0:1784189162.050538:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf469b4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1870854458117120:0@lo:400:kworker.0 00000100:00100000:1.0:1784189162.051906:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc05ed7df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bd553d0d-03e2-4233-b06b-b55bbfa2b954:3642:1870854458115968:0@lo:400:kworker.0 00000100:00100000:1.0:1784189162.051946:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc05edd0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3642:1870854458116480:0@lo:400:kworker.0 00000100:00100000:2.0:1784189162.061130:0:14684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc07faab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3642:x1870854458116992:12345-0@lo:400:kworker.0 Request processed in 20347us (27288us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189162.061408:0:14684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2433 00000100:00100000:1.0:1784189162.066307:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf469b5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1870854458116992:0@lo:400:kworker.0 00010000:00010000:2.0:1784189162.227864:0:26173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1784189162.231826:0:90330:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:2.0:1784189162.231880:0:90330:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff9dc0565e6000/0xcc1762b626f8b184 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc1762b626f8b18b expref: -99 pid: 88962 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189162.231896:0:90330:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff9dc0565e6000/0xcc1762b626f8b184 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0xcc1762b626f8b18b expref: -99 pid: 88962 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189162.231917:0:90330:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff9dc0565e6000/0xcc1762b626f8b184 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0xcc1762b626f8b18b expref: -99 pid: 88962 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189162.231924:0:90330:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.112@tcp lock: ffff9dc0565e6000/0xcc1762b626f8b184 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0xcc1762b626f8b18b expref: -99 pid: 88962 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189162.231949:0:90330:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1784189162.231954:0:90330:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:2.0:1784189162.231981:0:90330:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1784189162.231985:0:90330:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:2.0:1784189162.231990:0:90330:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1784189162.232013:0:90330:0:(import.c:65:import_set_state_nolock()) ffff9dc07118c000 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00010000:00010000:1.0:1784189162.232078:0:6502:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784189162.232085:0:6502:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.112@tcp lock: ffff9dc0565e6000/0xcc1762b626f8b184 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0xcc1762b626f8b18b expref: -99 pid: 88962 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189162.232092:0:6502:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc0565e6000 already unused, calling callback (ffffffffc114ac20) 10000000:00010000:1.0:1784189162.232096:0:6502:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.112@tcp lock: ffff9dc0565e6000/0xcc1762b626f8b184 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0xcc1762b626f8b18b expref: -99 pid: 88962 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189162.232105:0:6502:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.112@tcp lock: ffff9dc0565e6000/0xcc1762b626f8b184 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1008400000000 nid: local remote: 0xcc1762b626f8b18b expref: -99 pid: 88962 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1784189162.232112:0:6502:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.112@tcp lock: ffff9dc0565e6000/0xcc1762b626f8b184 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1009400000000 nid: local remote: 0xcc1762b626f8b18b expref: -99 pid: 88962 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784189162.232124:0:6502:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1784189162.232127:0:6502:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:1.0:1784189162.232129:0:6502:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:1.0:1784189162.232165:0:6502:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.112@tcp lock: ffff9dc0565e6000/0xcc1762b626f8b184 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0xcc1762b626f8b18b expref: -99 pid: 88962 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189162.232171:0:6502:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1784189162.232200:0:6502:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.112@tcp lock: ffff9dc0565e6000/0xcc1762b626f8b184 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0xcc1762b626f8b18b expref: -99 pid: 88962 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189162.232207:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.112@tcp lock: ffff9dc0565e6000/0xcc1762b626f8b184 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0xcc1762b626f8b18b expref: -99 pid: 88962 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189162.232219:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784189162.232221:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784189162.232222:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784189162.232355:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc05ed9a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:bd553d0d-03e2-4233-b06b-b55bbfa2b954:3641:1870854458117504:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1784189162.232416:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784189162.232568:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458117504 00000100:00100000:1.0:1784189162.232575:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458117504 00000100:00100000:1.0:1784189162.232629:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 694 00000100:00100000:1.0:1784189162.232639:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc07faa8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bd553d0d-03e2-4233-b06b-b55bbfa2b954+24:3641:x1870854458117504:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1784189162.232651:0:6500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784189162.232666:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dc05ec0dc00/0xcc1762b626f8b18b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xcc1762b626f8b184 expref: 24 pid: 88969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189162.232678:0:6500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784189162.232715:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc07faa8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bd553d0d-03e2-4233-b06b-b55bbfa2b954+23:3641:x1870854458117504:12345-0@lo:103:ldlm_bl.0 Request processed in 78us (299us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189162.232722:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 694 00000100:00100000:1.0:1784189162.232757:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc05ed9a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:bd553d0d-03e2-4233-b06b-b55bbfa2b954:3641:1870854458117504:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1784189162.233253:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc07faa8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3639:1870854458117376:0@lo:39:umount.0 00000100:00100000:3.0:1784189162.233289:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784189162.233553:0:66171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458117376 00000100:00100000:1.0:1784189162.233558:0:66171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458117376 00000100:00100000:1.0:1784189162.233599:0:66171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1233 00000100:00100000:1.0:1784189162.233606:0:66171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc05f02ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1870854458117376:12345-0@lo:39:umount.0 00000020:00000080:1.0:1784189162.233627:0:66171:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xcc1762b626f8b29c 00000100:00080000:1.0:1784189162.233642:0:66171:0:(import.c:65:import_set_state_nolock()) ffff9dc047a82000 : changing import state from FULL to CLOSED 00010000:00000080:1.0:1784189162.233667:0:66171:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9dc05f02ca80 x1870854458117376/t0(0) o39->lustre-MDT0000-lwp-MDT0000_UUID@0@lo:353/0 lens 224/224 e 0 to 0 dl 1784189173 ref 1 fl Interpret:/200/0 rc 0/0 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784189162.233701:0:66171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc05f02ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+1:3639:x1870854458117376:12345-0@lo:39:umount.0 Request processed in 96us (411us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189162.233707:0:66171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1233 00000020:00000080:1.0:1784189162.233714:0:66171:0:(genops.c:906:class_export_put()) final put ffff9dc047a83000/lustre-MDT0000-lwp-MDT0000_UUID 00010000:00010000:1.0:1784189162.233756:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1784189162.233762:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9dc047a83000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000020:00000080:1.0:1784189162.233797:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9dc047a82000 for lustre-MDT0000 00000100:00080000:3.0:1784189162.233905:0:3639:0:(import.c:65:import_set_state_nolock()) ffff9dc07118c000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:3.0:1784189162.233923:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc07faa8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3639:1870854458117376:0@lo:39:umount.0 00000100:00080000:2.0:1784189162.233971:0:90330:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1784189162.233975:0:90330:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:2.0:1784189162.233979:0:90330:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:2.0:1784189162.235075:0:90330:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff9dbf4369d400/0xcc1762b626f8b0ab lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc1762b626f8b0b2 expref: -99 pid: 88962 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189162.235088:0:90330:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff9dbf4369d400/0xcc1762b626f8b0ab lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0xcc1762b626f8b0b2 expref: -99 pid: 88962 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189162.235095:0:90330:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff9dbf4369d400/0xcc1762b626f8b0ab lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0xcc1762b626f8b0b2 expref: -99 pid: 88962 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189162.235101:0:90330:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.112@tcp lock: ffff9dbf4369d400/0xcc1762b626f8b0ab lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0xcc1762b626f8b0b2 expref: -99 pid: 88962 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189162.235444:0:7454:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784189162.235451:0:7454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.112@tcp lock: ffff9dbf4369d400/0xcc1762b626f8b0ab lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0xcc1762b626f8b0b2 expref: -99 pid: 88962 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189162.235458:0:7454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dbf4369d400 already unused, calling callback (ffffffffc114ac20) 10000000:00010000:3.0:1784189162.235462:0:7454:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.112@tcp lock: ffff9dbf4369d400/0xcc1762b626f8b0ab lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0xcc1762b626f8b0b2 expref: -99 pid: 88962 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189162.235470:0:7454:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.112@tcp lock: ffff9dbf4369d400/0xcc1762b626f8b0ab lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1008400000000 nid: local remote: 0xcc1762b626f8b0b2 expref: -99 pid: 88962 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1784189162.235477:0:7454:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.112@tcp lock: ffff9dbf4369d400/0xcc1762b626f8b0ab lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1009400000000 nid: local remote: 0xcc1762b626f8b0b2 expref: -99 pid: 88962 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784189162.235494:0:7454:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1784189162.235497:0:7454:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 00010000:00010000:3.0:1784189162.235526:0:7454:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.112@tcp lock: ffff9dbf4369d400/0xcc1762b626f8b0ab lrc: 3/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0xcc1762b626f8b0b2 expref: -99 pid: 88962 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189162.235532:0:7454:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1784189162.235561:0:7454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.112@tcp lock: ffff9dbf4369d400/0xcc1762b626f8b0ab lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0xcc1762b626f8b0b2 expref: -99 pid: 88962 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189162.235570:0:7454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784189162.235571:0:7454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784189162.235573:0:7454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784189162.235582:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1784189162.235596:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf46434000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:bd553d0d-03e2-4233-b06b-b55bbfa2b954:3643:1870854458117632:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1784189162.235648:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784189162.235696:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458117632 00000100:00100000:3.0:1784189162.235702:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458117632 00000100:00100000:3.0:1784189162.235740:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 695 00000100:00100000:3.0:1784189162.235748:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf44bc1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bd553d0d-03e2-4233-b06b-b55bbfa2b954+23:3643:x1870854458117632:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1784189162.235759:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784189162.235772:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dc05ec0d000/0xcc1762b626f8b0b2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xcc1762b626f8b0ab expref: 23 pid: 88969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189162.235787:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784189162.235816:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf44bc1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bd553d0d-03e2-4233-b06b-b55bbfa2b954+22:3643:x1870854458117632:12345-0@lo:103:ldlm_bl.0 Request processed in 68us (167us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189162.235822:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 695 00000100:00100000:3.0:1784189162.235858:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf46434000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:bd553d0d-03e2-4233-b06b-b55bbfa2b954:3643:1870854458117632:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1784189162.236114:0:90330:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1784189162.236120:0:90330:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.112@tcp lock: ffff9dbf4369d400/0xcc1762b626f8b0ab lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0xcc1762b626f8b0b2 expref: -99 pid: 88962 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189162.239375:0:90330:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff9dc05ec0d800/0xcc1762b626f8b1ae lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc1762b626f8b1b5 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189162.239399:0:90330:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff9dc05ec0d800/0xcc1762b626f8b1ae lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xcc1762b626f8b1b5 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189162.239407:0:90330:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff9dc05ec0d800/0xcc1762b626f8b1ae lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xcc1762b626f8b1b5 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189162.239412:0:90330:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.112@tcp lock: ffff9dc05ec0d800/0xcc1762b626f8b1ae lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xcc1762b626f8b1b5 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189162.239444:0:90330:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1784189162.239452:0:90330:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff9dc0565e6400/0xcc1762b626f8b176 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc1762b626f8b17d expref: -99 pid: 88962 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189162.239459:0:90330:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff9dc0565e6400/0xcc1762b626f8b176 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xcc1762b626f8b17d expref: -99 pid: 88962 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189162.239465:0:90330:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff9dc0565e6400/0xcc1762b626f8b176 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xcc1762b626f8b17d expref: -99 pid: 88962 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189162.239470:0:90330:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.112@tcp lock: ffff9dc0565e6400/0xcc1762b626f8b176 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xcc1762b626f8b17d expref: -99 pid: 88962 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189162.239510:0:90330:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1784189162.239516:0:90330:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff9dbf4369c000/0xcc1762b626f8b096 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc1762b626f8b0a4 expref: -99 pid: 88962 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189162.239523:0:90330:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff9dbf4369c000/0xcc1762b626f8b096 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xcc1762b626f8b0a4 expref: -99 pid: 88962 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189162.239529:0:90330:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff9dbf4369c000/0xcc1762b626f8b096 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xcc1762b626f8b0a4 expref: -99 pid: 88962 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189162.239535:0:90330:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.112@tcp lock: ffff9dbf4369c000/0xcc1762b626f8b096 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xcc1762b626f8b0a4 expref: -99 pid: 88962 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189162.239545:0:90330:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 10000000:01000000:2.0:1784189162.239549:0:90330:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 10000000:01000000:2.0:1784189162.239557:0:90330:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00000020:01000004:2.0:1784189162.239596:0:90330:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-MDT0000 00000020:01000000:2.0:1784189162.239601:0:90330:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='FA') 00000020:00000080:2.0:1784189162.239604:0:90330:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:02000400:2.0:1784189162.239609:0:90330:0:(obd_config.c:932:class_cleanup()) Failing over lustre-MDT0000 00010000:00010000:3.0:1784189162.241436:0:26173:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1784189162.241448:0:26173:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.112@tcp lock: ffff9dc05ec0d800/0xcc1762b626f8b1ae lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xcc1762b626f8b1b5 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189162.241459:0:26173:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc05ec0d800 already unused, calling callback (ffffffffc114ac20) 10000000:00010000:3.0:1784189162.241464:0:26173:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.112@tcp lock: ffff9dc05ec0d800/0xcc1762b626f8b1ae lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xcc1762b626f8b1b5 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189162.241473:0:26173:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.112@tcp lock: ffff9dc05ec0d800/0xcc1762b626f8b1ae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xcc1762b626f8b1b5 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1784189162.241480:0:26173:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.112@tcp lock: ffff9dc05ec0d800/0xcc1762b626f8b1ae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xcc1762b626f8b1b5 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784189162.241486:0:26173:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:3.0:1784189162.241489:0:26173:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:3.0:1784189162.241491:0:26173:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:3.0:1784189162.241533:0:26173:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.112@tcp lock: ffff9dc05ec0d800/0xcc1762b626f8b1ae lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xcc1762b626f8b1b5 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189162.241539:0:26173:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1784189162.241566:0:26173:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.112@tcp lock: ffff9dc05ec0d800/0xcc1762b626f8b1ae lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xcc1762b626f8b1b5 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189162.241573:0:26173:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.112@tcp lock: ffff9dc05ec0d800/0xcc1762b626f8b1ae lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xcc1762b626f8b1b5 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189162.241587:0:26173:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1784189162.241591:0:26173:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.112@tcp lock: ffff9dc0565e6400/0xcc1762b626f8b176 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xcc1762b626f8b17d expref: -99 pid: 88962 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189162.241614:0:26173:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc0565e6400 already unused, calling callback (ffffffffc114ac20) 10000000:00010000:3.0:1784189162.241617:0:26173:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.112@tcp lock: ffff9dc0565e6400/0xcc1762b626f8b176 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xcc1762b626f8b17d expref: -99 pid: 88962 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189162.241623:0:26173:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.112@tcp lock: ffff9dc0565e6400/0xcc1762b626f8b176 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0xcc1762b626f8b17d expref: -99 pid: 88962 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1784189162.241628:0:26173:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.112@tcp lock: ffff9dc0565e6400/0xcc1762b626f8b176 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0xcc1762b626f8b17d expref: -99 pid: 88962 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784189162.241633:0:26173:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:3.0:1784189162.241635:0:26173:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:3.0:1784189162.241637:0:26173:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:3.0:1784189162.241650:0:26173:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.112@tcp lock: ffff9dc0565e6400/0xcc1762b626f8b176 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xcc1762b626f8b17d expref: -99 pid: 88962 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189162.241655:0:26173:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1784189162.241670:0:26173:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.112@tcp lock: ffff9dc0565e6400/0xcc1762b626f8b176 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xcc1762b626f8b17d expref: -99 pid: 88962 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189162.241676:0:26173:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.112@tcp lock: ffff9dc0565e6400/0xcc1762b626f8b176 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xcc1762b626f8b17d expref: -99 pid: 88962 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189162.241686:0:26173:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784189162.241689:0:26173:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.112@tcp lock: ffff9dbf4369c000/0xcc1762b626f8b096 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xcc1762b626f8b0a4 expref: -99 pid: 88962 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189162.241695:0:26173:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dbf4369c000 already unused, calling callback (ffffffffc114ac20) 10000000:00010000:3.0:1784189162.241697:0:26173:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.112@tcp lock: ffff9dbf4369c000/0xcc1762b626f8b096 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xcc1762b626f8b0a4 expref: -99 pid: 88962 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189162.241710:0:26173:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.112@tcp lock: ffff9dbf4369c000/0xcc1762b626f8b096 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xcc1762b626f8b0a4 expref: -99 pid: 88962 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1784189162.241715:0:26173:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.112@tcp lock: ffff9dbf4369c000/0xcc1762b626f8b096 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xcc1762b626f8b0a4 expref: -99 pid: 88962 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784189162.241720:0:26173:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:3.0:1784189162.241722:0:26173:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:3.0:1784189162.241724:0:26173:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:3.0:1784189162.241736:0:26173:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.112@tcp lock: ffff9dbf4369c000/0xcc1762b626f8b096 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xcc1762b626f8b0a4 expref: -99 pid: 88962 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189162.241742:0:26173:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1784189162.241748:0:26173:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.112@tcp lock: ffff9dbf4369c000/0xcc1762b626f8b096 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xcc1762b626f8b0a4 expref: -99 pid: 88962 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189162.241753:0:26173:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.112@tcp lock: ffff9dbf4369c000/0xcc1762b626f8b096 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xcc1762b626f8b0a4 expref: -99 pid: 88962 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189162.241762:0:26173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784189162.241764:0:26173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784189162.241766:0:26173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784189162.241776:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1784189162.241794:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf44bc3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bd553d0d-03e2-4233-b06b-b55bbfa2b954:3642:1870854458117760:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1784189162.241856:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784189162.241909:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458117760 00000100:00100000:3.0:1784189162.241915:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458117760 00000100:00100000:3.0:1784189162.241960:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 696 00000100:00100000:3.0:1784189162.241968:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf44bc2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bd553d0d-03e2-4233-b06b-b55bbfa2b954+22:3642:x1870854458117760:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1784189162.241988:0:6499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784189162.242002:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dc0755a4000/0xcc1762b626f8b1b5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xcc1762b626f8b1ae expref: 22 pid: 88968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189162.242017:0:6499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784189162.242052:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf44bc2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bd553d0d-03e2-4233-b06b-b55bbfa2b954+21:3642:x1870854458117760:12345-0@lo:103:ldlm_bl.0 Request processed in 85us (196us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189162.242059:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 696 00000100:00100000:3.0:1784189162.242084:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf44bc0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bd553d0d-03e2-4233-b06b-b55bbfa2b954:3640:1870854458117888:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1784189162.242107:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784189162.242124:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1784189162.242130:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf44bc1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bd553d0d-03e2-4233-b06b-b55bbfa2b954:3640:1870854458118016:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1784189162.244499:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784189162.244571:0:26172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458117888 00000100:00100000:3.0:1784189162.244579:0:26172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458117888 00000100:00100000:3.0:1784189162.244621:0:26172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458118016 00000100:00100000:3.0:1784189162.244624:0:26172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458118016 00000100:00100000:3.0:1784189162.244649:0:26172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 697 00000100:00100000:3.0:1784189162.244657:0:26172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf46434000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:bd553d0d-03e2-4233-b06b-b55bbfa2b954+22:3640:x1870854458117888:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1784189162.244669:0:26172:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784189162.244687:0:26172:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dc05ec0d400/0xcc1762b626f8b17d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xcc1762b626f8b176 expref: 22 pid: 88973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189162.244704:0:26172:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784189162.244735:0:26172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf46434000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:bd553d0d-03e2-4233-b06b-b55bbfa2b954+21:3640:x1870854458117888:12345-0@lo:103:ldlm_bl.0 Request processed in 79us (2627us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189162.244742:0:26172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 697 00000100:00100000:3.0:1784189162.244758:0:26172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 698 00000100:00100000:3.0:1784189162.244777:0:26172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc080df2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:bd553d0d-03e2-4233-b06b-b55bbfa2b954+20:3640:x1870854458118016:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1784189162.244785:0:26172:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784189162.244794:0:26172:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dc05ec0d200/0xcc1762b626f8b0a4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xcc1762b626f8b096 expref: 20 pid: 88967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189162.244803:0:26172:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784189162.244826:0:26172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc080df2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:bd553d0d-03e2-4233-b06b-b55bbfa2b954+19:3640:x1870854458118016:12345-0@lo:103:ldlm_bl.0 Request processed in 50us (328us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189162.244832:0:26172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 698 00000100:00100000:3.0:1784189162.244875:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf44bc3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bd553d0d-03e2-4233-b06b-b55bbfa2b954:3642:1870854458117760:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1784189162.244917:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf44bc1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bd553d0d-03e2-4233-b06b-b55bbfa2b954:3640:1870854458118016:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1784189162.244925:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf44bc0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bd553d0d-03e2-4233-b06b-b55bbfa2b954:3640:1870854458117888:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1784189162.249481:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784189162.249514:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00000080:2.0:1784189162.251010:0:90330:0:(mdt_handler.c:8168:mdt_iocontrol()) lustre-MDT0000: cmd=40086672 len=0 karg=0000000000000000 uarg=0000000000000000 00000001:00080000:3.0:1784189162.255082:0:88963:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 107374182416 is committed 00010000:00010000:0.0:1784189162.255165:0:3626:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0755a5400/0xcc1762b626f8b5cf lrc: 3/0,1 mode: TXN/TXN res: [0x20000a811:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189162.255178:0:3626:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0755a5400/0xcc1762b626f8b5cf lrc: 2/0,0 mode: TXN/TXN res: [0x20000a811:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189162.255186:0:3626:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0755a5400/0xcc1762b626f8b5cf lrc: 3/0,0 mode: TXN/TXN res: [0x20000a811:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189162.255192:0:3626:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc0755a5400 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:0.0:1784189162.255197:0:3626:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0755a5400/0xcc1762b626f8b5cf lrc: 3/0,0 mode: TXN/TXN res: [0x20000a811:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189162.255204:0:3626:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0755a5400/0xcc1762b626f8b5cf lrc: 4/0,0 mode: TXN/TXN res: [0x20000a811:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189162.255220:0:3626:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x9:0x0].0x0 (ffff9dc07fa37500) 00010000:00010000:0.0:1784189162.255223:0:3626:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784189162.255237:0:3626:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0755a5400/0xcc1762b626f8b5cf lrc: 2/0,0 mode: --/TXN res: [0x20000a811:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189162.255244:0:3626:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0755a5400/0xcc1762b626f8b5cf lrc: 0/0,0 mode: --/TXN res: [0x20000a811:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00000080:2.0:1784189162.255960:0:90330:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 5/11 00000020:00080000:2.0:1784189162.255970:0:90330:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff9dc047a83800 lustre-MDT0000-lwp-MDT0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1784189162.255975:0:90330:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff9dc047a85000 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1784189162.255979:0:90330:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff9dc047a87000 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1784189162.255982:0:90330:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff9dbf43e9e000 lustre-MDT0001-mdtlov_UUID 0@lo 5 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1784189162.255988:0:90330:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff9dbf43e9f000 b90fcc1c-0e69-42a4-a116-a71fec7aeb78 192.168.203.12@tcp 12 (0 0 7) 0 0 0 0: 0000000000000000 107374182416 stale:0 00000020:00080000:2.0:1784189162.256009:0:90330:0:(genops.c:1574:class_disconnect_exports()) OBD device 13 (ffff9dc06bb33380) has exports, disconnecting them 00000020:00080000:2.0:1784189162.256012:0:90330:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9dc047a83800), last request at 1784189131 00000020:00000080:2.0:1784189162.256019:0:90330:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xcc1762b626f8b295 00000100:00080000:2.0:1784189162.256027:0:90330:0:(import.c:65:import_set_state_nolock()) ffff9dc047a87800 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1784189162.256056:0:90330:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9dc047a83800): rc 0 00000020:00000080:2.0:1784189162.256058:0:90330:0:(genops.c:906:class_export_put()) final put ffff9dc047a83800/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00080000:2.0:1784189162.256074:0:90330:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9dc047a85000), last request at 1784189162 00000020:00000080:2.0:1784189162.256077:0:90330:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xcc1762b626f8b28e 00000100:00080000:2.0:1784189162.256081:0:90330:0:(import.c:65:import_set_state_nolock()) ffff9dc047a84000 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1784189162.256219:0:90330:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9dc047a85000): rc 0 00000020:00000080:2.0:1784189162.256222:0:90330:0:(genops.c:906:class_export_put()) final put ffff9dc047a85000/lustre-MDT0000-lwp-OST0001_UUID 00000020:00080000:2.0:1784189162.256226:0:90330:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9dc047a87000), last request at 1784189162 00000020:00000080:2.0:1784189162.256239:0:90330:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xcc1762b626f8b287 00000100:00080000:2.0:1784189162.256244:0:90330:0:(import.c:65:import_set_state_nolock()) ffff9dc047a80000 : changing import state from FULL to CLOSED 00000020:00000080:1.0:1784189162.256274:0:89010:0:(genops.c:865:class_export_destroy()) destroying export ffff9dc047a83800/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000 00000020:00000080:1.0:1784189162.256345:0:89010:0:(genops.c:865:class_export_destroy()) destroying export ffff9dc047a85000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000020:00000080:1.0:1784189162.256368:0:89010:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9dc047a87800 for lustre-MDT0000 00000020:00000080:1.0:1784189162.256373:0:89010:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9dc047a84000 for lustre-MDT0000 00010000:00010000:0.0:1784189162.257729:0:26173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784189162.258207:0:7454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:2.0:1784189162.258285:0:90330:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9dc047a87000): rc 0 00000020:00000080:2.0:1784189162.258289:0:90330:0:(genops.c:906:class_export_put()) final put ffff9dc047a87000/lustre-MDT0000-lwp-OST0000_UUID 00000020:00080000:2.0:1784189162.258412:0:90330:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9dbf43e9e000), last request at 1784189125 00000020:00000080:2.0:1784189162.258425:0:90330:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xcc1762b626f8b0f8 00000100:00080000:2.0:1784189162.258441:0:90330:0:(import.c:65:import_set_state_nolock()) ffff9dc047a84800 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1784189162.258497:0:90330:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9dbf43e9e000): rc 0 00000020:00000080:2.0:1784189162.258500:0:90330:0:(genops.c:906:class_export_put()) final put ffff9dbf43e9e000/lustre-MDT0001-mdtlov_UUID 00010000:00010000:3.0:1784189162.258537:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784189162.258597:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1784189162.260742:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9dc047a87000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00000080:1.0:1784189162.260807:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9dc047a80000 for lustre-MDT0000 00000020:00000080:0.0:1784189162.260966:0:89010:0:(genops.c:865:class_export_destroy()) destroying export ffff9dbf43e9e000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000 00000020:00000080:0.0:1784189162.261009:0:89010:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9dc047a84800 for lustre-MDT0000 00000020:00080000:2.0:1784189162.261060:0:90330:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 192.168.203.12@tcp (ffff9dbf43e9f000), last request at 1784189160 00000020:00000080:2.0:1784189162.261067:0:90330:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xcc1762b626f8b0f1 00000020:00010000:2.0:1784189162.261080:0:90330:0:(genops.c:1942:obd_stale_export_put()) Put export ffff9dbf43e9f000: total 0 00000100:00080000:2.0:1784189162.261084:0:90330:0:(import.c:65:import_set_state_nolock()) ffff9dc047a86800 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1784189162.261107:0:90330:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 192.168.203.12@tcp (ffff9dbf43e9f000): rc 0 00000004:00000080:2.0:1784189162.261113:0:90330:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffae0987a73ae0 00000020:00010000:0.0:1784189162.261204:0:26173:0:(genops.c:1928:obd_stale_export_get()) Get export ffff9dbf43e9f000: total 0 00010000:00010000:0.0:1784189162.261272:0:26173:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff9dbf43e9f000, canceled 0 locks, left on hash table 7. 00010000:00010000:0.0:1784189162.261306:0:26173:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0755a5c00/0xcc1762b626f8b4d3 lrc: 0/0,0 mode: --/CR res: [0x20000a811:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c3ddf expref: 8 pid: 68287 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189162.261375:0:26173:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc07116e200/0xcc1762b626f8b64d lrc: 0/0,0 mode: --/PR res: [0x20000a811:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c3e5d expref: 7 pid: 66169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189162.261388:0:26173:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0755a4200/0xcc1762b626f8b4cc lrc: 0/0,0 mode: --/PR res: [0x20000a811:0x6:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c3dd8 expref: 6 pid: 66945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189162.261404:0:26173:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc058f66200/0xcc1762b626f8b4da lrc: 0/0,0 mode: --/PR res: [0x20000a811:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c3de6 expref: 5 pid: 66171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189162.261423:0:26173:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc058f67800/0xcc1762b626f8b5c8 lrc: 0/0,0 mode: --/PR res: [0x20000a811:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c3e25 expref: 4 pid: 68287 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189162.261437:0:26173:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0755a5e00/0xcc1762b626f8b5e4 lrc: 0/0,0 mode: --/CR res: [0x20000a811:0x9:0x0].0x0 bits 0xa/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c3e33 expref: 3 pid: 66170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189162.261451:0:26173:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4369da00/0xcc1762b626f8b607 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c3e4f expref: 2 pid: 66945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189162.261465:0:26173:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff9dbf43e9f000, canceled 7 locks, left on hash table 0. 00000100:00080000:2.0:1784189162.264598:0:90330:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1784189162.264621:0:90330:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:2.0:1784189162.265553:0:90330:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000100:00080000:2.0:1784189162.265584:0:90330:0:(import.c:65:import_set_state_nolock()) ffff9dc06b3ef000 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:1.0:1784189162.265647:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc07faab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3639:1870854458118144:0@lo:39:umount.0 00000100:00100000:1.0:1784189162.265714:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784189162.268314:0:23826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458118144 00000100:00100000:1.0:1784189162.268353:0:23826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458118144 00000100:00100000:1.0:1784189162.268411:0:23826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3793 00000100:00100000:1.0:1784189162.268420:0:23826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc05ed9a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3639:x1870854458118144:12345-0@lo:39:umount.0 00000020:00000080:1.0:1784189162.268470:0:23826:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xcc1762b626f8b137 00000100:00080000:1.0:1784189162.268477:0:23826:0:(import.c:65:import_set_state_nolock()) ffff9dbf4512c000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1784189162.268503:0:23826:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 19, last_transno is 81604378733 00000100:00100000:1.0:1784189162.268665:0:23826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc05ed9a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+3:3639:x1870854458118144:12345-0@lo:39:umount.0 Request processed in 245us (2950us total) trans 81604378734 rc 0/0 00000100:00100000:1.0:1784189162.268673:0:23826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3793 00010000:00010000:1.0:1784189162.268696:0:7454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1784189162.268723:0:3639:0:(import.c:65:import_set_state_nolock()) ffff9dc06b3ef000 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:1.0:1784189162.268731:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc07faab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3639:1870854458118144:0@lo:39:umount.0 00000100:00080000:3.0:1784189162.270531:0:90330:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1784189162.270538:0:90330:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294968950 gen 3 00000004:00080000:3.0:1784189162.270560:0:90330:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:3.0:1784189162.270611:0:90330:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:3.0:1784189162.270635:0:90330:0:(import.c:65:import_set_state_nolock()) ffff9dc05ed59000 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:3.0:1784189162.270657:0:90330:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1784189162.270659:0:90330:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294968954 gen 3 00000004:00080000:3.0:1784189162.270669:0:90330:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:3.0:1784189162.270737:0:90330:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:3.0:1784189162.270748:0:90330:0:(import.c:65:import_set_state_nolock()) ffff9dc0477b0000 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:3.0:1784189162.270787:0:90330:0:(genops.c:1579:class_disconnect_exports()) OBD device 13 (ffff9dc06bb33380) has no exports 00000100:00100000:2.0:1784189162.270962:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc080df1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3639:1870854458118272:0@lo:9:umount.0 00000100:00100000:2.0:1784189162.271026:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784189162.271062:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf44bc0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3639:1870854458118400:0@lo:9:umount.0 00000100:00100000:2.0:1784189162.271085:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784189162.271120:0:26160:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458118272 00000100:00100000:2.0:1784189162.271126:0:26160:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458118272 00000100:00100000:2.0:1784189162.271173:0:26160:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458118400 00000100:00100000:2.0:1784189162.271177:0:26160:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458118400 00000100:00100000:2.0:1784189162.271197:0:26160:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4956 00000100:00100000:2.0:1784189162.271205:0:26160:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc081cd3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+5:3639:x1870854458118272:12345-0@lo:9:umount.0 00000020:00000080:2.0:1784189162.271226:0:26160:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xcc1762b626f8b145 00000100:00080000:2.0:1784189162.271243:0:26160:0:(import.c:65:import_set_state_nolock()) ffff9dc07a8f2000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1784189162.271284:0:26160:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294968951 00000100:00100000:2.0:1784189162.271430:0:26160:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc081cd3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+2:3639:x1870854458118272:12345-0@lo:9:umount.0 Request processed in 225us (403us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189162.271438:0:26160:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4956 00000100:00100000:2.0:1784189162.271585:0:26160:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4957 00000100:00100000:2.0:1784189162.271591:0:26160:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc07faaa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+5:3639:x1870854458118400:12345-0@lo:9:umount.0 00000020:00000080:2.0:1784189162.271603:0:26160:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xcc1762b626f8b161 00000100:00080000:2.0:1784189162.271608:0:26160:0:(import.c:65:import_set_state_nolock()) ffff9dc045661800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1784189162.271628:0:26160:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294968955 00000100:00100000:2.0:1784189162.271688:0:26160:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc07faaa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+2:3639:x1870854458118400:12345-0@lo:9:umount.0 Request processed in 97us (602us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189162.271695:0:26160:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4957 00010000:00010000:2.0:1784189162.271724:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784189162.271729:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1784189162.271751:0:3639:0:(import.c:65:import_set_state_nolock()) ffff9dc05ed59000 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:2.0:1784189162.271757:0:3639:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:2.0:1784189162.271759:0:3639:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1784189162.271762:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc080df1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3639:1870854458118272:0@lo:9:umount.0 00000100:00080000:2.0:1784189162.271770:0:3639:0:(import.c:65:import_set_state_nolock()) ffff9dc0477b0000 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:2.0:1784189162.271776:0:3639:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:2.0:1784189162.271778:0:3639:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1784189162.271780:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf44bc0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3639:1870854458118400:0@lo:9:umount.0 00000020:00080000:3.0:1784189162.275883:0:90330:0:(genops.c:1579:class_disconnect_exports()) OBD device 13 (ffff9dc06bb33380) has no exports 00000020:00000080:0.0:1784189162.291287:0:26173:0:(genops.c:906:class_export_put()) final put ffff9dbf43e9f000/b90fcc1c-0e69-42a4-a116-a71fec7aeb78 00000020:00000080:1.0:1784189162.294277:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9dbf43e9f000/b90fcc1c-0e69-42a4-a116-a71fec7aeb78 for lustre-MDT0000 00000020:00000080:1.0:1784189162.294469:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9dc047a86800 for lustre-MDT0000 00010000:00010000:1.0:1784189162.294482:0:26173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784189162.294485:0:26173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784189162.294487:0:26173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1784189162.331249:0:90330:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xcc1762b626f8b10d 00000020:00000080:3.0:1784189162.331264:0:90330:0:(genops.c:906:class_export_put()) final put ffff9dbf43d89000/lustre-QMT0000_UUID 00000020:01000000:3.0:1784189162.331284:0:90330:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:0.0:1784189162.331361:0:89010:0:(genops.c:865:class_export_destroy()) destroying export ffff9dbf43d89000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:2.0:1784189162.331892:0:90330:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1784189162.331905:0:90330:0:(obd_config.c:955:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1784189162.331909:0:90330:0:(genops.c:1579:class_disconnect_exports()) OBD device 15 (ffff9dc07547cd40) has no exports 00000020:00000080:2.0:1784189162.333818:0:90330:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xcc1762b626f8b106 00000020:00000080:2.0:1784189162.333830:0:90330:0:(genops.c:906:class_export_put()) final put ffff9dc06b3ec000/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1784189162.333903:0:90330:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1784189162.333915:0:90330:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:2.0:1784189162.333918:0:90330:0:(genops.c:906:class_export_put()) final put ffff9dc06b3eb800/lustre-QMT0000_UUID 00000020:00000080:2.0:1784189162.333920:0:90330:0:(genops.c:865:class_export_destroy()) destroying export ffff9dc06b3eb800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:2.0:1784189162.333930:0:90330:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00000020:00000080:0.0:1784189162.334561:0:89010:0:(genops.c:865:class_export_destroy()) destroying export ffff9dc06b3ec000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:2.0:1784189162.334623:0:90330:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9dc0569891e0 - data ffff9dbf41ff3af8/ffff9dbf469ff800 00000020:01000000:2.0:1784189162.334755:0:90330:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9dc056989ba0 - data ffff9dc0704f4288/ffff9dc07fadf800 00000100:00080000:0.0:1784189162.396860:0:90330:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1784189162.396868:0:90330:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:0.0:1784189162.396882:0:90330:0:(client.c:3150:ptlrpc_free_committed()) @@@ free request with old gen req@ffff9dc07faab480 x1870854458118144/t81604378734(81604378734) o39->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1784189172 ref 1 fl Complete:RNQU/204/0 rc 0/0 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784189162.396929:0:90330:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:1.0:1784189162.399740:0:90330:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1784189162.399747:0:90330:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294968950 gen 4 00000004:00080000:1.0:1784189162.399766:0:90330:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1784189162.399768:0:90330:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1784189162.400467:0:88981:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1784189162.400472:0:88981:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x64:0x0] index 1 count 1 00000040:00080000:0.0:1784189162.400485:0:88981:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 25 count 2 00000100:00080000:1.0:1784189162.401469:0:90330:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1784189162.401475:0:90330:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294968954 gen 4 00000004:00080000:1.0:1784189162.401488:0:90330:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1784189162.401490:0:90330:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1784189162.402274:0:88983:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1784189162.402279:0:88983:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x66:0x0] index 1 count 1 00000040:00080000:0.0:1784189162.402289:0:88983:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 25 count 2 00000020:00000080:1.0:1784189162.411306:0:90330:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xcc1762b626f8b0c7 00000020:00000080:1.0:1784189162.411790:0:90330:0:(genops.c:906:class_export_put()) final put ffff9dbf44677800/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1784189162.411993:0:89010:0:(genops.c:865:class_export_destroy()) destroying export ffff9dbf44677800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1784189162.413146:0:90330:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xcc1762b626f8b0dc 00000020:00000080:1.0:1784189162.413156:0:90330:0:(genops.c:906:class_export_put()) final put ffff9dbf46d39800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:1.0:1784189162.413170:0:90330:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:1.0:1784189162.413176:0:90330:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1784189162.413186:0:90330:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00000080:0.0:1784189162.413449:0:89010:0:(genops.c:865:class_export_destroy()) destroying export ffff9dbf46d39800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:00080000:1.0:1784189162.413897:0:90330:0:(genops.c:1579:class_disconnect_exports()) OBD device 12 (ffff9dc06bb319c0) has no exports 00000004:01000000:1.0:1784189162.424714:0:90330:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:1.0:1784189162.424729:0:90330:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xcc1762b626f8b15a 00000020:00000080:1.0:1784189162.424737:0:90330:0:(genops.c:906:class_export_put()) final put ffff9dc05ed5b800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:1.0:1784189162.424766:0:90330:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:1.0:1784189162.424790:0:90330:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1784189162.424804:0:90330:0:(obd_config.c:955:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1784189162.424807:0:90330:0:(genops.c:1579:class_disconnect_exports()) OBD device 27 (ffff9dc049be0000) has no exports 00000020:00000080:1.0:1784189162.424814:0:90330:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xcc1762b626f8b153 00000020:00000080:1.0:1784189162.424818:0:90330:0:(genops.c:906:class_export_put()) final put ffff9dc0477b1800/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1784189162.424883:0:89010:0:(genops.c:865:class_export_destroy()) destroying export ffff9dc05ed5b800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:00000080:3.0:1784189162.424897:0:89010:0:(genops.c:865:class_export_destroy()) destroying export ffff9dc0477b1800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:1.0:1784189162.426693:0:90330:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:1.0:1784189162.426701:0:90330:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1784189162.426705:0:90330:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294968954 gen 5 00000004:00080000:1.0:1784189162.426713:0:90330:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1784189162.426715:0:90330:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1784189162.426756:0:90330:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1784189162.426811:0:89010:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9dc0477b0000 for lustre-OST0001-osc-MDT0000 00000020:00000080:1.0:1784189162.426854:0:90330:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1784189162.426859:0:90330:0:(genops.c:906:class_export_put()) final put ffff9dc06bb60800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1784189162.426863:0:90330:0:(genops.c:865:class_export_destroy()) destroying export ffff9dc06bb60800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:1.0:1784189162.426870:0:90330:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1784189162.426947:0:90330:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xcc1762b626f8b13e 00000020:00000080:1.0:1784189162.426953:0:90330:0:(genops.c:906:class_export_put()) final put ffff9dbf44675000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:1.0:1784189162.426965:0:90330:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:1.0:1784189162.426969:0:90330:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1784189162.426975:0:90330:0:(obd_config.c:955:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1784189162.426979:0:90330:0:(genops.c:1579:class_disconnect_exports()) OBD device 22 (ffff9dc0762999c0) has no exports 00000020:00000080:1.0:1784189162.426985:0:90330:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xcc1762b626f8b130 00000020:00000080:1.0:1784189162.426987:0:90330:0:(genops.c:906:class_export_put()) final put ffff9dc05ed5e000/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1784189162.427030:0:89010:0:(genops.c:865:class_export_destroy()) destroying export ffff9dbf44675000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:00000080:3.0:1784189162.427039:0:89010:0:(genops.c:865:class_export_destroy()) destroying export ffff9dc05ed5e000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:1.0:1784189162.428647:0:90330:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:1.0:1784189162.428654:0:90330:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1784189162.428658:0:90330:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294968950 gen 5 00000004:00080000:1.0:1784189162.428674:0:90330:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1784189162.428676:0:90330:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1784189162.428765:0:90330:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1784189162.428776:0:90330:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000004:01000000:1.0:1784189162.428791:0:90330:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:1.0:1784189162.428798:0:90330:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xcc1762b626f8b122 00000020:00000080:1.0:1784189162.428806:0:90330:0:(genops.c:906:class_export_put()) final put ffff9dc0755b3000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1784189162.435991:0:89010:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9dc05ed59000 for lustre-OST0000-osc-MDT0000 00000020:00000080:3.0:1784189162.436010:0:89010:0:(genops.c:906:class_export_put()) final put ffff9dc0755b2800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1784189162.436013:0:89010:0:(genops.c:865:class_export_destroy()) destroying export ffff9dc0755b2800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:3.0:1784189162.436020:0:89010:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1784189162.438045:0:89010:0:(genops.c:865:class_export_destroy()) destroying export ffff9dc0755b3000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:01000000:1.0:1784189162.438859:0:90330:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osp-MDT0000 (flags='') 00000020:00000080:1.0:1784189162.438887:0:90330:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1784189162.438901:0:90330:0:(obd_config.c:955:class_cleanup()) lustre-MDT0001-osp-MDT0000: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1784189162.438906:0:90330:0:(genops.c:1579:class_disconnect_exports()) OBD device 21 (ffff9dc07547b380) has no exports 00000020:00000080:1.0:1784189162.438914:0:90330:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xcc1762b626f8b11b 00000020:00000080:1.0:1784189162.438922:0:90330:0:(genops.c:906:class_export_put()) final put ffff9dbf43d8e800/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1784189162.439183:0:89010:0:(genops.c:865:class_export_destroy()) destroying export ffff9dbf43d8e800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:0.0:1784189162.444470:0:90330:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0001-osp-MDT0000: client import never connected 00000100:00080000:0.0:1784189162.444477:0:90330:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1784189162.444482:0:90330:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:0.0:1784189162.444488:0:90330:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1784189162.444536:0:90330:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1784189162.444551:0:90330:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1784189162.444577:0:90330:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1784189162.444581:0:90330:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1784189162.444585:0:90330:0:(genops.c:906:class_export_put()) final put ffff9dc05106d000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1784189162.444590:0:90330:0:(genops.c:865:class_export_destroy()) destroying export ffff9dc05106d000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:0.0:1784189162.444599:0:90330:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1784189162.444691:0:90330:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xcc1762b626f8b0e3 00000020:00000080:0.0:1784189162.444697:0:90330:0:(genops.c:906:class_export_put()) final put ffff9dbf46d3b800/lustre-MDD0000_UUID 00000020:01000000:0.0:1784189162.444701:0:90330:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:0.0:1784189162.444704:0:90330:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1784189162.444708:0:90330:0:(obd_config.c:955:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1784189162.444711:0:90330:0:(genops.c:1579:class_disconnect_exports()) OBD device 14 (ffff9dc06bb34d40) has no exports 00000020:00000080:0.0:1784189162.444740:0:90330:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1784189162.444743:0:90330:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:0.0:1784189162.444746:0:90330:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xcc1762b626f8b0ea 00000020:00000080:0.0:1784189162.444758:0:90330:0:(genops.c:906:class_export_put()) final put ffff9dbf46d3d800/lustre-MDT0000-osd_UUID 00000020:01000004:0.0:1784189162.444764:0:90330:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9dbf4845c000 from lustre-MDT0000, refs=3 00000020:01000004:0.0:1784189162.444767:0:90330:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9dbf4845c000 3 00000020:01000004:0.0:1784189162.444770:0:90330:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9dbf4845c000 from lustre-MDT0000 00000020:00000080:0.0:1784189162.444797:0:90330:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1784189162.444800:0:90330:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:0.0:1784189162.444802:0:90330:0:(genops.c:906:class_export_put()) final put ffff9dbf44673000/lustre-MDT0000_UUID 00000020:00000080:0.0:1784189162.444804:0:90330:0:(genops.c:865:class_export_destroy()) destroying export ffff9dbf44673000/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:0.0:1784189162.444810:0:90330:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:0.0:1784189162.444835:0:90330:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 3 references. 00000020:01000004:0.0:1784189162.444838:0:90330:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:0.0:1784189162.444841:0:90330:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:0.0:1784189162.444843:0:90330:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1784189162.444846:0:90330:0:(obd_config.c:955:class_cleanup()) MGS: forcing exports to disconnect: 2/5 00000020:00080000:0.0:1784189162.444852:0:90330:0:(genops.c:1840:print_export_data()) MGS: ACTIVE ffff9dbf43e9b800 bd553d0d-03e2-4233-b06b-b55bbfa2b954 0@lo 18 (0 0 13) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1784189162.444860:0:90330:0:(genops.c:1840:print_export_data()) MGS: ACTIVE ffff9dbf43e9d000 9957a2dc-fd88-4a91-bca3-e2b7f365ab0c 192.168.203.12@tcp 9 (0 0 4) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1784189162.444865:0:90330:0:(genops.c:1574:class_disconnect_exports()) OBD device 3 (ffff9dc075478000) has exports, disconnecting them 00000020:00080000:0.0:1784189162.444869:0:90330:0:(genops.c:1549:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff9dbf43e9b800), last request at 1784189125 00000020:00000080:0.0:1784189162.444887:0:90330:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xcc1762b626f8b088 00000020:00010000:0.0:1784189162.444890:0:90330:0:(genops.c:1942:obd_stale_export_put()) Put export ffff9dbf43e9b800: total 2 00000100:00080000:0.0:1784189162.444893:0:90330:0:(import.c:65:import_set_state_nolock()) ffff9dbf43e9f800 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1784189162.444904:0:90330:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9dbf43e9b800): rc 0 00000020:00080000:0.0:1784189162.444907:0:90330:0:(genops.c:1549:class_disconnect_export_list()) MGS: disconnecting export at 192.168.203.12@tcp (ffff9dbf43e9d000), last request at 1784189125 00000020:00000080:0.0:1784189162.444943:0:90330:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xcc1762b626f8b081 00000020:00010000:0.0:1784189162.444946:0:90330:0:(genops.c:1942:obd_stale_export_put()) Put export ffff9dbf43e9d000: total 2 00000100:00080000:0.0:1784189162.444948:0:90330:0:(import.c:65:import_set_state_nolock()) ffff9dbf43e99800 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1784189162.444961:0:90330:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 192.168.203.12@tcp (ffff9dbf43e9d000): rc 0 00000020:00080000:0.0:1784189162.444965:0:90330:0:(genops.c:1579:class_disconnect_exports()) OBD device 3 (ffff9dc075478000) has no exports 00000100:00100000:0.0:1784189162.445009:0:88968:0:(service.c:3183:ptlrpc_main()) ll_mgs_0001: service thread [ffff9dc0565d2000:88968] 1 exiting: rc = 0 00000100:00100000:0.0:1784189162.445100:0:88967:0:(service.c:3183:ptlrpc_main()) ll_mgs_0000: service thread [ffff9dc0565d2c00:88967] 0 exiting: rc = 1 00000020:00010000:0.0:1784189162.445136:0:7454:0:(genops.c:1928:obd_stale_export_get()) Get export ffff9dbf43e9b800: total 2 00010000:00010000:0.0:1784189162.445160:0:7454:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff9dbf43e9b800, canceled 0 locks, left on hash table 13. 00010000:00010000:0.0:1784189162.445186:0:7454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dbf4369de00/0xcc1762b626f8b256 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xcc1762b626f8b24f expref: 14 pid: 88968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189162.445279:0:7454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dbf4369ca00/0xcc1762b626f8b225 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xcc1762b626f8b21e expref: 13 pid: 88968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189162.445291:0:7454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dc0755a5a00/0xcc1762b626f8b1c3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xcc1762b626f8b1bc expref: 12 pid: 88968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189162.445302:0:7454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dc0565e6200/0xcc1762b626f8b202 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xcc1762b626f8b1fb expref: 11 pid: 88973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189162.445311:0:7454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dc0755a4c00/0xcc1762b626f8b241 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xcc1762b626f8b23a expref: 10 pid: 88969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189162.445411:0:7454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dbf4369dc00/0xcc1762b626f8b264 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xcc1762b626f8b25d expref: 9 pid: 88967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189162.445421:0:7454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dc0565e6600/0xcc1762b626f8b1f4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xcc1762b626f8b1ed expref: 8 pid: 88973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189162.445433:0:7454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dc05ec0c000/0xcc1762b626f8b233 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xcc1762b626f8b22c expref: 7 pid: 88967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189162.445442:0:7454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dbf4369cc00/0xcc1762b626f8b272 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xcc1762b626f8b26b expref: 6 pid: 88973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189162.445453:0:7454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dc05ec0da00/0xcc1762b626f8b280 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xcc1762b626f8b279 expref: 5 pid: 88967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189162.445474:0:7454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dc0755a4600/0xcc1762b626f8b1d1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xcc1762b626f8b1ca expref: 4 pid: 88968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189162.445484:0:7454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dc0755a4400/0xcc1762b626f8b217 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xcc1762b626f8b209 expref: 3 pid: 88968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189162.445493:0:7454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dc0565e7e00/0xcc1762b626f8b1df lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xcc1762b626f8b1d8 expref: 2 pid: 88973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189162.445501:0:7454:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff9dbf43e9b800, canceled 13 locks, left on hash table 0. 00000020:00000080:0.0:1784189162.445517:0:7454:0:(genops.c:906:class_export_put()) final put ffff9dbf43e9b800/bd553d0d-03e2-4233-b06b-b55bbfa2b954 00000020:00010000:0.0:1784189162.445522:0:7454:0:(genops.c:1928:obd_stale_export_get()) Get export ffff9dbf43e9d000: total 3 00010000:00010000:0.0:1784189162.445524:0:7454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784189162.445539:0:7454:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff9dbf43e9d000, canceled 0 locks, left on hash table 4. 00010000:00010000:0.0:1784189162.445552:0:7454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dc0755a5200/0xcc1762b626f8b1a7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c3dae expref: 5 pid: 88969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189162.445566:0:7454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dc05ec0c600/0xcc1762b626f8b210 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c3dbc expref: 4 pid: 88969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189162.445679:0:7454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dbf4369c600/0xcc1762b626f8b1e6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c3db5 expref: 3 pid: 88968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189162.445692:0:7454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dc0565e7a00/0xcc1762b626f8b248 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c3dc3 expref: 2 pid: 88969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189162.445702:0:7454:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff9dbf43e9d000, canceled 4 locks, left on hash table 0. 00000020:00000080:0.0:1784189162.445713:0:7454:0:(genops.c:906:class_export_put()) final put ffff9dbf43e9d000/9957a2dc-fd88-4a91-bca3-e2b7f365ab0c 00010000:00010000:0.0:1784189162.445716:0:7454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784189162.445723:0:7454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784189162.445724:0:7454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784189162.445758:0:88973:0:(service.c:3183:ptlrpc_main()) ll_mgs_0003: service thread [ffff9dc04a421200:88973] 3 exiting: rc = 0 00000100:00100000:3.0:1784189162.446357:0:88969:0:(service.c:3183:ptlrpc_main()) ll_mgs_0002: service thread [ffff9dc050af3400:88969] 2 exiting: rc = 0 00000020:00000080:3.0:1784189162.446412:0:89010:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9dc06b3ef000 for lustre-MDT0001-osp-MDT0000 00000020:00000080:3.0:1784189162.446419:0:89010:0:(genops.c:906:class_export_put()) final put ffff9dc0755b5000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1784189162.446422:0:89010:0:(genops.c:865:class_export_destroy()) destroying export ffff9dc0755b5000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:01000000:3.0:1784189162.446429:0:89010:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osp-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1784189162.446487:0:89010:0:(genops.c:865:class_export_destroy()) destroying export ffff9dbf46d3b800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:3.0:1784189162.446490:0:89010:0:(genops.c:906:class_export_put()) final put ffff9dc05ed5f800/lustre-MDD0000_UUID 00000020:00000080:3.0:1784189162.446492:0:89010:0:(genops.c:865:class_export_destroy()) destroying export ffff9dc05ed5f800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:3.0:1784189162.446496:0:89010:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:00000080:3.0:1784189162.446519:0:89010:0:(genops.c:865:class_export_destroy()) destroying export ffff9dbf46d3d800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1784189162.446522:0:89010:0:(genops.c:865:class_export_destroy()) destroying export ffff9dbf43e9b800/bd553d0d-03e2-4233-b06b-b55bbfa2b954 for MGS 00000020:00000080:3.0:1784189162.446542:0:89010:0:(genops.c:865:class_export_destroy()) destroying export ffff9dbf43e9d000/9957a2dc-fd88-4a91-bca3-e2b7f365ab0c for MGS 00000020:00000080:3.0:1784189162.446559:0:89010:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9dbf43e9f800 for MGS 00000020:00000080:3.0:1784189162.446562:0:89010:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9dbf43e99800 for MGS 00010000:00010000:2.0:1784189162.447702:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784189162.448113:0:90330:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784189162.448123:0:90330:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784189162.448129:0:90330:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784189162.448136:0:90330:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784189162.448142:0:90330:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784189162.448148:0:90330:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784189162.448153:0:90330:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784189162.448159:0:90330:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784189162.448164:0:90330:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784189162.448170:0:90330:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784189162.448176:0:90330:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784189162.448181:0:90330:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784189162.448186:0:90330:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784189162.448192:0:90330:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784189162.448210:0:90330:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784189162.448216:0:90330:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784189162.448223:0:90330:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784189162.448238:0:90330:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784189162.448244:0:90330:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784189162.448248:0:90330:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784189162.448254:0:90330:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784189162.448259:0:90330:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784189162.448264:0:90330:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784189162.448270:0:90330:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784189162.448276:0:90330:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784189162.448282:0:90330:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784189162.448288:0:90330:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784189162.448293:0:90330:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784189162.448299:0:90330:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784189162.448306:0:90330:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784189162.448312:0:90330:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784189162.449289:0:90330:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784189162.449421:0:90330:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784189162.449431:0:90330:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784189162.449437:0:90330:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784189162.449442:0:90330:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784189162.449447:0:90330:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784189162.449453:0:90330:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784189162.449459:0:90330:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784189162.449464:0:90330:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784189162.449470:0:90330:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784189162.449476:0:90330:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784189162.449481:0:90330:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784189162.449486:0:90330:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784189162.449491:0:90330:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784189162.449497:0:90330:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784189162.449504:0:90330:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784189162.449510:0:90330:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784189162.449516:0:90330:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784189162.449522:0:90330:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784189162.449529:0:90330:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784189162.449534:0:90330:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784189162.449540:0:90330:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784189162.449546:0:90330:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784189162.449552:0:90330:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784189162.449558:0:90330:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784189162.449563:0:90330:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784189162.449569:0:90330:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784189162.449575:0:90330:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784189162.449581:0:90330:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784189162.449586:0:90330:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784189162.449592:0:90330:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784189162.449598:0:90330:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784189162.449604:0:90330:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:01000000:0.0:1784189162.452271:0:90330:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9dbf45b80420 - data ffff9dbf41f87a20/ffff9dbf43e61800 00000020:01000000:0.0:1784189162.452416:0:90330:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9dbf45b80480 - data ffff9dc06bfa9870/ffff9dbf47e73c00 00000020:00000080:0.0:1784189162.452801:0:90330:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xcc1762b626f8b07a 00000020:00000080:0.0:1784189162.452822:0:90330:0:(genops.c:906:class_export_put()) final put ffff9dbf43e98000/lustre-MDT0000-osd_UUID 00000020:01000004:0.0:1784189162.452841:0:90330:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9dbf4845c000 from MGS, refs=2 00000020:01000004:0.0:1784189162.452844:0:90330:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9dbf4845c000 2 00000020:01000004:0.0:1784189162.452848:0:90330:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9dbf4845c000 from MGS 00000020:00000080:0.0:1784189162.452865:0:90330:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1784189162.452871:0:90330:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:0.0:1784189162.452874:0:90330:0:(genops.c:906:class_export_put()) final put ffff9dbf43e9e800/MGS 00000020:00000080:0.0:1784189162.452876:0:90330:0:(genops.c:865:class_export_destroy()) destroying export ffff9dbf43e9e800/MGS for MGS 00000020:01000000:0.0:1784189162.452882:0:90330:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:0.0:1784189162.452950:0:90330:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:0.0:1784189162.452953:0:90330:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1784189162.452962:0:90330:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1784189162.452968:0:90330:0:(genops.c:1840:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff9dc07118e800 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1784189162.452974:0:90330:0:(genops.c:1574:class_disconnect_exports()) OBD device 28 (ffff9dbf449f4d40) has exports, disconnecting them 00000020:00080000:0.0:1784189162.452978:0:90330:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff9dc07118e800), last request at 1784189125 00000020:00000080:0.0:1784189162.452982:0:90330:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xcc1762b626f8b199 00000020:00080000:0.0:1784189162.452991:0:90330:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9dc07118e800): rc 0 00000020:00000080:0.0:1784189162.452994:0:90330:0:(genops.c:906:class_export_put()) final put ffff9dc07118e800/lustre-MDT0000-lwp-MDT0000 00000020:00000080:3.0:1784189162.453627:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9dbf43e98000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1784189162.453635:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9dc07118e800/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:3.0:1784189162.511528:0:90330:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:3.0:1784189162.511537:0:90330:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1784189162.511541:0:90330:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:3.0:1784189162.511548:0:90330:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1784189162.511579:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9dc07118c000 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:3.0:1784189162.511726:0:90330:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1784189162.511739:0:90330:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:3.0:1784189162.511745:0:90330:0:(genops.c:906:class_export_put()) final put ffff9dbf4726c000/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:3.0:1784189162.511748:0:90330:0:(genops.c:865:class_export_destroy()) destroying export ffff9dbf4726c000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:3.0:1784189162.511762:0:90330:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:3.0:1784189162.512092:0:90330:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9dbf4845c000 1 00000020:00000080:3.0:1784189162.512102:0:90330:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xcc1762b626f8b06c 00000020:00000080:3.0:1784189162.512108:0:90330:0:(genops.c:906:class_export_put()) final put ffff9dbf43e98800/lustre-MDT0000-osd_UUID 00000020:01000000:3.0:1784189162.512121:0:90330:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:3.0:1784189162.512130:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9dbf43e98800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1784189162.512140:0:90330:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1784189162.512144:0:90330:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1784189162.512147:0:90330:0:(genops.c:1579:class_disconnect_exports()) OBD device 0 (ffff9dbf44d78000) has no exports 00000020:00000080:2.0:1784189162.600553:0:90330:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1784189162.600565:0:90330:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:2.0:1784189162.600571:0:90330:0:(genops.c:906:class_export_put()) final put ffff9dbf43fbb000/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1784189162.600577:0:90330:0:(genops.c:865:class_export_destroy()) destroying export ffff9dbf43fbb000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:2.0:1784189162.600586:0:90330:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:2.0:1784189162.601146:0:90330:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9dbf43fbc000 00000020:02000400:2.0:1784189162.601219:0:90330:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-MDT0000 complete 00000400:00000100:1.0:1784189162.793408:0:3635:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-192.168.203.12@tcp portal 26 match 1870854436275072 offset 0 length 224: 4 00000100:00100000:1.0:1784189162.793695:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1784189162.793769:0:66170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436275328 00000100:00100000:2.0:1784189162.793779:0:66170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436275328 00000100:00100000:2.0:1784189162.793849:0:66170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1172 00000100:00100000:2.0:1784189162.793859:0:66170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc05ed98000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+6:2398:x1870854436275328:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:2.0:1784189162.793924:0:66170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc05ed98000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+6:2398:x1870854436275328:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 65us (230us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189162.793932:0:66170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1172 00000100:00080000:3.0:1784189162.794943:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1784189162.796424:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1784189162.796462:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1784189162.796477:0:26169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436275584 00000100:00100000:2.0:1784189162.796485:0:26169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436275584 00000100:00100000:1.0:1784189162.796485:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1784189162.796503:0:68287:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436275200 00000100:00100000:1.0:1784189162.796507:0:68287:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436275200 00000100:00100000:2.0:1784189162.796528:0:26169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436275456 00000100:00100000:2.0:1784189162.796530:0:26169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436275456 00000100:00100000:1.0:1784189162.796531:0:68287:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1234 00000100:00100000:1.0:1784189162.796538:0:68287:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc05ed7ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2398:x1870854436275200:12345-192.168.203.12@tcp:400:kworker.0 00000020:00080000:1.0:1784189162.796547:0:68287:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-192.168.203.12@tcp 00000100:00100000:2.0:1784189162.796549:0:26169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 2436 00000100:00100000:2.0:1784189162.796554:0:26169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc05ed7df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+8:2398:x1870854436275584:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:1.0:1784189162.796589:0:68287:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc05ed7ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2398:x1870854436275200:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 50us (125us total) trans 0 rc -107/-107 00000100:00100000:1.0:1784189162.796596:0:68287:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1234 00000100:00100000:3.0:1784189162.796938:0:26170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 2437 00000100:00100000:3.0:1784189162.796948:0:26170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc071537800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+7:2398:x1870854436275456:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:2.0:1784189162.803315:0:26169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc05ed7df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+8:2398:x1870854436275584:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 6750us (6888us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189162.803343:0:26169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 2436 00000100:00100000:3.0:1784189162.810809:0:26170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc071537800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+7:2398:x1870854436275456:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 13852us (14311us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189162.810826:0:26170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 2437 00000100:00080000:3.0:1784189162.810873:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1784189162.810878:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1784189162.811053:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1784189162.811788:0:66945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436275712 00000100:00100000:3.0:1784189162.811798:0:66945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436275712 00000100:00100000:3.0:1784189162.811846:0:66945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1235 00000100:00100000:3.0:1784189162.811855:0:66945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc050542a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2395:x1870854436275712:12345-192.168.203.12@tcp:38:ptlrpcd_01_00.0 00010000:00020000:3.0:1784189162.811877:0:66945:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.203.12@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1784189162.844998:0:66945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc050542a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2395:x1870854436275712:12345-192.168.203.12@tcp:38:ptlrpcd_01_00.0 Request processed in 33132us (33935us total) trans 0 rc -19/-19 00000100:00100000:3.0:1784189162.845015:0:66945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1235 00010000:00010000:2.0:1784189163.251307:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784189163.819533:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1784189163.819578:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1784189163.819700:0:26171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436275968 00000100:00100000:3.0:1784189163.819715:0:26171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436275968 00000100:00100000:2.0:1784189163.819740:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436275840 00000100:00100000:2.0:1784189163.819744:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436275840 00000100:00100000:3.0:1784189163.819773:0:26171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 4958 00002000:00100000:2.0:1784189163.819776:0:8435:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x702:0x0] (1048576->2097151) req@ffff9dc050540380 x1870854436275840/t0(0) o4->b90fcc1c-0e69-42a4-a116-a71fec7aeb78@192.168.203.12@tcp:354/0 lens 488/0 e 0 to 0 dl 1784189174 ref 1 fl New:/600/ffffffff rc 0/-1 job:'md5sum.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1784189163.819781:0:26171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc050541c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+8:2399:x1870854436275968:12345-192.168.203.12@tcp:16:kworker.0 00002000:00100000:2.0:1784189163.819786:0:8435:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9dc050540380 with x1870854436275840 ext(1048576->2097151) 00002000:00010000:2.0:1784189163.819791:0:8435:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9dc050540380 00000100:00100000:2.0:1784189163.819821:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1004 00000100:00100000:2.0:1784189163.819828:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc050540380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+8:2399:x1870854436275840:12345-192.168.203.12@tcp:4:md5sum.0 00000001:00100000:3.0:1784189163.825905:0:8423:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1784189163.825914:0:8423:0:(genops.c:906:class_export_put()) final put ffff9dc07a8f1800/lustre-MDT0000-mdtlov_UUID 00000001:00080000:3.0:1784189163.825936:0:8423:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294968951 is committed 00000020:00000080:0.0:1784189163.825961:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9dc07a8f1800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:0.0:1784189163.826003:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9dc07a8f2000 for lustre-OST0000 00000100:00100000:1.0:1784189163.826198:0:26171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc050541c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+8:2399:x1870854436275968:12345-192.168.203.12@tcp:16:kworker.0 Request processed in 6411us (6612us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189163.826229:0:26171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 4958 00000100:00100000:3.0:1784189163.851385:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc050540380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+8:2399:x1870854436275840:12345-192.168.203.12@tcp:4:md5sum.0 Request processed in 31549us (31852us total) trans 4294968952 rc 0/0 00000100:00100000:3.0:1784189163.851399:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1004 00002000:00100000:3.0:1784189163.851412:0:8435:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x702:0x0] (1048576->2097151) req@ffff9dc050540380 x1870854436275840/t4294968952(0) o4->b90fcc1c-0e69-42a4-a116-a71fec7aeb78@192.168.203.12@tcp:354/0 lens 488/448 e 0 to 0 dl 1784189174 ref 1 fl Complete:/600/0 rc 0/0 job:'md5sum.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1784189163.851422:0:8435:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9dc050540380 with x1870854436275840 ext(1048576->2097151) 00002000:00010000:3.0:1784189163.851428:0:8435:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9dc050540380 00010000:00010000:1.0:1784189164.275176:0:26173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784189165.296773:0:7454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1784189165.618029:0:9506:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1784189165.618046:0:9506:0:(genops.c:906:class_export_put()) final put ffff9dc045665000/lustre-MDT0000-mdtlov_UUID 00000001:00080000:2.0:1784189165.618145:0:9506:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294968955 is committed 00000020:00000080:0.0:1784189165.618554:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9dc045665000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:0.0:1784189165.618675:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9dc045661800 for lustre-OST0001 00010000:00010000:2.0:1784189166.321730:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784189166.639921:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1784189166.640060:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc07faa9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1870854458118528:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1784189166.640122:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784189166.641109:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc071534700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1870854458118656:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1784189166.641156:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784189166.646858:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458118528 00000100:00100000:2.0:1784189166.646872:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458118528 00000100:00080000:0.0:1784189166.647105:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1784189166.647179:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458118656 00000100:00100000:2.0:1784189166.647183:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458118656 00000100:00100000:2.0:1784189166.647263:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1958 00000100:00100000:2.0:1784189166.647273:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc050543480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1870854458118528:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1784189166.647305:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17087424 pending 1073152 free 3922481152 avail 3690958848 00000100:00100000:2.0:1784189166.647394:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc050543480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1870854458118528:12345-0@lo:13:osp-pre-0-1.0 Request processed in 122us (7270us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189166.647401:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1958 00000100:00100000:2.0:1784189166.647418:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1959 00000100:00100000:2.0:1784189166.647424:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc050543100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1870854458118656:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1784189166.647440:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8649664 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1784189166.647585:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc050543100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1870854458118656:12345-0@lo:13:osp-pre-1-1.0 Request processed in 160us (6427us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189166.647592:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1959 00000100:00100000:2.0:1784189166.647639:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc071534700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1870854458118656:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1784189166.647656:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc07faa9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1870854458118528:0@lo:13:osp-pre-0-1.0 00000100:00080000:1.0:1784189166.651561:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1784189167.152093:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf44bc1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1870854458118784:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1784189167.152157:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784189167.152531:0:26492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458118784 00000100:00100000:3.0:1784189167.152539:0:26492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458118784 00000100:00100000:3.0:1784189167.152646:0:26492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3794 00000100:00100000:3.0:1784189167.152653:0:26492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc050542680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3640:x1870854458118784:12345-0@lo:41:osp-pre-0-1.0 00000020:00080000:3.0:1784189167.152660:0:26492:0:(tgt_handler.c:807:tgt_request_handle()) operation 41 on unconnected OST from 12345-0@lo 00000100:00100000:3.0:1784189167.152708:0:26492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc050542680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3640:x1870854458118784:12345-0@lo:41:osp-pre-0-1.0 Request processed in 54us (550us total) trans 0 rc -107/-107 00000100:00100000:3.0:1784189167.152715:0:26492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3794 00000100:02020000:0.0:1784189167.152776:0:3640:0:(client.c:1492:ptlrpc_check_status()) lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 00000100:00080000:0.0:1784189167.152781:0:3640:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-osp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1784189167.152786:0:3640:0:(import.c:65:import_set_state_nolock()) ffff9dbf436c4000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:0.0:1784189167.152790:0:3640:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:0.0:1784189167.152795:0:3640:0:(import.c:65:import_set_state_nolock()) ffff9dbf436c4000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1784189167.152799:0:3640:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3373 00000100:00080000:0.0:1784189167.152805:0:3640:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9dbf436c4000 using connection 192.168.203.112@tcp/0@lo 00000100:00100000:0.0:1784189167.152828:0:3640:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9dbf469b5880 x1870854458118912/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1784189167.152871:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf469b5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3639:1870854458118912:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:0.0:1784189167.152897:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784189167.153056:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc071534000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:bd553d0d-03e2-4233-b06b-b55bbfa2b954:3641:1870854458119040:0@lo:400:kworker.0 00000400:00000100:1.0:1784189167.153079:0:3641:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1870854458119040 offset 0 length 224: 4 00000100:00100000:1.0:1784189167.153098:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc071536d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3641:1870854458119552:0@lo:400:kworker.0 00000100:00100000:1.0:1784189167.153123:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784189167.153140:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1784189167.153145:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc071534a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3641:1870854458119424:0@lo:400:kworker.0 00000100:00100000:1.0:1784189167.153165:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784189167.153182:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf43f58a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3641:1870854458119936:0@lo:400:kworker.0 00000100:00100000:1.0:1784189167.153217:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784189167.153243:0:66169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458119552 00000100:00100000:1.0:1784189167.153247:0:66169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458119552 00000100:00100000:1.0:1784189167.153286:0:66169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458119424 00000100:00100000:1.0:1784189167.153290:0:66169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458119424 00000100:00100000:1.0:1784189167.153302:0:66169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458119936 00000100:00100000:1.0:1784189167.153305:0:66169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458119936 00000100:00100000:1.0:1784189167.153315:0:66169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1173 00000100:00100000:1.0:1784189167.153340:0:66169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc07ab99f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1870854458119552:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784189167.153392:0:66169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc07ab99f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1870854458119552:12345-0@lo:400:kworker.0 Request processed in 53us (267us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189167.153398:0:66169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1173 00000100:00100000:1.0:1784189167.153414:0:66169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1236 00000100:00100000:1.0:1784189167.153418:0:66169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc07ab99500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3641:x1870854458119424:12345-0@lo:400:kworker.0 00000020:00080000:1.0:1784189167.153422:0:66169:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:1.0:1784189167.155301:0:66169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc07ab99500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3641:x1870854458119424:12345-0@lo:400:kworker.0 Request processed in 24us (277us total) trans 0 rc -107/-107 00000100:00100000:1.0:1784189167.155353:0:66169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1236 00000100:00100000:1.0:1784189167.155399:0:66169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1237 00000100:00100000:1.0:1784189167.155406:0:66169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc07ab98000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3641:x1870854458119936:12345-0@lo:400:kworker.0 00000020:00080000:1.0:1784189167.155413:0:66169:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:1.0:1784189167.155482:0:66169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc07ab98000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3641:x1870854458119936:12345-0@lo:400:kworker.0 Request processed in 75us (2264us total) trans 0 rc -107/-107 00000100:00100000:1.0:1784189167.155489:0:66169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1237 00000100:00100000:1.0:1784189167.155537:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc071534e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3642:1870854458119168:0@lo:400:kworker.0 00000100:00100000:1.0:1784189167.155573:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784189167.155607:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc071534700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1870854458119680:0@lo:400:kworker.0 00000100:00100000:1.0:1784189167.155632:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784189167.155664:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1784189167.155671:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc071535f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3642:1870854458119296:0@lo:400:kworker.0 00000100:00100000:1.0:1784189167.155692:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784189167.155708:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf43f58000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1870854458119808:0@lo:400:kworker.0 00000100:00100000:1.0:1784189167.155727:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784189167.155755:0:68287:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458119168 00000100:00100000:1.0:1784189167.155761:0:68287:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458119168 00000100:00100000:1.0:1784189167.155785:0:68287:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458119296 00000100:00100000:1.0:1784189167.155788:0:68287:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458119296 00000100:00100000:1.0:1784189167.155813:0:68287:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1174 00000100:00100000:1.0:1784189167.155820:0:68287:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc07ab98a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1870854458119296:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784189167.155862:0:68287:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc07ab98a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1870854458119296:12345-0@lo:400:kworker.0 Request processed in 42us (169us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189167.155869:0:68287:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1174 00000100:00100000:1.0:1784189167.155882:0:68287:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1238 00000100:00100000:1.0:1784189167.155894:0:68287:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc07ab99c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3642:x1870854458119168:12345-0@lo:400:kworker.0 00000020:00080000:1.0:1784189167.155900:0:68287:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:1.0:1784189167.155924:0:68287:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc07ab99c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3642:x1870854458119168:12345-0@lo:400:kworker.0 Request processed in 29us (351us total) trans 0 rc -107/-107 00000100:00100000:1.0:1784189167.155930:0:68287:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1238 00000100:00080000:1.0:1784189167.155949:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1784189167.155976:0:3641:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1784189167.155981:0:3641:0:(import.c:65:import_set_state_nolock()) ffff9dbf425f4800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:1.0:1784189167.155985:0:3641:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:1.0:1784189167.155989:0:3641:0:(import.c:65:import_set_state_nolock()) ffff9dbf425f4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1784189167.155993:0:3641:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3373 00000100:00080000:1.0:1784189167.155999:0:3641:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9dbf425f4800 using connection 192.168.203.112@tcp/0@lo 00000100:00100000:1.0:1784189167.156023:0:3641:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9dc07ab98380 x1870854458120064/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1784189167.156041:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc071534a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3641:1870854458119424:0@lo:400:kworker.0 00000100:00080000:1.0:1784189167.156054:0:3641:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1784189167.156057:0:3641:0:(import.c:65:import_set_state_nolock()) ffff9dbf43690800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:1.0:1784189167.156060:0:3641:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:1.0:1784189167.156063:0:3641:0:(import.c:65:import_set_state_nolock()) ffff9dbf43690800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1784189167.156066:0:3641:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3373 00000100:00080000:1.0:1784189167.156071:0:3641:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff9dbf43690800 using connection 192.168.203.112@tcp/0@lo 00000100:00100000:1.0:1784189167.156086:0:3641:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9dbf4262c700 x1870854458120192/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1784189167.156097:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf43f58a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3641:1870854458119936:0@lo:400:kworker.0 00000100:00100000:1.0:1784189167.156123:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc071536d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3641:1870854458119552:0@lo:400:kworker.0 00000100:00100000:1.0:1784189167.156158:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc071535f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3642:1870854458119296:0@lo:400:kworker.0 00000100:00080000:1.0:1784189167.156167:0:3642:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0000 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1784189167.156170:0:3642:0:(import.c:65:import_set_state_nolock()) ffff9dbf42271800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:1.0:1784189167.156173:0:3642:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:1.0:1784189167.156176:0:3642:0:(import.c:65:import_set_state_nolock()) ffff9dbf42271800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1784189167.156179:0:3642:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3373 00000100:00080000:1.0:1784189167.156183:0:3642:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9dbf42271800 using connection 192.168.203.112@tcp/0@lo 00000100:00100000:1.0:1784189167.156210:0:3642:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9dbf4262d180 x1870854458120320/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1784189167.156221:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc071534e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3642:1870854458119168:0@lo:400:kworker.0 00000100:00100000:1.0:1784189167.156273:0:26168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458119680 00000100:00100000:1.0:1784189167.156277:0:26168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458119680 00000100:00100000:1.0:1784189167.156305:0:26168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458119808 00000100:00100000:1.0:1784189167.156308:0:26168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458119808 00000100:00100000:1.0:1784189167.156352:0:26168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2438 00000100:00100000:1.0:1784189167.156359:0:26168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc07ab9ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0001-mdtlov_UUID+5:3642:x1870854458119680:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784189167.156404:0:26168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc07ab9ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0001-mdtlov_UUID+5:3642:x1870854458119680:12345-0@lo:400:kworker.0 Request processed in 45us (770us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189167.156413:0:26168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2438 00000100:00100000:1.0:1784189167.156427:0:26168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2439 00000100:00100000:1.0:1784189167.156434:0:26168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc07ab9a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0001-mdtlov_UUID+5:3642:x1870854458119808:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784189167.156640:0:26168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc07ab9a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0001-mdtlov_UUID+5:3642:x1870854458119808:12345-0@lo:400:kworker.0 Request processed in 205us (910us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189167.156659:0:26168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2439 00000100:00100000:1.0:1784189167.156691:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf43f58000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1870854458119808:0@lo:400:kworker.0 00000100:00100000:1.0:1784189167.156702:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc071534700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1870854458119680:0@lo:400:kworker.0 00000100:00100000:2.0:1784189167.164537:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458118912 00000100:00100000:2.0:1784189167.164552:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458118912 00000100:00100000:3.0:1784189167.164728:0:26492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3795 00000100:00100000:3.0:1784189167.164737:0:26492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf469b7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3639:x1870854458118912:12345-0@lo:38:ptlrpcd_00_00.0 00010000:00020000:3.0:1784189167.164761:0:26492:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1784189167.164838:0:26492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf469b7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3639:x1870854458118912:12345-0@lo:38:ptlrpcd_00_00.0 Request processed in 100us (11939us total) trans 0 rc -19/-19 00000100:00100000:3.0:1784189167.164845:0:26492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3795 00000100:00080000:0.0:1784189167.169532:0:3639:0:(import.c:65:import_set_state_nolock()) ffff9dbf436c4000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1784189167.169546:0:3639:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1784189167.169552:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf469b5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3639:1870854458118912:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:0.0:1784189167.169676:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc07ab98380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3639:1870854458120064:0@lo:38:ptlrpcd_00_01.0 00000100:00100000:0.0:1784189167.169734:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784189167.169816:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf4262c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3639:1870854458120192:0@lo:38:ptlrpcd_00_01.0 00000100:00100000:0.0:1784189167.169841:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784189167.173252:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf4262d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3639:1870854458120320:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:0.0:1784189167.173348:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784189167.177916:0:66945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458120064 00000100:00100000:1.0:1784189167.177931:0:66945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458120064 00000100:00100000:1.0:1784189167.178072:0:66945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458120192 00000100:00100000:1.0:1784189167.178076:0:66945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458120192 00000100:00100000:3.0:1784189167.178542:0:66171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1239 00000100:00100000:3.0:1784189167.178552:0:66171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf469b5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3639:x1870854458120064:12345-0@lo:38:ptlrpcd_00_01.0 00000100:00100000:0.0:1784189167.179017:0:66170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458120320 00000100:00100000:0.0:1784189167.179024:0:66170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458120320 00000100:00100000:0.0:1784189167.179052:0:66170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1240 00000100:00100000:0.0:1784189167.179058:0:66170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf469b5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3639:x1870854458120192:12345-0@lo:38:ptlrpcd_00_01.0 00010000:00020000:0.0:1784189167.179070:0:66170:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1784189167.179129:0:66170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf469b5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3639:x1870854458120192:12345-0@lo:38:ptlrpcd_00_01.0 Request processed in 69us (9287us total) trans 0 rc -19/-19 00000100:00100000:0.0:1784189167.179136:0:66170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1240 00000100:00100000:0.0:1784189167.179154:0:66170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1241 00000100:00100000:0.0:1784189167.179159:0:66170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf469b6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3639:x1870854458120320:12345-0@lo:38:ptlrpcd_00_02.0 00010000:00020000:0.0:1784189167.179168:0:66170:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1784189167.179205:0:66170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf469b6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3639:x1870854458120320:12345-0@lo:38:ptlrpcd_00_02.0 Request processed in 45us (5857us total) trans 0 rc -19/-19 00000100:00100000:0.0:1784189167.179211:0:66170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1241 00000100:00080000:0.0:1784189167.179256:0:3639:0:(import.c:65:import_set_state_nolock()) ffff9dbf42271800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1784189167.179267:0:3639:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1784189167.179271:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf4262d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3639:1870854458120320:0@lo:38:ptlrpcd_00_02.0 00000100:00080000:0.0:1784189167.179298:0:3639:0:(import.c:65:import_set_state_nolock()) ffff9dbf43690800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1784189167.179302:0:3639:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1784189167.179305:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf4262c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3639:1870854458120192:0@lo:38:ptlrpcd_00_01.0 00010000:00020000:3.0:1784189167.180565:0:66171:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1784189167.180658:0:66171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf469b5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3639:x1870854458120064:12345-0@lo:38:ptlrpcd_00_01.0 Request processed in 2102us (10919us total) trans 0 rc -19/-19 00000100:00100000:3.0:1784189167.180670:0:66171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1239 00000100:00080000:0.0:1784189167.180902:0:3639:0:(import.c:65:import_set_state_nolock()) ffff9dbf425f4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1784189167.180908:0:3639:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1784189167.180912:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc07ab98380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3639:1870854458120064:0@lo:38:ptlrpcd_00_01.0 00010000:00010000:2.0:1784189167.343569:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1784189167.666248:0:75588:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:3.0:1784189167.666262:0:75588:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 81604378734 is committed 00000020:00000080:3.0:1784189167.666266:0:75588:0:(genops.c:906:class_export_put()) final put ffff9dbf45128800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1784189167.668095:0:89010:0:(genops.c:865:class_export_destroy()) destroying export ffff9dbf45128800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001 00000020:00000080:1.0:1784189167.668874:0:89010:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9dbf4512c000 for lustre-MDT0001 00000100:00100000:0.0:1784189167.913062:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000400:00000100:0.0:1784189167.913102:0:3635:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-192.168.203.12@tcp portal 26 match 1870854436276096 offset 0 length 224: 4 00000100:00100000:0.0:1784189167.913122:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1784189167.913150:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1784189167.913183:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1784189167.913432:0:66171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436276224 00000100:00100000:2.0:1784189167.913442:0:66171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436276224 00000100:00100000:2.0:1784189167.913486:0:66171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436276352 00000100:00100000:2.0:1784189167.913503:0:66171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436276352 00000100:00100000:2.0:1784189167.913549:0:66171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1175 00000100:00100000:2.0:1784189167.913558:0:66171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf469b4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+6:2399:x1870854436276352:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:2.0:1784189167.913624:0:66171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf469b4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+6:2399:x1870854436276352:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 66us (472us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189167.913631:0:66171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1175 00000100:00100000:2.0:1784189167.913649:0:66171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1242 00000100:00100000:2.0:1784189167.913654:0:66171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf469b4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2395:x1870854436276224:12345-192.168.203.12@tcp:38:kworker.0 00010000:00020000:2.0:1784189167.913672:0:66171:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.203.12@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1784189167.913695:0:66171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf469b4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2395:x1870854436276224:12345-192.168.203.12@tcp:38:kworker.0 Request processed in 40us (642us total) trans 0 rc -19/-19 00000100:00100000:2.0:1784189167.913702:0:66171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1242 00000100:00100000:3.0:1784189167.913978:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436276480 00000100:00100000:3.0:1784189167.913983:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436276480 00000100:00100000:3.0:1784189167.914018:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436276608 00000100:00100000:3.0:1784189167.914022:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436276608 00000100:00100000:3.0:1784189167.914046:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 2440 00000100:00100000:3.0:1784189167.914052:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf469b5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+8:2399:x1870854436276480:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:3.0:1784189167.914090:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf469b5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+8:2399:x1870854436276480:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 37us (966us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189167.914096:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 2440 00000100:00100000:3.0:1784189167.914108:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 2441 00000100:00100000:3.0:1784189167.914114:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf469b7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+7:2399:x1870854436276608:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:3.0:1784189167.914135:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf469b7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+7:2399:x1870854436276608:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 21us (951us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189167.914141:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 2441 00000100:00080000:1.0:1784189167.914409:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1784189167.914414:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1784189167.914416:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:1.0:1784189168.367669:0:26173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784189169.391492:0:7454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1784189169.716705:0:8423:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294968952 is committed 00010000:00010000:2.0:1784189170.416875:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784189171.442062:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784189171.760656:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc07faa9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1870854458120448:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1784189171.763428:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784189171.763609:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf4262c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1870854458120576:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1784189171.763642:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784189171.763837:0:9466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458120448 00000100:00100000:2.0:1784189171.763843:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458120576 00000100:00100000:0.0:1784189171.763846:0:9466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458120448 00000100:00100000:2.0:1784189171.763849:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458120576 00000100:00100000:0.0:1784189171.763915:0:9466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1960 00000100:00100000:0.0:1784189171.763926:0:9466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf44bc3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1870854458120448:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1784189171.763953:0:9466:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 16014272 pending 0 free 3922481152 avail 3690958848 00000100:00100000:2.0:1784189171.764078:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1961 00000100:00100000:0.0:1784189171.764081:0:9466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf44bc3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1870854458120448:12345-0@lo:13:osp-pre-0-1.0 Request processed in 155us (659us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189171.764091:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf4262ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1870854458120576:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1784189171.764095:0:9466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1960 00002000:00000024:2.0:1784189171.764113:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8649664 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1784189171.764153:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf4262ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1870854458120576:12345-0@lo:13:osp-pre-1-1.0 Request processed in 66us (510us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189171.764171:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1961 00000100:00080000:1.0:1784189171.764313:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1784189171.764347:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1784189171.764383:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf4262c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1870854458120576:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1784189171.766129:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc07faa9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1870854458120448:0@lo:13:osp-pre-0-1.0 00000100:00080000:0.0:1784189172.271752:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1784189172.271759:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1784189172.271762:0:36:0:(import.c:65:import_set_state_nolock()) ffff9dbf42271800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1784189172.271771:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3409 00000100:00080000:0.0:1784189172.271782:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1784189172.271790:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9dbf42271800 using connection 192.168.203.112@tcp/0@lo 00000100:00100000:0.0:1784189172.271815:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9dc07ab98380 x1870854458120832/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1784189172.271858:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1784189172.271862:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1784189172.271864:0:36:0:(import.c:65:import_set_state_nolock()) ffff9dbf425f4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1784189172.271881:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3409 00000100:00100000:1.0:1784189172.271997:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1784189172.272016:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc07ab98380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3639:1870854458120832:0@lo:38:kworker.0 00000100:00100000:1.0:1784189172.272021:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf469b5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bd553d0d-03e2-4233-b06b-b55bbfa2b954:3642:1870854458120704:0@lo:400:kworker.0 00000400:00000100:1.0:1784189172.272093:0:3642:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1870854458120704 offset 0 length 224: 4 00000100:00100000:3.0:1784189172.272126:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784189172.272176:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc05edd0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3640:1870854458120960:0@lo:400:kworker.0 00000100:00100000:1.0:1784189172.272225:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784189172.272257:0:66170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458120832 00000100:00100000:3.0:1784189172.272269:0:66170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458120832 00000100:00100000:1.0:1784189172.272283:0:66171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458120960 00000100:00100000:1.0:1784189172.272292:0:66171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458120960 00000100:00100000:1.0:1784189172.272463:0:66171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1176 00000100:00100000:1.0:1784189172.272479:0:66171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf4262c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1870854458120960:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784189172.272530:0:66171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf4262c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1870854458120960:12345-0@lo:400:kworker.0 Request processed in 53us (306us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189172.272537:0:66171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1176 00000100:00100000:1.0:1784189172.272554:0:66171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1243 00000100:00100000:1.0:1784189172.272560:0:66171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf44bc0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3639:x1870854458120832:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1784189172.272579:0:66171:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1784189172.272610:0:66171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf44bc0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3639:x1870854458120832:12345-0@lo:38:kworker.0 Request processed in 49us (488us total) trans 0 rc -19/-19 00000100:00100000:1.0:1784189172.272616:0:66171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1243 00000100:00080000:1.0:1784189172.272633:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1784189172.272664:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc05edd0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3640:1870854458120960:0@lo:400:kworker.0 00000100:00080000:3.0:1784189172.272755:0:3639:0:(import.c:65:import_set_state_nolock()) ffff9dbf42271800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1784189172.272855:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1784189172.272862:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9dbf425f4800 using connection 192.168.203.112@tcp/0@lo 00000100:00080000:3.0:1784189172.272876:0:3639:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1784189172.272884:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc07ab98380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3639:1870854458120832:0@lo:38:kworker.0 00000100:00100000:0.0:1784189172.272970:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9dc05edd0380 x1870854458121088/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1784189172.273037:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc05edd0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3639:1870854458121088:0@lo:38:kworker.0 00000100:00100000:2.0:1784189172.273070:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc05edd3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3641:1870854458121216:0@lo:400:kworker.0 00000100:00100000:3.0:1784189172.273092:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784189172.273131:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784189172.273183:0:66171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458121088 00000100:00100000:3.0:1784189172.273190:0:66171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458121088 00000100:00080000:0.0:1784189172.273199:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1784189172.273205:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1784189172.273208:0:36:0:(import.c:65:import_set_state_nolock()) ffff9dbf436c4000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1784189172.273213:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3409 00000100:00100000:3.0:1784189172.273217:0:66171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458121216 00000100:00080000:0.0:1784189172.273218:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1784189172.273224:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9dbf436c4000 using connection 192.168.203.112@tcp/0@lo 00000100:00100000:3.0:1784189172.273236:0:66171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458121216 00000100:00100000:0.0:1784189172.273247:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9dc05edd2a00 x1870854458121344/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1784189172.273287:0:66171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1177 00000100:00080000:0.0:1784189172.273300:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00100000:3.0:1784189172.273302:0:66171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc07faab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1870854458121216:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1784189172.273310:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1784189172.273314:0:36:0:(import.c:65:import_set_state_nolock()) ffff9dbf43690800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1784189172.273366:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3409 00000100:00080000:0.0:1784189172.273369:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1784189172.273374:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff9dbf43690800 using connection 192.168.203.112@tcp/0@lo 00000100:00100000:0.0:1784189172.273389:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9dc05ed39c00 x1870854458121728/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1784189172.275916:0:66169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1244 00000100:00100000:1.0:1784189172.275930:0:66169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc07ab98380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3639:x1870854458121088:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1784189172.275956:0:66169:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1784189172.277554:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc05edd0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1870854458121600:0@lo:400:kworker.0 00000100:00080000:0.0:1784189172.280909:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1784189172.280947:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc05edd2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1870854458121472:0@lo:400:kworker.0 00000100:00100000:0.0:1784189172.281018:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784189172.281103:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc05edd2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3639:1870854458121344:0@lo:38:kworker.0 00000100:00100000:0.0:1784189172.281137:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784189172.281173:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc05ed39c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3639:1870854458121728:0@lo:38:kworker.0 00000100:00100000:0.0:1784189172.281663:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784189172.281706:0:66170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458121728 00000100:00100000:0.0:1784189172.281714:0:66170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458121728 00000100:00100000:0.0:1784189172.281750:0:66170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1245 00000100:00100000:0.0:1784189172.281757:0:66170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc04a64ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3639:x1870854458121728:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1784189172.281779:0:66170:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1784189172.281824:0:66170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc04a64ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3639:x1870854458121728:12345-0@lo:38:kworker.0 Request processed in 65us (160us total) trans 0 rc -19/-19 00000100:00100000:0.0:1784189172.281832:0:66170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1245 00000100:00100000:3.0:1784189172.281928:0:66171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc07faab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1870854458121216:12345-0@lo:400:kworker.0 Request processed in 8623us (8791us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189172.281944:0:66171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1177 00000100:00100000:3.0:1784189172.282029:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc05edd3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3641:1870854458121216:0@lo:400:kworker.0 00000100:00080000:0.0:1784189172.282065:0:3639:0:(import.c:65:import_set_state_nolock()) ffff9dbf43690800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1784189172.282072:0:3639:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1784189172.282077:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc05ed39c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3639:1870854458121728:0@lo:38:kworker.0 00000100:00100000:3.0:1784189172.282102:0:14684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458121472 00000100:00100000:3.0:1784189172.282111:0:14684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458121472 00000100:00100000:0.0:1784189172.282129:0:23826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458121344 00000100:00100000:0.0:1784189172.282136:0:23826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458121344 00000100:00100000:3.0:1784189172.282180:0:14684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2442 00000100:00100000:3.0:1784189172.282189:0:14684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc05ed38700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3642:x1870854458121472:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784189172.282275:0:14684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc05ed38700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3642:x1870854458121472:12345-0@lo:400:kworker.0 Request processed in 87us (1257us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189172.282282:0:14684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2442 00000100:00100000:3.0:1784189172.282341:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc05edd2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1870854458121472:0@lo:400:kworker.0 00000100:00100000:0.0:1784189172.282637:0:23826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3796 00000100:00100000:0.0:1784189172.282644:0:23826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc04a64fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3639:x1870854458121344:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1784189172.282660:0:23826:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1784189172.282714:0:23826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc04a64fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3639:x1870854458121344:12345-0@lo:38:kworker.0 Request processed in 69us (1576us total) trans 0 rc -19/-19 00000100:00100000:0.0:1784189172.282721:0:23826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3796 00000100:00080000:0.0:1784189172.282759:0:3639:0:(import.c:65:import_set_state_nolock()) ffff9dbf436c4000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1784189172.282764:0:3639:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1784189172.282767:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc05edd2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3639:1870854458121344:0@lo:38:kworker.0 00000100:00100000:1.0:1784189172.284126:0:66169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc07ab98380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3639:x1870854458121088:12345-0@lo:38:kworker.0 Request processed in 8188us (11029us total) trans 0 rc -19/-19 00000100:00100000:1.0:1784189172.284139:0:66169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1244 00000100:00100000:2.0:1784189172.286540:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1784189172.287537:0:3639:0:(import.c:65:import_set_state_nolock()) ffff9dbf425f4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1784189172.287546:0:3639:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1784189172.287551:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc05edd0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3639:1870854458121088:0@lo:38:kworker.0 00000100:00100000:3.0:1784189172.288446:0:26166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458121600 00000100:00100000:3.0:1784189172.288463:0:26166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458121600 00000100:00100000:3.0:1784189172.288620:0:26166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2443 00000100:00100000:3.0:1784189172.288643:0:26166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc07faab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+5:3643:x1870854458121600:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784189172.288879:0:26166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc07faab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+5:3643:x1870854458121600:12345-0@lo:400:kworker.0 Request processed in 248us (2345us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189172.288888:0:26166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2443 00000100:00100000:0.0:1784189172.289044:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc05edd0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1870854458121600:0@lo:400:kworker.0 00010000:00010000:1.0:1784189172.463606:0:26173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784189173.031104:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1784189173.031279:0:66171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436276864 00000100:00100000:3.0:1784189173.031293:0:66171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436276864 00000100:00100000:3.0:1784189173.031382:0:66171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1246 00000100:00100000:3.0:1784189173.031390:0:66171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc04a64ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2395:x1870854436276864:12345-192.168.203.12@tcp:38:kworker.0 00010000:00020000:3.0:1784189173.031429:0:66171:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.203.12@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1784189173.031505:0:66171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc04a64ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2395:x1870854436276864:12345-192.168.203.12@tcp:38:kworker.0 Request processed in 114us (415us total) trans 0 rc -19/-19 00000100:00100000:3.0:1784189173.031513:0:66171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1246 00000100:00100000:0.0:1784189173.031692:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1784189173.031806:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000400:00000100:2.0:1784189173.031847:0:3633:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-192.168.203.12@tcp portal 26 match 1870854436276736 offset 0 length 224: 4 00000100:00100000:2.0:1784189173.031875:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1784189173.031965:0:66170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436276992 00000100:00100000:1.0:1784189173.031974:0:66170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436276992 00000100:00100000:1.0:1784189173.032045:0:66170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1178 00000100:00100000:1.0:1784189173.032055:0:66170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc04a64f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+6:2398:x1870854436276992:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:1.0:1784189173.032131:0:66170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc04a64f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+6:2398:x1870854436276992:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 76us (437us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189173.032172:0:66170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1178 00000100:00080000:3.0:1784189173.032179:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1784189173.036502:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436277248 00000100:00100000:0.0:1784189173.036518:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436277248 00000100:00100000:0.0:1784189173.036685:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436277120 00000100:00100000:0.0:1784189173.036689:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436277120 00000100:00100000:1.0:1784189173.036771:0:26162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 2444 00000100:00100000:1.0:1784189173.036799:0:26162:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc07faa9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+7:2398:x1870854436277248:12345-192.168.203.12@tcp:400:kworker.0 00000100:00080000:3.0:1784189173.036827:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1784189173.036843:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1784189173.036981:0:26162:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc07faa9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+7:2398:x1870854436277248:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 194us (5176us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189173.036991:0:26162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 2444 00000100:00100000:0.0:1784189173.042855:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 2445 00000100:00100000:0.0:1784189173.042873:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc07faa8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+6:2398:x1870854436277120:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:0.0:1784189173.043137:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc07faa8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+6:2398:x1870854436277120:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 266us (11258us total) trans 0 rc 0/0 00000100:00100000:0.0:1784189173.043146:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 2445 00010000:00010000:0.0:1784189173.487569:0:7454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784189174.511883:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784189175.535628:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784189176.559916:0:26173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784189176.879575:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1784189176.879600:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc07faaa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1870854458121856:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1784189176.879668:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784189176.879742:0:9466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458121856 00000100:00100000:2.0:1784189176.879750:0:9466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458121856 00000100:00100000:2.0:1784189176.879807:0:9466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1962 00000100:00100000:2.0:1784189176.879815:0:9466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf4262c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1870854458121856:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1784189176.879839:0:9466:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 16014272 pending 0 free 3922481152 avail 3690958848 00000100:00100000:2.0:1784189176.879875:0:9466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf4262c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1870854458121856:12345-0@lo:13:osp-pre-0-1.0 Request processed in 62us (208us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189176.879882:0:9466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1962 00000100:00080000:1.0:1784189176.879925:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1784189176.879956:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc07faaa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1870854458121856:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1784189176.880402:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1784189176.880411:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf4262d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1870854458121984:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1784189176.880438:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784189176.880522:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458121984 00000100:00100000:1.0:1784189176.880526:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458121984 00000100:00100000:1.0:1784189176.880558:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1963 00000100:00100000:1.0:1784189176.880564:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf43f58000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1870854458121984:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1784189176.880580:0:8432:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8649664 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1784189176.880611:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf43f58000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1870854458121984:12345-0@lo:13:osp-pre-1-1.0 Request processed in 47us (172us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189176.880617:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1963 00000100:00080000:1.0:1784189176.880632:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1784189176.880652:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf4262d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1870854458121984:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1784189177.391585:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf43f58a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bd553d0d-03e2-4233-b06b-b55bbfa2b954:3642:1870854458122112:0@lo:400:kworker.0 00000400:00000100:3.0:1784189177.391640:0:3642:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1870854458122112 offset 0 length 224: 4 00000100:00080000:1.0:1784189177.391700:0:89010:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1784189177.391705:0:89010:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1784189177.391708:0:89010:0:(import.c:65:import_set_state_nolock()) ffff9dbf42271800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1784189177.391713:0:89010:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3414 00000100:00080000:1.0:1784189177.391717:0:89010:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1784189177.391723:0:89010:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9dbf42271800 using connection 192.168.203.112@tcp/0@lo 00000100:00100000:1.0:1784189177.391745:0:89010:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9dbf4262d180 x1870854458122240/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1784189177.391813:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc071534700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3643:1870854458122368:0@lo:400:kworker.0 00000100:00100000:0.0:1784189177.391849:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784189177.391901:0:66169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458122368 00000100:00100000:0.0:1784189177.391909:0:66169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458122368 00000100:00100000:0.0:1784189177.391960:0:66169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1179 00000100:00100000:0.0:1784189177.391968:0:66169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc05ed39c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1870854458122368:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784189177.392012:0:66169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc05ed39c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1870854458122368:12345-0@lo:400:kworker.0 Request processed in 45us (162us total) trans 0 rc 0/0 00000100:00100000:0.0:1784189177.392019:0:66169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1179 00000100:00080000:0.0:1784189177.392053:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1784189177.392084:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc071534700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3643:1870854458122368:0@lo:400:kworker.0 00000100:00100000:2.0:1784189177.392166:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf4262d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3639:1870854458122240:0@lo:38:kworker.0 00000100:00100000:2.0:1784189177.392195:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784189177.393184:0:66945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458122240 00000100:00100000:0.0:1784189177.393193:0:66945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458122240 00000100:00100000:0.0:1784189177.393232:0:66945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1247 00000100:00100000:0.0:1784189177.393238:0:66945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc07faa8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3639:x1870854458122240:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1784189177.393260:0:66945:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1784189177.393358:0:66945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc07faa8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3639:x1870854458122240:12345-0@lo:38:kworker.0 Request processed in 118us (1161us total) trans 0 rc -19/-19 00000100:00100000:0.0:1784189177.393365:0:66945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1247 00000100:00080000:0.0:1784189177.393401:0:3639:0:(import.c:65:import_set_state_nolock()) ffff9dbf42271800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1784189177.393405:0:3639:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1784189177.393409:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf4262d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3639:1870854458122240:0@lo:38:kworker.0 00000100:00080000:1.0:1784189177.400498:0:89010:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1784189177.400506:0:89010:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1784189177.400510:0:89010:0:(import.c:65:import_set_state_nolock()) ffff9dbf425f4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1784189177.400517:0:89010:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3414 00000100:00080000:1.0:1784189177.400523:0:89010:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1784189177.400531:0:89010:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9dbf425f4800 using connection 192.168.203.112@tcp/0@lo 00000100:00100000:1.0:1784189177.400570:0:89010:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9dc071534e00 x1870854458122496/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1784189177.400611:0:89010:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1784189177.400614:0:89010:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1784189177.400616:0:89010:0:(import.c:65:import_set_state_nolock()) ffff9dbf436c4000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1784189177.400619:0:89010:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3414 00000100:00080000:1.0:1784189177.400622:0:89010:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1784189177.400626:0:89010:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9dbf436c4000 using connection 192.168.203.112@tcp/0@lo 00000100:00100000:1.0:1784189177.400641:0:89010:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9dc071536d80 x1870854458122752/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1784189177.400675:0:89010:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1784189177.400678:0:89010:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1784189177.400679:0:89010:0:(import.c:65:import_set_state_nolock()) ffff9dbf43690800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1784189177.400682:0:89010:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3414 00000100:00080000:1.0:1784189177.400684:0:89010:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1784189177.400688:0:89010:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff9dbf43690800 using connection 192.168.203.112@tcp/0@lo 00000100:00100000:1.0:1784189177.400698:0:89010:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9dc071534a80 x1870854458122880/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1784189177.400842:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc071535f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3640:1870854458122624:0@lo:400:kworker.0 00000100:00100000:1.0:1784189177.400900:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784189177.400958:0:66170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458122624 00000100:00100000:1.0:1784189177.400964:0:66170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458122624 00000100:00100000:1.0:1784189177.401020:0:66170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1180 00000100:00100000:1.0:1784189177.401030:0:66170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc071534700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1870854458122624:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784189177.401078:0:66170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc071534700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1870854458122624:12345-0@lo:400:kworker.0 Request processed in 50us (178us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189177.401085:0:66170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1180 00000100:00080000:1.0:1784189177.401104:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1784189177.401114:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc071534e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3639:1870854458122496:0@lo:38:kworker.0 00000100:00100000:1.0:1784189177.401150:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784189177.401167:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc071536d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3639:1870854458122752:0@lo:38:kworker.0 00000100:00100000:1.0:1784189177.401245:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784189177.401263:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc071534a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3639:1870854458122880:0@lo:38:kworker.0 00000100:00100000:1.0:1784189177.401283:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784189177.401345:0:66171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458122496 00000100:00100000:1.0:1784189177.401349:0:66171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458122496 00000100:00100000:1.0:1784189177.401380:0:66171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458122880 00000100:00100000:1.0:1784189177.401384:0:66171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458122880 00000100:00100000:1.0:1784189177.401399:0:66171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1248 00000100:00100000:1.0:1784189177.401404:0:66171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc081f80a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3639:x1870854458122496:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1784189177.401421:0:66171:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1784189177.401451:0:66171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc081f80a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3639:x1870854458122496:12345-0@lo:38:kworker.0 Request processed in 46us (300us total) trans 0 rc -19/-19 00000100:00100000:1.0:1784189177.401457:0:66171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1248 00000100:00100000:1.0:1784189177.401468:0:66171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1249 00000100:00100000:1.0:1784189177.401472:0:66171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc081f81880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3639:x1870854458122880:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1784189177.401481:0:66171:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1784189177.401505:0:66171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc081f81880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3639:x1870854458122880:12345-0@lo:38:kworker.0 Request processed in 32us (222us total) trans 0 rc -19/-19 00000100:00100000:1.0:1784189177.401511:0:66171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1249 00000100:00100000:1.0:1784189177.401530:0:26492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458122752 00000100:00100000:1.0:1784189177.401533:0:26492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458122752 00000100:00100000:1.0:1784189177.401553:0:26492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3797 00000100:00100000:1.0:1784189177.401557:0:26492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc081f82300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3639:x1870854458122752:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1784189177.401567:0:26492:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1784189177.401590:0:26492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc081f82300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3639:x1870854458122752:12345-0@lo:38:kworker.0 Request processed in 31us (346us total) trans 0 rc -19/-19 00000100:00100000:1.0:1784189177.401596:0:26492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3797 00000100:00100000:1.0:1784189177.401630:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc071535f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3640:1870854458122624:0@lo:400:kworker.0 00000100:00080000:1.0:1784189177.401666:0:3639:0:(import.c:65:import_set_state_nolock()) ffff9dbf425f4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1784189177.401677:0:3639:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1784189177.401680:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc071534e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3639:1870854458122496:0@lo:38:kworker.0 00000100:00080000:1.0:1784189177.401691:0:3639:0:(import.c:65:import_set_state_nolock()) ffff9dbf436c4000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1784189177.401694:0:3639:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1784189177.401697:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc071536d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3639:1870854458122752:0@lo:38:kworker.0 00000100:00080000:1.0:1784189177.401705:0:3639:0:(import.c:65:import_set_state_nolock()) ffff9dbf43690800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1784189177.401707:0:3639:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1784189177.401710:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc071534a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3639:1870854458122880:0@lo:38:kworker.0 00010000:00010000:0.0:1784189177.587268:0:7454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000400:00000100:3.0:1784189178.155976:0:3634:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-192.168.203.12@tcp portal 26 match 1870854436277376 offset 0 length 224: 4 00000100:00100000:3.0:1784189178.156016:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1784189178.156042:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1784189178.156127:0:26170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436277760 00000100:00100000:3.0:1784189178.156135:0:26170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436277760 00000100:00100000:3.0:1784189178.156191:0:26170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 2446 00000100:00100000:3.0:1784189178.156212:0:26170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc05edd0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+6:2399:x1870854436277760:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:3.0:1784189178.156274:0:26170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc05edd0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+6:2399:x1870854436277760:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 75us (231us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189178.156281:0:26170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 2446 00000100:00100000:1.0:1784189178.161474:0:66171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436277632 00000100:00100000:1.0:1784189178.161490:0:66171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436277632 00000100:00100000:1.0:1784189178.161579:0:66171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1181 00000100:00100000:1.0:1784189178.161589:0:66171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc05edd0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+6:2398:x1870854436277632:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:1.0:1784189178.161667:0:66171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc05edd0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+6:2398:x1870854436277632:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 80us (5650us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189178.161676:0:66171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1181 00000100:00080000:1.0:1784189178.161697:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1784189178.161702:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1784189178.161744:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1784189178.161877:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1784189178.162100:0:66169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436277504 00000100:00100000:1.0:1784189178.162104:0:66169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436277504 00000100:00100000:1.0:1784189178.162156:0:66169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1250 00000100:00100000:1.0:1784189178.162161:0:66169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc071536d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2395:x1870854436277504:12345-192.168.203.12@tcp:38:kworker.0 00010000:00020000:1.0:1784189178.162181:0:66169:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.203.12@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1784189178.162236:0:66169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc071536d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2395:x1870854436277504:12345-192.168.203.12@tcp:38:kworker.0 Request processed in 73us (360us total) trans 0 rc -19/-19 00000100:00100000:1.0:1784189178.162248:0:66169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1250 00000100:00100000:1.0:1784189178.162298:0:26171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436277888 00000100:00100000:1.0:1784189178.162302:0:26171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436277888 00000100:00100000:1.0:1784189178.162350:0:26171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 2447 00000100:00100000:1.0:1784189178.162357:0:26171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc071534a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+7:2398:x1870854436277888:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:1.0:1784189178.162387:0:26171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc071534a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+7:2398:x1870854436277888:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 31us (642us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189178.162393:0:26171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 2447 00000100:00080000:1.0:1784189178.162549:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1784189178.607544:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000400:00000100:1.0:1784189179.185590:0:3634:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-192.168.203.12@tcp portal 26 match 1870854436278016 offset 0 length 520: 4 00000100:00100000:1.0:1784189179.185623:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1784189179.185649:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1784189179.185679:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1784189179.185701:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1784189179.185727:0:26167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436278528 00000100:00100000:1.0:1784189179.185736:0:26167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436278528 00000100:00100000:1.0:1784189179.185775:0:26167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436278400 00000100:00100000:1.0:1784189179.185786:0:26167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436278400 00000100:00100000:3.0:1784189179.185792:0:66171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436278144 00000100:00100000:1.0:1784189179.185808:0:26167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 2448 00000100:00100000:3.0:1784189179.185810:0:66171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436278144 00000100:00100000:1.0:1784189179.185818:0:26167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc080f6aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+7:2397:x1870854436278528:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:3.0:1784189179.185842:0:66171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436278272 00000100:00100000:3.0:1784189179.185847:0:66171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436278272 00000100:00100000:3.0:1784189179.185878:0:66171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1182 00000100:00100000:3.0:1784189179.185889:0:66171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc071535f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+6:2397:x1870854436278272:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:1.0:1784189179.185893:0:26167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc080f6aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+7:2397:x1870854436278528:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 75us (211us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189179.185902:0:26167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 2448 00000100:00100000:1.0:1784189179.185920:0:26167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 2449 00000100:00100000:1.0:1784189179.185928:0:26167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc080f6a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+6:2397:x1870854436278400:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:3.0:1784189179.185935:0:66171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc071535f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+6:2397:x1870854436278272:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 45us (280us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189179.185967:0:66171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1182 00000100:00100000:1.0:1784189179.185973:0:26167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc080f6a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+6:2397:x1870854436278400:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 44us (269us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189179.185981:0:26167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 2449 00000100:00100000:3.0:1784189179.185986:0:66171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1251 00000100:00100000:3.0:1784189179.185993:0:66171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc071534e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2395:x1870854436278144:12345-192.168.203.12@tcp:38:kworker.0 00010000:00020000:3.0:1784189179.186110:0:66171:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.203.12@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1784189179.186149:0:66171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc071534e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2395:x1870854436278144:12345-192.168.203.12@tcp:38:kworker.0 Request processed in 155us (525us total) trans 0 rc -19/-19 00000100:00100000:3.0:1784189179.186157:0:66171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1251 00010000:00010000:3.0:1784189179.633767:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784189180.655488:0:26173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784189181.679624:0:7454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784189182.003430:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc080f69500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1870854458123008:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1784189182.003529:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784189182.003760:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1784189182.003771:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf4262d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1870854458123136:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1784189182.003820:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784189182.004870:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458123008 00000100:00100000:1.0:1784189182.004880:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458123008 00000100:00100000:1.0:1784189182.004938:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458123136 00000100:00100000:1.0:1784189182.004941:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458123136 00000100:00100000:1.0:1784189182.004961:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1964 00000100:00100000:1.0:1784189182.004971:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc07016d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1870854458123008:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1784189182.004999:0:8432:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8649664 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1784189182.005055:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc07016d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1870854458123008:12345-0@lo:13:osp-pre-1-1.0 Request processed in 85us (1525us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189182.005062:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1964 00000100:00100000:1.0:1784189182.005078:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1965 00000100:00100000:1.0:1784189182.005099:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc07b5e3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1870854458123136:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1784189182.005115:0:8432:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 16014272 pending 0 free 3922481152 avail 3690958848 00000100:00100000:1.0:1784189182.005146:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc07b5e3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1870854458123136:12345-0@lo:13:osp-pre-0-1.0 Request processed in 62us (1326us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189182.005152:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1965 00000100:00100000:1.0:1784189182.005196:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf4262d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1870854458123136:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1784189182.005231:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc080f69500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1870854458123008:0@lo:13:osp-pre-1-1.0 00000100:00080000:0.0:1784189182.005439:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1784189182.005444:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1784189182.516197:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc07b5e0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:bd553d0d-03e2-4233-b06b-b55bbfa2b954:3643:1870854458123264:0@lo:400:kworker.0 00000400:00000100:1.0:1784189182.516259:0:3643:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1870854458123264 offset 0 length 224: 4 00000100:00080000:0.0:1784189182.516343:0:63468:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1784189182.516348:0:63468:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1784189182.516351:0:63468:0:(import.c:65:import_set_state_nolock()) ffff9dbf42271800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1784189182.516356:0:63468:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3419 00000100:00080000:0.0:1784189182.516361:0:63468:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 15s 00000100:00080000:0.0:1784189182.516368:0:63468:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9dbf42271800 using connection 192.168.203.112@tcp/0@lo 00000100:00100000:0.0:1784189182.516391:0:63468:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9dc07b5e0380 x1870854458123392/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1784189182.516443:0:63468:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1784189182.516446:0:63468:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1784189182.516448:0:63468:0:(import.c:65:import_set_state_nolock()) ffff9dbf425f4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1784189182.516452:0:63468:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3419 00000100:00080000:0.0:1784189182.516455:0:63468:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 15s 00000100:00080000:0.0:1784189182.516459:0:63468:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9dbf425f4800 using connection 192.168.203.112@tcp/0@lo 00000100:00100000:0.0:1784189182.516470:0:63468:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9dc07b5e3480 x1870854458123648/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1784189182.516483:0:63468:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1784189182.516486:0:63468:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1784189182.516488:0:63468:0:(import.c:65:import_set_state_nolock()) ffff9dbf436c4000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1784189182.516490:0:63468:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3419 00000100:00080000:0.0:1784189182.516492:0:63468:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 15s 00000100:00080000:0.0:1784189182.516496:0:63468:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9dbf436c4000 using connection 192.168.203.112@tcp/0@lo 00000100:00100000:0.0:1784189182.516510:0:63468:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9dbf44c89c00 x1870854458123904/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1784189182.516519:0:63468:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1784189182.516521:0:63468:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1784189182.516523:0:63468:0:(import.c:65:import_set_state_nolock()) ffff9dbf43690800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1784189182.516526:0:63468:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3419 00000100:00080000:0.0:1784189182.516528:0:63468:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 15s 00000100:00080000:0.0:1784189182.516531:0:63468:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff9dbf43690800 using connection 192.168.203.112@tcp/0@lo 00000100:00100000:0.0:1784189182.516540:0:63468:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9dc075aa2a00 x1870854458124032/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1784189182.516583:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc07b5e0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3639:1870854458123392:0@lo:38:kworker.0 00000100:00100000:3.0:1784189182.516626:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784189182.516657:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc07b5e3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3639:1870854458123648:0@lo:38:kworker.0 00000100:00100000:3.0:1784189182.516678:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784189182.516692:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf44c89c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3639:1870854458123904:0@lo:38:kworker.0 00000100:00100000:3.0:1784189182.516761:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784189182.516780:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc075aa2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3639:1870854458124032:0@lo:38:kworker.0 00000100:00100000:3.0:1784189182.516801:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784189182.516848:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458123904 00000100:00100000:3.0:1784189182.516855:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458123904 00000100:00100000:3.0:1784189182.516885:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3798 00000100:00100000:3.0:1784189182.516891:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc05edd3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3639:x1870854458123904:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1784189182.516909:0:8439:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1784189182.516946:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc05edd3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3639:x1870854458123904:12345-0@lo:38:kworker.0 Request processed in 53us (184us total) trans 0 rc -19/-19 00000100:00100000:3.0:1784189182.516959:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3798 00000100:00080000:3.0:1784189182.516996:0:3639:0:(import.c:65:import_set_state_nolock()) ffff9dbf436c4000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1784189182.517000:0:3639:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1784189182.517003:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf44c89c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3639:1870854458123904:0@lo:38:kworker.0 00000100:00100000:1.0:1784189182.517227:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc07b5e2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3641:1870854458123776:0@lo:400:kworker.0 00000100:00100000:1.0:1784189182.517256:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784189182.517285:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1784189182.517292:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc07b5e1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3641:1870854458123520:0@lo:400:kworker.0 00000100:00100000:1.0:1784189182.517313:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784189182.517360:0:66169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458123392 00000100:00100000:1.0:1784189182.517364:0:66169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458123392 00000100:00100000:1.0:1784189182.517380:0:66169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458123648 00000100:00100000:1.0:1784189182.517382:0:66169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458123648 00000100:00100000:1.0:1784189182.517389:0:66169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458124032 00000100:00100000:1.0:1784189182.517391:0:66169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458124032 00000100:00100000:1.0:1784189182.517398:0:66169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458123776 00000100:00100000:1.0:1784189182.517400:0:66169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458123776 00000100:00100000:1.0:1784189182.517431:0:66169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458123520 00000100:00100000:1.0:1784189182.517434:0:66169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458123520 00000100:00100000:1.0:1784189182.517449:0:66169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1183 00000100:00100000:1.0:1784189182.517455:0:66169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc07016fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1870854458123776:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784189182.517497:0:66169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc07016fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1870854458123776:12345-0@lo:400:kworker.0 Request processed in 40us (239us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189182.517503:0:66169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1183 00000100:00100000:1.0:1784189182.517516:0:66169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1184 00000100:00100000:1.0:1784189182.517522:0:66169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc07016c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1870854458123520:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784189182.517549:0:66169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc07016c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1870854458123520:12345-0@lo:400:kworker.0 Request processed in 27us (234us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189182.517555:0:66169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1184 00000100:00100000:1.0:1784189182.517567:0:66169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1252 00000100:00100000:1.0:1784189182.517571:0:66169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc05edd2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3639:x1870854458123392:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1784189182.517590:0:66169:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1784189182.517623:0:66169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc05edd2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3639:x1870854458123392:12345-0@lo:38:kworker.0 Request processed in 51us (998us total) trans 0 rc -19/-19 00000100:00100000:1.0:1784189182.517629:0:66169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1252 00000100:00100000:1.0:1784189182.517640:0:66169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1253 00000100:00100000:1.0:1784189182.517643:0:66169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc05edd2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3639:x1870854458123648:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1784189182.517651:0:66169:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1784189182.517670:0:66169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc05edd2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3639:x1870854458123648:12345-0@lo:38:kworker.0 Request processed in 25us (991us total) trans 0 rc -19/-19 00000100:00100000:1.0:1784189182.517675:0:66169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1253 00000100:00100000:1.0:1784189182.517683:0:66169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1254 00000100:00100000:1.0:1784189182.517686:0:66169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc0505be300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3639:x1870854458124032:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1784189182.517693:0:66169:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1784189182.517710:0:66169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc0505be300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3639:x1870854458124032:12345-0@lo:38:kworker.0 Request processed in 23us (908us total) trans 0 rc -19/-19 00000100:00100000:1.0:1784189182.517715:0:66169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1254 00000100:00080000:1.0:1784189182.517733:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1784189182.517761:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc07b5e1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3641:1870854458123520:0@lo:400:kworker.0 00000100:00100000:1.0:1784189182.517771:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc07b5e2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3641:1870854458123776:0@lo:400:kworker.0 00000100:00080000:1.0:1784189182.517795:0:3639:0:(import.c:65:import_set_state_nolock()) ffff9dbf42271800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1784189182.517799:0:3639:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1784189182.517802:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc07b5e0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3639:1870854458123392:0@lo:38:kworker.0 00000100:00080000:1.0:1784189182.517810:0:3639:0:(import.c:65:import_set_state_nolock()) ffff9dbf425f4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1784189182.517813:0:3639:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1784189182.517821:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc07b5e3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3639:1870854458123648:0@lo:38:kworker.0 00000100:00080000:1.0:1784189182.517833:0:3639:0:(import.c:65:import_set_state_nolock()) ffff9dbf43690800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1784189182.517836:0:3639:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1784189182.517839:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc075aa2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3639:1870854458124032:0@lo:38:kworker.0 00010000:00010000:3.0:1784189182.704155:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00000400:1.0:1784189183.537361:0:3641:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1784189167/real 1784189167] req@ffff9dc071534000 x1870854458119040/t0(0) o400->MGC192.168.203.112@tcp@0@lo:26/25 lens 224/224 e 0 to 1 dl 1784189183 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784189183.537396:0:3641:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ TIMEOUT-NORESEND: req@ffff9dc071534000 x1870854458119040/t0(0) o400->MGC192.168.203.112@tcp@0@lo:26/25 lens 224/224 e 0 to 1 dl 1784189183 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1784189183.537405:0:3641:0:(import.c:65:import_set_state_nolock()) ffff9dc07110c800 MGS: changing import state from FULL to DISCONN 00000100:02020000:1.0:1784189183.537409:0:3641:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.203.112@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00000100:00080000:1.0:1784189183.537412:0:3641:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.203.112@tcp not replayable, auto-deactivating 00000100:00080000:1.0:1784189183.537414:0:3641:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:1.0:1784189183.537419:0:3641:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9dc071534000 x1870854458119040/t0(0) o400->MGC192.168.203.112@tcp@0@lo:26/25 lens 224/224 e 0 to 1 dl 1784189183 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784189183.537427:0:3641:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9dbf469b5f80 x1870854458120704/t0(0) o400->MGC192.168.203.112@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1784189188 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784189183.537442:0:3641:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9dbf43f58a80 x1870854458122112/t0(0) o400->MGC192.168.203.112@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1784189193 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784189183.537450:0:3641:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9dc07b5e0a80 x1870854458123264/t0(0) o400->MGC192.168.203.112@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1784189198 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 10000000:01000000:1.0:1784189183.537461:0:3641:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:1.0:1784189183.537465:0:3641:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:1.0:1784189183.537467:0:3641:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:1.0:1784189183.537469:0:3641:0:(import.c:418:ptlrpc_pinger_force()) MGS: waking up pinger s:DISCONN 00000100:00100000:0.0:1784189183.538927:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf43f58a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bd553d0d-03e2-4233-b06b-b55bbfa2b954:3642:1870854458122112:0@lo:400:kworker.0 00000100:00100000:0.0:1784189183.538941:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf469b5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bd553d0d-03e2-4233-b06b-b55bbfa2b954:3642:1870854458120704:0@lo:400:kworker.0 00000100:00100000:0.0:1784189183.539009:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc07b5e0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:bd553d0d-03e2-4233-b06b-b55bbfa2b954:3643:1870854458123264:0@lo:400:kworker.0 00000100:00080000:2.0:1784189183.544448:0:89010:0:(pinger.c:229:ptlrpc_pinger_process_import()) bd553d0d-03e2-4233-b06b-b55bbfa2b954->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1784189183.544459:0:89010:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:2.0:1784189183.544463:0:89010:0:(import.c:65:import_set_state_nolock()) ffff9dc07110c800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1784189183.544471:0:89010:0:(import.c:510:import_select_connection()) MGC192.168.203.112@tcp: connect to NID 0@lo last attempt 3367 00000100:00080000:2.0:1784189183.544481:0:89010:0:(import.c:624:import_select_connection()) MGC192.168.203.112@tcp: import ffff9dc07110c800 using connection 192.168.203.112@tcp/0@lo 00000100:00100000:2.0:1784189183.544519:0:89010:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9dc07faa9f80 x1870854458124160/t0(0) o250->MGC192.168.203.112@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1784189183.544550:0:89010:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1784189183.544554:0:89010:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1784189183.544569:0:89010:0:(import.c:65:import_set_state_nolock()) ffff9dbf42271800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1784189183.544573:0:89010:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3424 00000100:00080000:2.0:1784189183.544576:0:89010:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1784189183.544580:0:89010:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9dbf42271800 using connection 192.168.203.112@tcp/0@lo 00000100:00100000:2.0:1784189183.544597:0:89010:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9dc07faaaa00 x1870854458124288/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1784189183.544638:0:89010:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1784189183.544641:0:89010:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1784189183.544643:0:89010:0:(import.c:65:import_set_state_nolock()) ffff9dbf425f4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1784189183.544646:0:89010:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3424 00000100:00080000:2.0:1784189183.544648:0:89010:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1784189183.544652:0:89010:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9dbf425f4800 using connection 192.168.203.112@tcp/0@lo 00000100:00100000:2.0:1784189183.544662:0:89010:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9dc07faabb80 x1870854458124544/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1784189183.544676:0:89010:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1784189183.544678:0:89010:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1784189183.544680:0:89010:0:(import.c:65:import_set_state_nolock()) ffff9dbf436c4000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1784189183.544683:0:89010:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3424 00000100:00080000:2.0:1784189183.544685:0:89010:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1784189183.544689:0:89010:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9dbf436c4000 using connection 192.168.203.112@tcp/0@lo 00000100:00100000:2.0:1784189183.544699:0:89010:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9dc07faaad80 x1870854458124800/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1784189183.544723:0:89010:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1784189183.544726:0:89010:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1784189183.544733:0:89010:0:(import.c:65:import_set_state_nolock()) ffff9dbf43690800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1784189183.544736:0:89010:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3424 00000100:00080000:2.0:1784189183.544738:0:89010:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1784189183.544741:0:89010:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff9dbf43690800 using connection 192.168.203.112@tcp/0@lo 00000100:00100000:2.0:1784189183.544751:0:89010:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9dc07faab480 x1870854458125184/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1784189183.544802:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc07faa9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:bd553d0d-03e2-4233-b06b-b55bbfa2b954:3639:1870854458124160:0@lo:250:kworker.0 00000400:00000100:3.0:1784189183.544850:0:3639:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1870854458124160 offset 0 length 520: 4 00000100:00100000:3.0:1784189183.544884:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc07faaaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3639:1870854458124288:0@lo:38:kworker.0 00000100:00100000:3.0:1784189183.544915:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784189183.544942:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc07faabb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3639:1870854458124544:0@lo:38:kworker.0 00000100:00100000:3.0:1784189183.544961:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784189183.544974:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc07faaad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3639:1870854458124800:0@lo:38:kworker.0 00000100:00100000:3.0:1784189183.544995:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784189183.545011:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc07faab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3639:1870854458125184:0@lo:38:kworker.0 00000100:00100000:3.0:1784189183.545034:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784189183.545688:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc07faaa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1870854458124928:0@lo:400:kworker.0 00000100:00100000:0.0:1784189183.545728:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784189183.545758:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1784189183.545765:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc07faa9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1870854458125056:0@lo:400:kworker.0 00000100:00100000:0.0:1784189183.545785:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784189183.545815:0:26164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458124928 00000100:00100000:0.0:1784189183.545821:0:26164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458124928 00000100:00100000:0.0:1784189183.545862:0:26164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458125056 00000100:00100000:0.0:1784189183.545865:0:26164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458125056 00000100:00100000:0.0:1784189183.545886:0:26164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2450 00000100:00100000:0.0:1784189183.545894:0:26164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc075aa1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0001-mdtlov_UUID+5:3640:x1870854458124928:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784189183.545946:0:26164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc075aa1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0001-mdtlov_UUID+5:3640:x1870854458124928:12345-0@lo:400:kworker.0 Request processed in 53us (217us total) trans 0 rc 0/0 00000100:00100000:0.0:1784189183.545954:0:26164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2450 00000100:00100000:0.0:1784189183.545969:0:26164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2451 00000100:00100000:0.0:1784189183.545975:0:26164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc075aa0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0001-mdtlov_UUID+5:3640:x1870854458125056:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784189183.546000:0:26164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc075aa0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0001-mdtlov_UUID+5:3640:x1870854458125056:12345-0@lo:400:kworker.0 Request processed in 25us (214us total) trans 0 rc 0/0 00000100:00100000:0.0:1784189183.546005:0:26164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2451 00000100:00100000:0.0:1784189183.546048:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc07faa9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1870854458125056:0@lo:400:kworker.0 00000100:00100000:0.0:1784189183.546058:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc07faaa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1870854458124928:0@lo:400:kworker.0 00000100:00100000:0.0:1784189183.546108:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc07faa9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3643:1870854458124672:0@lo:400:kworker.0 00000100:00100000:0.0:1784189183.546133:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784189183.546153:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1784189183.546160:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc07faa8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3643:1870854458124416:0@lo:400:kworker.0 00000100:00100000:0.0:1784189183.546179:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784189183.546201:0:66171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458124288 00000100:00100000:0.0:1784189183.546205:0:66171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458124288 00000100:00100000:0.0:1784189183.546220:0:66171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458124544 00000100:00100000:0.0:1784189183.546223:0:66171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458124544 00000100:00100000:0.0:1784189183.546230:0:66171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458125184 00000100:00100000:0.0:1784189183.546233:0:66171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458125184 00000100:00100000:0.0:1784189183.546240:0:66171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458124672 00000100:00100000:0.0:1784189183.546242:0:66171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458124672 00000100:00100000:0.0:1784189183.546256:0:66171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458124416 00000100:00100000:0.0:1784189183.546259:0:66171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458124416 00000100:00100000:0.0:1784189183.546452:0:66171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1185 00000100:00100000:0.0:1784189183.546458:0:66171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc075aa0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1870854458124672:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784189183.546496:0:66171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc075aa0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1870854458124672:12345-0@lo:400:kworker.0 Request processed in 37us (361us total) trans 0 rc 0/0 00000100:00100000:0.0:1784189183.546502:0:66171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1185 00000100:00100000:0.0:1784189183.546513:0:66171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1186 00000100:00100000:0.0:1784189183.546518:0:66171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc075aa2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1870854458124416:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784189183.546542:0:66171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc075aa2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1870854458124416:12345-0@lo:400:kworker.0 Request processed in 24us (362us total) trans 0 rc 0/0 00000100:00100000:0.0:1784189183.546547:0:66171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1186 00000100:00100000:0.0:1784189183.546558:0:66171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1255 00000100:00100000:0.0:1784189183.546561:0:66171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc0505bfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3639:x1870854458124288:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1784189183.546590:0:66171:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1784189183.546681:0:66171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc0505bfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3639:x1870854458124288:12345-0@lo:38:kworker.0 Request processed in 118us (1766us total) trans 0 rc -19/-19 00000100:00100000:0.0:1784189183.546688:0:66171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1255 00000100:00100000:0.0:1784189183.546699:0:66171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1256 00000100:00100000:0.0:1784189183.546703:0:66171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc0505bce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3639:x1870854458124544:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1784189183.546711:0:66171:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1784189183.546734:0:66171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc0505bce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3639:x1870854458124544:12345-0@lo:38:kworker.0 Request processed in 29us (1772us total) trans 0 rc -19/-19 00000100:00100000:0.0:1784189183.546738:0:66171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1256 00000100:00100000:0.0:1784189183.546748:0:66171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1257 00000100:00100000:0.0:1784189183.546751:0:66171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc05ed78380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3639:x1870854458125184:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1784189183.546760:0:66171:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1784189183.546782:0:66171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc05ed78380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3639:x1870854458125184:12345-0@lo:38:kworker.0 Request processed in 29us (1747us total) trans 0 rc -19/-19 00000100:00100000:0.0:1784189183.546787:0:66171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1257 00000100:00100000:0.0:1784189183.546824:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc07faa8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3643:1870854458124416:0@lo:400:kworker.0 00000100:00100000:0.0:1784189183.546833:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc07faa9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3643:1870854458124672:0@lo:400:kworker.0 00000100:00080000:0.0:1784189183.546860:0:3639:0:(import.c:65:import_set_state_nolock()) ffff9dbf42271800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1784189183.546864:0:3639:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1784189183.546868:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc07faaaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3639:1870854458124288:0@lo:38:kworker.0 00000100:00080000:0.0:1784189183.546876:0:3639:0:(import.c:65:import_set_state_nolock()) ffff9dbf425f4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1784189183.546879:0:3639:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1784189183.546900:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc07faabb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3639:1870854458124544:0@lo:38:kworker.0 00000100:00080000:0.0:1784189183.546915:0:3639:0:(import.c:65:import_set_state_nolock()) ffff9dbf43690800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1784189183.546918:0:3639:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1784189183.546920:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc07faab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3639:1870854458125184:0@lo:38:kworker.0 00000100:00100000:0.0:1784189183.546966:0:26492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458124800 00000100:00100000:0.0:1784189183.546970:0:26492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458124800 00000100:00100000:0.0:1784189183.546990:0:26492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3799 00000100:00100000:0.0:1784189183.546995:0:26492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf44c89c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3639:x1870854458124800:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1784189183.547005:0:26492:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1784189183.547035:0:26492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf44c89c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3639:x1870854458124800:12345-0@lo:38:kworker.0 Request processed in 39us (2038us total) trans 0 rc -19/-19 00000100:00100000:0.0:1784189183.547041:0:26492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3799 00000100:00080000:0.0:1784189183.547082:0:3639:0:(import.c:65:import_set_state_nolock()) ffff9dbf436c4000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1784189183.547087:0:3639:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1784189183.547089:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc07faaad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3639:1870854458124800:0@lo:38:kworker.0 00000100:00100000:1.0:1784189183.547295:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc071534000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:bd553d0d-03e2-4233-b06b-b55bbfa2b954:3641:1870854458119040:0@lo:400:kworker.0 00010000:00010000:3.0:1784189183.736798:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1784189184.277272:0:90948:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1784189184.277279:0:90948:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds1_flakey 00000020:01000004:2.0:1784189184.277280:0:90948:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:2.0:1784189184.277562:0:90948:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff9dbf43fc9000 00000020:01000004:2.0:1784189184.277577:0:90948:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0000, type=osd-ldiskfs, lsifl=200005, mountfl=0 00000020:01000004:2.0:1784189184.277591:0:90948:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-ldiskfs) 00000020:00000080:2.0:1784189184.277604:0:90948:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff9dbf449f3380) 00000020:00000080:2.0:1784189184.277620:0:90948:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-ldiskfs with refcount 2 00000100:00100000:1.0:1784189184.295992:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1784189184.296051:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1784189184.296102:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1784189184.296125:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1784189184.296205:0:66945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436278784 00000100:00100000:1.0:1784189184.296214:0:66945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436278784 00000100:00100000:1.0:1784189184.296269:0:66945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436278656 00000100:00100000:1.0:1784189184.296274:0:66945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436278656 00000100:00100000:1.0:1784189184.296298:0:66945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1187 00000100:00100000:1.0:1784189184.296308:0:66945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc071534000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+6:2398:x1870854436278784:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:1.0:1784189184.296397:0:66945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc071534000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+6:2398:x1870854436278784:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 90us (345us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189184.296405:0:66945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1187 00000100:00100000:1.0:1784189184.296426:0:66945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1258 00000100:00100000:1.0:1784189184.296430:0:66945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc07b5e3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2395:x1870854436278656:12345-192.168.203.12@tcp:38:kworker.0 00010000:00020000:1.0:1784189184.296449:0:66945:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.203.12@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1784189184.296475:0:66945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc07b5e3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2395:x1870854436278656:12345-192.168.203.12@tcp:38:kworker.0 Request processed in 43us (349us total) trans 0 rc -19/-19 00000100:00100000:1.0:1784189184.296480:0:66945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1258 00000100:00080000:1.0:1784189184.296497:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1784189184.297220:0:26160:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436278912 00000100:00100000:2.0:1784189184.297229:0:26160:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436278912 00000100:00100000:2.0:1784189184.297285:0:26160:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 2452 00000100:00100000:2.0:1784189184.297293:0:26160:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc07016dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+6:2398:x1870854436278912:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:2.0:1784189184.297356:0:26160:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc07016dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+6:2398:x1870854436278912:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 63us (1372us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189184.297362:0:26160:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 2452 00000100:00100000:2.0:1784189184.297374:0:26160:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436279040 00000100:00100000:2.0:1784189184.297377:0:26160:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436279040 00000100:00100000:2.0:1784189184.297400:0:26160:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 2453 00000100:00100000:2.0:1784189184.297406:0:26160:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc07b5e0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+7:2398:x1870854436279040:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:2.0:1784189184.297431:0:26160:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc07b5e0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+7:2398:x1870854436279040:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 25us (1329us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189184.297447:0:26160:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 2453 00000100:00080000:1.0:1784189184.297597:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1784189184.297601:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00100000:10000000:2.0:1784189184.385535:0:90948:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:2.0:1784189184.387199:0:90948:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:2.0:1784189184.391165:0:90948:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:2.0:1784189184.391785:0:90948:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/32) registered 00100000:10000000:2.0:1784189184.391992:0:90948:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:2.0:1784189184.392265:0:90948:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/32) registered 00100000:10000000:2.0:1784189184.392604:0:90948:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:2.0:1784189184.392961:0:90948:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/32) registered 00100000:10000000:2.0:1784189184.393522:0:90948:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/32) registered 00100000:10000000:2.0:1784189184.394031:0:90948:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:2.0:1784189184.394249:0:90948:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:2.0:1784189184.394588:0:90948:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/32) registered 00100000:10000000:2.0:1784189184.395062:0:90948:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:2.0:1784189184.399394:0:90948:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x9:0x0] (8/32) registered 00100000:10000000:3.0:1784189184.401849:0:90948:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2f:0x0] (24/16) registered 00100000:10000000:3.0:1784189184.402132:0:90948:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:3.0:1784189184.404047:0:90948:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:3.0:1784189184.404494:0:90948:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1e:0x0] (16/1) registered 00100000:10000000:3.0:1784189184.404926:0:90948:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:3.0:1784189184.405400:0:90948:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:3.0:1784189184.405760:0:90948:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:3.0:1784189184.406001:0:90948:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x32:0x0] (24/16) registered 00100000:10000000:3.0:1784189184.406768:0:90948:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x34:0x0] (24/16) registered 00100000:10000000:3.0:1784189184.407210:0:90948:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:3.0:1784189184.408394:0:90948:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:3.0:1784189184.409673:0:90948:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:3.0:1784189184.409907:0:90948:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:3.0:1784189184.410761:0:90948:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:3.0:1784189184.411388:0:90948:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x20:0x0] (16/1) registered 00100000:10000000:3.0:1784189184.411709:0:90948:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x22:0x0] (16/1) registered 00100000:10000000:3.0:1784189184.411954:0:90948:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:3.0:1784189184.412261:0:90948:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:3.0:1784189184.412556:0:90948:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:3.0:1784189184.412822:0:90948:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:3.0:1784189184.413005:0:90948:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:3.0:1784189184.413360:0:90948:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:3.0:1784189184.413729:0:90948:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1f:0x0] (16/1) registered 00100000:10000000:3.0:1784189184.413914:0:90948:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x21:0x0] (16/1) registered 00100000:10000000:3.0:1784189184.414109:0:90948:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x23:0x0] (16/1) registered 00100000:10000000:3.0:1784189184.414892:0:90948:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x33:0x0] (24/16) registered 00100000:10000000:3.0:1784189184.415136:0:90948:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:3.0:1784189184.415765:0:90948:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x31:0x0] (24/16) registered 00100000:10000000:3.0:1784189184.416015:0:90948:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:3.0:1784189184.416280:0:90948:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x30:0x0] (24/16) registered 00100000:10000000:3.0:1784189184.416631:0:90948:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:3.0:1784189184.416960:0:90948:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:3.0:1784189184.420218:0:90948:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2:0x0] (8/32) registered 00100000:10000000:3.0:1784189184.422306:0:90948:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/32) registered 00100000:10000000:2.0:1784189184.423011:0:90948:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/32) registered 00100000:10000000:2.0:1784189184.423221:0:90948:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/32) registered 00100000:10000000:2.0:1784189184.423776:0:90948:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/32) registered 00100000:10000000:2.0:1784189184.423947:0:90948:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/32) registered 00100000:10000000:2.0:1784189184.424341:0:90948:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/32) registered 00080000:01000000:2.0:1784189184.425212:0:90948:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0000: register osd-ldiskfs tunable parameters 00000020:00000080:2.0:1784189184.425477:0:90948:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:2.0:1784189184.425485:0:90948:0:(osd_handler.c:8929:osd_obd_connect()) connect #0 00000020:00000080:2.0:1784189184.425495:0:90948:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xcc1762b626f8b677 00000020:01000004:2.0:1784189184.425502:0:90948:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0000 on device /dev/mapper/mds1_flakey 00000020:01000000:2.0:1784189184.425514:0:90948:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:2.0:1784189184.425531:0:90948:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9dbf43fc9000 from MGS 00000020:01000004:2.0:1784189184.425535:0:90948:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:2.0:1784189184.425546:0:90948:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff9dbf449f0000) 00000020:00000080:2.0:1784189184.425558:0:90948:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mgs with refcount 2 00000020:01000004:2.0:1784189184.425633:0:90948:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9dbf43fc9000 from MGS, refs=2 00080000:01000000:2.0:1784189184.425637:0:90948:0:(osd_handler.c:8929:osd_obd_connect()) connect #1 00000020:00000080:2.0:1784189184.425642:0:90948:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xcc1762b626f8b685 00010000:00010000:2.0:1784189184.425759:0:90948:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-MGS-3 is initialized 00000040:01000000:2.0:1784189184.435587:0:90948:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 10000000:01000000:3.0:1784189184.444695:0:90952:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:2.0:1784189184.444770:0:90948:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:2.0:1784189184.444825:0:90948:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1784189184.445994:0:90948:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:2.0:1784189184.446438:0:90948:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1784189184.446650:0:90948:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:2.0:1784189184.446656:0:90948:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:2.0:1784189184.447430:0:90948:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:2.0:1784189184.447437:0:90948:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:2.0:1784189184.447762:0:90948:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:2.0:1784189184.447767:0:90948:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:2.0:1784189184.448285:0:90948:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:2.0:1784189184.448307:0:90948:0:(obd_mount.c:392:lustre_start_mgc()) New MGS with live MGC 00000020:01000004:2.0:1784189184.448309:0:90948:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.112@tcp:Set MGC reconnect 2 10000000:01000000:2.0:1784189184.448312:0:90948:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.112@tcp 2/d0:i1:r0:or0:CONNECTING 00000100:00080000:2.0:1784189184.448397:0:90948:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffff9dc07110c800 already not connected (conn 62, was 0): CONNECTING 00000100:00100000:2.0:1784189184.448403:0:90948:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 12s for inflight to error out 00010000:00010000:3.0:1784189184.751591:0:26173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784189185.776039:0:7454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784189186.800026:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784189187.120364:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc075aa3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1870854458125440:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1784189187.120438:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784189187.120484:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1784189187.120491:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc07b5e0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1870854458125312:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1784189187.120516:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784189187.120609:0:9466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458125440 00000100:00100000:0.0:1784189187.120618:0:9466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458125440 00000100:00100000:0.0:1784189187.120689:0:9466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458125312 00000100:00100000:0.0:1784189187.120692:0:9466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458125312 00000100:00100000:0.0:1784189187.120710:0:9466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1966 00000100:00100000:0.0:1784189187.120718:0:9466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc05ed7bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1870854458125440:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1784189187.120745:0:9466:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 16014272 pending 0 free 3922481152 avail 3690958848 00000100:00100000:0.0:1784189187.120788:0:9466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc05ed7bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1870854458125440:12345-0@lo:13:osp-pre-0-1.0 Request processed in 71us (350us total) trans 0 rc 0/0 00000100:00100000:0.0:1784189187.120795:0:9466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1966 00000100:00100000:0.0:1784189187.120812:0:9466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1967 00000100:00100000:0.0:1784189187.120831:0:9466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc05ed79880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1870854458125312:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1784189187.120846:0:9466:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8649664 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1784189187.120875:0:9466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc05ed79880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1870854458125312:12345-0@lo:13:osp-pre-1-1.0 Request processed in 44us (358us total) trans 0 rc 0/0 00000100:00100000:0.0:1784189187.120881:0:9466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1967 00000100:00080000:3.0:1784189187.121032:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1784189187.121036:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1784189187.121079:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc07b5e0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1870854458125312:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1784189187.121093:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc075aa3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1870854458125440:0@lo:13:osp-pre-0-1.0 00010000:00010000:3.0:1784189187.823689:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1784189188.655433:0:89010:0:(pinger.c:229:ptlrpc_pinger_process_import()) bd553d0d-03e2-4233-b06b-b55bbfa2b954->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1784189188.655442:0:89010:0:(pinger.c:247:ptlrpc_pinger_process_import()) bd553d0d-03e2-4233-b06b-b55bbfa2b954->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1784189188.655446:0:89010:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1784189188.655449:0:89010:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1784189188.655453:0:89010:0:(import.c:65:import_set_state_nolock()) ffff9dbf42271800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1784189188.655460:0:89010:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3425 00000100:00080000:2.0:1784189188.655465:0:89010:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1784189188.655490:0:89010:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9dbf42271800 using connection 192.168.203.112@tcp/0@lo 00000100:00100000:2.0:1784189188.655528:0:89010:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9dc07faa8700 x1870854458125568/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1784189188.655606:0:89010:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1784189188.655610:0:89010:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1784189188.655611:0:89010:0:(import.c:65:import_set_state_nolock()) ffff9dbf425f4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1784189188.655615:0:89010:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3425 00000100:00080000:2.0:1784189188.655617:0:89010:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1784189188.655621:0:89010:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9dbf425f4800 using connection 192.168.203.112@tcp/0@lo 00000100:00100000:2.0:1784189188.655632:0:89010:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9dc07faab480 x1870854458125824/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1784189188.655650:0:89010:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1784189188.655653:0:89010:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1784189188.655655:0:89010:0:(import.c:65:import_set_state_nolock()) ffff9dbf436c4000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1784189188.655658:0:89010:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3425 00000100:00080000:2.0:1784189188.655661:0:89010:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1784189188.655665:0:89010:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9dbf436c4000 using connection 192.168.203.112@tcp/0@lo 00000100:00100000:3.0:1784189188.655669:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc07faabb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3641:1870854458125952:0@lo:400:kworker.0 00000100:00100000:2.0:1784189188.655680:0:89010:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9dc07faaaa00 x1870854458126080/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1784189188.655680:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc07faaad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3640:1870854458125696:0@lo:400:kworker.0 00000100:00080000:2.0:1784189188.655739:0:89010:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1784189188.655743:0:89010:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1784189188.655745:0:89010:0:(import.c:65:import_set_state_nolock()) ffff9dbf43690800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1784189188.655748:0:89010:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3425 00000100:00080000:2.0:1784189188.655751:0:89010:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1784189188.655760:0:89010:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff9dbf43690800 using connection 192.168.203.112@tcp/0@lo 00000100:00100000:2.0:1784189188.655774:0:89010:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9dc07faaa300 x1870854458126464/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1784189188.655917:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc07faa9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1870854458126208:0@lo:400:kworker.0 00000100:00100000:1.0:1784189188.656107:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784189188.656192:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc07faa8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3639:1870854458125568:0@lo:38:kworker.0 00000100:00100000:0.0:1784189188.656229:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784189188.656251:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc07faab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3639:1870854458125824:0@lo:38:kworker.0 00000100:00100000:0.0:1784189188.656272:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784189188.657172:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc07faa8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1870854458126336:0@lo:400:kworker.0 00000100:00100000:3.0:1784189188.657211:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784189188.657253:0:26169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458126336 00000100:00100000:3.0:1784189188.657259:0:26169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458126336 00000100:00100000:3.0:1784189188.657301:0:26169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2454 00000100:00100000:3.0:1784189188.657310:0:26169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf4693e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:3643:x1870854458126336:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784189188.657380:0:26169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf4693e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:3643:x1870854458126336:12345-0@lo:400:kworker.0 Request processed in 70us (168us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189188.657387:0:26169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2454 00000100:00100000:3.0:1784189188.657426:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc07faa8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1870854458126336:0@lo:400:kworker.0 00000100:00100000:2.0:1784189188.659545:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784189188.659636:0:26163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458126208 00000100:00100000:2.0:1784189188.659644:0:26163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458126208 00000100:00100000:2.0:1784189188.659688:0:26163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2455 00000100:00100000:2.0:1784189188.659698:0:26163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc07faa9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:3642:x1870854458126208:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784189188.660469:0:26163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc07faa9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:3642:x1870854458126208:12345-0@lo:400:kworker.0 Request processed in 766us (924us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189188.660478:0:26163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2455 00000100:00100000:2.0:1784189188.660537:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc07faa9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1870854458126208:0@lo:400:kworker.0 00000100:00100000:1.0:1784189188.663029:0:68287:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458125696 00000100:00100000:1.0:1784189188.663052:0:68287:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458125696 00000100:00100000:1.0:1784189188.663131:0:68287:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458125568 00000100:00100000:1.0:1784189188.663147:0:68287:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458125568 00000100:00100000:1.0:1784189188.663167:0:68287:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458125824 00000100:00100000:1.0:1784189188.663171:0:68287:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458125824 00000100:00100000:1.0:1784189188.663184:0:68287:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1188 00000100:00100000:1.0:1784189188.663194:0:68287:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc07b5e2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1870854458125696:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784189188.663277:0:68287:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc07b5e2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1870854458125696:12345-0@lo:400:kworker.0 Request processed in 86us (7171us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189188.663285:0:68287:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1188 00000100:00100000:1.0:1784189188.663301:0:68287:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1259 00000100:00100000:1.0:1784189188.663306:0:68287:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc075aa2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3639:x1870854458125568:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1784189188.663343:0:68287:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1784189188.663374:0:68287:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc075aa2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3639:x1870854458125568:12345-0@lo:38:kworker.0 Request processed in 67us (7144us total) trans 0 rc -19/-19 00000100:00100000:1.0:1784189188.663381:0:68287:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1259 00000100:00100000:1.0:1784189188.663393:0:68287:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1260 00000100:00100000:1.0:1784189188.663397:0:68287:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc075aa3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3639:x1870854458125824:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1784189188.663407:0:68287:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1784189188.663431:0:68287:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc075aa3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3639:x1870854458125824:12345-0@lo:38:kworker.0 Request processed in 33us (7158us total) trans 0 rc -19/-19 00000100:00100000:1.0:1784189188.663437:0:68287:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1260 00000100:00100000:1.0:1784189188.663490:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc07faaad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3640:1870854458125696:0@lo:400:kworker.0 00000100:00080000:2.0:1784189188.665121:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1784189188.668500:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784189188.668709:0:68287:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458125952 00000100:00100000:1.0:1784189188.668717:0:68287:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458125952 00000100:00100000:1.0:1784189188.668846:0:68287:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1189 00000100:00100000:1.0:1784189188.668856:0:68287:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf4693df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1870854458125952:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1784189188.672532:0:3639:0:(import.c:65:import_set_state_nolock()) ffff9dbf425f4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1784189188.672544:0:3639:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1784189188.672548:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc07faab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3639:1870854458125824:0@lo:38:kworker.0 00000100:00100000:0.0:1784189188.672560:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc07faaaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3639:1870854458126080:0@lo:38:kworker.0 00000100:00100000:0.0:1784189188.672618:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784189188.672664:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458126080 00000100:00100000:0.0:1784189188.672670:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458126080 00000100:00100000:0.0:1784189188.672703:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3800 00000100:00100000:0.0:1784189188.672710:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc075aa2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3639:x1870854458126080:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1784189188.672729:0:8439:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1784189188.672778:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc075aa2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3639:x1870854458126080:12345-0@lo:38:kworker.0 Request processed in 67us (159us total) trans 0 rc -19/-19 00000100:00100000:0.0:1784189188.672785:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3800 00000100:00080000:0.0:1784189188.672876:0:3639:0:(import.c:65:import_set_state_nolock()) ffff9dbf436c4000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1784189188.672881:0:3639:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1784189188.672884:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc07faaaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3639:1870854458126080:0@lo:38:kworker.0 00000100:00100000:0.0:1784189188.672904:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc07faaa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3639:1870854458126464:0@lo:38:kworker.0 00000100:00100000:0.0:1784189188.672931:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1784189188.672971:0:3639:0:(import.c:65:import_set_state_nolock()) ffff9dbf42271800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1784189188.672975:0:3639:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1784189188.672978:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc07faa8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3639:1870854458125568:0@lo:38:kworker.0 00000100:00100000:0.0:1784189188.673011:0:66171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458126464 00000100:00100000:0.0:1784189188.673015:0:66171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458126464 00000100:00100000:0.0:1784189188.673047:0:66171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1261 00000100:00100000:0.0:1784189188.673051:0:66171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf469b5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3639:x1870854458126464:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1784189188.673062:0:66171:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1784189188.673090:0:66171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf469b5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3639:x1870854458126464:12345-0@lo:38:kworker.0 Request processed in 37us (158us total) trans 0 rc -19/-19 00000100:00100000:0.0:1784189188.673096:0:66171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1261 00000100:00080000:0.0:1784189188.673123:0:3639:0:(import.c:65:import_set_state_nolock()) ffff9dbf43690800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1784189188.673127:0:3639:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1784189188.673134:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc07faaa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3639:1870854458126464:0@lo:38:kworker.0 00000100:00100000:1.0:1784189188.673436:0:68287:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf4693df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1870854458125952:12345-0@lo:400:kworker.0 Request processed in 4579us (4941us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189188.673452:0:68287:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1189 00000100:00100000:0.0:1784189188.673544:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc07faabb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3641:1870854458125952:0@lo:400:kworker.0 00000100:00080000:2.0:1784189188.673758:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:3.0:1784189188.848818:0:26173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784189189.419853:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1784189189.419902:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1784189189.419936:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1784189189.419962:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1784189189.420002:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1784189189.420058:0:26168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436279552 00000100:00100000:2.0:1784189189.420071:0:26168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436279552 00000100:00100000:3.0:1784189189.420072:0:66945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436279296 00000100:00100000:3.0:1784189189.420087:0:66945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436279296 00000100:00100000:3.0:1784189189.420257:0:66945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436279424 00000100:00100000:3.0:1784189189.420262:0:66945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436279424 00000100:00100000:3.0:1784189189.420358:0:66945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1190 00000100:00100000:3.0:1784189189.420372:0:66945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc07faaa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+6:2399:x1870854436279424:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:3.0:1784189189.420472:0:66945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc07faaa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+6:2399:x1870854436279424:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 103us (508us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189189.420480:0:66945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1190 00000100:00100000:2.0:1784189189.420571:0:26168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436279680 00000100:00100000:2.0:1784189189.420578:0:26168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436279680 00000100:00100000:0.0:1784189189.421305:0:90954:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436279168 00000100:00100000:0.0:1784189189.421311:0:90954:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436279168 00000100:00100000:0.0:1784189189.421359:0:90954:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 0 00000100:00100000:0.0:1784189189.421368:0:90954:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc05f002c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:2395:x1870854436279168:12345-192.168.203.12@tcp:250:kworker.0 00010000:00080000:0.0:1784189189.421394:0:90954:0:(ldlm_lib.c:1445:target_handle_connect()) MGS: connection from 9957a2dc-fd88-4a91-bca3-e2b7f365ab0c@192.168.203.12@tcp t0 exp 0000000000000000 cur 3431 last 0 00000020:00000080:0.0:1784189189.421422:0:90954:0:(genops.c:1406:class_connect()) connect: client 9957a2dc-fd88-4a91-bca3-e2b7f365ab0c, cookie 0xcc1762b626f8b68c 00000100:00080000:0.0:1784189189.421569:0:90954:0:(import.c:65:import_set_state_nolock()) ffff9dc05ed23800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1784189189.421643:0:90954:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc05f002c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9957a2dc-fd88-4a91-bca3-e2b7f365ab0c+5:2395:x1870854436279168:12345-192.168.203.12@tcp:250:kworker.0 Request processed in 275us (1799us total) trans 0 rc 0/0 00000100:00100000:0.0:1784189189.421652:0:90954:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 0 00000100:00100000:0.0:1784189189.421694:0:66171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1262 00000100:00100000:0.0:1784189189.421700:0:66171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc07faabb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2395:x1870854436279296:12345-192.168.203.12@tcp:38:kworker.0 00010000:00020000:0.0:1784189189.421714:0:66171:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.203.12@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1784189189.421738:0:66171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc07faabb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2395:x1870854436279296:12345-192.168.203.12@tcp:38:kworker.0 Request processed in 37us (1802us total) trans 0 rc -19/-19 00000100:00100000:0.0:1784189189.421744:0:66171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1262 00000100:00100000:2.0:1784189189.424429:0:26168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 2456 00000100:00100000:2.0:1784189189.424558:0:26168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc07faa9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+6:2399:x1870854436279552:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:1.0:1784189189.425791:0:26171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 2457 00000100:00100000:1.0:1784189189.425809:0:26171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc07faa8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+7:2399:x1870854436279680:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:1.0:1784189189.425878:0:26171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc07faa8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+7:2399:x1870854436279680:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 77us (5875us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189189.425886:0:26171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 2457 00000100:00080000:1.0:1784189189.425968:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1784189189.425974:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1784189189.425977:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1784189189.431000:0:26168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc07faa9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+6:2399:x1870854436279552:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 6549us (11088us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189189.431037:0:26168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 2456 00010000:00010000:1.0:1784189189.871839:0:7454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784189190.896542:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784189191.274208:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1784189191.274391:0:90956:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436279808 00000100:00100000:0.0:1784189191.274405:0:90956:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436279808 00000100:00100000:0.0:1784189191.274499:0:90956:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1 00000100:00100000:0.0:1784189191.274515:0:90956:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf455e6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9957a2dc-fd88-4a91-bca3-e2b7f365ab0c+5:42415:x1870854436279808:12345-192.168.203.12@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784189191.274542:0:90956:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784189191.274581:0:90956:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dc05ec0ea00/0xcc1762b626f8b693 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xcbfc5de7fe6c3e64 expref: -99 pid: 90956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189191.274616:0:90956:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dc05ec0ea00/0xcc1762b626f8b693 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c3e64 expref: 6 pid: 90956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189191.274631:0:90956:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dc05ec0ea00/0xcc1762b626f8b693 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c3e64 expref: 6 pid: 90956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189191.274643:0:90956:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc05ec0ea00, rc 0) 00000100:00100000:0.0:1784189191.274718:0:90956:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf455e6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9957a2dc-fd88-4a91-bca3-e2b7f365ab0c+6:42415:x1870854436279808:12345-192.168.203.12@tcp:101:ll_cfg_requeue.0 Request processed in 208us (523us total) trans 0 rc 0/0 00000100:00100000:0.0:1784189191.274730:0:90956:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1 00000100:00100000:3.0:1784189191.278626:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1784189191.279141:0:90955:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436279936 00000100:00100000:0.0:1784189191.279159:0:90955:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436279936 00000100:00100000:0.0:1784189191.279245:0:90955:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 2 00000100:00100000:0.0:1784189191.279259:0:90955:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf455e6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9957a2dc-fd88-4a91-bca3-e2b7f365ab0c+6:42415:x1870854436279936:12345-192.168.203.12@tcp:256:ll_cfg_requeue.0 00000100:00100000:0.0:1784189191.279424:0:90955:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf455e6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9957a2dc-fd88-4a91-bca3-e2b7f365ab0c+6:42415:x1870854436279936:12345-192.168.203.12@tcp:256:ll_cfg_requeue.0 Request processed in 167us (806us total) trans 0 rc -2/-2 00000100:00100000:0.0:1784189191.279433:0:90955:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 2 00000100:00100000:3.0:1784189191.303263:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1784189191.308392:0:90956:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436280064 00000100:00100000:0.0:1784189191.308408:0:90956:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436280064 00000100:00100000:0.0:1784189191.308477:0:90956:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 3 00000100:00100000:0.0:1784189191.308487:0:90956:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf46d28050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9957a2dc-fd88-4a91-bca3-e2b7f365ab0c+6:42415:x1870854436280064:12345-192.168.203.12@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784189191.308502:0:90956:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784189191.308520:0:90956:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dc05ec0ee00/0xcc1762b626f8b69a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xcbfc5de7fe6c3e6b expref: -99 pid: 90956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189191.308545:0:90956:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dc05ec0ee00/0xcc1762b626f8b69a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c3e6b expref: 7 pid: 90956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189191.308556:0:90956:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dc05ec0ee00/0xcc1762b626f8b69a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c3e6b expref: 7 pid: 90956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189191.308565:0:90956:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc05ec0ee00, rc 0) 00000100:00100000:0.0:1784189191.308632:0:90956:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf46d28050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9957a2dc-fd88-4a91-bca3-e2b7f365ab0c+7:42415:x1870854436280064:12345-192.168.203.12@tcp:101:ll_cfg_requeue.0 Request processed in 146us (5380us total) trans 0 rc 0/0 00000100:00100000:0.0:1784189191.308639:0:90956:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 3 00000100:00100000:2.0:1784189191.315928:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1784189191.316057:0:90955:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436280192 00000100:00100000:0.0:1784189191.316067:0:90955:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436280192 00000100:00100000:0.0:1784189191.316157:0:90955:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 4 00000100:00100000:0.0:1784189191.316167:0:90955:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf46d2ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9957a2dc-fd88-4a91-bca3-e2b7f365ab0c+7:42415:x1870854436280192:12345-192.168.203.12@tcp:501:ll_cfg_requeue.0 10000000:01000000:3.0:1784189191.317070:0:90958:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:0.0:1784189191.317303:0:90955:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 112 20000000:01000000:3.0:1784189191.323674:0:90959:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:3.0:1784189191.323682:0:90959:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 1 20000000:01000000:3.0:1784189191.323685:0:90959:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:3.0:1784189191.323687:0:90959:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:3.0:1784189191.323912:0:90959:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 20000000:01000000:0.0:1784189191.324171:0:90955:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:0.0:1784189191.324254:0:90955:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf46d2ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9957a2dc-fd88-4a91-bca3-e2b7f365ab0c+8:42415:x1870854436280192:12345-192.168.203.12@tcp:501:ll_cfg_requeue.0 Request processed in 8084us (8330us total) trans 0 rc 0/0 00000100:00100000:0.0:1784189191.324266:0:90955:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 4 00000100:00100000:1.0:1784189191.326123:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1784189191.326295:0:90954:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436280320 00000100:00100000:3.0:1784189191.326305:0:90954:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436280320 00000100:00100000:3.0:1784189191.326383:0:90954:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 5 00000100:00100000:3.0:1784189191.326393:0:90954:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf458b9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9957a2dc-fd88-4a91-bca3-e2b7f365ab0c+8:42415:x1870854436280320:12345-192.168.203.12@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1784189191.326531:0:90954:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf458b9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9957a2dc-fd88-4a91-bca3-e2b7f365ab0c+8:42415:x1870854436280320:12345-192.168.203.12@tcp:503:ll_cfg_requeue.0 Request processed in 139us (426us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189191.326540:0:90954:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 5 00000100:00100000:3.0:1784189191.331029:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1784189191.331164:0:90955:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436280448 00000100:00100000:0.0:1784189191.331174:0:90955:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436280448 00000100:00100000:0.0:1784189191.331302:0:90955:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 6 00000100:00100000:0.0:1784189191.331312:0:90955:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf458bac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9957a2dc-fd88-4a91-bca3-e2b7f365ab0c+8:42415:x1870854436280448:12345-192.168.203.12@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784189191.331352:0:90955:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784189191.331371:0:90955:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dc05ec0f000/0xcc1762b626f8b6a1 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xcbfc5de7fe6c3e72 expref: -99 pid: 90955 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189191.331399:0:90955:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dc05ec0f000/0xcc1762b626f8b6a1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c3e72 expref: 9 pid: 90955 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189191.331410:0:90955:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dc05ec0f000/0xcc1762b626f8b6a1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c3e72 expref: 9 pid: 90955 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189191.331420:0:90955:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc05ec0f000, rc 0) 00000100:00100000:0.0:1784189191.331487:0:90955:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf458bac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9957a2dc-fd88-4a91-bca3-e2b7f365ab0c+9:42415:x1870854436280448:12345-192.168.203.12@tcp:101:ll_cfg_requeue.0 Request processed in 176us (480us total) trans 0 rc 0/0 00000100:00100000:0.0:1784189191.331493:0:90955:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 6 00000100:00100000:2.0:1784189191.335802:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1784189191.335858:0:90956:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436280576 00000100:00100000:0.0:1784189191.335868:0:90956:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436280576 00000100:00100000:0.0:1784189191.335934:0:90956:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 7 00000100:00100000:0.0:1784189191.335959:0:90956:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf458b8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9957a2dc-fd88-4a91-bca3-e2b7f365ab0c+9:42415:x1870854436280576:12345-192.168.203.12@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1784189191.336155:0:90956:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf458b8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9957a2dc-fd88-4a91-bca3-e2b7f365ab0c+9:42415:x1870854436280576:12345-192.168.203.12@tcp:501:ll_cfg_requeue.0 Request processed in 197us (360us total) trans 0 rc 0/0 00000100:00100000:0.0:1784189191.336163:0:90956:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 7 00000100:00100000:1.0:1784189191.340923:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1784189191.341001:0:90954:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436280704 00000100:00100000:3.0:1784189191.341020:0:90954:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436280704 00000100:00100000:3.0:1784189191.341082:0:90954:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 8 00000100:00100000:3.0:1784189191.341091:0:90954:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf458ba450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9957a2dc-fd88-4a91-bca3-e2b7f365ab0c+9:42415:x1870854436280704:12345-192.168.203.12@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1784189191.341262:0:90954:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf458ba450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9957a2dc-fd88-4a91-bca3-e2b7f365ab0c+9:42415:x1870854436280704:12345-192.168.203.12@tcp:503:ll_cfg_requeue.0 Request processed in 170us (347us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189191.341270:0:90954:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 8 00000100:00100000:0.0:1784189191.350807:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1784189191.352509:0:90955:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436280832 00000100:00100000:2.0:1784189191.352522:0:90955:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436280832 00000100:00100000:2.0:1784189191.352820:0:90955:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 9 00000100:00100000:2.0:1784189191.352837:0:90955:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf458ba850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9957a2dc-fd88-4a91-bca3-e2b7f365ab0c+9:42415:x1870854436280832:12345-192.168.203.12@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1784189191.352856:0:90955:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784189191.352877:0:90955:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dc04a20aa00/0xcc1762b626f8b6a8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xcbfc5de7fe6c3e79 expref: -99 pid: 90955 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189191.352902:0:90955:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dc04a20aa00/0xcc1762b626f8b6a8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c3e79 expref: 10 pid: 90955 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189191.352911:0:90955:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dc04a20aa00/0xcc1762b626f8b6a8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c3e79 expref: 10 pid: 90955 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189191.352920:0:90955:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc04a20aa00, rc 0) 00000100:00100000:2.0:1784189191.352983:0:90955:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf458ba850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9957a2dc-fd88-4a91-bca3-e2b7f365ab0c+10:42415:x1870854436280832:12345-192.168.203.12@tcp:101:ll_cfg_requeue.0 Request processed in 150us (2184us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189191.352990:0:90955:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 9 00000100:00100000:2.0:1784189191.371896:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1784189191.373074:0:90956:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436280960 00000100:00100000:0.0:1784189191.373086:0:90956:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436280960 00000100:00100000:0.0:1784189191.373150:0:90956:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 10 00000100:00100000:0.0:1784189191.373159:0:90956:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf46be7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9957a2dc-fd88-4a91-bca3-e2b7f365ab0c+10:42415:x1870854436280960:12345-192.168.203.12@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1784189191.373460:0:90956:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf46be7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9957a2dc-fd88-4a91-bca3-e2b7f365ab0c+10:42415:x1870854436280960:12345-192.168.203.12@tcp:501:ll_cfg_requeue.0 Request processed in 234us (1504us total) trans 0 rc -2/-2 00000100:00100000:0.0:1784189191.373469:0:90956:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 10 00010000:00010000:3.0:1784189191.919842:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784189192.240126:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1784189192.240154:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc07b5e1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1870854458126592:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1784189192.240223:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784189192.240456:0:9466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458126592 00000100:00100000:1.0:1784189192.240464:0:9466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458126592 00000100:00100000:1.0:1784189192.240525:0:9466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1968 00000100:00100000:1.0:1784189192.240534:0:9466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf4693d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1870854458126592:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1784189192.240562:0:9466:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8649664 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1784189192.240607:0:9466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf4693d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1870854458126592:12345-0@lo:13:osp-pre-1-1.0 Request processed in 74us (383us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189192.240615:0:9466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1968 00000100:00080000:3.0:1784189192.240722:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1784189192.240770:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc07b5e1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1870854458126592:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1784189192.241191:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1784189192.241203:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf43f58a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1870854458126720:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1784189192.241242:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784189192.241353:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458126720 00000100:00100000:1.0:1784189192.241359:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458126720 00000100:00100000:1.0:1784189192.241407:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1969 00000100:00100000:1.0:1784189192.241414:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc07faaaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1870854458126720:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1784189192.241432:0:8432:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 16014272 pending 0 free 3922481152 avail 3690958848 00000100:00080000:0.0:1784189192.241510:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1784189192.241602:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc07faaaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1870854458126720:12345-0@lo:13:osp-pre-0-1.0 Request processed in 188us (359us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189192.241621:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1969 00000100:00100000:2.0:1784189192.241693:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf43f58a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1870854458126720:0@lo:13:osp-pre-0-1.0 00010000:00010000:3.0:1784189192.944277:0:26173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784189193.775428:0:3639:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1784189183/real 1784189183] req@ffff9dc07faa9f80 x1870854458124160/t0(0) o250->MGC192.168.203.112@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1784189193 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784189193.775641:0:3639:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9dc07faa9f80 x1870854458124160/t0(0) o250->MGC192.168.203.112@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1784189193 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1784189193.775661:0:3639:0:(import.c:65:import_set_state_nolock()) ffff9dc07110c800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1784189193.775670:0:3639:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:1.0:1784189193.775686:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc07faa9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:bd553d0d-03e2-4233-b06b-b55bbfa2b954:3639:1870854458124160:0@lo:250:kworker.0 10000000:01000000:2.0:1784189193.775783:0:90948:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00010000:00010000:2.0:1784189193.775891:0:90948:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.112@tcp lock: ffff9dc05ec0ce00/0xcc1762b626f8b26b lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0xcc1762b626f8b272 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1784189193.775902:0:90948:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.112@tcp lock: ffff9dc05ec0ce00/0xcc1762b626f8b26b lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0xcc1762b626f8b272 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784189193.775909:0:90948:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:2.0:1784189193.775931:0:90948:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1784189193.775940:0:90948:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.112@tcp lock: ffff9dc05ec0ce00/0xcc1762b626f8b26b lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0xcc1762b626f8b272 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189193.775958:0:90948:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.112@tcp lock: ffff9dbf4369d800/0xcc1762b626f8b1bc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x110e400000000 nid: local remote: 0xcc1762b626f8b1c3 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1784189193.775965:0:90948:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.112@tcp lock: ffff9dbf4369d800/0xcc1762b626f8b1bc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x110f400000000 nid: local remote: 0xcc1762b626f8b1c3 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784189193.775971:0:90948:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1784189193.775975:0:90948:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1784189193.775980:0:90948:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.112@tcp lock: ffff9dbf4369d800/0xcc1762b626f8b1bc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x590f400000000 nid: local remote: 0xcc1762b626f8b1c3 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189193.775990:0:90948:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.112@tcp lock: ffff9dc05ec0de00/0xcc1762b626f8b1d8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x110e400000000 nid: local remote: 0xcc1762b626f8b1df expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1784189193.776006:0:90948:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.112@tcp lock: ffff9dc05ec0de00/0xcc1762b626f8b1d8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x110f400000000 nid: local remote: 0xcc1762b626f8b1df expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784189193.776011:0:90948:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00080000:0.0:1784189193.776101:0:63468:0:(pinger.c:229:ptlrpc_pinger_process_import()) bd553d0d-03e2-4233-b06b-b55bbfa2b954->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1784189193.776107:0:63468:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1784189193.776109:0:63468:0:(import.c:65:import_set_state_nolock()) ffff9dc07110c800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1784189193.776114:0:63468:0:(import.c:510:import_select_connection()) MGC192.168.203.112@tcp: connect to NID 0@lo last attempt 3425 00000100:00080000:0.0:1784189193.776119:0:63468:0:(import.c:589:import_select_connection()) MGC192.168.203.112@tcp: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1784189193.776124:0:63468:0:(import.c:624:import_select_connection()) MGC192.168.203.112@tcp: import ffff9dc07110c800 using connection 192.168.203.112@tcp/0@lo 00000100:00100000:0.0:1784189193.776151:0:63468:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9dbf43f58a80 x1870854458126848/t0(0) o250->MGC192.168.203.112@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1784189193.776179:0:63468:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1784189193.776183:0:63468:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1784189193.776184:0:63468:0:(import.c:65:import_set_state_nolock()) ffff9dbf42271800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1784189193.776188:0:63468:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3430 00000100:00080000:0.0:1784189193.776229:0:63468:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1784189193.776234:0:63468:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9dbf42271800 using connection 192.168.203.112@tcp/0@lo 00000100:00020000:1.0:1784189193.776277:0:3639:0:(client.c:1391:ptlrpc_import_delay_req()) @@@ invalidate in flight req@ffff9dbf43f58a80 x1870854458126848/t0(0) o250->MGC192.168.203.112@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl Rpc:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00010000:00010000:2.0:1784189193.776278:0:90948:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1784189193.776292:0:90948:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.112@tcp lock: ffff9dc05ec0de00/0xcc1762b626f8b1d8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x590f400000000 nid: local remote: 0xcc1762b626f8b1df expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189193.776305:0:90948:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.112@tcp lock: ffff9dc05ec0c200/0xcc1762b626f8b209 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x110e400000000 nid: local remote: 0xcc1762b626f8b217 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1784189193.776311:0:90948:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.112@tcp lock: ffff9dc05ec0c200/0xcc1762b626f8b209 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x110f400000000 nid: local remote: 0xcc1762b626f8b217 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784189193.776316:0:90948:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1784189193.776361:0:90948:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1784189193.776365:0:90948:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.112@tcp lock: ffff9dc05ec0c200/0xcc1762b626f8b209 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x590f400000000 nid: local remote: 0xcc1762b626f8b217 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189193.776374:0:90948:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.112@tcp lock: ffff9dbf4369c200/0xcc1762b626f8b21e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x110e400000000 nid: local remote: 0xcc1762b626f8b225 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1784189193.776379:0:90948:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.112@tcp lock: ffff9dbf4369c200/0xcc1762b626f8b21e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x110f400000000 nid: local remote: 0xcc1762b626f8b225 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784189193.776385:0:90948:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1784189193.776388:0:90948:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1784189193.776391:0:90948:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.112@tcp lock: ffff9dbf4369c200/0xcc1762b626f8b21e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x590f400000000 nid: local remote: 0xcc1762b626f8b225 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189193.776398:0:90948:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.112@tcp lock: ffff9dc0565e7400/0xcc1762b626f8b23a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x110e400000000 nid: local remote: 0xcc1762b626f8b241 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1784189193.776404:0:90948:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.112@tcp lock: ffff9dc0565e7400/0xcc1762b626f8b23a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x110f400000000 nid: local remote: 0xcc1762b626f8b241 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784189193.776419:0:90948:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1784189193.776422:0:90948:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1784189193.776426:0:90948:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.112@tcp lock: ffff9dc0565e7400/0xcc1762b626f8b23a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x590f400000000 nid: local remote: 0xcc1762b626f8b241 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189193.776434:0:90948:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.112@tcp lock: ffff9dc0755a4800/0xcc1762b626f8b24f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x110e400000000 nid: local remote: 0xcc1762b626f8b256 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1784189193.776439:0:90948:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.112@tcp lock: ffff9dc0755a4800/0xcc1762b626f8b24f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x110f400000000 nid: local remote: 0xcc1762b626f8b256 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784189193.776444:0:90948:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1784189193.776446:0:90948:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1784189193.776449:0:90948:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.112@tcp lock: ffff9dc0755a4800/0xcc1762b626f8b24f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x590f400000000 nid: local remote: 0xcc1762b626f8b256 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189193.776460:0:90948:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.112@tcp lock: ffff9dbf4369d600/0xcc1762b626f8b279 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0xcc1762b626f8b280 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1784189193.776465:0:90948:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.112@tcp lock: ffff9dbf4369d600/0xcc1762b626f8b279 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0xcc1762b626f8b280 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784189193.776470:0:90948:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:0.0:1784189193.776697:0:63468:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9dc05ed91f80 x1870854458126976/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1784189193.776728:0:63468:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1784189193.776731:0:63468:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1784189193.776734:0:63468:0:(import.c:65:import_set_state_nolock()) ffff9dbf425f4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1784189193.776737:0:63468:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3430 00000100:00080000:0.0:1784189193.776739:0:63468:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1784189193.776743:0:63468:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9dbf425f4800 using connection 192.168.203.112@tcp/0@lo 00000100:00100000:0.0:1784189193.776758:0:63468:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9dbf46903480 x1870854458127232/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1784189193.776774:0:63468:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1784189193.776777:0:63468:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1784189193.776778:0:63468:0:(import.c:65:import_set_state_nolock()) ffff9dbf436c4000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1784189193.776782:0:63468:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3430 00000100:00080000:0.0:1784189193.776784:0:63468:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1784189193.776788:0:63468:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9dbf436c4000 using connection 192.168.203.112@tcp/0@lo 00000100:00100000:0.0:1784189193.776798:0:63468:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9dbf46900000 x1870854458127488/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1784189193.776830:0:63468:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1784189193.776838:0:63468:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1784189193.776841:0:63468:0:(import.c:65:import_set_state_nolock()) ffff9dbf43690800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1784189193.776845:0:63468:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3430 00010000:00010000:2.0:1784189193.776852:0:90948:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00000100:00080000:0.0:1784189193.776855:0:63468:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s 00010000:00010000:2.0:1784189193.776859:0:90948:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.112@tcp lock: ffff9dbf4369d600/0xcc1762b626f8b279 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0xcc1762b626f8b280 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1784189193.776862:0:63468:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff9dbf43690800 using connection 192.168.203.112@tcp/0@lo 00000100:00100000:0.0:1784189193.776880:0:63468:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9dc06b98fb80 x1870854458127872/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00010000:00010000:2.0:1784189193.776882:0:90948:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.112@tcp lock: ffff9dc05ec0cc00/0xcc1762b626f8b1ca lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0xcc1762b626f8b1d1 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1784189193.776913:0:90948:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.112@tcp lock: ffff9dc05ec0cc00/0xcc1762b626f8b1ca lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0xcc1762b626f8b1d1 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784189193.776918:0:90948:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1784189193.776922:0:90948:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1784189193.776927:0:90948:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.112@tcp lock: ffff9dc05ec0cc00/0xcc1762b626f8b1ca lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0xcc1762b626f8b1d1 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784189193.776943:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf46902680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1870854458127616:0@lo:400:kworker.0 00010000:00010000:2.0:1784189193.776944:0:90948:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.112@tcp lock: ffff9dbf4369c400/0xcc1762b626f8b1ed lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0xcc1762b626f8b1f4 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1784189193.776954:0:90948:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.112@tcp lock: ffff9dbf4369c400/0xcc1762b626f8b1ed lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0xcc1762b626f8b1f4 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784189193.776959:0:90948:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 00010000:00010000:2.0:1784189193.776963:0:90948:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1784189193.776966:0:90948:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.112@tcp lock: ffff9dbf4369c400/0xcc1762b626f8b1ed lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0xcc1762b626f8b1f4 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189193.776977:0:90948:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.112@tcp lock: ffff9dc0565e7c00/0xcc1762b626f8b1fb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x110e400000000 nid: local remote: 0xcc1762b626f8b202 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1784189193.776983:0:90948:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.112@tcp lock: ffff9dc0565e7c00/0xcc1762b626f8b1fb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x110f400000000 nid: local remote: 0xcc1762b626f8b202 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784189193.776989:0:90948:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1784189193.776992:0:90948:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1784189193.777005:0:90948:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.112@tcp lock: ffff9dc0565e7c00/0xcc1762b626f8b1fb lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x590f400000000 nid: local remote: 0xcc1762b626f8b202 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784189193.777067:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784189193.777104:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1784189193.777110:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc06b98f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1870854458127744:0@lo:400:kworker.0 00000100:00100000:0.0:1784189193.777133:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784189193.777164:0:9982:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458127616 00000100:00100000:0.0:1784189193.777171:0:9982:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458127616 00000100:00100000:0.0:1784189193.777207:0:9982:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458127744 00000100:00100000:0.0:1784189193.777211:0:9982:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458127744 00000100:00100000:0.0:1784189193.777229:0:9982:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2458 00000100:00100000:0.0:1784189193.777237:0:9982:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc06b98dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3640:x1870854458127616:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784189193.777284:0:9982:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc06b98dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3640:x1870854458127616:12345-0@lo:400:kworker.0 Request processed in 47us (218us total) trans 0 rc 0/0 00000100:00100000:0.0:1784189193.777292:0:9982:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2458 00000100:00100000:0.0:1784189193.777307:0:9982:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2459 00000100:00100000:0.0:1784189193.777314:0:9982:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc06b98e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3640:x1870854458127744:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784189193.777361:0:9982:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc06b98e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3640:x1870854458127744:12345-0@lo:400:kworker.0 Request processed in 48us (227us total) trans 0 rc 0/0 00000100:00100000:0.0:1784189193.777368:0:9982:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2459 00000100:00100000:0.0:1784189193.777409:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc06b98f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1870854458127744:0@lo:400:kworker.0 00000100:00100000:0.0:1784189193.777418:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf46902680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1870854458127616:0@lo:400:kworker.0 00000100:00100000:0.0:1784189193.777473:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf46902a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3643:1870854458127360:0@lo:400:kworker.0 00010000:00010000:2.0:1784189193.777878:0:90948:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.112@tcp lock: ffff9dc0565e6c00/0xcc1762b626f8b22c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x110e400000000 nid: local remote: 0xcc1762b626f8b233 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1784189193.777885:0:90948:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.112@tcp lock: ffff9dc0565e6c00/0xcc1762b626f8b22c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x110f400000000 nid: local remote: 0xcc1762b626f8b233 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784189193.777890:0:90948:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1784189193.777900:0:90948:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1784189193.777904:0:90948:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.112@tcp lock: ffff9dc0565e6c00/0xcc1762b626f8b22c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x590f400000000 nid: local remote: 0xcc1762b626f8b233 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189193.777912:0:90948:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.112@tcp lock: ffff9dc0755a5000/0xcc1762b626f8b25d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0xcc1762b626f8b264 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1784189193.777917:0:90948:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.112@tcp lock: ffff9dc0755a5000/0xcc1762b626f8b25d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0xcc1762b626f8b264 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784189193.777921:0:90948:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1784189193.777924:0:90948:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1784189193.777926:0:90948:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.112@tcp lock: ffff9dc0755a5000/0xcc1762b626f8b25d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0xcc1762b626f8b264 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784189193.778011:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc05ed91880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3642:1870854458127104:0@lo:400:kworker.0 00000100:00100000:3.0:1784189193.778051:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784189193.778091:0:66169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458127104 00000100:00100000:3.0:1784189193.778096:0:66169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458127104 00000100:00100000:3.0:1784189193.778136:0:66169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1191 00000100:00100000:3.0:1784189193.778144:0:66169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf4693f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1870854458127104:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784189193.778181:0:66169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf4693f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1870854458127104:12345-0@lo:400:kworker.0 Request processed in 38us (129us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189193.778187:0:66169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1191 00000100:00080000:3.0:1784189193.778206:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1784189193.778237:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc05ed91880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3642:1870854458127104:0@lo:400:kworker.0 00000100:00100000:0.0:1784189193.778631:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784189193.781209:0:66170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458127360 00000100:00100000:3.0:1784189193.781224:0:66170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458127360 00000100:00100000:3.0:1784189193.781299:0:66170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1192 00000100:00100000:3.0:1784189193.781337:0:66170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc06b98f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1870854458127360:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784189193.781430:0:66170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc06b98f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1870854458127360:12345-0@lo:400:kworker.0 Request processed in 110us (2798us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189193.781437:0:66170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1192 00000100:00080000:3.0:1784189193.781458:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1784189193.781585:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf46902a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3643:1870854458127360:0@lo:400:kworker.0 00000100:00080000:2.0:1784189193.812235:0:90948:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffff9dc07110c800 already not connected (conn 63, was 0): CONNECTING 00000100:00080000:1.0:1784189193.812237:0:3639:0:(import.c:65:import_set_state_nolock()) ffff9dc07110c800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1784189193.812257:0:90948:0:(import.c:65:import_set_state_nolock()) ffff9dc07110c800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1784189193.812266:0:90948:0:(import.c:510:import_select_connection()) MGC192.168.203.112@tcp: connect to NID 0@lo last attempt 3435 00000100:00080000:2.0:1784189193.812272:0:90948:0:(import.c:589:import_select_connection()) MGC192.168.203.112@tcp: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1784189193.812280:0:90948:0:(import.c:624:import_select_connection()) MGC192.168.203.112@tcp: import ffff9dc07110c800 using connection 192.168.203.112@tcp/0@lo 00000100:00080000:1.0:1784189193.812358:0:3639:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-5) 00000100:00100000:1.0:1784189193.812365:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf43f58a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:bd553d0d-03e2-4233-b06b-b55bbfa2b954:0:1870854458126848:0@lo:250:kworker.0 00000100:00100000:0.0:1784189193.812431:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc05ed91f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3639:1870854458126976:0@lo:38:kworker.0 00000100:00100000:0.0:1784189193.812501:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784189193.812511:0:90948:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9dc07faab480 x1870854458128000/t0(0) o250->MGC192.168.203.112@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1784189193.812529:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf46903480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3639:1870854458127232:0@lo:38:kworker.0 00000100:00080000:2.0:1784189193.812535:0:90948:0:(recover.c:337:ptlrpc_recover_import()) MGS: recovery started, waiting 20 seconds 00000100:00100000:0.0:1784189193.812552:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784189193.812567:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf46900000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3639:1870854458127488:0@lo:38:kworker.0 00000100:00100000:2.0:1784189193.812570:0:66945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458126976 00000100:00100000:2.0:1784189193.812576:0:66945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458126976 00000100:00100000:0.0:1784189193.812591:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784189193.812618:0:26492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458127488 00000100:00100000:0.0:1784189193.812622:0:26492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458127488 00000100:00100000:0.0:1784189193.812653:0:26492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3801 00000100:00100000:0.0:1784189193.812660:0:26492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf46902680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3639:x1870854458127488:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1784189193.812682:0:26492:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1784189193.812716:0:26492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf46902680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3639:x1870854458127488:12345-0@lo:38:kworker.0 Request processed in 55us (125us total) trans 0 rc -19/-19 00000100:00100000:0.0:1784189193.812722:0:26492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3801 00000100:00080000:0.0:1784189193.812765:0:3639:0:(import.c:65:import_set_state_nolock()) ffff9dbf436c4000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1784189193.812769:0:3639:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1784189193.812773:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf46900000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3639:1870854458127488:0@lo:38:kworker.0 00000100:00100000:0.0:1784189193.812779:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc06b98fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3639:1870854458127872:0@lo:38:kworker.0 00000100:00100000:0.0:1784189193.812806:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784189193.812833:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc07faab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:bd553d0d-03e2-4233-b06b-b55bbfa2b954:3639:1870854458128000:0@lo:250:mount.lustre.0 00000100:00100000:0.0:1784189193.812861:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784189193.812881:0:90955:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458128000 00000100:00100000:0.0:1784189193.812892:0:90955:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458128000 00000100:00100000:0.0:1784189193.812914:0:90955:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1784189193.812920:0:90955:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf46be5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0+-99:3639:x1870854458128000:12345-0@lo:250:mount.lustre.0 00010000:00080000:0.0:1784189193.812936:0:90955:0:(ldlm_lib.c:1445:target_handle_connect()) MGS: connection from bd553d0d-03e2-4233-b06b-b55bbfa2b954@0@lo t0 exp 0000000000000000 cur 3436 last 0 00000020:00000080:0.0:1784189193.812961:0:90955:0:(genops.c:1406:class_connect()) connect: client bd553d0d-03e2-4233-b06b-b55bbfa2b954, cookie 0xcc1762b626f8b6af 00000100:00080000:0.0:1784189193.813235:0:90955:0:(import.c:65:import_set_state_nolock()) ffff9dc06b8e5000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1784189193.813290:0:90955:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf46be5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd553d0d-03e2-4233-b06b-b55bbfa2b954+5:3639:x1870854458128000:12345-0@lo:250:mount.lustre.0 Request processed in 369us (429us total) trans 0 rc 0/0 00000100:00100000:0.0:1784189193.813298:0:90955:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1784189193.814794:0:66171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458127232 00000100:00100000:2.0:1784189193.814814:0:66171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458127232 00000100:00100000:2.0:1784189193.814847:0:66171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458127872 00000100:00100000:2.0:1784189193.814850:0:66171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458127872 00000100:00100000:2.0:1784189193.814867:0:66171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1263 00000100:00100000:2.0:1784189193.814873:0:66171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf46902a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3639:x1870854458127232:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1784189193.814891:0:66171:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1784189193.815339:0:3639:0:(client.c:3112:ptlrpc_free_committed()) MGC192.168.203.112@tcp: committing for last_committed 0 gen 26 00000100:00080000:1.0:1784189193.815350:0:3639:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.203.112@tcp: connect to target with instance 0 00000100:00080000:1.0:1784189193.815359:0:3639:0:(import.c:956:ptlrpc_connect_set_flags()) MGC192.168.203.112@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:1.0:1784189193.815365:0:3639:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:1.0:1784189193.815379:0:3639:0:(import.c:65:import_set_state_nolock()) ffff9dc07110c800 MGS: changing import state from CONNECTING to FULL 10000000:01000000:1.0:1784189193.815383:0:3639:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00100000:2.0:1784189193.815428:0:66171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf46902a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3639:x1870854458127232:12345-0@lo:38:kworker.0 Request processed in 553us (2874us total) trans 0 rc -19/-19 00000100:00100000:2.0:1784189193.815436:0:66171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1263 00000100:00100000:2.0:1784189193.815465:0:66171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1264 00000100:00100000:2.0:1784189193.815469:0:66171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf4859aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3639:x1870854458127872:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1784189193.815481:0:66171:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1784189193.815503:0:66171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf4859aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3639:x1870854458127872:12345-0@lo:38:kworker.0 Request processed in 33us (2697us total) trans 0 rc -19/-19 00000100:00100000:2.0:1784189193.815508:0:66171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1264 00000100:00080000:3.0:1784189193.815534:0:63468:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1784189193.815539:0:63468:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1784189193.815542:0:63468:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1784189193.815545:0:63468:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1784189193.815548:0:63468:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1784189193.815550:0:63468:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1784189193.815553:0:63468:0:(import.c:65:import_set_state_nolock()) ffff9dbf436c4000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1784189193.815559:0:63468:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3435 00000100:00080000:3.0:1784189193.815562:0:63468:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1784189193.815567:0:63468:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9dbf436c4000 using connection 192.168.203.112@tcp/0@lo 00000100:00100000:3.0:1784189193.815589:0:63468:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9dbf464ac380 x1870854458128256/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1784189193.815619:0:63468:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1784189193.815623:0:63468:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1784189193.815638:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1784189193.815650:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf464adf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1870854458128512:0@lo:400:kworker.0 00000100:00100000:3.0:1784189193.815692:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784189193.815733:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc05ed91880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bd553d0d-03e2-4233-b06b-b55bbfa2b954:3642:1870854458128128:0@lo:400:kworker.0 00000100:00100000:3.0:1784189193.815754:0:26161:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458128512 00000100:00100000:3.0:1784189193.815761:0:26161:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458128512 00000100:00100000:2.0:1784189193.815767:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784189193.815800:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1784189193.815803:0:26161:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2460 00000100:00100000:3.0:1784189193.815813:0:26161:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc07b5b3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:3641:x1870854458128512:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784189193.815819:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf464ad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1870854458128384:0@lo:400:kworker.0 00000100:00100000:2.0:1784189193.815845:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784189193.815873:0:26161:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc07b5b3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:3641:x1870854458128512:12345-0@lo:400:kworker.0 Request processed in 60us (177us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189193.815875:0:26159:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458128384 00000100:00100000:2.0:1784189193.815879:0:26159:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458128384 00000100:00100000:3.0:1784189193.815883:0:26161:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2460 00000100:00100000:2.0:1784189193.815913:0:26159:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2461 00000100:00100000:2.0:1784189193.815919:0:26159:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc07faaad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3642:x1870854458128384:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784189193.815955:0:26159:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc07faaad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3642:x1870854458128384:12345-0@lo:400:kworker.0 Request processed in 35us (109us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189193.815961:0:26159:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2461 00000100:00100000:0.0:1784189193.816196:0:66945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1265 00000100:00100000:0.0:1784189193.816202:0:66945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc06b98ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3639:x1870854458126976:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1784189193.816213:0:66945:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1784189193.816242:0:66945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc06b98ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3639:x1870854458126976:12345-0@lo:38:kworker.0 Request processed in 38us (3741us total) trans 0 rc -19/-19 00000100:00100000:0.0:1784189193.816248:0:66945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1265 00000100:00100000:0.0:1784189193.816274:0:90956:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458128128 00000100:00100000:0.0:1784189193.816277:0:90956:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458128128 00000100:00100000:0.0:1784189193.816302:0:90956:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1784189193.816308:0:90956:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf46be7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd553d0d-03e2-4233-b06b-b55bbfa2b954+5:3642:x1870854458128128:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784189193.816357:0:90956:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf46be7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd553d0d-03e2-4233-b06b-b55bbfa2b954+5:3642:x1870854458128128:12345-0@lo:400:kworker.0 Request processed in 49us (591us total) trans 0 rc 0/0 00000100:00100000:0.0:1784189193.816363:0:90956:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1784189193.817226:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf464adf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1870854458128512:0@lo:400:kworker.0 00000100:00100000:3.0:1784189193.817290:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf464ad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1870854458128384:0@lo:400:kworker.0 00000100:00100000:3.0:1784189193.817300:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc05ed91880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bd553d0d-03e2-4233-b06b-b55bbfa2b954:3642:1870854458128128:0@lo:400:kworker.0 00000100:00080000:3.0:1784189193.817360:0:90948:0:(recover.c:348:ptlrpc_recover_import()) MGS: recovery finished FULL, rc = 0 00000020:01000004:3.0:1784189193.817370:0:90948:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:3.0:1784189193.818255:0:90948:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds1_flakey 10000000:01000000:3.0:1784189193.818261:0:90948:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.112@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000100:00080000:1.0:1784189193.818509:0:3639:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:1.0:1784189193.818520:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc07faab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:bd553d0d-03e2-4233-b06b-b55bbfa2b954:3639:1870854458128000:0@lo:250:mount.lustre.0 00000040:01000000:3.0:1784189193.818605:0:90948:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.112@tcp ctxt 0 is initialized 00000020:01000004:3.0:1784189193.818644:0:90948:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.203.112@tcp, index=0000, flags=0x20005 00000020:01000004:3.0:1784189193.818648:0:90948:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1784189193.818650:0:90948:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1784189193.818651:0:90948:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1784189193.818653:0:90948:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1784189193.818654:0:90948:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1784189193.818655:0:90948:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1784189193.818657:0:90948:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1784189193.818658:0:90948:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1784189193.818660:0:90948:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1784189193.818661:0:90948:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1784189193.818664:0:90948:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:3.0:1784189193.818666:0:90948:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1784189193.818668:0:90948:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1784189193.818669:0:90948:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1784189193.818670:0:90948:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1784189193.818676:0:90948:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1784189193.818677:0:90948:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1784189193.818678:0:90948:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1784189193.818679:0:90948:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1784189193.818680:0:90948:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1784189193.818681:0:90948:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1784189193.818703:0:90948:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:3.0:1784189193.818719:0:90948:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc07b5b1180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd553d0d-03e2-4233-b06b-b55bbfa2b954:90948:1870854458128640:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1784189193.818780:0:90948:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:01000000:0.0:1784189193.818884:0:63468:0:(tgt_mount.c:1626:tgt_import_update()) NID #0: 192.168.203.112@tcp 10000000:01000000:0.0:1784189193.818897:0:63468:0:(mgc_request_server.c:464:mgc_set_info_async_server()) NID notify for lustre-OST0000 about 1 new NIDs 00000020:01000004:0.0:1784189193.818900:0:63468:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: req 00000020:01000004:0.0:1784189193.818901:0:63468:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1784189193.818903:0:63468:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1784189193.818909:0:63468:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1784189193.818910:0:63468:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1784189193.818911:0:63468:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1784189193.818912:0:63468:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1784189193.818913:0:63468:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1784189193.818915:0:63468:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:01000000:0.0:1784189193.818952:0:63468:0:(tgt_mount.c:1637:tgt_import_update()) lustre-OST0000: notify about 1 NIDs, rc = 0 10000000:01000000:0.0:1784189193.818959:0:63468:0:(mgc_request_server.c:464:mgc_set_info_async_server()) NID notify for lustre-OST0001 about 1 new NIDs 00000020:01000004:0.0:1784189193.818961:0:63468:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: req 00000020:01000004:0.0:1784189193.818962:0:63468:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1784189193.818964:0:63468:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1784189193.818964:0:63468:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1784189193.818965:0:63468:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1784189193.818966:0:63468:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1784189193.818967:0:63468:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1784189193.818968:0:63468:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1784189193.818969:0:63468:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:01000000:0.0:1784189193.818989:0:63468:0:(tgt_mount.c:1637:tgt_import_update()) lustre-OST0001: notify about 1 NIDs, rc = 0 10000000:01000000:0.0:1784189193.819002:0:63468:0:(mgc_request_server.c:464:mgc_set_info_async_server()) NID notify for lustre-MDT0001 about 1 new NIDs 00000020:01000004:0.0:1784189193.819004:0:63468:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: req 00000020:01000004:0.0:1784189193.819005:0:63468:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1784189193.819006:0:63468:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1784189193.819007:0:63468:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1784189193.819008:0:63468:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1784189193.819009:0:63468:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1784189193.819010:0:63468:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1784189193.819011:0:63468:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1784189193.819012:0:63468:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:01000000:0.0:1784189193.819024:0:63468:0:(tgt_mount.c:1637:tgt_import_update()) lustre-MDT0001: notify about 1 NIDs, rc = 0 00000100:00100000:0.0:1784189193.819049:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1784189193.819187:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc075f7f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bd553d0d-03e2-4233-b06b-b55bbfa2b954:3642:1870854458128896:0@lo:253:kworker.0 00000100:00100000:0.0:1784189193.819219:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf46900000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bd553d0d-03e2-4233-b06b-b55bbfa2b954:3640:1870854458128768:0@lo:253:kworker.0 00000100:00100000:3.0:1784189193.819227:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784189193.819259:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784189193.819370:0:90948:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dc05876dcc0 going to sleep for 11 seconds 00000100:00100000:2.0:1784189193.819480:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc05edaaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:bd553d0d-03e2-4233-b06b-b55bbfa2b954:3643:1870854458129024:0@lo:253:kworker.0 00000100:00100000:2.0:1784189193.819511:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784189193.827990:0:90955:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458128640 00000100:00100000:0.0:1784189193.828013:0:90955:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458128640 00000100:00100000:0.0:1784189193.828053:0:90955:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458128896 00000100:00100000:0.0:1784189193.828068:0:90955:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458128896 00000100:00100000:0.0:1784189193.828080:0:90955:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458128768 00000100:00100000:0.0:1784189193.828091:0:90955:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458128768 00000100:00100000:0.0:1784189193.828125:0:90955:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1784189193.828133:0:90955:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc07037fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd553d0d-03e2-4233-b06b-b55bbfa2b954+7:90948:x1870854458128640:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1784189193.828179:0:90955:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1784189193.828181:0:90955:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:0.0:1784189193.828183:0:90955:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 20000000:01000000:0.0:1784189193.828189:0:90955:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00080000:0.0:1784189193.828311:0:3639:0:(import.c:65:import_set_state_nolock()) ffff9dbf42271800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1784189193.828316:0:3639:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1784189193.828336:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc05ed91f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3639:1870854458126976:0@lo:38:kworker.0 00000100:00080000:0.0:1784189193.828348:0:3639:0:(import.c:65:import_set_state_nolock()) ffff9dbf425f4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1784189193.828352:0:3639:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1784189193.828354:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf46903480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3639:1870854458127232:0@lo:38:kworker.0 00000100:00080000:0.0:1784189193.828363:0:3639:0:(import.c:65:import_set_state_nolock()) ffff9dbf43690800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1784189193.828366:0:3639:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1784189193.828368:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc06b98fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3639:1870854458127872:0@lo:38:kworker.0 00000100:00100000:0.0:1784189193.828401:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf464ac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3639:1870854458128256:0@lo:38:kworker.0 00000100:00100000:0.0:1784189193.828452:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784189193.828478:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458128256 00000100:00100000:0.0:1784189193.828482:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458128256 00000100:00100000:0.0:1784189193.828503:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3802 00000100:00100000:0.0:1784189193.828508:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc05edaad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3639:x1870854458128256:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1784189193.828525:0:8439:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1784189193.828558:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc05edaad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3639:x1870854458128256:12345-0@lo:38:kworker.0 Request processed in 49us (106us total) trans 0 rc -19/-19 00000100:00100000:0.0:1784189193.828566:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3802 00000100:00080000:0.0:1784189193.828605:0:3639:0:(import.c:65:import_set_state_nolock()) ffff9dbf436c4000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1784189193.828609:0:3639:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1784189193.828611:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf464ac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3639:1870854458128256:0@lo:38:kworker.0 00000100:00100000:0.0:1784189193.829192:0:90955:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc07037fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd553d0d-03e2-4233-b06b-b55bbfa2b954+7:90948:x1870854458128640:12345-0@lo:253:mount.lustre.0 Request processed in 1058us (10410us total) trans 0 rc 0/0 00000100:00100000:0.0:1784189193.829199:0:90955:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1784189193.829224:0:90955:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1784189193.829230:0:90955:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc07037e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd553d0d-03e2-4233-b06b-b55bbfa2b954+6:3642:x1870854458128896:12345-0@lo:253:kworker.0 20000000:01000000:0.0:1784189193.829247:0:90955:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:0.0:1784189193.829258:0:90955:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:2.0:1784189193.831548:0:90948:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc07b5b1180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd553d0d-03e2-4233-b06b-b55bbfa2b954:90948:1870854458128640:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1784189193.831568:0:90948:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1784189193.831571:0:90948:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1784189193.831573:0:90948:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1784189193.831574:0:90948:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1784189193.831575:0:90948:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1784189193.831576:0:90948:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1784189193.831578:0:90948:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1784189193.831579:0:90948:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1784189193.831580:0:90948:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1784189193.831582:0:90948:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1784189193.831583:0:90948:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 20000000:01000000:0.0:1784189193.832292:0:90955:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1784189193.832310:0:90955:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:0.0:1784189193.832543:0:90955:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc07037e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd553d0d-03e2-4233-b06b-b55bbfa2b954+6:3642:x1870854458128896:12345-0@lo:253:kworker.0 Request processed in 3311us (13316us total) trans 0 rc 0/0 00000100:00100000:0.0:1784189193.832554:0:90955:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1784189193.832593:0:90955:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458129024 00000100:00100000:0.0:1784189193.832599:0:90955:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458129024 00000100:00100000:0.0:1784189193.832626:0:90955:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1784189193.832633:0:90955:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc07037f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd553d0d-03e2-4233-b06b-b55bbfa2b954+6:3640:x1870854458128768:12345-0@lo:253:kworker.0 20000000:01000000:0.0:1784189193.832660:0:90955:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:0.0:1784189193.832672:0:90955:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000020:01000004:2.0:1784189193.837006:0:90948:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9dbf43fc9000 from lustre-MDT0000 10000000:01000000:2.0:1784189193.837046:0:90948:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:2.0:1784189193.837049:0:90948:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:2.0:1784189193.837067:0:90948:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9dbf43fc9000 10000000:01000000:2.0:1784189193.837073:0:90948:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1784189193.837078:0:90948:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff9dbf43fc9000 10000000:01000000:2.0:1784189193.837080:0:90948:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:2.0:1784189193.837208:0:90948:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-barrier-ffff9dbf43fc9000 from 1 10000000:01000000:2.0:1784189193.837212:0:90948:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:2.0:1784189193.837253:0:90948:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff9dc04a20bc00/0xcc1762b626f8b6b6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 90948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189193.837283:0:90948:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: ffff9dc04a20bc00/0xcc1762b626f8b6b6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 90948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189193.837295:0:90948:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: ffff9dc04a20bc00/0xcc1762b626f8b6b6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 90948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784189193.837336:0:90948:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc07faa8000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd553d0d-03e2-4233-b06b-b55bbfa2b954:90948:1870854458129152:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1784189193.837402:0:90948:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784189193.837431:0:90948:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dc045d3cf00 going to sleep for 11 seconds 20000000:01000000:2.0:1784189193.837496:0:90958:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1784189193.837501:0:90958:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1784189193.837514:0:90958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9dc04a20b600/0xcc1762b626f8b6bd lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 90958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189193.837528:0:90958:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9dc05ec0ea00/0xcc1762b626f8b693 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c3e64 expref: 9 pid: 90956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189193.837535:0:90958:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9dc04a20b600/0xcc1762b626f8b6bd lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 90958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189193.837560:0:90958:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9dc05ec0ea00/0xcc1762b626f8b693 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c3e64 expref: 9 pid: 90956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189193.837573:0:90958:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9dc05ec0ea00/0xcc1762b626f8b693 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c3e64 expref: 9 pid: 90956 timeout: 3536 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784189193.837584:0:90958:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc07faab480 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:90958:1870854458129280:192.168.203.12@tcp:104: 00000100:00100000:2.0:1784189193.837631:0:90958:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dc045d3c3c0 going to sleep for 11 seconds 00000020:01000004:2.0:1784189193.837676:0:3642:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: rep 00000020:01000004:2.0:1784189193.837679:0:3642:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1784189193.837680:0:3642:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1784189193.837681:0:3642:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1784189193.837682:0:3642:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1784189193.837684:0:3642:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1784189193.837685:0:3642:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1784189193.837687:0:3642:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1784189193.837688:0:3642:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000100:00100000:2.0:1784189193.837691:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc075f7f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bd553d0d-03e2-4233-b06b-b55bbfa2b954:3642:1870854458128896:0@lo:253:kworker.0 20000000:01000000:2.0:1784189193.838764:0:90955:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1784189193.838769:0:90955:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:1.0:1784189193.839551:0:90954:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458129152 00000100:00100000:1.0:1784189193.839559:0:90954:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458129152 00000100:00100000:0.0:1784189193.839705:0:90954:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1784189193.839715:0:90954:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc07037d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd553d0d-03e2-4233-b06b-b55bbfa2b954+7:3643:x1870854458129024:12345-0@lo:253:kworker.0 20000000:01000000:0.0:1784189193.839747:0:90954:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:0.0:1784189193.839760:0:90954:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:1.0:1784189193.845946:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1784189193.846406:0:7455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436281088 00000100:00100000:3.0:1784189193.846564:0:7455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436281088 00010000:00010000:3.0:1784189193.846603:0:7455:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9dc05ec0ea00/0xcc1762b626f8b693 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c3e64 expref: 10 pid: 90956 timeout: 3536 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784189193.846660:0:7455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 2547 00000100:00100000:3.0:1784189193.846671:0:7455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc0711a6050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9957a2dc-fd88-4a91-bca3-e2b7f365ab0c+10:2396:x1870854436281088:12345-192.168.203.12@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1784189193.846685:0:7455:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784189193.846691:0:7455:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9dc05ec0ea00/0xcc1762b626f8b693 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c3e64 expref: 10 pid: 90956 timeout: 3536 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189193.846703:0:7455:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9dc05ec0ea00/0xcc1762b626f8b693 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c3e64 expref: 10 pid: 90956 timeout: 3536 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189193.846725:0:7455:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9dc04a20b600/0xcc1762b626f8b6bd lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 90958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189193.846733:0:7455:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dc04a20b600/0xcc1762b626f8b6bd lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 90958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1784189193.846768:0:7455:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.009267277s 00010000:00010000:3.0:1784189193.846773:0:7455:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9dc04a20b600/0xcc1762b626f8b6bd lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 90958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189193.846781:0:7455:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9dc04a20b600/0xcc1762b626f8b6bd lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 90958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189193.846788:0:7455:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9dc04a20b600/0xcc1762b626f8b6bd lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 90958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189193.846796:0:7455:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9dc04a20b600/0xcc1762b626f8b6bd lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 90958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189193.846802:0:7455:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc04a20b600 already unused, calling callback (ffffffffc0b2e230) 00010000:00010000:3.0:1784189193.846806:0:7455:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9dc04a20b600/0xcc1762b626f8b6bd lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 90958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189193.846815:0:7455:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9dc04a20b600/0xcc1762b626f8b6bd lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 90958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189193.846825:0:7455:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9dc04a20b600/0xcc1762b626f8b6bd lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 90958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189193.846836:0:7455:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784189193.846887:0:7455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc0711a6050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9957a2dc-fd88-4a91-bca3-e2b7f365ab0c+10:2396:x1870854436281088:12345-192.168.203.12@tcp:103:ldlm_bl.0 Request processed in 218us (949us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189193.846895:0:7455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 2547 00010000:00010000:0.0:1784189193.847358:0:90958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dc05ec0ea00/0xcc1762b626f8b693 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c3e64 expref: 9 pid: 90956 timeout: 3536 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784189193.847386:0:90958:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc07faab480 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:90958:1870854458129280:192.168.203.12@tcp:104: 00010000:00010000:0.0:1784189193.847406:0:90958:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9dc04a20b600/0xcc1762b626f8b6bd lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 90958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189193.847491:0:90958:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9dc04a20b600/0xcc1762b626f8b6bd lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 90958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189193.847497:0:90958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9dc04a20b600/0xcc1762b626f8b6bd lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 90958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189193.847503:0:90958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dc04a20b600/0xcc1762b626f8b6bd lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 90958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1784189193.848384:0:90954:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1784189193.848405:0:90954:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 00000100:00100000:1.0:1784189193.848451:0:90955:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc07037f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd553d0d-03e2-4233-b06b-b55bbfa2b954+7:3640:x1870854458128768:12345-0@lo:253:kworker.0 Request processed in 15816us (29189us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189193.848471:0:90955:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1784189193.848511:0:90955:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1784189193.848525:0:90955:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc07037f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd553d0d-03e2-4233-b06b-b55bbfa2b954+6:90948:x1870854458129152:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1784189193.848538:0:90955:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784189193.848557:0:90955:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dc07116e200/0xcc1762b626f8b6c4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xcc1762b626f8b6b6 expref: -99 pid: 90955 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189193.848580:0:90955:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dc07116e200/0xcc1762b626f8b6c4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcc1762b626f8b6b6 expref: 7 pid: 90955 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189193.848590:0:90955:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dc07116e200/0xcc1762b626f8b6c4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcc1762b626f8b6b6 expref: 7 pid: 90955 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189193.848610:0:90955:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc07116e200, rc 0) 00000100:00100000:1.0:1784189193.848644:0:90955:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc07037f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd553d0d-03e2-4233-b06b-b55bbfa2b954+7:90948:x1870854458129152:12345-0@lo:101:mount.lustre.0 Request processed in 124us (11242us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189193.848650:0:90955:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000020:01000004:1.0:1784189193.848692:0:3640:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: rep 00000020:01000004:1.0:1784189193.848695:0:3640:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1784189193.848697:0:3640:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1784189193.848698:0:3640:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1784189193.848699:0:3640:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1784189193.848701:0:3640:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1784189193.848702:0:3640:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1784189193.848704:0:3640:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1784189193.848706:0:3640:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000100:00100000:1.0:1784189193.848708:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf46900000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bd553d0d-03e2-4233-b06b-b55bbfa2b954:3640:1870854458128768:0@lo:253:kworker.0 20000000:01000000:2.0:1784189193.850278:0:90958:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1784189193.850287:0:90958:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1784189193.850311:0:90958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9dc04a20b400/0xcc1762b626f8b6cb lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 90958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189193.850364:0:90958:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dc04a20b400/0xcc1762b626f8b6cb lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 90958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1784189193.850371:0:90958:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.009267277s 00010000:00010000:2.0:1784189193.850376:0:90958:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9dc04a20b400/0xcc1762b626f8b6cb lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 90958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189193.850382:0:90958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9dc04a20b400/0xcc1762b626f8b6cb lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 90958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189193.850388:0:90958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9dc04a20b400/0xcc1762b626f8b6cb lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 90958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189193.850394:0:90958:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9dc04a20b400/0xcc1762b626f8b6cb lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 90958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189193.850400:0:90958:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc04a20b400 already unused, calling callback (ffffffffc0b2e230) 00000100:00100000:0.0:1784189193.850796:0:90948:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc07faa8000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd553d0d-03e2-4233-b06b-b55bbfa2b954:90948:1870854458129152:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1784189193.850814:0:90948:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: ffff9dc04a20bc00/0xcc1762b626f8b6b6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc1762b626f8b6c4 expref: -99 pid: 90948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189193.850822:0:90948:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: ffff9dc04a20bc00/0xcc1762b626f8b6b6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcc1762b626f8b6c4 expref: -99 pid: 90948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784189193.850839:0:90948:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:0.0:1784189193.850849:0:90948:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff9dc04a20bc00/0xcc1762b626f8b6b6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc1762b626f8b6c4 expref: -99 pid: 90948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189193.850856:0:90948:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: ffff9dc04a20bc00/0xcc1762b626f8b6b6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc1762b626f8b6c4 expref: -99 pid: 90948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784189193.850875:0:90948:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:0.0:1784189193.850891:0:90948:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1784189193.850897:0:90948:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff9dbf43fc9000 10000000:01000000:0.0:1784189193.850900:0:90948:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:0.0:1784189193.850903:0:90948:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:0.0:1784189193.850906:0:90948:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1784189193.850934:0:90948:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff9dc05ec0f200/0xcc1762b626f8b6d2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 90948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189193.850941:0:90948:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: ffff9dc05ec0f200/0xcc1762b626f8b6d2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 90948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189193.850949:0:90948:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: ffff9dc05ec0f200/0xcc1762b626f8b6d2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 90948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784189193.850969:0:90948:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc06b98fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd553d0d-03e2-4233-b06b-b55bbfa2b954:90948:1870854458129408:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1784189193.851038:0:90948:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784189193.851040:0:90954:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc07037d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd553d0d-03e2-4233-b06b-b55bbfa2b954+6:3643:x1870854458129024:12345-0@lo:253:kworker.0 Request processed in 11321us (31522us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189193.851053:0:90954:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1784189193.851073:0:90948:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dbf44c4f9c0 going to sleep for 11 seconds 00000020:01000004:1.0:1784189193.851122:0:3643:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: rep 00000020:01000004:1.0:1784189193.851125:0:3643:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1784189193.851127:0:3643:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1784189193.851128:0:3643:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1784189193.851129:0:3643:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1784189193.851131:0:3643:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1784189193.851132:0:3643:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1784189193.851134:0:3643:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1784189193.851135:0:3643:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000100:00100000:1.0:1784189193.851138:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc05edaaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:bd553d0d-03e2-4233-b06b-b55bbfa2b954:3643:1870854458129024:0@lo:253:kworker.0 00000100:00100000:1.0:1784189193.851176:0:90954:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458129408 00000100:00100000:1.0:1784189193.851182:0:90954:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458129408 00000100:00100000:1.0:1784189193.851220:0:90954:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1784189193.851227:0:90954:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc07037e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd553d0d-03e2-4233-b06b-b55bbfa2b954+6:90948:x1870854458129408:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1784189193.851240:0:90954:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784189193.851254:0:90954:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dc07116e400/0xcc1762b626f8b6d9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xcc1762b626f8b6d2 expref: -99 pid: 90954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189193.851271:0:90954:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dc07116e400/0xcc1762b626f8b6d9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcc1762b626f8b6d2 expref: 7 pid: 90954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189193.851280:0:90954:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dc07116e400/0xcc1762b626f8b6d9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcc1762b626f8b6d2 expref: 7 pid: 90954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189193.851289:0:90954:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc07116e400, rc 0) 00010000:00010000:2.0:1784189193.851347:0:90958:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9dc04a20b400/0xcc1762b626f8b6cb lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 90958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189193.851357:0:90958:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9dc04a20b400/0xcc1762b626f8b6cb lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 90958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189193.851368:0:90958:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9dc04a20b400/0xcc1762b626f8b6cb lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 90958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189193.851375:0:90958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9dc04a20b400/0xcc1762b626f8b6cb lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 90958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189193.851380:0:90958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dc04a20b400/0xcc1762b626f8b6cb lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 90958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784189193.851918:0:90954:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc07037e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd553d0d-03e2-4233-b06b-b55bbfa2b954+7:90948:x1870854458129408:12345-0@lo:101:mount.lustre.0 Request processed in 690us (884us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189193.851926:0:90954:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1784189193.854784:0:90948:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc06b98fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd553d0d-03e2-4233-b06b-b55bbfa2b954:90948:1870854458129408:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1784189193.854813:0:90948:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: ffff9dc05ec0f200/0xcc1762b626f8b6d2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc1762b626f8b6d9 expref: -99 pid: 90948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189193.854824:0:90948:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: ffff9dc05ec0f200/0xcc1762b626f8b6d2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcc1762b626f8b6d9 expref: -99 pid: 90948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784189193.854909:0:90948:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc06b98fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd553d0d-03e2-4233-b06b-b55bbfa2b954:90948:1870854458129536:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1784189193.854969:0:90948:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784189193.855028:0:90948:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dbf44c4f9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1784189193.855342:0:90956:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458129536 00000100:00100000:2.0:1784189193.855350:0:90956:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458129536 00000100:00100000:2.0:1784189193.855393:0:90956:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1784189193.855402:0:90956:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc07037c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd553d0d-03e2-4233-b06b-b55bbfa2b954+7:90948:x1870854458129536:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1784189193.855550:0:90956:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc07037c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd553d0d-03e2-4233-b06b-b55bbfa2b954+8:90948:x1870854458129536:12345-0@lo:501:mount.lustre.0 Request processed in 148us (580us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189193.855557:0:90956:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1784189193.858516:0:90948:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc06b98fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd553d0d-03e2-4233-b06b-b55bbfa2b954:90948:1870854458129536:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1784189193.858576:0:90948:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc06b98fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd553d0d-03e2-4233-b06b-b55bbfa2b954:90948:1870854458129664:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1784189193.858645:0:90948:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784189193.858677:0:90948:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dbf44c4f9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1784189193.858782:0:90956:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458129664 00000100:00100000:2.0:1784189193.858788:0:90956:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458129664 00000100:00100000:2.0:1784189193.858826:0:90956:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1784189193.858833:0:90956:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc049311850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd553d0d-03e2-4233-b06b-b55bbfa2b954+8:90948:x1870854458129664:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1784189193.860641:0:90956:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc049311850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd553d0d-03e2-4233-b06b-b55bbfa2b954+8:90948:x1870854458129664:12345-0@lo:503:mount.lustre.0 Request processed in 1801us (1989us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189193.860653:0:90956:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1784189193.860876:0:90948:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc06b98fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd553d0d-03e2-4233-b06b-b55bbfa2b954:90948:1870854458129664:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1784189193.861277:0:90960:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc07b5b2300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bd553d0d-03e2-4233-b06b-b55bbfa2b954:90960:1870854458129792:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1784189193.861369:0:90960:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784189193.861581:0:90955:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458129792 00000100:00100000:0.0:1784189193.861588:0:90955:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458129792 00000100:00100000:0.0:1784189193.861623:0:90955:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1784189193.861631:0:90955:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc049313450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd553d0d-03e2-4233-b06b-b55bbfa2b954+8:90960:x1870854458129792:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1784189193.861826:0:90960:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dc07b57c6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1784189193.862531:0:90955:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc049313450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd553d0d-03e2-4233-b06b-b55bbfa2b954+8:90960:x1870854458129792:12345-0@lo:502:llog_process_th.0 Request processed in 898us (1159us total) trans 0 rc 0/0 00000100:00100000:0.0:1784189193.862540:0:90955:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1784189193.862646:0:90960:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc07b5b2300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bd553d0d-03e2-4233-b06b-b55bbfa2b954:90960:1870854458129792:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1784189193.862672:0:90960:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1784189193.862682:0:90960:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784189193.862684:0:90960:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1784189193.862689:0:90960:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:3.0:1784189193.862691:0:90960:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1784189193.862705:0:90960:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff9dc049be19c0) 00000020:00000080:3.0:1784189193.862726:0:90960:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type lod with refcount 2 00000020:00000080:3.0:1784189193.862731:0:90960:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00080000:01000000:3.0:1784189193.862802:0:90960:0:(osd_handler.c:8929:osd_obd_connect()) connect #2 00000020:00000080:3.0:1784189193.862807:0:90960:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xcc1762b626f8b6e7 00000020:00000080:3.0:1784189193.863020:0:90960:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:3.0:1784189193.863024:0:90960:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1784189193.863028:0:90960:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784189193.863030:0:90960:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1784189193.863033:0:90960:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1784189193.863036:0:90960:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784189193.863037:0:90960:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:3.0:1784189193.863040:0:90960:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1784189193.863046:0:90960:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff9dc049be3380) 00000020:00000080:3.0:1784189193.863058:0:90960:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type mdt with refcount 2 00000020:00000080:3.0:1784189193.863062:0:90960:0:(obd_config.c:1470:class_process_config()) processing cmd: cf007 00000020:00000080:3.0:1784189193.863064:0:90960:0:(obd_config.c:1514:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:3.0:1784189193.863067:0:90960:0:(obd_config.c:1148:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:3.0:1784189193.863072:0:90960:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1784189193.863124:0:90960:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9dbf43fc9000 from lustre-MDT0000, refs=3 00000020:00000080:3.0:1784189193.863136:0:90960:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff9dc049be0000) 00000020:00000080:3.0:1784189193.863147:0:90960:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type mdd with refcount 2 00000004:01000000:3.0:1784189193.863200:0:90960:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:3.0:1784189193.863207:0:90960:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xcc1762b626f8b6fc 00000020:00000080:3.0:1784189193.863298:0:90960:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:3.0:1784189193.863313:0:90960:0:(mdd_device.c:1596:mdd_obd_connect()) connect #0 00000020:00000080:3.0:1784189193.863511:0:90960:0:(genops.c:1406:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0xcc1762b626f8b703 00080000:01000000:3.0:1784189193.863519:0:90960:0:(osd_handler.c:8929:osd_obd_connect()) connect #3 00000020:00000080:3.0:1784189193.863524:0:90960:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xcc1762b626f8b70a 00010000:00010000:3.0:1784189193.945281:0:90960:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-4 is initialized 00000001:00080000:3.0:1784189193.945429:0:90960:0:(tgt_lastrcvd.c:1748:tgt_clients_data_init()) RCVRNG CLIENT uuid: b90fcc1c-0e69-42a4-a116-a71fec7aeb78 idx: 0 lr: 103079215115 srv lr: 107374182400 lx: 0 gen 22 00000001:00080000:3.0:1784189193.945468:0:90960:0:(tgt_lastrcvd.c:1748:tgt_clients_data_init()) RCVRNG CLIENT uuid: lustre-MDT0001-mdtlov_UUID idx: 1 lr: 0 srv lr: 107374182400 lx: 0 gen 21 00000001:00000004:3.0:1784189193.945489:0:90960:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 26, last_transno is 107374182400 00000001:00080000:3.0:1784189193.945581:0:90960:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000001:00080000:3.0:1784189193.945633:0:90960:0:(tgt_lastrcvd.c:2283:tgt_reply_data_init()) lustre-MDT0000: restore reply ffff9dc07b57c6c0: xid 1870854436268928, transno 107374182407, client gen 22, slot idx 0 00000001:00080000:3.0:1784189193.945644:0:90960:0:(tgt_lastrcvd.c:2283:tgt_reply_data_init()) lustre-MDT0000: restore reply ffff9dbf4330f600: xid 1870854436268672, transno 107374182406, client gen 22, slot idx 1 00000020:00000080:3.0:1784189193.946134:0:90960:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff9dc0762999c0) 00000020:00000080:3.0:1784189193.946155:0:90960:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type qmt with refcount 2 00080000:01000000:3.0:1784189193.946226:0:90960:0:(osd_handler.c:8929:osd_obd_connect()) connect #4 00000020:00000080:3.0:1784189193.946233:0:90960:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xcc1762b626f8b726 00000020:00000080:1.0:1784189193.955288:0:90960:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:1.0:1784189193.957858:0:90960:0:(genops.c:1406:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0xcc1762b626f8b72d 00000020:00000080:1.0:1784189193.958532:0:90960:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:1.0:1784189193.958543:0:90960:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1784189193.958548:0:90960:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784189193.958550:0:90960:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:1.0:1784189193.958553:0:90960:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1784189193.958555:0:90960:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #8 00000020:01000000:1.0:1784189193.958557:0:90960:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1784189193.958558:0:90960:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1784189193.958559:0:90960:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1784189193.958562:0:90960:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784189193.958563:0:90960:0:(obd_config.c:1561:class_process_config()) marker 8 (0x6) lustre sys.timeout 00000020:01000000:1.0:1784189193.958565:0:90960:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1784189193.958570:0:90960:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784189193.958571:0:90960:0:(obd_config.c:1561:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:1.0:1784189193.958576:0:90960:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000004:01000000:1.0:1784189193.958614:0:90960:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:1.0:1784189193.958629:0:90960:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1784189193.958632:0:90960:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784189193.958634:0:90960:0:(obd_config.c:1561:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:1.0:1784189193.958636:0:90960:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1784189193.958639:0:90960:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784189193.958640:0:90960:0:(obd_config.c:1561:class_process_config()) marker 17 (0x1) lustre-MDT0001 add osp 00000020:00000080:1.0:1784189193.958642:0:90960:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1784189193.958647:0:90960:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.203.112@tcp to nid 0x20000c0a8cb70 (192.168.203.112@tcp) 00000020:00000080:1.0:1784189193.958672:0:90960:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1784189193.958686:0:90960:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osp-MDT0000 (ffff9dbf431299c0) 00000020:00000080:1.0:1784189193.958703:0:90960:0:(obd_config.c:720:class_attach_name()) OBD: dev 21 attached type osp with refcount 2 00000020:00000080:1.0:1784189193.958709:0:90960:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1784189193.958761:0:90960:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0001-osp-MDT0000: connect to lustre-MDT0000-osd (lustre-MDT0001-osp-MDT0000) 00080000:01000000:1.0:1784189193.958767:0:90960:0:(osd_handler.c:8929:osd_obd_connect()) connect #5 00000020:00000080:1.0:1784189193.958772:0:90960:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xcc1762b626f8b73b 00010000:00080000:1.0:1784189193.958803:0:90960:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9dbf4512e800@lustre-MDT0001-osp-MDT0000: add connection 192.168.203.112@tcp at head 00010000:00010000:1.0:1784189193.961940:0:90960:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-osp-MDT0000-9 is initialized 00000020:00000080:0.0:1784189193.962856:0:90960:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1784189193.962868:0:90960:0:(obd_config.c:1470:class_process_config()) processing cmd: cf014 00000004:01000000:0.0:1784189193.962905:0:90960:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0001_UUID idx:1 gen:1 00000020:00000080:0.0:1784189193.962929:0:90960:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xcc1762b626f8b742 00000100:00080000:0.0:1784189193.962941:0:90960:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1784189193.962946:0:90960:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff9dbf4512e800 using connection 192.168.203.112@tcp/0@lo 00000100:00100000:0.0:1784189193.962980:0:90960:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9dc06b98fb80 x1870854458129920/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1784189193.963112:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc06b98fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3639:1870854458129920:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1784189193.963179:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1784189193.963309:0:90960:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000020:01000000:0.0:1784189193.963390:0:90960:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1784189193.963395:0:90960:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784189193.963397:0:90960:0:(obd_config.c:1561:class_process_config()) marker 17 (0x2) lustre-MDT0001 add osp 00000020:01000000:0.0:1784189193.963400:0:90960:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1784189193.963402:0:90960:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #19 00000020:01000000:0.0:1784189193.963404:0:90960:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1784189193.963405:0:90960:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1784189193.963414:0:90960:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1784189193.963417:0:90960:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784189193.963418:0:90960:0:(obd_config.c:1561:class_process_config()) marker 19 (0x6) lustre sys.timeout 00000020:01000000:0.0:1784189193.963421:0:90960:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1784189193.963425:0:90960:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:0.0:1784189193.963428:0:90960:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784189193.963429:0:90960:0:(obd_config.c:1561:class_process_config()) marker 22 (0x1) lustre-OST0000 add osc 00000020:00000080:0.0:1784189193.963432:0:90960:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1784189193.963436:0:90960:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.203.112@tcp to nid 0x20000c0a8cb70 (192.168.203.112@tcp) 00000020:01000000:0.0:1784189193.963455:0:90960:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:0.0:1784189193.963457:0:90960:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1784189193.963469:0:90960:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff9dbf44d7cd40) 00000020:00000080:0.0:1784189193.963484:0:90960:0:(obd_config.c:720:class_attach_name()) OBD: dev 22 attached type osp with refcount 2 00000020:00000080:0.0:1784189193.963489:0:90960:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1784189193.963544:0:90960:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:0.0:1784189193.963550:0:90960:0:(osd_handler.c:8929:osd_obd_connect()) connect #6 00000020:00000080:0.0:1784189193.963555:0:90960:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xcc1762b626f8b750 00010000:00080000:0.0:1784189193.963582:0:90960:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9dc047a82000@lustre-OST0000-osc-MDT0000: add connection 192.168.203.112@tcp at head 00010000:00010000:0.0:1784189193.963754:0:90960:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-10 is initialized 00000100:00080000:1.0:1784189193.964305:0:63468:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1784189193.964310:0:63468:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1784189193.964312:0:63468:0:(import.c:65:import_set_state_nolock()) ffff9dbf42271800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1784189193.964330:0:63468:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3435 00000100:00080000:1.0:1784189193.964333:0:63468:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1784189193.964339:0:63468:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9dbf42271800 using connection 192.168.203.112@tcp/0@lo 00000100:00100000:1.0:1784189193.964362:0:63468:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9dc07b5e0380 x1870854458130048/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1784189193.964381:0:63468:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1784189193.964384:0:63468:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1784189193.964385:0:63468:0:(import.c:65:import_set_state_nolock()) ffff9dbf425f4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1784189193.964389:0:63468:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3435 00000100:00080000:1.0:1784189193.964391:0:63468:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1784189193.964394:0:63468:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9dbf425f4800 using connection 192.168.203.112@tcp/0@lo 00000100:00100000:1.0:1784189193.964407:0:63468:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9dc05edaaa00 x1870854458130176/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1784189193.964416:0:63468:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1784189193.964418:0:63468:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1784189193.964419:0:63468:0:(import.c:65:import_set_state_nolock()) ffff9dbf43690800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1784189193.964422:0:63468:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3435 00000100:00080000:1.0:1784189193.964424:0:63468:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1784189193.964427:0:63468:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff9dbf43690800 using connection 192.168.203.112@tcp/0@lo 00000100:00100000:1.0:1784189193.964446:0:63468:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9dbf43f58a80 x1870854458130304/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1784189193.964472:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc07b5e0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3639:1870854458130048:0@lo:38:kworker.0 00000100:00100000:1.0:1784189193.964517:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784189193.964542:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc05edaaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3639:1870854458130176:0@lo:38:kworker.0 00000100:00100000:1.0:1784189193.964562:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784189193.964577:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf43f58a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3639:1870854458130304:0@lo:38:kworker.0 00000100:00100000:1.0:1784189193.964596:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784189193.964635:0:66169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458130048 00000100:00100000:1.0:1784189193.964642:0:66169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458130048 00000100:00100000:1.0:1784189193.964666:0:66169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458130176 00000100:00100000:1.0:1784189193.964669:0:66169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458130176 00000100:00100000:1.0:1784189193.964681:0:66169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458130304 00000100:00100000:1.0:1784189193.964684:0:66169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458130304 00000100:00100000:1.0:1784189193.964696:0:66169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1266 00000100:00100000:1.0:1784189193.964702:0:66169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc080f69500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3639:x1870854458130048:12345-0@lo:38:kworker.0 00000100:00100000:1.0:1784189193.964751:0:66169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc080f69500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3639:x1870854458130048:12345-0@lo:38:kworker.0 Request processed in 47us (233us total) trans 0 rc -11/-11 00000100:00100000:1.0:1784189193.964757:0:66169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1266 00000100:00100000:1.0:1784189193.964771:0:66169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1267 00000100:00100000:1.0:1784189193.964775:0:66169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf4262d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3639:x1870854458130176:12345-0@lo:38:kworker.0 00000100:00100000:1.0:1784189193.964801:0:66169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf4262d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3639:x1870854458130176:12345-0@lo:38:kworker.0 Request processed in 24us (237us total) trans 0 rc -11/-11 00000100:00100000:1.0:1784189193.964806:0:66169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1267 00000100:00100000:1.0:1784189193.964817:0:66169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1268 00000100:00100000:1.0:1784189193.964821:0:66169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc05edded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3639:x1870854458130304:12345-0@lo:38:kworker.0 00000100:00100000:1.0:1784189193.964845:0:66169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc05edded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3639:x1870854458130304:12345-0@lo:38:kworker.0 Request processed in 22us (248us total) trans 0 rc -11/-11 00000100:00100000:1.0:1784189193.964856:0:66169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1268 00000100:00080000:1.0:1784189193.964897:0:3639:0:(import.c:65:import_set_state_nolock()) ffff9dbf42271800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1784189193.964901:0:3639:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1784189193.964904:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc07b5e0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3639:1870854458130048:0@lo:38:kworker.0 00000100:00080000:1.0:1784189193.964912:0:3639:0:(import.c:65:import_set_state_nolock()) ffff9dbf425f4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1784189193.964914:0:3639:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1784189193.964917:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc05edaaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3639:1870854458130176:0@lo:38:kworker.0 00000100:00080000:1.0:1784189193.964923:0:3639:0:(import.c:65:import_set_state_nolock()) ffff9dbf43690800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1784189193.964925:0:3639:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1784189193.964928:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf43f58a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3639:1870854458130304:0@lo:38:kworker.0 00000100:00100000:3.0:1784189193.965059:0:26492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458129920 00000100:00100000:3.0:1784189193.965064:0:26492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458129920 00000100:00100000:3.0:1784189193.965101:0:26492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3803 00000100:00100000:3.0:1784189193.965106:0:26492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc07b5e1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3639:x1870854458129920:12345-0@lo:38:llog_process_th.0 00010000:00080000:3.0:1784189193.965122:0:26492:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 3436 last 0 00000020:00000080:3.0:1784189193.965154:0:26492:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xcc1762b626f8b757 00000004:00100000:3.0:1784189193.965167:0:26492:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1784189193.965252:0:26492:0:(import.c:65:import_set_state_nolock()) ffff9dbf47454800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1784189193.965293:0:26492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc07b5e1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3639:x1870854458129920:12345-0@lo:38:llog_process_th.0 Request processed in 187us (2114us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189193.965300:0:26492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3803 00000040:01000000:0.0:1784189193.965605:0:90960:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:0.0:1784189193.965632:0:90960:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:0.0:1784189193.965704:0:90960:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0x1:0x2:0x0] first idx 24, last_idx 25 00000100:00100000:1.0:1784189193.966050:0:3639:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1784189193.966057:0:3639:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-osp-MDT0000: connect to target with instance 19 00000100:00080000:1.0:1784189193.966065:0:3639:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-osp-MDT0000: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:1.0:1784189193.966070:0:3639:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:1.0:1784189193.966072:0:3639:0:(import.c:65:import_set_state_nolock()) ffff9dbf4512e800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1784189193.966092:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc06b98fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3639:1870854458129920:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1784189193.966150:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf43f58a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1870854458130432:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1784189193.966186:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784189193.966232:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458130432 00000100:00100000:1.0:1784189193.966237:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458130432 00000100:00100000:1.0:1784189193.966267:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3804 00000100:00100000:1.0:1784189193.966274:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc05edaaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3640:x1870854458130432:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1784189193.966298:0:8439:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445576704 avail 1299337216 00000100:00100000:1.0:1784189193.966351:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc05edaaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3640:x1870854458130432:12345-0@lo:41:osp-pre-1-0.0 Request processed in 79us (165us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189193.966364:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3804 00000100:00100000:1.0:1784189193.966399:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf43f58a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1870854458130432:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1784189193.968813:0:7454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1784189193.969049:0:90960:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1784189193.969096:0:90960:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].26, 64 off9856 00000040:00080000:3.0:1784189193.973605:0:90960:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x68:0x0].1, 64 off8256 00000040:00080000:3.0:1784189193.974061:0:90966:0:(llog.c:805:llog_process_thread()) index: 25, lh_last_idx: 26 synced_idx: 0 lgh_last_idx: 26 00000040:00080000:3.0:1784189193.974066:0:90966:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x64:0x0] at index 25 of catalog [0x1:0x2:0x0] 00000040:00080000:3.0:1784189193.974233:0:90966:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0x1:0x2:0x0] first idx 25, last_idx 26 00000040:00080000:3.0:1784189193.974250:0:90966:0:(llog_cat_server.c:902:llog_cat_cleanup()) cancel plain log [0x1:0x64:0x0] at index 25 of catalog [0x1:0x2:0x0] 00000040:00080000:3.0:1784189193.974548:0:90966:0:(llog.c:805:llog_process_thread()) index: 26, lh_last_idx: 26 synced_idx: 26 lgh_last_idx: 26 00000040:00080000:3.0:1784189193.974552:0:90966:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x68:0x0] at index 26 of catalog [0x1:0x2:0x0] 00000020:00000080:1.0:1784189193.976749:0:90960:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1784189193.976763:0:90960:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1784189193.976808:0:90960:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:1.0:1784189193.976832:0:90960:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xcc1762b626f8b75e 00000100:00080000:1.0:1784189193.976842:0:90960:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1784189193.976848:0:90960:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9dc047a82000 using connection 192.168.203.112@tcp/0@lo 00000100:00100000:1.0:1784189193.976885:0:90960:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9dbf43f58a80 x1870854458130560/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1784189193.976944:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf43f58a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3639:1870854458130560:0@lo:8:llog_process_th.0 00000100:00100000:2.0:1784189193.977023:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784189193.977100:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458130560 00000100:00100000:3.0:1784189193.977108:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458130560 00000100:00100000:3.0:1784189193.977150:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4959 00000100:00100000:3.0:1784189193.977156:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc07faa9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3639:x1870854458130560:12345-0@lo:8:llog_process_th.0 00010000:00080000:3.0:1784189193.977181:0:8429:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 3436 last 0 00000020:00000080:3.0:1784189193.977204:0:8429:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xcc1762b626f8b765 00002000:00100000:3.0:1784189193.977216:0:8429:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff9dbf47451000 ocd_connect_flags: 0xa044401443000026 ocd_version: 21136a2 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:3.0:1784189193.977220:0:8429:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:3.0:1784189193.977223:0:8429:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1784189193.977286:0:8429:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1784189193.977305:0:8429:0:(import.c:65:import_set_state_nolock()) ffff9dbf47452000 : changing import state from RECOVER to FULL 00000100:00080000:1.0:1784189193.979981:0:90960:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:1.0:1784189193.980108:0:90960:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1784189193.980117:0:90960:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784189193.980119:0:90960:0:(obd_config.c:1561:class_process_config()) marker 22 (0x2) lustre-OST0000 add osc 00000020:01000000:1.0:1784189193.980133:0:90960:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1784189193.980136:0:90960:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #26 00000020:01000000:1.0:1784189193.980138:0:90960:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1784189193.980139:0:90960:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1784189193.980141:0:90960:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1784189193.980144:0:90960:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784189193.980145:0:90960:0:(obd_config.c:1561:class_process_config()) marker 26 (0x6) lustre sys.timeout 00000020:01000000:1.0:1784189193.980148:0:90960:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1784189193.980153:0:90960:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:1.0:1784189193.980157:0:90960:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784189193.980158:0:90960:0:(obd_config.c:1561:class_process_config()) marker 30 (0x1) lustre-OST0001 add osc 00000020:00000080:1.0:1784189193.980161:0:90960:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1784189193.980165:0:90960:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.203.112@tcp to nid 0x20000c0a8cb70 (192.168.203.112@tcp) 00000020:01000000:1.0:1784189193.980191:0:90960:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:1.0:1784189193.980194:0:90960:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1784189193.980226:0:90960:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff9dbf420019c0) 00000020:00000080:1.0:1784189193.980251:0:90960:0:(obd_config.c:720:class_attach_name()) OBD: dev 27 attached type osp with refcount 2 00000020:00000080:1.0:1784189193.980258:0:90960:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1784189193.980364:0:90960:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:1.0:1784189193.980371:0:90960:0:(osd_handler.c:8929:osd_obd_connect()) connect #7 00000020:00000080:1.0:1784189193.980378:0:90960:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xcc1762b626f8b773 00010000:00080000:1.0:1784189193.980410:0:90960:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9dc06b8e7800@lustre-OST0001-osc-MDT0000: add connection 192.168.203.112@tcp at head 00010000:00010000:1.0:1784189193.980608:0:90960:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-11 is initialized 00000040:01000000:1.0:1784189193.980677:0:90960:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1784189193.980692:0:90960:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:1.0:1784189193.981308:0:90960:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0x1:0x5:0x0] first idx 24, last_idx 25 00000100:00100000:3.0:1784189193.981843:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc07faa9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3639:x1870854458130560:12345-0@lo:8:llog_process_th.0 Request processed in 4680us (4815us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189193.981856:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4959 00000100:00100000:2.0:1784189193.985214:0:3639:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1784189193.985229:0:3639:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 1 00000100:00080000:2.0:1784189193.985243:0:3639:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1784189193.985250:0:3639:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:2.0:1784189193.985254:0:3639:0:(import.c:65:import_set_state_nolock()) ffff9dc047a82000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1784189193.985391:0:3639:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1784189193.985402:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf43f58a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3639:1870854458130560:0@lo:8:llog_process_th.0 00000100:00100000:1.0:1784189193.985657:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc07b5b2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1870854458130688:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1784189193.985723:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784189193.985821:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458130688 00000100:00100000:2.0:1784189193.985828:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458130688 00000100:00100000:2.0:1784189193.985884:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1970 00000100:00100000:2.0:1784189193.985893:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf43f58a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3641:x1870854458130688:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1784189193.985919:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 16014272 pending 0 free 3922481152 avail 3690958848 00000100:00080000:3.0:1784189193.985976:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:0.0:1784189193.986012:0:90966:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1784189193.986080:0:90966:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 3436209760711ns, next at 0ns, rc = 0 00080000:00080000:0.0:1784189193.986087:0:90966:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00100000:2.0:1784189193.986790:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf43f58a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3641:x1870854458130688:12345-0@lo:13:osp-pre-0-0.0 Request processed in 894us (1063us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189193.986801:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1970 00000100:00100000:1.0:1784189193.986917:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc07b5b2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1870854458130688:0@lo:13:osp-pre-0-0.0 00000040:00080000:3.0:1784189193.988895:0:90960:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1784189193.988931:0:90960:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].26, 64 off9856 00000004:00080000:0.0:1784189193.989308:0:90949:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00000040:00080000:3.0:1784189193.989720:0:90960:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6a:0x0].1, 64 off8256 00000040:00080000:1.0:1784189193.990308:0:90968:0:(llog.c:805:llog_process_thread()) index: 25, lh_last_idx: 26 synced_idx: 0 lgh_last_idx: 26 00000040:00080000:1.0:1784189193.990313:0:90968:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x66:0x0] at index 25 of catalog [0x1:0x5:0x0] 00000040:00080000:1.0:1784189193.990490:0:90968:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0x1:0x5:0x0] first idx 25, last_idx 26 00000040:00080000:1.0:1784189193.990507:0:90968:0:(llog_cat_server.c:902:llog_cat_cleanup()) cancel plain log [0x1:0x66:0x0] at index 25 of catalog [0x1:0x5:0x0] 00000040:00080000:1.0:1784189193.990637:0:90968:0:(llog.c:805:llog_process_thread()) index: 26, lh_last_idx: 26 synced_idx: 26 lgh_last_idx: 26 00000040:00080000:1.0:1784189193.990641:0:90968:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x6a:0x0] at index 26 of catalog [0x1:0x5:0x0] 00000020:00000080:3.0:1784189193.993077:0:90960:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1784189193.993226:0:90960:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1784189193.993273:0:90960:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:3.0:1784189193.993300:0:90960:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xcc1762b626f8b77a 00000100:00080000:3.0:1784189193.993311:0:90960:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1784189193.993721:0:90960:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9dc06b8e7800 using connection 192.168.203.112@tcp/0@lo 00000100:00100000:3.0:1784189193.993755:0:90960:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9dc07b5b2d80 x1870854458130816/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1784189193.993820:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc07b5b2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3639:1870854458130816:0@lo:8:llog_process_th.0 00000100:00100000:2.0:1784189193.993887:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1784189193.993947:0:90960:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:3.0:1784189193.994019:0:90960:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1784189193.994024:0:90960:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784189193.994026:0:90960:0:(obd_config.c:1561:class_process_config()) marker 30 (0x2) lustre-OST0001 add osc 00000020:01000000:3.0:1784189193.994029:0:90960:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1784189193.994032:0:90960:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784189193.994033:0:90960:0:(obd_config.c:1561:class_process_config()) marker 35 (0x1) lustre sys.timeout 00000020:00000080:3.0:1784189193.994036:0:90960:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1784189193.994037:0:90960:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1784189193.994040:0:90960:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1784189193.994042:0:90960:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784189193.994043:0:90960:0:(obd_config.c:1561:class_process_config()) marker 35 (0x2) lustre sys.timeout 00000020:01000000:3.0:1784189193.994045:0:90960:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1784189193.994047:0:90960:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784189193.994049:0:90960:0:(obd_config.c:1561:class_process_config()) marker 40 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1784189193.994052:0:90960:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:3.0:1784189193.994092:0:90960:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc07b5b0380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bd553d0d-03e2-4233-b06b-b55bbfa2b954:90960:1870854458130944:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1784189193.994223:0:26166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458130816 00000100:00100000:0.0:1784189193.994231:0:26166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458130816 00000100:00100000:0.0:1784189193.994268:0:26166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4960 00000100:00100000:0.0:1784189193.994276:0:26166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc07faa8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:0+-99:3639:x1870854458130816:12345-0@lo:8:llog_process_th.0 00010000:00080000:0.0:1784189193.994311:0:26166:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 3436 last 0 00000020:00000080:0.0:1784189193.994361:0:26166:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xcc1762b626f8b781 00002000:00100000:0.0:1784189193.995029:0:26166:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff9dc047a87800 ocd_connect_flags: 0xa044401443000026 ocd_version: 21136a2 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:0.0:1784189193.995037:0:26166:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:0.0:1784189193.995040:0:26166:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1784189193.995231:0:26166:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1784189193.995256:0:26166:0:(import.c:65:import_set_state_nolock()) ffff9dc047a84000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1784189193.995417:0:26166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc07faa8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+6:3639:x1870854458130816:12345-0@lo:8:llog_process_th.0 Request processed in 1139us (1527us total) trans 0 rc 0/0 00000100:00100000:0.0:1784189193.995425:0:26166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4960 00000100:00100000:2.0:1784189193.995506:0:3639:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1784189193.995515:0:3639:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 1 00000100:00080000:2.0:1784189193.995522:0:3639:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1784189193.995526:0:3639:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:2.0:1784189193.995529:0:3639:0:(import.c:65:import_set_state_nolock()) ffff9dc06b8e7800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1784189193.995584:0:3639:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1784189193.995619:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc07b5b2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3639:1870854458130816:0@lo:8:llog_process_th.0 00000004:00080000:0.0:1784189193.995955:0:90968:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1784189193.996023:0:90968:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 3436219703763ns, next at 0ns, rc = 0 00080000:00080000:0.0:1784189193.996031:0:90968:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00100000:3.0:1784189193.997316:0:90960:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784189193.997395:0:90960:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dc0718de000 going to sleep for 11 seconds 00000100:00100000:2.0:1784189193.997458:0:90956:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458130944 00000100:00100000:2.0:1784189193.997464:0:90956:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458130944 00000100:00100000:2.0:1784189193.997504:0:90956:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1784189193.997512:0:90956:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc049311c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd553d0d-03e2-4233-b06b-b55bbfa2b954+8:90960:x1870854458130944:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1784189193.997664:0:90956:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc049311c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd553d0d-03e2-4233-b06b-b55bbfa2b954+8:90960:x1870854458130944:12345-0@lo:502:llog_process_th.0 Request processed in 152us (350us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189193.997671:0:90956:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1784189193.997958:0:90960:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc07b5b0380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bd553d0d-03e2-4233-b06b-b55bbfa2b954:90960:1870854458130944:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1784189193.998001:0:90960:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1784189193.998009:0:90960:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784189193.998011:0:90960:0:(obd_config.c:1561:class_process_config()) marker 40 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1784189193.998015:0:90960:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 46 count 46 00000020:01000000:0.0:1784189193.998408:0:90948:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-45 (rc=0) 10000000:01000000:0.0:1784189193.998428:0:90948:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1784189193.998443:0:90948:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff9dc05ec0f200/0xcc1762b626f8b6d2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc1762b626f8b6d9 expref: -99 pid: 90948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189193.998453:0:90948:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: ffff9dc05ec0f200/0xcc1762b626f8b6d2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc1762b626f8b6d9 expref: -99 pid: 90948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784189193.998460:0:90948:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff9dbf43fc9000 from 1 10000000:01000000:0.0:1784189193.998463:0:90948:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1784189193.998495:0:90948:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff9dc05ec0ea00/0xcc1762b626f8b788 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 90948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189193.998502:0:90948:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: ffff9dc05ec0ea00/0xcc1762b626f8b788 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 90948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189193.998524:0:90948:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: ffff9dc05ec0ea00/0xcc1762b626f8b788 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 90948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784189193.998542:0:90948:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc06b98fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd553d0d-03e2-4233-b06b-b55bbfa2b954:90948:1870854458131072:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1784189193.998611:0:90948:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784189193.998638:0:90948:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dc05a5e1840 going to sleep for 11 seconds 00000100:00100000:0.0:1784189193.998667:0:90955:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458131072 00000100:00100000:0.0:1784189193.998672:0:90955:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458131072 00000100:00100000:0.0:1784189193.999347:0:90955:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1784189193.999358:0:90955:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc049310050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd553d0d-03e2-4233-b06b-b55bbfa2b954+8:90948:x1870854458131072:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1784189193.999371:0:90955:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784189193.999386:0:90955:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dc05ec0fa00/0xcc1762b626f8b78f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xcc1762b626f8b788 expref: -99 pid: 90955 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189193.999410:0:90955:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dc05ec0fa00/0xcc1762b626f8b78f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcc1762b626f8b788 expref: 9 pid: 90955 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189193.999419:0:90955:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dc05ec0fa00/0xcc1762b626f8b78f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcc1762b626f8b788 expref: 9 pid: 90955 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189193.999427:0:90955:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc05ec0fa00, rc 0) 00000100:00100000:0.0:1784189193.999470:0:90955:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc049310050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd553d0d-03e2-4233-b06b-b55bbfa2b954+9:90948:x1870854458131072:12345-0@lo:101:mount.lustre.0 Request processed in 115us (859us total) trans 0 rc 0/0 00000100:00100000:0.0:1784189193.999475:0:90955:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1784189193.999682:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1784189193.999693:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc07b5e0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1870854458131200:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1784189193.999733:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784189193.999766:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458131200 00000100:00100000:1.0:1784189193.999772:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458131200 00000100:00100000:1.0:1784189193.999809:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1971 00000100:00100000:1.0:1784189193.999816:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc0477c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3643:x1870854458131200:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1784189193.999836:0:8432:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8649664 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1784189193.999884:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc0477c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3643:x1870854458131200:12345-0@lo:13:osp-pre-1-0.0 Request processed in 68us (151us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189193.999891:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1971 00000100:00100000:1.0:1784189193.999928:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc07b5e0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1870854458131200:0@lo:13:osp-pre-1-0.0 00000100:00080000:1.0:1784189194.000545:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1784189194.000741:0:90948:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc06b98fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd553d0d-03e2-4233-b06b-b55bbfa2b954:90948:1870854458131072:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1784189194.000762:0:90948:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: ffff9dc05ec0ea00/0xcc1762b626f8b788 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc1762b626f8b78f expref: -99 pid: 90948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189194.000772:0:90948:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: ffff9dc05ec0ea00/0xcc1762b626f8b788 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcc1762b626f8b78f expref: -99 pid: 90948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784189194.001781:0:90948:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc07faab480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd553d0d-03e2-4233-b06b-b55bbfa2b954:90948:1870854458131328:0@lo:256:mount.lustre.0 00000100:00100000:2.0:1784189194.001843:0:90948:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784189194.002867:0:90948:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dc045d3c600 going to sleep for 11 seconds 00000004:00080000:2.0:1784189194.003235:0:90949:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000100:00100000:3.0:1784189194.003823:0:90956:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458131328 00000100:00100000:3.0:1784189194.003834:0:90956:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458131328 00000100:00100000:3.0:1784189194.003882:0:90956:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1784189194.003892:0:90956:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc049310c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd553d0d-03e2-4233-b06b-b55bbfa2b954+9:90948:x1870854458131328:12345-0@lo:256:mount.lustre.0 20000000:01000000:3.0:1784189194.003927:0:90956:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:3.0:1784189194.003943:0:90956:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:3.0:1784189194.003947:0:90956:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:3.0:1784189194.003949:0:90956:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:3.0:1784189194.003951:0:90956:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 115 00000100:00100000:3.0:1784189194.004898:0:90956:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc049310c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd553d0d-03e2-4233-b06b-b55bbfa2b954+9:90948:x1870854458131328:12345-0@lo:256:mount.lustre.0 Request processed in 1004us (3050us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189194.004909:0:90956:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1784189194.004988:0:90948:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc07faab480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd553d0d-03e2-4233-b06b-b55bbfa2b954:90948:1870854458131328:0@lo:256:mount.lustre.0 10000000:01000000:2.0:1784189194.005930:0:90948:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1784189194.006008:0:90948:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff9dc05ec0ea00/0xcc1762b626f8b788 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc1762b626f8b78f expref: -99 pid: 90948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189194.006023:0:90948:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: ffff9dc05ec0ea00/0xcc1762b626f8b788 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc1762b626f8b78f expref: -99 pid: 90948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784189194.006046:0:90948:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9dbf43fc9000 from 1 10000000:01000000:2.0:1784189194.006048:0:90948:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1784189194.006080:0:90948:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff9dc04a20b400/0xcc1762b626f8b796 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 90948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189194.006237:0:90948:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: ffff9dc04a20b400/0xcc1762b626f8b796 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 90948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189194.006248:0:90948:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: ffff9dc04a20b400/0xcc1762b626f8b796 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 90948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784189194.006270:0:90948:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc07faab480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd553d0d-03e2-4233-b06b-b55bbfa2b954:90948:1870854458131456:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1784189194.006665:0:90948:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784189194.006706:0:90948:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dc045d3c600 going to sleep for 11 seconds 00000100:00100000:1.0:1784189194.006776:0:90955:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458131456 00000100:00100000:1.0:1784189194.006783:0:90955:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458131456 00000100:00100000:1.0:1784189194.006827:0:90955:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1784189194.006835:0:90955:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc049310850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd553d0d-03e2-4233-b06b-b55bbfa2b954+9:90948:x1870854458131456:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1784189194.006847:0:90955:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784189194.006859:0:90955:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dc07116ec00/0xcc1762b626f8b79d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xcc1762b626f8b796 expref: -99 pid: 90955 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189194.006879:0:90955:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dc07116ec00/0xcc1762b626f8b79d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcc1762b626f8b796 expref: 10 pid: 90955 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189194.006889:0:90955:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dc07116ec00/0xcc1762b626f8b79d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcc1762b626f8b796 expref: 10 pid: 90955 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189194.006897:0:90955:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc07116ec00, rc 0) 00000100:00100000:1.0:1784189194.007010:0:90955:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc049310850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd553d0d-03e2-4233-b06b-b55bbfa2b954+10:90948:x1870854458131456:12345-0@lo:101:mount.lustre.0 Request processed in 175us (345us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189194.007017:0:90955:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1784189194.007210:0:90948:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc07faab480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd553d0d-03e2-4233-b06b-b55bbfa2b954:90948:1870854458131456:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1784189194.007224:0:90948:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: ffff9dc04a20b400/0xcc1762b626f8b796 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc1762b626f8b79d expref: -99 pid: 90948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189194.007233:0:90948:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: ffff9dc04a20b400/0xcc1762b626f8b796 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcc1762b626f8b79d expref: -99 pid: 90948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784189194.007289:0:90948:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc07b5b0380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd553d0d-03e2-4233-b06b-b55bbfa2b954:90948:1870854458131584:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1784189194.007313:0:90948:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784189194.007389:0:90948:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dc0718de6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1784189194.007417:0:90956:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458131584 00000100:00100000:2.0:1784189194.007421:0:90956:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458131584 00000100:00100000:2.0:1784189194.007477:0:90956:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1784189194.007484:0:90956:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc07cbe4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd553d0d-03e2-4233-b06b-b55bbfa2b954+10:90948:x1870854458131584:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1784189194.007587:0:90956:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc07cbe4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd553d0d-03e2-4233-b06b-b55bbfa2b954+10:90948:x1870854458131584:12345-0@lo:501:mount.lustre.0 Request processed in 103us (272us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189194.007593:0:90956:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1784189194.007648:0:90948:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc07b5b0380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd553d0d-03e2-4233-b06b-b55bbfa2b954:90948:1870854458131584:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1784189194.007672:0:90948:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc07b5b0380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd553d0d-03e2-4233-b06b-b55bbfa2b954:90948:1870854458131712:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1784189194.007709:0:90948:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784189194.007845:0:90948:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dc0718de6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1784189194.007915:0:90955:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458131712 00000100:00100000:1.0:1784189194.007918:0:90955:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458131712 00000100:00100000:1.0:1784189194.007936:0:90955:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1784189194.007941:0:90955:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc07cbe7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd553d0d-03e2-4233-b06b-b55bbfa2b954+10:90948:x1870854458131712:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1784189194.008027:0:90955:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc07cbe7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd553d0d-03e2-4233-b06b-b55bbfa2b954+10:90948:x1870854458131712:12345-0@lo:503:mount.lustre.0 Request processed in 84us (316us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189194.008039:0:90955:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1784189194.008110:0:90948:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc07b5b0380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd553d0d-03e2-4233-b06b-b55bbfa2b954:90948:1870854458131712:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1784189194.008581:0:90970:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc07b5b0380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bd553d0d-03e2-4233-b06b-b55bbfa2b954:90970:1870854458131840:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1784189194.008818:0:90970:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784189194.008852:0:90970:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dc0718de300 going to sleep for 11 seconds 00000100:00100000:1.0:1784189194.008896:0:90955:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458131840 00000100:00100000:1.0:1784189194.008901:0:90955:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458131840 00000100:00100000:1.0:1784189194.008921:0:90955:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1784189194.008926:0:90955:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc07cbe5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd553d0d-03e2-4233-b06b-b55bbfa2b954+10:90970:x1870854458131840:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1784189194.009972:0:90955:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc07cbe5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd553d0d-03e2-4233-b06b-b55bbfa2b954+10:90970:x1870854458131840:12345-0@lo:502:llog_process_th.0 Request processed in 1041us (1150us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189194.009983:0:90955:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1784189194.010080:0:90970:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc07b5b0380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bd553d0d-03e2-4233-b06b-b55bbfa2b954:90970:1870854458131840:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1784189194.010122:0:90970:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1784189194.010199:0:90970:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784189194.010203:0:90970:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1784189194.010210:0:90970:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9dbf43fc9000 00000020:00000080:3.0:1784189194.010214:0:90970:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1784189194.010221:0:90970:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1784189194.010224:0:90970:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784189194.010225:0:90970:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:3.0:1784189194.010227:0:90970:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1784189194.010230:0:90970:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784189194.010231:0:90970:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1784189194.010234:0:90970:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9dbf43fc9000 00000020:00000080:3.0:1784189194.010236:0:90970:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1784189194.010642:0:90970:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc07b5b0380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bd553d0d-03e2-4233-b06b-b55bbfa2b954:90970:1870854458131968:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1784189194.010699:0:90970:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784189194.010729:0:90970:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dc0718de300 going to sleep for 11 seconds 00000100:00100000:1.0:1784189194.010917:0:90956:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458131968 00000100:00100000:1.0:1784189194.010923:0:90956:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458131968 00000100:00100000:1.0:1784189194.010971:0:90956:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1784189194.010979:0:90956:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc07cbe4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd553d0d-03e2-4233-b06b-b55bbfa2b954+10:90970:x1870854458131968:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1784189194.011653:0:90970:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc07b5b0380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bd553d0d-03e2-4233-b06b-b55bbfa2b954:90970:1870854458131968:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1784189194.011683:0:90970:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1784189194.011690:0:90970:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784189194.011692:0:90970:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:3.0:1784189194.011696:0:90970:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000100:00100000:1.0:1784189194.011930:0:90956:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc07cbe4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd553d0d-03e2-4233-b06b-b55bbfa2b954+10:90970:x1870854458131968:12345-0@lo:502:llog_process_th.0 Request processed in 948us (1228us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189194.011940:0:90956:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000020:01000000:1.0:1784189194.011984:0:90948:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-6 (rc=0) 10000000:01000000:1.0:1784189194.012016:0:90948:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1784189194.012038:0:90948:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff9dc04a20b400/0xcc1762b626f8b796 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc1762b626f8b79d expref: -99 pid: 90948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189194.012049:0:90948:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: ffff9dc04a20b400/0xcc1762b626f8b796 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc1762b626f8b79d expref: -99 pid: 90948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784189194.012115:0:90948:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1784189194.012118:0:90948:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9dbf43fc9000 10000000:01000000:1.0:1784189194.012122:0:90948:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9dbf43fc9000 10000000:01000000:1.0:1784189194.012877:0:90948:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1784189194.012897:0:90948:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9dbf43fc9000 from 1 10000000:01000000:1.0:1784189194.012900:0:90948:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1784189194.012935:0:90948:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff9dc07116e000/0xcc1762b626f8b7a4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 90948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189194.012945:0:90948:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: ffff9dc07116e000/0xcc1762b626f8b7a4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 90948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189194.012954:0:90948:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: ffff9dc07116e000/0xcc1762b626f8b7a4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 90948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784189194.012976:0:90948:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc0477c3100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd553d0d-03e2-4233-b06b-b55bbfa2b954:90948:1870854458132096:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1784189194.013039:0:90948:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784189194.013077:0:90948:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dc0749d5300 going to sleep for 11 seconds 00000100:00100000:3.0:1784189194.013350:0:90955:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458132096 00000100:00100000:3.0:1784189194.013357:0:90955:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458132096 00000100:00100000:3.0:1784189194.013395:0:90955:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1784189194.013403:0:90955:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc04a4a0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd553d0d-03e2-4233-b06b-b55bbfa2b954+10:90948:x1870854458132096:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1784189194.013414:0:90955:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784189194.013428:0:90955:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dc058f67200/0xcc1762b626f8b7ab lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xcc1762b626f8b7a4 expref: -99 pid: 90955 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189194.013459:0:90955:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dc058f67200/0xcc1762b626f8b7ab lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcc1762b626f8b7a4 expref: 11 pid: 90955 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189194.013469:0:90955:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dc058f67200/0xcc1762b626f8b7ab lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcc1762b626f8b7a4 expref: 11 pid: 90955 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189194.013477:0:90955:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc058f67200, rc 0) 00000100:00100000:3.0:1784189194.013511:0:90955:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc04a4a0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd553d0d-03e2-4233-b06b-b55bbfa2b954+11:90948:x1870854458132096:12345-0@lo:101:mount.lustre.0 Request processed in 109us (472us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189194.013517:0:90955:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1784189194.016798:0:90948:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc0477c3100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd553d0d-03e2-4233-b06b-b55bbfa2b954:90948:1870854458132096:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1784189194.016828:0:90948:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: ffff9dc07116e000/0xcc1762b626f8b7a4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc1762b626f8b7ab expref: -99 pid: 90948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189194.016858:0:90948:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: ffff9dc07116e000/0xcc1762b626f8b7a4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xcc1762b626f8b7ab expref: -99 pid: 90948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784189194.016941:0:90948:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc06b98fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd553d0d-03e2-4233-b06b-b55bbfa2b954:90948:1870854458132224:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1784189194.017009:0:90948:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784189194.017077:0:90948:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dc05a5e13c0 going to sleep for 11 seconds 00000100:00100000:2.0:1784189194.019430:0:90954:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458132224 00000100:00100000:2.0:1784189194.019443:0:90954:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458132224 00000100:00100000:2.0:1784189194.021707:0:90954:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1784189194.021721:0:90954:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc056806c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd553d0d-03e2-4233-b06b-b55bbfa2b954+11:90948:x1870854458132224:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1784189194.021897:0:90954:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc056806c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd553d0d-03e2-4233-b06b-b55bbfa2b954+11:90948:x1870854458132224:12345-0@lo:501:mount.lustre.0 Request processed in 179us (4888us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189194.021916:0:90954:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1784189194.022244:0:90948:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc06b98fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd553d0d-03e2-4233-b06b-b55bbfa2b954:90948:1870854458132224:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1784189194.022297:0:90948:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc06b98fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd553d0d-03e2-4233-b06b-b55bbfa2b954:90948:1870854458132352:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1784189194.022363:0:90948:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784189194.022399:0:90948:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dc05a5e13c0 going to sleep for 11 seconds 00000100:00100000:1.0:1784189194.024469:0:90956:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458132352 00000100:00100000:1.0:1784189194.024483:0:90956:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458132352 00000100:00100000:1.0:1784189194.024541:0:90956:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1784189194.024563:0:90956:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc056804450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd553d0d-03e2-4233-b06b-b55bbfa2b954+11:90948:x1870854458132352:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1784189194.024729:0:90956:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc056804450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd553d0d-03e2-4233-b06b-b55bbfa2b954+11:90948:x1870854458132352:12345-0@lo:503:mount.lustre.0 Request processed in 178us (2364us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189194.024737:0:90956:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1784189194.025093:0:90948:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc06b98fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd553d0d-03e2-4233-b06b-b55bbfa2b954:90948:1870854458132352:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1784189194.030809:0:90973:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc06b98fb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bd553d0d-03e2-4233-b06b-b55bbfa2b954:90973:1870854458132480:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1784189194.030891:0:90973:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784189194.030937:0:90973:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dc080ea9d80 going to sleep for 11 seconds 00000100:00100000:1.0:1784189194.031000:0:90955:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458132480 00000100:00100000:1.0:1784189194.031008:0:90955:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458132480 00000100:00100000:1.0:1784189194.031056:0:90955:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1784189194.031066:0:90955:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc056804c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd553d0d-03e2-4233-b06b-b55bbfa2b954+11:90973:x1870854458132480:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1784189194.031207:0:90955:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc056804c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd553d0d-03e2-4233-b06b-b55bbfa2b954+11:90973:x1870854458132480:12345-0@lo:502:llog_process_th.0 Request processed in 141us (315us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189194.031215:0:90955:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1784189194.031448:0:90973:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc06b98fb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bd553d0d-03e2-4233-b06b-b55bbfa2b954:90973:1870854458132480:0@lo:502:llog_process_th.0 00000020:01000004:0.0:1784189194.031505:0:90973:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:0.0:1784189194.031519:0:90973:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff9dbf44d78000) 00000020:00000080:0.0:1784189194.031542:0:90973:0:(obd_config.c:720:class_attach_name()) OBD: dev 28 attached type lwp with refcount 2 00000020:01000004:0.0:1784189194.031716:0:90973:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9dbf43fc9000 from lustre-MDT0000, refs=4 00000020:01000004:0.0:1784189194.031720:0:90973:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9dbf43fc9000 from lustre-MDT0000, refs=4 00000020:01000004:0.0:1784189194.031723:0:90973:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9dbf43fc9000 4 00010000:00080000:0.0:1784189194.031752:0:90973:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9dc04979c000@lustre-MDT0000-lwp-MDT0000: add connection 192.168.203.112@tcp at head 00010000:00010000:0.0:1784189194.037403:0:90973:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-12 is initialized 00000020:00000080:0.0:1784189194.037510:0:90973:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:0.0:1784189194.037581:0:90973:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1784189194.037596:0:90973:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0xcc1762b626f8b7b9 00000100:00080000:0.0:1784189194.037607:0:90973:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1784189194.037612:0:90973:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff9dc04979c000 using connection 192.168.203.112@tcp/0@lo 00000100:00100000:0.0:1784189194.037647:0:90973:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9dc06b98fb80 x1870854458132608/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1784189194.037680:0:90973:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1784189194.039001:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc06b98fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3639:1870854458132608:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1784189194.039075:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784189194.041305:0:66169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458132608 00000100:00100000:1.0:1784189194.041344:0:66169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458132608 00000100:00100000:1.0:1784189194.041389:0:66169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1269 00000100:00100000:1.0:1784189194.041397:0:66169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc07faa8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3639:x1870854458132608:12345-0@lo:38:llog_process_th.0 00000100:00100000:1.0:1784189194.041489:0:66169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc07faa8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3639:x1870854458132608:12345-0@lo:38:llog_process_th.0 Request processed in 91us (2413us total) trans 0 rc -11/-11 00000100:00100000:1.0:1784189194.041497:0:66169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1269 00000100:00100000:1.0:1784189194.041546:0:3639:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1784189194.041569:0:3639:0:(import.c:65:import_set_state_nolock()) ffff9dc04979c000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1784189194.041574:0:3639:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1784189194.041578:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc06b98fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3639:1870854458132608:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1784189194.042413:0:90973:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc0477c3100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bd553d0d-03e2-4233-b06b-b55bbfa2b954:90973:1870854458132736:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1784189194.042476:0:90973:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784189194.042517:0:90973:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dc0749d5300 going to sleep for 11 seconds 00000100:00100000:0.0:1784189194.042574:0:90954:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458132736 00000100:00100000:0.0:1784189194.042580:0:90954:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458132736 00000100:00100000:0.0:1784189194.042730:0:90954:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1784189194.042739:0:90954:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc056807c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd553d0d-03e2-4233-b06b-b55bbfa2b954+11:90973:x1870854458132736:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1784189194.042856:0:90954:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc056807c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd553d0d-03e2-4233-b06b-b55bbfa2b954+11:90973:x1870854458132736:12345-0@lo:502:llog_process_th.0 Request processed in 118us (378us total) trans 0 rc 0/0 00000100:00100000:0.0:1784189194.042864:0:90954:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1784189194.042961:0:90973:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc0477c3100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bd553d0d-03e2-4233-b06b-b55bbfa2b954:90973:1870854458132736:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1784189194.043017:0:90973:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc0477c3100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bd553d0d-03e2-4233-b06b-b55bbfa2b954:90973:1870854458132864:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1784189194.043050:0:90973:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784189194.043077:0:90973:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dc042407b40 going to sleep for 11 seconds 00000100:00100000:0.0:1784189194.043251:0:90956:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458132864 00000100:00100000:0.0:1784189194.043256:0:90956:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458132864 00000100:00100000:0.0:1784189194.043290:0:90956:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1784189194.043297:0:90956:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc056805850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd553d0d-03e2-4233-b06b-b55bbfa2b954+11:90973:x1870854458132864:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1784189194.043386:0:90956:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc056805850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd553d0d-03e2-4233-b06b-b55bbfa2b954+11:90973:x1870854458132864:12345-0@lo:502:llog_process_th.0 Request processed in 88us (334us total) trans 0 rc 0/0 00000100:00100000:0.0:1784189194.043392:0:90956:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1784189194.043719:0:90973:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc0477c3100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bd553d0d-03e2-4233-b06b-b55bbfa2b954:90973:1870854458132864:0@lo:502:llog_process_th.0 00000040:00080000:1.0:1784189194.043743:0:90973:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:1.0:1784189194.043811:0:90948:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:1.0:1784189194.043828:0:90948:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1784189194.043842:0:90948:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff9dc07116e000/0xcc1762b626f8b7a4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc1762b626f8b7ab expref: -99 pid: 90948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189194.043853:0:90948:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: ffff9dc07116e000/0xcc1762b626f8b7a4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc1762b626f8b7ab expref: -99 pid: 90948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1784189194.043908:0:90948:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1784189194.043910:0:90948:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1784189194.043911:0:90948:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1784189194.043912:0:90948:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1784189194.043914:0:90948:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1784189194.043915:0:90948:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1784189194.043917:0:90948:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1784189194.043918:0:90948:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1784189194.043920:0:90948:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1784189194.043922:0:90948:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1784189194.043925:0:90948:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:1.0:1784189194.043927:0:90948:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1784189194.043928:0:90948:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1784189194.043929:0:90948:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1784189194.043930:0:90948:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1784189194.043931:0:90948:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1784189194.043933:0:90948:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1784189194.043934:0:90948:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1784189194.043935:0:90948:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1784189194.043936:0:90948:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1784189194.043937:0:90948:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1784189194.043954:0:90948:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:1.0:1784189194.043965:0:90948:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc0477c3100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd553d0d-03e2-4233-b06b-b55bbfa2b954:90948:1870854458132992:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1784189194.044010:0:90948:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784189194.044033:0:90948:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dc042407b40 going to sleep for 11 seconds 00000100:00100000:1.0:1784189194.044049:0:90955:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458132992 00000100:00100000:1.0:1784189194.044053:0:90955:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458132992 00000100:00100000:1.0:1784189194.044790:0:90955:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1784189194.044805:0:90955:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc056805c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd553d0d-03e2-4233-b06b-b55bbfa2b954+11:90948:x1870854458132992:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1784189194.044833:0:90955:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:1.0:1784189194.044848:0:90955:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1784189194.054275:0:90955:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1784189194.054295:0:90955:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:0.0:1784189194.054684:0:90955:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc056805c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd553d0d-03e2-4233-b06b-b55bbfa2b954+11:90948:x1870854458132992:12345-0@lo:253:mount.lustre.0 Request processed in 9878us (10668us total) trans 0 rc 0/0 00000100:00100000:0.0:1784189194.054696:0:90955:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1784189194.054792:0:90948:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc0477c3100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd553d0d-03e2-4233-b06b-b55bbfa2b954:90948:1870854458132992:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1784189194.054806:0:90948:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:3.0:1784189194.054810:0:90948:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1784189194.054812:0:90948:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1784189194.054813:0:90948:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1784189194.054814:0:90948:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1784189194.054815:0:90948:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1784189194.054816:0:90948:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1784189194.054818:0:90948:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1784189194.054819:0:90948:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1784189194.054821:0:90948:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1784189194.054822:0:90948:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1784189194.054838:0:90948:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 20000000:01000000:2.0:1784189194.055650:0:90958:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1784189194.055656:0:90958:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1784189194.055675:0:90958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9dc04a20ae00/0xcc1762b626f8b7c0 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 90958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189194.055692:0:90958:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9dc05ec0fa00/0xcc1762b626f8b78f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcc1762b626f8b788 expref: 10 pid: 90955 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189194.055700:0:90958:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9dc04a20ae00/0xcc1762b626f8b7c0 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 90958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189194.055739:0:90958:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9dc05ec0fa00/0xcc1762b626f8b78f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcc1762b626f8b788 expref: 10 pid: 90955 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189194.055871:0:90958:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9dc05ec0fa00/0xcc1762b626f8b78f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcc1762b626f8b788 expref: 10 pid: 90955 timeout: 3536 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784189194.055887:0:90958:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc07faab480 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:90958:1870854458133120:0@lo:104: 00000100:00100000:2.0:1784189194.055936:0:90958:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784189194.055983:0:90958:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dc045d3ce40 going to sleep for 11 seconds 00000100:00100000:3.0:1784189194.056304:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458133120 00000100:00100000:3.0:1784189194.056311:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458133120 00000100:00100000:3.0:1784189194.056382:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 310 00000100:00100000:3.0:1784189194.056391:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc075f7f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:bd553d0d-03e2-4233-b06b-b55bbfa2b954+3:90958:x1870854458133120:12345-0@lo:104: 00010000:00010000:3.0:1784189194.056404:0:6497:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.112@tcp lock: ffff9dc05ec0ea00/0xcc1762b626f8b788 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xcc1762b626f8b78f expref: -99 pid: 90948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189194.056468:0:6497:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1784189194.056474:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc075f7f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:bd553d0d-03e2-4233-b06b-b55bbfa2b954+3:90958:x1870854458133120:12345-0@lo:104: Request processed in 84us (538us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189194.056481:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 310 00010000:00010000:3.0:1784189194.056500:0:6501:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784189194.056505:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.112@tcp lock: ffff9dc05ec0ea00/0xcc1762b626f8b788 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xcc1762b626f8b78f expref: -99 pid: 90948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189194.056513:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc05ec0ea00 already unused, calling callback (ffffffffc114ac20) 10000000:00010000:3.0:1784189194.056517:0:6501:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.112@tcp lock: ffff9dc05ec0ea00/0xcc1762b626f8b788 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xcc1762b626f8b78f expref: -99 pid: 90948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189194.056525:0:6501:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.112@tcp lock: ffff9dc05ec0ea00/0xcc1762b626f8b788 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xcc1762b626f8b78f expref: -99 pid: 90948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1784189194.056533:0:6501:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.112@tcp lock: ffff9dc05ec0ea00/0xcc1762b626f8b788 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xcc1762b626f8b78f expref: -99 pid: 90948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784189194.056539:0:6501:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1784189194.056565:0:6501:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.112@tcp lock: ffff9dc05ec0ea00/0xcc1762b626f8b788 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcc1762b626f8b78f expref: -99 pid: 90948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189194.056572:0:6501:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1784189194.056596:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.112@tcp lock: ffff9dc05ec0ea00/0xcc1762b626f8b788 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcc1762b626f8b78f expref: -99 pid: 90948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189194.056603:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.112@tcp lock: ffff9dc05ec0ea00/0xcc1762b626f8b788 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcc1762b626f8b78f expref: -99 pid: 90948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189194.056628:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784189194.056630:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784189194.056631:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784189194.056746:0:90958:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc07faab480 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:90958:1870854458133120:0@lo:104: 00010000:00010000:2.0:1784189194.056766:0:90958:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9dc04a20ae00/0xcc1762b626f8b7c0 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 90958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784189194.056783:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1784189194.056793:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc07b5b0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bd553d0d-03e2-4233-b06b-b55bbfa2b954:3642:1870854458133248:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1784189194.056831:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784189194.057677:0:25703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458133248 00000100:00100000:3.0:1784189194.057684:0:25703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458133248 00010000:00010000:3.0:1784189194.057705:0:25703:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9dc05ec0fa00/0xcc1762b626f8b78f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcc1762b626f8b788 expref: 11 pid: 90955 timeout: 3536 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784189194.057738:0:25703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2548 00000100:00100000:3.0:1784189194.057746:0:25703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc07faab480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:bd553d0d-03e2-4233-b06b-b55bbfa2b954+11:3642:x1870854458133248:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1784189194.057758:0:25703:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784189194.057763:0:25703:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9dc05ec0fa00/0xcc1762b626f8b78f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcc1762b626f8b788 expref: 11 pid: 90955 timeout: 3536 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189194.057774:0:25703:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9dc05ec0fa00/0xcc1762b626f8b78f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcc1762b626f8b788 expref: 11 pid: 90955 timeout: 3536 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189194.057788:0:25703:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dc05ec0fa00/0xcc1762b626f8b78f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcc1762b626f8b788 expref: 11 pid: 90955 timeout: 3536 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189194.057801:0:25703:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9dc04a20ae00/0xcc1762b626f8b7c0 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 90958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189194.057809:0:25703:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dc04a20ae00/0xcc1762b626f8b7c0 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 90958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1784189194.057822:0:25703:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.009267277s 00010000:00010000:3.0:1784189194.057827:0:25703:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9dc04a20ae00/0xcc1762b626f8b7c0 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 90958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189194.057847:0:25703:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9dc04a20ae00/0xcc1762b626f8b7c0 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 90958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189194.057854:0:25703:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9dc04a20ae00/0xcc1762b626f8b7c0 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 90958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189194.057860:0:25703:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9dc04a20ae00/0xcc1762b626f8b7c0 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 90958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189194.057864:0:25703:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc04a20ae00 already unused, calling callback (ffffffffc0b2e230) 00010000:00010000:3.0:1784189194.057868:0:25703:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9dc04a20ae00/0xcc1762b626f8b7c0 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 90958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189194.057875:0:25703:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9dc04a20ae00/0xcc1762b626f8b7c0 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 90958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189194.057887:0:25703:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9dc04a20ae00/0xcc1762b626f8b7c0 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 90958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189194.057896:0:25703:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784189194.057938:0:25703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc07faab480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:bd553d0d-03e2-4233-b06b-b55bbfa2b954+10:3642:x1870854458133248:12345-0@lo:103:ldlm_bl.0 Request processed in 192us (1105us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189194.057945:0:25703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2548 00010000:00010000:2.0:1784189194.058685:0:90958:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9dc04a20ae00/0xcc1762b626f8b7c0 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 90958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189194.058696:0:90958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9dc04a20ae00/0xcc1762b626f8b7c0 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 90958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189194.058703:0:90958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dc04a20ae00/0xcc1762b626f8b7c0 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 90958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784189194.058748:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc07b5b0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bd553d0d-03e2-4233-b06b-b55bbfa2b954:3642:1870854458133248:0@lo:103:ldlm_bl.0 00000020:00080000:0.0:1784189194.070511:0:90948:0:(update_trans.c:1495:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 73014444062 00000040:01000000:0.0:1784189194.070805:0:90948:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000040:01000000:0.0:1784189194.071288:0:90979:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1784189194.071474:0:90948:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osp-MDT0000 ctxt 16 is initialized 00000100:00100000:1.0:1784189194.071772:0:90980:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc0477c3100 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:90980:1870854458133376:0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1784189194.071851:0:90980:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784189194.071891:0:90980:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dc04812b540 going to sleep for 11 seconds 00000100:00100000:2.0:1784189194.071947:0:26492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458133376 00000100:00100000:2.0:1784189194.071954:0:26492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458133376 00000100:00100000:2.0:1784189194.072018:0:26492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3805 00000100:00100000:2.0:1784189194.072027:0:26492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc07b5e0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:90980:x1870854458133376:12345-0@lo:1000:lod0000_rec0001.0 00000020:00080000:3.0:1784189194.072088:0:90978:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 73014444062 00000020:00080000:3.0:1784189194.072093:0:90978:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 73014444062 00000100:00100000:2.0:1784189194.072115:0:26492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc07b5e0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:90980:x1870854458133376:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 89us (263us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189194.072123:0:26492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3805 00000100:00100000:3.0:1784189194.072152:0:90980:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc0477c3100 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:90980:1870854458133376:0@lo:1000:lod0000_rec0001.0 00000040:01000000:3.0:1784189194.072185:0:90980:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:3.0:1784189194.072213:0:90980:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc07b5b0380 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:90980:1870854458133504:0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1784189194.072259:0:90980:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784189194.072285:0:90980:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dc0715a3a80 going to sleep for 11 seconds 00000040:01000000:0.0:1784189194.072508:0:90948:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:0.0:1784189194.072534:0:90948:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1784189194.072905:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458133504 00000100:00100000:2.0:1784189194.072911:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458133504 00000100:00100000:2.0:1784189194.072955:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3806 00000100:00100000:2.0:1784189194.072963:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc07b5b2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:90980:x1870854458133504:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1784189194.073096:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc07b5b2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:90980:x1870854458133504:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 134us (836us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189194.073102:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3806 00000100:00100000:2.0:1784189194.073143:0:90980:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc07b5b0380 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:90980:1870854458133504:0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1784189194.073203:0:90980:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc080df2680 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:90980:1870854458133632:0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1784189194.073241:0:90980:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784189194.073261:0:26492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458133632 00000100:00100000:2.0:1784189194.073264:0:26492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458133632 00000100:00100000:2.0:1784189194.073282:0:26492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3807 00000100:00100000:2.0:1784189194.073287:0:26492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc080df1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:90980:x1870854458133632:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1784189194.073339:0:26492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc080df1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:90980:x1870854458133632:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 52us (98us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189194.073345:0:26492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3807 00000100:00100000:2.0:1784189194.073360:0:90980:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dc07638fa80 going to sleep for 11 seconds 00000100:00100000:2.0:1784189194.073370:0:90980:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc080df2680 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:90980:1870854458133632:0@lo:1000:lod0000_rec0001.0 00000040:00080000:2.0:1784189194.073406:0:90980:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:0.0:1784189194.074236:0:90948:0:(mdd_device.c:553:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:0.0:1784189194.074248:0:90948:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:0.0:1784189194.074310:0:90948:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1784189194.077037:0:90948:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:0.0:1784189194.077583:0:90948:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:0.0:1784189194.077615:0:90948:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:0.0:1784189194.077721:0:90948:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1784189194.078701:0:90980:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x2400090a4:0x1:0x0] index 261376 count 1 00000004:00080000:2.0:1784189194.078771:0:90980:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osp-MDT0000 retrieved update log, duration 0, retries 0 00080000:10000000:0.0:1784189194.080785:0:90948:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x4d:0x0] (8/32) registered 00000040:00080000:1.0:1784189194.081967:0:90979:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00010000:00080000:0.0:1784189194.083065:0:90948:0:(ldlm_lib.c:3053:target_recovery_init()) RECOVERY: service lustre-MDT0000, 2 recoverable clients, last_transno 107374182407 00010000:00080000:3.0:1784189194.083722:0:90981:0:(ldlm_lib.c:2853:target_recovery_thread()) lustre-MDT0000: started recovery thread pid 90981 00010000:02000000:3.0:1784189194.083735:0:90981:0:(ldlm_lib.c:2335:target_recovery_overseer()) lustre-MDT0000: in recovery but waiting for the first client to connect 00010000:00080000:3.0:1784189194.083739:0:90981:0:(ldlm_lib.c:2545:check_for_recovery_ready()) connected 0 stale 0 max_recoverable_clients 2 abort 0 expired 0 00010000:00080000:3.0:1784189194.083742:0:90981:0:(ldlm_lib.c:2545:check_for_recovery_ready()) connected 0 stale 0 max_recoverable_clients 2 abort 0 expired 0 00000020:01000004:0.0:1784189194.083877:0:90948:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1784189194.083892:0:90948:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.112@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1784189194.083909:0:90948:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=46 00000080:00000004:0.0:1784189194.083928:0:90948:0:(super25.c:181:lustre_fill_super()) /dev/mapper/mds1_flakey: Mount complete 00000020:00000004:0.0:1784189194.084791:0:90948:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1784189194.085010:0:90948:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000040:00080000:1.0:1784189194.085298:0:90979:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x20000a810:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1784189194.085391:0:90979:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:1.0:1784189194.085396:0:90979:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00010000:00080000:1.0:1784189194.085500:0:90981:0:(ldlm_lib.c:2545:check_for_recovery_ready()) connected 0 stale 0 max_recoverable_clients 2 abort 0 expired 0 00000100:00100000:0.0:1784189194.544521:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1784189194.544570:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1784189194.544597:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1784189194.544616:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1784189194.544686:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1784189194.544722:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436281600 00000100:00100000:0.0:1784189194.544731:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436281600 00000100:00100000:0.0:1784189194.544782:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436281728 00000100:00100000:0.0:1784189194.544786:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436281728 00000100:00100000:0.0:1784189194.544809:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 2462 00000100:00100000:0.0:1784189194.544819:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc06b98fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+6:2399:x1870854436281600:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:0.0:1784189194.544880:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc06b98fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+6:2399:x1870854436281600:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 62us (309us total) trans 0 rc 0/0 00000100:00100000:0.0:1784189194.544895:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 2462 00000100:00100000:0.0:1784189194.544913:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 2463 00000100:00100000:0.0:1784189194.544919:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf46903480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+7:2399:x1870854436281728:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:0.0:1784189194.544946:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf46903480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+7:2399:x1870854436281728:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 28us (330us total) trans 0 rc 0/0 00000100:00100000:0.0:1784189194.544952:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 2463 00000100:00100000:0.0:1784189194.544974:0:68287:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436281472 00000100:00100000:0.0:1784189194.544977:0:68287:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436281472 00000100:00100000:0.0:1784189194.545016:0:68287:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436281344 00000100:00100000:0.0:1784189194.545020:0:68287:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436281344 00000100:00100000:0.0:1784189194.545035:0:68287:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1193 00000100:00100000:0.0:1784189194.545042:0:68287:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf46900000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+6:2399:x1870854436281472:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:0.0:1784189194.545067:0:68287:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf46900000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+6:2399:x1870854436281472:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 27us (469us total) trans 0 rc 0/0 00000100:00100000:0.0:1784189194.545073:0:68287:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1193 00000100:00100000:0.0:1784189194.545084:0:68287:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1270 00000100:00100000:0.0:1784189194.545088:0:68287:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc075662680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2395:x1870854436281344:12345-192.168.203.12@tcp:38:kworker.0 00010000:00080000:0.0:1784189194.545137:0:68287:0:(ldlm_lib.c:938:target_handle_reconnect()) connect export for UUID 'b90fcc1c-0e69-42a4-a116-a71fec7aeb78' at ffff9dc075657000, cookie 0xcc1762b626f8b711 00010000:00080000:0.0:1784189194.545143:0:68287:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from b90fcc1c-0e69-42a4-a116-a71fec7aeb78@192.168.203.12@tcp recovering/t107374182408 exp ffff9dc075657000 cur 3436 last 1784189193 00010000:02000400:0.0:1784189194.545150:0:68287:0:(ldlm_lib.c:2036:target_start_recovery_timer()) lustre-MDT0000: Will be in recovery for at least 1:00, or until 2 clients reconnect 00010000:00080000:0.0:1784189194.545156:0:68287:0:(ldlm_lib.c:2100:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 70 seconds 00000004:00100000:0.0:1784189194.545174:0:68287:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:0.0:1784189194.545305:0:68287:0:(import.c:65:import_set_state_nolock()) ffff9dbf43d8c800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1784189194.545373:0:68287:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc075662680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+6:2395:x1870854436281344:12345-192.168.203.12@tcp:38:kworker.0 Request processed in 281us (684us total) trans 0 rc 0/0 00000100:00100000:0.0:1784189194.545380:0:68287:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1270 00000100:00080000:0.0:1784189194.545403:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1784189194.545408:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1784189194.545410:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1784189194.545608:0:90954:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436281216 00000100:00100000:2.0:1784189194.545613:0:90954:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436281216 00000100:00100000:2.0:1784189194.545642:0:90954:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 37 00000100:00100000:2.0:1784189194.545649:0:90954:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc056807050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9957a2dc-fd88-4a91-bca3-e2b7f365ab0c+9:2399:x1870854436281216:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:2.0:1784189194.545684:0:90954:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc056807050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9957a2dc-fd88-4a91-bca3-e2b7f365ab0c+9:2399:x1870854436281216:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 35us (1172us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189194.545690:0:90954:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 37 00000100:00100000:0.0:1784189194.553664:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1784189194.553744:0:66170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436270336 00000100:00100000:1.0:1784189194.553754:0:66170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436270336 00000100:00100000:1.0:1784189194.553807:0:66170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1271 00000100:00100000:1.0:1784189194.553816:0:66170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc075663800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+6:2395:x1870854436270336:12345-192.168.203.12@tcp:36:mcreate.0 00010000:00080000:1.0:1784189194.553834:0:66170:0:(ldlm_lib.c:3228:target_queue_recovery_request()) Next recovery transno: 107374182408, current: 107374182408, replaying 00000100:00100000:1.0:1784189194.553851:0:66170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc075663800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+6:2395:x1870854436270336:12345-192.168.203.12@tcp:36:mcreate.0 Request processed in 37us (196us total) trans 0 rc 0/-999 00000100:00100000:1.0:1784189194.553858:0:66170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1271 00010000:00080000:3.0:1784189194.553894:0:90981:0:(ldlm_lib.c:2545:check_for_recovery_ready()) connected 1 stale 0 max_recoverable_clients 2 abort 0 expired 0 00010000:00010000:2.0:1784189194.992864:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1784189195.311578:0:6510:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1784189195.311586:0:6510:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff9dbf43fc9000 from 116 10000000:01000000:1.0:1784189195.311592:0:6510:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1784189195.311647:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff9dc07116fa00/0xcc1762b626f8b7c7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189195.311659:0:6510:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: ffff9dc07116fa00/0xcc1762b626f8b7c7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189195.311670:0:6510:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: ffff9dc07116fa00/0xcc1762b626f8b7c7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784189195.311695:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc05f02c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458133760:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1784189195.312054:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784189195.313080:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dbf43f24cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1784189195.316309:0:90955:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458133760 00000100:00100000:0.0:1784189195.316490:0:90955:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458133760 00000100:00100000:0.0:1784189195.316606:0:90955:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1784189195.316618:0:90955:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc056804850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd553d0d-03e2-4233-b06b-b55bbfa2b954+10:6510:x1870854458133760:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784189195.316636:0:90955:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784189195.316657:0:90955:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dc05ec0ec00/0xcc1762b626f8b7ce lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xcc1762b626f8b7c7 expref: -99 pid: 90955 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189195.316684:0:90955:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dc05ec0ec00/0xcc1762b626f8b7ce lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcc1762b626f8b7c7 expref: 11 pid: 90955 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189195.316694:0:90955:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dc05ec0ec00/0xcc1762b626f8b7ce lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcc1762b626f8b7c7 expref: 11 pid: 90955 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189195.316702:0:90955:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc05ec0ec00, rc 0) 00000100:00100000:0.0:1784189195.316779:0:90955:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc056804850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd553d0d-03e2-4233-b06b-b55bbfa2b954+11:6510:x1870854458133760:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 164us (4725us total) trans 0 rc 0/0 00000100:00100000:0.0:1784189195.316786:0:90955:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1784189195.316866:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc05f02c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458133760:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784189195.316884:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: ffff9dc07116fa00/0xcc1762b626f8b7c7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc1762b626f8b7ce expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189195.316893:0:6510:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: ffff9dc07116fa00/0xcc1762b626f8b7c7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcc1762b626f8b7ce expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784189195.316962:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc05f02c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458133888:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1784189195.317013:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784189195.329279:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dbf43f24cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1784189195.330066:0:90954:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458133888 00000100:00100000:2.0:1784189195.330084:0:90954:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458133888 00000100:00100000:2.0:1784189195.330301:0:90954:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1784189195.330310:0:90954:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf469ff450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd553d0d-03e2-4233-b06b-b55bbfa2b954+11:6510:x1870854458133888:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1784189195.330387:0:90954:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1784189195.330412:0:90954:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1784189195.330415:0:90954:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 116 00000100:00100000:2.0:1784189195.330631:0:90954:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf469ff450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd553d0d-03e2-4233-b06b-b55bbfa2b954+11:6510:x1870854458133888:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 321us (13617us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189195.330639:0:90954:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1784189195.335718:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc05f02c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458133888:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1784189195.335977:0:6510:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1784189195.335999:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff9dc07116fa00/0xcc1762b626f8b7c7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc1762b626f8b7ce expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189195.336011:0:6510:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: ffff9dc07116fa00/0xcc1762b626f8b7c7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc1762b626f8b7ce expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784189195.336021:0:6510:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1784189195.336024:0:6510:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9dbf44675800 from 52 10000000:01000000:1.0:1784189195.336026:0:6510:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1784189195.336062:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff9dc07116ee00/0xcc1762b626f8b7d5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189195.336070:0:6510:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: ffff9dc07116ee00/0xcc1762b626f8b7d5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189195.336093:0:6510:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: ffff9dc07116ee00/0xcc1762b626f8b7d5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784189195.336113:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc05f02c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458134016:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1784189195.336170:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784189195.336220:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dbf43f24cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1784189195.336234:0:90956:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458134016 00000100:00100000:3.0:1784189195.336243:0:90956:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458134016 00000100:00100000:3.0:1784189195.336302:0:90956:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1784189195.336311:0:90956:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf469ffc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd553d0d-03e2-4233-b06b-b55bbfa2b954+11:6510:x1870854458134016:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784189195.336338:0:90956:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784189195.336351:0:90956:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dc058f67400/0xcc1762b626f8b7dc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xcc1762b626f8b7d5 expref: -99 pid: 90956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189195.336374:0:90956:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dc058f67400/0xcc1762b626f8b7dc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcc1762b626f8b7d5 expref: 12 pid: 90956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189195.336385:0:90956:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dc058f67400/0xcc1762b626f8b7dc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcc1762b626f8b7d5 expref: 12 pid: 90956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189195.336394:0:90956:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc058f67400, rc 0) 00000100:00100000:3.0:1784189195.336683:0:90956:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf469ffc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd553d0d-03e2-4233-b06b-b55bbfa2b954+12:6510:x1870854458134016:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 120us (259us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189195.336690:0:90956:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1784189195.338898:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc05f02c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458134016:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784189195.338926:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: ffff9dc07116ee00/0xcc1762b626f8b7d5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc1762b626f8b7dc expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189195.338939:0:6510:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: ffff9dc07116ee00/0xcc1762b626f8b7d5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xcc1762b626f8b7dc expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784189195.339034:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc05f02c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458134144:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1784189195.339087:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784189195.339126:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dbf43f24cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1784189195.339199:0:90954:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458134144 00000100:00100000:2.0:1784189195.339206:0:90954:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458134144 00000100:00100000:2.0:1784189195.339256:0:90954:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1784189195.339265:0:90954:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf469fd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd553d0d-03e2-4233-b06b-b55bbfa2b954+12:6510:x1870854458134144:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1784189195.339425:0:90954:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf469fd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd553d0d-03e2-4233-b06b-b55bbfa2b954+12:6510:x1870854458134144:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 160us (337us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189195.339443:0:90954:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1784189195.341093:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc05f02c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458134144:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1784189195.341151:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc05f02c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458134272:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1784189195.341221:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784189195.341263:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dbf43f24cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1784189195.341523:0:90955:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458134272 00000100:00100000:0.0:1784189195.341530:0:90955:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458134272 00000100:00100000:0.0:1784189195.341586:0:90955:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1784189195.341596:0:90955:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf469fcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd553d0d-03e2-4233-b06b-b55bbfa2b954+12:6510:x1870854458134272:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1784189195.341775:0:90955:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf469fcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd553d0d-03e2-4233-b06b-b55bbfa2b954+12:6510:x1870854458134272:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 180us (553us total) trans 0 rc 0/0 00000100:00100000:0.0:1784189195.341783:0:90955:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1784189195.345383:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc05f02c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458134272:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1784189195.346639:0:91042:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 51 00000020:01000000:0.0:1784189195.346874:0:6510:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 52-51 (rc=0) 10000000:01000000:0.0:1784189195.346900:0:6510:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1784189195.346910:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff9dc07116ee00/0xcc1762b626f8b7d5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc1762b626f8b7dc expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189195.346921:0:6510:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: ffff9dc07116ee00/0xcc1762b626f8b7d5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc1762b626f8b7dc expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784189195.346930:0:6510:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1784189195.346932:0:6510:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff9dbf44675800 from 113 10000000:01000000:0.0:1784189195.346935:0:6510:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1784189195.346969:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff9dc05ec0f800/0xcc1762b626f8b7e3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189195.346977:0:6510:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: ffff9dc05ec0f800/0xcc1762b626f8b7e3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189195.346996:0:6510:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: ffff9dc05ec0f800/0xcc1762b626f8b7e3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784189195.347019:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc075661880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458134400:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1784189195.358264:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784189195.358380:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dc0749d5b40 going to sleep for 11 seconds 00000100:00100000:3.0:1784189195.361366:0:90956:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458134400 00000100:00100000:3.0:1784189195.361382:0:90956:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458134400 00000100:00100000:2.0:1784189195.361590:0:90956:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1784189195.361601:0:90956:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf469ff850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd553d0d-03e2-4233-b06b-b55bbfa2b954+12:6510:x1870854458134400:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1784189195.361617:0:90956:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784189195.361634:0:90956:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dc04a20b600/0xcc1762b626f8b7ea lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xcc1762b626f8b7e3 expref: -99 pid: 90956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189195.361660:0:90956:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dc04a20b600/0xcc1762b626f8b7ea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcc1762b626f8b7e3 expref: 13 pid: 90956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189195.361670:0:90956:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dc04a20b600/0xcc1762b626f8b7ea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcc1762b626f8b7e3 expref: 13 pid: 90956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189195.361678:0:90956:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc04a20b600, rc 0) 00000100:00100000:2.0:1784189195.361753:0:90956:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf469ff850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd553d0d-03e2-4233-b06b-b55bbfa2b954+13:6510:x1870854458134400:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 154us (3495us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189195.361759:0:90956:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1784189195.361900:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc075661880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458134400:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784189195.361916:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: ffff9dc05ec0f800/0xcc1762b626f8b7e3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc1762b626f8b7ea expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189195.361925:0:6510:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: ffff9dc05ec0f800/0xcc1762b626f8b7e3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xcc1762b626f8b7ea expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784189195.362000:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc07b5b2300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458134528:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1784189195.362038:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784189195.362247:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dbf46a20c00 going to sleep for 11 seconds 00000100:00100000:2.0:1784189195.362298:0:90954:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458134528 00000100:00100000:2.0:1784189195.362303:0:90954:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458134528 00000100:00100000:2.0:1784189195.362360:0:90954:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1784189195.362368:0:90954:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf469fe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd553d0d-03e2-4233-b06b-b55bbfa2b954+13:6510:x1870854458134528:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1784189195.362382:0:90954:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1784189195.362398:0:90954:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1784189195.362402:0:90954:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/4/3. 20000000:01000000:2.0:1784189195.362405:0:90954:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/4/3. 20000000:01000000:2.0:1784189195.362407:0:90954:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/4/3. 20000000:01000000:2.0:1784189195.362410:0:90954:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 116 00000100:00100000:2.0:1784189195.362593:0:90954:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf469fe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd553d0d-03e2-4233-b06b-b55bbfa2b954+13:6510:x1870854458134528:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 225us (553us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189195.362601:0:90954:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1784189195.369685:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc07b5b2300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458134528:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1784189195.369797:0:6510:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1784189195.369807:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff9dc05ec0f800/0xcc1762b626f8b7e3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc1762b626f8b7ea expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189195.369828:0:6510:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: ffff9dc05ec0f800/0xcc1762b626f8b7e3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc1762b626f8b7ea expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784189195.369837:0:6510:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:1.0:1784189195.369840:0:6510:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 46 10000000:01000000:1.0:1784189195.369843:0:6510:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:1.0:1784189195.369881:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff9dc07116e800/0xcc1762b626f8b7f1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189195.369890:0:6510:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: ffff9dc07116e800/0xcc1762b626f8b7f1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189195.369899:0:6510:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: ffff9dc07116e800/0xcc1762b626f8b7f1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784189195.369920:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc05f02c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458134656:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1784189195.369975:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784189195.370022:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dbf43f24cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1784189195.370120:0:90955:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458134656 00000100:00100000:0.0:1784189195.370127:0:90955:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458134656 00000100:00100000:0.0:1784189195.370178:0:90955:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1784189195.370207:0:90955:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc07a90c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd553d0d-03e2-4233-b06b-b55bbfa2b954+13:6510:x1870854458134656:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784189195.370222:0:90955:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784189195.370233:0:90955:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dc05ec0f600/0xcc1762b626f8b7f8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xcc1762b626f8b7f1 expref: -99 pid: 90955 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189195.370255:0:90955:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dc05ec0f600/0xcc1762b626f8b7f8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcc1762b626f8b7f1 expref: 14 pid: 90955 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189195.370265:0:90955:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dc05ec0f600/0xcc1762b626f8b7f8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcc1762b626f8b7f1 expref: 14 pid: 90955 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189195.370273:0:90955:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc05ec0f600, rc 0) 00000100:00100000:0.0:1784189195.370337:0:90955:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc07a90c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd553d0d-03e2-4233-b06b-b55bbfa2b954+14:6510:x1870854458134656:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 112us (341us total) trans 0 rc 0/0 00000100:00100000:0.0:1784189195.370344:0:90955:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1784189195.370688:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc05f02c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458134656:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784189195.370702:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: ffff9dc07116e800/0xcc1762b626f8b7f1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc1762b626f8b7f8 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189195.370710:0:6510:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: ffff9dc07116e800/0xcc1762b626f8b7f1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xcc1762b626f8b7f8 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784189195.370769:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc05f02c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458134784:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1784189195.370796:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784189195.370833:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dbf43f24cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1784189195.370883:0:90956:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458134784 00000100:00100000:2.0:1784189195.370889:0:90956:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458134784 00000100:00100000:2.0:1784189195.370922:0:90956:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1784189195.370929:0:90956:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc07a90e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd553d0d-03e2-4233-b06b-b55bbfa2b954+14:6510:x1870854458134784:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1784189195.371085:0:90956:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc07a90e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd553d0d-03e2-4233-b06b-b55bbfa2b954+14:6510:x1870854458134784:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 156us (287us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189195.371093:0:90956:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1784189195.371364:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc05f02c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458134784:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1784189195.371393:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc05f02c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458134912:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1784189195.371430:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784189195.371441:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dbf43f24cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1784189195.371544:0:90954:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458134912 00000100:00100000:2.0:1784189195.371549:0:90954:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458134912 00000100:00100000:2.0:1784189195.371585:0:90954:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1784189195.371592:0:90954:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc07a90c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd553d0d-03e2-4233-b06b-b55bbfa2b954+14:6510:x1870854458134912:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1784189195.373040:0:90954:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc07a90c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd553d0d-03e2-4233-b06b-b55bbfa2b954+14:6510:x1870854458134912:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 1442us (1603us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189195.373053:0:90954:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1784189195.373381:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc05f02c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458134912:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1784189195.374493:0:91043:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 64768 count 46 00000020:01000000:0.0:1784189195.374729:0:6510:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 46-45 (rc=0) 10000000:01000000:0.0:1784189195.374755:0:6510:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:0.0:1784189195.374766:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff9dc07116e800/0xcc1762b626f8b7f1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc1762b626f8b7f8 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189195.374778:0:6510:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: ffff9dc07116e800/0xcc1762b626f8b7f1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc1762b626f8b7f8 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784189195.374789:0:6510:0:(mgc_request.c:611:do_requeue()) updating log lustre-barrier 10000000:01000000:0.0:1784189195.374792:0:6510:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-barrier-ffff9dbf44675800 from 1 10000000:01000000:0.0:1784189195.374795:0:6510:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:0.0:1784189195.374835:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff9dc05ec0fa00/0xcc1762b626f8b7ff lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189195.374843:0:6510:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: ffff9dc05ec0fa00/0xcc1762b626f8b7ff lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189195.374864:0:6510:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: ffff9dc05ec0fa00/0xcc1762b626f8b7ff lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784189195.374887:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc075661880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458135040:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1784189195.374946:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784189195.374992:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dc08113f9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1784189195.375456:0:90956:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458135040 00000100:00100000:1.0:1784189195.375463:0:90956:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458135040 00000100:00100000:1.0:1784189195.375517:0:90956:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1784189195.375526:0:90956:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc07a90ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd553d0d-03e2-4233-b06b-b55bbfa2b954+14:6510:x1870854458135040:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784189195.375538:0:90956:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784189195.375550:0:90956:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dc07116e600/0xcc1762b626f8b806 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xcc1762b626f8b7ff expref: -99 pid: 90956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189195.375572:0:90956:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dc07116e600/0xcc1762b626f8b806 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcc1762b626f8b7ff expref: 15 pid: 90956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189195.375583:0:90956:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dc07116e600/0xcc1762b626f8b806 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcc1762b626f8b7ff expref: 15 pid: 90956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189195.375591:0:90956:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc07116e600, rc 0) 00000100:00100000:1.0:1784189195.375635:0:90956:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc07a90ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd553d0d-03e2-4233-b06b-b55bbfa2b954+15:6510:x1870854458135040:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 110us (688us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189195.375642:0:90956:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1784189195.375889:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc075661880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458135040:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784189195.375905:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: ffff9dc05ec0fa00/0xcc1762b626f8b7ff lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc1762b626f8b806 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189195.375914:0:6510:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: ffff9dc05ec0fa00/0xcc1762b626f8b7ff lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xcc1762b626f8b806 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784189195.375931:0:6510:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:0.0:1784189195.375935:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff9dc05ec0fa00/0xcc1762b626f8b7ff lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc1762b626f8b806 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189195.375942:0:6510:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: ffff9dc05ec0fa00/0xcc1762b626f8b7ff lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc1762b626f8b806 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784189195.375949:0:6510:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1784189195.375951:0:6510:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9dbf44675800 from 7 10000000:01000000:0.0:1784189195.375953:0:6510:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1784189195.375970:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff9dc05ec0ea00/0xcc1762b626f8b80d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189195.375977:0:6510:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: ffff9dc05ec0ea00/0xcc1762b626f8b80d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189195.376007:0:6510:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: ffff9dc05ec0ea00/0xcc1762b626f8b80d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784189195.376023:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc075661880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458135168:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1784189195.376051:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784189195.376356:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dc08113f9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1784189195.376425:0:90954:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458135168 00000100:00100000:2.0:1784189195.376449:0:90954:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458135168 00000100:00100000:2.0:1784189195.376482:0:90954:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1784189195.376489:0:90954:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc07a90c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd553d0d-03e2-4233-b06b-b55bbfa2b954+15:6510:x1870854458135168:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1784189195.376498:0:90954:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784189195.376508:0:90954:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dc04a20a200/0xcc1762b626f8b814 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xcc1762b626f8b80d expref: -99 pid: 90954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189195.376522:0:90954:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dc04a20a200/0xcc1762b626f8b814 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcc1762b626f8b80d expref: 16 pid: 90954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189195.376530:0:90954:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dc04a20a200/0xcc1762b626f8b814 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcc1762b626f8b80d expref: 16 pid: 90954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189195.376536:0:90954:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc04a20a200, rc 0) 00000100:00100000:2.0:1784189195.376572:0:90954:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc07a90c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd553d0d-03e2-4233-b06b-b55bbfa2b954+16:6510:x1870854458135168:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 84us (520us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189195.376578:0:90954:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1784189195.376692:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc075661880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458135168:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784189195.376704:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: ffff9dc05ec0ea00/0xcc1762b626f8b80d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc1762b626f8b814 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189195.376711:0:6510:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: ffff9dc05ec0ea00/0xcc1762b626f8b80d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xcc1762b626f8b814 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784189195.376766:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc075661880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458135296:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1784189195.376791:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784189195.376817:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dc08113f9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1784189195.376976:0:90956:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458135296 00000100:00100000:1.0:1784189195.376980:0:90956:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458135296 00000100:00100000:1.0:1784189195.377254:0:90956:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1784189195.377263:0:90956:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc07a90f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd553d0d-03e2-4233-b06b-b55bbfa2b954+16:6510:x1870854458135296:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1784189195.377395:0:90956:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc07a90f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd553d0d-03e2-4233-b06b-b55bbfa2b954+16:6510:x1870854458135296:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 133us (602us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189195.377402:0:90956:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1784189195.377469:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc075661880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458135296:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1784189195.377500:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc075661880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458135424:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1784189195.377539:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784189195.390654:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dc08113f9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1784189195.391201:0:90954:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458135424 00000100:00100000:3.0:1784189195.391211:0:90954:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458135424 00000100:00100000:3.0:1784189195.391270:0:90954:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1784189195.391279:0:90954:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc07a90e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd553d0d-03e2-4233-b06b-b55bbfa2b954+16:6510:x1870854458135424:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1784189195.391445:0:90954:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc07a90e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd553d0d-03e2-4233-b06b-b55bbfa2b954+16:6510:x1870854458135424:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 166us (13905us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189195.391453:0:90954:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1784189195.392600:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc075661880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458135424:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1784189195.393570:0:91044:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:0.0:1784189195.393642:0:6510:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:0.0:1784189195.393661:0:6510:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1784189195.393683:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff9dc05ec0ea00/0xcc1762b626f8b80d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc1762b626f8b814 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189195.393695:0:6510:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: ffff9dc05ec0ea00/0xcc1762b626f8b80d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc1762b626f8b814 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784189195.393705:0:6510:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1784189195.393707:0:6510:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9dbf425f7000 from 52 10000000:01000000:0.0:1784189195.393710:0:6510:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1784189195.393746:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff9dc05ec0e800/0xcc1762b626f8b81b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189195.393753:0:6510:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: ffff9dc05ec0e800/0xcc1762b626f8b81b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189195.393762:0:6510:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: ffff9dc05ec0e800/0xcc1762b626f8b81b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784189195.393785:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc075661880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458135552:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1784189195.393846:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784189195.393879:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dc08113fa80 going to sleep for 11 seconds 00000100:00100000:3.0:1784189195.394264:0:90954:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458135552 00000100:00100000:3.0:1784189195.394271:0:90954:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458135552 00000100:00100000:3.0:1784189195.394309:0:90954:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1784189195.394330:0:90954:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc07a90cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd553d0d-03e2-4233-b06b-b55bbfa2b954+16:6510:x1870854458135552:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784189195.394343:0:90954:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784189195.394358:0:90954:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dc058f66600/0xcc1762b626f8b822 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xcc1762b626f8b81b expref: -99 pid: 90954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189195.394380:0:90954:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dc058f66600/0xcc1762b626f8b822 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcc1762b626f8b81b expref: 17 pid: 90954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189195.394406:0:90954:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dc058f66600/0xcc1762b626f8b822 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcc1762b626f8b81b expref: 17 pid: 90954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189195.394415:0:90954:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc058f66600, rc 0) 00000100:00100000:3.0:1784189195.394466:0:90954:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc07a90cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd553d0d-03e2-4233-b06b-b55bbfa2b954+17:6510:x1870854458135552:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 149us (619us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189195.394473:0:90954:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1784189195.395681:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc075661880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458135552:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784189195.395704:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: ffff9dc05ec0e800/0xcc1762b626f8b81b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc1762b626f8b822 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189195.395715:0:6510:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: ffff9dc05ec0e800/0xcc1762b626f8b81b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xcc1762b626f8b822 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784189195.395790:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc075661880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458135680:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1784189195.395849:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784189195.395878:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dc08113fa80 going to sleep for 11 seconds 00000100:00100000:3.0:1784189195.396124:0:90954:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458135680 00000100:00100000:3.0:1784189195.396131:0:90954:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458135680 00000100:00100000:3.0:1784189195.396167:0:90954:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1784189195.396175:0:90954:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc07a90d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd553d0d-03e2-4233-b06b-b55bbfa2b954+17:6510:x1870854458135680:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784189195.396309:0:90954:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc07a90d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd553d0d-03e2-4233-b06b-b55bbfa2b954+17:6510:x1870854458135680:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 133us (458us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189195.396334:0:90954:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1784189195.396375:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc075661880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458135680:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1784189195.396408:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc075661880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458135808:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1784189195.396449:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784189195.396472:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dc08113fa80 going to sleep for 11 seconds 00000100:00100000:3.0:1784189195.396493:0:90954:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458135808 00000100:00100000:3.0:1784189195.396498:0:90954:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458135808 00000100:00100000:3.0:1784189195.396517:0:90954:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1784189195.396522:0:90954:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc07a90d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd553d0d-03e2-4233-b06b-b55bbfa2b954+17:6510:x1870854458135808:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1784189195.396603:0:90954:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc07a90d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd553d0d-03e2-4233-b06b-b55bbfa2b954+17:6510:x1870854458135808:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 80us (153us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189195.396611:0:90954:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1784189195.396787:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc075661880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458135808:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1784189195.398920:0:91045:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 51 00000020:01000000:3.0:1784189195.399370:0:6510:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 52-51 (rc=0) 10000000:01000000:3.0:1784189195.399398:0:6510:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1784189195.399409:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff9dc05ec0e800/0xcc1762b626f8b81b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc1762b626f8b822 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189195.399440:0:6510:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: ffff9dc05ec0e800/0xcc1762b626f8b81b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc1762b626f8b822 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784189195.399450:0:6510:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:3.0:1784189195.399452:0:6510:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 11 10000000:01000000:3.0:1784189195.399456:0:6510:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:3.0:1784189195.399493:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff9dc058f66c00/0xcc1762b626f8b829 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189195.399500:0:6510:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: ffff9dc058f66c00/0xcc1762b626f8b829 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189195.399511:0:6510:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: ffff9dc058f66c00/0xcc1762b626f8b829 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784189195.399534:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc07b5b1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458135936:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1784189195.399594:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784189195.399632:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dbf46a20c00 going to sleep for 11 seconds 00000100:00100000:1.0:1784189195.399740:0:90954:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458135936 00000100:00100000:1.0:1784189195.399747:0:90954:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458135936 00000100:00100000:1.0:1784189195.399795:0:90954:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1784189195.399804:0:90954:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc075a93450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd553d0d-03e2-4233-b06b-b55bbfa2b954+17:6510:x1870854458135936:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784189195.399816:0:90954:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784189195.399829:0:90954:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dc07116f200/0xcc1762b626f8b830 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xcc1762b626f8b829 expref: -99 pid: 90954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189195.399853:0:90954:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dc07116f200/0xcc1762b626f8b830 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcc1762b626f8b829 expref: 18 pid: 90954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189195.399863:0:90954:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dc07116f200/0xcc1762b626f8b830 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcc1762b626f8b829 expref: 18 pid: 90954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189195.399871:0:90954:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc07116f200, rc 0) 00000100:00100000:1.0:1784189195.399915:0:90954:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc075a93450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd553d0d-03e2-4233-b06b-b55bbfa2b954+18:6510:x1870854458135936:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 112us (321us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189195.399922:0:90954:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1784189195.400026:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc07b5b1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458135936:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784189195.400040:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: ffff9dc058f66c00/0xcc1762b626f8b829 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc1762b626f8b830 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189195.400049:0:6510:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: ffff9dc058f66c00/0xcc1762b626f8b829 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xcc1762b626f8b830 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784189195.400113:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc07b5b1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458136064:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784189195.400138:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784189195.400166:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dbf46a20c00 going to sleep for 11 seconds 00000100:00100000:1.0:1784189195.400572:0:90954:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458136064 00000100:00100000:1.0:1784189195.400578:0:90954:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458136064 00000100:00100000:1.0:1784189195.400638:0:90954:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1784189195.400645:0:90954:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc075a90850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd553d0d-03e2-4233-b06b-b55bbfa2b954+18:6510:x1870854458136064:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1784189195.400782:0:90954:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc075a90850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd553d0d-03e2-4233-b06b-b55bbfa2b954+18:6510:x1870854458136064:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 137us (642us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189195.400798:0:90954:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1784189195.400876:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc07b5b1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458136064:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784189195.400909:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc07b5b1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458136192:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1784189195.400950:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784189195.407647:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dbf46a20c00 going to sleep for 11 seconds 00000100:00100000:2.0:1784189195.409958:0:90955:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458136192 00000100:00100000:2.0:1784189195.409972:0:90955:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458136192 00000100:00100000:2.0:1784189195.410043:0:90955:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1784189195.410053:0:90955:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc075a91050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd553d0d-03e2-4233-b06b-b55bbfa2b954+18:6510:x1870854458136192:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1784189195.416529:0:90955:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc075a91050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd553d0d-03e2-4233-b06b-b55bbfa2b954+18:6510:x1870854458136192:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 6468us (15568us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189195.416544:0:90955:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1784189195.416703:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc07b5b1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458136192:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1784189195.417847:0:91046:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 64768 count 11 00000020:01000000:2.0:1784189195.418013:0:6510:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 11-10 (rc=0) 10000000:01000000:2.0:1784189195.418038:0:6510:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:2.0:1784189195.418049:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff9dc058f66c00/0xcc1762b626f8b829 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc1762b626f8b830 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189195.418087:0:6510:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: ffff9dc058f66c00/0xcc1762b626f8b829 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc1762b626f8b830 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784189195.418387:0:6510:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1784189195.418391:0:6510:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9dbf425f7000 from 7 10000000:01000000:2.0:1784189195.418394:0:6510:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1784189195.418431:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff9dc04a20b200/0xcc1762b626f8b837 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189195.418439:0:6510:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: ffff9dc04a20b200/0xcc1762b626f8b837 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189195.418449:0:6510:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: ffff9dc04a20b200/0xcc1762b626f8b837 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784189195.418473:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc080df2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458136320:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1784189195.418529:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784189195.418566:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dc07638fa80 going to sleep for 11 seconds 00000100:00100000:0.0:1784189195.418618:0:90956:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458136320 00000100:00100000:0.0:1784189195.418624:0:90956:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458136320 00000100:00100000:0.0:1784189195.418666:0:90956:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1784189195.418676:0:90956:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc075a91450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd553d0d-03e2-4233-b06b-b55bbfa2b954+18:6510:x1870854458136320:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784189195.418687:0:90956:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784189195.418699:0:90956:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dc05ec0e000/0xcc1762b626f8b83e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xcc1762b626f8b837 expref: -99 pid: 90956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189195.418720:0:90956:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dc05ec0e000/0xcc1762b626f8b83e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcc1762b626f8b837 expref: 19 pid: 90956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189195.418729:0:90956:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dc05ec0e000/0xcc1762b626f8b83e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcc1762b626f8b837 expref: 19 pid: 90956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189195.418737:0:90956:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc05ec0e000, rc 0) 00000100:00100000:0.0:1784189195.418772:0:90956:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc075a91450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd553d0d-03e2-4233-b06b-b55bbfa2b954+19:6510:x1870854458136320:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 97us (243us total) trans 0 rc 0/0 00000100:00100000:0.0:1784189195.418785:0:90956:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1784189195.419500:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc080df2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458136320:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1784189195.419516:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: ffff9dc04a20b200/0xcc1762b626f8b837 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc1762b626f8b83e expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189195.419525:0:6510:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: ffff9dc04a20b200/0xcc1762b626f8b837 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xcc1762b626f8b83e expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784189195.419584:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc080df2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458136448:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1784189195.419617:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784189195.419658:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dc07638fa80 going to sleep for 11 seconds 00000100:00100000:1.0:1784189195.419728:0:90954:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458136448 00000100:00100000:1.0:1784189195.419733:0:90954:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458136448 00000100:00100000:1.0:1784189195.419762:0:90954:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1784189195.419769:0:90954:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc075a92050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd553d0d-03e2-4233-b06b-b55bbfa2b954+19:6510:x1870854458136448:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1784189195.419867:0:90954:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc075a92050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd553d0d-03e2-4233-b06b-b55bbfa2b954+19:6510:x1870854458136448:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 99us (249us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189195.419874:0:90954:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1784189195.420456:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc080df2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458136448:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1784189195.420490:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc080df2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458136576:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1784189195.420536:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784189195.421396:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dc07638fa80 going to sleep for 11 seconds 00000100:00100000:1.0:1784189195.426465:0:90954:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458136576 00000100:00100000:1.0:1784189195.426479:0:90954:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458136576 00000100:00100000:0.0:1784189195.428569:0:90954:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1784189195.428582:0:90954:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf47e72450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd553d0d-03e2-4233-b06b-b55bbfa2b954+19:6510:x1870854458136576:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1784189195.428742:0:90954:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf47e72450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd553d0d-03e2-4233-b06b-b55bbfa2b954+19:6510:x1870854458136576:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 162us (8206us total) trans 0 rc 0/0 00000100:00100000:0.0:1784189195.428749:0:90954:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1784189195.428967:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc080df2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458136576:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1784189195.434206:0:91047:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:2.0:1784189195.434518:0:6510:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:2.0:1784189195.434540:0:6510:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1784189195.434551:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff9dc04a20b200/0xcc1762b626f8b837 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc1762b626f8b83e expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189195.434562:0:6510:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: ffff9dc04a20b200/0xcc1762b626f8b837 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc1762b626f8b83e expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784189195.434572:0:6510:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1784189195.434574:0:6510:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9dc07b5d6800 from 52 10000000:01000000:2.0:1784189195.434577:0:6510:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1784189195.434614:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff9dc04a20a000/0xcc1762b626f8b845 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189195.434621:0:6510:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: ffff9dc04a20a000/0xcc1762b626f8b845 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189195.434631:0:6510:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: ffff9dc04a20a000/0xcc1762b626f8b845 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784189195.434654:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc080df2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458136704:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1784189195.434727:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784189195.434782:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dc07638fa80 going to sleep for 11 seconds 00000100:00100000:0.0:1784189195.434840:0:90955:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458136704 00000100:00100000:0.0:1784189195.434848:0:90955:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458136704 00000100:00100000:0.0:1784189195.434896:0:90955:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1784189195.434905:0:90955:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf47e72050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd553d0d-03e2-4233-b06b-b55bbfa2b954+19:6510:x1870854458136704:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784189195.434916:0:90955:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784189195.434929:0:90955:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dc05ec0fc00/0xcc1762b626f8b84c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xcc1762b626f8b845 expref: -99 pid: 90955 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189195.434951:0:90955:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dc05ec0fc00/0xcc1762b626f8b84c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcc1762b626f8b845 expref: 20 pid: 90955 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189195.434960:0:90955:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dc05ec0fc00/0xcc1762b626f8b84c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcc1762b626f8b845 expref: 20 pid: 90955 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189195.434969:0:90955:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc05ec0fc00, rc 0) 00000100:00100000:0.0:1784189195.435024:0:90955:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf47e72050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd553d0d-03e2-4233-b06b-b55bbfa2b954+20:6510:x1870854458136704:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 119us (296us total) trans 0 rc 0/0 00000100:00100000:0.0:1784189195.435030:0:90955:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1784189195.435289:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc080df2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458136704:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1784189195.435302:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: ffff9dc04a20a000/0xcc1762b626f8b845 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc1762b626f8b84c expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189195.435311:0:6510:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: ffff9dc04a20a000/0xcc1762b626f8b845 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xcc1762b626f8b84c expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784189195.435393:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc080df2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458136832:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1784189195.435418:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784189195.435434:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dc07638fa80 going to sleep for 11 seconds 00000100:00100000:0.0:1784189195.435492:0:90956:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458136832 00000100:00100000:0.0:1784189195.435496:0:90956:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458136832 00000100:00100000:0.0:1784189195.435528:0:90956:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1784189195.435542:0:90956:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf47e71450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd553d0d-03e2-4233-b06b-b55bbfa2b954+20:6510:x1870854458136832:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1784189195.435684:0:90956:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf47e71450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd553d0d-03e2-4233-b06b-b55bbfa2b954+20:6510:x1870854458136832:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 142us (264us total) trans 0 rc 0/0 00000100:00100000:0.0:1784189195.435691:0:90956:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1784189195.435888:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc080df2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458136832:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1784189195.435919:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc05f02c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458136960:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1784189195.435961:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784189195.435999:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dbf43f24c00 going to sleep for 11 seconds 00000100:00100000:2.0:1784189195.436056:0:90955:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458136960 00000100:00100000:2.0:1784189195.436061:0:90955:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458136960 00000100:00100000:2.0:1784189195.436222:0:90955:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1784189195.436230:0:90955:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc0715a9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd553d0d-03e2-4233-b06b-b55bbfa2b954+20:6510:x1870854458136960:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1784189195.436339:0:90955:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc0715a9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd553d0d-03e2-4233-b06b-b55bbfa2b954+20:6510:x1870854458136960:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 88us (355us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189195.436347:0:90955:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1784189195.436390:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc05f02c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458136960:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1784189195.438250:0:91048:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 51 00000020:01000000:2.0:1784189195.438588:0:6510:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 52-51 (rc=0) 10000000:01000000:2.0:1784189195.438612:0:6510:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1784189195.438623:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff9dc04a20a000/0xcc1762b626f8b845 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc1762b626f8b84c expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189195.438635:0:6510:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: ffff9dc04a20a000/0xcc1762b626f8b845 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc1762b626f8b84c expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784189195.438736:0:6510:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:2.0:1784189195.438740:0:6510:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 14 10000000:01000000:2.0:1784189195.438743:0:6510:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:2.0:1784189195.438781:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff9dc04a20ba00/0xcc1762b626f8b853 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189195.438789:0:6510:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: ffff9dc04a20ba00/0xcc1762b626f8b853 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189195.438799:0:6510:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: ffff9dc04a20ba00/0xcc1762b626f8b853 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784189195.438822:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc080df2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458137088:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1784189195.438882:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784189195.438954:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dc07638fa80 going to sleep for 11 seconds 00000100:00100000:0.0:1784189195.439011:0:90955:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458137088 00000100:00100000:0.0:1784189195.439018:0:90955:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458137088 00000100:00100000:0.0:1784189195.439295:0:90955:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1784189195.439305:0:90955:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc05f002c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd553d0d-03e2-4233-b06b-b55bbfa2b954+20:6510:x1870854458137088:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784189195.439340:0:90955:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784189195.439353:0:90955:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dc05ec0e600/0xcc1762b626f8b85a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xcc1762b626f8b853 expref: -99 pid: 90955 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189195.439375:0:90955:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dc05ec0e600/0xcc1762b626f8b85a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcc1762b626f8b853 expref: 21 pid: 90955 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189195.439385:0:90955:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dc05ec0e600/0xcc1762b626f8b85a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcc1762b626f8b853 expref: 21 pid: 90955 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189195.439393:0:90955:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc05ec0e600, rc 0) 00000100:00100000:0.0:1784189195.439490:0:90955:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc05f002c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd553d0d-03e2-4233-b06b-b55bbfa2b954+21:6510:x1870854458137088:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 186us (607us total) trans 0 rc 0/0 00000100:00100000:0.0:1784189195.439496:0:90955:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1784189195.439617:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc080df2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458137088:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1784189195.439631:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: ffff9dc04a20ba00/0xcc1762b626f8b853 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc1762b626f8b85a expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189195.439640:0:6510:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: ffff9dc04a20ba00/0xcc1762b626f8b853 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0xcc1762b626f8b85a expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784189195.439711:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc080df2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458137216:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1784189195.439739:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784189195.439770:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dc07638fa80 going to sleep for 11 seconds 00000100:00100000:1.0:1784189195.439816:0:90954:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458137216 00000100:00100000:1.0:1784189195.439821:0:90954:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458137216 00000100:00100000:1.0:1784189195.439858:0:90954:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1784189195.439865:0:90954:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf455e6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd553d0d-03e2-4233-b06b-b55bbfa2b954+21:6510:x1870854458137216:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1784189195.440009:0:90954:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf455e6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd553d0d-03e2-4233-b06b-b55bbfa2b954+21:6510:x1870854458137216:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 144us (268us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189195.440017:0:90954:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1784189195.440291:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc080df2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458137216:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784189195.440355:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc07b5b1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458137344:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1784189195.440404:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784189195.440422:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dbf46a20000 going to sleep for 11 seconds 00000100:00100000:1.0:1784189195.440482:0:90954:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458137344 00000100:00100000:1.0:1784189195.440487:0:90954:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458137344 00000100:00100000:1.0:1784189195.440506:0:90954:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1784189195.440512:0:90954:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf455e6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd553d0d-03e2-4233-b06b-b55bbfa2b954+21:6510:x1870854458137344:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1784189195.441363:0:90954:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf455e6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd553d0d-03e2-4233-b06b-b55bbfa2b954+21:6510:x1870854458137344:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 847us (954us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189195.441372:0:90954:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1784189195.441614:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc07b5b1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458137344:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1784189195.442912:0:91049:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 64768 count 14 00000020:01000000:3.0:1784189195.443265:0:6510:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 14-13 (rc=0) 10000000:01000000:3.0:1784189195.443294:0:6510:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:3.0:1784189195.443306:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff9dc04a20ba00/0xcc1762b626f8b853 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc1762b626f8b85a expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189195.443514:0:6510:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: ffff9dc04a20ba00/0xcc1762b626f8b853 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc1762b626f8b85a expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784189195.443526:0:6510:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1784189195.443529:0:6510:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9dc07b5d6800 from 7 10000000:01000000:3.0:1784189195.443532:0:6510:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1784189195.443572:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff9dc058f66000/0xcc1762b626f8b861 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189195.443581:0:6510:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: ffff9dc058f66000/0xcc1762b626f8b861 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189195.443590:0:6510:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: ffff9dc058f66000/0xcc1762b626f8b861 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784189195.443626:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc07b5b1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458137472:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1784189195.443756:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784189195.443824:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dbf46a20000 going to sleep for 11 seconds 00000100:00100000:1.0:1784189195.443863:0:90954:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458137472 00000100:00100000:1.0:1784189195.443870:0:90954:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458137472 00000100:00100000:1.0:1784189195.443949:0:90954:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1784189195.443960:0:90954:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf46d28050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd553d0d-03e2-4233-b06b-b55bbfa2b954+21:6510:x1870854458137472:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784189195.443973:0:90954:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784189195.443995:0:90954:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dc07116f600/0xcc1762b626f8b868 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xcc1762b626f8b861 expref: -99 pid: 90954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189195.444018:0:90954:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dc07116f600/0xcc1762b626f8b868 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcc1762b626f8b861 expref: 22 pid: 90954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189195.444029:0:90954:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dc07116f600/0xcc1762b626f8b868 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcc1762b626f8b861 expref: 22 pid: 90954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189195.444038:0:90954:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc07116f600, rc 0) 00000100:00100000:1.0:1784189195.444201:0:90954:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf46d28050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd553d0d-03e2-4233-b06b-b55bbfa2b954+22:6510:x1870854458137472:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 242us (444us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189195.444208:0:90954:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1784189195.444525:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc07b5b1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458137472:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784189195.444540:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: ffff9dc058f66000/0xcc1762b626f8b861 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc1762b626f8b868 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189195.444550:0:6510:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: ffff9dc058f66000/0xcc1762b626f8b861 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xcc1762b626f8b868 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784189195.444612:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc07b5b1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458137600:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784189195.444642:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784189195.444672:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dbf46a20000 going to sleep for 11 seconds 00000100:00100000:2.0:1784189195.444881:0:90955:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458137600 00000100:00100000:2.0:1784189195.444896:0:90955:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458137600 00000100:00100000:2.0:1784189195.444932:0:90955:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1784189195.444939:0:90955:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf46d2ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd553d0d-03e2-4233-b06b-b55bbfa2b954+22:6510:x1870854458137600:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1784189195.445265:0:90955:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf46d2ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd553d0d-03e2-4233-b06b-b55bbfa2b954+22:6510:x1870854458137600:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 326us (621us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189195.445273:0:90955:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1784189195.445513:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc07b5b1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458137600:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1784189195.445549:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc075661880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458137728:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1784189195.445864:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784189195.445935:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dc08113f240 going to sleep for 11 seconds 00000100:00100000:2.0:1784189195.445975:0:90955:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458137728 00000100:00100000:2.0:1784189195.446020:0:90955:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458137728 00000100:00100000:2.0:1784189195.446269:0:90955:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1784189195.446279:0:90955:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf458b9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd553d0d-03e2-4233-b06b-b55bbfa2b954+22:6510:x1870854458137728:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1784189195.446488:0:90955:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf458b9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd553d0d-03e2-4233-b06b-b55bbfa2b954+22:6510:x1870854458137728:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 210us (623us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189195.446496:0:90955:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1784189195.446566:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc075661880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458137728:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1784189195.447649:0:91050:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:1.0:1784189195.447842:0:6510:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:1.0:1784189195.447868:0:6510:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1784189195.447879:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff9dc058f66000/0xcc1762b626f8b861 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc1762b626f8b868 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189195.447889:0:6510:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: ffff9dc058f66000/0xcc1762b626f8b861 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc1762b626f8b868 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784189195.447913:0:6510:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:1.0:1784189195.447916:0:6510:0:(mgc_request.c:1801:mgc_process_log()) Process log nodemap-ffff9dc06bb30000 from 1 10000000:01000000:1.0:1784189195.447919:0:6510:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:1.0:1784189195.447952:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff9dc07116f400/0xcc1762b626f8b86f lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189195.447960:0:6510:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: ffff9dc07116f400/0xcc1762b626f8b86f lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189195.447970:0:6510:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: ffff9dc07116f400/0xcc1762b626f8b86f lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784189195.448001:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc05f02c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458137856:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1784189195.448062:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784189195.448295:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dbf43f24cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1784189195.448410:0:90954:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458137856 00000100:00100000:0.0:1784189195.448416:0:90954:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458137856 00000100:00100000:0.0:1784189195.448450:0:90954:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1784189195.448459:0:90954:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf458bac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd553d0d-03e2-4233-b06b-b55bbfa2b954+22:6510:x1870854458137856:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784189195.448471:0:90954:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784189195.448484:0:90954:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dc05ec0f400/0xcc1762b626f8b876 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xcc1762b626f8b86f expref: -99 pid: 90954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189195.448506:0:90954:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dc05ec0f400/0xcc1762b626f8b876 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcc1762b626f8b86f expref: 23 pid: 90954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189195.448517:0:90954:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dc05ec0f400/0xcc1762b626f8b876 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcc1762b626f8b86f expref: 23 pid: 90954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189195.448524:0:90954:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc05ec0f400, rc 0) 00000100:00100000:0.0:1784189195.448559:0:90954:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf458bac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd553d0d-03e2-4233-b06b-b55bbfa2b954+23:6510:x1870854458137856:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 101us (497us total) trans 0 rc 0/0 00000100:00100000:0.0:1784189195.448566:0:90954:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1784189195.448697:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc05f02c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458137856:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784189195.448712:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: ffff9dc07116f400/0xcc1762b626f8b86f lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc1762b626f8b876 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189195.448721:0:6510:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: ffff9dc07116f400/0xcc1762b626f8b86f lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcc1762b626f8b876 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784189195.448738:0:6510:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:1.0:1784189195.448741:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff9dc07116f400/0xcc1762b626f8b86f lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc1762b626f8b876 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189195.448748:0:6510:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: ffff9dc07116f400/0xcc1762b626f8b86f lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc1762b626f8b876 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784189195.448768:0:6510:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:1.0:1784189195.448770:0:6510:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-sptlrpc-ffff9dc06bb30000 from 1 10000000:01000000:1.0:1784189195.448772:0:6510:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1784189195.448790:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff9dc07116fc00/0xcc1762b626f8b87d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189195.448797:0:6510:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: ffff9dc07116fc00/0xcc1762b626f8b87d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189195.448804:0:6510:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: ffff9dc07116fc00/0xcc1762b626f8b87d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784189195.448818:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc05f02c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458137984:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1784189195.448845:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784189195.448873:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dbf43f24cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1784189195.448978:0:90954:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458137984 00000100:00100000:0.0:1784189195.448992:0:90954:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458137984 00000100:00100000:0.0:1784189195.449022:0:90954:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1784189195.449029:0:90954:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf458b8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd553d0d-03e2-4233-b06b-b55bbfa2b954+23:6510:x1870854458137984:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784189195.449036:0:90954:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784189195.449044:0:90954:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dc05ec0e400/0xcc1762b626f8b884 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0xcc1762b626f8b87d expref: -99 pid: 90954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189195.449295:0:90954:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dc05ec0e400/0xcc1762b626f8b884 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcc1762b626f8b87d expref: 24 pid: 90954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189195.449304:0:90954:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dc05ec0e400/0xcc1762b626f8b884 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcc1762b626f8b87d expref: 24 pid: 90954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189195.449311:0:90954:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc05ec0e400, rc 0) 00000100:00100000:0.0:1784189195.449373:0:90954:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf458b8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd553d0d-03e2-4233-b06b-b55bbfa2b954+24:6510:x1870854458137984:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 344us (527us total) trans 0 rc 0/0 00000100:00100000:0.0:1784189195.449380:0:90954:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1784189195.449464:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc05f02c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458137984:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784189195.449476:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: ffff9dc07116fc00/0xcc1762b626f8b87d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc1762b626f8b884 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189195.449483:0:6510:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: ffff9dc07116fc00/0xcc1762b626f8b87d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0xcc1762b626f8b884 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784189195.449539:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc05f02c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458138112:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1784189195.449564:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784189195.449582:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dbf43f24cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1784189195.449630:0:90956:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458138112 00000100:00100000:3.0:1784189195.449634:0:90956:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458138112 00000100:00100000:3.0:1784189195.449674:0:90956:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1784189195.449682:0:90956:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf458ba450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd553d0d-03e2-4233-b06b-b55bbfa2b954+24:6510:x1870854458138112:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784189195.449763:0:90956:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf458ba450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd553d0d-03e2-4233-b06b-b55bbfa2b954+24:6510:x1870854458138112:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 82us (198us total) trans 0 rc -2/-2 00000100:00100000:3.0:1784189195.449770:0:90956:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1784189195.449919:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc05f02c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458138112:0@lo:501:ll_cfg_requeue.0 10000000:01000000:1.0:1784189195.449947:0:6510:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1784189195.449958:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff9dc07116fc00/0xcc1762b626f8b87d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc1762b626f8b884 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189195.449964:0:6510:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: ffff9dc07116fc00/0xcc1762b626f8b87d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc1762b626f8b884 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784189195.630519:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1784189195.636366:0:90956:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436281856 00000100:00100000:2.0:1784189195.636381:0:90956:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436281856 00000100:00100000:2.0:1784189195.636438:0:90956:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 73 00000100:00100000:2.0:1784189195.636448:0:90956:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf458ba850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9957a2dc-fd88-4a91-bca3-e2b7f365ab0c+9:42415:x1870854436281856:12345-192.168.203.12@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1784189195.636464:0:90956:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784189195.636482:0:90956:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dc04a20a400/0xcc1762b626f8b88b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xcbfc5de7fe6c3e80 expref: -99 pid: 90956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189195.636510:0:90956:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dc04a20a400/0xcc1762b626f8b88b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c3e80 expref: 10 pid: 90956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189195.636522:0:90956:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dc04a20a400/0xcc1762b626f8b88b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c3e80 expref: 10 pid: 90956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189195.636530:0:90956:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc04a20a400, rc 0) 00000100:00100000:2.0:1784189195.636605:0:90956:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf458ba850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9957a2dc-fd88-4a91-bca3-e2b7f365ab0c+10:42415:x1870854436281856:12345-192.168.203.12@tcp:101:ll_cfg_requeue.0 Request processed in 157us (6094us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189195.636612:0:90956:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 73 00000100:00100000:0.0:1784189195.651002:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1784189195.653889:0:90955:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436281984 00000100:00100000:2.0:1784189195.653902:0:90955:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436281984 00000100:00100000:2.0:1784189195.653965:0:90955:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 74 00000100:00100000:2.0:1784189195.653976:0:90955:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf46be7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9957a2dc-fd88-4a91-bca3-e2b7f365ab0c+10:42415:x1870854436281984:12345-192.168.203.12@tcp:256:ll_cfg_requeue.0 20000000:01000000:2.0:1784189195.654008:0:90955:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 16384. 20000000:01000000:2.0:1784189195.654024:0:90955:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1784189195.654028:0:90955:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/4/3. 20000000:01000000:2.0:1784189195.654031:0:90955:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/4/3. 20000000:01000000:2.0:1784189195.654034:0:90955:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/4/3. 20000000:01000000:2.0:1784189195.654036:0:90955:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 116 00000100:00100000:3.0:1784189195.668184:0:90955:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf46be7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9957a2dc-fd88-4a91-bca3-e2b7f365ab0c+10:42415:x1870854436281984:12345-192.168.203.12@tcp:256:ll_cfg_requeue.0 Request processed in 14199us (17193us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189195.668200:0:90955:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 74 00010000:00010000:3.0:1784189196.018680:0:26173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784189197.044442:0:7454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784189197.360193:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc07b5b2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1870854458138240:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1784189197.360270:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784189197.360344:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458138240 00000100:00100000:3.0:1784189197.360352:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458138240 00000100:00100000:3.0:1784189197.360404:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1972 00000100:00100000:3.0:1784189197.360413:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc07b5b0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1870854458138240:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1784189197.360441:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8649664 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1784189197.360484:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc07b5b0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1870854458138240:12345-0@lo:13:osp-pre-1-1.0 Request processed in 71us (214us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189197.360492:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1972 00000100:00080000:3.0:1784189197.360512:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1784189197.360546:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc07b5b2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1870854458138240:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1784189197.362266:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc05f02c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1870854458138368:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1784189197.362337:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784189197.362465:0:9466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458138368 00000100:00100000:1.0:1784189197.362472:0:9466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458138368 00000100:00100000:1.0:1784189197.362517:0:9466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1973 00000100:00100000:1.0:1784189197.362526:0:9466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc080e7c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1870854458138368:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1784189197.362549:0:9466:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 16014272 pending 0 free 3922481152 avail 3690958848 00000100:00100000:1.0:1784189197.362590:0:9466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc080e7c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1870854458138368:12345-0@lo:13:osp-pre-0-1.0 Request processed in 65us (253us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189197.362597:0:9466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1973 00000100:00100000:1.0:1784189197.362637:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc05f02c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1870854458138368:0@lo:13:osp-pre-0-1.0 00000100:00080000:1.0:1784189197.362655:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1784189198.077283:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1784189198.654647:0:91232:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg312-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1784189199.098283:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784189199.409132:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc080e7f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1870854458138496:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1784189199.409215:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784189199.409264:0:26492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458138496 00000100:00100000:1.0:1784189199.409271:0:26492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458138496 00000100:00100000:1.0:1784189199.409336:0:26492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3808 00000100:00100000:1.0:1784189199.409346:0:26492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc080e7c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3642:x1870854458138496:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1784189199.409378:0:26492:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445576704 avail 1299337216 00000100:00100000:1.0:1784189199.409433:0:26492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc080e7c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3642:x1870854458138496:12345-0@lo:41:osp-pre-1-0.0 Request processed in 88us (217us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189199.409440:0:26492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3808 00000100:00100000:1.0:1784189199.409487:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc080e7f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1870854458138496:0@lo:41:osp-pre-1-0.0 00000100:00080000:0.0:1784189199.409693:0:89010:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1784189199.409697:0:89010:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1784189199.409700:0:89010:0:(import.c:65:import_set_state_nolock()) ffff9dbf42271800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1784189199.409707:0:89010:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9dbf42271800 using connection 192.168.203.112@tcp/0@lo 00000100:00100000:0.0:1784189199.409732:0:89010:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9dc06bbf3480 x1870854458138752/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1784189199.409759:0:89010:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1784189199.409763:0:89010:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1784189199.409765:0:89010:0:(import.c:65:import_set_state_nolock()) ffff9dbf425f4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1784189199.409769:0:89010:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9dbf425f4800 using connection 192.168.203.112@tcp/0@lo 00000100:00100000:0.0:1784189199.409780:0:89010:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9dc06bbf3100 x1870854458139008/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1784189199.409811:0:89010:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1784189199.409814:0:89010:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1784189199.409815:0:89010:0:(import.c:65:import_set_state_nolock()) ffff9dbf436c4000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1784189199.409819:0:89010:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3436 00000100:00080000:0.0:1784189199.409822:0:89010:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1784189199.409826:0:89010:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9dbf436c4000 using connection 192.168.203.112@tcp/0@lo 00000100:00100000:0.0:1784189199.409839:0:89010:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9dc080f6c000 x1870854458139264/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1784189199.409859:0:89010:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1784189199.409862:0:89010:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1784189199.409864:0:89010:0:(import.c:65:import_set_state_nolock()) ffff9dbf43690800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1784189199.409868:0:89010:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff9dbf43690800 using connection 192.168.203.112@tcp/0@lo 00000100:00100000:0.0:1784189199.409878:0:89010:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9dbf43c5d180 x1870854458139648/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1784189199.409912:0:89010:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1784189199.409916:0:89010:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1784189199.409918:0:89010:0:(import.c:65:import_set_state_nolock()) ffff9dc04979c000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1784189199.409923:0:89010:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff9dc04979c000 using connection 192.168.203.112@tcp/0@lo 00000100:00100000:0.0:1784189199.409934:0:89010:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9dbf4a342a00 x1870854458140032/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1784189199.409968:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc06bbf2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3640:1870854458138880:0@lo:400:kworker.0 00000100:00100000:0.0:1784189199.410002:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784189199.410024:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf425fad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1870854458139776:0@lo:400:kworker.0 00000100:00100000:0.0:1784189199.410063:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784189199.410083:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1784189199.410089:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc080f6c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3640:1870854458139136:0@lo:400:kworker.0 00000100:00100000:0.0:1784189199.410110:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784189199.410126:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf4a342d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1870854458139904:0@lo:400:kworker.0 00000100:00100000:0.0:1784189199.410151:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784189199.410198:0:66171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458138880 00000100:00100000:0.0:1784189199.410203:0:66171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458138880 00000100:00100000:0.0:1784189199.410234:0:66171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458139136 00000100:00100000:0.0:1784189199.410237:0:66171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458139136 00000100:00100000:0.0:1784189199.410255:0:66171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1194 00000100:00100000:0.0:1784189199.410262:0:66171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf4a340a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1870854458138880:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784189199.410298:0:66171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf4a340a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1870854458138880:12345-0@lo:400:kworker.0 Request processed in 37us (296us total) trans 0 rc 0/0 00000100:00100000:0.0:1784189199.410304:0:66171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1194 00000100:00100000:0.0:1784189199.410336:0:66171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1195 00000100:00100000:0.0:1784189199.410343:0:66171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf4a342300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1870854458139136:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784189199.410371:0:66171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf4a342300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1870854458139136:12345-0@lo:400:kworker.0 Request processed in 29us (260us total) trans 0 rc 0/0 00000100:00100000:0.0:1784189199.410376:0:66171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1195 00000100:00100000:0.0:1784189199.410399:0:26168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458139776 00000100:00100000:0.0:1784189199.410403:0:26168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458139776 00000100:00100000:0.0:1784189199.410426:0:26168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458139904 00000100:00100000:0.0:1784189199.410429:0:26168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458139904 00000100:00100000:0.0:1784189199.410447:0:26168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2464 00000100:00100000:0.0:1784189199.410453:0:26168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf4a340700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+6:3640:x1870854458139776:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784189199.410482:0:26168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf4a340700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+6:3640:x1870854458139776:12345-0@lo:400:kworker.0 Request processed in 29us (418us total) trans 0 rc 0/0 00000100:00100000:0.0:1784189199.410496:0:26168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2464 00000100:00100000:0.0:1784189199.410509:0:26168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2465 00000100:00100000:0.0:1784189199.410515:0:26168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf4a343800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+6:3640:x1870854458139904:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784189199.410543:0:26168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf4a343800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+6:3640:x1870854458139904:12345-0@lo:400:kworker.0 Request processed in 29us (391us total) trans 0 rc 0/0 00000100:00100000:0.0:1784189199.410548:0:26168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2465 00000100:00100000:0.0:1784189199.410595:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc080f6c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3640:1870854458139136:0@lo:400:kworker.0 00000100:00100000:0.0:1784189199.410607:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf4a342d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1870854458139904:0@lo:400:kworker.0 00000100:00100000:0.0:1784189199.410616:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc06bbf2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3640:1870854458138880:0@lo:400:kworker.0 00000100:00100000:0.0:1784189199.410624:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf425fad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1870854458139776:0@lo:400:kworker.0 00000100:00100000:1.0:1784189199.410851:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc06bbf3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3639:1870854458138752:0@lo:38:kworker.0 00000100:00100000:1.0:1784189199.410881:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784189199.410906:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc06bbf3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3639:1870854458139008:0@lo:38:kworker.0 00000100:00100000:1.0:1784189199.410928:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784189199.410946:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc080f6c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3639:1870854458139264:0@lo:38:kworker.0 00000100:00100000:1.0:1784189199.410980:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784189199.410998:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf43c5d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3639:1870854458139648:0@lo:38:kworker.0 00000100:00100000:1.0:1784189199.411021:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784189199.411033:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf4a342a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3639:1870854458140032:0@lo:38:kworker.0 00000100:00100000:1.0:1784189199.411052:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1784189199.411086:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1784189199.411090:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1784189199.411092:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1784189199.411102:0:66170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458138752 00000100:00100000:1.0:1784189199.411106:0:66170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458138752 00000100:00100000:1.0:1784189199.411122:0:66170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458139008 00000100:00100000:1.0:1784189199.411124:0:66170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458139008 00000100:00100000:1.0:1784189199.411132:0:66170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458139648 00000100:00100000:1.0:1784189199.411134:0:66170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458139648 00000100:00100000:1.0:1784189199.411142:0:66170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458140032 00000100:00100000:1.0:1784189199.411145:0:66170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458140032 00000100:00100000:1.0:1784189199.411154:0:66170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1272 00000100:00100000:1.0:1784189199.411159:0:66170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc080e7f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3639:x1870854458138752:12345-0@lo:38:kworker.0 00000100:00100000:2.0:1784189199.411313:0:68287:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1273 00000100:00100000:2.0:1784189199.411350:0:68287:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc05f02c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3639:x1870854458139008:12345-0@lo:38:kworker.0 00010000:00080000:2.0:1784189199.411374:0:68287:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo recovering/t0 exp 0000000000000000 cur 3441 last 0 00000020:00000080:2.0:1784189199.411410:0:68287:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0xcc1762b626f8b892 00000004:00100000:2.0:1784189199.411425:0:68287:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1784189199.411547:0:68287:0:(import.c:65:import_set_state_nolock()) ffff9dc07a882800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1784189199.411594:0:68287:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc05f02c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3639:x1870854458139008:12345-0@lo:38:kworker.0 Request processed in 243us (664us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189199.411601:0:68287:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1273 00000100:00100000:2.0:1784189199.411619:0:68287:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1274 00000100:00100000:2.0:1784189199.411623:0:68287:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf46954a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3639:x1870854458139648:12345-0@lo:38:kworker.0 00010000:00080000:2.0:1784189199.411636:0:68287:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0001_UUID@0@lo recovering/t0 exp 0000000000000000 cur 3441 last 0 00000020:00000080:2.0:1784189199.411668:0:68287:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001_UUID, cookie 0xcc1762b626f8b899 00000004:00100000:2.0:1784189199.411674:0:68287:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1784189199.411693:0:68287:0:(import.c:65:import_set_state_nolock()) ffff9dc07a883000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1784189199.411722:0:68287:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf46954a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1870854458139648:12345-0@lo:38:kworker.0 Request processed in 98us (700us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189199.411729:0:68287:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1274 00000100:00100000:2.0:1784189199.411742:0:68287:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1275 00000100:00100000:2.0:1784189199.411746:0:68287:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf46955500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3639:x1870854458140032:12345-0@lo:38:kworker.0 00010000:00080000:2.0:1784189199.411759:0:68287:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo recovering/t0 exp 0000000000000000 cur 3441 last 0 00000020:00000080:2.0:1784189199.411784:0:68287:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0xcc1762b626f8b8a0 00000004:00100000:2.0:1784189199.411790:0:68287:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1784189199.411803:0:68287:0:(import.c:65:import_set_state_nolock()) ffff9dc075487800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1784189199.411831:0:68287:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf46955500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1870854458140032:12345-0@lo:38:kworker.0 Request processed in 83us (777us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189199.411837:0:68287:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1275 00010000:00080000:1.0:1784189199.412331:0:66170:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo recovering/t0 exp 0000000000000000 cur 3441 last 0 00000020:00000080:1.0:1784189199.412363:0:66170:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0xcc1762b626f8b8a7 00000004:00100000:1.0:1784189199.412372:0:66170:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1784189199.412393:0:66170:0:(import.c:65:import_set_state_nolock()) ffff9dc0715c4000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1784189199.412431:0:66170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc080e7f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1870854458138752:12345-0@lo:38:kworker.0 Request processed in 1270us (1549us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189199.412438:0:66170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1272 00000100:00100000:1.0:1784189199.412469:0:23826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458139264 00000100:00100000:1.0:1784189199.412474:0:23826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458139264 00000100:00100000:1.0:1784189199.412503:0:23826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3809 00000100:00100000:1.0:1784189199.412508:0:23826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc056475880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3639:x1870854458139264:12345-0@lo:38:kworker.0 00010000:00080000:1.0:1784189199.412522:0:23826:0:(ldlm_lib.c:938:target_handle_reconnect()) connect export for UUID 'lustre-MDT0001-mdtlov_UUID' at ffff9dc075654000, cookie 0xcc1762b626f8b718 00010000:00080000:1.0:1784189199.412526:0:23826:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo recovering/t77309411356 exp ffff9dc075654000 cur 3441 last 1784189193 00000004:00100000:1.0:1784189199.412535:0:23826:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1784189199.412550:0:23826:0:(import.c:65:import_set_state_nolock()) ffff9dc0715c2800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1784189199.412592:0:23826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc056475880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3639:x1870854458139264:12345-0@lo:38:kworker.0 Request processed in 82us (1610us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189199.412598:0:23826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3809 00010000:00080000:1.0:1784189199.412617:0:90981:0:(ldlm_lib.c:2545:check_for_recovery_ready()) connected 2 stale 0 max_recoverable_clients 2 abort 0 expired 0 00010000:00080000:1.0:1784189199.412622:0:90981:0:(ldlm_lib.c:2683:replay_request_or_update()) Waiting for transno 107374182408 00000020:00080000:1.0:1784189199.412626:0:90981:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1784189199.412630:0:90981:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 2, connected: 2, completed: 0, queue_len: 1, req_transno: 107374182408, next_transno: 107374182408 00010000:00080000:1.0:1784189199.412634:0:90981:0:(ldlm_lib.c:2246:check_for_next_transno()) waking for next (107374182408) 00000020:00080000:1.0:1784189199.412637:0:90981:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1784189199.412647:0:90981:0:(ldlm_lib.c:2747:replay_request_or_update()) @@@ processing x1870854436270336 t107374182408 from 192.168.203.12@tcp req@ffff9dc075663800 x1870854436270336/t0(107374182408) o36->b90fcc1c-0e69-42a4-a116-a71fec7aeb78@192.168.203.12@tcp:385/0 lens 528/0 e 0 to 0 dl 1784189205 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'mcreate.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784189199.412733:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc075661880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:bd553d0d-03e2-4233-b06b-b55bbfa2b954:3643:1870854458138624:0@lo:400:kworker.0 00000100:00100000:1.0:1784189199.412769:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784189199.412800:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf43c5ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1870854458139520:0@lo:400:kworker.0 00000100:00100000:1.0:1784189199.412825:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784189199.412847:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1784189199.412853:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc080f6e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1870854458139392:0@lo:400:kworker.0 00000100:00100000:1.0:1784189199.412875:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784189199.412905:0:90954:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458138624 00000100:00100000:1.0:1784189199.412908:0:90954:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458138624 00000100:00100000:1.0:1784189199.412938:0:90954:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1784189199.412944:0:90954:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf46be5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd553d0d-03e2-4233-b06b-b55bbfa2b954+24:3643:x1870854458138624:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784189199.412989:0:90954:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf46be5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd553d0d-03e2-4233-b06b-b55bbfa2b954+24:3643:x1870854458138624:12345-0@lo:400:kworker.0 Request processed in 46us (220us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189199.412996:0:90954:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1784189199.413024:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458139520 00000100:00100000:1.0:1784189199.413027:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458139520 00000100:00100000:1.0:1784189199.413056:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458139392 00000100:00100000:1.0:1784189199.413059:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458139392 00000100:00100000:1.0:1784189199.413080:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2466 00000100:00100000:1.0:1784189199.413086:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc05edd7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1870854458139520:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784189199.413116:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc05edd7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1870854458139520:12345-0@lo:400:kworker.0 Request processed in 31us (291us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189199.413122:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2466 00000100:00100000:1.0:1784189199.413133:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2467 00000100:00100000:1.0:1784189199.413139:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc05edd4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1870854458139392:12345-0@lo:400:kworker.0 00010000:00080000:0.0:1784189199.415047:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dc06bbf3480 x1870854458138752/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1784189224 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1784189199.415068:0:3639:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 26 00000100:00080000:0.0:1784189199.415894:0:3639:0:(import.c:1328:ptlrpc_connect_interpret()) @@@ lustre-MDT0000-lwp-OST0000: lwp recover req@ffff9dc06bbf3480 x1870854458138752/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1784189224 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1784189199.415906:0:3639:0:(import.c:65:import_set_state_nolock()) ffff9dbf42271800 lustre-MDT0000_UUID: changing import state from CONNECTING to RECOVER 00000100:00080000:0.0:1784189199.415912:0:3639:0:(import.c:65:import_set_state_nolock()) ffff9dbf42271800 lustre-MDT0000_UUID: changing import state from RECOVER to FULL 00000100:02000000:0.0:1784189199.415916:0:3639:0:(import.c:1743:ptlrpc_import_recovery_state_machine()) lustre-MDT0000-lwp-OST0000: Connection restored to 0@lo (at 0@lo) 00000100:00100000:0.0:1784189199.415923:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc06bbf3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3639:1870854458138752:0@lo:38:kworker.0 00010000:00080000:0.0:1784189199.415945:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dc06bbf3100 x1870854458139008/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1784189224 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1784189199.415972:0:3639:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 26 00000100:00080000:0.0:1784189199.416784:0:3639:0:(import.c:1328:ptlrpc_connect_interpret()) @@@ lustre-MDT0000-lwp-OST0001: lwp recover req@ffff9dc06bbf3100 x1870854458139008/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1784189224 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1784189199.416794:0:3639:0:(import.c:65:import_set_state_nolock()) ffff9dbf425f4800 lustre-MDT0000_UUID: changing import state from CONNECTING to RECOVER 00000100:00080000:0.0:1784189199.416798:0:3639:0:(import.c:65:import_set_state_nolock()) ffff9dbf425f4800 lustre-MDT0000_UUID: changing import state from RECOVER to FULL 00000100:02000000:0.0:1784189199.416801:0:3639:0:(import.c:1743:ptlrpc_import_recovery_state_machine()) lustre-MDT0000-lwp-OST0001: Connection restored to 0@lo (at 0@lo) 00000100:00100000:0.0:1784189199.416806:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc06bbf3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3639:1870854458139008:0@lo:38:kworker.0 00000100:00080000:0.0:1784189199.416833:0:3639:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-osp-MDT0001: connect to target with instance 26 00000100:00080000:0.0:1784189199.416841:0:3639:0:(import.c:65:import_set_state_nolock()) ffff9dbf436c4000 lustre-MDT0000_UUID: changing import state from CONNECTING to REPLAY 00000100:00080000:0.0:1784189199.416845:0:3639:0:(import.c:1700:ptlrpc_import_recovery_state_machine()) replay requested by lustre-MDT0000_UUID 00000100:00100000:0.0:1784189199.416847:0:3639:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 81604378625 gen 3 00000100:00080000:0.0:1784189199.416851:0:3639:0:(recover.c:53:ptlrpc_replay_next()) import ffff9dbf436c4000 from lustre-MDT0000_UUID committed 81604378625 last 0 00000100:00080000:0.0:1784189199.416854:0:3639:0:(import.c:65:import_set_state_nolock()) ffff9dbf436c4000 lustre-MDT0000_UUID: changing import state from REPLAY to REPLAY_LOCKS 00000100:00080000:0.0:1784189199.417031:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1784189199.417036:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1784189199.417063:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc080f6e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1870854458139392:0@lo:400:kworker.0 00000100:00100000:0.0:1784189199.417074:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc075661880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:bd553d0d-03e2-4233-b06b-b55bbfa2b954:3643:1870854458138624:0@lo:400:kworker.0 00000100:00100000:0.0:1784189199.417088:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf43c5ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1870854458139520:0@lo:400:kworker.0 00000100:00100000:1.0:1784189199.417209:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc05edd4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1870854458139392:12345-0@lo:400:kworker.0 Request processed in 37us (300us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189199.417224:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2467 00000004:00080000:3.0:1784189199.421296:0:90981:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 8586us 00000100:00100000:0.0:1784189199.422091:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc080f6c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3639:1870854458139264:0@lo:38:kworker.0 00010000:00080000:0.0:1784189199.422134:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dbf43c5d180 x1870854458139648/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1784189224 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1784189199.422153:0:3639:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0001: connect to target with instance 26 00010000:00080000:2.0:1784189199.426157:0:91263:0:(ldlm_request.c:2972:ldlm_lock_replay_thread()) lock replay thread lustre-MDT0000-osp-MDT0001 to lustre-MDT0000_UUID@0@lo 00010000:00010000:2.0:1784189199.426164:0:91263:0:(ldlm_request.c:2888:ldlm_cancel_unused_locks_for_replay()) Dropping as many unused locks as possible before replay for namespace lustre-MDT0000-osp-MDT0001 (0) 00010000:00010000:2.0:1784189199.426170:0:91263:0:(ldlm_request.c:2901:ldlm_cancel_unused_locks_for_replay()) Canceled 0 unused locks from namespace lustre-MDT0000-osp-MDT0001 00000100:00080000:2.0:1784189199.426590:0:91263:0:(import.c:65:import_set_state_nolock()) ffff9dbf436c4000 lustre-MDT0000_UUID: changing import state from REPLAY_LOCKS to REPLAY_WAIT 00000100:00080000:0.0:1784189199.426830:0:3639:0:(import.c:1328:ptlrpc_connect_interpret()) @@@ lustre-MDT0000-lwp-MDT0001: lwp recover req@ffff9dbf43c5d180 x1870854458139648/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1784189224 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1784189199.426840:0:3639:0:(import.c:65:import_set_state_nolock()) ffff9dbf43690800 lustre-MDT0000_UUID: changing import state from CONNECTING to RECOVER 00000100:00080000:0.0:1784189199.426856:0:3639:0:(import.c:65:import_set_state_nolock()) ffff9dbf43690800 lustre-MDT0000_UUID: changing import state from RECOVER to FULL 00000100:02000000:0.0:1784189199.426861:0:3639:0:(import.c:1743:ptlrpc_import_recovery_state_machine()) lustre-MDT0000-lwp-MDT0001: Connection restored to 0@lo (at 0@lo) 00000100:00100000:0.0:1784189199.426867:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf43c5d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3639:1870854458139648:0@lo:38:kworker.0 00010000:00080000:0.0:1784189199.426904:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dbf4a342a00 x1870854458140032/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1784189209 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1784189199.426921:0:3639:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 26 00000100:00080000:0.0:1784189199.426929:0:3639:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:0.0:1784189199.426934:0:3639:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1784189199.426937:0:3639:0:(import.c:65:import_set_state_nolock()) ffff9dc04979c000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1784189199.426941:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf4a342a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3639:1870854458140032:0@lo:38:kworker.0 00000100:00100000:0.0:1784189199.426985:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc080df2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3639:1870854458140160:0@lo:400:ldlm_lock_repla.0 00000100:00100000:0.0:1784189199.427046:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784189199.427292:0:26492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458140160 00000100:00100000:2.0:1784189199.427299:0:26492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458140160 00000100:00100000:2.0:1784189199.427369:0:26492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3810 00000100:00100000:2.0:1784189199.427377:0:26492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf4a342a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3639:x1870854458140160:12345-0@lo:400:ldlm_lock_repla.0 00010000:00080000:2.0:1784189199.427395:0:26492:0:(ldlm_lib.c:3137:target_queue_recovery_request()) @@@ queue final req req@ffff9dbf4a342a00 x1870854458140160/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:390/0 lens 224/0 e 0 to 0 dl 1784189210 ref 2 fl Interpret:/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784189199.427418:0:26492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf4a342a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3639:x1870854458140160:12345-0@lo:400:ldlm_lock_repla.0 Request processed in 42us (372us total) trans 0 rc 0/-999 00000100:00100000:2.0:1784189199.427426:0:26492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3810 00010000:00010000:2.0:1784189199.452304:0:90981:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04a20a600/0xcc1762b626f8b8ae lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 90981 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189199.452348:0:90981:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04a20a600/0xcc1762b626f8b8ae lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 90981 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189199.452362:0:90981:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04a20a600/0xcc1762b626f8b8ae lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 90981 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189199.452375:0:90981:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04a20b000/0xcc1762b626f8b8b5 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x21e7de2f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 90981 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189199.452382:0:90981:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04a20b000/0xcc1762b626f8b8b5 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x21e7de2f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 90981 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189199.452388:0:90981:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04a20b000/0xcc1762b626f8b8b5 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x21e7de2f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 90981 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189199.452770:0:90981:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04a20a600/0xcc1762b626f8b8ae lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 90981 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189199.452779:0:90981:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04a20a600/0xcc1762b626f8b8ae lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 90981 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189199.452786:0:90981:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04a20a600/0xcc1762b626f8b8ae lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 90981 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189199.452791:0:90981:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc04a20a600 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:2.0:1784189199.452806:0:90981:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04a20a600/0xcc1762b626f8b8ae lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 90981 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189199.452814:0:90981:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04a20a600/0xcc1762b626f8b8ae lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 90981 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189199.452827:0:90981:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9dc04a2a5c00) 00010000:00010000:2.0:1784189199.452831:0:90981:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784189199.452835:0:90981:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04a20a600/0xcc1762b626f8b8ae lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 90981 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189199.452841:0:90981:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04a20a600/0xcc1762b626f8b8ae lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 90981 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1784189199.452858:0:90981:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000007f26622a reply state 00000000dff1fb24 transno 107374182408 ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04a20b000/0xcc1762b626f8b8b5 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x21e7de2f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 90981 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189199.452869:0:90981:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04a20b000/0xcc1762b626f8b8b5 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x21e7de2f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 90981 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189199.452875:0:90981:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x21e7de2f (ffff9dc04a2a5b00) 00010000:00010000:2.0:1784189199.452877:0:90981:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1784189199.452880:0:90981:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:2.0:1784189199.453008:0:90981:0:(ldlm_lib.c:2100:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 101 seconds 00000020:00080000:2.0:1784189199.453029:0:90981:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1784189199.453033:0:90981:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 107374182409 00000020:00080000:2.0:1784189199.453037:0:90981:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1784189199.453039:0:90981:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 107374182409 00000100:00100000:2.0:1784189199.456366:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1784189199.456839:0:68287:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436270848 00000100:00100000:1.0:1784189199.456850:0:68287:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436270848 00000100:00100000:1.0:1784189199.456916:0:68287:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1276 00000100:00100000:1.0:1784189199.456926:0:68287:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf470e2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+8:2395:x1870854436270848:12345-192.168.203.12@tcp:36:rm.0 00010000:00080000:1.0:1784189199.456944:0:68287:0:(ldlm_lib.c:3228:target_queue_recovery_request()) Next recovery transno: 107374182409, current: 107374182409, replaying 00000100:00100000:1.0:1784189199.456965:0:68287:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf470e2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+8:2395:x1870854436270848:12345-192.168.203.12@tcp:36:rm.0 Request processed in 42us (610us total) trans 0 rc 0/-999 00000100:00100000:1.0:1784189199.456973:0:68287:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1276 00000020:00080000:2.0:1784189199.457018:0:90981:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1784189199.457022:0:90981:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 107374182409, next_transno: 107374182409 00010000:00080000:2.0:1784189199.457033:0:90981:0:(ldlm_lib.c:2246:check_for_next_transno()) waking for next (107374182409) 00000020:00080000:2.0:1784189199.457036:0:90981:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1784189199.457045:0:90981:0:(ldlm_lib.c:2747:replay_request_or_update()) @@@ processing x1870854436270848 t107374182409 from 192.168.203.12@tcp req@ffff9dbf470e2d80 x1870854436270848/t0(107374182409) o36->b90fcc1c-0e69-42a4-a116-a71fec7aeb78@192.168.203.12@tcp:390/0 lens 512/0 e 0 to 0 dl 1784189210 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'rm.0' uid:0 gid:0 projid:4294967295 00010000:00010000:2.0:1784189199.457126:0:90981:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04a20ac00/0xcc1762b626f8b8bc lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 90981 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189199.457141:0:90981:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04a20ac00/0xcc1762b626f8b8bc lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 90981 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189199.457152:0:90981:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04a20ac00/0xcc1762b626f8b8bc lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 90981 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189199.457163:0:90981:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04a20b800/0xcc1762b626f8b8c3 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x21e7de2f bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 90981 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189199.457171:0:90981:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04a20b800/0xcc1762b626f8b8c3 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x21e7de2f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 90981 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189199.457178:0:90981:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04a20b800/0xcc1762b626f8b8c3 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x21e7de2f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 90981 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189199.457251:0:90981:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04a20ae00/0xcc1762b626f8b8ca lrc: 3/0,1 mode: --/EX res: [0x20000a811:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 90981 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189199.457258:0:90981:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04a20ae00/0xcc1762b626f8b8ca lrc: 3/0,1 mode: EX/EX res: [0x20000a811:0xa:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 90981 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189199.457264:0:90981:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04a20ae00/0xcc1762b626f8b8ca lrc: 3/0,1 mode: EX/EX res: [0x20000a811:0xa:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 90981 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189199.457507:0:90981:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04a20ae00/0xcc1762b626f8b8ca lrc: 3/0,1 mode: EX/EX res: [0x20000a811:0xa:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 90981 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189199.457522:0:90981:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04a20ae00/0xcc1762b626f8b8ca lrc: 2/0,0 mode: EX/EX res: [0x20000a811:0xa:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 90981 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189199.457529:0:90981:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04a20ae00/0xcc1762b626f8b8ca lrc: 3/0,0 mode: EX/EX res: [0x20000a811:0xa:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 90981 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189199.457535:0:90981:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc04a20ae00 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:2.0:1784189199.457539:0:90981:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04a20ae00/0xcc1762b626f8b8ca lrc: 3/0,0 mode: EX/EX res: [0x20000a811:0xa:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 90981 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189199.457547:0:90981:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04a20ae00/0xcc1762b626f8b8ca lrc: 4/0,0 mode: EX/EX res: [0x20000a811:0xa:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 90981 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189199.457560:0:90981:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0xa:0x0].0x0 (ffff9dc04a2a5900) 00010000:00010000:2.0:1784189199.457562:0:90981:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1784189199.457567:0:90981:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04a20ae00/0xcc1762b626f8b8ca lrc: 2/0,0 mode: --/EX res: [0x20000a811:0xa:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 90981 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189199.457573:0:90981:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04a20ae00/0xcc1762b626f8b8ca lrc: 0/0,0 mode: --/EX res: [0x20000a811:0xa:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 90981 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189199.457593:0:90981:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04a20ac00/0xcc1762b626f8b8bc lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 90981 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189199.457600:0:90981:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04a20ac00/0xcc1762b626f8b8bc lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 90981 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189199.457606:0:90981:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04a20ac00/0xcc1762b626f8b8bc lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 90981 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189199.457611:0:90981:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc04a20ac00 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:2.0:1784189199.457619:0:90981:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04a20ac00/0xcc1762b626f8b8bc lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 90981 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189199.457626:0:90981:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04a20ac00/0xcc1762b626f8b8bc lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 90981 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189199.457634:0:90981:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9dc04a2a5a00) 00010000:00010000:2.0:1784189199.457636:0:90981:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784189199.457639:0:90981:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04a20ac00/0xcc1762b626f8b8bc lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 90981 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189199.457646:0:90981:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04a20ac00/0xcc1762b626f8b8bc lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 90981 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1784189199.457656:0:90981:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000092d8045 reply state 0000000001a2c33d transno 107374182409 ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04a20b800/0xcc1762b626f8b8c3 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x21e7de2f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 90981 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189199.457667:0:90981:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04a20b800/0xcc1762b626f8b8c3 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x21e7de2f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 90981 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189199.457673:0:90981:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x21e7de2f (ffff9dc04a2a5b00) 00010000:00010000:2.0:1784189199.457675:0:90981:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1784189199.457678:0:90981:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:2.0:1784189199.457751:0:90981:0:(ldlm_lib.c:2100:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:2.0:1784189199.457769:0:90981:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1784189199.457771:0:90981:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 107374182410 00000020:00080000:2.0:1784189199.457775:0:90981:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1784189199.457776:0:90981:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 107374182410 00000001:00080000:2.0:1784189199.459526:0:90949:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 107374182408 is committed 00010000:00010000:1.0:1784189199.459749:0:3627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04a20b000/0xcc1762b626f8b8b5 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x21e7de2f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 90981 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189199.459761:0:3627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04a20b000/0xcc1762b626f8b8b5 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x21e7de2f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 90981 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189199.459768:0:3627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04a20b000/0xcc1762b626f8b8b5 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x21e7de2f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 90981 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189199.459773:0:3627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc04a20b000 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:1.0:1784189199.459778:0:3627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04a20b000/0xcc1762b626f8b8b5 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x21e7de2f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 90981 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189199.459785:0:3627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04a20b000/0xcc1762b626f8b8b5 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x21e7de2f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 90981 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189199.459801:0:3627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x21e7de2f (ffff9dc04a2a5b00) 00010000:00010000:1.0:1784189199.459804:0:3627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784189199.459817:0:3627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04a20b000/0xcc1762b626f8b8b5 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x21e7de2f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 90981 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189199.459823:0:3627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04a20b000/0xcc1762b626f8b8b5 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x21e7de2f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 90981 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784189199.465991:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1784189199.466853:0:66945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436272256 00000100:00100000:0.0:1784189199.466865:0:66945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436272256 00000100:00100000:0.0:1784189199.466964:0:66945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1277 00000100:00100000:0.0:1784189199.466975:0:66945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf4a342d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+8:2395:x1870854436272256:12345-192.168.203.12@tcp:36:dd.0 00010000:00080000:0.0:1784189199.466993:0:66945:0:(ldlm_lib.c:3228:target_queue_recovery_request()) Next recovery transno: 107374182410, current: 107374182412, replaying 00000100:00100000:0.0:1784189199.467012:0:66945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf4a342d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+8:2395:x1870854436272256:12345-192.168.203.12@tcp:36:dd.0 Request processed in 41us (1029us total) trans 0 rc 0/-999 00000100:00100000:0.0:1784189199.467020:0:66945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1277 00000020:00080000:3.0:1784189199.467054:0:90981:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1784189199.467058:0:90981:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 107374182412, next_transno: 107374182410 00010000:00080000:3.0:1784189199.467063:0:90981:0:(ldlm_lib.c:2258:check_for_next_transno()) lustre-MDT0000: waking for gap in transno, VBR is OFF (skip: 107374182410, ql: 1, comp: 1, conn: 2, next: 107374182412, next_update 0 last_committed: 107374182408) 00000020:00080000:3.0:1784189199.467068:0:90981:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1784189199.467418:0:90981:0:(ldlm_lib.c:2747:replay_request_or_update()) @@@ processing x1870854436272256 t107374182412 from 192.168.203.12@tcp req@ffff9dbf4a342d80 x1870854436272256/t0(107374182412) o36->b90fcc1c-0e69-42a4-a116-a71fec7aeb78@192.168.203.12@tcp:390/0 lens 488/0 e 0 to 0 dl 1784189210 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:4294967295 00010000:00010000:3.0:1784189199.467772:0:90981:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc058f66800/0xcc1762b626f8b8d1 lrc: 3/0,1 mode: --/PW res: [0x20000a811:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 90981 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189199.467787:0:90981:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc058f66800/0xcc1762b626f8b8d1 lrc: 3/0,1 mode: PW/PW res: [0x20000a811:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 90981 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189199.467804:0:90981:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc058f66800/0xcc1762b626f8b8d1 lrc: 3/0,1 mode: PW/PW res: [0x20000a811:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 90981 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1784189199.467852:0:90981:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 107374182412 00000004:00010000:3.0:1784189199.467873:0:90981:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000c85ac962 reply state 00000000d561e6af transno 107374182412 ns: mdt-lustre-MDT0000_UUID lock: ffff9dc058f66800/0xcc1762b626f8b8d1 lrc: 3/0,1 mode: PW/PW res: [0x20000a811:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 90981 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189199.467887:0:90981:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc058f66800/0xcc1762b626f8b8d1 lrc: 3/0,1 mode: TXN/TXN res: [0x20000a811:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 90981 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189199.467894:0:90981:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x9:0x0].0x0 (ffff9dbf45994c00) 00010000:00010000:3.0:1784189199.467897:0:90981:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1784189199.467900:0:90981:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:3.0:1784189199.468109:0:90981:0:(ldlm_lib.c:2100:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:3.0:1784189199.468117:0:90981:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000020:00080000:3.0:1784189199.468129:0:90981:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1784189199.468131:0:90981:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 107374182413 00000020:00080000:3.0:1784189199.468135:0:90981:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1784189199.468137:0:90981:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 107374182413 00000100:00100000:1.0:1784189199.470911:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1784189199.471150:0:66171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436272640 00000100:00100000:0.0:1784189199.471162:0:66171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436272640 00000100:00100000:0.0:1784189199.471271:0:66171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1278 00000100:00100000:0.0:1784189199.471284:0:66171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf43e11180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+11:2395:x1870854436272640:12345-192.168.203.12@tcp:101:dd.0 00010000:00080000:0.0:1784189199.471596:0:66171:0:(ldlm_lib.c:3228:target_queue_recovery_request()) Next recovery transno: 107374182413, current: 107374182413, replaying 00000100:00100000:0.0:1784189199.471619:0:66171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf43e11180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+11:2395:x1870854436272640:12345-192.168.203.12@tcp:101:dd.0 Request processed in 337us (723us total) trans 0 rc 0/-999 00000100:00100000:0.0:1784189199.471627:0:66171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1278 00000020:00080000:3.0:1784189199.471670:0:90981:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1784189199.471675:0:90981:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 107374182413, next_transno: 107374182413 00010000:00080000:3.0:1784189199.471680:0:90981:0:(ldlm_lib.c:2246:check_for_next_transno()) waking for next (107374182413) 00000020:00080000:3.0:1784189199.471683:0:90981:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1784189199.471694:0:90981:0:(ldlm_lib.c:2747:replay_request_or_update()) @@@ processing x1870854436272640 t107374182413 from 192.168.203.12@tcp req@ffff9dbf43e11180 x1870854436272640/t0(107374182413) o101->b90fcc1c-0e69-42a4-a116-a71fec7aeb78@192.168.203.12@tcp:390/0 lens 640/0 e 0 to 0 dl 1784189210 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00010000:3.0:1784189199.471721:0:90981:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784189199.471750:0:90981:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc058f67c00/0xcc1762b626f8b8d8 lrc: 2/0,0 mode: --/EX res: [0x20000a811:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbfc5de7fe6c3e33 expref: -99 pid: 90981 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189199.471824:0:90981:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc058f67e00/0xcc1762b626f8b8df lrc: 3/0,1 mode: --/EX res: [0x20000a811:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 90981 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189199.471848:0:90981:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc058f67e00/0xcc1762b626f8b8df lrc: 3/0,1 mode: EX/EX res: [0x20000a811:0x9:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 90981 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189199.471863:0:90981:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc058f67e00/0xcc1762b626f8b8df lrc: 3/0,1 mode: EX/EX res: [0x20000a811:0x9:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 90981 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1784189199.472072:0:90981:0:(osp_internal.h:570:osp_update_last_fid()) Gap in objids: start=[0x280000401:0x45d:0x0], count =677 00000004:00080000:3.0:1784189199.472078:0:90981:0:(osp_object.c:1645:osp_create()) Writing gap [0x280000401:0x45d:0x0]+677 in llog 00000004:00080000:3.0:1784189199.472129:0:90981:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x702:0x0], index 0: 0 00000004:00080000:3.0:1784189199.472137:0:90981:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x703:0x0], index 1: 0 00010000:00010000:3.0:1784189199.472243:0:90981:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc058f67e00/0xcc1762b626f8b8df lrc: 3/0,0 mode: CR/CR res: [0x20000a811:0x9:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c3e33 expref: 14 pid: 90981 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189199.472256:0:90981:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x9:0x0].0x0 (ffff9dbf45994c00) 00010000:00010000:3.0:1784189199.472259:0:90981:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:3.0:1784189199.472276:0:90981:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc058f67c00/0xcc1762b626f8b8d8 lrc: 0/0,0 mode: --/EX res: [0x20000a811:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c3e33 expref: 14 pid: 90981 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189199.472294:0:90981:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc058f67e00/0xcc1762b626f8b8df lrc: 3/0,0 mode: CR/CR res: [0x20000a811:0x9:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c3e33 expref: 13 pid: 90981 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189199.472405:0:90981:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x9:0x0].0x0 (ffff9dbf45994c00) 00010000:00010000:3.0:1784189199.472409:0:90981:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:3.0:1784189199.472412:0:90981:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc058f67e00, rc 0) 00010000:00080000:3.0:1784189199.472500:0:90981:0:(ldlm_lib.c:2100:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:3.0:1784189199.472523:0:90981:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1784189199.472526:0:90981:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 107374182414 00000020:00080000:3.0:1784189199.472532:0:90981:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1784189199.472539:0:90981:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 107374182414 00000100:00100000:2.0:1784189199.477637:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1784189199.477740:0:66170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436282112 00000100:00100000:1.0:1784189199.477758:0:66170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436282112 00000100:00100000:1.0:1784189199.477842:0:66170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1196 00000100:00100000:1.0:1784189199.477856:0:66170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf470e2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+13:2395:x1870854436282112:12345-192.168.203.12@tcp:400:ldlm_lock_repla.0 00010000:00080000:1.0:1784189199.477890:0:66170:0:(ldlm_lib.c:3137:target_queue_recovery_request()) @@@ queue final req req@ffff9dbf470e2a00 x1870854436282112/t0(0) o400->b90fcc1c-0e69-42a4-a116-a71fec7aeb78@192.168.203.12@tcp:390/0 lens 224/0 e 0 to 0 dl 1784189210 ref 2 fl Interpret:H/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784189199.477916:0:66170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf470e2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+13:2395:x1870854436282112:12345-192.168.203.12@tcp:400:ldlm_lock_repla.0 Request processed in 63us (289us total) trans 0 rc 0/-999 00000100:00100000:1.0:1784189199.477925:0:66170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1196 00000020:00080000:3.0:1784189199.478290:0:90981:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1784189199.478296:0:90981:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 2, connected: 2, completed: 2, queue_len: 0, req_transno: 0, next_transno: 107374182414 00010000:00080000:3.0:1784189199.478299:0:90981:0:(ldlm_lib.c:2262:check_for_next_transno()) waking for completed recovery 00000020:00080000:3.0:1784189199.478303:0:90981:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1784189199.478312:0:90981:0:(ldlm_lib.c:2452:target_next_replay_lock()) Waiting for lock 00010000:00080000:3.0:1784189199.478315:0:90981:0:(ldlm_lib.c:2285:check_for_next_lock()) waking for completed lock replay 00000001:00000004:3.0:1784189199.478662:0:90981:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 26, last_transno is 111669149696 00000001:00100000:2.0:1784189199.479891:0:90949:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of b90fcc1c-0e69-42a4-a116-a71fec7aeb78 00000001:00100000:2.0:1784189199.479916:0:90949:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000001:00080000:2.0:1784189199.479942:0:90949:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 107374182413 is committed 00010000:00010000:0.0:1784189199.480054:0:3626:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04a20b800/0xcc1762b626f8b8c3 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x21e7de2f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 90981 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189199.480066:0:3626:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04a20b800/0xcc1762b626f8b8c3 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x21e7de2f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 90981 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189199.480074:0:3626:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04a20b800/0xcc1762b626f8b8c3 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x21e7de2f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 90981 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189199.480081:0:3626:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc04a20b800 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:0.0:1784189199.480086:0:3626:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04a20b800/0xcc1762b626f8b8c3 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x21e7de2f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 90981 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189199.480093:0:3626:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04a20b800/0xcc1762b626f8b8c3 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x21e7de2f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 90981 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189199.480113:0:3626:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04a20b800/0xcc1762b626f8b8c3 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x21e7de2f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 90981 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189199.480120:0:3626:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04a20b800/0xcc1762b626f8b8c3 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x21e7de2f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 90981 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189199.480147:0:3626:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc058f66800/0xcc1762b626f8b8d1 lrc: 3/0,1 mode: TXN/TXN res: [0x20000a811:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 90981 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189199.480154:0:3626:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc058f66800/0xcc1762b626f8b8d1 lrc: 2/0,0 mode: TXN/TXN res: [0x20000a811:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 90981 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189199.480169:0:3626:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dc058f66800/0xcc1762b626f8b8d1 lrc: 3/0,0 mode: TXN/TXN res: [0x20000a811:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 90981 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189199.480175:0:3626:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc058f66800 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:0.0:1784189199.480178:0:3626:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc058f66800/0xcc1762b626f8b8d1 lrc: 3/0,0 mode: TXN/TXN res: [0x20000a811:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 90981 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189199.480184:0:3626:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc058f66800/0xcc1762b626f8b8d1 lrc: 4/0,0 mode: TXN/TXN res: [0x20000a811:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 90981 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189199.480196:0:3626:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dc058f66800/0xcc1762b626f8b8d1 lrc: 2/0,0 mode: --/TXN res: [0x20000a811:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 90981 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189199.480202:0:3626:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc058f66800/0xcc1762b626f8b8d1 lrc: 0/0,0 mode: --/TXN res: [0x20000a811:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 90981 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1784189199.480215:0:90981:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00010000:00080000:3.0:1784189199.480276:0:90981:0:(ldlm_lib.c:1996:target_cancel_recovery_timer()) lustre-MDT0000: cancel recovery timer 00010000:00080000:3.0:1784189199.480293:0:90981:0:(ldlm_lib.c:2940:target_recovery_thread()) @@@ processing final ping from 0@lo: req@ffff9dbf4a342a00 x1870854458140160/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:390/0 lens 224/0 e 0 to 0 dl 1784189210 ref 1 fl Complete:/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00080000:3.0:1784189199.480644:0:90981:0:(ldlm_lib.c:2940:target_recovery_thread()) @@@ processing final ping from 192.168.203.12@tcp: req@ffff9dbf470e2a00 x1870854436282112/t0(0) o400->b90fcc1c-0e69-42a4-a116-a71fec7aeb78@192.168.203.12@tcp:390/0 lens 224/0 e 0 to 0 dl 1784189210 ref 1 fl Complete:H/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1784189199.480681:0:3639:0:(import.c:65:import_set_state_nolock()) ffff9dbf436c4000 lustre-MDT0000_UUID: changing import state from REPLAY_WAIT to RECOVER 00000100:00080000:0.0:1784189199.480695:0:3639:0:(client.c:3234:ptlrpc_resend_req()) @@@ going to resend req@ffff9dc080df2680 x1870854458140160/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1784189215 ref 1 fl Interpret:RQU/2c0/0 rc 0/0 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1784189199.480706:0:3639:0:(client.c:3243:ptlrpc_resend_req()) @@@ it has reply, so skip it req@ffff9dc080df2680 x1870854458140160/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1784189215 ref 1 fl Interpret:RQU/2c0/0 rc 0/0 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1784189199.480723:0:3639:0:(import.c:65:import_set_state_nolock()) ffff9dbf436c4000 lustre-MDT0000_UUID: changing import state from RECOVER to FULL 00010000:02000000:3.0:1784189199.480729:0:90981:0:(ldlm_lib.c:1868:target_finish_recovery()) lustre-MDT0000: Recovery over after 0:05, of 2 clients 2 recovered and 0 were evicted. 00000100:02000000:0.0:1784189199.480779:0:3639:0:(import.c:1743:ptlrpc_import_recovery_state_machine()) lustre-MDT0000-osp-MDT0001: Connection restored to 0@lo (at 0@lo) 00000100:00080000:0.0:1784189199.480786:0:3639:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 00000000a722b4a5): req@ffff9dbf44bc1c00 x1870854458118784/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1784189183 ref 1 fl Rpc:RSQU/200/0 rc -107/-107 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784189199.480805:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc080df2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3639:1870854458140160:0@lo:400:ldlm_lock_repla.0 00000100:00100000:0.0:1784189199.480888:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784189199.480990:0:23826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458118784 00000100:00100000:1.0:1784189199.480999:0:23826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458118784 00000100:00100000:1.0:1784189199.481059:0:23826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3811 00000100:00100000:1.0:1784189199.481068:0:23826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf4a343100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3640:x1870854458118784:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1784189199.481101:0:23826:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445281792 avail 1299042304 00000100:00100000:1.0:1784189199.481147:0:23826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf4a343100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3640:x1870854458118784:12345-0@lo:41:osp-pre-0-1.0 Request processed in 80us (259us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189199.481154:0:23826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3811 00000100:00100000:1.0:1784189199.481187:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf44bc1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1870854458118784:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1784189199.486250:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1784189199.486272:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf470e0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1870854458140288:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1784189199.486365:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784189199.486414:0:26492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458140288 00000100:00100000:2.0:1784189199.486420:0:26492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458140288 00000100:00100000:2.0:1784189199.486471:0:26492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3812 00000100:00100000:2.0:1784189199.486479:0:26492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf470e0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3643:x1870854458140288:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1784189199.486505:0:26492:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445281792 avail 1299042304 00000100:00100000:2.0:1784189199.486549:0:26492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf470e0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3643:x1870854458140288:12345-0@lo:41:osp-pre-0-1.0 Request processed in 69us (183us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189199.486557:0:26492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3812 00000100:00100000:2.0:1784189199.486602:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf470e0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1870854458140288:0@lo:41:osp-pre-0-1.0 00000004:00000080:2.0:1784189199.499858:0:90981:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffae09886e7e10 00100000:10000000:2.0:1784189199.499878:0:90981:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000004:00080000:1.0:1784189199.501484:0:90969:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x2c0000401:0x703:0x0] 00000100:00100000:1.0:1784189199.501553:0:90969:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf43e12d80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:90969:1870854458140416:0@lo:5:osp-pre-1-0.0 00000100:00100000:1.0:1784189199.501660:0:90969:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784189199.501708:0:90969:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dbf43f24180 going to sleep for 11 seconds 00000100:00100000:0.0:1784189199.501838:0:14684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458140416 00000100:00100000:0.0:1784189199.501849:0:14684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458140416 00000100:00100000:0.0:1784189199.501916:0:14684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4961 00000100:00100000:0.0:1784189199.501929:0:14684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf43e12a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:90969:x1870854458140416:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:0.0:1784189199.502059:0:14684:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 1825 -> diff = -30 00002000:02000040:0.0:1784189199.502066:0:14684:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000401:1796 to 0x2c0000401:1825) 00000004:00080000:3.0:1784189199.504153:0:90967:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x280000401:0x702:0x0] 00000100:00100000:3.0:1784189199.504218:0:90967:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc07b5b2300 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:90967:1870854458140544:0@lo:5:osp-pre-0-0.0 00000100:00100000:3.0:1784189199.504308:0:90967:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784189199.505488:0:90967:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dc062096000 going to sleep for 11 seconds 00000100:00100000:2.0:1784189199.507210:0:26159:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458140544 00000100:00100000:2.0:1784189199.507227:0:26159:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458140544 00000100:00100000:2.0:1784189199.507305:0:26159:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4962 00000100:00100000:2.0:1784189199.507314:0:26159:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc07b5b1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+6:90967:x1870854458140544:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:2.0:1784189199.507363:0:26159:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 1825 -> diff = -31 00002000:02000040:2.0:1784189199.507368:0:26159:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:1795 to 0x280000401:1825) 00002000:00010000:0.0:1784189199.513216:0:14684:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x721:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784189199.513231:0:14684:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000061338346/0xcc1762b626f8b8e6 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x721:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189199.513249:0:14684:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x721:0x0].0x0 since=3441s v=(0 0) 00010000:00010000:0.0:1784189199.513254:0:14684:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x721:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784189199.513260:0:14684:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000061338346/0xcc1762b626f8b8e6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x721:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189199.513274:0:14684:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000061338346/0xcc1762b626f8b8e6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x721:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189199.513284:0:14684:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000061338346/0xcc1762b626f8b8e6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x721:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189199.513291:0:14684:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000061338346/0xcc1762b626f8b8e6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x721:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189199.513314:0:14684:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1784189199.513451:0:14684:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x720:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784189199.513457:0:14684:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dc1a395e/0xcc1762b626f8b8ed lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x720:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189199.513479:0:14684:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x720:0x0].0x0 since=3441s v=(0 0) 00010000:00010000:0.0:1784189199.513483:0:14684:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x720:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784189199.513487:0:14684:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dc1a395e/0xcc1762b626f8b8ed lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x720:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189199.513496:0:14684:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000dc1a395e/0xcc1762b626f8b8ed lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x720:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189199.513504:0:14684:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dc1a395e/0xcc1762b626f8b8ed lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x720:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189199.513510:0:14684:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000dc1a395e/0xcc1762b626f8b8ed lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x720:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189199.513524:0:14684:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1784189199.513539:0:7454:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1784189199.513544:0:7454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000061338346/0xcc1762b626f8b8e6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x721:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189199.513551:0:7454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc05ec0fe00 already unused, calling callback (ffffffffc0b2e230) 00010000:00010000:0.0:1784189199.513556:0:7454:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000061338346/0xcc1762b626f8b8e6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x721:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189199.513564:0:7454:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000061338346/0xcc1762b626f8b8e6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x721:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189199.513593:0:7454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000061338346/0xcc1762b626f8b8e6 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x721:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189199.513600:0:7454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000061338346/0xcc1762b626f8b8e6 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x721:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189199.513621:0:7454:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784189199.513624:0:7454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000dc1a395e/0xcc1762b626f8b8ed lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x720:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189199.513632:0:7454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc05ec0e200 already unused, calling callback (ffffffffc0b2e230) 00010000:00010000:0.0:1784189199.513636:0:7454:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000dc1a395e/0xcc1762b626f8b8ed lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x720:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189199.513643:0:7454:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000dc1a395e/0xcc1762b626f8b8ed lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x720:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189199.513655:0:7454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000dc1a395e/0xcc1762b626f8b8ed lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x720:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189199.513663:0:7454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000dc1a395e/0xcc1762b626f8b8ed lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x720:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189199.513680:0:7454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784189199.513682:0:7454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784189199.513691:0:7454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1784189199.513748:0:14684:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x71f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784189199.513753:0:14684:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002a207b70/0xcc1762b626f8b8f4 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x71f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189199.513761:0:14684:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x71f:0x0].0x0 since=3441s v=(0 0) 00010000:00010000:0.0:1784189199.513764:0:14684:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x71f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784189199.513769:0:14684:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002a207b70/0xcc1762b626f8b8f4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x71f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189199.513777:0:14684:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002a207b70/0xcc1762b626f8b8f4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x71f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189199.513785:0:14684:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002a207b70/0xcc1762b626f8b8f4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x71f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189199.513798:0:14684:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002a207b70/0xcc1762b626f8b8f4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x71f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189199.513815:0:14684:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1784189199.513822:0:6501:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784189199.513826:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002a207b70/0xcc1762b626f8b8f4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x71f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189199.513832:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc04152ce00 already unused, calling callback (ffffffffc0b2e230) 00010000:00010000:0.0:1784189199.513836:0:6501:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002a207b70/0xcc1762b626f8b8f4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x71f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189199.514144:0:26173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784189199.515078:0:6501:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002a207b70/0xcc1762b626f8b8f4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x71f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189199.515097:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002a207b70/0xcc1762b626f8b8f4 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x71f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189199.515105:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002a207b70/0xcc1762b626f8b8f4 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x71f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189199.515123:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784189199.515125:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784189199.515127:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1784189199.515206:0:14684:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x71e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784189199.515212:0:14684:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c441b122/0xcc1762b626f8b8fb lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x71e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189199.515222:0:14684:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x71e:0x0].0x0 since=3441s v=(0 0) 00010000:00010000:0.0:1784189199.515226:0:14684:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x71e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784189199.515231:0:14684:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c441b122/0xcc1762b626f8b8fb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x71e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189199.515241:0:14684:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c441b122/0xcc1762b626f8b8fb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x71e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189199.515248:0:14684:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c441b122/0xcc1762b626f8b8fb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x71e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189199.515266:0:14684:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c441b122/0xcc1762b626f8b8fb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x71e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189199.515282:0:14684:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1784189199.515342:0:14684:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x71d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784189199.515347:0:14684:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ba1d3010/0xcc1762b626f8b902 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x71d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189199.515354:0:14684:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x71d:0x0].0x0 since=3441s v=(0 0) 00010000:00010000:0.0:1784189199.515357:0:14684:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x71d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784189199.515361:0:14684:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ba1d3010/0xcc1762b626f8b902 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x71d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189199.515369:0:14684:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ba1d3010/0xcc1762b626f8b902 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x71d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189199.515375:0:14684:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ba1d3010/0xcc1762b626f8b902 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x71d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189199.515381:0:14684:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ba1d3010/0xcc1762b626f8b902 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x71d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189199.515394:0:14684:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1784189199.515401:0:7454:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1784189199.515405:0:7454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c441b122/0xcc1762b626f8b8fb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x71e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189199.515419:0:7454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc04152ca00 already unused, calling callback (ffffffffc0b2e230) 00010000:00010000:0.0:1784189199.515422:0:7454:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c441b122/0xcc1762b626f8b8fb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x71e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189199.515431:0:7454:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c441b122/0xcc1762b626f8b8fb lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x71e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189199.515442:0:7454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c441b122/0xcc1762b626f8b8fb lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x71e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189199.515450:0:7454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c441b122/0xcc1762b626f8b8fb lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x71e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189199.515465:0:7454:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784189199.515469:0:7454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ba1d3010/0xcc1762b626f8b902 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x71d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189199.515476:0:7454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc04152da00 already unused, calling callback (ffffffffc0b2e230) 00010000:00010000:0.0:1784189199.515480:0:7454:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ba1d3010/0xcc1762b626f8b902 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x71d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189199.515488:0:7454:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ba1d3010/0xcc1762b626f8b902 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x71d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189199.515497:0:7454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ba1d3010/0xcc1762b626f8b902 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x71d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189199.515512:0:7454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ba1d3010/0xcc1762b626f8b902 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x71d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189199.515539:0:7454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784189199.515545:0:7454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784189199.515548:0:7454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1784189199.515596:0:14684:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x71c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784189199.515601:0:14684:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b87c84b6/0xcc1762b626f8b909 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x71c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189199.515609:0:14684:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x71c:0x0].0x0 since=3441s v=(0 0) 00010000:00010000:0.0:1784189199.515612:0:14684:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x71c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784189199.515616:0:14684:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b87c84b6/0xcc1762b626f8b909 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x71c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189199.515625:0:14684:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b87c84b6/0xcc1762b626f8b909 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x71c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189199.515631:0:14684:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b87c84b6/0xcc1762b626f8b909 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x71c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189199.515637:0:14684:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b87c84b6/0xcc1762b626f8b909 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x71c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189199.515652:0:14684:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1784189199.515667:0:26173:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784189199.515671:0:26173:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b87c84b6/0xcc1762b626f8b909 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x71c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189199.515678:0:26173:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc04152d800 already unused, calling callback (ffffffffc0b2e230) 00010000:00010000:0.0:1784189199.515681:0:26173:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b87c84b6/0xcc1762b626f8b909 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x71c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189199.515689:0:26173:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b87c84b6/0xcc1762b626f8b909 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x71c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189199.515699:0:26173:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b87c84b6/0xcc1762b626f8b909 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x71c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189199.515707:0:26173:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b87c84b6/0xcc1762b626f8b909 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x71c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189199.515720:0:26173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784189199.515722:0:26173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784189199.515723:0:26173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1784189199.515768:0:14684:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x71b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784189199.515773:0:14684:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000091ba7b99/0xcc1762b626f8b910 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x71b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189199.515781:0:14684:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x71b:0x0].0x0 since=3441s v=(0 0) 00010000:00010000:0.0:1784189199.515784:0:14684:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x71b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784189199.515788:0:14684:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000091ba7b99/0xcc1762b626f8b910 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x71b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189199.515808:0:14684:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000091ba7b99/0xcc1762b626f8b910 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x71b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189199.515816:0:14684:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000091ba7b99/0xcc1762b626f8b910 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x71b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189199.515822:0:14684:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000091ba7b99/0xcc1762b626f8b910 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x71b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189199.515846:0:14684:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1784189199.517271:0:14684:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x71a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784189199.517280:0:14684:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009985685d/0xcc1762b626f8b917 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x71a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189199.517293:0:14684:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x71a:0x0].0x0 since=3441s v=(0 0) 00010000:00010000:0.0:1784189199.517296:0:14684:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x71a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784189199.517302:0:14684:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009985685d/0xcc1762b626f8b917 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x71a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189199.517314:0:14684:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009985685d/0xcc1762b626f8b917 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x71a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189199.517339:0:14684:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009985685d/0xcc1762b626f8b917 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x71a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189199.517362:0:14684:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009985685d/0xcc1762b626f8b917 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x71a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189199.517381:0:14684:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1784189199.517394:0:7454:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1784189199.517399:0:7454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000091ba7b99/0xcc1762b626f8b910 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x71b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189199.517405:0:7454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc04152c600 already unused, calling callback (ffffffffc0b2e230) 00010000:00010000:0.0:1784189199.517408:0:7454:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000091ba7b99/0xcc1762b626f8b910 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x71b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189199.517416:0:7454:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000091ba7b99/0xcc1762b626f8b910 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x71b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189199.517427:0:7454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000091ba7b99/0xcc1762b626f8b910 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x71b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189199.517434:0:7454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000091ba7b99/0xcc1762b626f8b910 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x71b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189199.517453:0:7454:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784189199.517456:0:7454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009985685d/0xcc1762b626f8b917 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x71a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189199.517472:0:7454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc04152d200 already unused, calling callback (ffffffffc0b2e230) 00010000:00010000:0.0:1784189199.517475:0:7454:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009985685d/0xcc1762b626f8b917 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x71a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189199.517483:0:7454:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009985685d/0xcc1762b626f8b917 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x71a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189199.517493:0:7454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009985685d/0xcc1762b626f8b917 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x71a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189199.517501:0:7454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009985685d/0xcc1762b626f8b917 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x71a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189199.517514:0:7454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784189199.517516:0:7454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784189199.517518:0:7454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1784189199.517564:0:14684:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x719:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784189199.517569:0:14684:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fabc36df/0xcc1762b626f8b91e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x719:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189199.517577:0:14684:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x719:0x0].0x0 since=3441s v=(0 0) 00010000:00010000:0.0:1784189199.517580:0:14684:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x719:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784189199.517584:0:14684:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fabc36df/0xcc1762b626f8b91e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x719:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189199.517592:0:14684:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fabc36df/0xcc1762b626f8b91e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x719:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189199.517605:0:14684:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fabc36df/0xcc1762b626f8b91e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x719:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189199.517611:0:14684:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fabc36df/0xcc1762b626f8b91e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x719:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189199.517622:0:14684:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1784189199.517628:0:26173:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784189199.517632:0:26173:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fabc36df/0xcc1762b626f8b91e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x719:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189199.517637:0:26173:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc04152c400 already unused, calling callback (ffffffffc0b2e230) 00010000:00010000:0.0:1784189199.517640:0:26173:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fabc36df/0xcc1762b626f8b91e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x719:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189199.517646:0:26173:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fabc36df/0xcc1762b626f8b91e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x719:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189199.517657:0:26173:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fabc36df/0xcc1762b626f8b91e lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x719:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189199.517664:0:26173:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fabc36df/0xcc1762b626f8b91e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x719:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189199.517677:0:26173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784189199.517683:0:26173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784189199.517685:0:26173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1784189199.517722:0:14684:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x718:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784189199.517727:0:14684:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002a22be6d/0xcc1762b626f8b925 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x718:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189199.517734:0:14684:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x718:0x0].0x0 since=3441s v=(0 0) 00010000:00010000:0.0:1784189199.517736:0:14684:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x718:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784189199.517740:0:14684:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002a22be6d/0xcc1762b626f8b925 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x718:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189199.517747:0:14684:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002a22be6d/0xcc1762b626f8b925 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x718:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189199.517754:0:14684:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002a22be6d/0xcc1762b626f8b925 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x718:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189199.517759:0:14684:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002a22be6d/0xcc1762b626f8b925 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x718:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189199.517769:0:14684:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1784189199.517774:0:7454:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784189199.517777:0:7454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002a22be6d/0xcc1762b626f8b925 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x718:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189199.517783:0:7454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc04152d600 already unused, calling callback (ffffffffc0b2e230) 00010000:00010000:0.0:1784189199.517785:0:7454:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002a22be6d/0xcc1762b626f8b925 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x718:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189199.517802:0:7454:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002a22be6d/0xcc1762b626f8b925 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x718:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189199.517811:0:7454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002a22be6d/0xcc1762b626f8b925 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x718:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189199.517817:0:7454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002a22be6d/0xcc1762b626f8b925 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x718:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189199.517828:0:7454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784189199.517829:0:7454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784189199.517830:0:7454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784189199.522218:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784189199.525272:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1784189199.525305:0:26159:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x721:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00002000:00010000:0.0:1784189199.525864:0:14684:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x717:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784189199.525873:0:14684:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000490fcfab/0xcc1762b626f8b933 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x717:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189199.525889:0:14684:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x717:0x0].0x0 since=3441s v=(0 0) 00010000:00010000:0.0:1784189199.525894:0:14684:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x717:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784189199.525900:0:14684:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000490fcfab/0xcc1762b626f8b933 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x717:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189199.525914:0:14684:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000490fcfab/0xcc1762b626f8b933 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x717:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189199.525924:0:14684:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000490fcfab/0xcc1762b626f8b933 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x717:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189199.525945:0:14684:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000490fcfab/0xcc1762b626f8b933 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x717:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189199.525975:0:14684:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1784189199.525985:0:26173:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784189199.525991:0:26173:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000490fcfab/0xcc1762b626f8b933 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x717:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189199.525998:0:26173:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc04152d400 already unused, calling callback (ffffffffc0b2e230) 00010000:00010000:0.0:1784189199.526003:0:26173:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000490fcfab/0xcc1762b626f8b933 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x717:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189199.526012:0:26173:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000490fcfab/0xcc1762b626f8b933 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x717:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189199.526027:0:26173:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000490fcfab/0xcc1762b626f8b933 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x717:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189199.526033:0:26173:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000490fcfab/0xcc1762b626f8b933 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x717:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189199.526052:0:26173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784189199.526054:0:26173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784189199.526056:0:26173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1784189199.527167:0:14684:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x716:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784189199.527177:0:14684:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d7af1b89/0xcc1762b626f8b93a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x716:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189199.527191:0:14684:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x716:0x0].0x0 since=3441s v=(0 0) 00010000:00010000:1.0:1784189199.527194:0:14684:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x716:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784189199.527200:0:14684:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d7af1b89/0xcc1762b626f8b93a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x716:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189199.527211:0:14684:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d7af1b89/0xcc1762b626f8b93a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x716:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189199.527219:0:14684:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d7af1b89/0xcc1762b626f8b93a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x716:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189199.527226:0:14684:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d7af1b89/0xcc1762b626f8b93a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x716:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189199.527242:0:14684:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1784189199.527252:0:7454:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784189199.527257:0:7454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d7af1b89/0xcc1762b626f8b93a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x716:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189199.527265:0:7454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc07116f800 already unused, calling callback (ffffffffc0b2e230) 00010000:00010000:1.0:1784189199.527276:0:7454:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d7af1b89/0xcc1762b626f8b93a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x716:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189199.527284:0:7454:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d7af1b89/0xcc1762b626f8b93a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x716:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189199.527298:0:7454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d7af1b89/0xcc1762b626f8b93a lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x716:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189199.527304:0:7454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d7af1b89/0xcc1762b626f8b93a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x716:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189199.527341:0:7454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784189199.527343:0:7454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784189199.527344:0:7454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1784189199.527562:0:14684:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x715:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784189199.527568:0:14684:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006c76bcb1/0xcc1762b626f8b941 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x715:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189199.527577:0:14684:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x715:0x0].0x0 since=3441s v=(0 0) 00010000:00010000:1.0:1784189199.527580:0:14684:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x715:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784189199.527584:0:14684:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006c76bcb1/0xcc1762b626f8b941 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x715:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189199.527593:0:14684:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006c76bcb1/0xcc1762b626f8b941 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x715:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189199.527615:0:14684:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006c76bcb1/0xcc1762b626f8b941 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x715:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189199.527623:0:14684:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006c76bcb1/0xcc1762b626f8b941 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x715:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189199.527711:0:14684:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1784189199.527719:0:6501:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784189199.527724:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006c76bcb1/0xcc1762b626f8b941 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x715:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189199.527730:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc07116fe00 already unused, calling callback (ffffffffc0b2e230) 00010000:00010000:1.0:1784189199.527733:0:6501:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006c76bcb1/0xcc1762b626f8b941 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x715:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189199.527740:0:6501:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006c76bcb1/0xcc1762b626f8b941 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x715:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189199.527750:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006c76bcb1/0xcc1762b626f8b941 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x715:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189199.527756:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006c76bcb1/0xcc1762b626f8b941 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x715:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189199.527767:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784189199.527773:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784189199.527775:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1784189199.527871:0:14684:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x714:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784189199.527876:0:14684:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000022fa77b/0xcc1762b626f8b948 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x714:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189199.527883:0:14684:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x714:0x0].0x0 since=3441s v=(0 0) 00010000:00010000:1.0:1784189199.527886:0:14684:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x714:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784189199.527889:0:14684:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000022fa77b/0xcc1762b626f8b948 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x714:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189199.527897:0:14684:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000022fa77b/0xcc1762b626f8b948 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x714:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189199.527904:0:14684:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000022fa77b/0xcc1762b626f8b948 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x714:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189199.527910:0:14684:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000022fa77b/0xcc1762b626f8b948 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x714:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189199.527927:0:14684:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1784189199.527967:0:14684:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x713:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784189199.527972:0:14684:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000434d0145/0xcc1762b626f8b94f lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x713:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189199.527978:0:14684:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x713:0x0].0x0 since=3441s v=(0 0) 00010000:00010000:1.0:1784189199.527981:0:14684:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x713:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784189199.527984:0:14684:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000434d0145/0xcc1762b626f8b94f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x713:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189199.527998:0:14684:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000434d0145/0xcc1762b626f8b94f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x713:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189199.528005:0:14684:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000434d0145/0xcc1762b626f8b94f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x713:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189199.528011:0:14684:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000434d0145/0xcc1762b626f8b94f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x713:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189199.528024:0:14684:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1784189199.528030:0:26173:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1784189199.528034:0:26173:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000022fa77b/0xcc1762b626f8b948 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x714:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189199.528040:0:26173:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc07116f000 already unused, calling callback (ffffffffc0b2e230) 00010000:00010000:1.0:1784189199.528044:0:26173:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000022fa77b/0xcc1762b626f8b948 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x714:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189199.528051:0:26173:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000022fa77b/0xcc1762b626f8b948 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x714:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189199.528059:0:26173:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000022fa77b/0xcc1762b626f8b948 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x714:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189199.528066:0:26173:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000022fa77b/0xcc1762b626f8b948 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x714:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189199.528084:0:26173:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784189199.528087:0:26173:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000434d0145/0xcc1762b626f8b94f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x713:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189199.528094:0:26173:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc0565e6c00 already unused, calling callback (ffffffffc0b2e230) 00010000:00010000:1.0:1784189199.528097:0:26173:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000434d0145/0xcc1762b626f8b94f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x713:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189199.528104:0:26173:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000434d0145/0xcc1762b626f8b94f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x713:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189199.528115:0:26173:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000434d0145/0xcc1762b626f8b94f lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x713:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189199.528122:0:26173:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000434d0145/0xcc1762b626f8b94f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x713:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189199.528135:0:26173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784189199.528136:0:26173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784189199.528139:0:26173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1784189199.528261:0:14684:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x712:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784189199.528267:0:14684:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dc6deaed/0xcc1762b626f8b956 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x712:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189199.528276:0:14684:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x712:0x0].0x0 since=3441s v=(0 0) 00010000:00010000:1.0:1784189199.528285:0:14684:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x712:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784189199.528290:0:14684:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dc6deaed/0xcc1762b626f8b956 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x712:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189199.528299:0:14684:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000dc6deaed/0xcc1762b626f8b956 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x712:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189199.528307:0:14684:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dc6deaed/0xcc1762b626f8b956 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x712:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189199.528313:0:14684:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000dc6deaed/0xcc1762b626f8b956 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x712:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189199.528347:0:14684:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1784189199.528354:0:7454:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784189199.528357:0:7454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000dc6deaed/0xcc1762b626f8b956 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x712:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189199.528363:0:7454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc0565e7c00 already unused, calling callback (ffffffffc0b2e230) 00010000:00010000:1.0:1784189199.528366:0:7454:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000dc6deaed/0xcc1762b626f8b956 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x712:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189199.528371:0:7454:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000dc6deaed/0xcc1762b626f8b956 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x712:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189199.528379:0:7454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000dc6deaed/0xcc1762b626f8b956 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x712:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189199.528394:0:7454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000dc6deaed/0xcc1762b626f8b956 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x712:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189199.528404:0:7454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784189199.528405:0:7454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784189199.528407:0:7454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1784189199.528444:0:14684:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x711:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784189199.528449:0:14684:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b57cfe27/0xcc1762b626f8b95d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x711:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189199.528456:0:14684:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x711:0x0].0x0 since=3441s v=(0 0) 00010000:00010000:1.0:1784189199.528459:0:14684:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x711:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784189199.528462:0:14684:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b57cfe27/0xcc1762b626f8b95d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x711:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189199.528469:0:14684:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b57cfe27/0xcc1762b626f8b95d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x711:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189199.528475:0:14684:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b57cfe27/0xcc1762b626f8b95d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x711:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189199.528482:0:14684:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b57cfe27/0xcc1762b626f8b95d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x711:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189199.528500:0:14684:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1784189199.528536:0:14684:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x710:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784189199.528540:0:14684:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000afb0ab48/0xcc1762b626f8b964 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x710:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189199.528547:0:14684:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x710:0x0].0x0 since=3441s v=(0 0) 00010000:00010000:1.0:1784189199.528549:0:14684:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x710:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784189199.528553:0:14684:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000afb0ab48/0xcc1762b626f8b964 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x710:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189199.528561:0:14684:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000afb0ab48/0xcc1762b626f8b964 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x710:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189199.528568:0:14684:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000afb0ab48/0xcc1762b626f8b964 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x710:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189199.528574:0:14684:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000afb0ab48/0xcc1762b626f8b964 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x710:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189199.528577:0:6501:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784189199.528586:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b57cfe27/0xcc1762b626f8b95d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x711:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189199.528592:0:14684:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1784189199.528599:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc0565e7400 already unused, calling callback (ffffffffc0b2e230) 00010000:00010000:1.0:1784189199.528604:0:26173:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784189199.528605:0:6501:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b57cfe27/0xcc1762b626f8b95d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x711:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189199.528610:0:26173:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000afb0ab48/0xcc1762b626f8b964 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x710:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189199.528619:0:26173:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc0565e7a00 already unused, calling callback (ffffffffc0b2e230) 00010000:00010000:1.0:1784189199.528625:0:26173:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000afb0ab48/0xcc1762b626f8b964 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x710:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189199.528635:0:6501:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b57cfe27/0xcc1762b626f8b95d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x711:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189199.528650:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b57cfe27/0xcc1762b626f8b95d lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x711:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189199.528653:0:26173:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000afb0ab48/0xcc1762b626f8b964 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x710:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189199.528666:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b57cfe27/0xcc1762b626f8b95d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x711:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189199.528674:0:26173:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000afb0ab48/0xcc1762b626f8b964 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x710:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189199.528684:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784189199.528684:0:26173:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000afb0ab48/0xcc1762b626f8b964 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x710:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189199.528688:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784189199.528691:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784189199.528705:0:26173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784189199.528708:0:26173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784189199.528710:0:26173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1784189199.528751:0:14684:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x70f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784189199.528756:0:14684:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000afbbf3fa/0xcc1762b626f8b96b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x70f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189199.528764:0:14684:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x70f:0x0].0x0 since=3441s v=(0 0) 00010000:00010000:1.0:1784189199.528766:0:14684:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x70f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784189199.528770:0:14684:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000afbbf3fa/0xcc1762b626f8b96b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x70f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189199.528779:0:14684:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000afbbf3fa/0xcc1762b626f8b96b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x70f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189199.528787:0:14684:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000afbbf3fa/0xcc1762b626f8b96b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x70f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189199.528800:0:14684:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000afbbf3fa/0xcc1762b626f8b96b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x70f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189199.528818:0:14684:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1784189199.528854:0:14684:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x70e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784189199.528858:0:14684:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000726f31b6/0xcc1762b626f8b972 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x70e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189199.528865:0:14684:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x70e:0x0].0x0 since=3441s v=(0 0) 00010000:00010000:1.0:1784189199.528867:0:14684:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x70e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784189199.528871:0:14684:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000726f31b6/0xcc1762b626f8b972 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x70e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189199.528878:0:14684:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000726f31b6/0xcc1762b626f8b972 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x70e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189199.528884:0:14684:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000726f31b6/0xcc1762b626f8b972 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x70e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189199.528890:0:14684:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000726f31b6/0xcc1762b626f8b972 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x70e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189199.528899:0:14684:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:1.0:1784189199.528926:0:14684:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x70d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784189199.528930:0:14684:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007c749d2a/0xcc1762b626f8b979 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x70d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189199.528941:0:14684:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x70d:0x0].0x0 since=3441s v=(0 0) 00010000:00010000:1.0:1784189199.528944:0:14684:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x70d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784189199.528947:0:14684:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007c749d2a/0xcc1762b626f8b979 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x70d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189199.528972:0:14684:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007c749d2a/0xcc1762b626f8b979 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x70d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189199.528979:0:14684:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007c749d2a/0xcc1762b626f8b979 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x70d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189199.528984:0:14684:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007c749d2a/0xcc1762b626f8b979 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x70d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189199.528996:0:14684:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:1.0:1784189199.529002:0:26173:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1784189199.529005:0:26173:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000afbbf3fa/0xcc1762b626f8b96b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x70f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189199.529010:0:26173:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc0565e7e00 already unused, calling callback (ffffffffc0b2e230) 00010000:00010000:1.0:1784189199.529013:0:26173:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000afbbf3fa/0xcc1762b626f8b96b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x70f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189199.529019:0:26173:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000afbbf3fa/0xcc1762b626f8b96b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x70f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189199.529037:0:26173:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000afbbf3fa/0xcc1762b626f8b96b lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x70f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189199.529044:0:26173:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000afbbf3fa/0xcc1762b626f8b96b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x70f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189199.529055:0:26173:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1784189199.529060:0:26173:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000726f31b6/0xcc1762b626f8b972 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x70e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189199.529065:0:26173:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc0565e6600 already unused, calling callback (ffffffffc0b2e230) 00010000:00010000:1.0:1784189199.529068:0:26173:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000726f31b6/0xcc1762b626f8b972 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x70e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189199.529074:0:26173:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000726f31b6/0xcc1762b626f8b972 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x70e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189199.529080:0:26173:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000726f31b6/0xcc1762b626f8b972 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x70e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189199.529087:0:26173:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000726f31b6/0xcc1762b626f8b972 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x70e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189199.529096:0:26173:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784189199.529099:0:26173:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007c749d2a/0xcc1762b626f8b979 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x70d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189199.529109:0:26173:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc0565e6200 already unused, calling callback (ffffffffc0b2e230) 00010000:00010000:1.0:1784189199.529112:0:26173:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007c749d2a/0xcc1762b626f8b979 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x70d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189199.529119:0:26173:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007c749d2a/0xcc1762b626f8b979 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x70d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189199.529127:0:26173:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007c749d2a/0xcc1762b626f8b979 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x70d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189199.529134:0:26173:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007c749d2a/0xcc1762b626f8b979 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x70d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189199.529146:0:26173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784189199.529148:0:26173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784189199.529149:0:26173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1784189199.529188:0:14684:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x70c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784189199.529193:0:14684:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000c462bc2/0xcc1762b626f8b980 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x70c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189199.529201:0:14684:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x70c:0x0].0x0 since=3441s v=(0 0) 00010000:00010000:1.0:1784189199.529204:0:14684:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x70c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784189199.529208:0:14684:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000c462bc2/0xcc1762b626f8b980 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x70c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189199.529216:0:14684:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000c462bc2/0xcc1762b626f8b980 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x70c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189199.529231:0:14684:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000c462bc2/0xcc1762b626f8b980 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x70c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189199.529237:0:14684:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000c462bc2/0xcc1762b626f8b980 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x70c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189199.529247:0:14684:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1784189199.529253:0:26173:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784189199.529256:0:26173:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000c462bc2/0xcc1762b626f8b980 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x70c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189199.529261:0:26173:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc0565e6000 already unused, calling callback (ffffffffc0b2e230) 00010000:00010000:1.0:1784189199.529264:0:26173:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000c462bc2/0xcc1762b626f8b980 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x70c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189199.529270:0:26173:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000c462bc2/0xcc1762b626f8b980 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x70c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189199.529278:0:26173:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000c462bc2/0xcc1762b626f8b980 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x70c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189199.529283:0:26173:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000c462bc2/0xcc1762b626f8b980 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x70c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189199.529294:0:26173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784189199.529300:0:26173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784189199.529301:0:26173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1784189199.529353:0:14684:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x70b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784189199.529357:0:14684:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002c64c51e/0xcc1762b626f8b987 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x70b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189199.529364:0:14684:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x70b:0x0].0x0 since=3441s v=(0 0) 00010000:00010000:1.0:1784189199.529366:0:14684:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x70b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784189199.529370:0:14684:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002c64c51e/0xcc1762b626f8b987 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x70b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189199.529377:0:14684:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002c64c51e/0xcc1762b626f8b987 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x70b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189199.529384:0:14684:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002c64c51e/0xcc1762b626f8b987 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x70b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189199.529390:0:14684:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002c64c51e/0xcc1762b626f8b987 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x70b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189199.529402:0:14684:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1784189199.529407:0:26173:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784189199.529410:0:26173:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002c64c51e/0xcc1762b626f8b987 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x70b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189199.529416:0:26173:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc0565e6400 already unused, calling callback (ffffffffc0b2e230) 00010000:00010000:1.0:1784189199.529419:0:26173:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002c64c51e/0xcc1762b626f8b987 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x70b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189199.529438:0:26173:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002c64c51e/0xcc1762b626f8b987 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x70b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189199.529449:0:26173:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002c64c51e/0xcc1762b626f8b987 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x70b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189199.529456:0:26173:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002c64c51e/0xcc1762b626f8b987 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x70b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189199.529469:0:26173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784189199.529471:0:26173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784189199.529472:0:26173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1784189199.529512:0:14684:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x70a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784189199.529516:0:14684:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000a795375/0xcc1762b626f8b98e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x70a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189199.529523:0:14684:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x70a:0x0].0x0 since=3441s v=(0 0) 00010000:00010000:1.0:1784189199.529526:0:14684:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x70a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784189199.529529:0:14684:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000a795375/0xcc1762b626f8b98e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x70a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189199.529537:0:14684:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000a795375/0xcc1762b626f8b98e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x70a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189199.529543:0:14684:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000a795375/0xcc1762b626f8b98e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x70a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189199.529555:0:14684:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000a795375/0xcc1762b626f8b98e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x70a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189199.529565:0:14684:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1784189199.529570:0:26173:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784189199.529573:0:26173:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000a795375/0xcc1762b626f8b98e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x70a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189199.529579:0:26173:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc0565e7000 already unused, calling callback (ffffffffc0b2e230) 00010000:00010000:1.0:1784189199.529582:0:26173:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000a795375/0xcc1762b626f8b98e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x70a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189199.529589:0:26173:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000a795375/0xcc1762b626f8b98e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x70a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189199.529598:0:26173:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000a795375/0xcc1762b626f8b98e lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x70a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189199.529604:0:26173:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000a795375/0xcc1762b626f8b98e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x70a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189199.529615:0:26173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784189199.529616:0:26173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784189199.529617:0:26173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1784189199.529651:0:14684:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x709:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784189199.529662:0:14684:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000da3166f3/0xcc1762b626f8b995 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x709:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189199.529670:0:14684:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x709:0x0].0x0 since=3441s v=(0 0) 00010000:00010000:1.0:1784189199.529673:0:14684:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x709:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784189199.529677:0:14684:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000da3166f3/0xcc1762b626f8b995 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x709:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189199.529685:0:14684:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000da3166f3/0xcc1762b626f8b995 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x709:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189199.529693:0:14684:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000da3166f3/0xcc1762b626f8b995 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x709:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189199.529701:0:14684:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000da3166f3/0xcc1762b626f8b995 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x709:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189199.529713:0:14684:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1784189199.529719:0:26173:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784189199.529723:0:26173:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000da3166f3/0xcc1762b626f8b995 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x709:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189199.529730:0:26173:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc0565e6e00 already unused, calling callback (ffffffffc0b2e230) 00010000:00010000:1.0:1784189199.529733:0:26173:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000da3166f3/0xcc1762b626f8b995 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x709:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189199.529741:0:26173:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000da3166f3/0xcc1762b626f8b995 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x709:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189199.529758:0:26173:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000da3166f3/0xcc1762b626f8b995 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x709:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189199.529765:0:26173:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000da3166f3/0xcc1762b626f8b995 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x709:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189199.529778:0:26173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784189199.529779:0:26173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784189199.529781:0:26173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1784189199.529821:0:14684:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x708:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784189199.529826:0:14684:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a7eb9d01/0xcc1762b626f8b99c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x708:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189199.529833:0:14684:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x708:0x0].0x0 since=3441s v=(0 0) 00010000:00010000:1.0:1784189199.529836:0:14684:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x708:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784189199.529841:0:14684:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a7eb9d01/0xcc1762b626f8b99c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x708:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189199.529848:0:14684:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a7eb9d01/0xcc1762b626f8b99c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x708:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189199.529855:0:14684:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a7eb9d01/0xcc1762b626f8b99c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x708:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189199.529860:0:14684:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a7eb9d01/0xcc1762b626f8b99c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x708:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189199.529880:0:14684:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1784189199.529886:0:26173:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784189199.529889:0:26173:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a7eb9d01/0xcc1762b626f8b99c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x708:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189199.529894:0:26173:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc0565e6800 already unused, calling callback (ffffffffc0b2e230) 00010000:00010000:1.0:1784189199.529897:0:26173:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a7eb9d01/0xcc1762b626f8b99c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x708:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189199.529903:0:26173:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a7eb9d01/0xcc1762b626f8b99c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x708:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189199.529912:0:26173:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a7eb9d01/0xcc1762b626f8b99c lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x708:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189199.529918:0:26173:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a7eb9d01/0xcc1762b626f8b99c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x708:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189199.529929:0:26173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784189199.529931:0:26173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784189199.529932:0:26173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784189199.531112:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784189199.531119:0:7454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784189199.531599:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784189199.532374:0:26159:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000051238ad7/0xcc1762b626f8b92c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x721:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189199.532589:0:26159:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x721:0x0].0x0 since=3441s v=(0 0) 00010000:00010000:2.0:1784189199.532685:0:26159:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x721:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784189199.532694:0:26159:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000051238ad7/0xcc1762b626f8b92c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x721:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189199.532709:0:26159:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000051238ad7/0xcc1762b626f8b92c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x721:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189199.532719:0:26159:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000051238ad7/0xcc1762b626f8b92c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x721:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189199.532725:0:26159:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000051238ad7/0xcc1762b626f8b92c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x721:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189199.532756:0:26159:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1784189199.532769:0:26173:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784189199.532775:0:26173:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000051238ad7/0xcc1762b626f8b92c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x721:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189199.532783:0:26173:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc04a20a600 already unused, calling callback (ffffffffc0b2e230) 00010000:00010000:2.0:1784189199.532787:0:26173:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000051238ad7/0xcc1762b626f8b92c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x721:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189199.532796:0:26173:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000051238ad7/0xcc1762b626f8b92c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x721:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189199.532840:0:26173:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000051238ad7/0xcc1762b626f8b92c lrc: 1/0,0 mode: --/PW res: [0x280000401:0x721:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189199.532848:0:26173:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000051238ad7/0xcc1762b626f8b92c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x721:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189199.532867:0:26173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784189199.532868:0:26173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784189199.532870:0:26173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1784189199.533201:0:26159:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x720:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1784189199.533208:0:26159:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000b9d4674/0xcc1762b626f8b9a3 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x720:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189199.533219:0:26159:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x720:0x0].0x0 since=3441s v=(0 0) 00010000:00010000:2.0:1784189199.533222:0:26159:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x720:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784189199.533226:0:26159:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000b9d4674/0xcc1762b626f8b9a3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x720:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189199.533235:0:26159:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000b9d4674/0xcc1762b626f8b9a3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x720:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189199.533243:0:26159:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000b9d4674/0xcc1762b626f8b9a3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x720:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189199.533250:0:26159:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000b9d4674/0xcc1762b626f8b9a3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x720:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189199.533275:0:26159:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1784189199.533283:0:6501:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784189199.533287:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000b9d4674/0xcc1762b626f8b9a3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x720:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189199.533294:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc04a20a800 already unused, calling callback (ffffffffc0b2e230) 00010000:00010000:2.0:1784189199.533298:0:6501:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000b9d4674/0xcc1762b626f8b9a3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x720:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189199.533304:0:6501:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000b9d4674/0xcc1762b626f8b9a3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x720:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189199.533315:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000b9d4674/0xcc1762b626f8b9a3 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x720:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189199.533342:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000b9d4674/0xcc1762b626f8b9a3 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x720:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189199.533356:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784189199.533358:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784189199.533360:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1784189199.534570:0:26159:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x71f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1784189199.534579:0:26159:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d93d2bda/0xcc1762b626f8b9aa lrc: 3/0,1 mode: --/PW res: [0x280000401:0x71f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189199.534594:0:26159:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x71f:0x0].0x0 since=3441s v=(0 0) 00010000:00010000:2.0:1784189199.534606:0:26159:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x71f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784189199.534614:0:26159:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d93d2bda/0xcc1762b626f8b9aa lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x71f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189199.534625:0:26159:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d93d2bda/0xcc1762b626f8b9aa lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x71f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189199.534634:0:26159:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d93d2bda/0xcc1762b626f8b9aa lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x71f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189199.534641:0:26159:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d93d2bda/0xcc1762b626f8b9aa lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x71f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189199.534659:0:26159:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1784189199.534705:0:26159:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x71e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1784189199.534710:0:26159:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c24bc63e/0xcc1762b626f8b9b1 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x71e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189199.534717:0:26159:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x71e:0x0].0x0 since=3441s v=(0 0) 00010000:00010000:2.0:1784189199.534719:0:26159:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x71e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784189199.534723:0:26159:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c24bc63e/0xcc1762b626f8b9b1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x71e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189199.534731:0:26159:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c24bc63e/0xcc1762b626f8b9b1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x71e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189199.534738:0:26159:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c24bc63e/0xcc1762b626f8b9b1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x71e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189199.534750:0:26159:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c24bc63e/0xcc1762b626f8b9b1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x71e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189199.534766:0:26159:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1784189199.534775:0:6502:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1784189199.534780:0:6502:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d93d2bda/0xcc1762b626f8b9aa lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x71f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189199.534787:0:6502:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc04a20be00 already unused, calling callback (ffffffffc0b2e230) 00010000:00010000:2.0:1784189199.534790:0:6502:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d93d2bda/0xcc1762b626f8b9aa lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x71f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189199.534798:0:6502:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d93d2bda/0xcc1762b626f8b9aa lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x71f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189199.534810:0:6502:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d93d2bda/0xcc1762b626f8b9aa lrc: 1/0,0 mode: --/PW res: [0x280000401:0x71f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189199.534817:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d93d2bda/0xcc1762b626f8b9aa lrc: 0/0,0 mode: --/PW res: [0x280000401:0x71f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189199.534831:0:6502:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784189199.534835:0:6502:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c24bc63e/0xcc1762b626f8b9b1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x71e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189199.535573:0:6502:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc04a20b800 already unused, calling callback (ffffffffc0b2e230) 00010000:00010000:2.0:1784189199.535580:0:6502:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c24bc63e/0xcc1762b626f8b9b1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x71e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189199.535590:0:6502:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c24bc63e/0xcc1762b626f8b9b1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x71e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189199.535601:0:6502:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c24bc63e/0xcc1762b626f8b9b1 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x71e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189199.535608:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c24bc63e/0xcc1762b626f8b9b1 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x71e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189199.535624:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784189199.535626:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784189199.535627:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1784189199.535688:0:26159:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x71d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1784189199.535693:0:26159:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000039fec00f/0xcc1762b626f8b9b8 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x71d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189199.535702:0:26159:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x71d:0x0].0x0 since=3441s v=(0 0) 00010000:00010000:2.0:1784189199.535705:0:26159:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x71d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784189199.535710:0:26159:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000039fec00f/0xcc1762b626f8b9b8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x71d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189199.535718:0:26159:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000039fec00f/0xcc1762b626f8b9b8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x71d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189199.535732:0:26159:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000039fec00f/0xcc1762b626f8b9b8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x71d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189199.535738:0:26159:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000039fec00f/0xcc1762b626f8b9b8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x71d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189199.535751:0:26159:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1784189199.535759:0:26173:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784189199.535763:0:26173:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000039fec00f/0xcc1762b626f8b9b8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x71d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189199.535769:0:26173:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc04a20ae00 already unused, calling callback (ffffffffc0b2e230) 00010000:00010000:2.0:1784189199.535772:0:26173:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000039fec00f/0xcc1762b626f8b9b8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x71d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189199.535779:0:26173:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000039fec00f/0xcc1762b626f8b9b8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x71d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189199.535788:0:26173:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000039fec00f/0xcc1762b626f8b9b8 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x71d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189199.535794:0:26173:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000039fec00f/0xcc1762b626f8b9b8 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x71d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189199.535806:0:26173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784189199.535812:0:26173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784189199.535814:0:26173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1784189199.535848:0:26159:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x71c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00002000:00010000:1.0:1784189199.536071:0:14684:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x707:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784189199.536078:0:14684:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000070c36b38/0xcc1762b626f8b9c6 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x707:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189199.536087:0:14684:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x707:0x0].0x0 since=3441s v=(0 0) 00010000:00010000:1.0:1784189199.536097:0:14684:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x707:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784189199.536102:0:14684:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000070c36b38/0xcc1762b626f8b9c6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x707:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189199.536112:0:14684:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000070c36b38/0xcc1762b626f8b9c6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x707:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189199.536120:0:14684:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000070c36b38/0xcc1762b626f8b9c6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x707:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189199.536127:0:14684:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000070c36b38/0xcc1762b626f8b9c6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x707:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189199.536144:0:14684:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1784189199.536190:0:14684:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x706:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784189199.536195:0:14684:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fefded14/0xcc1762b626f8b9cd lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x706:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189199.536202:0:14684:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x706:0x0].0x0 since=3441s v=(0 0) 00010000:00010000:1.0:1784189199.536205:0:14684:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x706:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784189199.536209:0:14684:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fefded14/0xcc1762b626f8b9cd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x706:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189199.536217:0:14684:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fefded14/0xcc1762b626f8b9cd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x706:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189199.536224:0:14684:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fefded14/0xcc1762b626f8b9cd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x706:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189199.536238:0:14684:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fefded14/0xcc1762b626f8b9cd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x706:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189199.536250:0:14684:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:1.0:1784189199.536292:0:14684:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x705:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784189199.536297:0:14684:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d1a99062/0xcc1762b626f8b9d4 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x705:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189199.536305:0:14684:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x705:0x0].0x0 since=3441s v=(0 0) 00010000:00010000:1.0:1784189199.536308:0:14684:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x705:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784189199.536311:0:14684:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d1a99062/0xcc1762b626f8b9d4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x705:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189199.536342:0:14684:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d1a99062/0xcc1762b626f8b9d4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x705:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189199.536350:0:14684:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d1a99062/0xcc1762b626f8b9d4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x705:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189199.536356:0:14684:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d1a99062/0xcc1762b626f8b9d4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x705:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189199.536369:0:14684:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:1.0:1784189199.536407:0:14684:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x704:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784189199.536412:0:14684:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003b91f60d/0xcc1762b626f8b9db lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x704:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189199.536425:0:14684:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x704:0x0].0x0 since=3441s v=(0 0) 00010000:00010000:1.0:1784189199.536429:0:14684:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x704:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784189199.536433:0:14684:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003b91f60d/0xcc1762b626f8b9db lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x704:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189199.536442:0:14684:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003b91f60d/0xcc1762b626f8b9db lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x704:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189199.536450:0:14684:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003b91f60d/0xcc1762b626f8b9db lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x704:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189199.536457:0:14684:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003b91f60d/0xcc1762b626f8b9db lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x704:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189199.536466:0:14684:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00002000:00080000:1.0:1784189199.536523:0:14684:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x2c0000401:1795 00000100:00100000:1.0:1784189199.536612:0:14684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf43e12a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:90969:x1870854458140416:12345-0@lo:5:osp-pre-1-0.0 Request processed in 34684us (34950us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189199.536624:0:14684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4961 00000100:00100000:1.0:1784189199.536676:0:90969:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf43e12d80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:90969:1870854458140416:0@lo:5:osp-pre-1-0.0 00000004:00080000:1.0:1784189199.536691:0:90969:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x2c0000401:0x721:0x0] from OST, last_created [0x2c0000401:0x721:0x0]last_used is [0x2c0000401:0x703:0x0] 00000100:00100000:1.0:1784189199.536759:0:90969:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf43e10a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:90969:1870854458140800:0@lo:5:osp-pre-1-0.0 00000100:00100000:1.0:1784189199.536792:0:90969:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784189199.536815:0:90969:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dbf43f24180 going to sleep for 11 seconds 00000100:00100000:1.0:1784189199.536833:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1784189199.536844:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf43e12d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1870854458140672:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1784189199.536995:0:26159:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cf75c475/0xcc1762b626f8b9bf lrc: 3/0,1 mode: --/PW res: [0x280000401:0x71c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189199.537004:0:26159:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x71c:0x0].0x0 since=3441s v=(0 0) 00010000:00010000:2.0:1784189199.537007:0:26159:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x71c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784189199.537011:0:26159:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cf75c475/0xcc1762b626f8b9bf lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x71c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189199.537021:0:26159:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cf75c475/0xcc1762b626f8b9bf lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x71c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189199.537029:0:26159:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cf75c475/0xcc1762b626f8b9bf lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x71c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189199.537036:0:26159:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cf75c475/0xcc1762b626f8b9bf lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x71c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189199.537049:0:6501:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1784189199.537055:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000070c36b38/0xcc1762b626f8b9c6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x707:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189199.537063:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc0565e7600 already unused, calling callback (ffffffffc0b2e230) 00010000:00010000:2.0:1784189199.537067:0:6501:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000070c36b38/0xcc1762b626f8b9c6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x707:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189199.537087:0:6501:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000070c36b38/0xcc1762b626f8b9c6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x707:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189199.537093:0:7454:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1784189199.537100:0:7454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fefded14/0xcc1762b626f8b9cd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x706:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189199.537104:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000070c36b38/0xcc1762b626f8b9c6 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x707:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189199.537117:0:7454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc0565e7800 already unused, calling callback (ffffffffc0b2e230) 00010000:00010000:2.0:1784189199.537122:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000070c36b38/0xcc1762b626f8b9c6 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x707:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189199.537123:0:7454:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fefded14/0xcc1762b626f8b9cd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x706:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189199.537145:0:7454:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fefded14/0xcc1762b626f8b9cd lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x706:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189199.537153:0:6501:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1784189199.537158:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d1a99062/0xcc1762b626f8b9d4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x705:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189199.537176:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc0565e6a00 already unused, calling callback (ffffffffc0b2e230) 00010000:00010000:2.0:1784189199.537179:0:6501:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d1a99062/0xcc1762b626f8b9d4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x705:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189199.537181:0:7454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fefded14/0xcc1762b626f8b9cd lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x706:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189199.537193:0:6501:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d1a99062/0xcc1762b626f8b9d4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x705:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189199.537195:0:7454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fefded14/0xcc1762b626f8b9cd lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x706:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189199.537217:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d1a99062/0xcc1762b626f8b9d4 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x705:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189199.537222:0:7454:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784189199.537227:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d1a99062/0xcc1762b626f8b9d4 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x705:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189199.537228:0:7454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003b91f60d/0xcc1762b626f8b9db lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x704:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189199.537245:0:7454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc0565e7200 already unused, calling callback (ffffffffc0b2e230) 00010000:00010000:3.0:1784189199.537248:0:7454:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003b91f60d/0xcc1762b626f8b9db lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x704:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189199.537270:0:7454:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003b91f60d/0xcc1762b626f8b9db lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x704:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189199.537281:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784189199.537282:0:7454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003b91f60d/0xcc1762b626f8b9db lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x704:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189199.537286:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784189199.537290:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784189199.537295:0:7454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003b91f60d/0xcc1762b626f8b9db lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x704:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189199.537298:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784189199.537304:0:26173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784189199.537314:0:7454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784189199.537335:0:7454:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784189199.537340:0:26159:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1784189199.537347:0:7454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cf75c475/0xcc1762b626f8b9bf lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x71c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189199.537351:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784189199.537357:0:7454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc04a20ac00 already unused, calling callback (ffffffffc0b2e230) 00010000:00010000:3.0:1784189199.537361:0:7454:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cf75c475/0xcc1762b626f8b9bf lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x71c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189199.537369:0:7454:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cf75c475/0xcc1762b626f8b9bf lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x71c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189199.537380:0:7454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cf75c475/0xcc1762b626f8b9bf lrc: 1/0,0 mode: --/PW res: [0x280000401:0x71c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189199.537388:0:7454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cf75c475/0xcc1762b626f8b9bf lrc: 0/0,0 mode: --/PW res: [0x280000401:0x71c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189199.537406:0:7454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1784189199.537407:0:26159:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x71b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784189199.537408:0:7454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784189199.537411:0:7454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784189199.537415:0:26159:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009d2fcfa0/0xcc1762b626f8b9e2 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x71b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189199.537425:0:26159:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x71b:0x0].0x0 since=3441s v=(0 0) 00010000:00010000:2.0:1784189199.537428:0:26159:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x71b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784189199.537432:0:26159:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009d2fcfa0/0xcc1762b626f8b9e2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x71b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189199.537441:0:26159:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009d2fcfa0/0xcc1762b626f8b9e2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x71b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189199.537449:0:26159:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009d2fcfa0/0xcc1762b626f8b9e2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x71b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189199.537456:0:26159:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009d2fcfa0/0xcc1762b626f8b9e2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x71b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189199.537477:0:26159:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1784189199.537524:0:26159:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x71a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1784189199.537529:0:26159:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001c1c0e3f/0xcc1762b626f8b9e9 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x71a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189199.537537:0:26159:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x71a:0x0].0x0 since=3441s v=(0 0) 00010000:00010000:2.0:1784189199.537540:0:26159:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x71a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784189199.537544:0:26159:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001c1c0e3f/0xcc1762b626f8b9e9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x71a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189199.537553:0:26159:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001c1c0e3f/0xcc1762b626f8b9e9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x71a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189199.537560:0:26159:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001c1c0e3f/0xcc1762b626f8b9e9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x71a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189199.539925:0:6502:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784189199.539938:0:6502:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009d2fcfa0/0xcc1762b626f8b9e2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x71b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189199.539964:0:6502:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc04a20b000 already unused, calling callback (ffffffffc0b2e230) 00010000:00010000:3.0:1784189199.539970:0:6502:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009d2fcfa0/0xcc1762b626f8b9e2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x71b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189199.539996:0:6502:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009d2fcfa0/0xcc1762b626f8b9e2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x71b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189199.540017:0:6502:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009d2fcfa0/0xcc1762b626f8b9e2 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x71b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189199.540025:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009d2fcfa0/0xcc1762b626f8b9e2 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x71b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189199.540047:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784189199.540049:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784189199.540051:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784189199.540067:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000001:00100000:3.0:1784189199.540094:0:8423:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:1.0:1784189199.540125:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458140800 00000100:00100000:1.0:1784189199.540132:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458140800 00000100:00100000:1.0:1784189199.540180:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4963 00000100:00100000:1.0:1784189199.540189:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf43e10700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:90969:x1870854458140800:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:1.0:1784189199.540232:0:8429:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000401 at 1826 00000100:00100000:3.0:1784189199.540392:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458140672 00000100:00100000:3.0:1784189199.540397:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458140672 00000100:00100000:3.0:1784189199.540433:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1974 00000100:00100000:3.0:1784189199.540442:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf43e12300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3642:x1870854458140672:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1784189199.540457:0:8432:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8649664 pending 896 free 3923529728 avail 3692007424 00000100:00100000:3.0:1784189199.540522:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf43e12300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3642:x1870854458140672:12345-0@lo:13:osp-pre-1-0.0 Request processed in 81us (456us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189199.540530:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1974 00010000:00010000:2.0:1784189199.541067:0:26159:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001c1c0e3f/0xcc1762b626f8b9e9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x71a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189199.541102:0:26159:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1784189199.541112:0:26173:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784189199.541116:0:26173:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001c1c0e3f/0xcc1762b626f8b9e9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x71a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189199.541124:0:26173:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dbf4369c400 already unused, calling callback (ffffffffc0b2e230) 00010000:00010000:2.0:1784189199.541127:0:26173:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001c1c0e3f/0xcc1762b626f8b9e9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x71a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189199.541150:0:26173:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001c1c0e3f/0xcc1762b626f8b9e9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x71a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189199.541163:0:26173:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001c1c0e3f/0xcc1762b626f8b9e9 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x71a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189199.541170:0:26173:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001c1c0e3f/0xcc1762b626f8b9e9 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x71a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189199.541187:0:26173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784189199.541189:0:26173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784189199.541191:0:26173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1784189199.541271:0:26159:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x719:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1784189199.541277:0:26159:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b9a62591/0xcc1762b626f8b9f0 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x719:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189199.541288:0:26159:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x719:0x0].0x0 since=3441s v=(0 0) 00010000:00010000:2.0:1784189199.541292:0:26159:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x719:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784189199.541299:0:26159:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b9a62591/0xcc1762b626f8b9f0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x719:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189199.541311:0:26159:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b9a62591/0xcc1762b626f8b9f0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x719:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189199.541333:0:26159:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b9a62591/0xcc1762b626f8b9f0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x719:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189199.541348:0:26159:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b9a62591/0xcc1762b626f8b9f0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x719:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189199.541360:0:26159:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1784189199.541368:0:6501:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784189199.541372:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b9a62591/0xcc1762b626f8b9f0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x719:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189199.541378:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dbf4369d600 already unused, calling callback (ffffffffc0b2e230) 00010000:00010000:2.0:1784189199.541382:0:6501:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b9a62591/0xcc1762b626f8b9f0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x719:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189199.541389:0:6501:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b9a62591/0xcc1762b626f8b9f0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x719:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189199.541400:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b9a62591/0xcc1762b626f8b9f0 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x719:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189199.541406:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b9a62591/0xcc1762b626f8b9f0 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x719:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189199.541419:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784189199.541421:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784189199.541422:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1784189199.541465:0:26159:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x718:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1784189199.541476:0:26159:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001000f683/0xcc1762b626f8b9f7 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x718:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189199.541484:0:26159:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x718:0x0].0x0 since=3441s v=(0 0) 00010000:00010000:2.0:1784189199.541487:0:26159:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x718:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784189199.541491:0:26159:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001000f683/0xcc1762b626f8b9f7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x718:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189199.541499:0:26159:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001000f683/0xcc1762b626f8b9f7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x718:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189199.541507:0:26159:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001000f683/0xcc1762b626f8b9f7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x718:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189199.541513:0:26159:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001000f683/0xcc1762b626f8b9f7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x718:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189199.541526:0:26159:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1784189199.541535:0:7454:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784189199.541539:0:7454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001000f683/0xcc1762b626f8b9f7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x718:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189199.541546:0:7454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dbf4369c200 already unused, calling callback (ffffffffc0b2e230) 00010000:00010000:2.0:1784189199.541549:0:7454:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001000f683/0xcc1762b626f8b9f7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x718:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189199.541557:0:7454:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001000f683/0xcc1762b626f8b9f7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x718:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189199.541573:0:7454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001000f683/0xcc1762b626f8b9f7 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x718:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189199.541580:0:7454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001000f683/0xcc1762b626f8b9f7 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x718:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189199.541592:0:7454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784189199.541594:0:7454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784189199.541595:0:7454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1784189199.541635:0:26159:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x717:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1784189199.541640:0:26159:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000027d7c725/0xcc1762b626f8b9fe lrc: 3/0,1 mode: --/PW res: [0x280000401:0x717:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189199.541648:0:26159:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x717:0x0].0x0 since=3441s v=(0 0) 00010000:00010000:2.0:1784189199.541651:0:26159:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x717:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784189199.541655:0:26159:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000027d7c725/0xcc1762b626f8b9fe lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x717:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189199.541664:0:26159:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000027d7c725/0xcc1762b626f8b9fe lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x717:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189199.541672:0:26159:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000027d7c725/0xcc1762b626f8b9fe lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x717:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189199.541680:0:26159:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000027d7c725/0xcc1762b626f8b9fe lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x717:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189199.541704:0:26159:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1784189199.541711:0:6502:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784189199.541715:0:6502:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000027d7c725/0xcc1762b626f8b9fe lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x717:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189199.541722:0:6502:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dbf4369d800 already unused, calling callback (ffffffffc0b2e230) 00010000:00010000:2.0:1784189199.541725:0:6502:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000027d7c725/0xcc1762b626f8b9fe lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x717:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189199.541733:0:6502:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000027d7c725/0xcc1762b626f8b9fe lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x717:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189199.541743:0:6502:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000027d7c725/0xcc1762b626f8b9fe lrc: 1/0,0 mode: --/PW res: [0x280000401:0x717:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189199.541764:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000027d7c725/0xcc1762b626f8b9fe lrc: 0/0,0 mode: --/PW res: [0x280000401:0x717:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189199.541777:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784189199.541779:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784189199.541781:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1784189199.541821:0:26159:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x716:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1784189199.541827:0:26159:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b80d0988/0xcc1762b626f8ba05 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x716:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189199.541834:0:26159:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x716:0x0].0x0 since=3441s v=(0 0) 00010000:00010000:2.0:1784189199.541843:0:26159:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x716:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784189199.541848:0:26159:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b80d0988/0xcc1762b626f8ba05 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x716:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189199.544343:0:26159:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b80d0988/0xcc1762b626f8ba05 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x716:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189199.544359:0:26159:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b80d0988/0xcc1762b626f8ba05 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x716:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189199.544368:0:26159:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b80d0988/0xcc1762b626f8ba05 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x716:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189199.544391:0:26159:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1784189199.544485:0:26159:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x715:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1784189199.544491:0:26159:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009b61650b/0xcc1762b626f8ba0c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x715:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189199.544502:0:26159:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x715:0x0].0x0 since=3441s v=(0 0) 00010000:00010000:2.0:1784189199.544506:0:26159:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x715:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784189199.544512:0:26159:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009b61650b/0xcc1762b626f8ba0c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x715:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189199.544520:0:26159:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009b61650b/0xcc1762b626f8ba0c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x715:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189199.544528:0:26159:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009b61650b/0xcc1762b626f8ba0c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x715:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189199.544549:0:26159:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009b61650b/0xcc1762b626f8ba0c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x715:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189199.544563:0:26159:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1784189199.544574:0:6501:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1784189199.544580:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b80d0988/0xcc1762b626f8ba05 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x716:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189199.544588:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dbf4369c600 already unused, calling callback (ffffffffc0b2e230) 00010000:00010000:2.0:1784189199.544592:0:6501:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b80d0988/0xcc1762b626f8ba05 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x716:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189199.544600:0:6501:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b80d0988/0xcc1762b626f8ba05 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x716:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189199.544617:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b80d0988/0xcc1762b626f8ba05 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x716:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189199.544624:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b80d0988/0xcc1762b626f8ba05 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x716:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189199.544645:0:6501:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784189199.544647:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009b61650b/0xcc1762b626f8ba0c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x715:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189199.544665:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dbf4369cc00 already unused, calling callback (ffffffffc0b2e230) 00010000:00010000:3.0:1784189199.545006:0:26173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1784189199.545419:0:26159:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x714:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784189199.545426:0:26159:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008953f819/0xcc1762b626f8ba13 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x714:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189199.545448:0:26159:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x714:0x0].0x0 since=3441s v=(0 0) 00010000:00010000:3.0:1784189199.545452:0:26159:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x714:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784189199.545457:0:26159:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008953f819/0xcc1762b626f8ba13 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x714:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189199.545468:0:26159:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008953f819/0xcc1762b626f8ba13 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x714:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189199.545476:0:26159:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008953f819/0xcc1762b626f8ba13 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x714:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189199.545483:0:26159:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008953f819/0xcc1762b626f8ba13 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x714:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189199.545499:0:26159:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1784189199.545538:0:26159:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x713:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784189199.545544:0:26159:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000091484d86/0xcc1762b626f8ba1a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x713:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189199.545551:0:26159:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x713:0x0].0x0 since=3441s v=(0 0) 00010000:00010000:3.0:1784189199.545554:0:26159:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x713:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784189199.545557:0:26159:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000091484d86/0xcc1762b626f8ba1a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x713:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189199.545566:0:26159:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000091484d86/0xcc1762b626f8ba1a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x713:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189199.545585:0:26159:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000091484d86/0xcc1762b626f8ba1a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x713:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189199.545592:0:26159:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000091484d86/0xcc1762b626f8ba1a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x713:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189199.545605:0:26159:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:3.0:1784189199.545643:0:26159:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x712:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784189199.545648:0:26159:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009088e939/0xcc1762b626f8ba21 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x712:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189199.545656:0:26159:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x712:0x0].0x0 since=3441s v=(0 0) 00010000:00010000:3.0:1784189199.545659:0:26159:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x712:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784189199.545663:0:26159:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009088e939/0xcc1762b626f8ba21 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x712:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189199.545672:0:26159:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009088e939/0xcc1762b626f8ba21 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x712:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189199.545679:0:26159:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009088e939/0xcc1762b626f8ba21 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x712:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189199.545686:0:26159:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009088e939/0xcc1762b626f8ba21 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x712:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189199.545712:0:26159:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:3.0:1784189199.545720:0:26173:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1784189199.545723:0:26173:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008953f819/0xcc1762b626f8ba13 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x714:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189199.545731:0:26173:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc058f66400 already unused, calling callback (ffffffffc0b2e230) 00010000:00010000:3.0:1784189199.545734:0:26173:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008953f819/0xcc1762b626f8ba13 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x714:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189199.545742:0:26173:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008953f819/0xcc1762b626f8ba13 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x714:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189199.545756:0:26173:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008953f819/0xcc1762b626f8ba13 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x714:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189199.545763:0:26173:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008953f819/0xcc1762b626f8ba13 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x714:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189199.545778:0:26173:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1784189199.545781:0:26173:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000091484d86/0xcc1762b626f8ba1a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x713:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189199.545787:0:26173:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc058f67600 already unused, calling callback (ffffffffc0b2e230) 00010000:00010000:3.0:1784189199.545790:0:26173:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000091484d86/0xcc1762b626f8ba1a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x713:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189199.545807:0:26173:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000091484d86/0xcc1762b626f8ba1a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x713:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189199.545816:0:26173:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000091484d86/0xcc1762b626f8ba1a lrc: 1/0,0 mode: --/PW res: [0x280000401:0x713:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189199.545824:0:26173:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000091484d86/0xcc1762b626f8ba1a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x713:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189199.545835:0:26173:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784189199.545838:0:26173:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009088e939/0xcc1762b626f8ba21 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x712:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189199.545844:0:26173:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc058f67c00 already unused, calling callback (ffffffffc0b2e230) 00010000:00010000:3.0:1784189199.545847:0:26173:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009088e939/0xcc1762b626f8ba21 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x712:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189199.545927:0:26173:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009088e939/0xcc1762b626f8ba21 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x712:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189199.545936:0:26173:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009088e939/0xcc1762b626f8ba21 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x712:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189199.545943:0:26173:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009088e939/0xcc1762b626f8ba21 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x712:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189199.545974:0:26173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784189199.545976:0:26173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784189199.545978:0:26173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1784189199.546019:0:26159:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x711:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784189199.546024:0:26159:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b7722a60/0xcc1762b626f8ba28 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x711:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189199.546031:0:26159:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x711:0x0].0x0 since=3441s v=(0 0) 00010000:00010000:3.0:1784189199.546034:0:26159:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x711:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784189199.546038:0:26159:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b7722a60/0xcc1762b626f8ba28 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x711:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189199.546112:0:26159:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b7722a60/0xcc1762b626f8ba28 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x711:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189199.546120:0:26159:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b7722a60/0xcc1762b626f8ba28 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x711:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189199.546127:0:26159:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b7722a60/0xcc1762b626f8ba28 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x711:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189199.546139:0:26159:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1784189199.546145:0:26173:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784189199.546148:0:26173:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b7722a60/0xcc1762b626f8ba28 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x711:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189199.546164:0:26173:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc058f67a00 already unused, calling callback (ffffffffc0b2e230) 00010000:00010000:3.0:1784189199.546167:0:26173:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b7722a60/0xcc1762b626f8ba28 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x711:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189199.546174:0:26173:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b7722a60/0xcc1762b626f8ba28 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x711:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189199.546185:0:26173:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b7722a60/0xcc1762b626f8ba28 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x711:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189199.546192:0:26173:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b7722a60/0xcc1762b626f8ba28 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x711:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189199.546204:0:26173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784189199.546206:0:26173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784189199.546207:0:26173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1784189199.546250:0:26159:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x710:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784189199.546256:0:26159:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c2da6eae/0xcc1762b626f8ba2f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x710:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189199.546264:0:26159:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x710:0x0].0x0 since=3441s v=(0 0) 00010000:00010000:3.0:1784189199.546266:0:26159:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x710:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784189199.546270:0:26159:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c2da6eae/0xcc1762b626f8ba2f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x710:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189199.546280:0:26159:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c2da6eae/0xcc1762b626f8ba2f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x710:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189199.546296:0:26159:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c2da6eae/0xcc1762b626f8ba2f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x710:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189199.546303:0:26159:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c2da6eae/0xcc1762b626f8ba2f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x710:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189199.546315:0:26159:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1784189199.546343:0:26173:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784189199.546346:0:26173:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c2da6eae/0xcc1762b626f8ba2f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x710:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189199.546352:0:26173:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc058f66e00 already unused, calling callback (ffffffffc0b2e230) 00010000:00010000:3.0:1784189199.546355:0:26173:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c2da6eae/0xcc1762b626f8ba2f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x710:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189199.546363:0:26173:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c2da6eae/0xcc1762b626f8ba2f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x710:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189199.546374:0:26173:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c2da6eae/0xcc1762b626f8ba2f lrc: 1/0,0 mode: --/PW res: [0x280000401:0x710:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189199.546382:0:26173:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c2da6eae/0xcc1762b626f8ba2f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x710:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189199.546394:0:26173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784189199.546400:0:26173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784189199.546402:0:26173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1784189199.546441:0:26159:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x70f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784189199.546446:0:26159:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bd7d33cb/0xcc1762b626f8ba36 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x70f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189199.546454:0:26159:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x70f:0x0].0x0 since=3441s v=(0 0) 00010000:00010000:3.0:1784189199.546457:0:26159:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x70f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784189199.546461:0:26159:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bd7d33cb/0xcc1762b626f8ba36 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x70f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189199.546470:0:26159:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bd7d33cb/0xcc1762b626f8ba36 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x70f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189199.546477:0:26159:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bd7d33cb/0xcc1762b626f8ba36 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x70f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189199.546483:0:26159:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bd7d33cb/0xcc1762b626f8ba36 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x70f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189199.546496:0:26159:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1784189199.546502:0:26173:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784189199.546505:0:26173:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bd7d33cb/0xcc1762b626f8ba36 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x70f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189199.546512:0:26173:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc058f66a00 already unused, calling callback (ffffffffc0b2e230) 00010000:00010000:3.0:1784189199.546515:0:26173:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bd7d33cb/0xcc1762b626f8ba36 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x70f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189199.546533:0:26173:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bd7d33cb/0xcc1762b626f8ba36 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x70f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189199.546545:0:26173:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bd7d33cb/0xcc1762b626f8ba36 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x70f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189199.546552:0:26173:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bd7d33cb/0xcc1762b626f8ba36 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x70f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189199.546564:0:26173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784189199.546566:0:26173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784189199.546567:0:26173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1784189199.546612:0:26159:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x70e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784189199.546617:0:26159:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f0defe11/0xcc1762b626f8ba3d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x70e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189199.546625:0:26159:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x70e:0x0].0x0 since=3441s v=(0 0) 00010000:00010000:3.0:1784189199.546629:0:26159:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x70e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784189199.546633:0:26159:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f0defe11/0xcc1762b626f8ba3d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x70e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189199.546643:0:26159:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f0defe11/0xcc1762b626f8ba3d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x70e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189199.546651:0:26159:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f0defe11/0xcc1762b626f8ba3d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x70e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189199.546665:0:26159:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f0defe11/0xcc1762b626f8ba3d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x70e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189199.546676:0:26159:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1784189199.546683:0:26173:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784189199.546686:0:26173:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f0defe11/0xcc1762b626f8ba3d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x70e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189199.546693:0:26173:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc058f66800 already unused, calling callback (ffffffffc0b2e230) 00010000:00010000:3.0:1784189199.546696:0:26173:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f0defe11/0xcc1762b626f8ba3d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x70e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189199.546704:0:26173:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f0defe11/0xcc1762b626f8ba3d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x70e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189199.546715:0:26173:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f0defe11/0xcc1762b626f8ba3d lrc: 1/0,0 mode: --/PW res: [0x280000401:0x70e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189199.546722:0:26173:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f0defe11/0xcc1762b626f8ba3d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x70e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189199.546734:0:26173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784189199.546736:0:26173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784189199.546737:0:26173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1784189199.546776:0:26159:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x70d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784189199.546787:0:26159:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d5f29200/0xcc1762b626f8ba44 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x70d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189199.546795:0:26159:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x70d:0x0].0x0 since=3441s v=(0 0) 00010000:00010000:3.0:1784189199.546798:0:26159:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x70d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784189199.546802:0:26159:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d5f29200/0xcc1762b626f8ba44 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x70d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189199.546811:0:26159:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d5f29200/0xcc1762b626f8ba44 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x70d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189199.546818:0:26159:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d5f29200/0xcc1762b626f8ba44 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x70d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189199.546825:0:26159:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d5f29200/0xcc1762b626f8ba44 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x70d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189199.546838:0:26159:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1784189199.546845:0:26173:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784189199.546849:0:26173:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d5f29200/0xcc1762b626f8ba44 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x70d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189199.546949:0:6501:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009b61650b/0xcc1762b626f8ba0c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x715:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189199.546970:0:6501:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009b61650b/0xcc1762b626f8ba0c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x715:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189199.546981:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009b61650b/0xcc1762b626f8ba0c lrc: 1/0,0 mode: --/PW res: [0x280000401:0x715:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189199.546987:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009b61650b/0xcc1762b626f8ba0c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x715:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189199.547003:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784189199.547004:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784189199.547006:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784189199.547012:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784189199.547016:0:7454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1784189199.547415:0:26159:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x70c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1784189199.547423:0:26159:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000058b994fe/0xcc1762b626f8ba4b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x70c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189199.547432:0:26159:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x70c:0x0].0x0 since=3441s v=(0 0) 00010000:00010000:2.0:1784189199.547435:0:26159:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x70c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784189199.547440:0:26159:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000058b994fe/0xcc1762b626f8ba4b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x70c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189199.547462:0:26159:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000058b994fe/0xcc1762b626f8ba4b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x70c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189199.547470:0:26159:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000058b994fe/0xcc1762b626f8ba4b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x70c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189199.547479:0:26159:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000058b994fe/0xcc1762b626f8ba4b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x70c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189199.547493:0:26159:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1784189199.547501:0:6501:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784189199.547505:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000058b994fe/0xcc1762b626f8ba4b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x70c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189199.547512:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dbf4369dc00 already unused, calling callback (ffffffffc0b2e230) 00010000:00010000:2.0:1784189199.547516:0:6501:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000058b994fe/0xcc1762b626f8ba4b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x70c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189199.547524:0:6501:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000058b994fe/0xcc1762b626f8ba4b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x70c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189199.547535:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000058b994fe/0xcc1762b626f8ba4b lrc: 1/0,0 mode: --/PW res: [0x280000401:0x70c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189199.547543:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000058b994fe/0xcc1762b626f8ba4b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x70c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189199.547563:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784189199.547565:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784189199.547567:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1784189199.547607:0:26159:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x70b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1784189199.547612:0:26159:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000049369dde/0xcc1762b626f8ba52 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x70b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189199.547620:0:26159:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x70b:0x0].0x0 since=3441s v=(0 0) 00010000:00010000:2.0:1784189199.547623:0:26159:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x70b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784189199.547627:0:26159:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000049369dde/0xcc1762b626f8ba52 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x70b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189199.547635:0:26159:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000049369dde/0xcc1762b626f8ba52 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x70b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189199.547642:0:26159:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000049369dde/0xcc1762b626f8ba52 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x70b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189199.547649:0:26159:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000049369dde/0xcc1762b626f8ba52 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x70b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189199.547661:0:26159:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1784189199.547667:0:6502:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784189199.547670:0:6502:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000049369dde/0xcc1762b626f8ba52 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x70b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189199.547687:0:6502:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dbf4369ca00 already unused, calling callback (ffffffffc0b2e230) 00010000:00010000:2.0:1784189199.547690:0:6502:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000049369dde/0xcc1762b626f8ba52 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x70b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189199.547698:0:6502:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000049369dde/0xcc1762b626f8ba52 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x70b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189199.547708:0:6502:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000049369dde/0xcc1762b626f8ba52 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x70b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189199.547715:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000049369dde/0xcc1762b626f8ba52 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x70b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189199.547728:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784189199.547730:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784189199.547731:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1784189199.547770:0:26159:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x70a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1784189199.547775:0:26159:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f23aca89/0xcc1762b626f8ba59 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x70a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189199.547783:0:26159:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x70a:0x0].0x0 since=3441s v=(0 0) 00010000:00010000:2.0:1784189199.547786:0:26159:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x70a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784189199.547790:0:26159:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f23aca89/0xcc1762b626f8ba59 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x70a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189199.547799:0:26159:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f23aca89/0xcc1762b626f8ba59 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x70a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189199.547814:0:26159:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f23aca89/0xcc1762b626f8ba59 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x70a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189199.547822:0:26159:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f23aca89/0xcc1762b626f8ba59 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x70a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189199.547833:0:26159:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1784189199.547840:0:7454:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784189199.547844:0:7454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f23aca89/0xcc1762b626f8ba59 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x70a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189199.550154:0:26173:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc058f67800 already unused, calling callback (ffffffffc0b2e230) 00010000:00010000:3.0:1784189199.550161:0:26173:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d5f29200/0xcc1762b626f8ba44 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x70d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189199.550172:0:26173:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d5f29200/0xcc1762b626f8ba44 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x70d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189199.550203:0:26173:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d5f29200/0xcc1762b626f8ba44 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x70d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189199.550211:0:26173:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d5f29200/0xcc1762b626f8ba44 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x70d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189199.550235:0:26173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784189199.550237:0:26173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784189199.550240:0:26173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784189199.551583:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf43e12d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1870854458140672:0@lo:13:osp-pre-1-0.0 00002000:00010000:3.0:1784189199.551822:0:26159:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x709:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784189199.551831:0:26159:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000b588bb2/0xcc1762b626f8ba60 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x709:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189199.551845:0:26159:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x709:0x0].0x0 since=3441s v=(0 0) 00010000:00010000:3.0:1784189199.552344:0:26159:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x709:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784189199.552355:0:26159:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000b588bb2/0xcc1762b626f8ba60 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x709:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189199.552371:0:26159:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000b588bb2/0xcc1762b626f8ba60 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x709:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189199.552381:0:26159:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000b588bb2/0xcc1762b626f8ba60 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x709:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189199.552389:0:26159:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000b588bb2/0xcc1762b626f8ba60 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x709:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189199.552431:0:26159:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1784189199.552488:0:26159:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x708:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784189199.552494:0:26159:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000062d13dad/0xcc1762b626f8ba67 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x708:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189199.552501:0:26159:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x708:0x0].0x0 since=3441s v=(0 0) 00010000:00010000:3.0:1784189199.552504:0:26159:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x708:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784189199.552508:0:26159:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000062d13dad/0xcc1762b626f8ba67 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x708:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189199.552517:0:26159:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000062d13dad/0xcc1762b626f8ba67 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x708:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189199.552526:0:26159:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000062d13dad/0xcc1762b626f8ba67 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x708:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189199.552533:0:26159:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000062d13dad/0xcc1762b626f8ba67 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x708:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189199.552554:0:26159:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:3.0:1784189199.552592:0:26159:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x707:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784189199.552597:0:26159:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007391f9a3/0xcc1762b626f8ba6e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x707:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189199.552605:0:26159:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x707:0x0].0x0 since=3441s v=(0 0) 00010000:00010000:3.0:1784189199.552614:0:26159:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x707:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784189199.552619:0:26159:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007391f9a3/0xcc1762b626f8ba6e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x707:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189199.552629:0:26159:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007391f9a3/0xcc1762b626f8ba6e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x707:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189199.552637:0:26159:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007391f9a3/0xcc1762b626f8ba6e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x707:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189199.552644:0:26159:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007391f9a3/0xcc1762b626f8ba6e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x707:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189199.552658:0:26159:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:3.0:1784189199.552669:0:26173:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1784189199.552674:0:26173:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000b588bb2/0xcc1762b626f8ba60 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x709:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189199.552682:0:26173:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc058f66200 already unused, calling callback (ffffffffc0b2e230) 00010000:00010000:3.0:1784189199.552686:0:26173:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000b588bb2/0xcc1762b626f8ba60 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x709:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189199.552695:0:26173:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000b588bb2/0xcc1762b626f8ba60 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x709:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189199.552711:0:26173:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000b588bb2/0xcc1762b626f8ba60 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x709:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189199.552730:0:26173:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000b588bb2/0xcc1762b626f8ba60 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x709:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189199.552751:0:26173:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1784189199.552754:0:26173:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000062d13dad/0xcc1762b626f8ba67 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x708:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189199.552761:0:26173:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc0755a5000 already unused, calling callback (ffffffffc0b2e230) 00010000:00010000:3.0:1784189199.552765:0:26173:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000062d13dad/0xcc1762b626f8ba67 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x708:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189199.552772:0:26173:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000062d13dad/0xcc1762b626f8ba67 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x708:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189199.552783:0:26173:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000062d13dad/0xcc1762b626f8ba67 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x708:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189199.552790:0:26173:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000062d13dad/0xcc1762b626f8ba67 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x708:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189199.552802:0:26173:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784189199.552805:0:26173:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007391f9a3/0xcc1762b626f8ba6e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x707:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189199.552811:0:26173:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc0755a4800 already unused, calling callback (ffffffffc0b2e230) 00010000:00010000:3.0:1784189199.552821:0:26173:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007391f9a3/0xcc1762b626f8ba6e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x707:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189199.552829:0:26173:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007391f9a3/0xcc1762b626f8ba6e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x707:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189199.552839:0:26173:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007391f9a3/0xcc1762b626f8ba6e lrc: 1/0,0 mode: --/PW res: [0x280000401:0x707:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189199.552846:0:26173:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007391f9a3/0xcc1762b626f8ba6e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x707:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189199.552872:0:26173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784189199.552874:0:26173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784189199.552876:0:26173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1784189199.552924:0:26159:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x706:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784189199.552930:0:26159:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005a83b75c/0xcc1762b626f8ba75 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x706:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189199.552938:0:26159:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x706:0x0].0x0 since=3441s v=(0 0) 00010000:00010000:3.0:1784189199.552941:0:26159:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x706:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784189199.552945:0:26159:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005a83b75c/0xcc1762b626f8ba75 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x706:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189199.552966:0:26159:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005a83b75c/0xcc1762b626f8ba75 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x706:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189199.552985:0:26159:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005a83b75c/0xcc1762b626f8ba75 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x706:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189199.552992:0:26159:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005a83b75c/0xcc1762b626f8ba75 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x706:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189199.553004:0:26159:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1784189199.553012:0:26173:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784189199.553015:0:26173:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005a83b75c/0xcc1762b626f8ba75 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x706:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189199.553023:0:26173:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc0755a5200 already unused, calling callback (ffffffffc0b2e230) 00010000:00010000:3.0:1784189199.553027:0:26173:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005a83b75c/0xcc1762b626f8ba75 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x706:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189199.553035:0:26173:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005a83b75c/0xcc1762b626f8ba75 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x706:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189199.553046:0:26173:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005a83b75c/0xcc1762b626f8ba75 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x706:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189199.553053:0:26173:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005a83b75c/0xcc1762b626f8ba75 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x706:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189199.553067:0:26173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784189199.553074:0:26173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784189199.553076:0:26173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1784189199.553117:0:26159:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x705:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784189199.553122:0:26159:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004cf1f60e/0xcc1762b626f8ba7c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x705:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189199.553130:0:26159:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x705:0x0].0x0 since=3441s v=(0 0) 00010000:00010000:3.0:1784189199.553133:0:26159:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x705:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784189199.553137:0:26159:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004cf1f60e/0xcc1762b626f8ba7c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x705:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189199.553146:0:26159:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004cf1f60e/0xcc1762b626f8ba7c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x705:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189199.553152:0:26159:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004cf1f60e/0xcc1762b626f8ba7c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x705:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189199.553159:0:26159:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004cf1f60e/0xcc1762b626f8ba7c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x705:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189199.553170:0:26159:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1784189199.553177:0:26173:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784189199.553181:0:26173:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004cf1f60e/0xcc1762b626f8ba7c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x705:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189199.553187:0:26173:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc0755a4400 already unused, calling callback (ffffffffc0b2e230) 00010000:00010000:3.0:1784189199.553191:0:26173:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004cf1f60e/0xcc1762b626f8ba7c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x705:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189199.553209:0:26173:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004cf1f60e/0xcc1762b626f8ba7c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x705:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189199.553220:0:26173:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004cf1f60e/0xcc1762b626f8ba7c lrc: 1/0,0 mode: --/PW res: [0x280000401:0x705:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189199.553227:0:26173:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004cf1f60e/0xcc1762b626f8ba7c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x705:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189199.553239:0:26173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784189199.553241:0:26173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784189199.553243:0:26173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1784189199.553282:0:26159:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x704:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784189199.553287:0:26159:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b12f7059/0xcc1762b626f8ba83 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x704:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189199.553295:0:26159:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x704:0x0].0x0 since=3441s v=(0 0) 00010000:00010000:3.0:1784189199.553298:0:26159:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x704:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784189199.553301:0:26159:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b12f7059/0xcc1762b626f8ba83 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x704:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189199.553309:0:26159:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b12f7059/0xcc1762b626f8ba83 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x704:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189199.553336:0:26159:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b12f7059/0xcc1762b626f8ba83 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x704:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189199.553350:0:26159:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b12f7059/0xcc1762b626f8ba83 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x704:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189199.553362:0:26159:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1784189199.553368:0:26173:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784189199.553372:0:26173:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b12f7059/0xcc1762b626f8ba83 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x704:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189199.553379:0:26173:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc0755a4600 already unused, calling callback (ffffffffc0b2e230) 00010000:00010000:3.0:1784189199.553382:0:26173:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b12f7059/0xcc1762b626f8ba83 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x704:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189199.553390:0:26173:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b12f7059/0xcc1762b626f8ba83 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x704:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189199.553401:0:26173:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b12f7059/0xcc1762b626f8ba83 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x704:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189199.553408:0:26173:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b12f7059/0xcc1762b626f8ba83 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x704:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189199.553420:0:26173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784189199.553422:0:26173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784189199.553424:0:26173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1784189199.553460:0:26159:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x703:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784189199.553470:0:26159:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c9d589c0/0xcc1762b626f8ba8a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x703:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189199.553477:0:26159:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x703:0x0].0x0 since=3441s v=(0 0) 00010000:00010000:3.0:1784189199.553480:0:26159:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x703:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784189199.553484:0:26159:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c9d589c0/0xcc1762b626f8ba8a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x703:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189199.553493:0:26159:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c9d589c0/0xcc1762b626f8ba8a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x703:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189199.553501:0:26159:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c9d589c0/0xcc1762b626f8ba8a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x703:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189199.553509:0:26159:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c9d589c0/0xcc1762b626f8ba8a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x703:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189199.553521:0:26159:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1784189199.553527:0:26173:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784189199.553530:0:26173:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c9d589c0/0xcc1762b626f8ba8a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x703:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189199.553537:0:26173:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc0755a4c00 already unused, calling callback (ffffffffc0b2e230) 00010000:00010000:3.0:1784189199.553540:0:26173:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c9d589c0/0xcc1762b626f8ba8a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x703:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189199.553548:0:26173:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c9d589c0/0xcc1762b626f8ba8a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x703:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189199.553563:0:26173:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c9d589c0/0xcc1762b626f8ba8a lrc: 1/0,0 mode: --/PW res: [0x280000401:0x703:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189199.553570:0:26173:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c9d589c0/0xcc1762b626f8ba8a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x703:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189199.553581:0:26173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784189199.553583:0:26173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784189199.553585:0:26173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:3.0:1784189199.553611:0:26159:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x280000401:1794 00000100:00100000:3.0:1784189199.553694:0:26159:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc07b5b1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:90967:x1870854458140544:12345-0@lo:5:osp-pre-0-0.0 Request processed in 46378us (49384us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189199.553704:0:26159:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4962 00000100:00100000:3.0:1784189199.553752:0:90967:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc07b5b2300 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:90967:1870854458140544:0@lo:5:osp-pre-0-0.0 00000004:00080000:3.0:1784189199.553765:0:90967:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x280000401:0x721:0x0] from OST, last_created [0x280000401:0x721:0x0]last_used is [0x280000401:0x702:0x0] 00000100:00100000:3.0:1784189199.553826:0:90967:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc0477c3100 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:90967:1870854458141056:0@lo:5:osp-pre-0-0.0 00000100:00100000:3.0:1784189199.553860:0:90967:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784189199.553883:0:90967:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dc062096000 going to sleep for 11 seconds 00000100:00100000:3.0:1784189199.553901:0:26166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458141056 00000100:00100000:3.0:1784189199.553908:0:26166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458141056 00000100:00100000:3.0:1784189199.553947:0:26166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4964 00000100:00100000:1.0:1784189199.554879:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc07b5b2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1870854458140928:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1784189199.554927:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784189199.555041:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458140928 00000100:00100000:1.0:1784189199.555046:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458140928 00000100:00100000:1.0:1784189199.555081:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1975 00000100:00100000:1.0:1784189199.555089:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf43e12d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3640:x1870854458140928:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1784189199.555114:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 16014272 pending 0 free 3922481152 avail 3690958848 00000100:00100000:1.0:1784189199.555154:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf43e12d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3640:x1870854458140928:12345-0@lo:13:osp-pre-0-0.0 Request processed in 65us (225us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189199.555160:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1975 00000100:00100000:1.0:1784189199.555201:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc07b5b2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1870854458140928:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1784189199.555218:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784189199.557104:0:7454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dbf4369de00 already unused, calling callback (ffffffffc0b2e230) 00010000:00010000:2.0:1784189199.557115:0:7454:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f23aca89/0xcc1762b626f8ba59 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x70a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189199.557131:0:7454:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f23aca89/0xcc1762b626f8ba59 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x70a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189199.557154:0:7454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f23aca89/0xcc1762b626f8ba59 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x70a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189199.557163:0:7454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f23aca89/0xcc1762b626f8ba59 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x70a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189199.557200:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784189199.557213:0:7454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784189199.557215:0:7454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784189199.557217:0:7454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784189199.557615:0:26166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf44bc1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+5:90967:x1870854458141056:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:3.0:1784189199.557661:0:26166:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000401 at 1826 00000100:00100000:3.0:1784189199.565015:0:26166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf44bc1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+6:90967:x1870854458141056:12345-0@lo:5:osp-pre-0-0.0 Request processed in 11050us (11143us total) trans 4294968953 rc 0/0 00000100:00100000:3.0:1784189199.565036:0:26166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4964 00000001:00100000:0.0:1784189199.566053:0:9506:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:2.0:1784189199.570213:0:90967:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc0477c3100 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:90967:1870854458141056:0@lo:5:osp-pre-0-0.0 00000004:00080000:2.0:1784189199.570236:0:90967:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x280000401:0x721:0x0]-[0x280000401:0x741:0x0] 00000001:00080000:0.0:1784189199.576719:0:9506:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294968956 is committed 00000100:00100000:3.0:1784189199.576944:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf43e10700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:90969:x1870854458140800:12345-0@lo:5:osp-pre-1-0.0 Request processed in 36752us (40147us total) trans 4294968956 rc 0/0 00000100:00100000:3.0:1784189199.576966:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4963 00000100:00100000:0.0:1784189199.577149:0:90969:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294968956 gen 2 00000100:00100000:0.0:1784189199.577159:0:90969:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf43e10a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:90969:1870854458140800:0@lo:5:osp-pre-1-0.0 00000004:00080000:0.0:1784189199.577173:0:90969:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x2c0000401:0x721:0x0]-[0x2c0000401:0x741:0x0] 00000100:00100000:2.0:1784189199.656201:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1784189199.656244:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1784189199.656346:0:66945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436282368 00000100:00100000:0.0:1784189199.656356:0:66945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436282368 00000100:00100000:0.0:1784189199.656425:0:66945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1197 00000100:00100000:0.0:1784189199.656435:0:66945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf470e0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+6:2398:x1870854436282368:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:0.0:1784189199.656507:0:66945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf470e0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+6:2398:x1870854436282368:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 72us (316us total) trans 0 rc 0/0 00000100:00100000:0.0:1784189199.656515:0:66945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1197 00000100:00100000:3.0:1784189199.656668:0:26163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436282624 00000100:00100000:3.0:1784189199.656673:0:26163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436282624 00000100:00100000:3.0:1784189199.656792:0:26163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 2468 00000100:00100000:3.0:1784189199.656800:0:26163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf470e2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+7:2398:x1870854436282624:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:3.0:1784189199.656829:0:26163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf470e2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+7:2398:x1870854436282624:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 30us (585us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189199.656836:0:26163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 2468 00000100:00100000:3.0:1784189199.656893:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1784189199.656949:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1784189199.657307:0:26170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436282496 00000100:00100000:3.0:1784189199.657313:0:26170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436282496 00000100:00100000:3.0:1784189199.657371:0:26170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 2469 00000100:00100000:3.0:1784189199.657378:0:26170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf44bc1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+6:2398:x1870854436282496:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:3.0:1784189199.657415:0:26170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf44bc1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+6:2398:x1870854436282496:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 36us (465us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189199.657422:0:26170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 2469 00000100:00100000:3.0:1784189199.657443:0:90955:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436282240 00000100:00100000:3.0:1784189199.657447:0:90955:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436282240 00000100:00100000:3.0:1784189199.657475:0:90955:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 76 00000100:00100000:3.0:1784189199.657482:0:90955:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf46be7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9957a2dc-fd88-4a91-bca3-e2b7f365ab0c+10:2398:x1870854436282240:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:3.0:1784189199.657507:0:90955:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf46be7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9957a2dc-fd88-4a91-bca3-e2b7f365ab0c+10:2398:x1870854436282240:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 25us (614us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189199.657525:0:90955:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 76 00000100:00080000:2.0:1784189199.657735:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1784189199.657739:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1784189199.657742:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000020:00000004:1.0:1784189199.722413:0:91287:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1784189199.722818:0:91287:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000001:00100000:2.0:1784189199.932133:0:75588:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:1.0:1784189200.111886:0:26173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1784189200.559896:0:91337:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1784189200.560942:0:91337:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1784189201.139180:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784189202.159664:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784189202.458604:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1784189202.462224:0:66171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436282752 00000100:00100000:0.0:1784189202.462250:0:66171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436282752 00000100:00100000:0.0:1784189202.462509:0:66171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1279 00000100:00100000:0.0:1784189202.462522:0:66171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf44bc2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+7:69830:x1870854436282752:12345-192.168.203.12@tcp:101:lfs.0 00010000:00010000:0.0:1784189202.462549:0:66171:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784189202.462578:0:66171:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04152d200/0xcc1762b626f8ba91 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbfc5de7fe6c3e87 expref: -99 pid: 66171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189202.462670:0:66171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04152c600/0xcc1762b626f8ba98 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189202.462687:0:66171:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04152c600/0xcc1762b626f8ba98 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189202.462700:0:66171:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04152c600/0xcc1762b626f8ba98 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784189202.462788:0:66171:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1784189202.462793:0:66171:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1784189202.462840:0:66171:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04152c600/0xcc1762b626f8ba98 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189202.462869:0:66171:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04152d200/0xcc1762b626f8ba91 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c3e87 expref: 9 pid: 66171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189202.462892:0:66171:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04152c600/0xcc1762b626f8ba98 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c3e87 expref: 8 pid: 66171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189202.462985:0:66171:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9dc056eaaf00) 00010000:00010000:0.0:1784189202.462989:0:66171:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1784189202.462993:0:66171:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc04152c600, rc 0) 00000100:00100000:0.0:1784189202.463239:0:66171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf44bc2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+8:69830:x1870854436282752:12345-192.168.203.12@tcp:101:lfs.0 Request processed in 718us (4647us total) trans 0 rc 0/0 00000100:00100000:0.0:1784189202.463248:0:66171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1279 00000100:00080000:2.0:1784189202.467043:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1784189202.469732:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1784189202.469855:0:66170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436282880 00000100:00100000:1.0:1784189202.469870:0:66170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436282880 00000100:00100000:1.0:1784189202.469961:0:66170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1280 00000100:00100000:1.0:1784189202.469994:0:66170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf4a342680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+8:69830:x1870854436282880:12345-192.168.203.12@tcp:41:lfs.0 00000004:00000024:1.0:1784189202.470056:0:66170:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445281792 avail 1299042304 00000100:00100000:1.0:1784189202.470162:0:66170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf4a342680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+8:69830:x1870854436282880:12345-192.168.203.12@tcp:41:lfs.0 Request processed in 172us (444us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189202.470171:0:66170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1280 00000100:00100000:1.0:1784189202.472731:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1784189202.472830:0:68287:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436283008 00000100:00100000:0.0:1784189202.472841:0:68287:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436283008 00000100:00100000:0.0:1784189202.472970:0:68287:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1281 00000100:00100000:0.0:1784189202.472983:0:68287:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf43e13800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+6:69830:x1870854436283008:12345-192.168.203.12@tcp:41:lfs.0 00000004:00000024:0.0:1784189202.473042:0:68287:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445576704 avail 1299337216 00000100:00100000:0.0:1784189202.473132:0:68287:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf43e13800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+6:69830:x1870854436283008:12345-192.168.203.12@tcp:41:lfs.0 Request processed in 153us (413us total) trans 0 rc 0/0 00000100:00100000:0.0:1784189202.473745:0:68287:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1281 00000100:00080000:2.0:1784189202.476338:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1784189202.477648:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1784189202.477853:0:9466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436283136 00000100:00100000:1.0:1784189202.477866:0:9466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436283136 00000100:00100000:1.0:1784189202.477973:0:9466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1976 00000100:00100000:1.0:1784189202.477987:0:9466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf46434000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+6:69830:x1870854436283136:12345-192.168.203.12@tcp:13:lfs.0 00002000:00000024:1.0:1784189202.478049:0:9466:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 16013376 pending 0 free 3922481152 avail 3690958848 00000100:00100000:1.0:1784189202.478147:0:9466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf46434000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+6:69830:x1870854436283136:12345-192.168.203.12@tcp:13:lfs.0 Request processed in 155us (500us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189202.478156:0:9466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1976 00000100:00080000:2.0:1784189202.479637:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1784189202.479705:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc05ed91f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1870854458141184:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1784189202.479784:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784189202.479890:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458141184 00000100:00100000:3.0:1784189202.479899:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458141184 00000100:00100000:3.0:1784189202.479986:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1977 00000100:00100000:3.0:1784189202.479999:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf4a343b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1870854458141184:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1784189202.480310:0:8432:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8648768 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1784189202.480399:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf4a343b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1870854458141184:12345-0@lo:13:osp-pre-1-1.0 Request processed in 403us (614us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189202.480408:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1977 00000100:00100000:3.0:1784189202.480536:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc05ed91f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1870854458141184:0@lo:13:osp-pre-1-1.0 00000100:00080000:2.0:1784189202.480770:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1784189202.480944:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1784189202.480969:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc05ed91f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1870854458141312:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1784189202.481306:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784189202.481496:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458141312 00000100:00100000:3.0:1784189202.481504:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458141312 00000100:00100000:3.0:1784189202.481636:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1978 00000100:00100000:3.0:1784189202.481646:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf470e3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1870854458141312:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1784189202.481669:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 16013376 pending 0 free 3922481152 avail 3690958848 00000100:00100000:3.0:1784189202.481728:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf470e3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1870854458141312:12345-0@lo:13:osp-pre-0-1.0 Request processed in 83us (422us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189202.481734:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1978 00000100:00100000:1.0:1784189202.481811:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc05ed91f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1870854458141312:0@lo:13:osp-pre-0-1.0 00000100:00080000:2.0:1784189202.482350:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1784189202.483769:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1784189202.486438:0:9466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436283264 00000100:00100000:0.0:1784189202.486460:0:9466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436283264 00000100:00100000:0.0:1784189202.486629:0:9466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1979 00000100:00100000:0.0:1784189202.486646:0:9466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc05ed91880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+7:69830:x1870854436283264:12345-192.168.203.12@tcp:13:lfs.0 00002000:00000024:0.0:1784189202.486681:0:9466:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8648768 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1784189202.487919:0:9466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc05ed91880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+7:69830:x1870854436283264:12345-192.168.203.12@tcp:13:lfs.0 Request processed in 1266us (4149us total) trans 0 rc 0/0 00000100:00100000:0.0:1784189202.487943:0:9466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1979 00000100:00080000:2.0:1784189202.496137:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1784189203.185469:0:7454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784189204.212786:0:26173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784189204.528122:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1784189204.528155:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf470e3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1870854458141440:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1784189204.528252:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784189204.528358:0:23826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458141440 00000100:00100000:1.0:1784189204.528367:0:23826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458141440 00000100:00100000:1.0:1784189204.528429:0:23826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3813 00000100:00100000:1.0:1784189204.528439:0:23826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf43e13100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3642:x1870854458141440:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1784189204.528486:0:23826:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445281792 avail 1299042304 00000100:00100000:1.0:1784189204.528543:0:23826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf43e13100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3642:x1870854458141440:12345-0@lo:41:osp-pre-0-1.0 Request processed in 104us (291us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189204.528569:0:23826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3813 00000100:00100000:1.0:1784189204.528628:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf470e3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1870854458141440:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1784189204.529683:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1784189204.529702:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf470e2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1870854458141568:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1784189204.529762:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784189204.529813:0:26492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458141568 00000100:00100000:2.0:1784189204.529821:0:26492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458141568 00000100:00100000:2.0:1784189204.529883:0:26492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3814 00000100:00100000:2.0:1784189204.529891:0:26492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf470e3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3641:x1870854458141568:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1784189204.529937:0:26492:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445576704 avail 1299337216 00000100:00100000:2.0:1784189204.529983:0:26492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf470e3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3641:x1870854458141568:12345-0@lo:41:osp-pre-1-0.0 Request processed in 93us (221us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189204.529991:0:26492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3814 00000100:00100000:2.0:1784189204.530040:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf470e2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1870854458141568:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1784189204.531430:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf470e0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3642:1870854458141824:0@lo:400:kworker.0 00000100:00100000:2.0:1784189204.531528:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784189204.531563:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf470e0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1870854458142336:0@lo:400:kworker.0 00000100:00100000:2.0:1784189204.531592:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784189204.531612:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf470e1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1870854458142848:0@lo:400:kworker.0 00000100:00100000:2.0:1784189204.531634:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784189204.531657:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:2.0:1784189204.531663:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf470e1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3642:1870854458141952:0@lo:400:kworker.0 00000100:00100000:2.0:1784189204.531688:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784189204.531707:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf470e1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1870854458142464:0@lo:400:kworker.0 00000100:00100000:2.0:1784189204.531729:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784189204.531747:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf470e3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3642:1870854458142976:0@lo:400:kworker.0 00000100:00100000:2.0:1784189204.531767:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784189204.531806:0:66169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458141824 00000100:00100000:2.0:1784189204.531813:0:66169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458141824 00000100:00100000:2.0:1784189204.531876:0:66169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458141952 00000100:00100000:2.0:1784189204.531879:0:66169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458141952 00000100:00100000:2.0:1784189204.531900:0:66169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458142976 00000100:00100000:2.0:1784189204.531903:0:66169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458142976 00000100:00100000:2.0:1784189204.531947:0:66169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1198 00000100:00100000:2.0:1784189204.531956:0:66169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc07fb35500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3642:x1870854458141824:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784189204.532008:0:66169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc07fb35500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3642:x1870854458141824:12345-0@lo:400:kworker.0 Request processed in 53us (480us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189204.532015:0:66169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1198 00000100:00100000:2.0:1784189204.532031:0:66169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1199 00000100:00100000:2.0:1784189204.532037:0:66169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc07fb35c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1870854458141952:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784189204.532067:0:66169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc07fb35c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1870854458141952:12345-0@lo:400:kworker.0 Request processed in 30us (378us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189204.532073:0:66169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1199 00000100:00100000:2.0:1784189204.532085:0:66169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1200 00000100:00100000:2.0:1784189204.532091:0:66169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc07fb35180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1870854458142976:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784189204.532116:0:66169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc07fb35180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1870854458142976:12345-0@lo:400:kworker.0 Request processed in 25us (347us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189204.532122:0:66169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1200 00000100:00100000:2.0:1784189204.532142:0:26223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458142336 00000100:00100000:2.0:1784189204.532145:0:26223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458142336 00000100:00100000:2.0:1784189204.532172:0:26223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458142848 00000100:00100000:2.0:1784189204.532175:0:26223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458142848 00000100:00100000:2.0:1784189204.532194:0:26223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458142464 00000100:00100000:2.0:1784189204.532197:0:26223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458142464 00000100:00100000:2.0:1784189204.532217:0:26223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2470 00000100:00100000:2.0:1784189204.532223:0:26223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc07fb34380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0001-mdtlov_UUID+5:3642:x1870854458142336:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784189204.532253:0:26223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc07fb34380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0001-mdtlov_UUID+5:3642:x1870854458142336:12345-0@lo:400:kworker.0 Request processed in 31us (661us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189204.532258:0:26223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2470 00000100:00100000:2.0:1784189204.532270:0:26223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2471 00000100:00100000:2.0:1784189204.532285:0:26223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc07fb35880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0000-mdtlov_UUID+5:3642:x1870854458142848:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784189204.532315:0:26223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc07fb35880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0000-mdtlov_UUID+5:3642:x1870854458142848:12345-0@lo:400:kworker.0 Request processed in 31us (680us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189204.532355:0:26223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2471 00000100:00100000:2.0:1784189204.532368:0:26223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2472 00000100:00100000:2.0:1784189204.532374:0:26223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc07fb37480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0001-mdtlov_UUID+5:3642:x1870854458142464:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784189204.532399:0:26223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc07fb37480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0001-mdtlov_UUID+5:3642:x1870854458142464:12345-0@lo:400:kworker.0 Request processed in 26us (670us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189204.532406:0:26223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2472 00000100:00080000:2.0:1784189204.532442:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1784189204.532446:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1784189204.532449:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1784189204.532451:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1784189204.532508:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf470e1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3642:1870854458141952:0@lo:400:kworker.0 00000100:00100000:2.0:1784189204.532519:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf470e1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1870854458142464:0@lo:400:kworker.0 00000100:00100000:2.0:1784189204.532530:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf470e3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3642:1870854458142976:0@lo:400:kworker.0 00000100:00100000:2.0:1784189204.532540:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf470e0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3642:1870854458141824:0@lo:400:kworker.0 00000100:00100000:2.0:1784189204.532547:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf470e0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1870854458142336:0@lo:400:kworker.0 00000100:00100000:2.0:1784189204.532556:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf470e1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1870854458142848:0@lo:400:kworker.0 00000100:00100000:1.0:1784189204.535020:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf470e0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3640:1870854458142080:0@lo:400:kworker.0 00000100:00100000:1.0:1784189204.535112:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784189204.535163:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf470e1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3640:1870854458142592:0@lo:400:kworker.0 00000100:00100000:1.0:1784189204.535182:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784189204.535491:0:66170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458142080 00000100:00100000:2.0:1784189204.535501:0:66170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458142080 00000100:00100000:2.0:1784189204.535568:0:66170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458142592 00000100:00100000:2.0:1784189204.535571:0:66170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458142592 00000100:00100000:2.0:1784189204.535589:0:66170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1201 00000100:00100000:2.0:1784189204.535597:0:66170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf43e12680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3640:x1870854458142080:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784189204.535700:0:66169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1202 00000100:00100000:3.0:1784189204.535709:0:66169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf43e13b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1870854458142592:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784189204.535773:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf470e2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:bd553d0d-03e2-4233-b06b-b55bbfa2b954:3641:1870854458141696:0@lo:400:kworker.0 00000100:00100000:2.0:1784189204.537183:0:66170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf43e12680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3640:x1870854458142080:12345-0@lo:400:kworker.0 Request processed in 1577us (2060us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189204.537198:0:66170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1201 00000100:00080000:2.0:1784189204.537251:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1784189204.541336:0:66169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf43e13b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1870854458142592:12345-0@lo:400:kworker.0 Request processed in 5596us (6119us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189204.541377:0:66169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1202 00000100:00100000:0.0:1784189204.541712:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784189204.541778:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf470e1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3641:1870854458142208:0@lo:400:kworker.0 00000100:00100000:0.0:1784189204.541828:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784189204.541895:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf470e3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1870854458142720:0@lo:400:kworker.0 00000100:00100000:2.0:1784189204.541979:0:90956:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458141696 00000100:00100000:2.0:1784189204.541989:0:90956:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458141696 00000100:00100000:2.0:1784189204.542048:0:90956:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1784189204.542056:0:90956:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc07037fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd553d0d-03e2-4233-b06b-b55bbfa2b954+24:3641:x1870854458141696:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784189204.542116:0:90956:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc07037fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd553d0d-03e2-4233-b06b-b55bbfa2b954+24:3641:x1870854458141696:12345-0@lo:400:kworker.0 Request processed in 59us (404us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189204.542123:0:90956:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1784189204.542207:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784189204.542264:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf470e2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:bd553d0d-03e2-4233-b06b-b55bbfa2b954:3641:1870854458141696:0@lo:400:kworker.0 00000100:00100000:2.0:1784189204.543723:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458142720 00000100:00100000:2.0:1784189204.543736:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458142720 00000100:00100000:2.0:1784189204.543798:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2473 00000100:00100000:2.0:1784189204.543808:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf4a341f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3641:x1870854458142720:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784189204.543891:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf4a341f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3641:x1870854458142720:12345-0@lo:400:kworker.0 Request processed in 83us (1682us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189204.543899:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2473 00000100:00080000:2.0:1784189204.543938:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1784189204.543981:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf470e3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1870854458142720:0@lo:400:kworker.0 00000100:00100000:1.0:1784189204.550069:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf470e1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3640:1870854458142592:0@lo:400:kworker.0 00000100:00100000:1.0:1784189204.550134:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf470e0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3640:1870854458142080:0@lo:400:kworker.0 00000100:00100000:3.0:1784189204.551024:0:68287:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458142208 00000100:00100000:3.0:1784189204.551037:0:68287:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458142208 00000100:00100000:3.0:1784189204.551143:0:68287:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1203 00000100:00100000:3.0:1784189204.551155:0:68287:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf4a340e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1870854458142208:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784189204.551266:0:68287:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf4a340e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1870854458142208:12345-0@lo:400:kworker.0 Request processed in 113us (9437us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189204.551275:0:68287:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1203 00000100:00100000:3.0:1784189204.551344:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf470e1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3641:1870854458142208:0@lo:400:kworker.0 00000100:00080000:0.0:1784189204.551564:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1784189204.778464:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1784189204.778510:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1784189204.778618:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1784189204.778649:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1784189204.778676:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1784189204.778713:0:90954:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436283392 00000100:00100000:2.0:1784189204.778733:0:90954:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436283392 00000100:00100000:2.0:1784189204.778801:0:90954:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 78 00000100:00100000:2.0:1784189204.778813:0:90954:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc07037e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9957a2dc-fd88-4a91-bca3-e2b7f365ab0c+10:2399:x1870854436283392:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:2.0:1784189204.778911:0:90954:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc07037e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9957a2dc-fd88-4a91-bca3-e2b7f365ab0c+10:2399:x1870854436283392:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 100us (461us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189204.778933:0:90954:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 78 00000100:00100000:2.0:1784189204.778975:0:66171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436283648 00000100:00100000:2.0:1784189204.778979:0:66171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436283648 00000100:00100000:1.0:1784189204.780186:0:26169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436283904 00000100:00100000:1.0:1784189204.780199:0:26169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436283904 00000100:00100000:1.0:1784189204.780267:0:26169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436283776 00000100:00100000:1.0:1784189204.780272:0:26169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436283776 00000100:00100000:1.0:1784189204.780306:0:26169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 2474 00000100:00100000:1.0:1784189204.780340:0:26169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc07fb36a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+7:2399:x1870854436283904:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:1.0:1784189204.780413:0:26169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc07fb36a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+7:2399:x1870854436283904:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 99us (1795us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189204.780421:0:26169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 2474 00000100:00100000:1.0:1784189204.780441:0:26169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 2475 00000100:00100000:1.0:1784189204.780448:0:26169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc07fb34700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+6:2399:x1870854436283776:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:1.0:1784189204.780473:0:26169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc07fb34700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+6:2399:x1870854436283776:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 26us (1797us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189204.780479:0:26169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 2475 00000100:00100000:2.0:1784189204.780737:0:66171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436283520 00000100:00100000:2.0:1784189204.780743:0:66171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436283520 00000100:00100000:1.0:1784189204.782349:0:66945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1204 00000100:00100000:0.0:1784189204.783206:0:66945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc07fb36d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+6:2399:x1870854436283648:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:0.0:1784189204.783356:0:66945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc07fb36d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+6:2399:x1870854436283648:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 932us (4804us total) trans 0 rc 0/0 00000100:00100000:0.0:1784189204.783368:0:66945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1204 00000100:00100000:0.0:1784189204.783409:0:66945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1205 00000100:00100000:0.0:1784189204.783421:0:66945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc07fb34a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+8:2399:x1870854436283520:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:0.0:1784189204.783473:0:66945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc07fb34a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+8:2399:x1870854436283520:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 55us (4822us total) trans 0 rc 0/0 00000100:00100000:0.0:1784189204.783480:0:66945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1205 00000100:00080000:1.0:1784189204.790411:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1784189204.790425:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1784189204.790428:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1784189204.790432:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1784189205.040242:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf43e10e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1870854458143104:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1784189205.040360:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784189205.040440:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458143104 00000100:00100000:1.0:1784189205.040450:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458143104 00000100:00100000:1.0:1784189205.040512:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1980 00000100:00100000:1.0:1784189205.040523:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf43e11f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1870854458143104:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1784189205.040564:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8648768 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1784189205.040627:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf43e11f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1870854458143104:12345-0@lo:13:osp-pre-1-0.0 Request processed in 105us (267us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189205.040635:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1980 00000100:00100000:1.0:1784189205.040691:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf43e10e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1870854458143104:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1784189205.041408:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc05ed91f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1870854458143232:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1784189205.041457:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784189205.041554:0:9466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458143232 00000100:00100000:3.0:1784189205.041560:0:9466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458143232 00000100:00100000:3.0:1784189205.041609:0:9466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1981 00000100:00100000:3.0:1784189205.041617:0:9466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf43e10e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3641:x1870854458143232:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1784189205.041641:0:9466:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 16013376 pending 0 free 3922481152 avail 3690958848 00000100:00100000:3.0:1784189205.041681:0:9466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf43e10e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3641:x1870854458143232:12345-0@lo:13:osp-pre-0-0.0 Request processed in 65us (224us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189205.041687:0:9466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1981 00000100:00100000:1.0:1784189205.047217:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc05ed91f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1870854458143232:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1784189205.234554:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1784189205.558658:0:8423:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294968953 is committed 00010000:00010000:2.0:1784189206.257174:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784189207.279748:0:7454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784189207.599674:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc05ed91f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1870854458143360:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1784189207.599785:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784189207.600221:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458143360 00000100:00100000:0.0:1784189207.600233:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458143360 00000100:00100000:0.0:1784189207.600338:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1982 00000100:00100000:0.0:1784189207.600351:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf464ac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1870854458143360:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1784189207.600389:0:8432:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8648768 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1784189207.600471:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf464ac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1870854458143360:12345-0@lo:13:osp-pre-1-1.0 Request processed in 122us (685us total) trans 0 rc 0/0 00000100:00100000:0.0:1784189207.600480:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1982 00000100:00100000:1.0:1784189207.600573:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf464ad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1870854458143488:0@lo:13:osp-pre-0-1.0 00000100:00080000:2.0:1784189207.600580:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1784189207.600612:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784189207.600703:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458143488 00000100:00100000:3.0:1784189207.600710:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458143488 00000100:00100000:2.0:1784189207.600711:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc05ed91f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1870854458143360:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1784189207.600766:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1983 00000100:00100000:3.0:1784189207.600776:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf43e10000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1870854458143488:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1784189207.600797:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 16013376 pending 0 free 3922481152 avail 3690958848 00000100:00100000:3.0:1784189207.600847:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf43e10000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1870854458143488:12345-0@lo:13:osp-pre-0-1.0 Request processed in 73us (234us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189207.600870:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1983 00000100:00080000:1.0:1784189207.600928:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1784189207.601558:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf464ad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1870854458143488:0@lo:13:osp-pre-0-1.0 00010000:00010000:1.0:1784189208.303655:0:26173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1784189208.526749:0:91531:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg312-client.virtnet: executing wait_import_state_mount (FULL|IDLE) mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 00010000:00010000:1.0:1784189209.327801:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784189209.647506:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc07fb36300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bd553d0d-03e2-4233-b06b-b55bbfa2b954:3640:1870854458143616:0@lo:400:kworker.0 00000100:00100000:0.0:1784189209.647578:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784189209.648724:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1784189209.648737:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc07fb37800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3640:1870854458143744:0@lo:400:kworker.0 00000100:00100000:0.0:1784189209.648786:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784189209.648874:0:66170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458143744 00000100:00100000:3.0:1784189209.648892:0:66170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458143744 00000100:00100000:3.0:1784189209.648954:0:66170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1206 00000100:00100000:3.0:1784189209.648963:0:66170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf4a340000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1870854458143744:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784189209.649021:0:66170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf4a340000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1870854458143744:12345-0@lo:400:kworker.0 Request processed in 60us (235us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189209.649028:0:66170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1206 00000100:00100000:3.0:1784189209.649721:0:90955:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458143616 00000100:00100000:3.0:1784189209.649727:0:90955:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458143616 00000100:00100000:3.0:1784189209.649760:0:90955:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1784189209.649767:0:90955:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc07037f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd553d0d-03e2-4233-b06b-b55bbfa2b954+24:3640:x1870854458143616:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784189209.649808:0:90955:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc07037f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd553d0d-03e2-4233-b06b-b55bbfa2b954+24:3640:x1870854458143616:12345-0@lo:400:kworker.0 Request processed in 42us (2231us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189209.649815:0:90955:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00080000:0.0:1784189209.650411:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1784189209.650463:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc07fb37800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3640:1870854458143744:0@lo:400:kworker.0 00000100:00100000:0.0:1784189209.650475:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc07fb36300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bd553d0d-03e2-4233-b06b-b55bbfa2b954:3640:1870854458143616:0@lo:400:kworker.0 00000100:00100000:3.0:1784189209.651376:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf464ad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1870854458144000:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1784189209.651426:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784189209.651472:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1784189209.651479:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf464adf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1870854458143872:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1784189209.651503:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784189209.651616:0:23826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458144000 00000100:00100000:0.0:1784189209.651626:0:23826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458144000 00000100:00100000:0.0:1784189209.651666:0:23826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458143872 00000100:00100000:0.0:1784189209.651669:0:23826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458143872 00000100:00100000:0.0:1784189209.651688:0:23826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3815 00000100:00100000:0.0:1784189209.651695:0:23826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc056eaf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3643:x1870854458144000:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1784189209.651729:0:23826:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445281792 avail 1299042304 00000100:00100000:0.0:1784189209.651769:0:23826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc056eaf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3643:x1870854458144000:12345-0@lo:41:osp-pre-0-1.0 Request processed in 74us (342us total) trans 0 rc 0/0 00000100:00100000:0.0:1784189209.651776:0:23826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3815 00000100:00100000:0.0:1784189209.651789:0:23826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3816 00000100:00100000:0.0:1784189209.651794:0:23826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf4367c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3643:x1870854458143872:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1784189209.651821:0:23826:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445576704 avail 1299337216 00000100:00100000:0.0:1784189209.651846:0:23826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf4367c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3643:x1870854458143872:12345-0@lo:41:osp-pre-1-0.0 Request processed in 52us (342us total) trans 0 rc 0/0 00000100:00100000:0.0:1784189209.651852:0:23826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3816 00000100:00100000:0.0:1784189209.651903:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf464adf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1870854458143872:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1784189209.651915:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf464ad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1870854458144000:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1784189209.652193:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc07fb37100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3640:1870854458144128:0@lo:400:kworker.0 00000100:00100000:0.0:1784189209.652222:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784189209.652271:0:66171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458144128 00000100:00100000:2.0:1784189209.652275:0:66171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458144128 00000100:00100000:2.0:1784189209.652309:0:66171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1207 00000100:00100000:2.0:1784189209.652316:0:66171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf4a341500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1870854458144128:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1784189209.653006:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1784189209.669410:0:66171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf4a341500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1870854458144128:12345-0@lo:400:kworker.0 Request processed in 17085us (17177us total) trans 0 rc 0/0 00000100:00100000:0.0:1784189209.669576:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc07fb37100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3640:1870854458144128:0@lo:400:kworker.0 00000100:00100000:2.0:1784189209.669638:0:66171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1207 00000100:00100000:2.0:1784189209.669751:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc07fb37b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3642:1870854458144384:0@lo:400:kworker.0 00000100:00100000:2.0:1784189209.669803:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784189209.669853:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1784189209.669859:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc07fb35f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1870854458144512:0@lo:400:kworker.0 00000100:00100000:2.0:1784189209.669896:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784189209.669939:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458144512 00000100:00100000:2.0:1784189209.669945:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458144512 00000100:00100000:0.0:1784189209.670072:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1784189209.670081:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc07fb36680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3640:1870854458144256:0@lo:400:kworker.0 00000100:00100000:0.0:1784189209.670110:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784189209.670134:0:66170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458144384 00000100:00100000:0.0:1784189209.670138:0:66170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458144384 00000100:00100000:0.0:1784189209.670166:0:66170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458144256 00000100:00100000:0.0:1784189209.670169:0:66170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458144256 00000100:00100000:0.0:1784189209.670189:0:66170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1208 00000100:00100000:0.0:1784189209.670196:0:66170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc07fb34e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1870854458144384:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784189209.670251:0:66170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc07fb34e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1870854458144384:12345-0@lo:400:kworker.0 Request processed in 54us (447us total) trans 0 rc 0/0 00000100:00100000:0.0:1784189209.670257:0:66170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1208 00000100:00100000:0.0:1784189209.670272:0:66170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1209 00000100:00100000:0.0:1784189209.670278:0:66170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf4a340380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3640:x1870854458144256:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784189209.670304:0:66170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf4a340380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3640:x1870854458144256:12345-0@lo:400:kworker.0 Request processed in 26us (194us total) trans 0 rc 0/0 00000100:00100000:0.0:1784189209.670310:0:66170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1209 00000100:00100000:0.0:1784189209.670366:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc07fb36680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3640:1870854458144256:0@lo:400:kworker.0 00000100:00100000:2.0:1784189209.670636:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2476 00000100:00100000:2.0:1784189209.670644:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc07fb34000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1870854458144512:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784189209.670674:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc07fb34000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1870854458144512:12345-0@lo:400:kworker.0 Request processed in 32us (778us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189209.670680:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2476 00000100:00100000:2.0:1784189209.670703:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc07fb35f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1870854458144512:0@lo:400:kworker.0 00000100:00100000:2.0:1784189209.670711:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc07fb37b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3642:1870854458144384:0@lo:400:kworker.0 00000100:00100000:2.0:1784189209.670755:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc07fb36680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1870854458144896:0@lo:400:kworker.0 00000100:00100000:2.0:1784189209.670775:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784189209.670800:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458144896 00000100:00100000:2.0:1784189209.670803:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458144896 00000100:00100000:2.0:1784189209.670824:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2477 00000100:00100000:2.0:1784189209.670829:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc07fb37100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3642:x1870854458144896:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784189209.670855:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc07fb37100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3642:x1870854458144896:12345-0@lo:400:kworker.0 Request processed in 26us (79us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189209.670860:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2477 00000100:00100000:2.0:1784189209.670892:0:3642:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294968953 gen 2 00000100:00100000:2.0:1784189209.670903:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc07fb36680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1870854458144896:0@lo:400:kworker.0 00000100:00100000:2.0:1784189209.670931:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1784189209.670936:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc07fb36680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1870854458145024:0@lo:400:kworker.0 00000100:00100000:2.0:1784189209.670955:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784189209.670975:0:26170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458145024 00000100:00100000:2.0:1784189209.670978:0:26170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458145024 00000100:00100000:1.0:1784189209.672037:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc07fb35f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3641:1870854458144768:0@lo:400:kworker.0 00000100:00100000:1.0:1784189209.672088:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784189209.672114:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1784189209.672121:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc07fb37b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1870854458144640:0@lo:400:kworker.0 00000100:00100000:1.0:1784189209.672143:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784189209.672173:0:66171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458144768 00000100:00100000:1.0:1784189209.672178:0:66171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458144768 00000100:00100000:2.0:1784189209.672195:0:26170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458144640 00000100:00100000:2.0:1784189209.672205:0:26170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458144640 00000100:00100000:1.0:1784189209.672215:0:66171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1210 00000100:00100000:1.0:1784189209.672226:0:66171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf43e11500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1870854458144768:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784189209.672237:0:26170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2478 00000100:00100000:2.0:1784189209.672245:0:26170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc07fb36300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+5:3642:x1870854458145024:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784189209.672274:0:66171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf43e11500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1870854458144768:12345-0@lo:400:kworker.0 Request processed in 50us (184us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189209.672283:0:66171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1210 00000100:00100000:2.0:1784189209.672291:0:26170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc07fb36300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+5:3642:x1870854458145024:12345-0@lo:400:kworker.0 Request processed in 47us (1334us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189209.672298:0:26170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2478 00000100:00100000:1.0:1784189209.672312:0:26171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2479 00000100:00080000:0.0:1784189209.672505:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1784189209.672509:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1784189209.672511:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1784189209.672513:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1784189209.672747:0:26171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf43e10380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0001-mdtlov_UUID+5:3641:x1870854458144640:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784189209.672799:0:26171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf43e10380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0001-mdtlov_UUID+5:3641:x1870854458144640:12345-0@lo:400:kworker.0 Request processed in 479us (654us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189209.673128:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc07fb36680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1870854458145024:0@lo:400:kworker.0 00000100:00100000:0.0:1784189209.673539:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf47545c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3640:1870854458145152:0@lo:400:kworker.0 00000100:00100000:0.0:1784189209.673577:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784189209.673603:0:66945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458145152 00000100:00100000:0.0:1784189209.673609:0:66945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458145152 00000100:00100000:0.0:1784189209.673642:0:66945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1211 00000100:00100000:0.0:1784189209.673649:0:66945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf4a341880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1870854458145152:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784189209.675180:0:26171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2479 00000100:00100000:1.0:1784189209.675252:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc07fb37b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1870854458144640:0@lo:400:kworker.0 00000100:00100000:1.0:1784189209.675268:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc07fb35f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3641:1870854458144768:0@lo:400:kworker.0 00000100:00100000:1.0:1784189209.691008:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf47545c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3640:1870854458145152:0@lo:400:kworker.0 00000100:00100000:0.0:1784189209.691216:0:66945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf4a341880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1870854458145152:12345-0@lo:400:kworker.0 Request processed in 17563us (17633us total) trans 0 rc 0/0 00000100:00100000:0.0:1784189209.691230:0:66945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1211 00000100:00100000:1.0:1784189209.900103:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1784189209.900148:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1784189209.900206:0:66169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436284160 00000100:00100000:0.0:1784189209.900214:0:66169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436284160 00000100:00100000:0.0:1784189209.900283:0:66169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1212 00000100:00100000:0.0:1784189209.900293:0:66169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf43e11880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+8:2398:x1870854436284160:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:0.0:1784189209.900405:0:66169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf43e11880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+8:2398:x1870854436284160:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 112us (255us total) trans 0 rc 0/0 00000100:00100000:0.0:1784189209.900413:0:66169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1212 00000100:00100000:3.0:1784189209.900567:0:90956:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436284032 00000100:00100000:3.0:1784189209.900572:0:90956:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436284032 00000100:00100000:3.0:1784189209.900610:0:90956:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 80 00000100:00100000:3.0:1784189209.900618:0:90956:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc07037f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9957a2dc-fd88-4a91-bca3-e2b7f365ab0c+10:2398:x1870854436284032:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:3.0:1784189209.900662:0:90956:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc07037f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9957a2dc-fd88-4a91-bca3-e2b7f365ab0c+10:2398:x1870854436284032:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 45us (569us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189209.900670:0:90956:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 80 00000100:00080000:1.0:1784189209.900784:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1784189209.901713:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1784189209.901749:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1784189209.901781:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1784189209.901816:0:26167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436284544 00000100:00100000:1.0:1784189209.901822:0:26167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436284544 00000100:00100000:1.0:1784189209.901860:0:26167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436284416 00000100:00100000:1.0:1784189209.901864:0:26167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436284416 00000100:00100000:1.0:1784189209.901898:0:26167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 2480 00000100:00100000:1.0:1784189209.901906:0:26167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf43e13480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+7:2398:x1870854436284544:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:1.0:1784189209.901950:0:26167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf43e13480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+7:2398:x1870854436284544:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 45us (200us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189209.901957:0:26167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 2480 00000100:00100000:1.0:1784189209.901977:0:26167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 2481 00000100:00100000:1.0:1784189209.901984:0:26167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf43e10a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+6:2398:x1870854436284416:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:1.0:1784189209.902007:0:26167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf43e10a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+6:2398:x1870854436284416:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 23us (225us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189209.902013:0:26167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 2481 00000100:00080000:1.0:1784189209.902035:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1784189209.902038:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1784189209.902151:0:66170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436284288 00000100:00100000:0.0:1784189209.902155:0:66170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436284288 00000100:00100000:0.0:1784189209.902205:0:66170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1213 00000100:00100000:0.0:1784189209.902212:0:66170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf43e11c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+6:2398:x1870854436284288:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:0.0:1784189209.902240:0:66170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf43e11c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+6:2398:x1870854436284288:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 29us (531us total) trans 0 rc 0/0 00000100:00100000:0.0:1784189209.902246:0:66170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1213 00000100:00080000:1.0:1784189209.902637:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000001:02000400:3.0:1784189209.992276:0:91580:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: mdc.lustre-MDT0000-mdc-*.mds_server_uuid in FULL state after 0 sec 00000100:00100000:0.0:1784189210.160638:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1784189210.160662:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf4a341c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1870854458145280:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1784189210.160723:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784189210.160765:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458145280 00000100:00100000:0.0:1784189210.160772:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458145280 00000100:00100000:0.0:1784189210.160817:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1984 00000100:00100000:0.0:1784189210.160826:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf4a343480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1870854458145280:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1784189210.160862:0:8432:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8648768 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1784189210.160911:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf4a343480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1870854458145280:12345-0@lo:13:osp-pre-1-0.0 Request processed in 86us (188us total) trans 0 rc 0/0 00000100:00100000:0.0:1784189210.160919:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1984 00000100:00100000:0.0:1784189210.160964:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf4a341c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1870854458145280:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1784189210.163345:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1784189210.163363:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf47547480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1870854458145408:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1784189210.163422:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784189210.163466:0:9466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458145408 00000100:00100000:3.0:1784189210.163472:0:9466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458145408 00000100:00100000:3.0:1784189210.163514:0:9466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1985 00000100:00100000:3.0:1784189210.163522:0:9466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf47545180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1870854458145408:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1784189210.163549:0:9466:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 16013376 pending 0 free 3922481152 avail 3690958848 00000100:00100000:3.0:1784189210.163589:0:9466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf47545180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1870854458145408:12345-0@lo:13:osp-pre-0-0.0 Request processed in 67us (166us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189210.163596:0:9466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1985 00000100:00100000:3.0:1784189210.163636:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf47547480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1870854458145408:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1784189210.353299:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784189211.375615:0:7454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784189211.937853:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1784189211.937965:0:66945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436284672 00000100:00100000:1.0:1784189211.937975:0:66945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436284672 00000100:00100000:1.0:1784189211.938049:0:66945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1282 00000100:00100000:1.0:1784189211.938060:0:66945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf47547480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+8:70297:x1870854436284672:12345-192.168.203.12@tcp:41:lfs.0 00000004:00000024:1.0:1784189211.938096:0:66945:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445281792 avail 1299042304 00000100:00100000:1.0:1784189211.938157:0:66945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf47547480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+8:70297:x1870854436284672:12345-192.168.203.12@tcp:41:lfs.0 Request processed in 99us (313us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189211.938165:0:66945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1282 00000100:00080000:2.0:1784189211.938346:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1784189211.939842:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1784189211.939931:0:66171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436284800 00000100:00100000:1.0:1784189211.939951:0:66171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436284800 00000100:00100000:1.0:1784189211.940058:0:66171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1283 00000100:00100000:1.0:1784189211.940067:0:66171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf4a341c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+6:70297:x1870854436284800:12345-192.168.203.12@tcp:41:lfs.0 00000004:00000024:1.0:1784189211.940096:0:66171:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445576704 avail 1299337216 00000100:00100000:1.0:1784189211.940152:0:66171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf4a341c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+6:70297:x1870854436284800:12345-192.168.203.12@tcp:41:lfs.0 Request processed in 86us (315us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189211.940160:0:66171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1283 00000100:00080000:2.0:1784189211.940740:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1784189211.946238:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1784189211.946350:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436284928 00000100:00100000:0.0:1784189211.946360:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436284928 00000100:00100000:0.0:1784189211.946438:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1986 00000100:00100000:0.0:1784189211.946448:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc07b5b2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+6:70297:x1870854436284928:12345-192.168.203.12@tcp:13:lfs.0 00002000:00000024:0.0:1784189211.946478:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 16013376 pending 0 free 3922481152 avail 3690958848 00000100:00100000:0.0:1784189211.946555:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc07b5b2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+6:70297:x1870854436284928:12345-192.168.203.12@tcp:13:lfs.0 Request processed in 108us (325us total) trans 0 rc 0/0 00000100:00100000:0.0:1784189211.946562:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1986 00000100:00080000:2.0:1784189211.947263:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1784189211.950691:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1784189211.950854:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436285056 00000100:00100000:0.0:1784189211.950872:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436285056 00000100:00100000:0.0:1784189211.950944:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1987 00000100:00100000:0.0:1784189211.950954:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf47546d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+7:70297:x1870854436285056:12345-192.168.203.12@tcp:13:lfs.0 00002000:00000024:0.0:1784189211.950993:0:8432:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8648768 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1784189211.951058:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf47546d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+7:70297:x1870854436285056:12345-192.168.203.12@tcp:13:lfs.0 Request processed in 104us (374us total) trans 0 rc 0/0 00000100:00100000:0.0:1784189211.951066:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1987 00000100:00080000:2.0:1784189211.951391:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1784189211.990960:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1784189211.991059:0:68287:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436285312 00000100:00100000:0.0:1784189211.991069:0:68287:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436285312 00000100:00100000:0.0:1784189211.991127:0:68287:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1284 00000100:00100000:0.0:1784189211.991136:0:68287:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc070221880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+8:70313:x1870854436285312:12345-192.168.203.12@tcp:101:lfs.0 00010000:00010000:0.0:1784189211.991156:0:68287:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784189211.991175:0:68287:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04152d400/0xcc1762b626f8ba9f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbfc5de7fe6c3e8e expref: -99 pid: 68287 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189211.991243:0:68287:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04152d600/0xcc1762b626f8baa6 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189211.991258:0:68287:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04152d600/0xcc1762b626f8baa6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189211.991283:0:68287:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04152d600/0xcc1762b626f8baa6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189211.991297:0:68287:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04152c400/0xcc1762b626f8baad lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189211.991304:0:68287:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04152c400/0xcc1762b626f8baad lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189211.991310:0:68287:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04152c400/0xcc1762b626f8baad lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189211.991413:0:68287:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04152d600/0xcc1762b626f8baa6 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189211.991420:0:68287:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04152d600/0xcc1762b626f8baa6 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189211.991426:0:68287:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04152d600/0xcc1762b626f8baa6 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189211.991433:0:68287:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04152d600/0xcc1762b626f8baa6 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189211.991438:0:68287:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc04152d600 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:0.0:1784189211.991442:0:68287:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04152d600/0xcc1762b626f8baa6 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189211.991449:0:68287:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04152d600/0xcc1762b626f8baa6 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189211.991460:0:68287:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9dc056eaaf00) 00010000:00010000:0.0:1784189211.991480:0:68287:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784189211.991485:0:68287:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04152d600/0xcc1762b626f8baa6 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189211.991492:0:68287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04152d600/0xcc1762b626f8baa6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189211.991508:0:68287:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04152c400/0xcc1762b626f8baad lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189211.991514:0:68287:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04152c400/0xcc1762b626f8baad lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189211.991520:0:68287:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04152c400/0xcc1762b626f8baad lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189211.991525:0:68287:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc04152c400 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:0.0:1784189211.991528:0:68287:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04152c400/0xcc1762b626f8baad lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189211.991534:0:68287:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04152c400/0xcc1762b626f8baad lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189211.991542:0:68287:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xae972c0d (ffff9dc047db8500) 00010000:00010000:0.0:1784189211.991545:0:68287:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784189211.991548:0:68287:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04152c400/0xcc1762b626f8baad lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189211.991553:0:68287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04152c400/0xcc1762b626f8baad lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189211.991602:0:68287:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04152d400/0xcc1762b626f8ba9f lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c3e8e expref: 9 pid: 68287 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189211.991620:0:68287:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9dc056eaaf00) 00010000:00010000:0.0:1784189211.991622:0:68287:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1784189211.991626:0:68287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04152d400/0xcc1762b626f8ba9f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c3e8e expref: 9 pid: 68287 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189211.991635:0:68287:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc04152d400, rc 0) 00000100:00100000:0.0:1784189211.991696:0:68287:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc070221880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+8:70313:x1870854436285312:12345-192.168.203.12@tcp:101:lfs.0 Request processed in 560us (744us total) trans 0 rc 301/301 00000100:00100000:0.0:1784189211.991703:0:68287:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1284 00000100:00100000:1.0:1784189212.001351:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1784189212.002012:0:66169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436285440 00000100:00100000:3.0:1784189212.002027:0:66169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436285440 00000100:00100000:3.0:1784189212.002117:0:66169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1285 00000100:00100000:3.0:1784189212.002129:0:66169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc070221c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+8:70313:x1870854436285440:12345-192.168.203.12@tcp:34:lfs.0 00010000:00010000:3.0:1784189212.002221:0:66169:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0755a4c00/0xcc1762b626f8bab4 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189212.002241:0:66169:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0755a4c00/0xcc1762b626f8bab4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189212.002271:0:66169:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0755a4c00/0xcc1762b626f8bab4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189212.002288:0:66169:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0755a4400/0xcc1762b626f8babb lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189212.002295:0:66169:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0755a4400/0xcc1762b626f8babb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189212.002302:0:66169:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0755a4400/0xcc1762b626f8babb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189212.002432:0:66169:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0755a4600/0xcc1762b626f8bac2 lrc: 3/1,0 mode: --/PR res: [0x20000a811:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189212.002440:0:66169:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0755a4600/0xcc1762b626f8bac2 lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189212.002446:0:66169:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0755a4600/0xcc1762b626f8bac2 lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784189212.002497:0:66169:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000a811:0x9:0x0]: returning size 1048576 00000004:00200000:3.0:1784189212.002501:0:66169:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1784189212.002519:0:66169:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0755a4600/0xcc1762b626f8bac2 lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189212.002536:0:66169:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0755a4c00/0xcc1762b626f8bab4 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189212.002544:0:66169:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0755a4c00/0xcc1762b626f8bab4 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189212.002562:0:66169:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0755a4c00/0xcc1762b626f8bab4 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189212.002571:0:66169:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0755a4c00/0xcc1762b626f8bab4 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189212.002577:0:66169:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc0755a4c00 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:3.0:1784189212.002582:0:66169:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0755a4c00/0xcc1762b626f8bab4 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189212.002590:0:66169:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0755a4c00/0xcc1762b626f8bab4 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189212.002604:0:66169:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9dc056eaaf00) 00010000:00010000:3.0:1784189212.002607:0:66169:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784189212.002613:0:66169:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0755a4c00/0xcc1762b626f8bab4 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189212.002619:0:66169:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0755a4c00/0xcc1762b626f8bab4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189212.002638:0:66169:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0755a4400/0xcc1762b626f8babb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189212.002644:0:66169:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0755a4400/0xcc1762b626f8babb lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189212.002649:0:66169:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0755a4400/0xcc1762b626f8babb lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189212.002656:0:66169:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc0755a4400 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:3.0:1784189212.002666:0:66169:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0755a4400/0xcc1762b626f8babb lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189212.002672:0:66169:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0755a4400/0xcc1762b626f8babb lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189212.002679:0:66169:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xae972c0d (ffff9dc07fab4300) 00010000:00010000:3.0:1784189212.002682:0:66169:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784189212.002685:0:66169:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0755a4400/0xcc1762b626f8babb lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189212.002691:0:66169:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0755a4400/0xcc1762b626f8babb lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189212.002707:0:66169:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0755a4600/0xcc1762b626f8bac2 lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189212.002712:0:66169:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0755a4600/0xcc1762b626f8bac2 lrc: 2/0,0 mode: PR/PR res: [0x20000a811:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189212.002718:0:66169:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0755a4600/0xcc1762b626f8bac2 lrc: 3/0,0 mode: PR/PR res: [0x20000a811:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189212.002723:0:66169:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc0755a4600 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:3.0:1784189212.002726:0:66169:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0755a4600/0xcc1762b626f8bac2 lrc: 3/0,0 mode: PR/PR res: [0x20000a811:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189212.002732:0:66169:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0755a4600/0xcc1762b626f8bac2 lrc: 4/0,0 mode: PR/PR res: [0x20000a811:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189212.002739:0:66169:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x9:0x0].0x0 (ffff9dbf45994c00) 00010000:00010000:3.0:1784189212.002740:0:66169:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784189212.002750:0:66169:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0755a4600/0xcc1762b626f8bac2 lrc: 2/0,0 mode: --/PR res: [0x20000a811:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189212.002756:0:66169:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0755a4600/0xcc1762b626f8bac2 lrc: 0/0,0 mode: --/PR res: [0x20000a811:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784189212.003252:0:66169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc070221c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+8:70313:x1870854436285440:12345-192.168.203.12@tcp:34:lfs.0 Request processed in 1122us (1914us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189212.003262:0:66169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1285 00000100:00100000:3.0:1784189212.034617:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1784189212.035085:0:66170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436285696 00000100:00100000:0.0:1784189212.035099:0:66170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436285696 00000100:00100000:0.0:1784189212.035191:0:66170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1286 00000100:00100000:0.0:1784189212.035204:0:66170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf47546a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+8:70316:x1870854436285696:12345-192.168.203.12@tcp:101:lfs.0 00010000:00010000:0.0:1784189212.035233:0:66170:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784189212.035260:0:66170:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04152d400/0xcc1762b626f8bac9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbfc5de7fe6c3e95 expref: -99 pid: 66170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189212.035410:0:66170:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04152c400/0xcc1762b626f8bad0 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189212.035439:0:66170:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04152c400/0xcc1762b626f8bad0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189212.035453:0:66170:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04152c400/0xcc1762b626f8bad0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189212.035471:0:66170:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04152d600/0xcc1762b626f8bad7 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189212.035497:0:66170:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04152d600/0xcc1762b626f8bad7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189212.035505:0:66170:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04152d600/0xcc1762b626f8bad7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189212.035610:0:66170:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04152c400/0xcc1762b626f8bad0 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189212.035619:0:66170:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04152c400/0xcc1762b626f8bad0 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189212.035638:0:66170:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04152c400/0xcc1762b626f8bad0 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189212.035646:0:66170:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04152c400/0xcc1762b626f8bad0 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189212.035653:0:66170:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc04152c400 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:0.0:1784189212.035657:0:66170:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04152c400/0xcc1762b626f8bad0 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189212.035667:0:66170:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04152c400/0xcc1762b626f8bad0 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189212.035683:0:66170:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9dc056eaaf00) 00010000:00010000:0.0:1784189212.035687:0:66170:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784189212.035693:0:66170:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04152c400/0xcc1762b626f8bad0 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189212.035701:0:66170:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04152c400/0xcc1762b626f8bad0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189212.036219:0:66170:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04152d600/0xcc1762b626f8bad7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189212.036229:0:66170:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04152d600/0xcc1762b626f8bad7 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189212.036236:0:66170:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04152d600/0xcc1762b626f8bad7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189212.036242:0:66170:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc04152d600 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:0.0:1784189212.036246:0:66170:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04152d600/0xcc1762b626f8bad7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189212.036254:0:66170:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04152d600/0xcc1762b626f8bad7 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189212.036266:0:66170:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xae972c0d (ffff9dc047db8500) 00010000:00010000:0.0:1784189212.036268:0:66170:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784189212.036272:0:66170:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04152d600/0xcc1762b626f8bad7 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189212.036278:0:66170:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04152d600/0xcc1762b626f8bad7 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189212.036402:0:66170:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04152d400/0xcc1762b626f8bac9 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c3e95 expref: 9 pid: 66170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189212.036415:0:66170:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9dc056eaaf00) 00010000:00010000:0.0:1784189212.036418:0:66170:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1784189212.036433:0:66170:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04152d400/0xcc1762b626f8bac9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c3e95 expref: 9 pid: 66170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189212.036445:0:66170:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc04152d400, rc 0) 00000100:00100000:0.0:1784189212.036559:0:66170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf47546a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+8:70316:x1870854436285696:12345-192.168.203.12@tcp:101:lfs.0 Request processed in 1357us (1956us total) trans 0 rc 301/301 00000100:00100000:0.0:1784189212.036570:0:66170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1286 00000100:00100000:1.0:1784189212.047285:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1784189212.047431:0:66945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436285824 00000100:00100000:0.0:1784189212.047444:0:66945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436285824 00000100:00100000:0.0:1784189212.047520:0:66945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1287 00000100:00100000:0.0:1784189212.047532:0:66945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc070223480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+8:70316:x1870854436285824:12345-192.168.203.12@tcp:34:lfs.0 00010000:00010000:0.0:1784189212.047639:0:66945:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04152d400/0xcc1762b626f8bade lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189212.047660:0:66945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04152d400/0xcc1762b626f8bade lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189212.047675:0:66945:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04152d400/0xcc1762b626f8bade lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189212.047693:0:66945:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04152d600/0xcc1762b626f8bae5 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189212.047700:0:66945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04152d600/0xcc1762b626f8bae5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189212.047707:0:66945:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04152d600/0xcc1762b626f8bae5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189212.047829:0:66945:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04152c400/0xcc1762b626f8baec lrc: 3/1,0 mode: --/PR res: [0x20000a811:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189212.047856:0:66945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04152c400/0xcc1762b626f8baec lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189212.047877:0:66945:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04152c400/0xcc1762b626f8baec lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784189212.047935:0:66945:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000a811:0x9:0x0]: returning size 1048576 00000004:00200000:0.0:1784189212.047940:0:66945:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1784189212.047955:0:66945:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04152c400/0xcc1762b626f8baec lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189212.047973:0:66945:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04152d400/0xcc1762b626f8bade lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189212.047981:0:66945:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04152d400/0xcc1762b626f8bade lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189212.047988:0:66945:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04152d400/0xcc1762b626f8bade lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189212.047995:0:66945:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04152d400/0xcc1762b626f8bade lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189212.048001:0:66945:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc04152d400 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:0.0:1784189212.048006:0:66945:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04152d400/0xcc1762b626f8bade lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189212.048014:0:66945:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04152d400/0xcc1762b626f8bade lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189212.048028:0:66945:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9dc056eaaf00) 00010000:00010000:0.0:1784189212.048038:0:66945:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784189212.048045:0:66945:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04152d400/0xcc1762b626f8bade lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189212.048052:0:66945:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04152d400/0xcc1762b626f8bade lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189212.048069:0:66945:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04152d600/0xcc1762b626f8bae5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189212.048075:0:66945:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04152d600/0xcc1762b626f8bae5 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189212.048080:0:66945:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04152d600/0xcc1762b626f8bae5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189212.048086:0:66945:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc04152d600 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:0.0:1784189212.048089:0:66945:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04152d600/0xcc1762b626f8bae5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189212.048094:0:66945:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04152d600/0xcc1762b626f8bae5 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189212.048101:0:66945:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xae972c0d (ffff9dc047db8500) 00010000:00010000:0.0:1784189212.048104:0:66945:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784189212.048107:0:66945:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04152d600/0xcc1762b626f8bae5 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189212.048113:0:66945:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04152d600/0xcc1762b626f8bae5 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189212.048128:0:66945:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04152c400/0xcc1762b626f8baec lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189212.048140:0:66945:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04152c400/0xcc1762b626f8baec lrc: 2/0,0 mode: PR/PR res: [0x20000a811:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189212.048146:0:66945:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04152c400/0xcc1762b626f8baec lrc: 3/0,0 mode: PR/PR res: [0x20000a811:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189212.048151:0:66945:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc04152c400 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:0.0:1784189212.048155:0:66945:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04152c400/0xcc1762b626f8baec lrc: 3/0,0 mode: PR/PR res: [0x20000a811:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189212.048161:0:66945:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04152c400/0xcc1762b626f8baec lrc: 4/0,0 mode: PR/PR res: [0x20000a811:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189212.048170:0:66945:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x9:0x0].0x0 (ffff9dbf45994c00) 00010000:00010000:0.0:1784189212.048172:0:66945:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784189212.048176:0:66945:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04152c400/0xcc1762b626f8baec lrc: 2/0,0 mode: --/PR res: [0x20000a811:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189212.048181:0:66945:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04152c400/0xcc1762b626f8baec lrc: 0/0,0 mode: --/PR res: [0x20000a811:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784189212.048283:0:66945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc070223480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+8:70316:x1870854436285824:12345-192.168.203.12@tcp:34:lfs.0 Request processed in 751us (1010us total) trans 0 rc 0/0 00000100:00100000:0.0:1784189212.048292:0:66945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1287 00000100:00100000:3.0:1784189212.072136:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1784189212.072372:0:66169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436286080 00000100:00100000:0.0:1784189212.072385:0:66169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436286080 00000100:00100000:0.0:1784189212.072472:0:66169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1288 00000100:00100000:0.0:1784189212.072484:0:66169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf47544a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+8:70321:x1870854436286080:12345-192.168.203.12@tcp:101:md5sum.0 00010000:00010000:0.0:1784189212.072747:0:66169:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784189212.072793:0:66169:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04152c400/0xcc1762b626f8baf3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbfc5de7fe6c3e9c expref: -99 pid: 66169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189212.072906:0:66169:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04152d600/0xcc1762b626f8bafa lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189212.072923:0:66169:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04152d600/0xcc1762b626f8bafa lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189212.072935:0:66169:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04152d600/0xcc1762b626f8bafa lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189212.072959:0:66169:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04152d400/0xcc1762b626f8bb01 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189212.072966:0:66169:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04152d400/0xcc1762b626f8bb01 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189212.072972:0:66169:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04152d400/0xcc1762b626f8bb01 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189212.073099:0:66169:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04152d200/0xcc1762b626f8bb08 lrc: 3/1,0 mode: --/PR res: [0x20000a811:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189212.073107:0:66169:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04152d200/0xcc1762b626f8bb08 lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189212.073114:0:66169:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04152d200/0xcc1762b626f8bb08 lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784189212.073124:0:66169:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000a811:0x9:0x0]: returning size 1048576 00010000:00010000:0.0:1784189212.073363:0:66169:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04152d600/0xcc1762b626f8bafa lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189212.073383:0:66169:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04152d600/0xcc1762b626f8bafa lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189212.073389:0:66169:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04152d600/0xcc1762b626f8bafa lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189212.073396:0:66169:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04152d600/0xcc1762b626f8bafa lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189212.073402:0:66169:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc04152d600 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:0.0:1784189212.073407:0:66169:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04152d600/0xcc1762b626f8bafa lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189212.073414:0:66169:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04152d600/0xcc1762b626f8bafa lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189212.073426:0:66169:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9dc056eaaf00) 00010000:00010000:0.0:1784189212.073429:0:66169:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784189212.073433:0:66169:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04152d600/0xcc1762b626f8bafa lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189212.073440:0:66169:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04152d600/0xcc1762b626f8bafa lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189212.073458:0:66169:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04152d400/0xcc1762b626f8bb01 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189212.073464:0:66169:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04152d400/0xcc1762b626f8bb01 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189212.073470:0:66169:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04152d400/0xcc1762b626f8bb01 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189212.073569:0:66169:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc04152d400 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:0.0:1784189212.073573:0:66169:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04152d400/0xcc1762b626f8bb01 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189212.073579:0:66169:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04152d400/0xcc1762b626f8bb01 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189212.073588:0:66169:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xae972c0d (ffff9dc047db8500) 00010000:00010000:0.0:1784189212.073590:0:66169:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784189212.073592:0:66169:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04152d400/0xcc1762b626f8bb01 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189212.073599:0:66169:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04152d400/0xcc1762b626f8bb01 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189212.073785:0:66169:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04152c400/0xcc1762b626f8baf3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c3e9c expref: 11 pid: 66169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189212.073803:0:66169:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04152d200/0xcc1762b626f8bb08 lrc: 3/0,0 mode: PR/PR res: [0x20000a811:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c3e9c expref: 10 pid: 66169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189212.073812:0:66169:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x9:0x0].0x0 (ffff9dbf45994c00) 00010000:00010000:0.0:1784189212.073815:0:66169:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1784189212.073818:0:66169:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc04152d200, rc 0) 00000100:00100000:0.0:1784189212.073956:0:66169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf47544a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+10:70321:x1870854436286080:12345-192.168.203.12@tcp:101:md5sum.0 Request processed in 1474us (1833us total) trans 111669149697 rc 0/0 00000100:00100000:0.0:1784189212.073965:0:66169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1288 00000100:00100000:3.0:1784189212.083747:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1784189212.086952:0:24833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436286208 00000100:00100000:2.0:1784189212.086968:0:24833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436286208 00002000:00100000:2.0:1784189212.087467:0:24833:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x702:0x0] (0->32767) req@ffff9dbf47544700 x1870854436286208/t0(0) o3->b90fcc1c-0e69-42a4-a116-a71fec7aeb78@192.168.203.12@tcp:403/0 lens 488/0 e 0 to 0 dl 1784189223 ref 1 fl New:/600/ffffffff rc 0/-1 job:'md5sum.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1784189212.087479:0:24833:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9dbf47544700 with x1870854436286208 ext(0->32767) 00002000:00010000:2.0:1784189212.087485:0:24833:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9dbf47544700 00000100:00100000:2.0:1784189212.087585:0:24833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1005 00000100:00100000:2.0:1784189212.087596:0:24833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf47544700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+7:2398:x1870854436286208:12345-192.168.203.12@tcp:3:md5sum.0 00000100:00100000:2.0:1784189212.097818:0:24833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf47544700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+7:2398:x1870854436286208:12345-192.168.203.12@tcp:3:md5sum.0 Request processed in 10213us (14068us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189212.097832:0:24833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1005 00002000:00100000:2.0:1784189212.097844:0:24833:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x702:0x0] (0->32767) req@ffff9dbf47544700 x1870854436286208/t0(0) o3->b90fcc1c-0e69-42a4-a116-a71fec7aeb78@192.168.203.12@tcp:403/0 lens 488/440 e 0 to 0 dl 1784189223 ref 1 fl Complete:/600/0 rc 0/0 job:'md5sum.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1784189212.097884:0:24833:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9dbf47544700 with x1870854436286208 ext(0->32767) 00002000:00010000:2.0:1784189212.097890:0:24833:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9dbf47544700 00000100:00100000:1.0:1784189212.119633:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1784189212.119691:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1784189212.119767:0:25599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436286336 00000100:00100000:0.0:1784189212.119786:0:25599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436286336 00002000:00100000:0.0:1784189212.119835:0:25599:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x702:0x0] (32768->1048575) req@ffff9dc070221180 x1870854436286336/t0(0) o3->b90fcc1c-0e69-42a4-a116-a71fec7aeb78@192.168.203.12@tcp:403/0 lens 488/0 e 0 to 0 dl 1784189223 ref 1 fl New:/600/ffffffff rc 0/-1 job:'md5sum.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1784189212.119845:0:25599:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9dc070221180 with x1870854436286336 ext(32768->1048575) 00002000:00010000:0.0:1784189212.119851:0:25599:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9dc070221180 00000100:00100000:0.0:1784189212.119888:0:25599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436286464 00000100:00100000:0.0:1784189212.119892:0:25599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436286464 00002000:00100000:0.0:1784189212.119910:0:25599:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x702:0x0] (1048576->2097151) req@ffff9dc070222d80 x1870854436286464/t0(0) o3->b90fcc1c-0e69-42a4-a116-a71fec7aeb78@192.168.203.12@tcp:403/0 lens 488/0 e 0 to 0 dl 1784189223 ref 1 fl New:/600/ffffffff rc 0/-1 job:'md5sum.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1784189212.119918:0:25599:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9dc070222d80 with x1870854436286464 ext(1048576->2097151) 00002000:00010000:0.0:1784189212.119921:0:25599:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9dc070222d80 00000100:00100000:0.0:1784189212.119944:0:25599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1006 00000100:00100000:0.0:1784189212.119952:0:25599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc070221180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+7:2397:x1870854436286336:12345-192.168.203.12@tcp:3:md5sum.0 00000100:00100000:2.0:1784189212.120239:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1007 00000100:00100000:2.0:1784189212.120249:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc070222d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+6:2396:x1870854436286464:12345-192.168.203.12@tcp:3:md5sum.0 00000100:00100000:1.0:1784189212.142127:0:25599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc070221180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+7:2397:x1870854436286336:12345-192.168.203.12@tcp:3:md5sum.0 Request processed in 22165us (22493us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189212.142141:0:25599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1006 00002000:00100000:1.0:1784189212.142154:0:25599:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x702:0x0] (32768->1048575) req@ffff9dc070221180 x1870854436286336/t0(0) o3->b90fcc1c-0e69-42a4-a116-a71fec7aeb78@192.168.203.12@tcp:403/0 lens 488/440 e 0 to 0 dl 1784189223 ref 1 fl Complete:/600/0 rc 0/0 job:'md5sum.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1784189212.142166:0:25599:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9dc070221180 with x1870854436286336 ext(32768->1048575) 00002000:00010000:1.0:1784189212.142172:0:25599:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9dc070221180 00000100:00100000:2.0:1784189212.162414:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc070222d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+6:2396:x1870854436286464:12345-192.168.203.12@tcp:3:md5sum.0 Request processed in 42155us (42711us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1784189212.162427:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1007 00002000:00100000:2.0:1784189212.162439:0:8434:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x702:0x0] (1048576->2097151) req@ffff9dc070222d80 x1870854436286464/t0(0) o3->b90fcc1c-0e69-42a4-a116-a71fec7aeb78@192.168.203.12@tcp:403/0 lens 488/440 e 0 to 0 dl 1784189223 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'md5sum.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1784189212.162450:0:8434:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9dc070222d80 with x1870854436286464 ext(1048576->2097151) 00002000:00010000:2.0:1784189212.162456:0:8434:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9dc070222d80 00000100:00100000:0.0:1784189212.182172:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1784189212.182305:0:66172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436286720 00000100:00100000:2.0:1784189212.182315:0:66172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436286720 00000100:00100000:2.0:1784189212.182404:0:66172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 229 00000100:00100000:2.0:1784189212.182414:0:66172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf4a341180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+10:70321:x1870854436286720:12345-192.168.203.12@tcp:35:md5sum.0 00000100:00100000:2.0:1784189212.182825:0:66172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf4a341180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+11:70321:x1870854436286720:12345-192.168.203.12@tcp:35:md5sum.0 Request processed in 412us (659us total) trans 111669149698 rc 0/0 00000100:00100000:2.0:1784189212.182834:0:66172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 229 00010000:00010000:1.0:1784189212.405904:0:26173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784189212.720049:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc07fb36680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1870854458145536:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1784189212.720124:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784189212.720193:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf47546300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1870854458145664:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1784189212.720218:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784189212.720251:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458145536 00000100:00100000:0.0:1784189212.720259:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458145536 00000100:00100000:0.0:1784189212.720303:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458145664 00000100:00100000:0.0:1784189212.720306:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458145664 00000100:00100000:0.0:1784189212.720357:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1988 00000100:00100000:0.0:1784189212.720367:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf464ad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1870854458145536:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1784189212.720388:0:8432:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8648768 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1784189212.720430:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf464ad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1870854458145536:12345-0@lo:13:osp-pre-1-1.0 Request processed in 65us (306us total) trans 0 rc 0/0 00000100:00100000:0.0:1784189212.720450:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1988 00000100:00100000:0.0:1784189212.720467:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1989 00000100:00100000:0.0:1784189212.720473:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf464adf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1870854458145664:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1784189212.720483:0:8432:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 16013376 pending 0 free 3922481152 avail 3690958848 00000100:00100000:0.0:1784189212.720517:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf464adf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1870854458145664:12345-0@lo:13:osp-pre-0-1.0 Request processed in 43us (296us total) trans 0 rc 0/0 00000100:00100000:0.0:1784189212.720522:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1989 00000100:00100000:0.0:1784189212.720561:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf47546300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1870854458145664:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1784189212.720591:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc07fb36680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1870854458145536:0@lo:13:osp-pre-1-1.0 00000100:00080000:2.0:1784189212.720847:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1784189212.720930:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1784189213.427136:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784189214.447570:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784189214.768670:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1784189214.768690:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1784189214.768691:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf47547800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1870854458145792:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1784189214.768706:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc080df2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1870854458145920:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1784189214.768888:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc070220700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3641:1870854458146304:0@lo:400:kworker.0 00000100:00100000:2.0:1784189214.773035:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc070222300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3642:1870854458146432:0@lo:400:kworker.0 00000100:00100000:3.0:1784189214.773101:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784189214.773377:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784189214.775249:0:23826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458145792 00000100:00100000:3.0:1784189214.775262:0:23826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458145792 00000100:00100000:3.0:1784189214.775339:0:23826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458145920 00000100:00100000:3.0:1784189214.775343:0:23826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458145920 00000100:00100000:2.0:1784189214.775361:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784189214.775381:0:23826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3817 00000100:00100000:3.0:1784189214.775392:0:23826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf47547100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3640:x1870854458145792:12345-0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1784189214.775415:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc070223b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1870854458146944:0@lo:400:kworker.0 00000004:00000024:3.0:1784189214.775432:0:23826:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445281792 avail 1299042304 00000100:00100000:2.0:1784189214.775466:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784189214.775480:0:23826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf47547100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3640:x1870854458145792:12345-0@lo:41:osp-pre-0-1.0 Request processed in 89us (2377us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189214.775487:0:23826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3817 00000100:00100000:2.0:1784189214.775493:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc070221500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1870854458147456:0@lo:400:kworker.0 00000100:00100000:3.0:1784189214.775505:0:23826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3818 00000100:00100000:3.0:1784189214.775513:0:23826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf43c5d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3643:x1870854458145920:12345-0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1784189214.775521:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784189214.775545:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [3->2] 00000100:00100000:2.0:1784189214.775553:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc070222a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bd553d0d-03e2-4233-b06b-b55bbfa2b954:3642:1870854458146048:0@lo:400:kworker.0 00000100:00100000:2.0:1784189214.775578:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784189214.775603:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc070223800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3642:1870854458146560:0@lo:400:kworker.0 00000100:00100000:2.0:1784189214.775625:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784189214.775642:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc070220e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3642:1870854458147072:0@lo:400:kworker.0 00000004:00000024:3.0:1784189214.775655:0:23826:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445576704 avail 1299337216 00000100:00100000:2.0:1784189214.775667:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784189214.775689:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc070220380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3642:1870854458147584:0@lo:400:kworker.0 00000100:00100000:3.0:1784189214.775704:0:23826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf43c5d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3643:x1870854458145920:12345-0@lo:41:osp-pre-1-0.0 Request processed in 192us (2327us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189214.775712:0:23826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3818 00000100:00100000:2.0:1784189214.775718:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784189214.775751:0:68287:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458146432 00000100:00100000:2.0:1784189214.775755:0:68287:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458146432 00000100:00100000:2.0:1784189214.775805:0:68287:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458146560 00000100:00100000:2.0:1784189214.775808:0:68287:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458146560 00000100:00100000:2.0:1784189214.775820:0:68287:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458147072 00000100:00100000:2.0:1784189214.775822:0:68287:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458147072 00000100:00100000:2.0:1784189214.775833:0:68287:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458147584 00000100:00080000:3.0:1784189214.775906:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1784189214.775910:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1784189214.775977:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784189214.775997:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc070222680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1870854458146816:0@lo:400:kworker.0 00000100:00100000:1.0:1784189214.776023:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784189214.776083:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc070220000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1870854458147328:0@lo:400:kworker.0 00000100:00100000:1.0:1784189214.776106:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784189214.776175:0:26160:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458146944 00000100:00100000:3.0:1784189214.776180:0:26160:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458146944 00000100:00100000:3.0:1784189214.776221:0:26160:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458147456 00000100:00100000:3.0:1784189214.776225:0:26160:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458147456 00000100:00100000:3.0:1784189214.776243:0:26160:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458146816 00000100:00100000:3.0:1784189214.776245:0:26160:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458146816 00000100:00100000:3.0:1784189214.776263:0:26160:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458147328 00000100:00100000:3.0:1784189214.776266:0:26160:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458147328 00000100:00100000:3.0:1784189214.776286:0:26160:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2482 00000100:00100000:3.0:1784189214.776293:0:26160:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc07fb36680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:3642:x1870854458146944:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784189214.776369:0:26160:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc07fb36680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:3642:x1870854458146944:12345-0@lo:400:kworker.0 Request processed in 77us (903us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189214.776376:0:26160:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2482 00000100:00100000:3.0:1784189214.776390:0:26160:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2483 00000100:00100000:3.0:1784189214.776396:0:26160:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc07fb35f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+5:3642:x1870854458147456:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784189214.776422:0:26160:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc07fb35f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+5:3642:x1870854458147456:12345-0@lo:400:kworker.0 Request processed in 26us (901us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189214.776427:0:26160:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2483 00000100:00100000:3.0:1784189214.776437:0:26160:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2484 00000100:00100000:3.0:1784189214.776443:0:26160:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf4a32d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:3641:x1870854458146816:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784189214.776469:0:26160:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf4a32d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:3641:x1870854458146816:12345-0@lo:400:kworker.0 Request processed in 26us (444us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189214.776474:0:26160:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2484 00000100:00100000:3.0:1784189214.776496:0:26160:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2485 00000100:00100000:3.0:1784189214.776503:0:26160:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf4a32dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+5:3641:x1870854458147328:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784189214.776523:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc080df2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1870854458145920:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1784189214.776658:0:26160:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf4a32dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+5:3641:x1870854458147328:12345-0@lo:400:kworker.0 Request processed in 156us (551us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189214.776665:0:26160:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2485 00000100:00080000:3.0:1784189214.776687:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1784189214.776690:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1784189214.776820:0:68287:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458147584 00000100:00100000:0.0:1784189214.776830:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc070220000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1870854458147328:0@lo:400:kworker.0 00000100:00100000:0.0:1784189214.776863:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc070222680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1870854458146816:0@lo:400:kworker.0 00000100:00100000:0.0:1784189214.776874:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:0.0:1784189214.776881:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc070220a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3641:1870854458146176:0@lo:400:kworker.0 00000100:00100000:0.0:1784189214.776911:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784189214.776926:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc070223100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1870854458146688:0@lo:400:kworker.0 00000100:00100000:2.0:1784189214.776931:0:68287:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458146304 00000100:00100000:2.0:1784189214.776935:0:68287:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458146304 00000100:00100000:0.0:1784189214.776952:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784189214.776962:0:68287:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1214 00000100:00100000:2.0:1784189214.776971:0:68287:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc07fb37800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3642:x1870854458146432:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784189214.776978:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc070221f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1870854458147200:0@lo:400:kworker.0 00000100:00100000:0.0:1784189214.777010:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784189214.777016:0:68287:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc07fb37800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3642:x1870854458146432:12345-0@lo:400:kworker.0 Request processed in 46us (1657us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189214.777034:0:68287:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1214 00000100:00100000:2.0:1784189214.777051:0:68287:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458146176 00000100:00100000:2.0:1784189214.777055:0:68287:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458146176 00000100:00100000:1.0:1784189214.777072:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458146688 00000100:00100000:1.0:1784189214.777078:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458146688 00000100:00100000:2.0:1784189214.777081:0:68287:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1215 00000100:00100000:2.0:1784189214.777090:0:68287:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc07fb37b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1870854458146560:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784189214.777120:0:68287:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc07fb37b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1870854458146560:12345-0@lo:400:kworker.0 Request processed in 32us (1494us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189214.777125:0:68287:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1215 00000100:00100000:2.0:1784189214.777137:0:68287:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1216 00000100:00100000:2.0:1784189214.777143:0:68287:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc0477c3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1870854458147072:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784189214.777158:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458147200 00000100:00100000:1.0:1784189214.777163:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458147200 00000100:00100000:2.0:1784189214.777169:0:68287:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc0477c3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1870854458147072:12345-0@lo:400:kworker.0 Request processed in 25us (1503us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189214.777175:0:68287:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1216 00000100:00100000:2.0:1784189214.777188:0:68287:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1217 00000100:00100000:2.0:1784189214.777194:0:68287:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc05ed91f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1870854458147584:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784189214.777215:0:68287:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc05ed91f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1870854458147584:12345-0@lo:400:kworker.0 Request processed in 22us (1499us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189214.777220:0:68287:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1217 00000100:00100000:2.0:1784189214.777229:0:68287:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1218 00000100:00100000:2.0:1784189214.777234:0:68287:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf4a32c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1870854458146304:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784189214.777260:0:68287:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf4a32c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1870854458146304:12345-0@lo:400:kworker.0 Request processed in 26us (1283us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189214.777265:0:68287:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1218 00000100:00100000:2.0:1784189214.777288:0:68287:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1219 00000100:00100000:2.0:1784189214.777294:0:68287:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf43c5ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1870854458146176:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784189214.777310:0:26492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3819 00000100:00100000:2.0:1784189214.777378:0:68287:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf43c5ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1870854458146176:12345-0@lo:400:kworker.0 Request processed in 83us (465us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189214.777385:0:68287:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1219 00000100:00100000:0.0:1784189214.777517:0:26492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc070222680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3641:x1870854458146688:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784189214.777670:0:26492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc070222680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3641:x1870854458146688:12345-0@lo:400:kworker.0 Request processed in 353us (718us total) trans 0 rc 0/0 00000100:00100000:0.0:1784189214.777677:0:26492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3819 00000100:00100000:0.0:1784189214.777693:0:26492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3820 00000100:00100000:0.0:1784189214.777699:0:26492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc070220000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3641:x1870854458147200:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784189214.777732:0:26492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc070220000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3641:x1870854458147200:12345-0@lo:400:kworker.0 Request processed in 33us (723us total) trans 0 rc 0/0 00000100:00100000:0.0:1784189214.777738:0:26492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3820 00000100:00100000:3.0:1784189214.786081:0:90954:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458146048 00000100:00100000:3.0:1784189214.786105:0:90954:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458146048 00000100:00100000:3.0:1784189214.786178:0:90954:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1784189214.786187:0:90954:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc07037d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd553d0d-03e2-4233-b06b-b55bbfa2b954+24:3642:x1870854458146048:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784189214.786265:0:90954:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc07037d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd553d0d-03e2-4233-b06b-b55bbfa2b954+24:3642:x1870854458146048:12345-0@lo:400:kworker.0 Request processed in 79us (10685us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189214.786272:0:90954:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1784189214.786361:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf47547800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1870854458145792:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1784189214.787474:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc070222a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bd553d0d-03e2-4233-b06b-b55bbfa2b954:3642:1870854458146048:0@lo:400:kworker.0 00000100:00100000:3.0:1784189214.787490:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc070223800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3642:1870854458146560:0@lo:400:kworker.0 00000100:00100000:3.0:1784189214.787502:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc070220e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3642:1870854458147072:0@lo:400:kworker.0 00000100:00100000:3.0:1784189214.787518:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc070220380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3642:1870854458147584:0@lo:400:kworker.0 00000100:00100000:3.0:1784189214.787530:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc070222300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3642:1870854458146432:0@lo:400:kworker.0 00000100:00100000:3.0:1784189214.787541:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc070223b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1870854458146944:0@lo:400:kworker.0 00000100:00100000:3.0:1784189214.787555:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc070221500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1870854458147456:0@lo:400:kworker.0 00000100:00080000:2.0:1784189214.788792:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1784189214.788801:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1784189214.788850:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc070220a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3641:1870854458146176:0@lo:400:kworker.0 00000100:00100000:2.0:1784189214.788867:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc070223100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1870854458146688:0@lo:400:kworker.0 00000100:00100000:2.0:1784189214.788880:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc070221f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1870854458147200:0@lo:400:kworker.0 00000100:00100000:2.0:1784189214.788894:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc070220700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3641:1870854458146304:0@lo:400:kworker.0 00000100:00100000:3.0:1784189215.015113:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1784189215.015204:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1784189215.015233:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1784189215.015251:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1784189215.015458:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436287232 00000100:00100000:2.0:1784189215.015468:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436287232 00000100:00080000:1.0:1784189215.015529:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1784189215.015560:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1784189215.015675:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436287360 00000100:00100000:2.0:1784189215.015680:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436287360 00000100:00100000:2.0:1784189215.015713:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 2486 00000100:00100000:2.0:1784189215.015721:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf47546680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+6:2399:x1870854436287232:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:2.0:1784189215.015789:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf47546680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+6:2399:x1870854436287232:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 69us (585us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189215.015797:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 2486 00000100:00100000:2.0:1784189215.015814:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 2487 00000100:00100000:2.0:1784189215.015821:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf47544e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+7:2399:x1870854436287360:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:2.0:1784189215.015854:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf47544e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+7:2399:x1870854436287360:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 34us (294us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189215.015859:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 2487 00000100:00080000:2.0:1784189215.015876:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1784189215.015962:0:68287:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436286976 00000100:00100000:0.0:1784189215.015968:0:68287:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436286976 00000100:00080000:2.0:1784189215.015990:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1784189215.016012:0:68287:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436287104 00000100:00100000:0.0:1784189215.016016:0:68287:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436287104 00000100:00100000:2.0:1784189215.016020:0:66171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1220 00000100:00100000:2.0:1784189215.016031:0:66171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf47547800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+11:2399:x1870854436286976:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:0.0:1784189215.016050:0:68287:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1221 00000100:00100000:0.0:1784189215.016059:0:68287:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf47547b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+6:2399:x1870854436287104:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:2.0:1784189215.016076:0:66171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf47547800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+11:2399:x1870854436286976:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 47us (972us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189215.016083:0:66171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1220 00000100:00100000:0.0:1784189215.016097:0:68287:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf47547b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+6:2399:x1870854436287104:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 38us (842us total) trans 0 rc 0/0 00000100:00100000:0.0:1784189215.016106:0:68287:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1221 00000100:00100000:0.0:1784189215.016131:0:90955:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436286848 00000100:00100000:0.0:1784189215.016134:0:90955:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436286848 00000100:00080000:2.0:1784189215.016147:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1784189215.016299:0:90955:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 82 00000100:00100000:0.0:1784189215.016306:0:90955:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc07037e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9957a2dc-fd88-4a91-bca3-e2b7f365ab0c+10:2399:x1870854436286848:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:0.0:1784189215.016432:0:90955:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc07037e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9957a2dc-fd88-4a91-bca3-e2b7f365ab0c+10:2399:x1870854436286848:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 125us (1197us total) trans 0 rc 0/0 00000100:00100000:0.0:1784189215.016439:0:90955:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 82 00000100:00100000:3.0:1784189215.279534:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf47545f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1870854458147712:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1784189215.279603:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784189215.279759:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458147712 00000100:00100000:0.0:1784189215.279767:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458147712 00000100:00100000:0.0:1784189215.279817:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1990 00000100:00100000:0.0:1784189215.279828:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf47544000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1870854458147712:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1784189215.279873:0:8432:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 16013376 pending 0 free 3922481152 avail 3690958848 00000100:00100000:0.0:1784189215.279930:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf47544000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1870854458147712:12345-0@lo:13:osp-pre-0-0.0 Request processed in 103us (325us total) trans 0 rc 0/0 00000100:00100000:0.0:1784189215.279938:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1990 00000100:00100000:0.0:1784189215.280085:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf47545f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1870854458147712:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1784189215.280853:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc070220700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1870854458147840:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1784189215.280904:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784189215.280957:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458147840 00000100:00100000:3.0:1784189215.280965:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458147840 00000100:00100000:3.0:1784189215.281001:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1991 00000100:00100000:3.0:1784189215.281010:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc070221f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1870854458147840:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1784189215.281032:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8648768 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1784189215.281073:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc070221f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1870854458147840:12345-0@lo:13:osp-pre-1-0.0 Request processed in 63us (168us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189215.281081:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1991 00000100:00100000:3.0:1784189215.281122:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc070220700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1870854458147840:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1784189215.471828:0:7454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784189216.496636:0:26173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784189217.519708:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784189217.841275:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf47545500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1870854458147968:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1784189217.841385:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784189217.841457:0:9466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458147968 00000100:00100000:3.0:1784189217.841466:0:9466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458147968 00000100:00100000:3.0:1784189217.841535:0:9466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1992 00000100:00100000:3.0:1784189217.841546:0:9466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf47544380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1870854458147968:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1784189217.841597:0:9466:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 16013376 pending 0 free 3922481152 avail 3690958848 00000100:00100000:3.0:1784189217.841648:0:9466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf47544380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1870854458147968:12345-0@lo:13:osp-pre-0-1.0 Request processed in 104us (262us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189217.841657:0:9466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1992 00000100:00080000:3.0:1784189217.841684:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1784189217.841742:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf47545500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1870854458147968:0@lo:13:osp-pre-0-1.0 00000001:00080000:0.0:1784189217.845173:0:90949:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 111669149698 is committed 00000100:00100000:3.0:1784189217.853991:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1784189217.854023:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf47545500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1870854458148096:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1784189217.854117:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784189217.854182:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458148096 00000100:00100000:3.0:1784189217.854192:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458148096 00000100:00100000:3.0:1784189217.854261:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1993 00000100:00100000:3.0:1784189217.854271:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf47545880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1870854458148096:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1784189217.854306:0:8432:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8648768 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1784189217.854376:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf47545880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1870854458148096:12345-0@lo:13:osp-pre-1-1.0 Request processed in 107us (260us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189217.854384:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1993 00000100:00080000:3.0:1784189217.854410:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1784189217.854456:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf47545500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1870854458148096:0@lo:13:osp-pre-1-1.0 00000001:02000400:3.0:1784189218.507526:0:91775:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == replay-single test 133: check resend of ongoing requests for lwp during failover ========================================================== 04:06:56 (1784189216) 00010000:00010000:1.0:1784189218.547021:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784189218.577878:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1784189218.577963:0:66169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436287616 00000100:00100000:3.0:1784189218.577976:0:66169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436287616 00000100:00100000:3.0:1784189218.578077:0:66169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1289 00000100:00100000:3.0:1784189218.578089:0:66169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf470e1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+6:70905:x1870854436287616:12345-192.168.203.12@tcp:36:mkdir.0 00000100:00100000:3.0:1784189218.578261:0:66169:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf47545500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID:66169:1870854458148224:0@lo:900:mdt00_000.0 00000100:00100000:3.0:1784189218.578357:0:66169:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784189218.578393:0:66169:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dbf445d3a80 going to sleep for 11 seconds 00000100:00100000:3.0:1784189218.578418:0:66181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458148224 00000100:00100000:3.0:1784189218.578421:0:66181:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458148224 00000100:00100000:3.0:1784189218.578452:0:66181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1784189218.578459:0:66181:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf45586450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:66169:x1870854458148224:12345-0@lo:900:mdt00_000.0 00000100:00100000:3.0:1784189218.578529:0:66181:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf45586450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:66169:x1870854458148224:12345-0@lo:900:mdt00_000.0 Request processed in 70us (171us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189218.578538:0:66181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1784189218.578789:0:66169:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf47545500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID:66169:1870854458148224:0@lo:900:mdt00_000.0 00000100:00100000:2.0:1784189218.578880:0:66169:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf470e0000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:66169:1870854458148352:0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1784189218.578917:0:66169:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784189218.578946:0:66169:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dc05085ba80 going to sleep for 11 seconds 00000100:00100000:3.0:1784189218.579035:0:26492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458148352 00000100:00100000:3.0:1784189218.579051:0:26492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458148352 00000100:00100000:3.0:1784189218.579127:0:26492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3821 00000100:00100000:3.0:1784189218.579138:0:26492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf470e1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:66169:x1870854458148352:12345-0@lo:1000:mdt00_000.0 00000100:00080000:0.0:1784189218.579253:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1784189218.579382:0:26492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf470e1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:66169:x1870854458148352:12345-0@lo:1000:mdt00_000.0 Request processed in 246us (463us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189218.579393:0:26492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3821 00000100:00100000:0.0:1784189218.579507:0:66169:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf470e0000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:66169:1870854458148352:0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1784189218.579577:0:66169:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc070223100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:66169:1870854458148480:0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1784189218.579609:0:66169:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784189218.579631:0:66169:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dbf43c47600 going to sleep for 11 seconds 00000100:00100000:3.0:1784189218.579697:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458148480 00000100:00100000:3.0:1784189218.579703:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458148480 00000100:00100000:3.0:1784189218.579744:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3822 00000100:00100000:3.0:1784189218.579751:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc070220a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:66169:x1870854458148480:12345-0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1784189218.579878:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc070220a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:66169:x1870854458148480:12345-0@lo:1000:mdt00_000.0 Request processed in 126us (267us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189218.579886:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3822 00000100:00100000:2.0:1784189218.582729:0:66169:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc070223100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:66169:1870854458148480:0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1784189218.582859:0:66169:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf470e3480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:66169:1870854458148608:0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1784189218.582941:0:66169:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784189218.583660:0:66169:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dc05085b180 going to sleep for 11 seconds 00000100:00100000:0.0:1784189218.585237:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458148608 00000100:00100000:0.0:1784189218.585253:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458148608 00000100:00100000:0.0:1784189218.587600:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3823 00000100:00100000:0.0:1784189218.587622:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf470e2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:66169:x1870854458148608:12345-0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1784189218.588047:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf470e2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:66169:x1870854458148608:12345-0@lo:1000:mdt00_000.0 Request processed in 431us (5104us total) trans 0 rc -2/-2 00000100:00100000:0.0:1784189218.588058:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3823 00000100:00100000:2.0:1784189218.588902:0:66169:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf470e3480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:66169:1870854458148608:0@lo:1000:mdt00_000.0 00010000:00010000:2.0:1784189218.589005:0:66169:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9dbf4369d400/0xcc1762b626f8bb16 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189218.589018:0:66169:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff9dbf4369d400/0xcc1762b626f8bb16 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 66169 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189218.589044:0:66169:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff9dbf4369d400/0xcc1762b626f8bb16 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 66169 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784189218.589070:0:66169:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf470e3480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:66169:1870854458148736:0@lo:101:mdt00_000.0 00000100:00100000:2.0:1784189218.589131:0:66169:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784189218.593913:0:26492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458148736 00000100:00100000:3.0:1784189218.593931:0:26492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458148736 00000100:00100000:3.0:1784189218.593999:0:26492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3824 00000100:00100000:3.0:1784189218.594010:0:26492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf470e1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:66169:x1870854458148736:12345-0@lo:101:mdt00_000.0 00010000:00010000:3.0:1784189218.594039:0:26492:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784189218.594068:0:26492:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0755a4600/0xcc1762b626f8bb1d lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcc1762b626f8bb16 expref: -99 pid: 26492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784189218.594205:0:66169:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dc05085b9c0 going to sleep for 11 seconds 00010000:00010000:3.0:1784189218.594639:0:26492:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04152c600/0xcc1762b626f8ba98 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c3e87 expref: 8 pid: 66171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189218.594652:0:26492:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0755a4600/0xcc1762b626f8bb1d lrc: 4/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xcc1762b626f8bb16 expref: 7 pid: 26492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189218.594706:0:26492:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04152c600/0xcc1762b626f8ba98 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c3e87 expref: 8 pid: 66171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189218.594723:0:26492:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04152c600/0xcc1762b626f8ba98 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c3e87 expref: 8 pid: 66171 timeout: 3560 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784189218.594741:0:26492:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf47545500 pname:cluuid:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000_UUID:26492:1870854458148864:192.168.203.12@tcp:104: 00000100:00100000:3.0:1784189218.594858:0:26492:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dbf445d33c0 going to sleep for 11 seconds 00000100:00100000:0.0:1784189218.600907:0:26492:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf47545500 pname:cluuid:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000_UUID:26492:1870854458148864:192.168.203.12@tcp:104: 00010000:00010000:0.0:1784189218.600986:0:26492:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0755a4600/0xcc1762b626f8bb1d lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xcc1762b626f8bb16 expref: 7 pid: 26492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189218.601004:0:26492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9dc056eaaf00) 00010000:00010000:0.0:1784189218.601008:0:26492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784189218.601013:0:26492:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0755a4600/0xcc1762b626f8bb1d lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xcc1762b626f8bb16 expref: 7 pid: 26492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189218.601025:0:26492:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc0755a4600, rc 0) 00000100:00100000:0.0:1784189218.601107:0:26492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf470e1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:66169:x1870854458148736:12345-0@lo:101:mdt00_000.0 Request processed in 7098us (11975us total) trans 0 rc 0/0 00000100:00100000:0.0:1784189218.601118:0:26492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3824 00000100:00100000:2.0:1784189218.601371:0:66169:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf470e3480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:66169:1870854458148736:0@lo:101:mdt00_000.0 00010000:00010000:2.0:1784189218.601396:0:66169:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9dbf4369d400/0xcc1762b626f8bb16 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xcc1762b626f8bb1d expref: -99 pid: 66169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189218.601409:0:66169:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: lustre-MDT0000-osp-MDT0001 lock: ffff9dbf4369d400/0xcc1762b626f8bb16 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xcc1762b626f8bb1d expref: -99 pid: 66169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784189218.602023:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1784189218.602433:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436287744 00000100:00100000:3.0:1784189218.602444:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436287744 00010000:00010000:3.0:1784189218.602503:0:6499:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04152c600/0xcc1762b626f8ba98 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c3e87 expref: 9 pid: 66171 timeout: 3560 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784189218.602550:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 2549 00000100:00100000:3.0:1784189218.602571:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc070221500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+9:2396:x1870854436287744:12345-192.168.203.12@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1784189218.602589:0:6499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784189218.602597:0:6499:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04152c600/0xcc1762b626f8ba98 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c3e87 expref: 9 pid: 66171 timeout: 3560 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189218.602610:0:6499:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04152c600/0xcc1762b626f8ba98 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c3e87 expref: 9 pid: 66171 timeout: 3560 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189218.602637:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04152c600/0xcc1762b626f8ba98 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c3e87 expref: 9 pid: 66171 timeout: 3560 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189218.602656:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9dc056eaaf00) 00010000:00010000:3.0:1784189218.602678:0:6499:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0755a4600/0xcc1762b626f8bb1d lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xcc1762b626f8bb16 expref: 6 pid: 26492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189218.602689:0:6499:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0755a4600/0xcc1762b626f8bb1d lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0xcc1762b626f8bb16 expref: 6 pid: 26492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189218.602699:0:6499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0755a4600/0xcc1762b626f8bb1d lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0xcc1762b626f8bb16 expref: 6 pid: 26492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189218.602740:0:6499:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0755a4600/0xcc1762b626f8bb1d lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xcc1762b626f8bb16 expref: 6 pid: 26492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784189218.602758:0:6499:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf47545f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0000_UUID:6499:1870854458148992:0@lo:105: 00000100:00100000:3.0:1784189218.602826:0:6499:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784189218.602868:0:6499:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dbf445d3300 going to sleep for 11 seconds 00000100:00100000:3.0:1784189218.602890:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458148992 00000100:00100000:3.0:1784189218.602894:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458148992 00000100:00100000:3.0:1784189218.602928:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 311 00000100:00100000:3.0:1784189218.602934:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf47546300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0001-mdtlov_UUID+4:6499:x1870854458148992:12345-0@lo:105: 00010000:00010000:3.0:1784189218.602947:0:6497:0:(ldlm_lockd.c:2518:ldlm_callback_handler()) ### completion ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff9dbf4369d400/0xcc1762b626f8bb16 lrc: 5/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xcc1762b626f8bb1d expref: -99 pid: 66169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189218.602958:0:6497:0:(ldlm_lockd.c:1968:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-MDT0000-osp-MDT0001 lock: ffff9dbf4369d400/0xcc1762b626f8bb16 lrc: 5/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xcc1762b626f8bb1d expref: -99 pid: 66169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189218.602967:0:6497:0:(ldlm_lockd.c:2045:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-MDT0000-osp-MDT0001 lock: ffff9dbf4369d400/0xcc1762b626f8bb16 lrc: 5/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xcc1762b626f8bb1d expref: -99 pid: 66169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189218.602975:0:6497:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9dbf4369d400/0xcc1762b626f8bb16 lrc: 5/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xcc1762b626f8bb1d expref: -99 pid: 66169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189218.602990:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff9dbf4369d400/0xcc1762b626f8bb16 lrc: 6/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xcc1762b626f8bb1d expref: -99 pid: 66169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189218.603003:0:6497:0:(ldlm_lockd.c:2073:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-MDT0000-osp-MDT0001 lock: ffff9dbf4369d400/0xcc1762b626f8bb16 lrc: 6/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1080000000000 nid: local remote: 0xcc1762b626f8bb1d expref: -99 pid: 66169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189218.603025:0:6497:0:(ldlm_lockd.c:2084:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff9dbf4369d400) 00000100:00100000:3.0:1784189218.603062:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf47546300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0001-mdtlov_UUID+4:6499:x1870854458148992:12345-0@lo:105: Request processed in 127us (236us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189218.603070:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 311 00000100:00100000:3.0:1784189218.603114:0:6499:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf47545f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0000_UUID:6499:1870854458148992:0@lo:105: 00010000:00010000:3.0:1784189218.603132:0:6499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784189218.603176:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc070221500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+8:2396:x1870854436287744:12345-192.168.203.12@tcp:103:ldlm_bl.0 Request processed in 608us (1157us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189218.603183:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 2549 00010000:00010000:3.0:1784189218.603309:0:66169:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: lustre-MDT0000-osp-MDT0001 lock: ffff9dbf4369d400/0xcc1762b626f8bb16 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xcc1762b626f8bb1d expref: -99 pid: 66169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189218.603361:0:66169:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9dbf4369d400/0xcc1762b626f8bb16 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xcc1762b626f8bb1d expref: -99 pid: 66169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1784189218.603438:0:66169:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00010000:00010000:3.0:1784189218.603485:0:66169:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9dc0755a4c00/0xcc1762b626f8bb24 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189218.603493:0:66169:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff9dc0755a4c00/0xcc1762b626f8bb24 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 66169 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189218.603517:0:66169:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff9dc0755a4c00/0xcc1762b626f8bb24 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 66169 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784189218.603536:0:66169:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf47545f80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:66169:1870854458149120:0@lo:101:mdt00_000.0 00000100:00100000:3.0:1784189218.603570:0:66169:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784189218.603593:0:66169:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dbf445d3300 going to sleep for 11 seconds 00000100:00100000:3.0:1784189218.603611:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458149120 00000100:00100000:3.0:1784189218.603616:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458149120 00000100:00100000:3.0:1784189218.603648:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3825 00000100:00100000:3.0:1784189218.603654:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf47545c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:66169:x1870854458149120:12345-0@lo:101:mdt00_000.0 00010000:00010000:3.0:1784189218.603674:0:8439:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784189218.603690:0:8439:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0755a5000/0xcc1762b626f8bb2b lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcc1762b626f8bb24 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189218.603711:0:8439:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0755a5000/0xcc1762b626f8bb2b lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xcc1762b626f8bb24 expref: 8 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189218.603724:0:8439:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0755a5000/0xcc1762b626f8bb2b lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xcc1762b626f8bb24 expref: 8 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189218.603733:0:8439:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x8401ce4f (ffff9dc07fab4900) 00010000:00010000:3.0:1784189218.603736:0:8439:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784189218.603738:0:8439:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc0755a5000, rc 0) 00000100:00100000:3.0:1784189218.603770:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf47545c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:66169:x1870854458149120:12345-0@lo:101:mdt00_000.0 Request processed in 115us (199us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189218.603775:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3825 00000100:00100000:3.0:1784189218.603808:0:66169:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf47545f80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:66169:1870854458149120:0@lo:101:mdt00_000.0 00010000:00010000:3.0:1784189218.603843:0:66169:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff9dc0755a4c00/0xcc1762b626f8bb24 lrc: 4/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xcc1762b626f8bb2b expref: -99 pid: 66169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189218.603851:0:66169:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9dc0755a4c00/0xcc1762b626f8bb24 lrc: 4/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xcc1762b626f8bb2b expref: -99 pid: 66169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1784189218.603864:0:66169:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00000100:00100000:3.0:1784189218.603900:0:66169:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf47545f80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:66169:1870854458149248:0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1784189218.603931:0:66169:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784189218.603946:0:66169:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dbf445d3240 going to sleep for 11 seconds 00000100:00100000:3.0:1784189218.603961:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458149248 00000100:00100000:3.0:1784189218.603965:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458149248 00000100:00100000:3.0:1784189218.603988:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3826 00000100:00100000:3.0:1784189218.603994:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf47545500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:66169:x1870854458149248:12345-0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1784189218.604057:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf47545500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:66169:x1870854458149248:12345-0@lo:1000:mdt00_000.0 Request processed in 63us (125us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189218.604063:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3826 00000100:00100000:3.0:1784189218.604086:0:66169:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf47545f80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:66169:1870854458149248:0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1784189218.604126:0:66169:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf47545f80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:66169:1870854458149376:0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1784189218.604148:0:66169:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784189218.604161:0:66169:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dbf445d3240 going to sleep for 11 seconds 00000100:00100000:3.0:1784189218.604172:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458149376 00000100:00100000:3.0:1784189218.604175:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458149376 00000100:00100000:3.0:1784189218.604196:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3827 00000100:00100000:3.0:1784189218.604202:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf44fad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:66169:x1870854458149376:12345-0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1784189218.604278:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf44fad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:66169:x1870854458149376:12345-0@lo:1000:mdt00_000.0 Request processed in 75us (128us total) trans 0 rc -2/-2 00000100:00100000:3.0:1784189218.604291:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3827 00000100:00100000:3.0:1784189218.604345:0:66169:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf47545f80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:66169:1870854458149376:0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1784189218.604426:0:66169:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf47545f80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:66169:1870854458149504:0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1784189218.604450:0:66169:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784189218.604464:0:66169:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dbf445d3240 going to sleep for 11 seconds 00000100:00100000:3.0:1784189218.604474:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458149504 00000100:00100000:3.0:1784189218.604478:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458149504 00000100:00100000:3.0:1784189218.604498:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3828 00000100:00100000:3.0:1784189218.604503:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf4262f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:66169:x1870854458149504:12345-0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1784189218.604550:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf4262f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:66169:x1870854458149504:12345-0@lo:1000:mdt00_000.0 Request processed in 46us (99us total) trans 0 rc -2/-2 00000100:00100000:3.0:1784189218.604557:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3828 00000100:00100000:3.0:1784189218.604581:0:66169:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf47545f80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:66169:1870854458149504:0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1784189218.604630:0:66169:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf47545f80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:66169:1870854458149632:0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1784189218.604652:0:66169:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784189218.604663:0:66169:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dbf445d3240 going to sleep for 11 seconds 00000100:00100000:3.0:1784189218.604674:0:23826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458149632 00000100:00100000:3.0:1784189218.604677:0:23826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458149632 00000100:00100000:3.0:1784189218.604698:0:23826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3829 00000100:00100000:3.0:1784189218.604704:0:23826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc05ed7ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:66169:x1870854458149632:12345-0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1784189218.604756:0:23826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc05ed7ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:66169:x1870854458149632:12345-0@lo:1000:mdt00_000.0 Request processed in 51us (103us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189218.604762:0:23826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3829 00000100:00100000:3.0:1784189218.604786:0:66169:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf47545f80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:66169:1870854458149632:0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1784189218.604849:0:66169:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf47545f80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:66169:1870854458149760:0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1784189218.604873:0:66169:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784189218.604885:0:66169:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dbf445d3240 going to sleep for 11 seconds 00000100:00100000:3.0:1784189218.604895:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458149760 00000100:00100000:3.0:1784189218.604898:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458149760 00000100:00100000:3.0:1784189218.604917:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3830 00000100:00100000:3.0:1784189218.604922:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc05ed90700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:66169:x1870854458149760:12345-0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1784189218.604976:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc05ed90700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:66169:x1870854458149760:12345-0@lo:1000:mdt00_000.0 Request processed in 53us (102us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189218.604982:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3830 00000100:00100000:3.0:1784189218.605007:0:66169:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf47545f80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:66169:1870854458149760:0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1784189218.605043:0:66169:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf47545f80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:66169:1870854458149888:0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1784189218.605066:0:66169:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784189218.605079:0:66169:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dbf445d3240 going to sleep for 11 seconds 00000100:00100000:3.0:1784189218.605089:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458149888 00000100:00100000:3.0:1784189218.605092:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458149888 00000100:00100000:3.0:1784189218.605111:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3831 00000100:00100000:3.0:1784189218.605117:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc06b98d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:66169:x1870854458149888:12345-0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1784189218.605160:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc06b98d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:66169:x1870854458149888:12345-0@lo:1000:mdt00_000.0 Request processed in 42us (92us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189218.605167:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3831 00000100:00100000:3.0:1784189218.605191:0:66169:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf47545f80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:66169:1870854458149888:0@lo:1000:mdt00_000.0 00000100:00080000:0.0:1784189218.606258:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000040:00080000:3.0:1784189218.607090:0:66169:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x2400090a0:0x2:0x0].2, 1000 off35920 00000040:00080000:3.0:1784189218.607217:0:66169:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x2000088d1:0x2:0x0].2, 1152 off36272 00000004:00080000:3.0:1784189218.607226:0:66169:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff9dbf445d3300 with version 9 00000004:00080000:1.0:1784189218.609971:0:75594:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9dc05020c840 version 9 rpc_version 9 00000020:00100000:1.0:1784189218.610044:0:75594:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1784189218.610057:0:75594:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9dbf4a32f480 x1870854458150144/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 2440/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1784189218.610090:0:75594:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf4a32f480 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:75594:1870854458150144:0@lo:1000:osp_up0-1.0 00000100:00100000:1.0:1784189218.610184:0:75594:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784189218.610229:0:75594:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dc04673f540 going to sleep for 11 seconds 00000100:00100000:1.0:1784189218.610260:0:23826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458150144 00000100:00100000:1.0:1784189218.610268:0:23826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458150144 00000100:00100000:1.0:1784189218.610354:0:23826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3832 00000100:00100000:1.0:1784189218.610365:0:23826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf4a32d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:75594:x1870854458150144:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:2.0:1784189218.617129:0:23826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf4a32d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:75594:x1870854458150144:12345-0@lo:1000:osp_up0-1.0 Request processed in 6750us (6929us total) trans 111669149699 rc 0/0 00000100:00100000:2.0:1784189218.617148:0:23826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3832 00000100:00100000:3.0:1784189218.617303:0:75594:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf4a32f480 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:75594:1870854458150144:0@lo:1000:osp_up0-1.0 00010000:00010000:0.0:1784189218.617561:0:66169:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9dc04152c200/0xcc1762b626f8bb32 lrc: 3/0,1 mode: --/PW res: [0x240006991:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189218.617582:0:66169:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9dc04152c200/0xcc1762b626f8bb32 lrc: 3/0,1 mode: PW/PW res: [0x240006991:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66169 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189218.617599:0:66169:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9dc04152c200/0xcc1762b626f8bb32 lrc: 3/0,1 mode: PW/PW res: [0x240006991:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66169 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1784189218.617621:0:66169:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000006805e824 reply state 0000000023826d10 transno 81604378735 ns: mdt-lustre-MDT0001_UUID lock: ffff9dc04152c200/0xcc1762b626f8bb32 lrc: 3/0,1 mode: PW/PW res: [0x240006991:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66169 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189218.617634:0:66169:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9dc04152c200/0xcc1762b626f8bb32 lrc: 3/0,1 mode: TXN/TXN res: [0x240006991:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66169 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189218.617642:0:66169:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240006991:0xb:0x0].0x0 (ffff9dc047db8300) 00010000:00010000:0.0:1784189218.617656:0:66169:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1784189218.617661:0:66169:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1784189218.617669:0:66169:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240006991:0xb:0x0]: returning size 4096 00000004:00080000:0.0:1784189218.617680:0:66169:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00010000:00010000:0.0:1784189218.617694:0:66169:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9dbf4369d400/0xcc1762b626f8bb16 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xcc1762b626f8bb1d expref: -99 pid: 66169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189218.617704:0:66169:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9dbf4369d400/0xcc1762b626f8bb16 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xcc1762b626f8bb1d expref: -99 pid: 66169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189218.617713:0:66169:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9dbf4369d400/0xcc1762b626f8bb16 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xcc1762b626f8bb1d expref: -99 pid: 66169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189218.617741:0:66169:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:0.0:1784189218.617747:0:66169:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00010000:00010000:0.0:1784189218.617752:0:66169:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9dc0755a4c00/0xcc1762b626f8bb24 lrc: 4/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xcc1762b626f8bb2b expref: -99 pid: 66169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189218.617760:0:66169:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-osp-MDT0001 lock: ffff9dc0755a4c00/0xcc1762b626f8bb24 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xcc1762b626f8bb2b expref: -99 pid: 66169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784189218.617936:0:66169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf470e1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+8:70905:x1870854436287616:12345-192.168.203.12@tcp:36:mkdir.0 Request processed in 39847us (40071us total) trans 81604378735 rc 0/0 00000100:00100000:0.0:1784189218.617946:0:66169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1289 00010000:00010000:2.0:1784189218.618043:0:7454:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784189218.618051:0:7454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff9dbf4369d400/0xcc1762b626f8bb16 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0xcc1762b626f8bb1d expref: -99 pid: 66169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189218.618060:0:7454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dbf4369d400 already unused, calling callback (ffffffffc1767ed0) 00010000:00010000:2.0:1784189218.618066:0:7454:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff9dbf4369d400/0xcc1762b626f8bb16 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xcc1762b626f8bb1d expref: -99 pid: 66169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1784189218.618074:0:7454:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9dbf4369d400/0xcc1762b626f8bb16 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xcc1762b626f8bb1d expref: -99 pid: 66169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189218.618130:0:7454:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff9dbf4369d400/0xcc1762b626f8bb16 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xcc1762b626f8bb1d expref: -99 pid: 66169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189218.618138:0:7454:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1784189218.618172:0:7454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9dbf4369d400/0xcc1762b626f8bb16 lrc: 1/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xcc1762b626f8bb1d expref: -99 pid: 66169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189218.618182:0:7454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9dbf4369d400/0xcc1762b626f8bb16 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xcc1762b626f8bb1d expref: -99 pid: 66169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189218.618203:0:7454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784189218.618205:0:7454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784189218.618207:0:7454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784189218.618216:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1784189218.618235:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf470e0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1870854458150272:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1784189218.618291:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784189218.618377:0:26172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458150272 00000100:00100000:2.0:1784189218.618384:0:26172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458150272 00000100:00100000:2.0:1784189218.618434:0:26172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 699 00000100:00100000:2.0:1784189218.618443:0:26172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf470e0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:lustre-MDT0001-mdtlov_UUID+9:3641:x1870854458150272:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1784189218.618458:0:26172:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784189218.618480:0:26172:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0755a4600/0xcc1762b626f8bb1d lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xcc1762b626f8bb16 expref: 9 pid: 26492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189218.618495:0:26172:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9dc056eaaf00) 00010000:00010000:2.0:1784189218.618506:0:26172:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784189218.618536:0:26172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf470e0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:lustre-MDT0001-mdtlov_UUID+8:3641:x1870854458150272:12345-0@lo:103:ldlm_bl.0 Request processed in 94us (245us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189218.618550:0:26172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 699 00000100:00100000:2.0:1784189218.618592:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf470e0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1870854458150272:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1784189218.647553:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1784189218.652490:0:68287:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436287872 00000100:00100000:3.0:1784189218.652510:0:68287:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436287872 00000100:00100000:3.0:1784189218.652599:0:68287:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1290 00000100:00100000:3.0:1784189218.652611:0:68287:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf470e0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+8:70906:x1870854436287872:12345-192.168.203.12@tcp:101:lfs.0 00010000:00010000:3.0:1784189218.652636:0:68287:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784189218.652666:0:68287:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0755a4400/0xcc1762b626f8bb39 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbfc5de7fe6c3ea3 expref: -99 pid: 68287 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189218.652750:0:68287:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0755a4800/0xcc1762b626f8bb40 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189218.652766:0:68287:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0755a4800/0xcc1762b626f8bb40 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189218.652780:0:68287:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0755a4800/0xcc1762b626f8bb40 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784189218.652846:0:68287:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1784189218.652851:0:68287:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1784189218.652874:0:68287:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0755a4800/0xcc1762b626f8bb40 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189218.652902:0:68287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0755a4400/0xcc1762b626f8bb39 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c3ea3 expref: 10 pid: 68287 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189218.652926:0:68287:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0755a4800/0xcc1762b626f8bb40 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c3ea3 expref: 9 pid: 68287 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189218.652936:0:68287:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9dc07fab4a00) 00010000:00010000:3.0:1784189218.652948:0:68287:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1784189218.652953:0:68287:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc0755a4800, rc 0) 00000100:00100000:3.0:1784189218.653041:0:68287:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf470e0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+9:70906:x1870854436287872:12345-192.168.203.12@tcp:101:lfs.0 Request processed in 432us (5504us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189218.653049:0:68287:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1290 00000100:00100000:3.0:1784189218.660803:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1784189218.661206:0:66945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436288000 00000100:00100000:0.0:1784189218.661218:0:66945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436288000 00000100:00100000:0.0:1784189218.661286:0:66945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1291 00000100:00100000:0.0:1784189218.661493:0:66945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf47545f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+9:70906:x1870854436288000:12345-192.168.203.12@tcp:101:lfs.0 00010000:00010000:0.0:1784189218.661521:0:66945:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784189218.661553:0:66945:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04152c800/0xcc1762b626f8bb47 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbfc5de7fe6c3eaa expref: -99 pid: 66945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189218.661629:0:66945:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04152ce00/0xcc1762b626f8bb4e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189218.661645:0:66945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04152ce00/0xcc1762b626f8bb4e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189218.661657:0:66945:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04152ce00/0xcc1762b626f8bb4e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189218.661668:0:66945:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04152ca00/0xcc1762b626f8bb55 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189218.661678:0:66945:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0755a5000/0xcc1762b626f8bb2b lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xcc1762b626f8bb24 expref: 7 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189218.661687:0:66945:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04152ca00/0xcc1762b626f8bb55 lrc: 4/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189218.661730:0:66945:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0755a5000/0xcc1762b626f8bb2b lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 0@lo remote: 0xcc1762b626f8bb24 expref: 7 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784189218.661749:0:66945:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc070223b80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:66945:1870854458150400:0@lo:104: 00000100:00100000:0.0:1784189218.661808:0:66945:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784189218.661857:0:66945:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dbf43c47cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1784189218.661930:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458150400 00000100:00100000:3.0:1784189218.661936:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458150400 00000100:00100000:3.0:1784189218.661978:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 312 00000100:00100000:3.0:1784189218.661986:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc070222300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0001-mdtlov_UUID+4:66945:x1870854458150400:12345-0@lo:104: 00010000:00010000:3.0:1784189218.662001:0:6496:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff9dc0755a4c00/0xcc1762b626f8bb24 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0xcc1762b626f8bb2b expref: -99 pid: 66169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189218.662069:0:6496:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1784189218.662076:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc070222300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0001-mdtlov_UUID+4:66945:x1870854458150400:12345-0@lo:104: Request processed in 91us (268us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189218.662083:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 312 00010000:00010000:3.0:1784189218.662112:0:26173:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784189218.662120:0:26173:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff9dc0755a4c00/0xcc1762b626f8bb24 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0xcc1762b626f8bb2b expref: -99 pid: 66169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189218.662129:0:26173:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc0755a4c00 already unused, calling callback (ffffffffc1767ed0) 00010000:00010000:3.0:1784189218.662135:0:26173:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff9dc0755a4c00/0xcc1762b626f8bb24 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x1408400000000 nid: local remote: 0xcc1762b626f8bb2b expref: -99 pid: 66169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1784189218.662145:0:26173:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9dc0755a4c00/0xcc1762b626f8bb24 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x1409400000000 nid: local remote: 0xcc1762b626f8bb2b expref: -99 pid: 66169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189218.662190:0:26173:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff9dc0755a4c00/0xcc1762b626f8bb24 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xcc1762b626f8bb2b expref: -99 pid: 66169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189218.662198:0:26173:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1784189218.662228:0:26173:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9dc0755a4c00/0xcc1762b626f8bb24 lrc: 1/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xcc1762b626f8bb2b expref: -99 pid: 66169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189218.662236:0:26173:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9dc0755a4c00/0xcc1762b626f8bb24 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xcc1762b626f8bb2b expref: -99 pid: 66169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189218.662257:0:26173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784189218.662259:0:26173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784189218.662261:0:26173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784189218.662269:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1784189218.662282:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc05f02e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1870854458150528:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1784189218.662473:0:66945:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc070223b80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:66945:1870854458150400:0@lo:104: 00010000:00010000:1.0:1784189218.662498:0:66945:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04152ca00/0xcc1762b626f8bb55 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784189218.662631:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784189218.662703:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458150528 00000100:00100000:1.0:1784189218.662709:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458150528 00010000:00010000:1.0:1784189218.662731:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0755a5000/0xcc1762b626f8bb2b lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000400000020 nid: 0@lo remote: 0xcc1762b626f8bb24 expref: 8 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784189218.662780:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2550 00000100:00100000:1.0:1784189218.662788:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc0477c2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0001-mdtlov_UUID+8:3640:x1870854458150528:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1784189218.662800:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000001:00080000:1.0:1784189218.665116:0:90949:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 111669149699 is committed 00010000:00010000:0.0:1784189218.665285:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0755a5000/0xcc1762b626f8bb2b lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 0@lo remote: 0xcc1762b626f8bb24 expref: 7 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189218.667447:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x8401ce4f (ffff9dc07fab4900) 00010000:00010000:0.0:1784189218.667635:0:6498:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04152ca00/0xcc1762b626f8bb55 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189218.667653:0:6498:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04152ca00/0xcc1762b626f8bb55 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189218.667663:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04152ca00/0xcc1762b626f8bb55 lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189218.667706:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784189218.668074:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc0477c2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0001-mdtlov_UUID+6:3640:x1870854458150528:12345-0@lo:103:ldlm_bl.0 Request processed in 5282us (5438us total) trans 0 rc 0/0 00000100:00100000:0.0:1784189218.668086:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2550 00000100:00100000:2.0:1784189218.668269:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc05f02e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1870854458150528:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1784189218.668540:0:66945:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04152ca00/0xcc1762b626f8bb55 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189218.668550:0:66945:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04152ca00/0xcc1762b626f8bb55 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784189218.668860:0:66945:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc070220380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:66945:1870854458150656:0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1784189218.668919:0:66945:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784189218.668957:0:66945:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dbf43c47cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1784189218.669012:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458150656 00000100:00100000:2.0:1784189218.669019:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458150656 00000100:00100000:2.0:1784189218.669110:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3833 00000100:00100000:2.0:1784189218.669119:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc070220e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:66945:x1870854458150656:12345-0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1784189218.669226:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc070220e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:66945:x1870854458150656:12345-0@lo:1000:mdt00_003.0 Request processed in 108us (307us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189218.669234:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3833 00000100:00100000:2.0:1784189218.671697:0:66945:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc070220380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:66945:1870854458150656:0@lo:1000:mdt00_003.0 00010000:00010000:2.0:1784189218.671795:0:66945:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4369d400/0xcc1762b626f8bb5c lrc: 3/1,0 mode: --/PR res: [0x240006991:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189218.671824:0:66945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4369d400/0xcc1762b626f8bb5c lrc: 3/1,0 mode: PR/PR res: [0x240006991:0xb:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189218.671838:0:66945:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4369d400/0xcc1762b626f8bb5c lrc: 3/1,0 mode: PR/PR res: [0x240006991:0xb:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1784189218.671872:0:66945:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4369d400/0xcc1762b626f8bb5c lrc: 3/1,0 mode: PR/PR res: [0x240006991:0xb:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189218.671891:0:66945:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04152ce00/0xcc1762b626f8bb4e lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189218.671897:0:66945:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04152ce00/0xcc1762b626f8bb4e lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189218.671911:0:66945:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04152ce00/0xcc1762b626f8bb4e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189218.671918:0:66945:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04152ce00/0xcc1762b626f8bb4e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189218.671925:0:66945:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc04152ce00 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:2.0:1784189218.671931:0:66945:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04152ce00/0xcc1762b626f8bb4e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189218.671940:0:66945:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04152ce00/0xcc1762b626f8bb4e lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189218.671955:0:66945:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9dc07fab4a00) 00010000:00010000:2.0:1784189218.671959:0:66945:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784189218.671965:0:66945:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04152ce00/0xcc1762b626f8bb4e lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189218.671972:0:66945:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04152ce00/0xcc1762b626f8bb4e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189218.671988:0:66945:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04152ca00/0xcc1762b626f8bb55 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189218.671994:0:66945:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04152ca00/0xcc1762b626f8bb55 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189218.672000:0:66945:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04152ca00/0xcc1762b626f8bb55 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189218.672005:0:66945:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc04152ca00 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:2.0:1784189218.672014:0:66945:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04152ca00/0xcc1762b626f8bb55 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189218.672021:0:66945:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04152ca00/0xcc1762b626f8bb55 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189218.672029:0:66945:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x8401ce4f (ffff9dc07fab4900) 00010000:00010000:2.0:1784189218.672031:0:66945:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784189218.672034:0:66945:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04152ca00/0xcc1762b626f8bb55 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189218.672040:0:66945:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04152ca00/0xcc1762b626f8bb55 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189218.672088:0:66945:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04152c800/0xcc1762b626f8bb47 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c3eaa expref: 11 pid: 66945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189218.672102:0:66945:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4369d400/0xcc1762b626f8bb5c lrc: 3/0,0 mode: PR/PR res: [0x240006991:0xb:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c3eaa expref: 10 pid: 66945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189218.672110:0:66945:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240006991:0xb:0x0].0x0 (ffff9dc04a2a5a00) 00010000:00010000:2.0:1784189218.672113:0:66945:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1784189218.672115:0:66945:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dbf4369d400, rc 0) 00000100:00100000:2.0:1784189218.672285:0:66945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf47545f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+10:70906:x1870854436288000:12345-192.168.203.12@tcp:101:lfs.0 Request processed in 10988us (11493us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189218.672294:0:66945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1291 00000100:00100000:0.0:1784189218.674901:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1784189218.675002:0:66169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436288128 00000100:00100000:1.0:1784189218.675014:0:66169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436288128 00000100:00100000:1.0:1784189218.675095:0:66169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1292 00000100:00100000:1.0:1784189218.675107:0:66169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc070223800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+8:70906:x1870854436288128:12345-192.168.203.12@tcp:101:lfs.0 00010000:00010000:1.0:1784189218.675139:0:66169:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784189218.675165:0:66169:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9dc0565e6a00/0xcc1762b626f8bb63 lrc: 2/0,0 mode: --/CR res: [0x240006991:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbfc5de7fe6c3eb1 expref: -99 pid: 66169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189218.675257:0:66169:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9dc0565e7c00/0xcc1762b626f8bb6a lrc: 3/1,0 mode: --/PR res: [0x240006991:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189218.675275:0:66169:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9dc0565e7c00/0xcc1762b626f8bb6a lrc: 3/1,0 mode: PR/PR res: [0x240006991:0xb:0x0].0x0 bits 0x10/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66169 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189218.675289:0:66169:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9dc0565e7c00/0xcc1762b626f8bb6a lrc: 3/1,0 mode: PR/PR res: [0x240006991:0xb:0x0].0x0 bits 0x10/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66169 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784189218.675572:0:66169:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240006991:0xb:0x0]: returning size 4096 00000004:00200000:1.0:1784189218.675585:0:66169:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00010000:00010000:1.0:1784189218.675636:0:66169:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9dc0565e6a00/0xcc1762b626f8bb63 lrc: 0/0,0 mode: --/CR res: [0x240006991:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c3eb1 expref: 10 pid: 66169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189218.675660:0:66169:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9dc0565e7c00/0xcc1762b626f8bb6a lrc: 3/0,0 mode: PR/PR res: [0x240006991:0xb:0x0].0x0 bits 0x10/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c3eb1 expref: 9 pid: 66169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189218.675679:0:66169:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240006991:0xb:0x0].0x0 (ffff9dc047db8300) 00010000:00010000:1.0:1784189218.675682:0:66169:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 10 00010000:00010000:1.0:1784189218.675687:0:66169:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc0565e7c00, rc 0) 00000100:00100000:1.0:1784189218.675764:0:66169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc070223800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+9:70906:x1870854436288128:12345-192.168.203.12@tcp:101:lfs.0 Request processed in 659us (878us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189218.675773:0:66169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1292 00000100:00100000:2.0:1784189218.683262:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1784189218.683348:0:66170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436288256 00000100:00100000:3.0:1784189218.683360:0:66170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436288256 00000100:00100000:3.0:1784189218.683438:0:66170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1293 00000100:00100000:3.0:1784189218.683451:0:66170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf470e3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+9:70906:x1870854436288256:12345-192.168.203.12@tcp:101:lfs.0 00010000:00010000:3.0:1784189218.683479:0:66170:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784189218.683507:0:66170:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9dc0755a4c00/0xcc1762b626f8bb71 lrc: 2/0,0 mode: --/CR res: [0x240006991:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbfc5de7fe6c3eb8 expref: -99 pid: 66170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189218.683596:0:66170:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9dc0755a4400/0xcc1762b626f8bb78 lrc: 3/1,0 mode: --/CR res: [0x240006991:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189218.683614:0:66170:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9dc0755a4400/0xcc1762b626f8bb78 lrc: 3/1,0 mode: CR/CR res: [0x240006991:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 66170 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189218.683648:0:66170:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9dc0755a4400/0xcc1762b626f8bb78 lrc: 3/1,0 mode: CR/CR res: [0x240006991:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 66170 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189218.683669:0:66170:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9dc0755a5200/0xcc1762b626f8bb7f lrc: 3/1,0 mode: --/PR res: [0x240006991:0xb:0x0].0xf7117594 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189218.683677:0:66170:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9dc0755a5200/0xcc1762b626f8bb7f lrc: 3/1,0 mode: PR/PR res: [0x240006991:0xb:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66170 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189218.683684:0:66170:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9dc0755a5200/0xcc1762b626f8bb7f lrc: 3/1,0 mode: PR/PR res: [0x240006991:0xb:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66170 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189218.683738:0:66170:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9dc0755a4400/0xcc1762b626f8bb78 lrc: 4/1,0 mode: CR/CR res: [0x240006991:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 66170 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189218.683746:0:66170:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9dc0755a4400/0xcc1762b626f8bb78 lrc: 4/1,0 mode: CR/CR res: [0x240006991:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 66170 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189218.683753:0:66170:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9dc0755a4400/0xcc1762b626f8bb78 lrc: 3/0,0 mode: CR/CR res: [0x240006991:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 66170 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189218.683761:0:66170:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9dc0755a4400/0xcc1762b626f8bb78 lrc: 4/0,0 mode: CR/CR res: [0x240006991:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 66170 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189218.683769:0:66170:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc0755a4400 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:3.0:1784189218.683774:0:66170:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9dc0755a4400/0xcc1762b626f8bb78 lrc: 4/0,0 mode: CR/CR res: [0x240006991:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 66170 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189218.683782:0:66170:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9dc0755a4400/0xcc1762b626f8bb78 lrc: 5/0,0 mode: CR/CR res: [0x240006991:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 66170 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189218.683796:0:66170:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240006991:0xb:0x0].0x0 (ffff9dc047db8300) 00010000:00010000:3.0:1784189218.683807:0:66170:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784189218.683824:0:66170:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9dc0755a4400/0xcc1762b626f8bb78 lrc: 3/0,0 mode: --/CR res: [0x240006991:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 66170 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189218.683831:0:66170:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9dc0755a4400/0xcc1762b626f8bb78 lrc: 0/0,0 mode: --/CR res: [0x240006991:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 66170 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189218.684112:0:66170:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9dc0755a5200/0xcc1762b626f8bb7f lrc: 3/1,0 mode: PR/PR res: [0x240006991:0xb:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66170 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189218.684119:0:66170:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9dc0755a5200/0xcc1762b626f8bb7f lrc: 2/0,0 mode: PR/PR res: [0x240006991:0xb:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66170 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189218.684124:0:66170:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9dc0755a5200/0xcc1762b626f8bb7f lrc: 3/0,0 mode: PR/PR res: [0x240006991:0xb:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66170 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189218.684129:0:66170:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc0755a5200 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:3.0:1784189218.684132:0:66170:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9dc0755a5200/0xcc1762b626f8bb7f lrc: 3/0,0 mode: PR/PR res: [0x240006991:0xb:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66170 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189218.684138:0:66170:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9dc0755a5200/0xcc1762b626f8bb7f lrc: 4/0,0 mode: PR/PR res: [0x240006991:0xb:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66170 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189218.684146:0:66170:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240006991:0xb:0x0].0xf7117594 (ffff9dc07fab4200) 00010000:00010000:3.0:1784189218.684148:0:66170:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784189218.684151:0:66170:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9dc0755a5200/0xcc1762b626f8bb7f lrc: 2/0,0 mode: --/PR res: [0x240006991:0xb:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66170 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189218.684157:0:66170:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9dc0755a5200/0xcc1762b626f8bb7f lrc: 0/0,0 mode: --/PR res: [0x240006991:0xb:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66170 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189218.684198:0:66170:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9dc0755a4c00/0xcc1762b626f8bb71 lrc: 1/0,0 mode: --/CR res: [0x240006991:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c3eb8 expref: 10 pid: 66170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189218.684217:0:66170:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240006991:0xb:0x0].0x0 (ffff9dc047db8300) 00010000:00010000:3.0:1784189218.684220:0:66170:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784189218.684224:0:66170:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9dc0755a4c00/0xcc1762b626f8bb71 lrc: 0/0,0 mode: --/CR res: [0x240006991:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c3eb8 expref: 10 pid: 66170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189218.684234:0:66170:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc0755a4c00, rc 0) 00000100:00100000:3.0:1784189218.684355:0:66170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf470e3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+9:70906:x1870854436288256:12345-192.168.203.12@tcp:101:lfs.0 Request processed in 906us (1173us total) trans 0 rc 301/301 00000100:00100000:3.0:1784189218.684366:0:66170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1293 00000100:00100000:2.0:1784189218.695979:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1784189218.696027:0:66945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436288384 00000100:00100000:2.0:1784189218.696040:0:66945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436288384 00000100:00100000:2.0:1784189218.696120:0:66945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1294 00000100:00100000:2.0:1784189218.696132:0:66945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf470e1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+9:70906:x1870854436288384:12345-192.168.203.12@tcp:101:lfs.0 00010000:00010000:2.0:1784189218.696158:0:66945:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784189218.696186:0:66945:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9dbf4369d600/0xcc1762b626f8bb86 lrc: 2/0,0 mode: --/CR res: [0x240006991:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbfc5de7fe6c3ebf expref: -99 pid: 66945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189218.696413:0:66945:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9dbf4369c200/0xcc1762b626f8bb8d lrc: 3/1,0 mode: --/CR res: [0x240006991:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189218.696549:0:66945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9dbf4369c200/0xcc1762b626f8bb8d lrc: 3/1,0 mode: CR/CR res: [0x240006991:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 66945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189218.696565:0:66945:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9dbf4369c200/0xcc1762b626f8bb8d lrc: 3/1,0 mode: CR/CR res: [0x240006991:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 66945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189218.696585:0:66945:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9dbf4369d800/0xcc1762b626f8bb94 lrc: 3/1,0 mode: --/PR res: [0x240006991:0xb:0x0].0xf7117594 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189218.696594:0:66945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9dbf4369d800/0xcc1762b626f8bb94 lrc: 3/1,0 mode: PR/PR res: [0x240006991:0xb:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189218.696601:0:66945:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9dbf4369d800/0xcc1762b626f8bb94 lrc: 3/1,0 mode: PR/PR res: [0x240006991:0xb:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189218.696661:0:66945:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9dbf4369c200/0xcc1762b626f8bb8d lrc: 4/1,0 mode: CR/CR res: [0x240006991:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 66945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189218.696668:0:66945:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9dbf4369c200/0xcc1762b626f8bb8d lrc: 4/1,0 mode: CR/CR res: [0x240006991:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 66945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189218.696673:0:66945:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9dbf4369c200/0xcc1762b626f8bb8d lrc: 3/0,0 mode: CR/CR res: [0x240006991:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 66945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189218.696693:0:66945:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9dbf4369c200/0xcc1762b626f8bb8d lrc: 4/0,0 mode: CR/CR res: [0x240006991:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 66945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189218.696699:0:66945:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dbf4369c200 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:2.0:1784189218.696704:0:66945:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9dbf4369c200/0xcc1762b626f8bb8d lrc: 4/0,0 mode: CR/CR res: [0x240006991:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 66945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189218.696712:0:66945:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9dbf4369c200/0xcc1762b626f8bb8d lrc: 5/0,0 mode: CR/CR res: [0x240006991:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 66945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189218.696725:0:66945:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240006991:0xb:0x0].0x0 (ffff9dc047db8300) 00010000:00010000:2.0:1784189218.696729:0:66945:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784189218.696734:0:66945:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9dbf4369c200/0xcc1762b626f8bb8d lrc: 3/0,0 mode: --/CR res: [0x240006991:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 66945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189218.696741:0:66945:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9dbf4369c200/0xcc1762b626f8bb8d lrc: 0/0,0 mode: --/CR res: [0x240006991:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 66945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189218.696752:0:66945:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9dbf4369d800/0xcc1762b626f8bb94 lrc: 3/1,0 mode: PR/PR res: [0x240006991:0xb:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189218.696758:0:66945:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9dbf4369d800/0xcc1762b626f8bb94 lrc: 2/0,0 mode: PR/PR res: [0x240006991:0xb:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189218.696763:0:66945:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9dbf4369d800/0xcc1762b626f8bb94 lrc: 3/0,0 mode: PR/PR res: [0x240006991:0xb:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189218.696768:0:66945:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dbf4369d800 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:2.0:1784189218.696770:0:66945:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9dbf4369d800/0xcc1762b626f8bb94 lrc: 3/0,0 mode: PR/PR res: [0x240006991:0xb:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189218.696785:0:66945:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9dbf4369d800/0xcc1762b626f8bb94 lrc: 4/0,0 mode: PR/PR res: [0x240006991:0xb:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189218.696793:0:66945:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240006991:0xb:0x0].0xf7117594 (ffff9dc04a2a5500) 00010000:00010000:2.0:1784189218.696795:0:66945:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784189218.696798:0:66945:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9dbf4369d800/0xcc1762b626f8bb94 lrc: 2/0,0 mode: --/PR res: [0x240006991:0xb:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189218.696804:0:66945:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9dbf4369d800/0xcc1762b626f8bb94 lrc: 0/0,0 mode: --/PR res: [0x240006991:0xb:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189218.697011:0:66945:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9dbf4369d600/0xcc1762b626f8bb86 lrc: 1/0,0 mode: --/CR res: [0x240006991:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c3ebf expref: 10 pid: 66945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189218.697023:0:66945:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240006991:0xb:0x0].0x0 (ffff9dc047db8300) 00010000:00010000:2.0:1784189218.697025:0:66945:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784189218.697028:0:66945:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9dbf4369d600/0xcc1762b626f8bb86 lrc: 0/0,0 mode: --/CR res: [0x240006991:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c3ebf expref: 10 pid: 66945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189218.697037:0:66945:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dbf4369d600, rc 0) 00000100:00100000:2.0:1784189218.697126:0:66945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf470e1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+9:70906:x1870854436288384:12345-192.168.203.12@tcp:101:lfs.0 Request processed in 997us (1160us total) trans 0 rc 301/301 00000100:00100000:2.0:1784189218.697134:0:66945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1294 00000100:00100000:1.0:1784189218.701615:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1784189218.701770:0:68287:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436288512 00000100:00100000:2.0:1784189218.701784:0:68287:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436288512 00000100:00100000:2.0:1784189218.701869:0:68287:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1295 00000100:00100000:2.0:1784189218.701881:0:68287:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf4a32ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+9:70906:x1870854436288512:12345-192.168.203.12@tcp:101:lfs.0 00010000:00010000:2.0:1784189218.701914:0:68287:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784189218.701942:0:68287:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9dbf4369d600/0xcc1762b626f8bb9b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbfc5de7fe6c3ec6 expref: -99 pid: 68287 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189218.702037:0:68287:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9dbf4369d800/0xcc1762b626f8bba2 lrc: 3/1,0 mode: --/PR res: [0x240006991:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189218.702053:0:68287:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9dbf4369d800/0xcc1762b626f8bba2 lrc: 3/1,0 mode: PR/PR res: [0x240006991:0xb:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 68287 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189218.702066:0:68287:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9dbf4369d800/0xcc1762b626f8bba2 lrc: 3/1,0 mode: PR/PR res: [0x240006991:0xb:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 68287 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784189218.702124:0:68287:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240006991:0xb:0x0]: returning size 4096 00000004:00200000:2.0:1784189218.702129:0:68287:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1784189218.702150:0:68287:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff9dbf4369d800/0xcc1762b626f8bba2 lrc: 3/1,0 mode: PR/PR res: [0x240006991:0xb:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 68287 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189218.702181:0:68287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9dbf4369d600/0xcc1762b626f8bb9b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c3ec6 expref: 11 pid: 68287 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189218.702202:0:68287:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9dbf4369d800/0xcc1762b626f8bba2 lrc: 3/0,0 mode: PR/PR res: [0x240006991:0xb:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c3ec6 expref: 10 pid: 68287 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189218.702211:0:68287:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240006991:0xb:0x0].0x0 (ffff9dc047db8300) 00010000:00010000:2.0:1784189218.702214:0:68287:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1784189218.702218:0:68287:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dbf4369d800, rc 0) 00000100:00100000:1.0:1784189218.702690:0:68287:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf4a32ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+10:70906:x1870854436288512:12345-192.168.203.12@tcp:101:lfs.0 Request processed in 807us (1085us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189218.702701:0:68287:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1295 00000100:00100000:0.0:1784189218.708679:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1784189218.708897:0:66170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436288768 00000100:00100000:3.0:1784189218.708911:0:66170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436288768 00000100:00100000:3.0:1784189218.708980:0:66170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1296 00000100:00100000:3.0:1784189218.708990:0:66170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc070222a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+10:70906:x1870854436288768:12345-192.168.203.12@tcp:101:lfs.0 00010000:00010000:3.0:1784189218.709015:0:66170:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784189218.709043:0:66170:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9dc0755a4c00/0xcc1762b626f8bba9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbfc5de7fe6c3ecd expref: -99 pid: 66170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784189218.709182:0:66170:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240006991:0xb:0x0]: returning size 4096 00010000:00010000:3.0:1784189218.709304:0:66170:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9dc0755a4c00/0xcc1762b626f8bba9 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c3ecd expref: 12 pid: 66170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189218.709609:0:66170:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9dc07fab4200) 00010000:00010000:3.0:1784189218.709613:0:66170:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1784189218.709620:0:66170:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9dc0755a4c00/0xcc1762b626f8bba9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c3ecd expref: 12 pid: 66170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189218.709662:0:66170:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc0755a4c00, rc 0) 00000100:00100000:3.0:1784189218.709781:0:66170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc070222a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+11:70906:x1870854436288768:12345-192.168.203.12@tcp:101:lfs.0 Request processed in 791us (1114us total) trans 81604378736 rc 301/301 00000100:00100000:3.0:1784189218.709790:0:66170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1296 00000100:00100000:2.0:1784189218.717762:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1784189218.718514:0:66169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436289024 00000100:00100000:3.0:1784189218.718529:0:66169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436289024 00000100:00100000:3.0:1784189218.718684:0:66169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1297 00000100:00100000:3.0:1784189218.718699:0:66169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf470e1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+11:70906:x1870854436289024:12345-192.168.203.12@tcp:36:lfs.0 00010000:00010000:3.0:1784189218.718785:0:66169:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784189218.718833:0:66169:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9dbf4369d800/0xcc1762b626f8bba2 lrc: 0/0,0 mode: --/PR res: [0x240006991:0xb:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c3ec6 expref: 11 pid: 68287 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189218.718853:0:66169:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240006991:0xb:0x0].0x0 (ffff9dc047db8300) 00010000:00010000:3.0:1784189218.718860:0:66169:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1784189218.719094:0:66169:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9dc0755a5200/0xcc1762b626f8bbb7 lrc: 3/0,1 mode: --/CW res: [0x240006991:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189218.719116:0:66169:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9dc0755a5200/0xcc1762b626f8bbb7 lrc: 3/0,1 mode: CW/CW res: [0x240006991:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66169 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189218.719130:0:66169:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9dc0755a5200/0xcc1762b626f8bbb7 lrc: 3/0,1 mode: CW/CW res: [0x240006991:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66169 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189218.719155:0:66169:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9dc0755a4400/0xcc1762b626f8bbbe lrc: 3/0,1 mode: --/PW res: [0x240006991:0xb:0x0].0xf7117594 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189218.719163:0:66169:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9dc0755a4400/0xcc1762b626f8bbbe lrc: 3/0,1 mode: PW/PW res: [0x240006991:0xb:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66169 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189218.719179:0:66169:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9dc0755a4400/0xcc1762b626f8bbbe lrc: 3/0,1 mode: PW/PW res: [0x240006991:0xb:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66169 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189218.720691:0:66169:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9dc0755a5a00/0xcc1762b626f8bbc5 lrc: 3/0,1 mode: --/PW res: [0x240006991:0xc:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189218.720712:0:66169:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9dc0755a5a00/0xcc1762b626f8bbc5 lrc: 3/0,1 mode: PW/PW res: [0x240006991:0xc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66169 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189218.720723:0:66169:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9dc0755a5a00/0xcc1762b626f8bbc5 lrc: 3/0,1 mode: PW/PW res: [0x240006991:0xc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66169 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1784189218.720741:0:66169:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000082023429 reply state 00000000300596df transno 81604378737 ns: mdt-lustre-MDT0001_UUID lock: ffff9dc0755a5a00/0xcc1762b626f8bbc5 lrc: 3/0,1 mode: PW/PW res: [0x240006991:0xc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66169 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189218.720754:0:66169:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9dc0755a5a00/0xcc1762b626f8bbc5 lrc: 3/0,1 mode: TXN/TXN res: [0x240006991:0xc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66169 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189218.720762:0:66169:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240006991:0xc:0x0].0x0 (ffff9dc07fab4400) 00010000:00010000:3.0:1784189218.720765:0:66169:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1784189218.720768:0:66169:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1784189218.720775:0:66169:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240006991:0xc:0x0]: returning size 4096 00010000:00010000:3.0:1784189218.720785:0:66169:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9dc0755a5200/0xcc1762b626f8bbb7 lrc: 4/0,1 mode: CW/CW res: [0x240006991:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66169 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189218.720793:0:66169:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9dc0755a5200/0xcc1762b626f8bbb7 lrc: 4/0,1 mode: CW/CW res: [0x240006991:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66169 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189218.720800:0:66169:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9dc0755a5200/0xcc1762b626f8bbb7 lrc: 3/0,0 mode: CW/CW res: [0x240006991:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66169 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189218.720807:0:66169:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9dc0755a5200/0xcc1762b626f8bbb7 lrc: 4/0,0 mode: CW/CW res: [0x240006991:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66169 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189218.720832:0:66169:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc0755a5200 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:3.0:1784189218.720837:0:66169:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9dc0755a5200/0xcc1762b626f8bbb7 lrc: 4/0,0 mode: CW/CW res: [0x240006991:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66169 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189218.720854:0:66169:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9dc0755a5200/0xcc1762b626f8bbb7 lrc: 5/0,0 mode: CW/CW res: [0x240006991:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66169 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189218.720867:0:66169:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240006991:0xb:0x0].0x0 (ffff9dc047db8300) 00010000:00010000:3.0:1784189218.720870:0:66169:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784189218.720876:0:66169:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9dc0755a5200/0xcc1762b626f8bbb7 lrc: 3/0,0 mode: --/CW res: [0x240006991:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66169 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189218.720883:0:66169:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9dc0755a5200/0xcc1762b626f8bbb7 lrc: 0/0,0 mode: --/CW res: [0x240006991:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66169 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1784189218.720908:0:66169:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000082023429 reply state 00000000300596df transno 81604378737 ns: mdt-lustre-MDT0001_UUID lock: ffff9dc0755a4400/0xcc1762b626f8bbbe lrc: 3/0,1 mode: PW/PW res: [0x240006991:0xb:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66169 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189218.720917:0:66169:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9dc0755a4400/0xcc1762b626f8bbbe lrc: 3/0,1 mode: TXN/TXN res: [0x240006991:0xb:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66169 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189218.721279:0:66169:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240006991:0xb:0x0].0xf7117594 (ffff9dc07fab4800) 00010000:00010000:3.0:1784189218.721284:0:66169:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1784189218.721287:0:66169:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:3.0:1784189218.721765:0:66169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf470e1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+12:70906:x1870854436289024:12345-192.168.203.12@tcp:36:lfs.0 Request processed in 3063us (4010us total) trans 81604378737 rc 0/0 00000100:00100000:3.0:1784189218.721776:0:66169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1297 00000100:00100000:2.0:1784189218.728362:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1784189218.730948:0:66173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436289280 00000100:00100000:3.0:1784189218.730973:0:66173:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436289280 00000100:00100000:3.0:1784189218.731060:0:66173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 230 00000100:00100000:3.0:1784189218.731097:0:66173:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf470e3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+12:70906:x1870854436289280:12345-192.168.203.12@tcp:35:lfs.0 00000100:00100000:3.0:1784189218.731455:0:66173:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf470e3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+13:70906:x1870854436289280:12345-192.168.203.12@tcp:35:lfs.0 Request processed in 363us (3104us total) trans 81604378738 rc 0/0 00000100:00100000:3.0:1784189218.731465:0:66173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 230 00000100:00100000:2.0:1784189218.786399:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1784189218.786524:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436289408 00000100:00100000:3.0:1784189218.786539:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436289408 00000100:00100000:0.0:1784189218.786704:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 700 00000100:00100000:0.0:1784189218.786844:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf470e0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9957a2dc-fd88-4a91-bca3-e2b7f365ab0c+10:2397:x1870854436289408:12345-192.168.203.12@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1784189218.786866:0:6499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784189218.786893:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dc05ec0ee00/0xcc1762b626f8b69a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c3e6b expref: 10 pid: 90956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189218.787007:0:6499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784189218.787081:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf470e0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9957a2dc-fd88-4a91-bca3-e2b7f365ab0c+9:2397:x1870854436289408:12345-192.168.203.12@tcp:103:ldlm_bl.0 Request processed in 244us (695us total) trans 0 rc 0/0 00000100:00100000:0.0:1784189218.787090:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 700 00000100:00100000:2.0:1784189218.787894:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1784189218.787986:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1784189218.789883:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1784189218.790136:0:26172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436289920 00000100:00100000:3.0:1784189218.790151:0:26172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436289920 00000100:00100000:3.0:1784189218.790232:0:26172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436290048 00000100:00100000:3.0:1784189218.790237:0:26172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436290048 00000100:00100000:3.0:1784189218.790282:0:26172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 701 00000100:00100000:3.0:1784189218.790294:0:26172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc05f02e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:9957a2dc-fd88-4a91-bca3-e2b7f365ab0c+10:2399:x1870854436289920:12345-192.168.203.12@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1784189218.790315:0:26172:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784189218.790360:0:26172:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dc04a20a400/0xcc1762b626f8b88b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c3e80 expref: 10 pid: 90956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189218.790383:0:26172:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784189218.790449:0:26172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc05f02e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:9957a2dc-fd88-4a91-bca3-e2b7f365ab0c+9:2399:x1870854436289920:12345-192.168.203.12@tcp:103:ldlm_bl.0 Request processed in 156us (2557us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189218.790458:0:26172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 701 00000100:00100000:3.0:1784189218.790479:0:26172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 702 00000100:00100000:3.0:1784189218.790487:0:26172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc0711a7050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:9957a2dc-fd88-4a91-bca3-e2b7f365ab0c+8:2396:x1870854436290048:12345-192.168.203.12@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1784189218.790496:0:26172:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784189218.790506:0:26172:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dc05ec0f000/0xcc1762b626f8b6a1 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c3e72 expref: 8 pid: 90955 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189218.790517:0:26172:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784189218.790546:0:26172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc0711a7050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:9957a2dc-fd88-4a91-bca3-e2b7f365ab0c+7:2396:x1870854436290048:12345-192.168.203.12@tcp:103:ldlm_bl.0 Request processed in 59us (2560us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189218.790553:0:26172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 702 00000100:00100000:1.0:1784189218.791727:0:26168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436289792 00000100:00100000:1.0:1784189218.791740:0:26168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436289792 00000100:00100000:2.0:1784189218.791990:0:26223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 4965 00000100:00100000:2.0:1784189218.792002:0:26223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc07b7e0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+7:2395:x1870854436289792:12345-192.168.203.12@tcp:9:umount.0 00000020:00000080:2.0:1784189218.792040:0:26223:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xcc1762b626f8b4a9 00000020:00010000:2.0:1784189218.792050:0:26223:0:(genops.c:1942:obd_stale_export_put()) Put export ffff9dbf42275000: total 0 00000100:00080000:2.0:1784189218.792056:0:26223:0:(import.c:65:import_set_state_nolock()) ffff9dbf42276800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1784189218.792129:0:26223:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294968956 00000100:00100000:2.0:1784189218.792435:0:26223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc07b7e0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+5:2395:x1870854436289792:12345-192.168.203.12@tcp:9:umount.0 Request processed in 434us (2563us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189218.792445:0:26223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 4965 00000020:00010000:0.0:1784189218.792730:0:6501:0:(genops.c:1928:obd_stale_export_get()) Get export ffff9dbf42275000: total 0 00010000:00010000:0.0:1784189218.792782:0:6501:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff9dbf42275000, canceled 0 locks, left on hash table 2. 00010000:00010000:0.0:1784189218.792860:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000090219bd6/0xcc1762b626f8b5eb lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x702:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c3e3a expref: 4 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189218.793045:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e88c95bf/0xcc1762b626f8b5f9 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x703:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c3e48 expref: 3 pid: 26165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189218.793065:0:6501:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff9dbf42275000, canceled 2 locks, left on hash table 0. 00010000:00010000:0.0:1784189218.793081:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784189218.793084:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784189218.793086:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1784189218.793503:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1784189218.806553:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1784189218.807745:0:26171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436290304 00000100:00100000:1.0:1784189218.807762:0:26171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436290304 00000100:00100000:1.0:1784189218.807870:0:26171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 4966 00000100:00100000:1.0:1784189218.807883:0:26171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc081cd3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+6:2395:x1870854436290304:12345-192.168.203.12@tcp:9:umount.0 00000020:00000080:1.0:1784189218.807925:0:26171:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xcc1762b626f8b4a2 00000020:00010000:1.0:1784189218.807947:0:26171:0:(genops.c:1942:obd_stale_export_put()) Put export ffff9dc075656800: total 0 00000100:00080000:1.0:1784189218.807953:0:26171:0:(import.c:65:import_set_state_nolock()) ffff9dc075654800 : changing import state from FULL to CLOSED 00000100:00080000:0.0:1784189218.807995:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00000004:1.0:1784189218.808020:0:26171:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294968953 00000020:00010000:3.0:1784189218.808068:0:6502:0:(genops.c:1928:obd_stale_export_get()) Get export ffff9dc075656800: total 0 00010000:00010000:3.0:1784189218.808126:0:6502:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff9dc075656800, canceled 0 locks, left on hash table 1. 00002000:00010000:3.0:1784189218.808166:0:6502:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x702:0x0] updating lvb size from disk: 1048576 -> 2097152 00002000:00010000:3.0:1784189218.808169:0:6502:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x702:0x0] updating lvb atime from disk: 0 -> 1784189159 00002000:00010000:3.0:1784189218.808172:0:6502:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x702:0x0] updating lvb blocks from disk: 0 -> 2048 00010000:00010000:3.0:1784189218.808212:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000b6eacba/0xcc1762b626f8b5f2 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x702:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c3e41 expref: 4 pid: 26163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784189218.808233:0:26171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc081cd3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+3:2395:x1870854436290304:12345-192.168.203.12@tcp:9:umount.0 Request processed in 352us (1695us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189218.808241:0:26171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 4966 00010000:00010000:3.0:1784189218.808245:0:6502:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff9dc075656800, canceled 1 locks, left on hash table 0. 00010000:00010000:3.0:1784189218.808259:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784189218.808261:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784189218.808264:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784189218.822965:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1784189218.823446:0:68287:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436290816 00000100:00100000:1.0:1784189218.823460:0:68287:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436290816 00000100:00100000:1.0:1784189218.823650:0:68287:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1298 00000100:00100000:1.0:1784189218.823681:0:68287:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc07b7e1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+10:2395:x1870854436290816:12345-192.168.203.12@tcp:39:umount.0 00000020:00000080:1.0:1784189218.823758:0:68287:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xcc1762b626f8b711 00000020:00010000:1.0:1784189218.823778:0:68287:0:(genops.c:1942:obd_stale_export_put()) Put export ffff9dc075657000: total 0 00000100:00080000:1.0:1784189218.823784:0:68287:0:(import.c:65:import_set_state_nolock()) ffff9dbf43d8c800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1784189218.823836:0:68287:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 26, last_transno is 111669149699 00000020:00010000:3.0:1784189218.823853:0:7454:0:(genops.c:1928:obd_stale_export_get()) Get export ffff9dc075657000: total 0 00010000:00010000:3.0:1784189218.823929:0:7454:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff9dc075657000, canceled 0 locks, left on hash table 4. 00010000:00010000:3.0:1784189218.823969:0:7454:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x9:0x0].0x0 (ffff9dbf45994c00) 00010000:00010000:3.0:1784189218.823973:0:7454:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1784189218.823983:0:7454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04152d200/0xcc1762b626f8bb08 lrc: 0/0,0 mode: --/PR res: [0x20000a811:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c3e9c expref: 8 pid: 66169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189218.824010:0:7454:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240006991:0xb:0x0].0x0 (ffff9dc04a2a5a00) 00010000:00010000:3.0:1784189218.824012:0:7454:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1784189218.824015:0:7454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4369d400/0xcc1762b626f8bb5c lrc: 0/0,0 mode: --/PR res: [0x240006991:0xb:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c3eaa expref: 7 pid: 66945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189218.824035:0:7454:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9dc07fab4a00) 00010000:00010000:3.0:1784189218.824044:0:7454:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1784189218.824049:0:7454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0755a4800/0xcc1762b626f8bb40 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c3ea3 expref: 6 pid: 68287 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784189218.824056:0:68287:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc07b7e1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+6:2395:x1870854436290816:12345-192.168.203.12@tcp:39:umount.0 Request processed in 379us (1107us total) trans 111669149700 rc 0/0 00000100:00100000:1.0:1784189218.824064:0:68287:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1298 00010000:00010000:3.0:1784189218.824070:0:7454:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x9:0x0].0x0 (ffff9dbf45994c00) 00010000:00010000:3.0:1784189218.824072:0:7454:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:3.0:1784189218.824075:0:7454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc058f67e00/0xcc1762b626f8b8df lrc: 0/0,0 mode: --/CR res: [0x20000a811:0x9:0x0].0x0 bits 0xa/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c3e33 expref: 5 pid: 90981 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189218.824305:0:7454:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff9dc075657000, canceled 4 locks, left on hash table 0. 00010000:00010000:3.0:1784189218.824378:0:7454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784189218.824381:0:7454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784189218.824382:0:7454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784189218.833996:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1784189218.834179:0:66170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436291072 00000100:00100000:3.0:1784189218.834190:0:66170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436291072 00000100:00100000:3.0:1784189218.834270:0:66170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1299 00000100:00100000:3.0:1784189218.834282:0:66170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc070221500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+13:2395:x1870854436291072:12345-192.168.203.12@tcp:39:umount.0 00000020:00000080:3.0:1784189218.834363:0:66170:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xcc1762b626f86468 00000020:00010000:3.0:1784189218.834380:0:66170:0:(genops.c:1942:obd_stale_export_put()) Put export ffff9dc04ffb1800: total 0 00000100:00080000:3.0:1784189218.834385:0:66170:0:(import.c:65:import_set_state_nolock()) ffff9dc06bb5d000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1784189218.834430:0:66170:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 19, last_transno is 81604378738 00000100:00100000:3.0:1784189218.834619:0:66170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc070221500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b90fcc1c-0e69-42a4-a116-a71fec7aeb78+11:2395:x1870854436291072:12345-192.168.203.12@tcp:39:umount.0 Request processed in 339us (637us total) trans 81604378739 rc 0/0 00000100:00100000:3.0:1784189218.834628:0:66170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1299 00010000:00010000:3.0:1784189218.834664:0:3626:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9dc0755a4400/0xcc1762b626f8bbbe lrc: 3/0,1 mode: TXN/TXN res: [0x240006991:0xb:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66169 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189218.834675:0:3626:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9dc0755a4400/0xcc1762b626f8bbbe lrc: 2/0,0 mode: TXN/TXN res: [0x240006991:0xb:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66169 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189218.834704:0:3626:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9dc0755a4400/0xcc1762b626f8bbbe lrc: 3/0,0 mode: TXN/TXN res: [0x240006991:0xb:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66169 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189218.834711:0:3626:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc0755a4400 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:3.0:1784189218.834716:0:3626:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9dc0755a4400/0xcc1762b626f8bbbe lrc: 3/0,0 mode: TXN/TXN res: [0x240006991:0xb:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66169 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189218.834725:0:3626:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9dc0755a4400/0xcc1762b626f8bbbe lrc: 4/0,0 mode: TXN/TXN res: [0x240006991:0xb:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66169 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189218.834745:0:3626:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240006991:0xb:0x0].0xf7117594 (ffff9dc07fab4800) 00010000:00010000:3.0:1784189218.834749:0:3626:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784189218.834755:0:3626:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9dc0755a4400/0xcc1762b626f8bbbe lrc: 2/0,0 mode: --/TXN res: [0x240006991:0xb:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66169 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189218.834762:0:3626:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9dc0755a4400/0xcc1762b626f8bbbe lrc: 0/0,0 mode: --/TXN res: [0x240006991:0xb:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66169 initiator: MDT1 lru_score: 0 lru_type: 0 00000020:00010000:1.0:1784189218.834779:0:26173:0:(genops.c:1928:obd_stale_export_get()) Get export ffff9dc04ffb1800: total 0 00010000:00010000:1.0:1784189218.834785:0:26173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784189218.834789:0:3626:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9dc0755a5a00/0xcc1762b626f8bbc5 lrc: 3/0,1 mode: TXN/TXN res: [0x240006991:0xc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66169 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189218.834860:0:26173:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff9dc04ffb1800, canceled 0 locks, left on hash table 1. 00010000:00010000:1.0:1784189218.835006:0:26173:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240006991:0xb:0x0].0x0 (ffff9dc047db8300) 00010000:00010000:1.0:1784189218.835010:0:26173:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 10 00010000:00010000:1.0:1784189218.835017:0:26173:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9dc0565e7c00/0xcc1762b626f8bb6a lrc: 0/0,0 mode: --/PR res: [0x240006991:0xb:0x0].0x0 bits 0x10/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c3eb1 expref: 10 pid: 66169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189218.835033:0:26173:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff9dc04ffb1800, canceled 1 locks, left on hash table 0. 00010000:00010000:1.0:1784189218.835049:0:26173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784189218.835052:0:26173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784189218.835054:0:26173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784189218.835059:0:3627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9dc04152c200/0xcc1762b626f8bb32 lrc: 3/0,1 mode: TXN/TXN res: [0x240006991:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66169 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189218.835068:0:3627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9dc04152c200/0xcc1762b626f8bb32 lrc: 2/0,0 mode: TXN/TXN res: [0x240006991:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66169 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189218.835074:0:3627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9dc04152c200/0xcc1762b626f8bb32 lrc: 3/0,0 mode: TXN/TXN res: [0x240006991:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66169 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189218.835079:0:3627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc04152c200 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:2.0:1784189218.835082:0:3627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9dc04152c200/0xcc1762b626f8bb32 lrc: 3/0,0 mode: TXN/TXN res: [0x240006991:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66169 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189218.835088:0:3627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9dc04152c200/0xcc1762b626f8bb32 lrc: 4/0,0 mode: TXN/TXN res: [0x240006991:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66169 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189218.835108:0:3627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240006991:0xb:0x0].0x0 (ffff9dc047db8300) 00010000:00010000:2.0:1784189218.835110:0:3627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784189218.835114:0:3627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9dc04152c200/0xcc1762b626f8bb32 lrc: 2/0,0 mode: --/TXN res: [0x240006991:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66169 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189218.835120:0:3627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9dc04152c200/0xcc1762b626f8bb32 lrc: 0/0,0 mode: --/TXN res: [0x240006991:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66169 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189218.835178:0:3626:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9dc0755a5a00/0xcc1762b626f8bbc5 lrc: 2/0,0 mode: TXN/TXN res: [0x240006991:0xc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66169 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189218.835184:0:3626:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9dc0755a5a00/0xcc1762b626f8bbc5 lrc: 3/0,0 mode: TXN/TXN res: [0x240006991:0xc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66169 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189218.835189:0:3626:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc0755a5a00 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:3.0:1784189218.835192:0:3626:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9dc0755a5a00/0xcc1762b626f8bbc5 lrc: 3/0,0 mode: TXN/TXN res: [0x240006991:0xc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66169 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189218.835207:0:3626:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9dc0755a5a00/0xcc1762b626f8bbc5 lrc: 4/0,0 mode: TXN/TXN res: [0x240006991:0xc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66169 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189218.835216:0:3626:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240006991:0xc:0x0].0x0 (ffff9dc07fab4400) 00010000:00010000:3.0:1784189218.835219:0:3626:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784189218.835221:0:3626:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9dc0755a5a00/0xcc1762b626f8bbc5 lrc: 2/0,0 mode: --/TXN res: [0x240006991:0xc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66169 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189218.835227:0:3626:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9dc0755a5a00/0xcc1762b626f8bbc5 lrc: 0/0,0 mode: --/TXN res: [0x240006991:0xc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66169 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784189218.884444:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1784189218.884572:0:90956:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436291328 00000100:00100000:3.0:1784189218.884587:0:90956:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436291328 00000100:00100000:3.0:1784189218.884686:0:90956:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 83 00000100:00100000:3.0:1784189218.884701:0:90956:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc07037c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9957a2dc-fd88-4a91-bca3-e2b7f365ab0c+7:2395:x1870854436291328:12345-192.168.203.12@tcp:251:umount.0 00000020:00000080:3.0:1784189218.884776:0:90956:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xcc1762b626f8b68c 00000020:00010000:3.0:1784189218.884788:0:90956:0:(genops.c:1942:obd_stale_export_put()) Put export ffff9dc05ed22000: total 0 00000100:00080000:3.0:1784189218.884795:0:90956:0:(import.c:65:import_set_state_nolock()) ffff9dc05ed23800 : changing import state from FULL to CLOSED 00000100:00100000:3.0:1784189218.884907:0:90956:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc07037c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9957a2dc-fd88-4a91-bca3-e2b7f365ab0c+3:2395:x1870854436291328:12345-192.168.203.12@tcp:251:umount.0 Request processed in 201us (473us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189218.884918:0:90956:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 83 00000020:00010000:1.0:1784189218.885793:0:6501:0:(genops.c:1928:obd_stale_export_get()) Get export ffff9dc05ed22000: total 0 00010000:00010000:1.0:1784189218.885892:0:6501:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff9dc05ed22000, canceled 0 locks, left on hash table 1. 00010000:00010000:1.0:1784189218.885952:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dc04a20aa00/0xcc1762b626f8b6a8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c3e79 expref: 2 pid: 90955 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189218.885975:0:6501:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff9dc05ed22000, canceled 1 locks, left on hash table 0. 00000020:00000080:1.0:1784189218.885986:0:6501:0:(genops.c:906:class_export_put()) final put ffff9dc05ed22000/9957a2dc-fd88-4a91-bca3-e2b7f365ab0c 00010000:00010000:1.0:1784189218.886004:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784189218.886021:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784189218.886023:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1784189218.886218:0:89010:0:(genops.c:865:class_export_destroy()) destroying export ffff9dc05ed22000/9957a2dc-fd88-4a91-bca3-e2b7f365ab0c for MGS 00000020:00000080:3.0:1784189218.886285:0:89010:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9dc05ed23800 for MGS 00010000:00010000:2.0:1784189219.570048:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784189219.887496:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1784189219.887528:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc070220380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1870854458150784:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1784189219.887622:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784189219.887684:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458150784 00000100:00100000:0.0:1784189219.887693:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458150784 00000100:00100000:0.0:1784189219.887761:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3834 00000100:00100000:0.0:1784189219.887772:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc070223b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3643:x1870854458150784:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1784189219.887845:0:8438:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1445568512 avail 1299329024 00000100:00100000:0.0:1784189219.887912:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc070223b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3643:x1870854458150784:12345-0@lo:41:osp-pre-1-0.0 Request processed in 142us (291us total) trans 0 rc 0/0 00000100:00100000:0.0:1784189219.887921:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3834 00000100:00100000:2.0:1784189219.888035:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc070220380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1870854458150784:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1784189219.889837:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1784189219.889863:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc07b7e1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1870854458150912:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1784189219.890042:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784189219.890274:0:26492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458150912 00000100:00100000:2.0:1784189219.890283:0:26492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458150912 00000100:00100000:2.0:1784189219.890368:0:26492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3835 00000100:00100000:2.0:1784189219.890380:0:26492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc0477c2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3642:x1870854458150912:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1784189219.890427:0:26492:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1445277696 avail 1299038208 00000100:00100000:2.0:1784189219.890490:0:26492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc0477c2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3642:x1870854458150912:12345-0@lo:41:osp-pre-0-1.0 Request processed in 113us (448us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189219.890498:0:26492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3835 00000100:00100000:2.0:1784189219.890597:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc07faaa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bd553d0d-03e2-4233-b06b-b55bbfa2b954:3640:1870854458151040:0@lo:400:kworker.0 00000100:00100000:2.0:1784189219.890637:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784189219.892652:0:3642:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 111669149699 gen 3 00000004:00080000:1.0:1784189219.892667:0:3642:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 111669149699 committed transno 111669149699 00000100:00100000:1.0:1784189219.892719:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc07b7e1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1870854458150912:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1784189219.892728:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1784189219.892744:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc07faab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3640:1870854458151168:0@lo:400:kworker.0 00000100:00100000:2.0:1784189219.892828:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784189219.892903:0:90954:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458151040 00000100:00100000:2.0:1784189219.892911:0:90954:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458151040 00000100:00100000:2.0:1784189219.892965:0:90954:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1784189219.892974:0:90954:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc049311850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd553d0d-03e2-4233-b06b-b55bbfa2b954+24:3640:x1870854458151040:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784189219.893067:0:66169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458151168 00000100:00100000:1.0:1784189219.893072:0:66169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458151168 00000100:00100000:1.0:1784189219.893124:0:66169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1222 00000100:00100000:1.0:1784189219.893132:0:66169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc07b7e3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1870854458151168:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784189219.893175:0:66169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc07b7e3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1870854458151168:12345-0@lo:400:kworker.0 Request processed in 44us (348us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189219.893183:0:66169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1222 00000100:00080000:1.0:1784189219.893710:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1784189219.893774:0:90954:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc049311850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd553d0d-03e2-4233-b06b-b55bbfa2b954+24:3640:x1870854458151040:12345-0@lo:400:kworker.0 Request processed in 80us (2416us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189219.893783:0:90954:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1784189219.893870:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc07faab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3640:1870854458151168:0@lo:400:kworker.0 00000100:00100000:2.0:1784189219.893884:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc07faaa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bd553d0d-03e2-4233-b06b-b55bbfa2b954:3640:1870854458151040:0@lo:400:kworker.0 00000100:00100000:3.0:1784189219.896338:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc07faa8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3643:1870854458151424:0@lo:400:kworker.0 00000100:00100000:3.0:1784189219.896458:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784189219.896498:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc07faaad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3643:1870854458151936:0@lo:400:kworker.0 00000100:00100000:3.0:1784189219.896521:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784189219.896545:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:3.0:1784189219.896551:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc07faa9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3643:1870854458151296:0@lo:400:kworker.0 00000100:00100000:3.0:1784189219.896575:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784189219.896593:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc07faa9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1870854458151808:0@lo:400:kworker.0 00000100:00100000:3.0:1784189219.896620:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784189219.896639:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc07faab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3643:1870854458152320:0@lo:400:kworker.0 00000100:00100000:3.0:1784189219.896661:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784189219.896694:0:68287:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458151424 00000100:00100000:3.0:1784189219.896703:0:68287:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458151424 00000100:00100000:3.0:1784189219.896772:0:68287:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458151936 00000100:00100000:3.0:1784189219.896776:0:68287:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458151936 00000100:00100000:3.0:1784189219.896790:0:68287:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458151296 00000100:00100000:3.0:1784189219.896792:0:68287:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458151296 00000100:00100000:3.0:1784189219.896819:0:68287:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458152320 00000100:00100000:3.0:1784189219.896822:0:68287:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458152320 00000100:00100000:3.0:1784189219.896837:0:68287:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1223 00000100:00100000:3.0:1784189219.896846:0:68287:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc07faaa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1870854458151424:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784189219.897084:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc07faa8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1870854458151680:0@lo:400:kworker.0 00000100:00100000:2.0:1784189219.897118:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784189219.897141:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc07faa8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1870854458152192:0@lo:400:kworker.0 00000100:00100000:2.0:1784189219.897162:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784189219.897182:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1784189219.897188:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc07faa9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3641:1870854458151552:0@lo:400:kworker.0 00000100:00100000:2.0:1784189219.897208:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784189219.897219:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc07faa9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1870854458152064:0@lo:400:kworker.0 00000100:00100000:2.0:1784189219.897236:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784189219.897264:0:26164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458151808 00000100:00100000:2.0:1784189219.897268:0:26164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458151808 00000100:00100000:2.0:1784189219.897300:0:26164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458151680 00000100:00100000:2.0:1784189219.897303:0:26164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458151680 00000100:00100000:2.0:1784189219.897342:0:26164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458152192 00000100:00100000:2.0:1784189219.897345:0:26164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458152192 00000100:00100000:2.0:1784189219.897366:0:26164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458152064 00000100:00100000:2.0:1784189219.897369:0:26164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458152064 00000100:00100000:2.0:1784189219.897395:0:26164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2488 00000100:00100000:2.0:1784189219.897403:0:26164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf470e0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0001-mdtlov_UUID+5:3643:x1870854458151808:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784189219.897443:0:26164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf470e0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0001-mdtlov_UUID+5:3643:x1870854458151808:12345-0@lo:400:kworker.0 Request processed in 40us (821us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189219.897463:0:26164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2488 00000100:00100000:2.0:1784189219.897481:0:26164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2489 00000100:00100000:2.0:1784189219.897487:0:26164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc07b7e1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0001-mdtlov_UUID+5:3641:x1870854458151680:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784189219.897520:0:26164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc07b7e1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0001-mdtlov_UUID+5:3641:x1870854458151680:12345-0@lo:400:kworker.0 Request processed in 34us (401us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189219.897526:0:26164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2489 00000100:00100000:2.0:1784189219.897539:0:26164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2490 00000100:00100000:2.0:1784189219.897545:0:26164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc07b7e2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+5:3641:x1870854458152192:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784189219.897571:0:26164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc07b7e2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+5:3641:x1870854458152192:12345-0@lo:400:kworker.0 Request processed in 26us (407us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189219.897577:0:26164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2490 00000100:00100000:2.0:1784189219.897587:0:26164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2491 00000100:00100000:2.0:1784189219.897593:0:26164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc07b7e0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+5:3641:x1870854458152064:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784189219.897618:0:26164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc07b7e0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+5:3641:x1870854458152064:12345-0@lo:400:kworker.0 Request processed in 26us (380us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189219.897624:0:26164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2491 00000100:00100000:2.0:1784189219.897673:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc07faa9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1870854458152064:0@lo:400:kworker.0 00000100:00100000:2.0:1784189219.897685:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc07faa8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1870854458151680:0@lo:400:kworker.0 00000100:00100000:2.0:1784189219.897694:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc07faa8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1870854458152192:0@lo:400:kworker.0 00000100:00100000:3.0:1784189219.897810:0:68287:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc07faaa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1870854458151424:12345-0@lo:400:kworker.0 Request processed in 954us (1342us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189219.897819:0:68287:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1223 00000100:00100000:3.0:1784189219.897834:0:68287:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458151552 00000100:00100000:3.0:1784189219.897838:0:68287:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458151552 00000100:00100000:3.0:1784189219.897855:0:68287:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1224 00000100:00100000:3.0:1784189219.897861:0:68287:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc07faab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1870854458151936:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784189219.897978:0:68287:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc07faab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1870854458151936:12345-0@lo:400:kworker.0 Request processed in 55us (1394us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189219.897985:0:68287:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1224 00000100:00100000:3.0:1784189219.898000:0:68287:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1225 00000100:00100000:3.0:1784189219.898006:0:68287:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf470e2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1870854458151296:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784189219.898038:0:68287:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf470e2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1870854458151296:12345-0@lo:400:kworker.0 Request processed in 32us (1462us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189219.898044:0:68287:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1225 00000100:00100000:3.0:1784189219.898056:0:68287:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1226 00000100:00100000:3.0:1784189219.898062:0:68287:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf470e0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1870854458152320:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784189219.898089:0:68287:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf470e0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1870854458152320:12345-0@lo:400:kworker.0 Request processed in 28us (1428us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189219.898095:0:68287:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1226 00000100:00100000:3.0:1784189219.898107:0:68287:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1227 00000100:00100000:3.0:1784189219.898113:0:68287:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc07b7e2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1870854458151552:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784189219.898142:0:68287:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc07b7e2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1870854458151552:12345-0@lo:400:kworker.0 Request processed in 29us (932us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189219.898149:0:68287:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1227 00000100:00080000:3.0:1784189219.898184:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1784189219.898189:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1784189219.898192:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1784189219.898194:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1784189219.898238:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc07faa9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3643:1870854458151296:0@lo:400:kworker.0 00000100:00100000:3.0:1784189219.898249:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc07faa9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1870854458151808:0@lo:400:kworker.0 00000100:00100000:3.0:1784189219.898259:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc07faab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3643:1870854458152320:0@lo:400:kworker.0 00000100:00100000:3.0:1784189219.898281:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc07faa8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3643:1870854458151424:0@lo:400:kworker.0 00000100:00100000:3.0:1784189219.898291:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc07faaad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3643:1870854458151936:0@lo:400:kworker.0 00000100:00100000:2.0:1784189219.898458:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc07faa9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3641:1870854458151552:0@lo:400:kworker.0 00000100:00100000:3.0:1784189220.064541:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1784189220.065505:0:90955:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436291456 00000100:00100000:0.0:1784189220.065522:0:90955:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436291456 00000100:00100000:0.0:1784189220.065593:0:90955:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 85 00000100:00100000:0.0:1784189220.065604:0:90955:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc049313450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0+-99:2395:x1870854436291456:12345-192.168.203.12@tcp:250:mount.lustre.0 00010000:00080000:0.0:1784189220.065641:0:90955:0:(ldlm_lib.c:1445:target_handle_connect()) MGS: connection from 60f345e3-c70e-4f53-b5e7-c9671463c9a5@192.168.203.12@tcp t0 exp 0000000000000000 cur 3462 last 0 00000020:00000080:0.0:1784189220.065684:0:90955:0:(genops.c:1406:class_connect()) connect: client 60f345e3-c70e-4f53-b5e7-c9671463c9a5, cookie 0xcc1762b626f8bbcc 00000100:00080000:0.0:1784189220.065748:0:90955:0:(import.c:65:import_set_state_nolock()) ffff9dbf44677800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1784189220.065860:0:90955:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc049313450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:60f345e3-c70e-4f53-b5e7-c9671463c9a5+5:2395:x1870854436291456:12345-192.168.203.12@tcp:250:mount.lustre.0 Request processed in 255us (1333us total) trans 0 rc 0/0 00000100:00100000:0.0:1784189220.065870:0:90955:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 85 00000100:00100000:2.0:1784189220.074853:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1784189220.077952:0:90956:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436291584 00000100:00100000:2.0:1784189220.077973:0:90956:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436291584 00000100:00100000:2.0:1784189220.078073:0:90956:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 86 00000100:00100000:2.0:1784189220.078085:0:90956:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc049311c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:60f345e3-c70e-4f53-b5e7-c9671463c9a5+5:70928:x1870854436291584:12345-192.168.203.12@tcp:101:mount.lustre.0 00010000:00010000:2.0:1784189220.078108:0:90956:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784189220.078133:0:90956:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dbf4369ca00/0xcc1762b626f8bbd3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xcbfc5de7fe6c3ee2 expref: -99 pid: 90956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189220.078172:0:90956:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dbf4369ca00/0xcc1762b626f8bbd3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c3ee2 expref: 6 pid: 90956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189220.078186:0:90956:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dbf4369ca00/0xcc1762b626f8bbd3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c3ee2 expref: 6 pid: 90956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189220.078197:0:90956:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dbf4369ca00, rc 0) 00000100:00100000:2.0:1784189220.078283:0:90956:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc049311c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:60f345e3-c70e-4f53-b5e7-c9671463c9a5+6:70928:x1870854436291584:12345-192.168.203.12@tcp:101:mount.lustre.0 Request processed in 199us (3445us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189220.078291:0:90956:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 86 00000100:00100000:0.0:1784189220.085534:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1784189220.085631:0:90954:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436291712 00000100:00100000:2.0:1784189220.085644:0:90954:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436291712 00000100:00100000:2.0:1784189220.085732:0:90954:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 87 00000100:00100000:2.0:1784189220.085746:0:90954:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc049310050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:60f345e3-c70e-4f53-b5e7-c9671463c9a5+6:70928:x1870854436291712:12345-192.168.203.12@tcp:501:mount.lustre.0 00000100:00100000:2.0:1784189220.086202:0:90954:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc049310050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:60f345e3-c70e-4f53-b5e7-c9671463c9a5+6:70928:x1870854436291712:12345-192.168.203.12@tcp:501:mount.lustre.0 Request processed in 458us (682us total) trans 0 rc -2/-2 00000100:00100000:2.0:1784189220.086212:0:90954:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 87 00000100:00100000:2.0:1784189220.092441:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1784189220.093974:0:90955:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436291840 00000100:00100000:3.0:1784189220.093993:0:90955:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436291840 00000100:00100000:3.0:1784189220.094070:0:90955:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 88 00000100:00100000:3.0:1784189220.094085:0:90955:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc049310c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:60f345e3-c70e-4f53-b5e7-c9671463c9a5+6:70928:x1870854436291840:12345-192.168.203.12@tcp:101:mount.lustre.0 00010000:00010000:3.0:1784189220.094108:0:90955:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784189220.094131:0:90955:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dc0755a4400/0xcc1762b626f8bbda lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0xcbfc5de7fe6c3ee9 expref: -99 pid: 90955 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189220.094170:0:90955:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dc0755a4400/0xcc1762b626f8bbda lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c3ee9 expref: 7 pid: 90955 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189220.094182:0:90955:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dc0755a4400/0xcc1762b626f8bbda lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c3ee9 expref: 7 pid: 90955 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189220.094195:0:90955:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc0755a4400, rc 0) 00000100:00100000:3.0:1784189220.094475:0:90955:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc049310c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:60f345e3-c70e-4f53-b5e7-c9671463c9a5+7:70928:x1870854436291840:12345-192.168.203.12@tcp:101:mount.lustre.0 Request processed in 392us (2124us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189220.094483:0:90955:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 88 00000100:00100000:0.0:1784189220.101080:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1784189220.101264:0:90954:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436291968 00000100:00100000:2.0:1784189220.101278:0:90954:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436291968 00000100:00100000:2.0:1784189220.101447:0:90954:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 89 00000100:00100000:2.0:1784189220.101458:0:90954:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc049310850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:60f345e3-c70e-4f53-b5e7-c9671463c9a5+7:70928:x1870854436291968:12345-192.168.203.12@tcp:501:mount.lustre.0 00000100:00100000:2.0:1784189220.101699:0:90954:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc049310850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:60f345e3-c70e-4f53-b5e7-c9671463c9a5+8:70928:x1870854436291968:12345-192.168.203.12@tcp:501:mount.lustre.0 Request processed in 242us (634us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189220.101708:0:90954:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 89 00000100:00100000:0.0:1784189220.105590:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1784189220.105676:0:90955:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436292096 00000100:00100000:1.0:1784189220.105688:0:90955:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436292096 00000100:00100000:1.0:1784189220.105758:0:90955:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 90 00000100:00100000:1.0:1784189220.105770:0:90955:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc07cbe4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:60f345e3-c70e-4f53-b5e7-c9671463c9a5+8:70928:x1870854436292096:12345-192.168.203.12@tcp:503:mount.lustre.0 00000100:00100000:1.0:1784189220.105979:0:90955:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc07cbe4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:60f345e3-c70e-4f53-b5e7-c9671463c9a5+8:70928:x1870854436292096:12345-192.168.203.12@tcp:503:mount.lustre.0 Request processed in 210us (402us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189220.105989:0:90955:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 90 00000100:00100000:1.0:1784189220.111965:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1784189220.113000:0:90956:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436292224 00000100:00100000:0.0:1784189220.113018:0:90956:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436292224 00000100:00100000:0.0:1784189220.113124:0:90956:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 91 00000100:00100000:0.0:1784189220.113136:0:90956:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc07cbe7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:60f345e3-c70e-4f53-b5e7-c9671463c9a5+8:70947:x1870854436292224:12345-192.168.203.12@tcp:502:llog_process_th.0 00000100:00100000:0.0:1784189220.113421:0:90956:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc07cbe7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:60f345e3-c70e-4f53-b5e7-c9671463c9a5+8:70947:x1870854436292224:12345-192.168.203.12@tcp:502:llog_process_th.0 Request processed in 286us (1470us total) trans 0 rc 0/0 00000100:00100000:0.0:1784189220.113431:0:90956:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 91 00000100:00100000:0.0:1784189220.161079:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1784189220.161446:0:90954:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436292352 00000100:00100000:2.0:1784189220.161458:0:90954:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436292352 00000100:00100000:2.0:1784189220.161534:0:90954:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 92 00000100:00100000:2.0:1784189220.161545:0:90954:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc07cbe5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:60f345e3-c70e-4f53-b5e7-c9671463c9a5+8:70947:x1870854436292352:12345-192.168.203.12@tcp:502:llog_process_th.0 00000100:00100000:2.0:1784189220.161750:0:90954:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc07cbe5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:60f345e3-c70e-4f53-b5e7-c9671463c9a5+8:70947:x1870854436292352:12345-192.168.203.12@tcp:502:llog_process_th.0 Request processed in 205us (683us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189220.161759:0:90954:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 92 00000100:00100000:3.0:1784189220.166631:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1784189220.166731:0:90956:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436292480 00000100:00100000:0.0:1784189220.166743:0:90956:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436292480 00000100:00100000:0.0:1784189220.166830:0:90956:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 93 00000100:00100000:0.0:1784189220.166843:0:90956:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc07cbe4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:60f345e3-c70e-4f53-b5e7-c9671463c9a5+8:70947:x1870854436292480:12345-192.168.203.12@tcp:502:llog_process_th.0 00000100:00100000:0.0:1784189220.167071:0:90956:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc07cbe4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:60f345e3-c70e-4f53-b5e7-c9671463c9a5+8:70947:x1870854436292480:12345-192.168.203.12@tcp:502:llog_process_th.0 Request processed in 230us (456us total) trans 0 rc 0/0 00000100:00100000:0.0:1784189220.167081:0:90956:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 93 00000100:00100000:3.0:1784189220.171385:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1784189220.172403:0:90955:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436292608 00000100:00100000:1.0:1784189220.172418:0:90955:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436292608 00000100:00100000:1.0:1784189220.172506:0:90955:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 94 00000100:00100000:1.0:1784189220.172519:0:90955:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc04a4a0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:60f345e3-c70e-4f53-b5e7-c9671463c9a5+8:70928:x1870854436292608:12345-192.168.203.12@tcp:101:mount.lustre.0 00010000:00010000:1.0:1784189220.172543:0:90955:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784189220.172581:0:90955:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dc0565e7400/0xcc1762b626f8bbe1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xcbfc5de7fe6c3f1a expref: -99 pid: 90955 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189220.172619:0:90955:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dc0565e7400/0xcc1762b626f8bbe1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c3f1a expref: 9 pid: 90955 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189220.172631:0:90955:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dc0565e7400/0xcc1762b626f8bbe1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c3f1a expref: 9 pid: 90955 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189220.172641:0:90955:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc0565e7400, rc 0) 00000100:00100000:1.0:1784189220.172719:0:90955:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc04a4a0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:60f345e3-c70e-4f53-b5e7-c9671463c9a5+9:70928:x1870854436292608:12345-192.168.203.12@tcp:101:mount.lustre.0 Request processed in 203us (1350us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189220.172727:0:90955:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 94 00000100:00100000:1.0:1784189220.183906:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1784189220.184105:0:90954:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436292736 00000100:00100000:2.0:1784189220.184120:0:90954:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436292736 00000100:00100000:2.0:1784189220.185131:0:90954:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 95 00000100:00100000:2.0:1784189220.185149:0:90954:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc056806c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:60f345e3-c70e-4f53-b5e7-c9671463c9a5+9:70928:x1870854436292736:12345-192.168.203.12@tcp:256:mount.lustre.0 20000000:01000000:2.0:1784189220.185183:0:90954:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:2.0:1784189220.185214:0:90954:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1784189220.185219:0:90954:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:2.0:1784189220.185222:0:90954:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:2.0:1784189220.185226:0:90954:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:2.0:1784189220.185228:0:90954:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 116 00000100:00100000:2.0:1784189220.187080:0:90954:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc056806c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:60f345e3-c70e-4f53-b5e7-c9671463c9a5+9:70928:x1870854436292736:12345-192.168.203.12@tcp:256:mount.lustre.0 Request processed in 1924us (3176us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189220.187098:0:90954:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 95 00000100:00100000:3.0:1784189220.190497:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1784189220.190604:0:90956:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436292864 00000100:00100000:0.0:1784189220.190616:0:90956:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436292864 00000100:00100000:0.0:1784189220.190690:0:90956:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 96 00000100:00100000:0.0:1784189220.190702:0:90956:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc056804450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:60f345e3-c70e-4f53-b5e7-c9671463c9a5+9:70928:x1870854436292864:12345-192.168.203.12@tcp:101:mount.lustre.0 00010000:00010000:0.0:1784189220.190725:0:90956:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784189220.190749:0:90956:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dc04152c800/0xcc1762b626f8bbe8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xcbfc5de7fe6c3f21 expref: -99 pid: 90956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189220.190785:0:90956:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dc04152c800/0xcc1762b626f8bbe8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c3f21 expref: 10 pid: 90956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189220.190807:0:90956:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dc04152c800/0xcc1762b626f8bbe8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c3f21 expref: 10 pid: 90956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189220.190818:0:90956:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc04152c800, rc 0) 00000100:00100000:0.0:1784189220.190902:0:90956:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc056804450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:60f345e3-c70e-4f53-b5e7-c9671463c9a5+10:70928:x1870854436292864:12345-192.168.203.12@tcp:101:mount.lustre.0 Request processed in 201us (416us total) trans 0 rc 0/0 00000100:00100000:0.0:1784189220.190910:0:90956:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 96 00000100:00100000:1.0:1784189220.193104:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1784189220.193451:0:90954:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436292992 00000100:00100000:0.0:1784189220.193462:0:90954:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436292992 00000100:00100000:0.0:1784189220.193589:0:90954:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 97 00000100:00100000:0.0:1784189220.193601:0:90954:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc056804c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:60f345e3-c70e-4f53-b5e7-c9671463c9a5+10:70928:x1870854436292992:12345-192.168.203.12@tcp:501:mount.lustre.0 00000100:00100000:0.0:1784189220.193791:0:90954:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc056804c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:60f345e3-c70e-4f53-b5e7-c9671463c9a5+10:70928:x1870854436292992:12345-192.168.203.12@tcp:501:mount.lustre.0 Request processed in 190us (699us total) trans 0 rc 0/0 00000100:00100000:0.0:1784189220.193809:0:90954:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 97 00000100:00100000:1.0:1784189220.196154:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1784189220.196290:0:90955:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436293120 00000100:00100000:3.0:1784189220.196303:0:90955:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436293120 00000100:00100000:3.0:1784189220.196421:0:90955:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 98 00000100:00100000:3.0:1784189220.196605:0:90955:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc056807c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:60f345e3-c70e-4f53-b5e7-c9671463c9a5+10:70928:x1870854436293120:12345-192.168.203.12@tcp:503:mount.lustre.0 00000100:00100000:3.0:1784189220.196812:0:90955:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc056807c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:60f345e3-c70e-4f53-b5e7-c9671463c9a5+10:70928:x1870854436293120:12345-192.168.203.12@tcp:503:mount.lustre.0 Request processed in 381us (672us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189220.196822:0:90955:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 98 00000100:00100000:1.0:1784189220.202926:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1784189220.203285:0:90954:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436293248 00000100:00100000:0.0:1784189220.203299:0:90954:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436293248 00000100:00100000:0.0:1784189220.203410:0:90954:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 99 00000100:00100000:0.0:1784189220.203421:0:90954:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc056805850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:60f345e3-c70e-4f53-b5e7-c9671463c9a5+10:70955:x1870854436293248:12345-192.168.203.12@tcp:502:llog_process_th.0 00000100:00100000:0.0:1784189220.203622:0:90954:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc056805850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:60f345e3-c70e-4f53-b5e7-c9671463c9a5+10:70955:x1870854436293248:12345-192.168.203.12@tcp:502:llog_process_th.0 Request processed in 201us (711us total) trans 0 rc 0/0 00000100:00100000:0.0:1784189220.203631:0:90954:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 99 00000100:00100000:2.0:1784189220.209790:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1784189220.209904:0:90955:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436293376 00000100:00100000:3.0:1784189220.209917:0:90955:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436293376 00000100:00100000:3.0:1784189220.210004:0:90955:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 100 00000100:00100000:3.0:1784189220.210017:0:90955:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc056805c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:60f345e3-c70e-4f53-b5e7-c9671463c9a5+10:70955:x1870854436293376:12345-192.168.203.12@tcp:502:llog_process_th.0 00000100:00100000:3.0:1784189220.210299:0:90955:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc056805c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:60f345e3-c70e-4f53-b5e7-c9671463c9a5+10:70955:x1870854436293376:12345-192.168.203.12@tcp:502:llog_process_th.0 Request processed in 283us (522us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189220.210310:0:90955:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 100 00000100:00100000:1.0:1784189220.228544:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1784189220.228597:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1784189220.228714:0:66170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436293504 00000100:00100000:0.0:1784189220.228726:0:66170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436293504 00000100:00100000:0.0:1784189220.228783:0:66170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436293760 00000100:00100000:0.0:1784189220.228787:0:66170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436293760 00000100:00100000:0.0:1784189220.228822:0:66170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1300 00000100:00100000:0.0:1784189220.228833:0:66170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf4a32f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2395:x1870854436293504:12345-192.168.203.12@tcp:38:mount.lustre.0 00010000:00080000:0.0:1784189220.228876:0:66170:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from debedd94-805c-42a0-a5e5-41758b2012e9@192.168.203.12@tcp t0 exp 0000000000000000 cur 3462 last 0 00000020:00000080:0.0:1784189220.228953:0:66170:0:(genops.c:1406:class_connect()) connect: client debedd94-805c-42a0-a5e5-41758b2012e9, cookie 0xcc1762b626f8bbef 00000004:00100000:0.0:1784189220.228986:0:66170:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:0.0:1784189220.229137:0:66170:0:(import.c:65:import_set_state_nolock()) ffff9dbf43d8e000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1784189220.229220:0:66170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf4a32f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:debedd94-805c-42a0-a5e5-41758b2012e9+6:2395:x1870854436293504:12345-192.168.203.12@tcp:38:mount.lustre.0 Request processed in 387us (690us total) trans 0 rc 0/0 00000100:00100000:0.0:1784189220.229229:0:66170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1300 00000100:00100000:0.0:1784189220.229261:0:66170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1301 00000100:00100000:0.0:1784189220.229282:0:66170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf4a32d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2395:x1870854436293760:12345-192.168.203.12@tcp:38:mount.lustre.0 00010000:00080000:0.0:1784189220.229294:0:66170:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0001: connection from debedd94-805c-42a0-a5e5-41758b2012e9@192.168.203.12@tcp t0 exp 0000000000000000 cur 3462 last 0 00000020:00000080:0.0:1784189220.229371:0:66170:0:(genops.c:1406:class_connect()) connect: client debedd94-805c-42a0-a5e5-41758b2012e9, cookie 0xcc1762b626f8bbf6 00000004:00100000:0.0:1784189220.229386:0:66170:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:0.0:1784189220.229448:0:66170:0:(import.c:65:import_set_state_nolock()) ffff9dc04ffb4800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1784189220.229476:0:66170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf4a32d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:debedd94-805c-42a0-a5e5-41758b2012e9+6:2395:x1870854436293760:12345-192.168.203.12@tcp:38:mount.lustre.0 Request processed in 192us (878us total) trans 0 rc 0/0 00000100:00100000:0.0:1784189220.229483:0:66170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1301 00000100:00100000:1.0:1784189220.249420:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1784189220.249467:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1784189220.249547:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1784189220.249890:0:66169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436294016 00000100:00100000:2.0:1784189220.249903:0:66169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436294016 00000100:00100000:2.0:1784189220.250016:0:66169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436293888 00000100:00100000:2.0:1784189220.250020:0:66169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436293888 00000100:00100000:2.0:1784189220.250044:0:66169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436293632 00000100:00100000:2.0:1784189220.250047:0:66169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436293632 00000100:00100000:2.0:1784189220.250066:0:66169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1302 00000100:00100000:2.0:1784189220.250078:0:66169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf4a32dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:debedd94-805c-42a0-a5e5-41758b2012e9+7:70928:x1870854436294016:12345-192.168.203.12@tcp:41:mount.lustre.0 00000004:00000024:2.0:1784189220.250119:0:66169:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445277696 avail 1299038208 00000100:00100000:2.0:1784189220.250227:0:66169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf4a32dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:debedd94-805c-42a0-a5e5-41758b2012e9+7:70928:x1870854436294016:12345-192.168.203.12@tcp:41:mount.lustre.0 Request processed in 150us (822us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189220.250234:0:66169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1302 00000100:00100000:2.0:1784189220.250252:0:66169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1303 00000100:00100000:2.0:1784189220.250259:0:66169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf4a32ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:debedd94-805c-42a0-a5e5-41758b2012e9+6:0:x1870854436293888:12345-192.168.203.12@tcp:41:mount.lustre.0 00000004:00000024:2.0:1784189220.250285:0:66169:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445568512 avail 1299329024 00000100:00100000:2.0:1784189220.250351:0:66169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf4a32ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:debedd94-805c-42a0-a5e5-41758b2012e9+6:0:x1870854436293888:12345-192.168.203.12@tcp:41:mount.lustre.0 Request processed in 91us (883us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189220.250358:0:66169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1303 00000100:00100000:2.0:1784189220.250370:0:66169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1304 00000100:00100000:2.0:1784189220.250376:0:66169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf4a32ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:debedd94-805c-42a0-a5e5-41758b2012e9+6:0:x1870854436293632:12345-192.168.203.12@tcp:41:mount.lustre.0 00000004:00000024:2.0:1784189220.250386:0:66169:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445277696 avail 1299038208 00000100:00100000:2.0:1784189220.250407:0:66169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf4a32ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:debedd94-805c-42a0-a5e5-41758b2012e9+6:0:x1870854436293632:12345-192.168.203.12@tcp:41:mount.lustre.0 Request processed in 31us (861us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189220.250412:0:66169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1304 00000100:00080000:1.0:1784189220.254163:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1784189220.254178:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1784189220.267784:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1784189220.267919:0:66169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436294144 00000100:00100000:2.0:1784189220.267939:0:66169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436294144 00000100:00100000:2.0:1784189220.268029:0:66169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1305 00000100:00100000:2.0:1784189220.268042:0:66169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc070223100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:debedd94-805c-42a0-a5e5-41758b2012e9+6:70928:x1870854436294144:12345-192.168.203.12@tcp:40:mount.lustre.0 00000100:00100000:2.0:1784189220.268182:0:66169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc070223100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:debedd94-805c-42a0-a5e5-41758b2012e9+6:70928:x1870854436294144:12345-192.168.203.12@tcp:40:mount.lustre.0 Request processed in 142us (413us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189220.268190:0:66169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1305 00000100:00100000:1.0:1784189220.279962:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1784189220.280163:0:66180:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436294528 00000100:00100000:2.0:1784189220.280175:0:66180:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436294528 00000100:00100000:2.0:1784189220.280249:0:66180:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 12 00000100:00100000:2.0:1784189220.280262:0:66180:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf4a32c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:debedd94-805c-42a0-a5e5-41758b2012e9+6:70928:x1870854436294528:12345-192.168.203.12@tcp:900:mount.lustre.0 00000100:00100000:2.0:1784189220.280410:0:66180:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf4a32c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:debedd94-805c-42a0-a5e5-41758b2012e9+6:70928:x1870854436294528:12345-192.168.203.12@tcp:900:mount.lustre.0 Request processed in 150us (461us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189220.280419:0:66180:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 12 00000100:00100000:1.0:1784189220.281400:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1784189220.281539:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1784189220.282850:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436294272 00000100:00100000:3.0:1784189220.282866:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436294272 00000100:00100000:3.0:1784189220.283243:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436294400 00000100:00100000:3.0:1784189220.283248:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436294400 00000100:00100000:0.0:1784189220.283367:0:26161:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 4967 00000100:00100000:0.0:1784189220.283378:0:26161:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf4a32e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:0+-99:2395:x1870854436294272:12345-192.168.203.12@tcp:8:mount.lustre.0 00010000:00080000:0.0:1784189220.283421:0:26161:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0000: connection from debedd94-805c-42a0-a5e5-41758b2012e9@192.168.203.12@tcp t0 exp 0000000000000000 cur 3462 last 0 00000020:00000080:0.0:1784189220.283471:0:26161:0:(genops.c:1406:class_connect()) connect: client debedd94-805c-42a0-a5e5-41758b2012e9, cookie 0xcc1762b626f8bbfd 00002000:00100000:0.0:1784189220.283496:0:26161:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli debedd94-805c-42a0-a5e5-41758b2012e9/ffff9dc06bb60800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 21136a2 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1784189220.283521:0:26161:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:0.0:1784189220.283641:0:26161:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1784189220.283682:0:26161:0:(import.c:65:import_set_state_nolock()) ffff9dc0477d1000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1784189220.283761:0:26161:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf4a32e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:debedd94-805c-42a0-a5e5-41758b2012e9+6:2395:x1870854436294272:12345-192.168.203.12@tcp:8:mount.lustre.0 Request processed in 384us (2366us total) trans 0 rc 0/0 00000100:00100000:0.0:1784189220.283769:0:26161:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 4967 00000100:00100000:0.0:1784189220.283792:0:26161:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 4968 00000100:00100000:0.0:1784189220.283807:0:26161:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf4a32f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:0+-99:2395:x1870854436294400:12345-192.168.203.12@tcp:8:mount.lustre.0 00010000:00080000:0.0:1784189220.283826:0:26161:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0001: connection from debedd94-805c-42a0-a5e5-41758b2012e9@192.168.203.12@tcp t0 exp 0000000000000000 cur 3462 last 0 00000020:00000080:0.0:1784189220.283867:0:26161:0:(genops.c:1406:class_connect()) connect: client debedd94-805c-42a0-a5e5-41758b2012e9, cookie 0xcc1762b626f8bc04 00002000:00100000:0.0:1784189220.283873:0:26161:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli debedd94-805c-42a0-a5e5-41758b2012e9/ffff9dc0477d1800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 21136a2 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1784189220.284109:0:26161:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1784189220.284162:0:26161:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1784189220.284180:0:26161:0:(import.c:65:import_set_state_nolock()) ffff9dc0477d2000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1784189220.284213:0:26161:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf4a32f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:debedd94-805c-42a0-a5e5-41758b2012e9+6:2395:x1870854436294400:12345-192.168.203.12@tcp:8:mount.lustre.0 Request processed in 414us (2674us total) trans 0 rc 0/0 00000100:00100000:0.0:1784189220.284221:0:26161:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 4968 00000100:00100000:0.0:1784189220.291382:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1784189220.291707:0:66173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436294656 00000100:00100000:3.0:1784189220.291721:0:66173:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436294656 00000100:00100000:3.0:1784189220.291796:0:66173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 231 00000100:00100000:3.0:1784189220.291820:0:66173:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc070220700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:debedd94-805c-42a0-a5e5-41758b2012e9+6:70928:x1870854436294656:12345-192.168.203.12@tcp:33:mount.lustre.0 00000004:00200000:3.0:1784189220.292084:0:66173:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:3.0:1784189220.292270:0:66173:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc070220700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:debedd94-805c-42a0-a5e5-41758b2012e9+6:70928:x1870854436294656:12345-192.168.203.12@tcp:33:mount.lustre.0 Request processed in 453us (950us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189220.292280:0:66173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 231 00000100:00100000:1.0:1784189220.401376:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc070220380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1870854458152448:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1784189220.401483:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784189220.401712:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc05f02e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1870854458152576:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1784189220.401746:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784189220.401839:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458152448 00000100:00100000:3.0:1784189220.401850:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458152448 00000100:00100000:3.0:1784189220.401941:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458152576 00000100:00100000:3.0:1784189220.401946:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458152576 00000100:00100000:3.0:1784189220.401966:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1994 00000100:00100000:3.0:1784189220.401974:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf4a32f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1870854458152448:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1784189220.402004:0:8432:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8648768 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1784189220.402288:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf4a32f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1870854458152448:12345-0@lo:13:osp-pre-1-0.0 Request processed in 314us (805us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189220.402297:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1994 00000100:00100000:3.0:1784189220.402354:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1995 00000100:00100000:3.0:1784189220.402362:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf4a32e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1870854458152576:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1784189220.402374:0:8432:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8648768 pending 0 free 3922481152 avail 3690958848 00000100:00100000:3.0:1784189220.402407:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf4a32e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1870854458152576:12345-0@lo:13:osp-pre-0-0.0 Request processed in 47us (661us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189220.402414:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1995 00000100:00100000:3.0:1784189220.402467:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc070220380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1870854458152448:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1784189220.402634:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc05f02e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1870854458152576:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1784189220.591990:0:7454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784189221.615630:0:26173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784189222.010542:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1784189222.010655:0:68287:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436294784 00000100:00100000:2.0:1784189222.010669:0:68287:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436294784 00000100:00100000:2.0:1784189222.010761:0:68287:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1306 00000100:00100000:2.0:1784189222.010773:0:68287:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf4a32fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:debedd94-805c-42a0-a5e5-41758b2012e9+6:70998:x1870854436294784:12345-192.168.203.12@tcp:101:lfs.0 00010000:00010000:2.0:1784189222.010810:0:68287:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784189222.010841:0:68287:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4369cc00/0xcc1762b626f8bc0b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbfc5de7fe6c3f52 expref: -99 pid: 68287 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189222.010942:0:68287:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4369c600/0xcc1762b626f8bc12 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189222.010959:0:68287:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4369c600/0xcc1762b626f8bc12 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189222.010975:0:68287:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4369c600/0xcc1762b626f8bc12 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784189222.011031:0:68287:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1784189222.011052:0:68287:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1784189222.011081:0:68287:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4369c600/0xcc1762b626f8bc12 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189222.011109:0:68287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4369cc00/0xcc1762b626f8bc0b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c3f52 expref: 8 pid: 68287 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189222.011132:0:68287:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4369c600/0xcc1762b626f8bc12 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c3f52 expref: 7 pid: 68287 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189222.011142:0:68287:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9dc04a2a5500) 00010000:00010000:2.0:1784189222.011145:0:68287:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1784189222.011150:0:68287:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dbf4369c600, rc 0) 00000100:00100000:2.0:1784189222.011243:0:68287:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf4a32fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:debedd94-805c-42a0-a5e5-41758b2012e9+7:70998:x1870854436294784:12345-192.168.203.12@tcp:101:lfs.0 Request processed in 471us (716us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189222.011250:0:68287:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1306 00000100:00080000:1.0:1784189222.011765:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1784189222.031491:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1784189222.031576:0:66170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436294912 00000100:00100000:0.0:1784189222.031599:0:66170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436294912 00000100:00100000:0.0:1784189222.031683:0:66170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1307 00000100:00100000:0.0:1784189222.031694:0:66170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf4a32ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:debedd94-805c-42a0-a5e5-41758b2012e9+7:70998:x1870854436294912:12345-192.168.203.12@tcp:41:lfs.0 00000004:00000024:0.0:1784189222.031749:0:66170:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445277696 avail 1299038208 00000100:00100000:0.0:1784189222.031857:0:66170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf4a32ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:debedd94-805c-42a0-a5e5-41758b2012e9+7:70998:x1870854436294912:12345-192.168.203.12@tcp:41:lfs.0 Request processed in 164us (380us total) trans 0 rc 0/0 00000100:00100000:0.0:1784189222.031866:0:66170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1307 00000100:00100000:0.0:1784189222.033946:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1784189222.035536:0:66171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436295040 00000100:00100000:2.0:1784189222.035552:0:66171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436295040 00000100:00100000:2.0:1784189222.035996:0:66171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1308 00000100:00100000:2.0:1784189222.036010:0:66171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc070220380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:debedd94-805c-42a0-a5e5-41758b2012e9+6:70998:x1870854436295040:12345-192.168.203.12@tcp:41:lfs.0 00000004:00000024:2.0:1784189222.036065:0:66171:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445568512 avail 1299329024 00000100:00100000:2.0:1784189222.036180:0:66171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc070220380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:debedd94-805c-42a0-a5e5-41758b2012e9+6:70998:x1870854436295040:12345-192.168.203.12@tcp:41:lfs.0 Request processed in 172us (2256us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189222.036188:0:66171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1308 00000100:00080000:1.0:1784189222.039684:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1784189222.045949:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1784189222.046177:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436295168 00000100:00100000:3.0:1784189222.046190:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436295168 00000100:00080000:1.0:1784189222.046301:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1784189222.047636:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1996 00000100:00100000:3.0:1784189222.047660:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf4a32df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:debedd94-805c-42a0-a5e5-41758b2012e9+6:70998:x1870854436295168:12345-192.168.203.12@tcp:13:lfs.0 00002000:00000024:3.0:1784189222.047711:0:8432:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8648768 pending 0 free 3922481152 avail 3690958848 00000100:00100000:3.0:1784189222.048107:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf4a32df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:debedd94-805c-42a0-a5e5-41758b2012e9+6:70998:x1870854436295168:12345-192.168.203.12@tcp:13:lfs.0 Request processed in 456us (2171us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189222.048117:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1996 00000100:00100000:0.0:1784189222.058511:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1784189222.058712:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436295296 00000100:00100000:3.0:1784189222.058724:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436295296 00000100:00080000:1.0:1784189222.058836:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1784189222.058852:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1997 00000100:00100000:3.0:1784189222.058865:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc080df2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:debedd94-805c-42a0-a5e5-41758b2012e9+6:70998:x1870854436295296:12345-192.168.203.12@tcp:13:lfs.0 00002000:00000024:3.0:1784189222.058923:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8648768 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1784189222.059016:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc080df2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:debedd94-805c-42a0-a5e5-41758b2012e9+6:70998:x1870854436295296:12345-192.168.203.12@tcp:13:lfs.0 Request processed in 153us (517us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189222.059024:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1997 00010000:00010000:3.0:1784189222.642518:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784189222.939631:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1784189222.939775:0:66945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436295424 00000100:00100000:1.0:1784189222.939794:0:66945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436295424 00000100:00100000:1.0:1784189222.939856:0:66945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1309 00000100:00100000:1.0:1784189222.939867:0:66945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc07b7e0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:debedd94-805c-42a0-a5e5-41758b2012e9+7:71032:x1870854436295424:12345-192.168.203.12@tcp:101:cp.0 00010000:00010000:1.0:1784189222.939886:0:66945:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784189222.939907:0:66945:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0565e6200/0xcc1762b626f8bc19 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbfc5de7fe6c3f59 expref: -99 pid: 66945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189222.939980:0:66945:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0565e6000/0xcc1762b626f8bc20 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189222.939994:0:66945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0565e6000/0xcc1762b626f8bc20 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189222.940006:0:66945:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0565e6000/0xcc1762b626f8bc20 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189222.940021:0:66945:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0565e6400/0xcc1762b626f8bc27 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189222.940041:0:66945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0565e6400/0xcc1762b626f8bc27 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189222.940048:0:66945:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0565e6400/0xcc1762b626f8bc27 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189222.940109:0:66945:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0565e7000/0xcc1762b626f8bc2e lrc: 3/1,0 mode: --/PR res: [0x240006991:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189222.940117:0:66945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0565e7000/0xcc1762b626f8bc2e lrc: 3/1,0 mode: PR/PR res: [0x240006991:0xb:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189222.940124:0:66945:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0565e7000/0xcc1762b626f8bc2e lrc: 3/1,0 mode: PR/PR res: [0x240006991:0xb:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1784189222.940160:0:66945:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0565e7000/0xcc1762b626f8bc2e lrc: 3/1,0 mode: PR/PR res: [0x240006991:0xb:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189222.940174:0:66945:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0565e6000/0xcc1762b626f8bc20 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189222.940180:0:66945:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0565e6000/0xcc1762b626f8bc20 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189222.940187:0:66945:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0565e6000/0xcc1762b626f8bc20 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189222.940193:0:66945:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0565e6000/0xcc1762b626f8bc20 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189222.940198:0:66945:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc0565e6000 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:1.0:1784189222.940202:0:66945:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0565e6000/0xcc1762b626f8bc20 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189222.940217:0:66945:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0565e6000/0xcc1762b626f8bc20 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189222.940241:0:66945:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9dc04a2a5500) 00010000:00010000:1.0:1784189222.940244:0:66945:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784189222.940249:0:66945:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0565e6000/0xcc1762b626f8bc20 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189222.940255:0:66945:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0565e6000/0xcc1762b626f8bc20 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189222.940266:0:66945:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0565e6400/0xcc1762b626f8bc27 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189222.940272:0:66945:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0565e6400/0xcc1762b626f8bc27 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189222.940278:0:66945:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0565e6400/0xcc1762b626f8bc27 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189222.940283:0:66945:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc0565e6400 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:1.0:1784189222.940286:0:66945:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0565e6400/0xcc1762b626f8bc27 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189222.940292:0:66945:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0565e6400/0xcc1762b626f8bc27 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189222.940298:0:66945:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x8401ce4f (ffff9dc07fa37000) 00010000:00010000:1.0:1784189222.940301:0:66945:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784189222.940303:0:66945:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0565e6400/0xcc1762b626f8bc27 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189222.940336:0:66945:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0565e6400/0xcc1762b626f8bc27 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189222.940373:0:66945:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0565e6200/0xcc1762b626f8bc19 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c3f59 expref: 9 pid: 66945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189222.940390:0:66945:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0565e7000/0xcc1762b626f8bc2e lrc: 3/0,0 mode: PR/PR res: [0x240006991:0xb:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c3f59 expref: 8 pid: 66945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189222.940397:0:66945:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240006991:0xb:0x0].0x0 (ffff9dc07fa37700) 00010000:00010000:1.0:1784189222.940400:0:66945:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1784189222.940402:0:66945:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc0565e7000, rc 0) 00000100:00100000:1.0:1784189222.940584:0:66945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc07b7e0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:debedd94-805c-42a0-a5e5-41758b2012e9+8:71032:x1870854436295424:12345-192.168.203.12@tcp:101:cp.0 Request processed in 718us (960us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189222.940593:0:66945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1309 00000100:00100000:1.0:1784189222.944695:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1784189222.945721:0:66180:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436295552 00000100:00100000:3.0:1784189222.945731:0:66180:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436295552 00000100:00100000:3.0:1784189222.945800:0:66180:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 13 00000100:00100000:3.0:1784189222.945810:0:66180:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf4a32c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:debedd94-805c-42a0-a5e5-41758b2012e9+6:71032:x1870854436295552:12345-192.168.203.12@tcp:900:cp.0 00000100:00100000:3.0:1784189222.945889:0:66180:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf4a32c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:debedd94-805c-42a0-a5e5-41758b2012e9+6:71032:x1870854436295552:12345-192.168.203.12@tcp:900:cp.0 Request processed in 80us (1201us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189222.945897:0:66180:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 13 00000100:00100000:0.0:1784189222.951382:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1784189222.951606:0:66170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436295680 00000100:00100000:3.0:1784189222.951623:0:66170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436295680 00000100:00100000:3.0:1784189222.951829:0:66170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1310 00000100:00100000:3.0:1784189222.951844:0:66170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc075661880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:debedd94-805c-42a0-a5e5-41758b2012e9+6:71032:x1870854436295680:12345-192.168.203.12@tcp:101:cp.0 00010000:00010000:3.0:1784189222.951871:0:66170:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784189222.951905:0:66170:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9dc0755a5a00/0xcc1762b626f8bc35 lrc: 2/0,0 mode: --/CR res: [0x240006991:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbfc5de7fe6c3f60 expref: -99 pid: 66170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189222.951985:0:66170:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9dc0755a4800/0xcc1762b626f8bc3c lrc: 3/1,0 mode: --/PR res: [0x240006991:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189222.951998:0:66170:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9dc0755a4800/0xcc1762b626f8bc3c lrc: 3/1,0 mode: PR/PR res: [0x240006991:0xb:0x0].0x0 bits 0x10/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66170 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189222.952022:0:66170:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9dc0755a4800/0xcc1762b626f8bc3c lrc: 3/1,0 mode: PR/PR res: [0x240006991:0xb:0x0].0x0 bits 0x10/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66170 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784189222.952083:0:66170:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240006991:0xb:0x0]: returning size 4096 00000004:00200000:3.0:1784189222.952087:0:66170:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00010000:00010000:3.0:1784189222.952156:0:66170:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9dc0755a5a00/0xcc1762b626f8bc35 lrc: 0/0,0 mode: --/CR res: [0x240006991:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c3f60 expref: 8 pid: 66170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189222.952183:0:66170:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9dc0755a4800/0xcc1762b626f8bc3c lrc: 3/0,0 mode: PR/PR res: [0x240006991:0xb:0x0].0x0 bits 0x10/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c3f60 expref: 7 pid: 66170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189222.952194:0:66170:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240006991:0xb:0x0].0x0 (ffff9dc07fab4400) 00010000:00010000:3.0:1784189222.952197:0:66170:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 10 00010000:00010000:3.0:1784189222.952201:0:66170:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc0755a4800, rc 0) 00000100:00100000:3.0:1784189222.952291:0:66170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc075661880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:debedd94-805c-42a0-a5e5-41758b2012e9+7:71032:x1870854436295680:12345-192.168.203.12@tcp:101:cp.0 Request processed in 449us (916us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189222.952300:0:66170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1310 00000100:00100000:2.0:1784189222.957447:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1784189222.957793:0:66171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436295808 00000100:00100000:0.0:1784189222.957803:0:66171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436295808 00000100:00100000:0.0:1784189222.957858:0:66171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1311 00000100:00100000:0.0:1784189222.957868:0:66171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc07b7e2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:debedd94-805c-42a0-a5e5-41758b2012e9+7:71032:x1870854436295808:12345-192.168.203.12@tcp:101:cp.0 00010000:00010000:0.0:1784189222.957888:0:66171:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784189222.957917:0:66171:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9dc04152d600/0xcc1762b626f8bc43 lrc: 2/0,0 mode: --/CR res: [0x240006991:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbfc5de7fe6c3f67 expref: -99 pid: 66171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189222.957980:0:66171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9dc04152d400/0xcc1762b626f8bc4a lrc: 3/1,0 mode: --/CR res: [0x240006991:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189222.957994:0:66171:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9dc04152d400/0xcc1762b626f8bc4a lrc: 3/1,0 mode: CR/CR res: [0x240006991:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66171 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189222.958005:0:66171:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9dc04152d400/0xcc1762b626f8bc4a lrc: 3/1,0 mode: CR/CR res: [0x240006991:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66171 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189222.958019:0:66171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9dc04152d200/0xcc1762b626f8bc51 lrc: 3/1,0 mode: --/PR res: [0x240006991:0xb:0x0].0xf7117594 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189222.958027:0:66171:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9dc04152d200/0xcc1762b626f8bc51 lrc: 3/1,0 mode: PR/PR res: [0x240006991:0xb:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66171 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189222.958033:0:66171:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9dc04152d200/0xcc1762b626f8bc51 lrc: 3/1,0 mode: PR/PR res: [0x240006991:0xb:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66171 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189222.958121:0:66171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9dc04152c400/0xcc1762b626f8bc58 lrc: 3/1,0 mode: --/PR res: [0x240006991:0xc:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189222.958129:0:66171:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9dc04152c400/0xcc1762b626f8bc58 lrc: 3/1,0 mode: PR/PR res: [0x240006991:0xc:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66171 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189222.958135:0:66171:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9dc04152c400/0xcc1762b626f8bc58 lrc: 3/1,0 mode: PR/PR res: [0x240006991:0xc:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66171 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784189222.958170:0:66171:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240006991:0xc:0x0]: returning size 4096 00000004:00200000:0.0:1784189222.958174:0:66171:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1784189222.958196:0:66171:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff9dc04152c400/0xcc1762b626f8bc58 lrc: 3/1,0 mode: PR/PR res: [0x240006991:0xc:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66171 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189222.958215:0:66171:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9dc04152d400/0xcc1762b626f8bc4a lrc: 4/1,0 mode: CR/CR res: [0x240006991:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66171 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189222.958222:0:66171:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9dc04152d400/0xcc1762b626f8bc4a lrc: 4/1,0 mode: CR/CR res: [0x240006991:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66171 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189222.958229:0:66171:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9dc04152d400/0xcc1762b626f8bc4a lrc: 3/0,0 mode: CR/CR res: [0x240006991:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66171 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189222.958236:0:66171:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9dc04152d400/0xcc1762b626f8bc4a lrc: 4/0,0 mode: CR/CR res: [0x240006991:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66171 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189222.958242:0:66171:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc04152d400 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:0.0:1784189222.958246:0:66171:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9dc04152d400/0xcc1762b626f8bc4a lrc: 4/0,0 mode: CR/CR res: [0x240006991:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66171 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189222.958254:0:66171:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9dc04152d400/0xcc1762b626f8bc4a lrc: 5/0,0 mode: CR/CR res: [0x240006991:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66171 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189222.958266:0:66171:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240006991:0xb:0x0].0x0 (ffff9dc07fab4400) 00010000:00010000:0.0:1784189222.958269:0:66171:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784189222.958273:0:66171:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9dc04152d400/0xcc1762b626f8bc4a lrc: 3/0,0 mode: --/CR res: [0x240006991:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66171 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189222.958279:0:66171:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9dc04152d400/0xcc1762b626f8bc4a lrc: 0/0,0 mode: --/CR res: [0x240006991:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66171 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189222.958292:0:66171:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9dc04152d200/0xcc1762b626f8bc51 lrc: 3/1,0 mode: PR/PR res: [0x240006991:0xb:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66171 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189222.958298:0:66171:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9dc04152d200/0xcc1762b626f8bc51 lrc: 2/0,0 mode: PR/PR res: [0x240006991:0xb:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66171 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189222.958310:0:66171:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9dc04152d200/0xcc1762b626f8bc51 lrc: 3/0,0 mode: PR/PR res: [0x240006991:0xb:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66171 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189222.958316:0:66171:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc04152d200 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:0.0:1784189222.958340:0:66171:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9dc04152d200/0xcc1762b626f8bc51 lrc: 3/0,0 mode: PR/PR res: [0x240006991:0xb:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66171 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189222.958347:0:66171:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9dc04152d200/0xcc1762b626f8bc51 lrc: 4/0,0 mode: PR/PR res: [0x240006991:0xb:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66171 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189222.958357:0:66171:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240006991:0xb:0x0].0xf7117594 (ffff9dc074ae2100) 00010000:00010000:0.0:1784189222.958360:0:66171:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784189222.958364:0:66171:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9dc04152d200/0xcc1762b626f8bc51 lrc: 2/0,0 mode: --/PR res: [0x240006991:0xb:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66171 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189222.958370:0:66171:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9dc04152d200/0xcc1762b626f8bc51 lrc: 0/0,0 mode: --/PR res: [0x240006991:0xb:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66171 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189222.958401:0:66171:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9dc04152d600/0xcc1762b626f8bc43 lrc: 0/0,0 mode: --/CR res: [0x240006991:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c3f67 expref: 9 pid: 66171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189222.958415:0:66171:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9dc04152c400/0xcc1762b626f8bc58 lrc: 3/0,0 mode: PR/PR res: [0x240006991:0xc:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c3f67 expref: 8 pid: 66171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189222.958422:0:66171:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240006991:0xc:0x0].0x0 (ffff9dc074ae2200) 00010000:00010000:0.0:1784189222.958424:0:66171:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1784189222.958426:0:66171:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc04152c400, rc 0) 00000100:00100000:0.0:1784189222.959751:0:66171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc07b7e2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:debedd94-805c-42a0-a5e5-41758b2012e9+8:71032:x1870854436295808:12345-192.168.203.12@tcp:101:cp.0 Request processed in 614us (1041us total) trans 0 rc 0/0 00000100:00100000:0.0:1784189222.959775:0:66171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1311 00000100:00100000:3.0:1784189222.965478:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1784189222.965479:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1784189222.965499:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf4a32d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1870854458152704:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1784189222.965562:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784189222.965613:0:66945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436295936 00000100:00100000:1.0:1784189222.965620:0:66945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436295936 00000100:00100000:1.0:1784189222.965669:0:66945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1312 00000100:00100000:1.0:1784189222.965678:0:66945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc05f02e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:debedd94-805c-42a0-a5e5-41758b2012e9+8:71032:x1870854436295936:12345-192.168.203.12@tcp:101:cp.0 00010000:00010000:1.0:1784189222.965697:0:66945:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784189222.965717:0:66945:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9dc0565e6400/0xcc1762b626f8bc5f lrc: 2/0,0 mode: --/CR res: [0x240006991:0xc:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbfc5de7fe6c3f6e expref: -99 pid: 66945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189222.965804:0:66945:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9dc0565e6000/0xcc1762b626f8bc66 lrc: 3/1,0 mode: --/CR res: [0x240006991:0xc:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189222.965818:0:66945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9dc0565e6000/0xcc1762b626f8bc66 lrc: 3/1,0 mode: CR/CR res: [0x240006991:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189222.965830:0:66945:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9dc0565e6000/0xcc1762b626f8bc66 lrc: 3/1,0 mode: CR/CR res: [0x240006991:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66945 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784189222.965837:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458152704 00000100:00100000:3.0:1784189222.965842:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458152704 00010000:00010000:1.0:1784189222.965844:0:66945:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9dc0565e6e00/0xcc1762b626f8bc6d lrc: 3/1,0 mode: --/PR res: [0x240006991:0xc:0x0].0xb1bed465 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189222.965851:0:66945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9dc0565e6e00/0xcc1762b626f8bc6d lrc: 3/1,0 mode: PR/PR res: [0x240006991:0xc:0x0].0xb1bed465 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189222.965857:0:66945:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9dc0565e6e00/0xcc1762b626f8bc6d lrc: 3/1,0 mode: PR/PR res: [0x240006991:0xc:0x0].0xb1bed465 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66945 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784189222.965881:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1998 00000100:00100000:3.0:1784189222.965888:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc05ed7df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1870854458152704:12345-0@lo:13:osp-pre-0-1.0 00010000:00010000:1.0:1784189222.965899:0:66945:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9dc0565e6000/0xcc1762b626f8bc66 lrc: 4/1,0 mode: CR/CR res: [0x240006991:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66945 initiator: MDT1 lru_score: 0 lru_type: 0 00002000:00000024:3.0:1784189222.965903:0:8432:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8648768 pending 0 free 3922481152 avail 3690958848 00010000:00010000:1.0:1784189222.965906:0:66945:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9dc0565e6000/0xcc1762b626f8bc66 lrc: 4/1,0 mode: CR/CR res: [0x240006991:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189222.965911:0:66945:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9dc0565e6000/0xcc1762b626f8bc66 lrc: 3/0,0 mode: CR/CR res: [0x240006991:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189222.965917:0:66945:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9dc0565e6000/0xcc1762b626f8bc66 lrc: 4/0,0 mode: CR/CR res: [0x240006991:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189222.965923:0:66945:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc0565e6000 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:1.0:1784189222.965933:0:66945:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9dc0565e6000/0xcc1762b626f8bc66 lrc: 4/0,0 mode: CR/CR res: [0x240006991:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189222.965941:0:66945:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9dc0565e6000/0xcc1762b626f8bc66 lrc: 5/0,0 mode: CR/CR res: [0x240006991:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66945 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784189222.965946:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc05ed7df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1870854458152704:12345-0@lo:13:osp-pre-0-1.0 Request processed in 59us (384us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189222.965952:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1998 00010000:00010000:1.0:1784189222.965954:0:66945:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240006991:0xc:0x0].0x0 (ffff9dc074ae2200) 00010000:00010000:1.0:1784189222.965957:0:66945:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784189222.965961:0:66945:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9dc0565e6000/0xcc1762b626f8bc66 lrc: 3/0,0 mode: --/CR res: [0x240006991:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189222.965967:0:66945:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9dc0565e6000/0xcc1762b626f8bc66 lrc: 0/0,0 mode: --/CR res: [0x240006991:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189222.965978:0:66945:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9dc0565e6e00/0xcc1762b626f8bc6d lrc: 3/1,0 mode: PR/PR res: [0x240006991:0xc:0x0].0xb1bed465 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189222.965984:0:66945:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9dc0565e6e00/0xcc1762b626f8bc6d lrc: 2/0,0 mode: PR/PR res: [0x240006991:0xc:0x0].0xb1bed465 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189222.965990:0:66945:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9dc0565e6e00/0xcc1762b626f8bc6d lrc: 3/0,0 mode: PR/PR res: [0x240006991:0xc:0x0].0xb1bed465 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189222.965995:0:66945:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc0565e6e00 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:1.0:1784189222.965998:0:66945:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9dc0565e6e00/0xcc1762b626f8bc6d lrc: 3/0,0 mode: PR/PR res: [0x240006991:0xc:0x0].0xb1bed465 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189222.966005:0:66945:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9dc0565e6e00/0xcc1762b626f8bc6d lrc: 4/0,0 mode: PR/PR res: [0x240006991:0xc:0x0].0xb1bed465 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189222.966012:0:66945:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240006991:0xc:0x0].0xb1bed465 (ffff9dc07fa37000) 00010000:00010000:1.0:1784189222.966014:0:66945:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784189222.966025:0:66945:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9dc0565e6e00/0xcc1762b626f8bc6d lrc: 2/0,0 mode: --/PR res: [0x240006991:0xc:0x0].0xb1bed465 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189222.966030:0:66945:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9dc0565e6e00/0xcc1762b626f8bc6d lrc: 0/0,0 mode: --/PR res: [0x240006991:0xc:0x0].0xb1bed465 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189222.966066:0:66945:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9dc0565e6400/0xcc1762b626f8bc5f lrc: 1/0,0 mode: --/CR res: [0x240006991:0xc:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c3f6e expref: 9 pid: 66945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189222.966076:0:66945:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240006991:0xc:0x0].0x0 (ffff9dc074ae2200) 00010000:00010000:1.0:1784189222.966079:0:66945:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784189222.966082:0:66945:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9dc0565e6400/0xcc1762b626f8bc5f lrc: 0/0,0 mode: --/CR res: [0x240006991:0xc:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c3f6e expref: 9 pid: 66945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189222.966091:0:66945:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc0565e6400, rc 0) 00000100:00100000:1.0:1784189222.966136:0:66945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc05f02e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:debedd94-805c-42a0-a5e5-41758b2012e9+8:71032:x1870854436295936:12345-192.168.203.12@tcp:101:cp.0 Request processed in 459us (664us total) trans 0 rc 301/301 00000100:00100000:1.0:1784189222.966143:0:66945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1312 00000100:00080000:1.0:1784189222.966161:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1784189222.966338:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf4a32d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1870854458152704:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1784189222.967637:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc07b7e3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1870854458152832:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1784189222.967685:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784189222.968112:0:9466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458152832 00000100:00100000:2.0:1784189222.968120:0:9466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458152832 00000100:00080000:1.0:1784189222.968378:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1784189222.968387:0:9466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1999 00000100:00100000:2.0:1784189222.968397:0:9466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf4a32d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1870854458152832:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1784189222.968418:0:9466:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8648768 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1784189222.968474:0:9466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf4a32d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1870854458152832:12345-0@lo:13:osp-pre-1-1.0 Request processed in 78us (787us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189222.968481:0:9466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1999 00000100:00100000:1.0:1784189222.968554:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc07b7e3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1870854458152832:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1784189222.973901:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1784189222.974101:0:66170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436296064 00000100:00100000:3.0:1784189222.974118:0:66170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436296064 00000100:00100000:3.0:1784189222.974179:0:66170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1313 00000100:00100000:3.0:1784189222.974190:0:66170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc050541c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:debedd94-805c-42a0-a5e5-41758b2012e9+8:71032:x1870854436296064:12345-192.168.203.12@tcp:101:cp.0 00010000:00010000:3.0:1784189222.974209:0:66170:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784189222.974302:0:66170:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9dc0755a5a00/0xcc1762b626f8bc74 lrc: 2/0,0 mode: --/CR res: [0x240006991:0xc:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbfc5de7fe6c3f75 expref: -99 pid: 66170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189222.974660:0:66170:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9dc0755a4e00/0xcc1762b626f8bc7b lrc: 3/1,0 mode: --/CR res: [0x240006991:0xc:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189222.974675:0:66170:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9dc0755a4e00/0xcc1762b626f8bc7b lrc: 3/1,0 mode: CR/CR res: [0x240006991:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66170 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189222.974688:0:66170:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9dc0755a4e00/0xcc1762b626f8bc7b lrc: 3/1,0 mode: CR/CR res: [0x240006991:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66170 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189222.974702:0:66170:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9dc0755a5200/0xcc1762b626f8bc82 lrc: 3/1,0 mode: --/PR res: [0x240006991:0xc:0x0].0xb1bed465 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189222.974710:0:66170:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9dc0755a5200/0xcc1762b626f8bc82 lrc: 3/1,0 mode: PR/PR res: [0x240006991:0xc:0x0].0xb1bed465 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66170 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189222.974716:0:66170:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9dc0755a5200/0xcc1762b626f8bc82 lrc: 3/1,0 mode: PR/PR res: [0x240006991:0xc:0x0].0xb1bed465 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66170 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189222.974835:0:66170:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9dc0755a4e00/0xcc1762b626f8bc7b lrc: 4/1,0 mode: CR/CR res: [0x240006991:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66170 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189222.974843:0:66170:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9dc0755a4e00/0xcc1762b626f8bc7b lrc: 4/1,0 mode: CR/CR res: [0x240006991:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66170 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189222.974848:0:66170:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9dc0755a4e00/0xcc1762b626f8bc7b lrc: 3/0,0 mode: CR/CR res: [0x240006991:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66170 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189222.974860:0:66170:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9dc0755a4e00/0xcc1762b626f8bc7b lrc: 4/0,0 mode: CR/CR res: [0x240006991:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66170 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189222.974865:0:66170:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc0755a4e00 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:3.0:1784189222.974869:0:66170:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9dc0755a4e00/0xcc1762b626f8bc7b lrc: 4/0,0 mode: CR/CR res: [0x240006991:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66170 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189222.974876:0:66170:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9dc0755a4e00/0xcc1762b626f8bc7b lrc: 5/0,0 mode: CR/CR res: [0x240006991:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66170 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189222.974887:0:66170:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240006991:0xc:0x0].0x0 (ffff9dc074ae2200) 00010000:00010000:3.0:1784189222.974889:0:66170:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784189222.974894:0:66170:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9dc0755a4e00/0xcc1762b626f8bc7b lrc: 3/0,0 mode: --/CR res: [0x240006991:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66170 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189222.974900:0:66170:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9dc0755a4e00/0xcc1762b626f8bc7b lrc: 0/0,0 mode: --/CR res: [0x240006991:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66170 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189222.974912:0:66170:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9dc0755a5200/0xcc1762b626f8bc82 lrc: 3/1,0 mode: PR/PR res: [0x240006991:0xc:0x0].0xb1bed465 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66170 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189222.974917:0:66170:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9dc0755a5200/0xcc1762b626f8bc82 lrc: 2/0,0 mode: PR/PR res: [0x240006991:0xc:0x0].0xb1bed465 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66170 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189222.974922:0:66170:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9dc0755a5200/0xcc1762b626f8bc82 lrc: 3/0,0 mode: PR/PR res: [0x240006991:0xc:0x0].0xb1bed465 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66170 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189222.974927:0:66170:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc0755a5200 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:3.0:1784189222.974929:0:66170:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9dc0755a5200/0xcc1762b626f8bc82 lrc: 3/0,0 mode: PR/PR res: [0x240006991:0xc:0x0].0xb1bed465 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66170 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189222.974944:0:66170:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9dc0755a5200/0xcc1762b626f8bc82 lrc: 4/0,0 mode: PR/PR res: [0x240006991:0xc:0x0].0xb1bed465 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66170 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189222.974953:0:66170:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240006991:0xc:0x0].0xb1bed465 (ffff9dc07fab4800) 00010000:00010000:3.0:1784189222.974955:0:66170:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784189222.974958:0:66170:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9dc0755a5200/0xcc1762b626f8bc82 lrc: 2/0,0 mode: --/PR res: [0x240006991:0xc:0x0].0xb1bed465 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66170 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189222.975303:0:66170:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9dc0755a5200/0xcc1762b626f8bc82 lrc: 0/0,0 mode: --/PR res: [0x240006991:0xc:0x0].0xb1bed465 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66170 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189222.975360:0:66170:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9dc0755a5a00/0xcc1762b626f8bc74 lrc: 1/0,0 mode: --/CR res: [0x240006991:0xc:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c3f75 expref: 9 pid: 66170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189222.975372:0:66170:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240006991:0xc:0x0].0x0 (ffff9dc074ae2200) 00010000:00010000:3.0:1784189222.975374:0:66170:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784189222.975378:0:66170:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9dc0755a5a00/0xcc1762b626f8bc74 lrc: 0/0,0 mode: --/CR res: [0x240006991:0xc:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c3f75 expref: 9 pid: 66170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189222.975389:0:66170:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc0755a5a00, rc 0) 00000100:00100000:3.0:1784189222.975457:0:66170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc050541c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:debedd94-805c-42a0-a5e5-41758b2012e9+8:71032:x1870854436296064:12345-192.168.203.12@tcp:101:cp.0 Request processed in 1268us (1562us total) trans 0 rc 301/301 00000100:00100000:3.0:1784189222.975466:0:66170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1313 00000100:00100000:0.0:1784189222.979586:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1784189222.979682:0:66179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436296192 00000100:00100000:1.0:1784189222.979691:0:66179:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436296192 00000100:00100000:1.0:1784189222.979746:0:66179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 13 00000100:00100000:1.0:1784189222.979768:0:66179:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf425fad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0001:debedd94-805c-42a0-a5e5-41758b2012e9+8:71032:x1870854436296192:12345-192.168.203.12@tcp:700:cp.0 00000020:02000000:1.0:1784189222.979792:0:66179:0:(tgt_handler.c:884:tgt_request_handle()) *** cfs_fail_loc=123, val=2147483648*** 00000100:00100000:1.0:1784189222.986044:0:66179:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf425fad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0001:debedd94-805c-42a0-a5e5-41758b2012e9+8:71032:x1870854436296192:12345-192.168.203.12@tcp:700:cp.0 Request processed in 6268us (6455us total) trans 0 rc 0/-999 00000100:00100000:1.0:1784189222.986059:0:66179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 13 00010000:00010000:2.0:1784189223.663727:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1784189224.500498:0:90949:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of debedd94-805c-42a0-a5e5-41758b2012e9 00000001:00100000:1.0:1784189224.500510:0:90949:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of b90fcc1c-0e69-42a4-a116-a71fec7aeb78 00000001:00080000:1.0:1784189224.500518:0:90949:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 111669149700 is committed 00000020:00000080:1.0:1784189224.500535:0:90949:0:(genops.c:906:class_export_put()) final put ffff9dc075657000/b90fcc1c-0e69-42a4-a116-a71fec7aeb78 00000020:00000080:3.0:1784189224.500802:0:89010:0:(genops.c:865:class_export_destroy()) destroying export ffff9dc075657000/b90fcc1c-0e69-42a4-a116-a71fec7aeb78 for lustre-MDT0000 00000020:00000080:3.0:1784189224.500868:0:89010:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9dbf43d8c800 for lustre-MDT0000 00000001:00100000:1.0:1784189224.501187:0:8423:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of debedd94-805c-42a0-a5e5-41758b2012e9 00000001:00100000:1.0:1784189224.501193:0:8423:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of b90fcc1c-0e69-42a4-a116-a71fec7aeb78 00000020:00000080:1.0:1784189224.501196:0:8423:0:(genops.c:906:class_export_put()) final put ffff9dc075656800/b90fcc1c-0e69-42a4-a116-a71fec7aeb78 00000020:00000080:0.0:1784189224.501428:0:63468:0:(genops.c:865:class_export_destroy()) destroying export ffff9dc075656800/b90fcc1c-0e69-42a4-a116-a71fec7aeb78 for lustre-OST0000 00000020:00000080:0.0:1784189224.501476:0:63468:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9dc075654800 for lustre-OST0000 00000001:00100000:2.0:1784189224.501630:0:75588:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of debedd94-805c-42a0-a5e5-41758b2012e9 00000001:00100000:2.0:1784189224.501636:0:75588:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of b90fcc1c-0e69-42a4-a116-a71fec7aeb78 00000001:00080000:2.0:1784189224.501643:0:75588:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 81604378739 is committed 00000020:00000080:2.0:1784189224.501652:0:75588:0:(genops.c:906:class_export_put()) final put ffff9dc04ffb1800/b90fcc1c-0e69-42a4-a116-a71fec7aeb78 00000020:00080000:2.0:1784189224.501669:0:75588:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0001-osd tmt ffff9dbf445d3240 refcount 2 committed 0 result 0 batchid 77309411386 00000020:00080000:2.0:1784189224.501674:0:75588:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9dc062013600 obd lustre-MDT0000-osp-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff9dbf445d3300 00000020:00080000:2.0:1784189224.501678:0:75588:0:(update_trans.c:71:top_multiple_thandle_dump()) cookie [0x2000088d1:0x2:0x0].2 00000020:00080000:2.0:1784189224.501681:0:75588:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9dc062013400 obd lustre-MDT0001-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9dc0565a5a00 00000020:00080000:2.0:1784189224.501683:0:75588:0:(update_trans.c:71:top_multiple_thandle_dump()) cookie [0x2400090a0:0x2:0x0].2 00000020:00000080:3.0:1784189224.501812:0:89010:0:(genops.c:865:class_export_destroy()) destroying export ffff9dc04ffb1800/b90fcc1c-0e69-42a4-a116-a71fec7aeb78 for lustre-MDT0001 00000020:00080000:0.0:1784189224.501843:0:75608:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 77309411386 committed batchid 77309411385 00000020:00000080:3.0:1784189224.501863:0:89010:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9dc06bb5d000 for lustre-MDT0001 00000020:00080000:0.0:1784189224.501904:0:75608:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 77309411385 00000001:00100000:0.0:1784189224.502039:0:9506:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of debedd94-805c-42a0-a5e5-41758b2012e9 00000001:00100000:0.0:1784189224.502046:0:9506:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of b90fcc1c-0e69-42a4-a116-a71fec7aeb78 00000020:00000080:0.0:1784189224.502048:0:9506:0:(genops.c:906:class_export_put()) final put ffff9dbf42275000/b90fcc1c-0e69-42a4-a116-a71fec7aeb78 00000020:00000080:2.0:1784189224.502198:0:63468:0:(genops.c:865:class_export_destroy()) destroying export ffff9dbf42275000/b90fcc1c-0e69-42a4-a116-a71fec7aeb78 for lustre-OST0001 00000020:00000080:2.0:1784189224.502234:0:63468:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9dbf42276800 for lustre-OST0001 00010000:00010000:3.0:1784189224.687593:0:7454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784189225.007652:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc080e7d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:bd553d0d-03e2-4233-b06b-b55bbfa2b954:3643:1870854458152960:0@lo:400:kworker.0 00000100:00100000:3.0:1784189225.007719:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784189225.007882:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc05eddc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3643:1870854458153472:0@lo:400:kworker.0 00000100:00100000:1.0:1784189225.007886:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc05ed38700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3640:1870854458153088:0@lo:400:kworker.0 00000100:00100000:1.0:1784189225.007929:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc05eddf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3642:1870854458153344:0@lo:400:kworker.0 00000100:00100000:1.0:1784189225.007953:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc05ed3b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3641:1870854458153216:0@lo:400:kworker.0 00000100:00100000:0.0:1784189225.008737:0:90954:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458152960 00000100:00100000:0.0:1784189225.008746:0:90954:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458152960 00000100:00100000:0.0:1784189225.008801:0:90954:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1784189225.008812:0:90954:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc056807050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd553d0d-03e2-4233-b06b-b55bbfa2b954+24:3643:x1870854458152960:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784189225.008813:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784189225.008854:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc07b5e0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3643:1870854458153984:0@lo:400:kworker.0 00000100:00100000:0.0:1784189225.008872:0:90954:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc056807050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd553d0d-03e2-4233-b06b-b55bbfa2b954+24:3643:x1870854458152960:12345-0@lo:400:kworker.0 Request processed in 63us (1153us total) trans 0 rc 0/0 00000100:00100000:0.0:1784189225.008880:0:90954:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1784189225.008881:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784189225.008895:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc06b98dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3643:1870854458154496:0@lo:400:kworker.0 00000100:00100000:3.0:1784189225.008989:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784189225.009032:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc080e7d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:bd553d0d-03e2-4233-b06b-b55bbfa2b954:3643:1870854458152960:0@lo:400:kworker.0 00000100:00100000:3.0:1784189225.009064:0:68287:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458153984 00000100:00100000:3.0:1784189225.009067:0:68287:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458153984 00000100:00100000:3.0:1784189225.009094:0:68287:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458154496 00000100:00100000:3.0:1784189225.009097:0:68287:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458154496 00000100:00100000:3.0:1784189225.009113:0:68287:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1228 00000100:00100000:3.0:1784189225.009119:0:68287:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc06b98fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1870854458153984:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784189225.009155:0:68287:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc06b98fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1870854458153984:12345-0@lo:400:kworker.0 Request processed in 37us (273us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189225.009161:0:68287:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1228 00000100:00100000:3.0:1784189225.009174:0:68287:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1229 00000100:00100000:3.0:1784189225.009180:0:68287:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc07b5b3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1870854458154496:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784189225.009202:0:68287:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc07b5b3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1870854458154496:12345-0@lo:400:kworker.0 Request processed in 23us (285us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189225.009207:0:68287:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1229 00000100:00100000:3.0:1784189225.009227:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784189225.009254:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc080f6a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1870854458153728:0@lo:400:kworker.0 00000100:00100000:3.0:1784189225.009864:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784189225.009889:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc075aa1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1870854458154240:0@lo:400:kworker.0 00000100:00100000:3.0:1784189225.009912:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784189225.009958:0:68287:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458153216 00000100:00100000:3.0:1784189225.009963:0:68287:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458153216 00000100:00100000:3.0:1784189225.010001:0:68287:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1230 00000100:00100000:3.0:1784189225.010009:0:68287:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc07b5b1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1870854458153216:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784189225.010050:0:68287:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc07b5b1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1870854458153216:12345-0@lo:400:kworker.0 Request processed in 42us (821us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189225.010056:0:68287:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1230 00000100:00100000:3.0:1784189225.010075:0:26166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458153728 00000100:00100000:3.0:1784189225.010079:0:26166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458153728 00000100:00100000:3.0:1784189225.010104:0:26166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458154240 00000100:00100000:3.0:1784189225.010108:0:26166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458154240 00000100:00100000:3.0:1784189225.010129:0:26166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2492 00000100:00100000:3.0:1784189225.010135:0:26166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc080e7d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+5:3641:x1870854458153728:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784189225.010165:0:26166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc080e7d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+5:3641:x1870854458153728:12345-0@lo:400:kworker.0 Request processed in 30us (302us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189225.010171:0:26166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2492 00000100:00100000:3.0:1784189225.010183:0:26166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2493 00000100:00100000:3.0:1784189225.010189:0:26166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc05edd7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+5:3641:x1870854458154240:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784189225.010214:0:26166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc05edd7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+5:3641:x1870854458154240:12345-0@lo:400:kworker.0 Request processed in 25us (302us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189225.010220:0:26166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2493 00000100:00080000:3.0:1784189225.010236:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1784189225.010240:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1784189225.010300:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc05ed3b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3641:1870854458153216:0@lo:400:kworker.0 00000100:00100000:3.0:1784189225.010312:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc080f6a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1870854458153728:0@lo:400:kworker.0 00000100:00100000:3.0:1784189225.010347:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc075aa1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1870854458154240:0@lo:400:kworker.0 00000100:00100000:3.0:1784189225.010379:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784189225.010401:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf4693e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1870854458153856:0@lo:400:kworker.0 00000100:00100000:3.0:1784189225.010425:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784189225.010441:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc075aa0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1870854458154368:0@lo:400:kworker.0 00000100:00100000:3.0:1784189225.010475:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784189225.010503:0:66170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458153344 00000100:00100000:3.0:1784189225.010507:0:66170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458153344 00000100:00100000:3.0:1784189225.010534:0:66170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1231 00000100:00100000:3.0:1784189225.010540:0:66170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc05edd4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3642:x1870854458153344:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784189225.010585:0:66170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc05edd4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3642:x1870854458153344:12345-0@lo:400:kworker.0 Request processed in 44us (205us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189225.010591:0:66170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1231 00000100:00100000:3.0:1784189225.010608:0:26167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458153856 00000100:00100000:3.0:1784189225.010611:0:26167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458153856 00000100:00100000:3.0:1784189225.010633:0:26167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458154368 00000100:00100000:3.0:1784189225.010636:0:26167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458154368 00000100:00100000:3.0:1784189225.010655:0:26167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2494 00000100:00100000:3.0:1784189225.010661:0:26167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc075aa1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0001-mdtlov_UUID+5:3642:x1870854458153856:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784189225.010691:0:26167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc075aa1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0001-mdtlov_UUID+5:3642:x1870854458153856:12345-0@lo:400:kworker.0 Request processed in 30us (265us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189225.010697:0:26167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2494 00000100:00100000:3.0:1784189225.010709:0:26167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2495 00000100:00100000:3.0:1784189225.010715:0:26167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc080f6a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+5:3642:x1870854458154368:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784189225.010749:0:26167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc080f6a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+5:3642:x1870854458154368:12345-0@lo:400:kworker.0 Request processed in 33us (273us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189225.010755:0:26167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2495 00000100:00080000:3.0:1784189225.010789:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1784189225.010792:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1784189225.010801:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784189225.010827:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc080f6aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1870854458153600:0@lo:400:kworker.0 00000100:00100000:3.0:1784189225.010853:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784189225.010872:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc07016dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1870854458154112:0@lo:400:kworker.0 00000100:00100000:3.0:1784189225.010894:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784189225.010911:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc07ab9ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1870854458154624:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1784189225.010931:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784189225.010961:0:23826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458153600 00000100:00100000:3.0:1784189225.010965:0:23826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458153600 00000100:00100000:3.0:1784189225.010988:0:23826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458154112 00000100:00100000:3.0:1784189225.010991:0:23826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458154112 00000100:00100000:3.0:1784189225.011001:0:23826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458154624 00000100:00100000:3.0:1784189225.011003:0:23826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458154624 00000100:00100000:3.0:1784189225.011014:0:23826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3836 00000100:00100000:3.0:1784189225.011019:0:23826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf46903480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3640:x1870854458153600:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784189225.011055:0:23826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf46903480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3640:x1870854458153600:12345-0@lo:400:kworker.0 Request processed in 35us (201us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189225.011062:0:23826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3836 00000100:00100000:3.0:1784189225.011074:0:23826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3837 00000100:00100000:3.0:1784189225.011080:0:23826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf44bc1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3640:x1870854458154112:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784189225.011106:0:23826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf44bc1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3640:x1870854458154112:12345-0@lo:400:kworker.0 Request processed in 26us (211us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189225.011121:0:23826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3837 00000100:00100000:3.0:1784189225.011133:0:23826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3838 00000100:00100000:3.0:1784189225.011139:0:23826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf44bc1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3640:x1870854458154624:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1784189225.011162:0:23826:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445277696 avail 1299038208 00000100:00100000:3.0:1784189225.011192:0:23826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf44bc1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3640:x1870854458154624:12345-0@lo:41:osp-pre-0-1.0 Request processed in 53us (260us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189225.011198:0:23826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3838 00000100:00100000:3.0:1784189225.011222:0:66171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458153088 00000100:00100000:3.0:1784189225.011226:0:66171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458153088 00000100:00100000:3.0:1784189225.011252:0:66171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1232 00000100:00100000:3.0:1784189225.011259:0:66171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc05ed3b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1870854458153088:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784189225.011287:0:66171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc05ed3b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1870854458153088:12345-0@lo:400:kworker.0 Request processed in 28us (484us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189225.011293:0:66171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1232 00000100:00080000:3.0:1784189225.011305:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1784189225.011348:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc05eddf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3642:1870854458153344:0@lo:400:kworker.0 00000100:00100000:3.0:1784189225.011359:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf4693e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1870854458153856:0@lo:400:kworker.0 00000100:00100000:3.0:1784189225.011368:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc075aa0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1870854458154368:0@lo:400:kworker.0 00000100:00100000:3.0:1784189225.011399:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc05ed38700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3640:1870854458153088:0@lo:400:kworker.0 00000100:00100000:3.0:1784189225.011409:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc080f6aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1870854458153600:0@lo:400:kworker.0 00000100:00100000:3.0:1784189225.011417:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc07016dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1870854458154112:0@lo:400:kworker.0 00000100:00100000:3.0:1784189225.011430:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc07ab9ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1870854458154624:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1784189225.011592:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc07b5e0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3643:1870854458153984:0@lo:400:kworker.0 00000100:00100000:3.0:1784189225.011605:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc06b98dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3643:1870854458154496:0@lo:400:kworker.0 00000100:00100000:0.0:1784189225.012877:0:66169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458153472 00000100:00100000:0.0:1784189225.012886:0:66169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458153472 00000100:00080000:3.0:1784189225.013007:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1784189225.013113:0:66169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1233 00000100:00100000:0.0:1784189225.013124:0:66169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc06b98e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1870854458153472:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784189225.013200:0:66169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc06b98e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1870854458153472:12345-0@lo:400:kworker.0 Request processed in 78us (5278us total) trans 0 rc 0/0 00000100:00100000:0.0:1784189225.013207:0:66169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1233 00000100:00100000:0.0:1784189225.013740:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc05eddc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3643:1870854458153472:0@lo:400:kworker.0 00000100:00100000:0.0:1784189225.013809:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc07ab9a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1870854458154752:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1784189225.013863:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784189225.014032:0:23826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458154752 00000100:00100000:3.0:1784189225.014038:0:23826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458154752 00000100:00100000:3.0:1784189225.014107:0:23826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3839 00000100:00100000:3.0:1784189225.014115:0:23826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc06bbf3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3641:x1870854458154752:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1784189225.014144:0:23826:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445568512 avail 1299329024 00000100:00100000:3.0:1784189225.014185:0:23826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc06bbf3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3641:x1870854458154752:12345-0@lo:41:osp-pre-1-0.0 Request processed in 71us (321us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189225.014192:0:23826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3839 00000100:00100000:0.0:1784189225.014250:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc07ab9a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1870854458154752:0@lo:41:osp-pre-1-0.0 00000020:01000004:2.0:1784189225.442468:0:91969:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:2.0:1784189225.442521:0:91969:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff9dc07116e000/0xcc1762b626f8b7a4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc1762b626f8b7ab expref: -99 pid: 90948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189225.442536:0:91969:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff9dc07116e000/0xcc1762b626f8b7a4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0xcc1762b626f8b7ab expref: -99 pid: 90948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189225.442545:0:91969:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff9dc07116e000/0xcc1762b626f8b7a4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0xcc1762b626f8b7ab expref: -99 pid: 90948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189225.442584:0:91969:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.112@tcp lock: ffff9dc07116e000/0xcc1762b626f8b7a4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0xcc1762b626f8b7ab expref: -99 pid: 90948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189225.442603:0:91969:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1784189225.442609:0:91969:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:2.0:1784189225.442637:0:91969:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1784189225.442642:0:91969:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:2.0:1784189225.442648:0:91969:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1784189225.442672:0:91969:0:(import.c:65:import_set_state_nolock()) ffff9dc04979c000 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00010000:00010000:1.0:1784189225.442892:0:26173:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784189225.442899:0:26173:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.112@tcp lock: ffff9dc07116e000/0xcc1762b626f8b7a4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0xcc1762b626f8b7ab expref: -99 pid: 90948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189225.442908:0:26173:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc07116e000 already unused, calling callback (ffffffffc114ac20) 10000000:00010000:1.0:1784189225.443028:0:26173:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.112@tcp lock: ffff9dc07116e000/0xcc1762b626f8b7a4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0xcc1762b626f8b7ab expref: -99 pid: 90948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189225.443039:0:26173:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.112@tcp lock: ffff9dc07116e000/0xcc1762b626f8b7a4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1008400000000 nid: local remote: 0xcc1762b626f8b7ab expref: -99 pid: 90948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1784189225.443058:0:26173:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.112@tcp lock: ffff9dc07116e000/0xcc1762b626f8b7a4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1009400000000 nid: local remote: 0xcc1762b626f8b7ab expref: -99 pid: 90948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784189225.443070:0:26173:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1784189225.443075:0:26173:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:1.0:1784189225.443078:0:26173:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:1.0:1784189225.443110:0:26173:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.112@tcp lock: ffff9dc07116e000/0xcc1762b626f8b7a4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0xcc1762b626f8b7ab expref: -99 pid: 90948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189225.443116:0:26173:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1784189225.443142:0:26173:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.112@tcp lock: ffff9dc07116e000/0xcc1762b626f8b7a4 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0xcc1762b626f8b7ab expref: -99 pid: 90948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189225.443151:0:26173:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.112@tcp lock: ffff9dc07116e000/0xcc1762b626f8b7a4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0xcc1762b626f8b7ab expref: -99 pid: 90948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189225.443164:0:26173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784189225.443166:0:26173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784189225.443168:0:26173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784189225.443232:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc07ab9a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bd553d0d-03e2-4233-b06b-b55bbfa2b954:3642:1870854458155008:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1784189225.443302:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784189225.443437:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458155008 00000100:00100000:1.0:1784189225.443444:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458155008 00000100:00100000:1.0:1784189225.443497:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 703 00000100:00100000:1.0:1784189225.443506:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc06b98dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bd553d0d-03e2-4233-b06b-b55bbfa2b954+24:3642:x1870854458155008:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1784189225.443524:0:6499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784189225.443538:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dc058f67200/0xcc1762b626f8b7ab lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xcc1762b626f8b7a4 expref: 24 pid: 90955 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189225.443560:0:6499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784189225.443599:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc06b98dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bd553d0d-03e2-4233-b06b-b55bbfa2b954+23:3642:x1870854458155008:12345-0@lo:103:ldlm_bl.0 Request processed in 94us (297us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189225.443613:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 703 00000100:00100000:1.0:1784189225.443650:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc07ab9a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bd553d0d-03e2-4233-b06b-b55bbfa2b954:3642:1870854458155008:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1784189225.444077:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc07b7e3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3639:1870854458154880:0@lo:39:umount.0 00000100:00100000:0.0:1784189225.444443:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784189225.448526:0:66171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458154880 00000100:00100000:3.0:1784189225.448541:0:66171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458154880 00000100:00100000:3.0:1784189225.448621:0:66171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1314 00000100:00100000:3.0:1784189225.448632:0:66171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc06bbf3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1870854458154880:12345-0@lo:39:umount.0 00000020:00000080:3.0:1784189225.448663:0:66171:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xcc1762b626f8b8a0 00000100:00080000:3.0:1784189225.448671:0:66171:0:(import.c:65:import_set_state_nolock()) ffff9dc075487800 : changing import state from FULL to CLOSED 00010000:00010000:2.0:1784189225.449259:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784189225.450444:0:66171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc06bbf3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+1:3639:x1870854458154880:12345-0@lo:39:umount.0 Request processed in 1807us (5994us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189225.450464:0:66171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1314 00000020:00000080:3.0:1784189225.450481:0:66171:0:(genops.c:906:class_export_put()) final put ffff9dc07a886800/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:2.0:1784189225.450563:0:89010:0:(genops.c:865:class_export_destroy()) destroying export ffff9dc07a886800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000020:00000080:2.0:1784189225.450624:0:89010:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9dc075487800 for lustre-MDT0000 00000100:00080000:0.0:1784189225.450796:0:3639:0:(import.c:65:import_set_state_nolock()) ffff9dc04979c000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:0.0:1784189225.450814:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc07b7e3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3639:1870854458154880:0@lo:39:umount.0 00000100:00080000:2.0:1784189225.450937:0:91969:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1784189225.450941:0:91969:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:2.0:1784189225.450946:0:91969:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:2.0:1784189225.452376:0:91969:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff9dc05ec0f200/0xcc1762b626f8b6d2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc1762b626f8b6d9 expref: -99 pid: 90948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189225.452830:0:91969:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff9dc05ec0f200/0xcc1762b626f8b6d2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0xcc1762b626f8b6d9 expref: -99 pid: 90948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189225.452840:0:91969:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff9dc05ec0f200/0xcc1762b626f8b6d2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0xcc1762b626f8b6d9 expref: -99 pid: 90948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189225.453432:0:91969:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.112@tcp lock: ffff9dc05ec0f200/0xcc1762b626f8b6d2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0xcc1762b626f8b6d9 expref: -99 pid: 90948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189225.453456:0:91969:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1784189225.453472:0:91969:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff9dc07116fa00/0xcc1762b626f8b7c7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc1762b626f8b7ce expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189225.453480:0:91969:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff9dc07116fa00/0xcc1762b626f8b7c7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xcc1762b626f8b7ce expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189225.453487:0:91969:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff9dc07116fa00/0xcc1762b626f8b7c7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xcc1762b626f8b7ce expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189225.453493:0:91969:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.112@tcp lock: ffff9dc07116fa00/0xcc1762b626f8b7c7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xcc1762b626f8b7ce expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189225.453511:0:91969:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1784189225.453517:0:91969:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff9dc04a20b400/0xcc1762b626f8b796 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc1762b626f8b79d expref: -99 pid: 90948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189225.453525:0:91969:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff9dc04a20b400/0xcc1762b626f8b796 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xcc1762b626f8b79d expref: -99 pid: 90948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189225.453532:0:91969:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff9dc04a20b400/0xcc1762b626f8b796 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xcc1762b626f8b79d expref: -99 pid: 90948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189225.453539:0:91969:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.112@tcp lock: ffff9dc04a20b400/0xcc1762b626f8b796 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xcc1762b626f8b79d expref: -99 pid: 90948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189225.453660:0:7454:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1784189225.453668:0:7454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.112@tcp lock: ffff9dc05ec0f200/0xcc1762b626f8b6d2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0xcc1762b626f8b6d9 expref: -99 pid: 90948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189225.453676:0:7454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc05ec0f200 already unused, calling callback (ffffffffc114ac20) 10000000:00010000:0.0:1784189225.453680:0:7454:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.112@tcp lock: ffff9dc05ec0f200/0xcc1762b626f8b6d2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0xcc1762b626f8b6d9 expref: -99 pid: 90948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189225.453689:0:7454:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.112@tcp lock: ffff9dc05ec0f200/0xcc1762b626f8b6d2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1008400000000 nid: local remote: 0xcc1762b626f8b6d9 expref: -99 pid: 90948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1784189225.453696:0:7454:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.112@tcp lock: ffff9dc05ec0f200/0xcc1762b626f8b6d2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1009400000000 nid: local remote: 0xcc1762b626f8b6d9 expref: -99 pid: 90948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784189225.453702:0:7454:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1784189225.453704:0:7454:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 00010000:00010000:0.0:1784189225.453737:0:7454:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.112@tcp lock: ffff9dc05ec0f200/0xcc1762b626f8b6d2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0xcc1762b626f8b6d9 expref: -99 pid: 90948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189225.453744:0:7454:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1784189225.453792:0:7454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.112@tcp lock: ffff9dc05ec0f200/0xcc1762b626f8b6d2 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0xcc1762b626f8b6d9 expref: -99 pid: 90948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189225.453812:0:7454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.112@tcp lock: ffff9dc05ec0f200/0xcc1762b626f8b6d2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0xcc1762b626f8b6d9 expref: -99 pid: 90948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189225.453828:0:7454:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784189225.453831:0:7454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.112@tcp lock: ffff9dc07116fa00/0xcc1762b626f8b7c7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xcc1762b626f8b7ce expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189225.453838:0:7454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc07116fa00 already unused, calling callback (ffffffffc114ac20) 10000000:00010000:0.0:1784189225.453841:0:7454:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.112@tcp lock: ffff9dc07116fa00/0xcc1762b626f8b7c7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xcc1762b626f8b7ce expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189225.453859:0:7454:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.112@tcp lock: ffff9dc07116fa00/0xcc1762b626f8b7c7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xcc1762b626f8b7ce expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1784189225.453867:0:7454:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.112@tcp lock: ffff9dc07116fa00/0xcc1762b626f8b7c7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xcc1762b626f8b7ce expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784189225.453872:0:7454:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:0.0:1784189225.453874:0:7454:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:0.0:1784189225.453877:0:7454:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:0.0:1784189225.453893:0:7454:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.112@tcp lock: ffff9dc07116fa00/0xcc1762b626f8b7c7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xcc1762b626f8b7ce expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189225.453899:0:7454:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1784189225.454086:0:7454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.112@tcp lock: ffff9dc07116fa00/0xcc1762b626f8b7c7 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xcc1762b626f8b7ce expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189225.454095:0:7454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.112@tcp lock: ffff9dc07116fa00/0xcc1762b626f8b7c7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xcc1762b626f8b7ce expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189225.454115:0:7454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784189225.454117:0:7454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784189225.454118:0:7454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784189225.454137:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc06bbf2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:bd553d0d-03e2-4233-b06b-b55bbfa2b954:3643:1870854458155136:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1784189225.454199:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784189225.454254:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc080f6c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bd553d0d-03e2-4233-b06b-b55bbfa2b954:3640:1870854458155264:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1784189225.454275:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784189225.454306:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458155136 00000100:00100000:0.0:1784189225.454313:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458155136 00000100:00100000:0.0:1784189225.454373:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458155264 00000100:00100000:0.0:1784189225.454377:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458155264 00000100:00100000:0.0:1784189225.454400:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 704 00000100:00100000:0.0:1784189225.454408:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc080f6e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bd553d0d-03e2-4233-b06b-b55bbfa2b954+24:3643:x1870854458155136:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1784189225.454421:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784189225.454435:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dc07116e400/0xcc1762b626f8b6d9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xcc1762b626f8b6d2 expref: 24 pid: 90954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189225.454450:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784189225.454481:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc080f6e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bd553d0d-03e2-4233-b06b-b55bbfa2b954+23:3643:x1870854458155136:12345-0@lo:103:ldlm_bl.0 Request processed in 73us (281us total) trans 0 rc 0/0 00000100:00100000:0.0:1784189225.454488:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 704 00000100:00100000:0.0:1784189225.454504:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 705 00000100:00100000:0.0:1784189225.454511:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc080f6c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bd553d0d-03e2-4233-b06b-b55bbfa2b954+22:3640:x1870854458155264:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1784189225.454518:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784189225.454526:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dc05ec0ec00/0xcc1762b626f8b7ce lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xcc1762b626f8b7c7 expref: 22 pid: 90955 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189225.454655:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784189225.454878:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784189225.454948:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc080f6c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bd553d0d-03e2-4233-b06b-b55bbfa2b954:3640:1870854458155264:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1784189225.454970:0:91969:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1784189225.456073:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc080f6c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bd553d0d-03e2-4233-b06b-b55bbfa2b954+21:3640:x1870854458155264:12345-0@lo:103:ldlm_bl.0 Request processed in 1558us (1792us total) trans 0 rc 0/0 00000100:00100000:0.0:1784189225.456084:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 705 00000100:00100000:0.0:1784189225.456132:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc06bbf2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:bd553d0d-03e2-4233-b06b-b55bbfa2b954:3643:1870854458155136:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1784189225.456643:0:91969:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff9dc04a20bc00/0xcc1762b626f8b6b6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc1762b626f8b6c4 expref: -99 pid: 90948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189225.456655:0:91969:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff9dc04a20bc00/0xcc1762b626f8b6b6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xcc1762b626f8b6c4 expref: -99 pid: 90948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189225.456662:0:91969:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff9dc04a20bc00/0xcc1762b626f8b6b6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xcc1762b626f8b6c4 expref: -99 pid: 90948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189225.456669:0:91969:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.112@tcp lock: ffff9dc04a20bc00/0xcc1762b626f8b6b6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xcc1762b626f8b6c4 expref: -99 pid: 90948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189225.457051:0:26173:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1784189225.457060:0:26173:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.112@tcp lock: ffff9dc04a20b400/0xcc1762b626f8b796 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xcc1762b626f8b79d expref: -99 pid: 90948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189225.457081:0:26173:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc04a20b400 already unused, calling callback (ffffffffc114ac20) 10000000:00010000:3.0:1784189225.457086:0:26173:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.112@tcp lock: ffff9dc04a20b400/0xcc1762b626f8b796 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xcc1762b626f8b79d expref: -99 pid: 90948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189225.457095:0:26173:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.112@tcp lock: ffff9dc04a20b400/0xcc1762b626f8b796 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0xcc1762b626f8b79d expref: -99 pid: 90948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1784189225.457102:0:26173:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.112@tcp lock: ffff9dc04a20b400/0xcc1762b626f8b796 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0xcc1762b626f8b79d expref: -99 pid: 90948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784189225.457108:0:26173:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:3.0:1784189225.457111:0:26173:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:3.0:1784189225.457113:0:26173:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:3.0:1784189225.457146:0:26173:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.112@tcp lock: ffff9dc04a20b400/0xcc1762b626f8b796 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xcc1762b626f8b79d expref: -99 pid: 90948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189225.457152:0:26173:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1784189225.457206:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00010000:00010000:3.0:1784189225.457277:0:26173:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.112@tcp lock: ffff9dc04a20b400/0xcc1762b626f8b796 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xcc1762b626f8b79d expref: -99 pid: 90948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189225.457285:0:26173:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.112@tcp lock: ffff9dc04a20b400/0xcc1762b626f8b796 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xcc1762b626f8b79d expref: -99 pid: 90948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189225.457299:0:26173:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784189225.457302:0:26173:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.112@tcp lock: ffff9dc04a20bc00/0xcc1762b626f8b6b6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xcc1762b626f8b6c4 expref: -99 pid: 90948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189225.457308:0:26173:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc04a20bc00 already unused, calling callback (ffffffffc114ac20) 10000000:00010000:3.0:1784189225.457311:0:26173:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.112@tcp lock: ffff9dc04a20bc00/0xcc1762b626f8b6b6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xcc1762b626f8b6c4 expref: -99 pid: 90948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189225.457338:0:26173:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.112@tcp lock: ffff9dc04a20bc00/0xcc1762b626f8b6b6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xcc1762b626f8b6c4 expref: -99 pid: 90948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1784189225.457345:0:26173:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.112@tcp lock: ffff9dc04a20bc00/0xcc1762b626f8b6b6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xcc1762b626f8b6c4 expref: -99 pid: 90948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784189225.457351:0:26173:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:3.0:1784189225.457353:0:26173:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 00010000:00010000:3.0:1784189225.457368:0:26173:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.112@tcp lock: ffff9dc04a20bc00/0xcc1762b626f8b6b6 lrc: 3/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xcc1762b626f8b6c4 expref: -99 pid: 90948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189225.457372:0:26173:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1784189225.457390:0:26173:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.112@tcp lock: ffff9dc04a20bc00/0xcc1762b626f8b6b6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xcc1762b626f8b6c4 expref: -99 pid: 90948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189225.457397:0:26173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784189225.457398:0:26173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784189225.457400:0:26173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784189225.457406:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1784189225.457420:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc07fb34380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:bd553d0d-03e2-4233-b06b-b55bbfa2b954:3643:1870854458155520:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1784189225.457482:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784189225.457572:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458155520 00000100:00100000:1.0:1784189225.457579:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458155520 00010000:00010000:0.0:1784189225.457667:0:91969:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1784189225.457673:0:91969:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.112@tcp lock: ffff9dc04a20bc00/0xcc1762b626f8b6b6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xcc1762b626f8b6c4 expref: -99 pid: 90948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784189225.457683:0:91969:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 10000000:01000000:0.0:1784189225.457688:0:91969:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 10000000:01000000:0.0:1784189225.457692:0:91969:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00000100:00100000:1.0:1784189225.457724:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 706 00000020:01000004:0.0:1784189225.457731:0:91969:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-MDT0000 00000100:00100000:1.0:1784189225.457737:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc07fb35880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bd553d0d-03e2-4233-b06b-b55bbfa2b954+21:3643:x1870854458155520:12345-0@lo:103:ldlm_bl.0 00000020:01000000:0.0:1784189225.457737:0:91969:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='FA') 00000020:00000080:0.0:1784189225.457744:0:91969:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00010000:00010000:1.0:1784189225.457753:0:6499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000020:02000400:0.0:1784189225.457772:0:91969:0:(obd_config.c:932:class_cleanup()) Failing over lustre-MDT0000 00010000:00010000:1.0:1784189225.458010:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dc07116e200/0xcc1762b626f8b6c4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xcc1762b626f8b6b6 expref: 21 pid: 90955 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189225.458026:0:6499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784189225.458067:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc07fb35880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bd553d0d-03e2-4233-b06b-b55bbfa2b954+20:3643:x1870854458155520:12345-0@lo:103:ldlm_bl.0 Request processed in 335us (584us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189225.458075:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 706 00000100:00100000:1.0:1784189225.458113:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc07fb34380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:bd553d0d-03e2-4233-b06b-b55bbfa2b954:3643:1870854458155520:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1784189225.459667:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc07b5e0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bd553d0d-03e2-4233-b06b-b55bbfa2b954:3640:1870854458155392:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1784189225.459724:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784189225.459786:0:7455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458155392 00000100:00100000:1.0:1784189225.459798:0:7455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458155392 00000100:00100000:1.0:1784189225.459857:0:7455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 707 00000100:00100000:1.0:1784189225.459866:0:7455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc07b7e2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bd553d0d-03e2-4233-b06b-b55bbfa2b954+20:3640:x1870854458155392:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1784189225.459880:0:7455:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784189225.459900:0:7455:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dc07116ec00/0xcc1762b626f8b79d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xcc1762b626f8b796 expref: 20 pid: 90955 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189225.459916:0:7455:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784189225.459973:0:7455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc07b7e2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bd553d0d-03e2-4233-b06b-b55bbfa2b954+19:3640:x1870854458155392:12345-0@lo:103:ldlm_bl.0 Request processed in 107us (248us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189225.459981:0:7455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 707 00000100:00100000:2.0:1784189225.459998:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc07b5e0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bd553d0d-03e2-4233-b06b-b55bbfa2b954:3640:1870854458155392:0@lo:103:ldlm_bl.0 00000004:00000080:0.0:1784189225.460544:0:91969:0:(mdt_handler.c:8168:mdt_iocontrol()) lustre-MDT0000: cmd=40086672 len=0 karg=0000000000000000 uarg=0000000000000000 00010000:00010000:3.0:1784189225.460667:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1784189225.461136:0:91969:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 5/11 00000020:00080000:1.0:1784189225.461146:0:91969:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff9dbf43d8a000 debedd94-805c-42a0-a5e5-41758b2012e9 192.168.203.12@tcp 6 (0 0 2) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1784189225.461153:0:91969:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff9dc0715c0000 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1784189225.461157:0:91969:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff9dc07a885000 lustre-MDT0000-lwp-MDT0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1784189225.461162:0:91969:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff9dc06b8e4800 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1784189225.461166:0:91969:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff9dc075654000 lustre-MDT0001-mdtlov_UUID 0@lo 5 (0 0 0) 0 0 0 0: 0000000000000000 111669149699 stale:0 00000020:00080000:1.0:1784189225.461170:0:91969:0:(genops.c:1574:class_disconnect_exports()) OBD device 13 (ffff9dc049be3380) has exports, disconnecting them 00000020:00080000:1.0:1784189225.461175:0:91969:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 192.168.203.12@tcp (ffff9dbf43d8a000), last request at 1784189222 00000020:00000080:1.0:1784189225.461181:0:91969:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xcc1762b626f8bbef 00000020:00010000:1.0:1784189225.461191:0:91969:0:(genops.c:1942:obd_stale_export_put()) Put export ffff9dbf43d8a000: total 0 00000100:00080000:1.0:1784189225.461195:0:91969:0:(import.c:65:import_set_state_nolock()) ffff9dbf43d8e000 : changing import state from FULL to CLOSED 00000020:00080000:1.0:1784189225.461223:0:91969:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 192.168.203.12@tcp (ffff9dbf43d8a000): rc 0 00000020:00080000:1.0:1784189225.461226:0:91969:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9dc0715c0000), last request at 1784189225 00000020:00000080:1.0:1784189225.461229:0:91969:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xcc1762b626f8b8a7 00000100:00080000:1.0:1784189225.461233:0:91969:0:(import.c:65:import_set_state_nolock()) ffff9dc0715c4000 : changing import state from FULL to CLOSED 00000020:00080000:1.0:1784189225.461257:0:91969:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9dc0715c0000): rc 0 00000020:00000080:1.0:1784189225.461259:0:91969:0:(genops.c:906:class_export_put()) final put ffff9dc0715c0000/lustre-MDT0000-lwp-OST0000_UUID 00000020:00080000:1.0:1784189225.461277:0:91969:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9dc07a885000), last request at 1784189199 00000020:00000080:1.0:1784189225.461281:0:91969:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xcc1762b626f8b899 00000100:00080000:1.0:1784189225.461284:0:91969:0:(import.c:65:import_set_state_nolock()) ffff9dc07a883000 : changing import state from FULL to CLOSED 00000020:00080000:1.0:1784189225.461293:0:91969:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9dc07a885000): rc 0 00000020:00000080:1.0:1784189225.461295:0:91969:0:(genops.c:906:class_export_put()) final put ffff9dc07a885000/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00080000:1.0:1784189225.461299:0:91969:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9dc06b8e4800), last request at 1784189225 00000020:00000080:1.0:1784189225.461313:0:91969:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xcc1762b626f8b892 00000100:00080000:1.0:1784189225.461350:0:91969:0:(import.c:65:import_set_state_nolock()) ffff9dc07a882800 : changing import state from FULL to CLOSED 00000020:00080000:1.0:1784189225.461385:0:91969:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9dc06b8e4800): rc 0 00000020:00000080:1.0:1784189225.461389:0:91969:0:(genops.c:906:class_export_put()) final put ffff9dc06b8e4800/lustre-MDT0000-lwp-OST0001_UUID 00000020:00080000:1.0:1784189225.461396:0:91969:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9dc075654000), last request at 1784189193 00000020:00000080:1.0:1784189225.461400:0:91969:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xcc1762b626f8b718 00000100:00080000:1.0:1784189225.461409:0:91969:0:(import.c:65:import_set_state_nolock()) ffff9dc0715c2800 : changing import state from FULL to CLOSED 00000020:00080000:1.0:1784189225.461417:0:91969:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9dc075654000): rc 0 00000020:00000080:1.0:1784189225.461419:0:91969:0:(genops.c:906:class_export_put()) final put ffff9dc075654000/lustre-MDT0001-mdtlov_UUID 00000004:00000080:1.0:1784189225.461427:0:91969:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffae0981803ae0 00000020:00000080:2.0:1784189225.461434:0:63468:0:(genops.c:865:class_export_destroy()) destroying export ffff9dc0715c0000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00000080:2.0:1784189225.461473:0:63468:0:(genops.c:865:class_export_destroy()) destroying export ffff9dc07a885000/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000 00000020:00000080:2.0:1784189225.461492:0:63468:0:(genops.c:865:class_export_destroy()) destroying export ffff9dc06b8e4800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000100:00080000:1.0:1784189225.461509:0:91969:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000020:00000080:2.0:1784189225.461511:0:63468:0:(genops.c:865:class_export_destroy()) destroying export ffff9dc075654000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000 00000100:00100000:1.0:1784189225.461514:0:91969:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 3 00000020:00000080:2.0:1784189225.461538:0:63468:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9dc0715c4000 for lustre-MDT0000 00000020:00000080:2.0:1784189225.461544:0:63468:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9dc07a883000 for lustre-MDT0000 00000020:00000080:2.0:1784189225.461561:0:63468:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9dc07a882800 for lustre-MDT0000 00000020:00000080:2.0:1784189225.461564:0:63468:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9dc0715c2800 for lustre-MDT0000 00000020:00010000:3.0:1784189225.461783:0:6501:0:(genops.c:1928:obd_stale_export_get()) Get export ffff9dbf43d8a000: total 0 00010000:00010000:3.0:1784189225.461829:0:6501:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff9dbf43d8a000, canceled 0 locks, left on hash table 2. 00010000:00010000:3.0:1784189225.461862:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0565e7000/0xcc1762b626f8bc2e lrc: 0/0,0 mode: --/PR res: [0x240006991:0xb:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c3f59 expref: 3 pid: 66945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189225.461890:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4369c600/0xcc1762b626f8bc12 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c3f52 expref: 2 pid: 68287 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1784189225.462349:0:91969:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000100:00080000:1.0:1784189225.462372:0:91969:0:(import.c:65:import_set_state_nolock()) ffff9dbf4512e800 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00010000:00010000:0.0:1784189225.462757:0:7454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784189225.462783:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc07ab9a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3639:1870854458155648:0@lo:39:umount.0 00000100:00100000:0.0:1784189225.462844:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784189225.462935:0:26492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458155648 00000100:00100000:1.0:1784189225.462942:0:26492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458155648 00000100:00100000:1.0:1784189225.462985:0:26492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3840 00000100:00100000:1.0:1784189225.462993:0:26492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc080f6c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3639:x1870854458155648:12345-0@lo:39:umount.0 00000020:00000080:1.0:1784189225.463017:0:26492:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xcc1762b626f8b757 00000100:00080000:1.0:1784189225.463024:0:26492:0:(import.c:65:import_set_state_nolock()) ffff9dbf47454800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1784189225.463048:0:26492:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 19, last_transno is 81604378739 00010000:00010000:3.0:1784189225.463074:0:6501:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff9dbf43d8a000, canceled 2 locks, left on hash table 0. 00000100:00100000:1.0:1784189225.463198:0:26492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc080f6c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+3:3639:x1870854458155648:12345-0@lo:39:umount.0 Request processed in 204us (352us total) trans 81604378740 rc 0/0 00000100:00100000:1.0:1784189225.463206:0:26492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3840 00010000:00010000:0.0:1784189225.463853:0:7454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1784189225.463888:0:3639:0:(import.c:65:import_set_state_nolock()) ffff9dbf4512e800 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:0.0:1784189225.463895:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc07ab9a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3639:1870854458155648:0@lo:39:umount.0 00010000:00010000:0.0:1784189225.464676:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784189225.464683:0:26173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1784189225.467716:0:91969:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1784189225.467723:0:91969:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294968953 gen 3 00000004:00080000:1.0:1784189225.467791:0:91969:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:1.0:1784189225.467852:0:91969:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:1.0:1784189225.467892:0:91969:0:(import.c:65:import_set_state_nolock()) ffff9dc047a82000 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:2.0:1784189225.469998:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc07ab9ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3639:1870854458155776:0@lo:9:umount.0 00000100:00100000:2.0:1784189225.470075:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784189225.470140:0:26169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458155776 00000100:00100000:2.0:1784189225.470148:0:26169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458155776 00000100:00100000:2.0:1784189225.470198:0:26169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4969 00000100:00100000:2.0:1784189225.470207:0:26169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc07b7e3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+5:3639:x1870854458155776:12345-0@lo:9:umount.0 00000020:00000080:2.0:1784189225.470234:0:26169:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xcc1762b626f8b765 00000100:00080000:2.0:1784189225.470242:0:26169:0:(import.c:65:import_set_state_nolock()) ffff9dbf47452000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1784189225.470284:0:26169:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294968953 00000100:00100000:2.0:1784189225.470442:0:26169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc07b7e3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+2:3639:x1870854458155776:12345-0@lo:9:umount.0 Request processed in 235us (366us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189225.470450:0:26169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4969 00000100:00080000:2.0:1784189225.470492:0:3639:0:(import.c:65:import_set_state_nolock()) ffff9dc047a82000 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:1.0:1784189225.470554:0:91969:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1784189225.470558:0:91969:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294968956 gen 3 00000004:00080000:1.0:1784189225.470569:0:91969:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:1.0:1784189225.470627:0:91969:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:1.0:1784189225.470644:0:91969:0:(import.c:65:import_set_state_nolock()) ffff9dc06b8e7800 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:1.0:1784189225.470689:0:91969:0:(genops.c:1579:class_disconnect_exports()) OBD device 13 (ffff9dc049be3380) has no exports 00010000:00010000:0.0:1784189225.471874:0:7454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784189225.471956:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc06bbf2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:0:1870854458156032:0@lo:13:osp-pre-1-0.0 00000004:00080000:2.0:1784189225.473668:0:3639:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:2.0:1784189225.473676:0:3639:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1784189225.473683:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc07ab9ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3639:1870854458155776:0@lo:9:umount.0 00000100:00100000:2.0:1784189225.473718:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf469b5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3639:1870854458155904:0@lo:9:umount.0 00000100:00100000:2.0:1784189225.473803:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784189225.473884:0:9982:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458155904 00000100:00100000:2.0:1784189225.473891:0:9982:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458155904 00000100:00100000:2.0:1784189225.473932:0:9982:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4970 00000100:00100000:2.0:1784189225.473940:0:9982:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc07b7e0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3639:x1870854458155904:12345-0@lo:9:umount.0 00000020:00000080:2.0:1784189225.473964:0:9982:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xcc1762b626f8b781 00000100:00080000:2.0:1784189225.473973:0:9982:0:(import.c:65:import_set_state_nolock()) ffff9dc047a84000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1784189225.474011:0:9982:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294968956 00000100:00100000:2.0:1784189225.474132:0:9982:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc07b7e0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+2:3639:x1870854458155904:12345-0@lo:9:umount.0 Request processed in 192us (329us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189225.474140:0:9982:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4970 00000100:00080000:2.0:1784189225.474177:0:3639:0:(import.c:65:import_set_state_nolock()) ffff9dc06b8e7800 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:2.0:1784189225.474184:0:3639:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:2.0:1784189225.474186:0:3639:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1784189225.474189:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf469b5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3639:1870854458155904:0@lo:9:umount.0 00010000:00010000:0.0:1784189225.474358:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:1.0:1784189225.477888:0:91969:0:(genops.c:1579:class_disconnect_exports()) OBD device 13 (ffff9dc049be3380) has no exports 00000020:00000080:3.0:1784189225.504473:0:6501:0:(genops.c:906:class_export_put()) final put ffff9dbf43d8a000/debedd94-805c-42a0-a5e5-41758b2012e9 00010000:00010000:0.0:1784189225.504697:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784189225.504701:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784189225.504704:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1784189225.513117:0:89010:0:(genops.c:865:class_export_destroy()) destroying export ffff9dbf43d8a000/debedd94-805c-42a0-a5e5-41758b2012e9 for lustre-MDT0000 00000020:00000080:0.0:1784189225.513455:0:89010:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9dbf43d8e000 for lustre-MDT0000 00000020:00000080:1.0:1784189225.563415:0:91969:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xcc1762b626f8b72d 00000020:00000080:1.0:1784189225.563430:0:91969:0:(genops.c:906:class_export_put()) final put ffff9dc047a84800/lustre-QMT0000_UUID 00000020:01000000:1.0:1784189225.563451:0:91969:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:3.0:1784189225.563474:0:63468:0:(genops.c:865:class_export_destroy()) destroying export ffff9dc047a84800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:0.0:1784189225.563527:0:91969:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1784189225.563539:0:91969:0:(obd_config.c:955:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1784189225.563543:0:91969:0:(genops.c:1579:class_disconnect_exports()) OBD device 15 (ffff9dc0762999c0) has no exports 00000020:00000080:0.0:1784189225.564517:0:91969:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xcc1762b626f8b726 00000020:00000080:0.0:1784189225.564526:0:91969:0:(genops.c:906:class_export_put()) final put ffff9dbf47457800/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1784189225.564586:0:91969:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1784189225.564595:0:91969:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:0.0:1784189225.564597:0:91969:0:(genops.c:906:class_export_put()) final put ffff9dbf47455000/lustre-QMT0000_UUID 00000020:00000080:0.0:1784189225.564600:0:91969:0:(genops.c:865:class_export_destroy()) destroying export ffff9dbf47455000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:0.0:1784189225.564609:0:91969:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00000020:00000080:3.0:1784189225.564770:0:63468:0:(genops.c:865:class_export_destroy()) destroying export ffff9dbf47457800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:0.0:1784189225.564820:0:91969:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9dbf447dfcc0 - data ffff9dc07069e438/ffff9dc075390400 00000020:01000000:0.0:1784189225.564944:0:91969:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9dbf457f8480 - data ffff9dc06be00af8/ffff9dbf456b3c00 00000100:00080000:1.0:1784189225.606600:0:91969:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1784189225.606609:0:91969:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:1.0:1784189225.606624:0:91969:0:(client.c:3150:ptlrpc_free_committed()) @@@ free request with old gen req@ffff9dc07ab9a300 x1870854458155648/t81604378740(81604378740) o39->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1784189235 ref 1 fl Complete:RNQU/204/0 rc 0/0 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784189225.606649:0:91969:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:1.0:1784189225.608595:0:91969:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1784189225.608601:0:91969:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294968953 gen 4 00000004:00080000:1.0:1784189225.608620:0:91969:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1784189225.608623:0:91969:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:2.0:1784189225.608862:0:90966:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:2.0:1784189225.608867:0:90966:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x68:0x0] index 1 count 1 00000040:00080000:2.0:1784189225.608878:0:90966:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 26 count 2 00000100:00080000:1.0:1784189225.609573:0:91969:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1784189225.609578:0:91969:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294968956 gen 4 00000004:00080000:1.0:1784189225.609599:0:91969:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1784189225.609601:0:91969:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:2.0:1784189225.609817:0:90968:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:2.0:1784189225.609821:0:90968:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x6a:0x0] index 1 count 1 00000040:00080000:2.0:1784189225.609829:0:90968:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 26 count 2 00000020:00000080:1.0:1784189225.611406:0:91969:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xcc1762b626f8b6e7 00000020:00000080:1.0:1784189225.611416:0:91969:0:(genops.c:906:class_export_put()) final put ffff9dbf45129000/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1784189225.611963:0:91969:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xcc1762b626f8b6fc 00000020:00000080:1.0:1784189225.611969:0:91969:0:(genops.c:906:class_export_put()) final put ffff9dc075651800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:1.0:1784189225.611974:0:91969:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:1.0:1784189225.611989:0:91969:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1784189225.611999:0:91969:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1784189225.612003:0:91969:0:(genops.c:1579:class_disconnect_exports()) OBD device 12 (ffff9dc049be19c0) has no exports 00000004:01000000:1.0:1784189225.612155:0:91969:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:1.0:1784189225.612164:0:91969:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xcc1762b626f8b77a 00000020:00000080:1.0:1784189225.612169:0:91969:0:(genops.c:906:class_export_put()) final put ffff9dbf43e99000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:1.0:1784189225.612173:0:91969:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:1.0:1784189225.612177:0:91969:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1784189225.612184:0:91969:0:(obd_config.c:955:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1784189225.612187:0:91969:0:(genops.c:1579:class_disconnect_exports()) OBD device 27 (ffff9dbf420019c0) has no exports 00000020:00000080:1.0:1784189225.612193:0:91969:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xcc1762b626f8b773 00000020:00000080:1.0:1784189225.612196:0:91969:0:(genops.c:906:class_export_put()) final put ffff9dc06b8e4000/lustre-MDT0000-osd_UUID 00010000:01000000:1.0:1784189225.612518:0:91969:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:1.0:1784189225.612522:0:91969:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1784189225.612526:0:91969:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294968956 gen 5 00000004:00080000:1.0:1784189225.612531:0:91969:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1784189225.612533:0:91969:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1784189225.612563:0:91969:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1784189225.612570:0:91969:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1784189225.612576:0:91969:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xcc1762b626f8b75e 00000020:00000080:1.0:1784189225.612579:0:91969:0:(genops.c:906:class_export_put()) final put ffff9dbf43e9f000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:1.0:1784189225.612583:0:91969:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:1.0:1784189225.612586:0:91969:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1784189225.612591:0:91969:0:(obd_config.c:955:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1784189225.612593:0:91969:0:(genops.c:1579:class_disconnect_exports()) OBD device 22 (ffff9dbf44d7cd40) has no exports 00000020:00000080:1.0:1784189225.612597:0:91969:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xcc1762b626f8b750 00000020:00000080:1.0:1784189225.612600:0:91969:0:(genops.c:906:class_export_put()) final put ffff9dc047a81000/lustre-MDT0000-osd_UUID 00010000:01000000:1.0:1784189225.612943:0:91969:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:1.0:1784189225.612947:0:91969:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1784189225.612949:0:91969:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294968953 gen 5 00000004:00080000:1.0:1784189225.612952:0:91969:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1784189225.612953:0:91969:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1784189225.612984:0:91969:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1784189225.612989:0:91969:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000004:01000000:1.0:1784189225.612998:0:91969:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:1.0:1784189225.613003:0:91969:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xcc1762b626f8b742 00000020:00000080:1.0:1784189225.613007:0:91969:0:(genops.c:906:class_export_put()) final put ffff9dc06b8e0000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:1.0:1784189225.613010:0:91969:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osp-MDT0000 (flags='') 00000020:00000080:1.0:1784189225.613013:0:91969:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1784189225.613017:0:91969:0:(obd_config.c:955:class_cleanup()) lustre-MDT0001-osp-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1784189225.613019:0:91969:0:(genops.c:1579:class_disconnect_exports()) OBD device 21 (ffff9dbf431299c0) has no exports 00000020:00000080:1.0:1784189225.613023:0:91969:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xcc1762b626f8b73b 00000020:00000080:1.0:1784189225.613025:0:91969:0:(genops.c:906:class_export_put()) final put ffff9dbf4512c000/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1784189225.613946:0:63468:0:(genops.c:865:class_export_destroy()) destroying export ffff9dbf45129000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1784189225.613960:0:63468:0:(genops.c:865:class_export_destroy()) destroying export ffff9dc075651800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:00000080:3.0:1784189225.613965:0:63468:0:(genops.c:865:class_export_destroy()) destroying export ffff9dbf43e99000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:00000080:3.0:1784189225.613971:0:63468:0:(genops.c:865:class_export_destroy()) destroying export ffff9dc06b8e4000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1784189225.613975:0:63468:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9dc06b8e7800 for lustre-OST0001-osc-MDT0000 00000020:00000080:3.0:1784189225.613980:0:63468:0:(genops.c:906:class_export_put()) final put ffff9dbf43e9a000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1784189225.613983:0:63468:0:(genops.c:865:class_export_destroy()) destroying export ffff9dbf43e9a000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:3.0:1784189225.613986:0:63468:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1784189225.614061:0:63468:0:(genops.c:865:class_export_destroy()) destroying export ffff9dbf43e9f000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:00000080:3.0:1784189225.614066:0:63468:0:(genops.c:865:class_export_destroy()) destroying export ffff9dc047a81000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1784189225.614070:0:63468:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9dc047a82000 for lustre-OST0000-osc-MDT0000 00000020:00000080:3.0:1784189225.614074:0:63468:0:(genops.c:906:class_export_put()) final put ffff9dc06b8e2800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1784189225.614076:0:63468:0:(genops.c:865:class_export_destroy()) destroying export ffff9dc06b8e2800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:3.0:1784189225.614079:0:63468:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1784189225.614108:0:63468:0:(genops.c:865:class_export_destroy()) destroying export ffff9dc06b8e0000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:00000080:3.0:1784189225.614113:0:63468:0:(genops.c:865:class_export_destroy()) destroying export ffff9dbf4512c000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:2.0:1784189225.614457:0:91969:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0001-osp-MDT0000: client import never connected 00000100:00080000:2.0:1784189225.614461:0:91969:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1784189225.614464:0:91969:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:2.0:1784189225.614469:0:91969:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1784189225.614513:0:91969:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1784189225.614523:0:91969:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1784189225.614548:0:91969:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1784189225.614553:0:91969:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1784189225.614557:0:91969:0:(genops.c:906:class_export_put()) final put ffff9dbf45128800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1784189225.614571:0:91969:0:(genops.c:865:class_export_destroy()) destroying export ffff9dbf45128800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:2.0:1784189225.614575:0:91969:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1784189225.614650:0:91969:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xcc1762b626f8b703 00000020:00000080:2.0:1784189225.614656:0:91969:0:(genops.c:906:class_export_put()) final put ffff9dc075655800/lustre-MDD0000_UUID 00000020:01000000:2.0:1784189225.614661:0:91969:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:2.0:1784189225.614665:0:91969:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1784189225.614669:0:91969:0:(obd_config.c:955:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1784189225.614673:0:91969:0:(genops.c:1579:class_disconnect_exports()) OBD device 14 (ffff9dc049be0000) has no exports 00000020:00000080:2.0:1784189225.614694:0:91969:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1784189225.614698:0:91969:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:2.0:1784189225.614702:0:91969:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xcc1762b626f8b70a 00000020:00000080:2.0:1784189225.614705:0:91969:0:(genops.c:906:class_export_put()) final put ffff9dc075655000/lustre-MDT0000-osd_UUID 00000020:01000004:2.0:1784189225.614710:0:91969:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9dbf43fc9000 from lustre-MDT0000, refs=3 00000020:01000004:2.0:1784189225.614714:0:91969:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9dbf43fc9000 3 00000020:01000004:2.0:1784189225.614717:0:91969:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9dbf43fc9000 from lustre-MDT0000 00000020:00000080:2.0:1784189225.614735:0:91969:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1784189225.614739:0:91969:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:2.0:1784189225.614742:0:91969:0:(genops.c:906:class_export_put()) final put ffff9dbf4512b800/lustre-MDT0000_UUID 00000020:00000080:2.0:1784189225.614744:0:91969:0:(genops.c:865:class_export_destroy()) destroying export ffff9dbf4512b800/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:2.0:1784189225.614753:0:91969:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:2.0:1784189225.614801:0:91969:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 3 references. 00000020:01000004:2.0:1784189225.614804:0:91969:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:2.0:1784189225.614807:0:91969:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:2.0:1784189225.614809:0:91969:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1784189225.614812:0:91969:0:(obd_config.c:955:class_cleanup()) MGS: forcing exports to disconnect: 2/5 00000020:00080000:2.0:1784189225.614819:0:91969:0:(genops.c:1840:print_export_data()) MGS: ACTIVE ffff9dbf44673000 60f345e3-c70e-4f53-b5e7-c9671463c9a5 192.168.203.12@tcp 9 (0 0 4) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1784189225.614825:0:91969:0:(genops.c:1840:print_export_data()) MGS: ACTIVE ffff9dc06b8e1000 bd553d0d-03e2-4233-b06b-b55bbfa2b954 0@lo 18 (0 0 13) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1784189225.614829:0:91969:0:(genops.c:1574:class_disconnect_exports()) OBD device 3 (ffff9dbf449f0000) has exports, disconnecting them 00000020:00080000:2.0:1784189225.614834:0:91969:0:(genops.c:1549:class_disconnect_export_list()) MGS: disconnecting export at 192.168.203.12@tcp (ffff9dbf44673000), last request at 1784189220 00000020:00000080:2.0:1784189225.614846:0:91969:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xcc1762b626f8bbcc 00000020:00010000:2.0:1784189225.614850:0:91969:0:(genops.c:1942:obd_stale_export_put()) Put export ffff9dbf44673000: total 2 00000100:00080000:2.0:1784189225.614859:0:91969:0:(import.c:65:import_set_state_nolock()) ffff9dbf44677800 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1784189225.614881:0:91969:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 192.168.203.12@tcp (ffff9dbf44673000): rc 0 00000020:00080000:2.0:1784189225.614885:0:91969:0:(genops.c:1549:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff9dc06b8e1000), last request at 1784189193 00000020:00000080:2.0:1784189225.614893:0:91969:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xcc1762b626f8b6af 00000020:00010000:2.0:1784189225.614896:0:91969:0:(genops.c:1942:obd_stale_export_put()) Put export ffff9dc06b8e1000: total 2 00000100:00080000:2.0:1784189225.614899:0:91969:0:(import.c:65:import_set_state_nolock()) ffff9dc06b8e5000 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1784189225.614907:0:91969:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9dc06b8e1000): rc 0 00000020:00080000:2.0:1784189225.614912:0:91969:0:(genops.c:1579:class_disconnect_exports()) OBD device 3 (ffff9dbf449f0000) has no exports 00000100:00100000:3.0:1784189225.614992:0:90955:0:(service.c:3183:ptlrpc_main()) ll_mgs_0001: service thread [ffff9dc05edf6c00:90955] 1 exiting: rc = 0 00000020:00000080:3.0:1784189225.615066:0:63468:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9dbf4512e800 for lustre-MDT0001-osp-MDT0000 00000020:00000080:3.0:1784189225.615073:0:63468:0:(genops.c:906:class_export_put()) final put ffff9dc047a80000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1784189225.615074:0:63468:0:(genops.c:865:class_export_destroy()) destroying export ffff9dc047a80000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:01000000:3.0:1784189225.615084:0:63468:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osp-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1784189225.615121:0:63468:0:(genops.c:865:class_export_destroy()) destroying export ffff9dc075655800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:3.0:1784189225.615125:0:63468:0:(genops.c:906:class_export_put()) final put ffff9dc050ae7000/lustre-MDD0000_UUID 00000020:00000080:3.0:1784189225.615126:0:63468:0:(genops.c:865:class_export_destroy()) destroying export ffff9dc050ae7000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:3.0:1784189225.615129:0:63468:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:00000080:3.0:1784189225.615151:0:63468:0:(genops.c:865:class_export_destroy()) destroying export ffff9dc075655000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00010000:0.0:1784189225.615270:0:26173:0:(genops.c:1928:obd_stale_export_get()) Get export ffff9dbf44673000: total 0 00010000:00010000:0.0:1784189225.615307:0:26173:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff9dbf44673000, canceled 0 locks, left on hash table 4. 00010000:00010000:0.0:1784189225.616000:0:26173:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dc0565e7400/0xcc1762b626f8bbe1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c3f1a expref: 5 pid: 90955 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189225.616028:0:26173:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dc0755a4400/0xcc1762b626f8bbda lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c3ee9 expref: 4 pid: 90955 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189225.616042:0:26173:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dbf4369ca00/0xcc1762b626f8bbd3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c3ee2 expref: 3 pid: 90956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189225.616053:0:26173:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dc04152c800/0xcc1762b626f8bbe8 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c3f21 expref: 2 pid: 90956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189225.616064:0:26173:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff9dbf44673000, canceled 4 locks, left on hash table 0. 00000020:00000080:0.0:1784189225.616088:0:26173:0:(genops.c:906:class_export_put()) final put ffff9dbf44673000/60f345e3-c70e-4f53-b5e7-c9671463c9a5 00000020:00010000:0.0:1784189225.616095:0:26173:0:(genops.c:1928:obd_stale_export_get()) Get export ffff9dc06b8e1000: total 1 00010000:00010000:0.0:1784189225.616098:0:26173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784189225.616118:0:26173:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff9dc06b8e1000, canceled 0 locks, left on hash table 13. 00010000:00010000:0.0:1784189225.616135:0:26173:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dc07116f200/0xcc1762b626f8b830 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xcc1762b626f8b829 expref: 14 pid: 90954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189225.616148:0:26173:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dc05ec0e000/0xcc1762b626f8b83e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xcc1762b626f8b837 expref: 13 pid: 90956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189225.616159:0:26173:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dc05ec0fc00/0xcc1762b626f8b84c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xcc1762b626f8b845 expref: 12 pid: 90955 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189225.616169:0:26173:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dc058f67400/0xcc1762b626f8b7dc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xcc1762b626f8b7d5 expref: 11 pid: 90956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189225.616181:0:26173:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dc05ec0e600/0xcc1762b626f8b85a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xcc1762b626f8b853 expref: 10 pid: 90955 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189225.616205:0:26173:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dc04a20b600/0xcc1762b626f8b7ea lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xcc1762b626f8b7e3 expref: 9 pid: 90956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189225.616219:0:26173:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dc05ec0f600/0xcc1762b626f8b7f8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xcc1762b626f8b7f1 expref: 8 pid: 90955 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189225.616229:0:26173:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dc05ec0f400/0xcc1762b626f8b876 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xcc1762b626f8b86f expref: 7 pid: 90954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189225.616239:0:26173:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dc07116e600/0xcc1762b626f8b806 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xcc1762b626f8b7ff expref: 6 pid: 90956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189225.616250:0:26173:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dc07116f600/0xcc1762b626f8b868 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xcc1762b626f8b861 expref: 5 pid: 90954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189225.616260:0:26173:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dc058f66600/0xcc1762b626f8b822 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xcc1762b626f8b81b expref: 4 pid: 90954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189225.616269:0:26173:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dc05ec0e400/0xcc1762b626f8b884 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xcc1762b626f8b87d expref: 3 pid: 90954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189225.616281:0:26173:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dc04a20a200/0xcc1762b626f8b814 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xcc1762b626f8b80d expref: 2 pid: 90954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189225.616292:0:26173:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff9dc06b8e1000, canceled 13 locks, left on hash table 0. 00000020:00000080:0.0:1784189225.616306:0:26173:0:(genops.c:906:class_export_put()) final put ffff9dc06b8e1000/bd553d0d-03e2-4233-b06b-b55bbfa2b954 00010000:00010000:0.0:1784189225.616310:0:26173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784189225.616312:0:26173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784189225.616314:0:26173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784189225.616351:0:7454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784189225.616467:0:90956:0:(service.c:3183:ptlrpc_main()) ll_mgs_0002: service thread [ffff9dc05edf7800:90956] 2 exiting: rc = 0 00000100:00100000:0.0:1784189225.616545:0:90954:0:(service.c:3183:ptlrpc_main()) ll_mgs_0000: service thread [ffff9dc05edf6800:90954] 0 exiting: rc = 1 00000100:00100000:2.0:1784189225.616891:0:91969:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784189225.616900:0:91969:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784189225.616905:0:91969:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784189225.616910:0:91969:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784189225.616915:0:91969:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784189225.616919:0:91969:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784189225.616925:0:91969:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784189225.616931:0:91969:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784189225.616936:0:91969:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784189225.616941:0:91969:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784189225.616947:0:91969:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784189225.616952:0:91969:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784189225.616957:0:91969:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784189225.616962:0:91969:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784189225.616967:0:91969:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784189225.616973:0:91969:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784189225.616978:0:91969:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784189225.616983:0:91969:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784189225.616989:0:91969:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784189225.616994:0:91969:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784189225.616999:0:91969:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784189225.617004:0:91969:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784189225.617009:0:91969:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784189225.617014:0:91969:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784189225.617019:0:91969:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784189225.617025:0:91969:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784189225.617040:0:91969:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784189225.617051:0:91969:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784189225.617056:0:91969:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784189225.617061:0:91969:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784189225.617066:0:91969:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784189225.617071:0:91969:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784189225.617075:0:91969:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784189225.617080:0:91969:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784189225.617085:0:91969:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784189225.617090:0:91969:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784189225.617095:0:91969:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784189225.617100:0:91969:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784189225.617105:0:91969:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784189225.617111:0:91969:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784189225.617116:0:91969:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784189225.617121:0:91969:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784189225.617126:0:91969:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784189225.617131:0:91969:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784189225.617136:0:91969:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784189225.617141:0:91969:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784189225.617147:0:91969:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784189225.617151:0:91969:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784189225.617156:0:91969:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784189225.617161:0:91969:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784189225.617166:0:91969:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784189225.617171:0:91969:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784189225.617176:0:91969:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784189225.617182:0:91969:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784189225.617187:0:91969:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784189225.617193:0:91969:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784189225.617199:0:91969:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784189225.617204:0:91969:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784189225.617209:0:91969:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784189225.617215:0:91969:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784189225.617219:0:91969:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784189225.617233:0:91969:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784189225.617238:0:91969:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784189225.617244:0:91969:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:3.0:1784189225.617880:0:63468:0:(genops.c:865:class_export_destroy()) destroying export ffff9dbf44673000/60f345e3-c70e-4f53-b5e7-c9671463c9a5 for MGS 00000020:00000080:3.0:1784189225.617914:0:63468:0:(genops.c:865:class_export_destroy()) destroying export ffff9dc06b8e1000/bd553d0d-03e2-4233-b06b-b55bbfa2b954 for MGS 00000020:00000080:3.0:1784189225.617926:0:63468:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9dbf44677800 for MGS 00000020:00000080:3.0:1784189225.617932:0:63468:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9dc06b8e5000 for MGS 00000020:01000000:2.0:1784189225.618144:0:91969:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9dbf457f8c60 - data ffff9dc049fe71b0/ffff9dc0715ae800 00000020:01000000:2.0:1784189225.618253:0:91969:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9dbf457f8180 - data ffff9dbf41f86438/ffff9dc07a7a9800 00000020:00000080:2.0:1784189225.618773:0:91969:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xcc1762b626f8b685 00000020:00000080:2.0:1784189225.618781:0:91969:0:(genops.c:906:class_export_put()) final put ffff9dc07a884000/lustre-MDT0000-osd_UUID 00000020:01000004:2.0:1784189225.618829:0:91969:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9dbf43fc9000 from MGS, refs=2 00000020:01000004:2.0:1784189225.618833:0:91969:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9dbf43fc9000 2 00000020:01000004:2.0:1784189225.618837:0:91969:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9dbf43fc9000 from MGS 00000020:00000080:2.0:1784189225.618856:0:91969:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1784189225.618863:0:91969:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:2.0:1784189225.618865:0:91969:0:(genops.c:906:class_export_put()) final put ffff9dc05ed5c000/MGS 00000020:00000080:2.0:1784189225.618868:0:91969:0:(genops.c:865:class_export_destroy()) destroying export ffff9dc05ed5c000/MGS for MGS 00000020:01000000:2.0:1784189225.618872:0:91969:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:2.0:1784189225.618937:0:91969:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:2.0:1784189225.618940:0:91969:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1784189225.618950:0:91969:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1784189225.618956:0:91969:0:(genops.c:1840:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff9dc07b5d2000 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1784189225.618962:0:91969:0:(genops.c:1574:class_disconnect_exports()) OBD device 28 (ffff9dbf44d78000) has exports, disconnecting them 00000020:00080000:2.0:1784189225.618967:0:91969:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff9dc07b5d2000), last request at 1784189194 00000020:00000080:2.0:1784189225.618971:0:91969:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xcc1762b626f8b7b9 00000020:00080000:2.0:1784189225.618980:0:91969:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9dc07b5d2000): rc 0 00000020:00000080:2.0:1784189225.618984:0:91969:0:(genops.c:906:class_export_put()) final put ffff9dc07b5d2000/lustre-MDT0000-lwp-MDT0000 00000020:00000080:3.0:1784189225.619102:0:63468:0:(genops.c:865:class_export_destroy()) destroying export ffff9dc07a884000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1784189225.620309:0:89010:0:(genops.c:865:class_export_destroy()) destroying export ffff9dc07b5d2000/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:3.0:1784189225.621392:0:91969:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:3.0:1784189225.621397:0:91969:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1784189225.621401:0:91969:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:3.0:1784189225.621408:0:91969:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1784189225.621434:0:89010:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9dc04979c000 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:3.0:1784189225.621549:0:91969:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1784189225.621561:0:91969:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:3.0:1784189225.621566:0:91969:0:(genops.c:906:class_export_put()) final put ffff9dc0715c4800/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:3.0:1784189225.621569:0:91969:0:(genops.c:865:class_export_destroy()) destroying export ffff9dc0715c4800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:3.0:1784189225.621574:0:91969:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:3.0:1784189225.621647:0:91969:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9dbf43fc9000 1 00000020:00000080:3.0:1784189225.621653:0:91969:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xcc1762b626f8b677 00000020:00000080:3.0:1784189225.621659:0:91969:0:(genops.c:906:class_export_put()) final put ffff9dc05ed5f800/lustre-MDT0000-osd_UUID 00000020:01000000:3.0:1784189225.621666:0:91969:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:3.0:1784189225.621673:0:89010:0:(genops.c:865:class_export_destroy()) destroying export ffff9dc05ed5f800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1784189225.621683:0:91969:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1784189225.621697:0:91969:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1784189225.621700:0:91969:0:(genops.c:1579:class_disconnect_exports()) OBD device 0 (ffff9dbf449f3380) has no exports 00010000:00010000:0.0:1784189225.721689:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1784189225.726988:0:91969:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1784189225.727000:0:91969:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:2.0:1784189225.727006:0:91969:0:(genops.c:906:class_export_put()) final put ffff9dbf43fca000/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1784189225.727010:0:91969:0:(genops.c:865:class_export_destroy()) destroying export ffff9dbf43fca000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:2.0:1784189225.727021:0:91969:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:2.0:1784189225.727133:0:91969:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9dbf43fce000 00000020:02000400:2.0:1784189225.727195:0:91969:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-MDT0000 complete 00000400:00000100:0.0:1784189225.767349:0:3635:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-192.168.203.12@tcp portal 26 match 1870854436296320 offset 0 length 224: 4 00000100:00100000:0.0:1784189225.773639:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1784189225.773677:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1784189225.773698:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1784189225.773734:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1784189225.773770:0:68287:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436296448 00000100:00100000:0.0:1784189225.773779:0:68287:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436296448 00000100:00100000:1.0:1784189225.774577:0:14684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436296704 00000100:00100000:1.0:1784189225.774584:0:14684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436296704 00000100:00100000:1.0:1784189225.774635:0:14684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436296832 00000100:00100000:1.0:1784189225.774639:0:14684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436296832 00000100:00100000:1.0:1784189225.774663:0:14684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 2496 00000100:00100000:1.0:1784189225.774672:0:14684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf47544e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:debedd94-805c-42a0-a5e5-41758b2012e9+5:2397:x1870854436296704:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:1.0:1784189225.774753:0:14684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf47544e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:debedd94-805c-42a0-a5e5-41758b2012e9+5:2397:x1870854436296704:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 82us (1053us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189225.774777:0:14684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 2496 00000100:00100000:1.0:1784189225.774793:0:14684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 2497 00000100:00100000:1.0:1784189225.774800:0:14684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf4693e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:debedd94-805c-42a0-a5e5-41758b2012e9+5:2396:x1870854436296832:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:1.0:1784189225.774826:0:14684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf4693e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:debedd94-805c-42a0-a5e5-41758b2012e9+5:2396:x1870854436296832:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 27us (1091us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189225.774832:0:14684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 2497 00000100:00080000:2.0:1784189225.774876:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1784189225.774880:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1784189225.774978:0:68287:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436296576 00000100:00100000:0.0:1784189225.774983:0:68287:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436296576 00000100:00080000:2.0:1784189225.775035:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1784189225.775063:0:66169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1234 00000100:00100000:1.0:1784189225.775070:0:66169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf47546680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:debedd94-805c-42a0-a5e5-41758b2012e9+7:2396:x1870854436296576:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:1.0:1784189225.775099:0:66169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf47546680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:debedd94-805c-42a0-a5e5-41758b2012e9+7:2396:x1870854436296576:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 30us (1421us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189225.775112:0:66169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1234 00000100:00100000:1.0:1784189225.775128:0:66169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1315 00000100:00100000:1.0:1784189225.775132:0:66169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc06bbf2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2396:x1870854436296448:12345-192.168.203.12@tcp:400:kworker.0 00000020:00080000:1.0:1784189225.775137:0:66169:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-192.168.203.12@tcp 00000100:00100000:1.0:1784189225.775160:0:66169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc06bbf2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2396:x1870854436296448:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 26us (1528us total) trans 0 rc -107/-107 00000100:00100000:1.0:1784189225.775165:0:66169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1315 00000100:00100000:0.0:1784189225.815112:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1784189225.815178:0:66171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436296960 00000100:00100000:3.0:1784189225.815186:0:66171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436296960 00000100:00100000:3.0:1784189225.815234:0:66171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1316 00000100:00100000:3.0:1784189225.815242:0:66171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc075aa0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2395:x1870854436296960:12345-192.168.203.12@tcp:38:ptlrpcd_00_00.0 00010000:00020000:3.0:1784189225.815263:0:66171:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.203.12@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1784189225.815357:0:66171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc075aa0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2395:x1870854436296960:12345-192.168.203.12@tcp:38:ptlrpcd_00_00.0 Request processed in 114us (252us total) trans 0 rc -19/-19 00000100:00100000:3.0:1784189225.815364:0:66171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1316 00010000:00010000:3.0:1784189226.736543:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784189227.762124:0:26173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784189228.079981:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf469b7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1870854458156160:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1784189228.080058:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784189228.080416:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458156160 00000100:00100000:1.0:1784189228.080424:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458156160 00000100:00100000:1.0:1784189228.080488:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2000 00000100:00100000:1.0:1784189228.080497:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc07b871c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1870854458156160:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1784189228.080524:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8648768 pending 0 free 3922481152 avail 3690958848 00000100:00100000:1.0:1784189228.080568:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc07b871c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1870854458156160:12345-0@lo:13:osp-pre-0-1.0 Request processed in 73us (509us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189228.080575:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2000 00000100:00080000:3.0:1784189228.081018:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1784189228.081059:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf469b7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1870854458156160:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1784189228.082155:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1784189228.082170:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc07b7e1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1870854458156288:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1784189228.082218:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784189228.082362:0:9466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458156288 00000100:00100000:2.0:1784189228.082368:0:9466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458156288 00000100:00100000:2.0:1784189228.082419:0:9466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2001 00000100:00100000:2.0:1784189228.082428:0:9466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc07fb37480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1870854458156288:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1784189228.082453:0:9466:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8648768 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1784189228.082491:0:9466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc07fb37480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1870854458156288:12345-0@lo:13:osp-pre-1-1.0 Request processed in 65us (272us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189228.082497:0:9466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2001 00000100:00080000:3.0:1784189228.082683:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1784189228.082716:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc07b7e1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1870854458156288:0@lo:13:osp-pre-1-1.0 00010000:00010000:2.0:1784189228.787948:0:7454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784189229.807470:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784189230.128043:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc07b7e0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bd553d0d-03e2-4233-b06b-b55bbfa2b954:3642:1870854458156416:0@lo:400:kworker.0 00000400:00000100:0.0:1784189230.128125:0:3642:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1870854458156416 offset 0 length 224: 4 00000100:00100000:3.0:1784189230.128227:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf469b7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1870854458156544:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1784189230.128294:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784189230.128392:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458156544 00000100:00100000:3.0:1784189230.128402:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458156544 00000100:00100000:3.0:1784189230.128451:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3841 00000100:00100000:3.0:1784189230.128460:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc07fb36a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3643:x1870854458156544:12345-0@lo:41:osp-pre-0-1.0 00000020:00080000:3.0:1784189230.128488:0:8438:0:(tgt_handler.c:807:tgt_request_handle()) operation 41 on unconnected OST from 12345-0@lo 00000100:00100000:3.0:1784189230.128533:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc07fb36a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3643:x1870854458156544:12345-0@lo:41:osp-pre-0-1.0 Request processed in 71us (238us total) trans 0 rc -107/-107 00000100:00100000:3.0:1784189230.128548:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3841 00000100:02020000:3.0:1784189230.128601:0:3643:0:(client.c:1492:ptlrpc_check_status()) lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 00000100:00080000:3.0:1784189230.128607:0:3643:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-osp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1784189230.128612:0:3643:0:(import.c:65:import_set_state_nolock()) ffff9dbf436c4000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:3.0:1784189230.128616:0:3643:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:3.0:1784189230.128623:0:3643:0:(import.c:65:import_set_state_nolock()) ffff9dbf436c4000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1784189230.128628:0:3643:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3441 00000100:00080000:3.0:1784189230.128635:0:3643:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9dbf436c4000 using connection 192.168.203.112@tcp/0@lo 00000100:00100000:3.0:1784189230.128662:0:3643:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9dc07fb34700 x1870854458156800/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1784189230.128696:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc07b7e1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3640:1870854458156672:0@lo:400:kworker.0 00000100:00100000:3.0:1784189230.128751:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784189230.128802:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc07fb34700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3639:1870854458156800:0@lo:38:ptlrpcd_00_03.0 00000100:00100000:3.0:1784189230.128833:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784189230.128871:0:26492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458156800 00000100:00100000:3.0:1784189230.128875:0:26492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458156800 00000100:00100000:3.0:1784189230.128896:0:26492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3842 00000100:00100000:3.0:1784189230.128901:0:26492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc07fb37100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3639:x1870854458156800:12345-0@lo:38:ptlrpcd_00_03.0 00010000:00020000:3.0:1784189230.128924:0:26492:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1784189230.128962:0:26492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc07fb37100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3639:x1870854458156800:12345-0@lo:38:ptlrpcd_00_03.0 Request processed in 59us (129us total) trans 0 rc -19/-19 00000100:00100000:3.0:1784189230.128978:0:26492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3842 00000100:00100000:3.0:1784189230.128999:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc07b7e1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3641:1870854458156928:0@lo:400:kworker.0 00000100:00100000:3.0:1784189230.129031:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784189230.129065:0:66945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458156672 00000100:00100000:1.0:1784189230.129079:0:66945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458156672 00000100:00080000:3.0:1784189230.129084:0:3639:0:(import.c:65:import_set_state_nolock()) ffff9dbf436c4000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1784189230.129091:0:3639:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1784189230.129095:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc07fb34700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3639:1870854458156800:0@lo:38:ptlrpcd_00_03.0 00000100:00100000:1.0:1784189230.129139:0:66945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458156928 00000100:00100000:1.0:1784189230.129145:0:66945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458156928 00000100:00100000:3.0:1784189230.129161:0:68287:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1317 00000100:00100000:3.0:1784189230.129169:0:68287:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc07fb34000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3640:x1870854458156672:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784189230.129193:0:66945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1235 00000100:00100000:1.0:1784189230.129207:0:66945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc07fb36300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1870854458156928:12345-0@lo:400:kworker.0 00000020:00080000:3.0:1784189230.129234:0:68287:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:3.0:1784189230.129395:0:68287:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc07fb34000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3640:x1870854458156672:12345-0@lo:400:kworker.0 Request processed in 224us (642us total) trans 0 rc -107/-107 00000100:00100000:3.0:1784189230.129403:0:68287:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1317 00000100:00080000:3.0:1784189230.129439:0:3640:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0000 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1784189230.129446:0:3640:0:(import.c:65:import_set_state_nolock()) ffff9dbf42271800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:3.0:1784189230.129449:0:3640:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:3.0:1784189230.129453:0:3640:0:(import.c:65:import_set_state_nolock()) ffff9dbf42271800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1784189230.129456:0:3640:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3441 00000100:00080000:3.0:1784189230.129462:0:3640:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9dbf42271800 using connection 192.168.203.112@tcp/0@lo 00000100:00100000:3.0:1784189230.129479:0:3640:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9dc07fb34700 x1870854458157184/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1784189230.129495:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc07b7e1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3640:1870854458156672:0@lo:400:kworker.0 00000100:00100000:3.0:1784189230.129513:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc07fb34700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3639:1870854458157184:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:3.0:1784189230.129538:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784189230.129593:0:66171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458157184 00000100:00100000:3.0:1784189230.129598:0:66171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458157184 00000100:00100000:3.0:1784189230.129620:0:66171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1318 00000100:00100000:3.0:1784189230.129625:0:66171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc07fb36680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3639:x1870854458157184:12345-0@lo:38:ptlrpcd_00_00.0 00010000:00020000:3.0:1784189230.129638:0:66171:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1784189230.129669:0:66171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc07fb36680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3639:x1870854458157184:12345-0@lo:38:ptlrpcd_00_00.0 Request processed in 43us (131us total) trans 0 rc -19/-19 00000100:00100000:3.0:1784189230.129675:0:66171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1318 00000100:00080000:3.0:1784189230.129690:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1784189230.129950:0:66945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc07fb36300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1870854458156928:12345-0@lo:400:kworker.0 Request processed in 743us (914us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189230.129961:0:66945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1235 00000100:00100000:3.0:1784189230.131675:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc07b7e1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3641:1870854458156928:0@lo:400:kworker.0 00000100:00080000:3.0:1784189230.131787:0:3639:0:(import.c:65:import_set_state_nolock()) ffff9dbf42271800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1784189230.131794:0:3639:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1784189230.131798:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc07fb34700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3639:1870854458157184:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:3.0:1784189230.133073:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc07b7e3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3643:1870854458157312:0@lo:400:kworker.0 00000100:00100000:3.0:1784189230.133160:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784189230.133218:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1784189230.133226:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc07b7e3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3643:1870854458157056:0@lo:400:kworker.0 00000100:00100000:3.0:1784189230.133252:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784189230.133270:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc07b7e1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3643:1870854458157696:0@lo:400:kworker.0 00000100:00100000:3.0:1784189230.133307:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784189230.133369:0:66170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458157312 00000100:00100000:3.0:1784189230.133376:0:66170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458157312 00000100:00100000:3.0:1784189230.133439:0:66170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458157056 00000100:00100000:3.0:1784189230.133443:0:66170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458157056 00000100:00100000:3.0:1784189230.133456:0:66170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458157696 00000100:00100000:3.0:1784189230.133459:0:66170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458157696 00000100:00100000:3.0:1784189230.133472:0:66170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1236 00000100:00100000:3.0:1784189230.133500:0:66170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc07fb34700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1870854458157312:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784189230.133564:0:66170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc07fb34700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1870854458157312:12345-0@lo:400:kworker.0 Request processed in 65us (403us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189230.133572:0:66170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1236 00000100:00100000:3.0:1784189230.133591:0:66170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1319 00000100:00100000:3.0:1784189230.133595:0:66170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc07fb35f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3643:x1870854458157056:12345-0@lo:400:kworker.0 00000020:00080000:3.0:1784189230.133601:0:66170:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:3.0:1784189230.133624:0:66170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc07fb35f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3643:x1870854458157056:12345-0@lo:400:kworker.0 Request processed in 28us (372us total) trans 0 rc -107/-107 00000100:00100000:3.0:1784189230.133629:0:66170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1319 00000100:00100000:3.0:1784189230.133639:0:66170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1320 00000100:00100000:3.0:1784189230.133643:0:66170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc07fb34380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3643:x1870854458157696:12345-0@lo:400:kworker.0 00000020:00080000:3.0:1784189230.133647:0:66170:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:3.0:1784189230.133666:0:66170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc07fb34380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3643:x1870854458157696:12345-0@lo:400:kworker.0 Request processed in 22us (359us total) trans 0 rc -107/-107 00000100:00100000:3.0:1784189230.133672:0:66170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1320 00000100:00080000:3.0:1784189230.133688:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1784189230.133731:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc07b7e0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1870854458157568:0@lo:400:kworker.0 00000100:00100000:3.0:1784189230.133768:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784189230.133788:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1784189230.133795:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc07b7e1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1870854458157440:0@lo:400:kworker.0 00000100:00100000:3.0:1784189230.133818:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1784189230.133865:0:3643:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1784189230.133872:0:3643:0:(import.c:65:import_set_state_nolock()) ffff9dbf425f4800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:3.0:1784189230.133876:0:3643:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:3.0:1784189230.133882:0:3643:0:(import.c:65:import_set_state_nolock()) ffff9dbf425f4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1784189230.133893:0:3643:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3441 00000100:00080000:3.0:1784189230.133900:0:3643:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9dbf425f4800 using connection 192.168.203.112@tcp/0@lo 00000100:00100000:3.0:1784189230.133931:0:3643:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9dc05eddf100 x1870854458157824/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1784189230.133954:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc07b7e3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3643:1870854458157056:0@lo:400:kworker.0 00000100:00080000:3.0:1784189230.133968:0:3643:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1784189230.133971:0:3643:0:(import.c:65:import_set_state_nolock()) ffff9dbf43690800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:3.0:1784189230.133974:0:3643:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:3.0:1784189230.133977:0:3643:0:(import.c:65:import_set_state_nolock()) ffff9dbf43690800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1784189230.133980:0:3643:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3441 00000100:00080000:3.0:1784189230.133985:0:3643:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff9dbf43690800 using connection 192.168.203.112@tcp/0@lo 00000100:00100000:3.0:1784189230.134000:0:3643:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9dbf43e12300 x1870854458157952/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1784189230.134011:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc07b7e1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3643:1870854458157696:0@lo:400:kworker.0 00000100:00100000:3.0:1784189230.134028:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc07b7e3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3643:1870854458157312:0@lo:400:kworker.0 00000100:00100000:3.0:1784189230.134058:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc05eddf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3639:1870854458157824:0@lo:38:ptlrpcd_00_03.0 00000100:00100000:3.0:1784189230.134087:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784189230.134103:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf43e12300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3639:1870854458157952:0@lo:38:ptlrpcd_00_03.0 00000100:00100000:3.0:1784189230.134124:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784189230.134148:0:66945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458157824 00000100:00100000:3.0:1784189230.134153:0:66945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458157824 00000100:00100000:3.0:1784189230.134172:0:66945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458157952 00000100:00100000:3.0:1784189230.134175:0:66945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458157952 00000100:00100000:3.0:1784189230.134197:0:66945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1321 00000100:00100000:3.0:1784189230.134201:0:66945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf43e12d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3639:x1870854458157824:12345-0@lo:38:ptlrpcd_00_03.0 00010000:00020000:3.0:1784189230.134224:0:66945:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1784189230.134257:0:66945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf43e12d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3639:x1870854458157824:12345-0@lo:38:ptlrpcd_00_03.0 Request processed in 53us (168us total) trans 0 rc -19/-19 00000100:00100000:3.0:1784189230.134263:0:66945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1321 00000100:00100000:3.0:1784189230.134274:0:66945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1322 00000100:00100000:3.0:1784189230.134278:0:66945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf43e11f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3639:x1870854458157952:12345-0@lo:38:ptlrpcd_00_03.0 00010000:00020000:3.0:1784189230.134288:0:66945:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1784189230.134311:0:66945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf43e11f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3639:x1870854458157952:12345-0@lo:38:ptlrpcd_00_03.0 Request processed in 31us (187us total) trans 0 rc -19/-19 00000100:00100000:3.0:1784189230.134344:0:66945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1322 00000100:00080000:3.0:1784189230.134370:0:3639:0:(import.c:65:import_set_state_nolock()) ffff9dbf425f4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1784189230.134375:0:3639:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1784189230.134378:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc05eddf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3639:1870854458157824:0@lo:38:ptlrpcd_00_03.0 00000100:00080000:3.0:1784189230.134386:0:3639:0:(import.c:65:import_set_state_nolock()) ffff9dbf43690800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1784189230.134388:0:3639:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1784189230.134391:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf43e12300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3639:1870854458157952:0@lo:38:ptlrpcd_00_03.0 00000100:00100000:3.0:1784189230.134441:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458157568 00000100:00100000:3.0:1784189230.134444:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458157568 00000100:00100000:3.0:1784189230.134479:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458157440 00000100:00100000:3.0:1784189230.134482:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458157440 00000100:00100000:3.0:1784189230.134504:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2498 00000100:00100000:3.0:1784189230.134510:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc05eddea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1870854458157568:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784189230.134566:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc05eddea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1870854458157568:12345-0@lo:400:kworker.0 Request processed in 45us (786us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189230.134580:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2498 00000100:00100000:3.0:1784189230.134593:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2499 00000100:00100000:3.0:1784189230.134599:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc05eddc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1870854458157440:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784189230.134629:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc05eddc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1870854458157440:12345-0@lo:400:kworker.0 Request processed in 30us (810us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189230.134635:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2499 00000100:00080000:3.0:1784189230.134653:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1784189230.134656:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1784189230.134672:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc07b7e1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1870854458157440:0@lo:400:kworker.0 00000100:00100000:3.0:1784189230.134684:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc07b7e0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1870854458157568:0@lo:400:kworker.0 00000001:00100000:1.0:1784189230.643203:0:8423:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1784189230.643212:0:8423:0:(genops.c:906:class_export_put()) final put ffff9dbf47451000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1784189230.643683:0:63468:0:(genops.c:865:class_export_destroy()) destroying export ffff9dbf47451000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:2.0:1784189230.643750:0:63468:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9dbf47452000 for lustre-OST0000 00000001:00100000:1.0:1784189230.646402:0:9506:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1784189230.646415:0:9506:0:(genops.c:906:class_export_put()) final put ffff9dc047a87800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1784189230.647913:0:89010:0:(genops.c:865:class_export_destroy()) destroying export ffff9dc047a87800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:3.0:1784189230.647964:0:89010:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9dc047a84000 for lustre-OST0001 00000001:00100000:0.0:1784189230.649046:0:75588:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:0.0:1784189230.649062:0:75588:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 81604378740 is committed 00000020:00000080:0.0:1784189230.649067:0:75588:0:(genops.c:906:class_export_put()) final put ffff9dbf47453800/lustre-MDT0000-mdtlov_UUID 00000020:00080000:0.0:1784189230.649088:0:75588:0:(update_trans.c:1348:distribute_txn_batchid_cb()) lustre-MDT0001: 77309411386 batchid updated 00000020:00080000:1.0:1784189230.649384:0:75608:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 77309411386 00000004:00080000:1.0:1784189230.649473:0:75608:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff9dc045243540 with version 10 00000020:00080000:1.0:1784189230.649490:0:75608:0:(update_trans.c:1311:distribute_txn_cancel_records()) lustre-MDT0000-osp-MDT0001: batchid 77309411386 cancel update log [0x2000088d1:0x2:0x0].2: rc = 0 00000020:00080000:1.0:1784189230.649600:0:75608:0:(update_trans.c:1311:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 77309411386 cancel update log [0x2400090a0:0x2:0x0].2: rc = 0 00000020:00080000:1.0:1784189230.649616:0:75608:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 77309411386 00000004:00080000:3.0:1784189230.649987:0:75594:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9dc05020c840 version 10 rpc_version 10 00000020:00100000:3.0:1784189230.650028:0:75594:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:3.0:1784189230.650039:0:75594:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9dbf43e12300 x1870854458158208/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1784189230.650062:0:75594:0:(client.c:1832:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != DISCONN) req@ffff9dbf43e12300 x1870854458158208/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'osp_up0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784189230.650071:0:75594:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dbf42691a80 going to sleep for 0 seconds 00000020:00000080:2.0:1784189230.651713:0:63468:0:(genops.c:865:class_export_destroy()) destroying export ffff9dbf47453800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001 00000020:00000080:2.0:1784189230.651810:0:63468:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9dbf47454800 for lustre-MDT0001 00010000:00010000:3.0:1784189230.832636:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784189230.888008:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000400:00000100:1.0:1784189230.888052:0:3633:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-192.168.203.12@tcp portal 26 match 1870854436297088 offset 0 length 224: 4 00000100:00100000:1.0:1784189230.888078:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1784189230.888115:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1784189230.888147:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1784189230.888243:0:66945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436297216 00000100:00100000:3.0:1784189230.888256:0:66945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436297216 00000100:00100000:0.0:1784189230.888258:0:66171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436297344 00000100:00100000:0.0:1784189230.888274:0:66171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436297344 00000100:00100000:3.0:1784189230.888369:0:66945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1323 00000100:00100000:3.0:1784189230.888383:0:66945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf469b5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2395:x1870854436297216:12345-192.168.203.12@tcp:38:kworker.0 00000100:00100000:0.0:1784189230.888402:0:66171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1237 00010000:00020000:3.0:1784189230.888418:0:66945:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.203.12@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1784189230.888420:0:66171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc075662d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:debedd94-805c-42a0-a5e5-41758b2012e9+7:2397:x1870854436297344:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:0.0:1784189230.888514:0:66171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc075662d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:debedd94-805c-42a0-a5e5-41758b2012e9+7:2397:x1870854436297344:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 100us (396us total) trans 0 rc 0/0 00000100:00100000:0.0:1784189230.888539:0:66171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1237 00000100:00100000:0.0:1784189230.888594:0:26163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436297472 00000100:00100000:0.0:1784189230.888598:0:26163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436297472 00000100:00100000:0.0:1784189230.888635:0:26163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436297600 00000100:00100000:0.0:1784189230.888640:0:26163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436297600 00000100:00100000:0.0:1784189230.888664:0:26163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 2500 00000100:00100000:0.0:1784189230.888679:0:26163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf46902300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:debedd94-805c-42a0-a5e5-41758b2012e9+5:2397:x1870854436297472:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:2.0:1784189230.888697:0:26170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 2501 00000100:00100000:2.0:1784189230.888716:0:26170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf4a343b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:debedd94-805c-42a0-a5e5-41758b2012e9+5:2397:x1870854436297600:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:3.0:1784189230.892312:0:66945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf469b5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2395:x1870854436297216:12345-192.168.203.12@tcp:38:kworker.0 Request processed in 3914us (4300us total) trans 0 rc -19/-19 00000100:00100000:3.0:1784189230.892357:0:66945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1323 00000100:00080000:3.0:1784189230.892415:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1784189230.892422:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1784189230.892427:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1784189230.893171:0:26163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf46902300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:debedd94-805c-42a0-a5e5-41758b2012e9+5:2397:x1870854436297472:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 4487us (5079us total) trans 0 rc 0/0 00000100:00100000:0.0:1784189230.893185:0:26163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 2500 00000100:00100000:2.0:1784189230.896103:0:26170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf4a343b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:debedd94-805c-42a0-a5e5-41758b2012e9+5:2397:x1870854436297600:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 7375us (7934us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189230.896123:0:26170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 2501 00000100:00100000:3.0:1784189231.663650:0:75594:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dbf42691a80 going to sleep for 0 seconds 00010000:00010000:0.0:1784189231.856094:0:26173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784189232.687464:0:75594:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dbf42691a80 going to sleep for 0 seconds 00010000:00010000:2.0:1784189232.882026:0:7454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784189233.200878:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf4a343480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1870854458158336:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1784189233.200974:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784189233.201070:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458158336 00000100:00100000:1.0:1784189233.201080:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458158336 00000100:00100000:1.0:1784189233.201161:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2002 00000100:00100000:1.0:1784189233.201173:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf43e10e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1870854458158336:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1784189233.201209:0:8432:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8648768 pending 0 free 3922481152 avail 3690958848 00000100:00100000:1.0:1784189233.201272:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf43e10e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1870854458158336:12345-0@lo:13:osp-pre-0-1.0 Request processed in 102us (298us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189233.201279:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2002 00000100:00080000:3.0:1784189233.203383:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1784189233.203563:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf4a343480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1870854458158336:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1784189233.203959:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1784189233.203980:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc07b7e1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1870854458158464:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1784189233.204060:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784189233.204153:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458158464 00000100:00100000:2.0:1784189233.204161:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458158464 00000100:00100000:2.0:1784189233.204241:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2003 00000100:00100000:2.0:1784189233.204252:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf43e10000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1870854458158464:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1784189233.204290:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8648768 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1784189233.204390:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf43e10000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1870854458158464:12345-0@lo:13:osp-pre-1-1.0 Request processed in 139us (330us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189233.204399:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2003 00000100:00100000:2.0:1784189233.204439:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc07b7e1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1870854458158464:0@lo:13:osp-pre-1-1.0 00000100:00080000:3.0:1784189233.204643:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1784189233.711466:0:75594:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dbf42691a80 going to sleep for 0 seconds 00010000:00010000:0.0:1784189233.903587:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784189234.735530:0:75594:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dbf42691a80 going to sleep for 0 seconds 00010000:00010000:3.0:1784189234.929056:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1784189235.248128:0:89010:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1784189235.248138:0:89010:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1784189235.248143:0:89010:0:(import.c:65:import_set_state_nolock()) ffff9dbf42271800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1784189235.248153:0:89010:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3472 00000100:00100000:3.0:1784189235.248157:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc05ed38700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:bd553d0d-03e2-4233-b06b-b55bbfa2b954:3641:1870854458158592:0@lo:400:kworker.0 00000100:00080000:0.0:1784189235.248163:0:89010:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1784189235.248173:0:89010:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9dbf42271800 using connection 192.168.203.112@tcp/0@lo 00000100:00100000:0.0:1784189235.248203:0:89010:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9dc080f69180 x1870854458158720/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000400:00000100:3.0:1784189235.248232:0:3641:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1870854458158592 offset 0 length 224: 4 00000100:00080000:0.0:1784189235.248258:0:89010:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1784189235.248263:0:89010:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1784189235.248264:0:89010:0:(import.c:65:import_set_state_nolock()) ffff9dbf425f4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1784189235.248269:0:89010:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3472 00000100:00080000:0.0:1784189235.248272:0:89010:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 5s 00000100:00100000:3.0:1784189235.248295:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00080000:0.0:1784189235.248297:0:89010:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9dbf425f4800 using connection 192.168.203.112@tcp/0@lo 00000100:00100000:3.0:1784189235.248306:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc080f6aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3643:1870854458158848:0@lo:400:kworker.0 00000100:00100000:0.0:1784189235.248341:0:89010:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9dc07016d500 x1870854458158976/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1784189235.248363:0:89010:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1784189235.248367:0:89010:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1784189235.248370:0:89010:0:(import.c:65:import_set_state_nolock()) ffff9dbf436c4000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1784189235.248373:0:89010:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3472 00000100:00080000:0.0:1784189235.248377:0:89010:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 5s 00000100:00100000:3.0:1784189235.248380:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1784189235.248385:0:89010:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9dbf436c4000 using connection 192.168.203.112@tcp/0@lo 00000100:00100000:0.0:1784189235.248407:0:89010:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9dc080e7c700 x1870854458159232/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1784189235.248413:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc07016dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3643:1870854458159104:0@lo:400:kworker.0 00000100:00100000:3.0:1784189235.248446:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1784189235.248451:0:89010:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1784189235.248456:0:89010:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1784189235.248461:0:89010:0:(import.c:65:import_set_state_nolock()) ffff9dbf43690800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1784189235.248464:0:89010:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3472 00000100:00080000:0.0:1784189235.248468:0:89010:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1784189235.248473:0:89010:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff9dbf43690800 using connection 192.168.203.112@tcp/0@lo 00000100:00100000:0.0:1784189235.248488:0:89010:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9dc07b5b0700 x1870854458159616/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1784189235.248495:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc07b5b0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1870854458159488:0@lo:400:kworker.0 00000100:00100000:3.0:1784189235.248531:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784189235.248556:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1784189235.248564:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc07b5b1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1870854458159360:0@lo:400:kworker.0 00000100:00100000:0.0:1784189235.248567:0:26171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458159488 00000100:00100000:0.0:1784189235.248576:0:26171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458159488 00000100:00100000:3.0:1784189235.248589:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784189235.248620:0:26164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458159360 00000100:00100000:3.0:1784189235.248624:0:26164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458159360 00000100:00100000:0.0:1784189235.248653:0:26171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2502 00000100:00100000:3.0:1784189235.248663:0:26164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2503 00000100:00100000:0.0:1784189235.248668:0:26171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf43e10380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0001-mdtlov_UUID+5:3641:x1870854458159488:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784189235.248746:0:26171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf43e10380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0001-mdtlov_UUID+5:3641:x1870854458159488:12345-0@lo:400:kworker.0 Request processed in 84us (213us total) trans 0 rc 0/0 00000100:00100000:0.0:1784189235.248763:0:26171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2502 00000100:00100000:3.0:1784189235.248846:0:26164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf43e13480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0001-mdtlov_UUID+5:3641:x1870854458159360:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784189235.248882:0:26164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf43e13480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0001-mdtlov_UUID+5:3641:x1870854458159360:12345-0@lo:400:kworker.0 Request processed in 210us (292us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189235.248889:0:26164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2503 00000100:00080000:3.0:1784189235.248907:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1784189235.248912:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1784189235.248940:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc07b5b1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1870854458159360:0@lo:400:kworker.0 00000100:00100000:3.0:1784189235.248956:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc07b5b0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1870854458159488:0@lo:400:kworker.0 00000100:00100000:3.0:1784189235.249009:0:66170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458158848 00000100:00100000:3.0:1784189235.249013:0:66170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458158848 00000100:00080000:0.0:1784189235.249045:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1784189235.249088:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc080f69180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3639:1870854458158720:0@lo:38:kworker.0 00000100:00100000:2.0:1784189235.249122:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784189235.252119:0:66171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458159104 00000100:00100000:0.0:1784189235.252138:0:66171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458159104 00000100:00100000:2.0:1784189235.252143:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc07016d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3639:1870854458158976:0@lo:38:kworker.0 00000100:00100000:0.0:1784189235.252219:0:66171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458158720 00000100:00100000:0.0:1784189235.252223:0:66171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458158720 00000100:00100000:2.0:1784189235.252225:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784189235.252241:0:66171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458158976 00000100:00100000:2.0:1784189235.252245:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc080e7c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3639:1870854458159232:0@lo:38:kworker.0 00000100:00100000:0.0:1784189235.252245:0:66171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458158976 00000100:00100000:0.0:1784189235.252262:0:66171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1238 00000100:00100000:0.0:1784189235.252276:0:66171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf43e12a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1870854458158848:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784189235.252284:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784189235.252334:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc07b5b0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3639:1870854458159616:0@lo:38:kworker.0 00000100:00100000:0.0:1784189235.252376:0:66171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf43e12a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1870854458158848:12345-0@lo:400:kworker.0 Request processed in 103us (3998us total) trans 0 rc 0/0 00000100:00100000:0.0:1784189235.252384:0:66171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1238 00000100:00100000:0.0:1784189235.252404:0:66171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1239 00000100:00100000:0.0:1784189235.252412:0:66171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf43e10700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1870854458159104:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784189235.252433:0:66170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1324 00000100:00100000:3.0:1784189235.252443:0:66170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc07b7e1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3639:x1870854458158720:12345-0@lo:38:kworker.0 00000100:00100000:0.0:1784189235.252450:0:66171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf43e10700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1870854458159104:12345-0@lo:400:kworker.0 Request processed in 38us (4003us total) trans 0 rc 0/0 00000100:00100000:0.0:1784189235.252458:0:66171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1239 00010000:00020000:3.0:1784189235.252473:0:66170:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1784189235.252517:0:66170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc07b7e1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3639:x1870854458158720:12345-0@lo:38:kworker.0 Request processed in 75us (3393us total) trans 0 rc -19/-19 00000100:00100000:3.0:1784189235.252523:0:66170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1324 00000100:00100000:0.0:1784189235.252543:0:66171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1325 00000100:00100000:0.0:1784189235.252549:0:66171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc07b7e0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3639:x1870854458158976:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1784189235.252561:0:66171:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1784189235.252571:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784189235.252600:0:66171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc07b7e0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3639:x1870854458158976:12345-0@lo:38:kworker.0 Request processed in 49us (375us total) trans 0 rc -19/-19 00000100:00080000:2.0:1784189235.252622:0:3639:0:(import.c:65:import_set_state_nolock()) ffff9dbf42271800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1784189235.252634:0:3639:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1784189235.252639:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc080f69180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3639:1870854458158720:0@lo:38:kworker.0 00000100:00080000:2.0:1784189235.252652:0:3639:0:(import.c:65:import_set_state_nolock()) ffff9dbf425f4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00100000:1.0:1784189235.252653:0:66169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458159616 00000100:00080000:2.0:1784189235.252657:0:3639:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1784189235.252661:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc07016d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3639:1870854458158976:0@lo:38:kworker.0 00000100:00100000:1.0:1784189235.252661:0:66169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458159616 00000100:00100000:2.0:1784189235.253583:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458159232 00000100:00100000:2.0:1784189235.253593:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458159232 00000100:00100000:2.0:1784189235.253632:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3843 00000100:00100000:2.0:1784189235.253638:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc07b7e1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3639:x1870854458159232:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1784189235.253656:0:8438:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1784189235.253727:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc07b7e1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3639:x1870854458159232:12345-0@lo:38:kworker.0 Request processed in 88us (1447us total) trans 0 rc -19/-19 00000100:00100000:2.0:1784189235.253752:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3843 00000100:00080000:2.0:1784189235.253792:0:3639:0:(import.c:65:import_set_state_nolock()) ffff9dbf436c4000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1784189235.253797:0:3639:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1784189235.253801:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc080e7c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3639:1870854458159232:0@lo:38:kworker.0 00000100:00100000:2.0:1784189235.253852:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc07016dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3643:1870854458159104:0@lo:400:kworker.0 00000100:00100000:2.0:1784189235.253868:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc080f6aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3643:1870854458158848:0@lo:400:kworker.0 00000100:00080000:2.0:1784189235.253909:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1784189235.260001:0:66171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1325 00000100:00100000:1.0:1784189235.260570:0:66169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1326 00000100:00100000:1.0:1784189235.260583:0:66169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc07b7e3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3639:x1870854458159616:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1784189235.260616:0:66169:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1784189235.260754:0:66169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc07b7e3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3639:x1870854458159616:12345-0@lo:38:kworker.0 Request processed in 170us (8182us total) trans 0 rc -19/-19 00000100:00100000:1.0:1784189235.260778:0:66169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1326 00000100:00080000:3.0:1784189235.261084:0:3639:0:(import.c:65:import_set_state_nolock()) ffff9dbf43690800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1784189235.261091:0:3639:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1784189235.261103:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc07b5b0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3639:1870854458159616:0@lo:38:kworker.0 00000100:00100000:3.0:1784189235.759787:0:75594:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dbf42691a80 going to sleep for 0 seconds 00010000:00010000:0.0:1784189235.951521:0:26173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784189236.012798:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1784189236.012848:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000400:00000100:3.0:1784189236.012881:0:3633:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-192.168.203.12@tcp portal 26 match 1870854436297728 offset 0 length 224: 4 00000100:00100000:2.0:1784189236.012917:0:68287:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436297984 00000100:00100000:3.0:1784189236.012918:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1784189236.012932:0:68287:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436297984 00000100:00100000:3.0:1784189236.012977:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1784189236.013029:0:68287:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436297856 00000100:00100000:2.0:1784189236.013033:0:68287:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436297856 00000100:00100000:3.0:1784189236.013043:0:66170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1240 00000100:00100000:3.0:1784189236.013062:0:66170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf43e10a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:debedd94-805c-42a0-a5e5-41758b2012e9+7:2396:x1870854436297984:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:0.0:1784189236.013099:0:26165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436298240 00000100:00100000:3.0:1784189236.013163:0:66170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf43e10a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:debedd94-805c-42a0-a5e5-41758b2012e9+7:2396:x1870854436297984:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 105us (391us total) trans 0 rc 0/0 00000100:00100000:0.0:1784189236.013196:0:26165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436298240 00000100:00100000:0.0:1784189236.013235:0:26165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436298112 00000100:00100000:0.0:1784189236.013239:0:26165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436298112 00000100:00100000:0.0:1784189236.013264:0:26165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 2504 00000100:00100000:0.0:1784189236.013273:0:26165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc05eddf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:debedd94-805c-42a0-a5e5-41758b2012e9+5:2396:x1870854436298240:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:2.0:1784189236.014009:0:68287:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1327 00000100:00100000:2.0:1784189236.014019:0:68287:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf464ad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2395:x1870854436297856:12345-192.168.203.12@tcp:38:kworker.0 00010000:00020000:2.0:1784189236.014042:0:68287:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.203.12@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1784189236.014107:0:66170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1240 00000100:00100000:0.0:1784189236.014133:0:26165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc05eddf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:debedd94-805c-42a0-a5e5-41758b2012e9+5:2396:x1870854436298240:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 857us (1281us total) trans 0 rc 0/0 00000100:00100000:0.0:1784189236.014144:0:26165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 2504 00000100:00100000:0.0:1784189236.014167:0:26165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 2505 00000100:00100000:0.0:1784189236.014177:0:26165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf464ac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:debedd94-805c-42a0-a5e5-41758b2012e9+5:2396:x1870854436298112:12345-192.168.203.12@tcp:400:kworker.0 00000100:00080000:3.0:1784189236.014182:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1784189236.014191:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1784189236.014197:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1784189236.016914:0:68287:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf464ad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2395:x1870854436297856:12345-192.168.203.12@tcp:38:kworker.0 Request processed in 2295us (3341us total) trans 0 rc -19/-19 00000100:00100000:2.0:1784189236.016929:0:68287:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1327 00000100:00100000:0.0:1784189236.017055:0:26165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf464ac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:debedd94-805c-42a0-a5e5-41758b2012e9+5:2396:x1870854436298112:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 2877us (4135us total) trans 0 rc 0/0 00000100:00100000:0.0:1784189236.017064:0:26165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 2505 00000100:00100000:3.0:1784189236.783931:0:75594:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dbf42691a80 going to sleep for 0 seconds 00010000:00010000:2.0:1784189236.976666:0:7454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784189237.810037:0:75594:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dbf42691a80 going to sleep for 0 seconds 00010000:00010000:2.0:1784189238.002951:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784189238.321202:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1784189238.321220:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf4a340700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1870854458159744:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1784189238.321312:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784189238.321424:0:9466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458159744 00000100:00100000:1.0:1784189238.321433:0:9466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458159744 00000100:00100000:1.0:1784189238.321516:0:9466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2004 00000100:00100000:1.0:1784189238.321526:0:9466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf4a343800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1870854458159744:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1784189238.321567:0:9466:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8648768 pending 0 free 3922481152 avail 3690958848 00000100:00100000:1.0:1784189238.321620:0:9466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf4a343800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1870854458159744:12345-0@lo:13:osp-pre-0-1.0 Request processed in 94us (306us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189238.321628:0:9466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2004 00000100:00080000:1.0:1784189238.321654:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1784189238.321711:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf4a340700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1870854458159744:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1784189238.325924:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1784189238.325953:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf464adf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1870854458159872:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1784189238.326049:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784189238.326110:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458159872 00000100:00100000:3.0:1784189238.326120:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458159872 00000100:00100000:3.0:1784189238.326191:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2005 00000100:00100000:3.0:1784189238.326201:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf47545180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1870854458159872:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1784189238.326239:0:8432:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8648768 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1784189238.326291:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf47545180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1870854458159872:12345-0@lo:13:osp-pre-1-1.0 Request processed in 91us (242us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189238.326300:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2005 00000100:00080000:3.0:1784189238.326358:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1784189238.326399:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf464adf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1870854458159872:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1784189238.831419:0:75594:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dbf42691a80 going to sleep for 0 seconds 00010000:00010000:3.0:1784189239.023498:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784189239.592468:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1784189239.592530:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1784189239.592639:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000400:00000100:3.0:1784189239.592673:0:3633:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-192.168.203.12@tcp portal 26 match 1870854436298368 offset 0 length 224: 4 00000100:00100000:3.0:1784189239.592700:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1784189239.592745:0:66170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436298496 00000100:00100000:3.0:1784189239.592757:0:66170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436298496 00000100:00100000:3.0:1784189239.592815:0:66170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436298624 00000100:00100000:3.0:1784189239.592818:0:66170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436298624 00000100:00100000:3.0:1784189239.592866:0:66170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1241 00000100:00100000:3.0:1784189239.592879:0:66170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf47544380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:debedd94-805c-42a0-a5e5-41758b2012e9+7:2395:x1870854436298624:12345-192.168.203.12@tcp:38:kworker.0 00010000:02000400:3.0:1784189239.592921:0:66170:0:(ldlm_lib.c:964:target_handle_reconnect()) lustre-MDT0001: Client debedd94-805c-42a0-a5e5-41758b2012e9 (at 192.168.203.12@tcp) reconnecting 00000100:00100000:1.0:1784189239.594031:0:66945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1328 00000100:00100000:1.0:1784189239.594045:0:66945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf47544000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2395:x1870854436298496:12345-192.168.203.12@tcp:38:kworker.0 00010000:00020000:1.0:1784189239.594072:0:66945:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.203.12@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1784189239.594161:0:66945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf47544000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2395:x1870854436298496:12345-192.168.203.12@tcp:38:kworker.0 Request processed in 116us (1630us total) trans 0 rc -19/-19 00000100:00100000:1.0:1784189239.594171:0:66945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1328 00000100:00100000:1.0:1784189239.594206:0:26161:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436298752 00000100:00100000:1.0:1784189239.594212:0:26161:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436298752 00000100:00100000:1.0:1784189239.594253:0:26161:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436298880 00000100:00100000:1.0:1784189239.594257:0:26161:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436298880 00000100:00100000:1.0:1784189239.594282:0:26161:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 2506 00000100:00100000:1.0:1784189239.594310:0:26161:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf47546d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:debedd94-805c-42a0-a5e5-41758b2012e9+5:2396:x1870854436298752:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:1.0:1784189239.594395:0:26161:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf47546d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:debedd94-805c-42a0-a5e5-41758b2012e9+5:2396:x1870854436298752:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 87us (1943us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189239.594401:0:26161:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 2506 00000100:00100000:1.0:1784189239.594418:0:26161:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 2507 00000100:00100000:1.0:1784189239.594425:0:26161:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf47545880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:debedd94-805c-42a0-a5e5-41758b2012e9+5:2396:x1870854436298880:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:1.0:1784189239.594451:0:26161:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf47545880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:debedd94-805c-42a0-a5e5-41758b2012e9+5:2396:x1870854436298880:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 27us (1750us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189239.594457:0:26161:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 2507 00000100:00080000:2.0:1784189239.597091:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1784189239.597105:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1784189239.597109:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:3.0:1784189239.606733:0:66170:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0001: connection from debedd94-805c-42a0-a5e5-41758b2012e9@192.168.203.12@tcp t0 exp ffff9dc04ffb2000 cur 3481 last 1784189239 00000004:00100000:2.0:1784189239.608748:0:66170:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0001: cli 192.168.203.12@tcp supports cksum type f7, return f7 00000100:00080000:2.0:1784189239.608789:0:66170:0:(import.c:65:import_set_state_nolock()) ffff9dc04ffb4800 : changing import state from FULL to RECOVER 00000100:00080000:2.0:1784189239.608803:0:66170:0:(import.c:65:import_set_state_nolock()) ffff9dc04ffb4800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1784189239.608919:0:66170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf47544380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:debedd94-805c-42a0-a5e5-41758b2012e9+7:2395:x1870854436298624:12345-192.168.203.12@tcp:38:kworker.0 Request processed in 16041us (16277us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189239.608949:0:66170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1241 00000100:00100000:3.0:1784189239.614146:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1784189239.617017:0:66179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436296192 00000100:00100000:1.0:1784189239.617035:0:66179:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436296192 00000100:00100000:1.0:1784189239.617148:0:66179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 14 00000100:00100000:1.0:1784189239.617160:0:66179:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf464adf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0001:debedd94-805c-42a0-a5e5-41758b2012e9+7:71032:x1870854436296192:12345-192.168.203.12@tcp:700:cp.0 00000100:00080000:1.0:1784189239.617248:0:66179:0:(client.c:1832:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != DISCONN) req@ffff9dbf4a340700 x1870854458160000/t0(0) o700->lustre-MDT0000-lwp-MDT0001@0@lo:32/10 lens 264/248 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'mdt_seqm_0001.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784189239.617261:0:66179:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dc06bb569c0 going to sleep for 0 seconds 00000100:00100000:3.0:1784189239.865125:0:75594:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dbf42691a80 going to sleep for 0 seconds 00010000:00010000:0.0:1784189240.049291:0:26173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1784189240.367710:0:63468:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1784189240.367720:0:63468:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1784189240.367725:0:63468:0:(import.c:65:import_set_state_nolock()) ffff9dbf42271800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1784189240.367744:0:63468:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3477 00000100:00080000:1.0:1784189240.367751:0:63468:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1784189240.367878:0:63468:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9dbf42271800 using connection 192.168.203.112@tcp/0@lo 00000100:00100000:1.0:1784189240.367909:0:63468:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9dbf4a343480 x1870854458160256/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1784189240.367958:0:63468:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1784189240.367962:0:63468:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1784189240.367964:0:63468:0:(import.c:65:import_set_state_nolock()) ffff9dbf425f4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1784189240.367968:0:63468:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3477 00000100:00080000:1.0:1784189240.367971:0:63468:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1784189240.367975:0:63468:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9dbf425f4800 using connection 192.168.203.112@tcp/0@lo 00000100:00100000:1.0:1784189240.367988:0:63468:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9dc0477c1c00 x1870854458160512/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1784189240.368022:0:63468:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1784189240.368025:0:63468:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1784189240.368027:0:63468:0:(import.c:65:import_set_state_nolock()) ffff9dbf436c4000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1784189240.368031:0:63468:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3477 00000100:00080000:1.0:1784189240.368034:0:63468:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1784189240.368038:0:63468:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9dbf436c4000 using connection 192.168.203.112@tcp/0@lo 00000100:00100000:1.0:1784189240.368053:0:63468:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9dc05edd0380 x1870854458160768/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1784189240.368076:0:63468:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1784189240.368079:0:63468:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1784189240.368081:0:63468:0:(import.c:65:import_set_state_nolock()) ffff9dbf43690800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1784189240.368083:0:63468:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3477 00000100:00080000:1.0:1784189240.368086:0:63468:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1784189240.368089:0:63468:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff9dbf43690800 using connection 192.168.203.112@tcp/0@lo 00000100:00100000:1.0:1784189240.368102:0:63468:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9dbf4a32df80 x1870854458161152/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1784189240.368144:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf4a341f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bd553d0d-03e2-4233-b06b-b55bbfa2b954:3640:1870854458160128:0@lo:400:kworker.0 00000400:00000100:1.0:1784189240.368218:0:3640:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1870854458160128 offset 0 length 224: 4 00000100:00100000:1.0:1784189240.368265:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf4a32e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1870854458161024:0@lo:400:kworker.0 00000100:00100000:1.0:1784189240.368301:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784189240.368356:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1784189240.368362:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc0477c0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3640:1870854458160384:0@lo:400:kworker.0 00000100:00100000:1.0:1784189240.368389:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784189240.368428:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf4a32f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1870854458160896:0@lo:400:kworker.0 00000100:00100000:3.0:1784189240.369279:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf4a343480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3639:1870854458160256:0@lo:38:kworker.0 00000100:00100000:1.0:1784189240.373019:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784189240.373100:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1784189240.373115:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc080df2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3643:1870854458160640:0@lo:400:kworker.0 00000100:00100000:3.0:1784189240.373197:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784189240.373237:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc0477c1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3639:1870854458160512:0@lo:38:kworker.0 00000100:00100000:3.0:1784189240.373285:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784189240.373483:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc05edd0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3639:1870854458160768:0@lo:38:kworker.0 00000100:00100000:3.0:1784189240.373521:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784189240.373543:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf4a32df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3639:1870854458161152:0@lo:38:kworker.0 00000100:00100000:3.0:1784189240.373582:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784189240.373666:0:26166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458161024 00000100:00100000:3.0:1784189240.373676:0:26166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458161024 00000100:00100000:3.0:1784189240.373758:0:26166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458160896 00000100:00100000:3.0:1784189240.373762:0:26166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458160896 00000100:00100000:3.0:1784189240.373791:0:26166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2508 00000100:00100000:3.0:1784189240.373803:0:26166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf4a32d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+5:3640:x1870854458161024:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784189240.373873:0:26166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf4a32d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+5:3640:x1870854458161024:12345-0@lo:400:kworker.0 Request processed in 73us (5570us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189240.373881:0:26166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2508 00000100:00100000:3.0:1784189240.373903:0:26166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2509 00000100:00100000:3.0:1784189240.373910:0:26166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc071537800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+5:3643:x1870854458160896:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784189240.373939:0:26166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc071537800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+5:3643:x1870854458160896:12345-0@lo:400:kworker.0 Request processed in 30us (931us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189240.373944:0:26166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2509 00000100:00100000:3.0:1784189240.373963:0:66945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458160384 00000100:00100000:3.0:1784189240.373966:0:66945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458160384 00000100:00100000:3.0:1784189240.373996:0:66945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458160256 00000100:00100000:3.0:1784189240.373998:0:66945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458160256 00000100:00100000:3.0:1784189240.374006:0:66945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1242 00000100:00100000:3.0:1784189240.374012:0:66945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc05ed7df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1870854458160384:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784189240.374043:0:66945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc05ed7df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1870854458160384:12345-0@lo:400:kworker.0 Request processed in 32us (5653us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189240.374049:0:66945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1242 00000100:00100000:3.0:1784189240.374057:0:66945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458160512 00000100:00100000:3.0:1784189240.374060:0:66945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458160512 00000100:00100000:3.0:1784189240.374068:0:66945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458161152 00000100:00100000:3.0:1784189240.374070:0:66945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458161152 00000100:00100000:3.0:1784189240.374089:0:66945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1329 00000100:00100000:3.0:1784189240.374094:0:66945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc074ad5450 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3639:x1870854458160256:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1784189240.374115:0:66945:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1784189240.374157:0:66945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc074ad5450 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3639:x1870854458160256:12345-0@lo:38:kworker.0 Request processed in 62us (961us total) trans 0 rc -19/-19 00000100:00100000:3.0:1784189240.374164:0:66945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1329 00000100:00100000:3.0:1784189240.375660:0:66945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1330 00000100:00100000:3.0:1784189240.375671:0:66945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc070221f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3639:x1870854458160512:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1784189240.375693:0:66945:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1784189240.375756:0:66945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc070221f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3639:x1870854458160512:12345-0@lo:38:kworker.0 Request processed in 85us (2471us total) trans 0 rc -19/-19 00000100:00100000:3.0:1784189240.375764:0:66945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1330 00000100:00100000:3.0:1784189240.375781:0:66945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1331 00000100:00100000:3.0:1784189240.375785:0:66945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc075f7fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3639:x1870854458161152:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1784189240.375794:0:66945:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1784189240.375819:0:66945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc075f7fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3639:x1870854458161152:12345-0@lo:38:kworker.0 Request processed in 32us (2236us total) trans 0 rc -19/-19 00000100:00100000:3.0:1784189240.375824:0:66945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1331 00000100:00100000:3.0:1784189240.375860:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458160768 00000100:00100000:3.0:1784189240.375867:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458160768 00000100:00100000:3.0:1784189240.375905:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3844 00000100:00100000:3.0:1784189240.375909:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc075f7c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3639:x1870854458160768:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1784189240.375920:0:8439:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1784189240.375948:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc075f7c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3639:x1870854458160768:12345-0@lo:38:kworker.0 Request processed in 37us (2427us total) trans 0 rc -19/-19 00000100:00100000:3.0:1784189240.375963:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3844 00000100:00080000:3.0:1784189240.375986:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1784189240.375993:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1784189240.375996:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1784189240.376053:0:3639:0:(import.c:65:import_set_state_nolock()) ffff9dbf42271800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1784189240.376058:0:3639:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1784189240.376064:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf4a343480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3639:1870854458160256:0@lo:38:kworker.0 00000100:00080000:3.0:1784189240.376075:0:3639:0:(import.c:65:import_set_state_nolock()) ffff9dbf425f4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1784189240.376079:0:3639:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1784189240.376082:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc0477c1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3639:1870854458160512:0@lo:38:kworker.0 00000100:00080000:3.0:1784189240.376092:0:3639:0:(import.c:65:import_set_state_nolock()) ffff9dbf436c4000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1784189240.376096:0:3639:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1784189240.376099:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc05edd0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3639:1870854458160768:0@lo:38:kworker.0 00000100:00080000:3.0:1784189240.376109:0:3639:0:(import.c:65:import_set_state_nolock()) ffff9dbf43690800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1784189240.376112:0:3639:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1784189240.376114:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf4a32df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3639:1870854458161152:0@lo:38:kworker.0 00000100:00100000:3.0:1784189240.376173:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc0477c0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3640:1870854458160384:0@lo:400:kworker.0 00000100:00100000:3.0:1784189240.376188:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf4a32e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1870854458161024:0@lo:400:kworker.0 00000100:00100000:1.0:1784189240.376735:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784189240.376780:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf4a32f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1870854458160896:0@lo:400:kworker.0 00000100:00100000:1.0:1784189240.376811:0:68287:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458160640 00000100:00100000:1.0:1784189240.376816:0:68287:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458160640 00000100:00100000:1.0:1784189240.376867:0:68287:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1243 00000100:00100000:1.0:1784189240.376874:0:68287:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc071534a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1870854458160640:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784189240.376922:0:68287:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc071534a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1870854458160640:12345-0@lo:400:kworker.0 Request processed in 48us (190us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189240.376929:0:68287:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1243 00000100:00080000:1.0:1784189240.376953:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1784189240.376973:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc080df2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3643:1870854458160640:0@lo:400:kworker.0 00000100:00100000:2.0:1784189240.626209:0:66179:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dc06bb569c0 going to sleep for 0 seconds 00000100:00100000:2.0:1784189240.879717:0:75594:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dbf42691a80 going to sleep for 0 seconds 00010000:00010000:2.0:1784189241.071833:0:7454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784189241.647424:0:66179:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dc06bb569c0 going to sleep for 0 seconds 00000100:00100000:3.0:1784189241.903703:0:75594:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dbf42691a80 going to sleep for 0 seconds 00010000:00010000:1.0:1784189242.095621:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784189242.663796:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1784189242.664180:0:66169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436299392 00000100:00100000:3.0:1784189242.664195:0:66169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436299392 00000100:00100000:3.0:1784189242.664301:0:66169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1244 00000100:00100000:3.0:1784189242.664314:0:66169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc071534380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:debedd94-805c-42a0-a5e5-41758b2012e9+8:2398:x1870854436299392:12345-192.168.203.12@tcp:400:kworker.0 00000100:00080000:1.0:1784189242.664369:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1784189242.673807:0:66179:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dc06bb569c0 going to sleep for 0 seconds 00000400:00000100:2.0:1784189242.673820:0:3634:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-192.168.203.12@tcp portal 26 match 1870854436299136 offset 0 length 520: 4 00000100:00100000:3.0:1784189242.674070:0:66169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc071534380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:debedd94-805c-42a0-a5e5-41758b2012e9+8:2398:x1870854436299392:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 9752us (10281us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189242.674474:0:66169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1244 00000100:00100000:2.0:1784189242.674710:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1784189242.674753:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1784189242.674784:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1784189242.674813:0:26167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436299520 00000100:00100000:2.0:1784189242.674825:0:26167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436299520 00000100:00100000:2.0:1784189242.674887:0:26167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436299648 00000100:00100000:2.0:1784189242.674891:0:26167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436299648 00000100:00100000:2.0:1784189242.674921:0:26167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 4971 00000100:00100000:2.0:1784189242.674932:0:26167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc07b7e3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:debedd94-805c-42a0-a5e5-41758b2012e9+5:2395:x1870854436299520:12345-192.168.203.12@tcp:9:kworker.0 00000020:00000080:2.0:1784189242.674974:0:26167:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xcc1762b626f8bbfd 00000100:00080000:2.0:1784189242.674987:0:26167:0:(import.c:65:import_set_state_nolock()) ffff9dc0477d1000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1784189242.675055:0:26167:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294968953 00000100:00100000:2.0:1784189242.675262:0:26167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc07b7e3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:debedd94-805c-42a0-a5e5-41758b2012e9+2:2395:x1870854436299520:12345-192.168.203.12@tcp:9:kworker.0 Request processed in 330us (507us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189242.675270:0:26167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 4971 00000100:00100000:2.0:1784189242.675286:0:26167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 4972 00000100:00100000:2.0:1784189242.675294:0:26167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc07b7e1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:debedd94-805c-42a0-a5e5-41758b2012e9+5:2395:x1870854436299648:12345-192.168.203.12@tcp:9:kworker.0 00000020:00000080:2.0:1784189242.675306:0:26167:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xcc1762b626f8bc04 00000100:00080000:2.0:1784189242.675312:0:26167:0:(import.c:65:import_set_state_nolock()) ffff9dc0477d2000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1784189242.675369:0:26167:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294968956 00000100:00100000:2.0:1784189242.675462:0:26167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc07b7e1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:debedd94-805c-42a0-a5e5-41758b2012e9+2:2395:x1870854436299648:12345-192.168.203.12@tcp:9:kworker.0 Request processed in 169us (677us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189242.675470:0:26167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 4972 00010000:00010000:2.0:1784189242.675502:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784189242.675509:0:26173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1784189242.675517:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1784189242.675521:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1784189242.675651:0:68287:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436299264 00000100:00100000:0.0:1784189242.675658:0:68287:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436299264 00000100:00100000:0.0:1784189242.675692:0:68287:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1332 00000100:00100000:0.0:1784189242.675698:0:68287:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc07b7e1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2395:x1870854436299264:12345-192.168.203.12@tcp:38:kworker.0 00010000:00020000:0.0:1784189242.675725:0:68287:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.203.12@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1784189242.675757:0:68287:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc07b7e1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2395:x1870854436299264:12345-192.168.203.12@tcp:38:kworker.0 Request processed in 58us (1049us total) trans 0 rc -19/-19 00000100:00100000:0.0:1784189242.675765:0:68287:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1332 00000100:00100000:1.0:1784189242.934003:0:75594:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dbf42691a80 going to sleep for 0 seconds 00010000:00010000:0.0:1784189243.120210:0:7454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784189243.439582:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc071536a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1870854458161280:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1784189243.439701:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784189243.439815:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458161280 00000100:00100000:1.0:1784189243.439826:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458161280 00000100:00100000:1.0:1784189243.440030:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2006 00000100:00100000:1.0:1784189243.440042:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc075f7e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1870854458161280:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1784189243.440084:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 211008 pending 0 free 3922481152 avail 3690958848 00000100:00100000:1.0:1784189243.440141:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc075f7e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1870854458161280:12345-0@lo:13:osp-pre-0-1.0 Request processed in 101us (440us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189243.440150:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2006 00000100:00080000:1.0:1784189243.440176:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1784189243.440252:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc071536a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1870854458161280:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1784189243.440863:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc075f7ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1870854458161408:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1784189243.440989:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784189243.441196:0:9466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458161408 00000100:00100000:3.0:1784189243.441203:0:9466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458161408 00000100:00100000:3.0:1784189243.441263:0:9466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2007 00000100:00100000:3.0:1784189243.441271:0:9466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc071537100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1870854458161408:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1784189243.441300:0:9466:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 211008 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1784189243.441366:0:9466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc071537100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1870854458161408:12345-0@lo:13:osp-pre-1-1.0 Request processed in 96us (377us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189243.441375:0:9466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2007 00000100:00100000:3.0:1784189243.441416:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc075f7ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1870854458161408:0@lo:13:osp-pre-1-1.0 00000100:00080000:1.0:1784189243.441514:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1784189243.696592:0:66179:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dc06bb569c0 going to sleep for 0 seconds 00000020:01000004:2.0:1784189243.822357:0:92390:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1784189243.822369:0:92390:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds1_flakey 00000020:01000004:2.0:1784189243.822371:0:92390:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:2.0:1784189243.822520:0:92390:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff9dbf46b0a800 00000020:01000004:2.0:1784189243.822551:0:92390:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0000, type=osd-ldiskfs, lsifl=200005, mountfl=0 00000020:01000004:2.0:1784189243.822571:0:92390:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-ldiskfs) 00000020:00000080:2.0:1784189243.822590:0:92390:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff9dbf449f3380) 00000020:00000080:2.0:1784189243.822626:0:92390:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-ldiskfs with refcount 2 00100000:10000000:0.0:1784189243.934510:0:92390:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:0.0:1784189243.935277:0:92390:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:0.0:1784189243.938283:0:92390:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:0.0:1784189243.938718:0:92390:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/32) registered 00100000:10000000:0.0:1784189243.939051:0:92390:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:0.0:1784189243.939551:0:92390:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/32) registered 00100000:10000000:0.0:1784189243.939827:0:92390:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:0.0:1784189243.940144:0:92390:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/32) registered 00100000:10000000:0.0:1784189243.940457:0:92390:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/32) registered 00100000:10000000:0.0:1784189243.940669:0:92390:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:0.0:1784189243.940991:0:92390:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:0.0:1784189243.941298:0:92390:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/32) registered 00100000:10000000:0.0:1784189243.941594:0:92390:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:0.0:1784189243.941802:0:92390:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x9:0x0] (8/32) registered 00100000:10000000:2.0:1784189243.944502:0:92390:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2f:0x0] (24/16) registered 00100000:10000000:2.0:1784189243.944788:0:92390:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:2.0:1784189243.945036:0:92390:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:2.0:1784189243.945279:0:92390:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1e:0x0] (16/1) registered 00100000:10000000:2.0:1784189243.945583:0:92390:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:2.0:1784189243.945809:0:92390:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:2.0:1784189243.946057:0:92390:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:2.0:1784189243.946295:0:92390:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x32:0x0] (24/16) registered 00100000:10000000:2.0:1784189243.946499:0:92390:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x34:0x0] (24/16) registered 00100000:10000000:2.0:1784189243.946722:0:92390:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:2.0:1784189243.947002:0:92390:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:2.0:1784189243.947290:0:92390:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:2.0:1784189243.947596:0:92390:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:2.0:1784189243.947805:0:92390:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:2.0:1784189243.948117:0:92390:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x20:0x0] (16/1) registered 00100000:10000000:2.0:1784189243.948421:0:92390:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x22:0x0] (16/1) registered 00100000:10000000:2.0:1784189243.948609:0:92390:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:2.0:1784189243.948847:0:92390:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:2.0:1784189243.949253:0:92390:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:2.0:1784189243.949594:0:92390:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:2.0:1784189243.949845:0:92390:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:2.0:1784189243.950233:0:92390:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:2.0:1784189243.950464:0:92390:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1f:0x0] (16/1) registered 00100000:10000000:2.0:1784189243.950664:0:92390:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x21:0x0] (16/1) registered 00100000:10000000:2.0:1784189243.950995:0:92390:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x23:0x0] (16/1) registered 00100000:10000000:2.0:1784189243.951250:0:92390:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x33:0x0] (24/16) registered 00000100:00100000:1.0:1784189243.951436:0:75594:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dbf42691a80 going to sleep for 0 seconds 00100000:10000000:2.0:1784189243.951635:0:92390:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:2.0:1784189243.951854:0:92390:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x31:0x0] (24/16) registered 00100000:10000000:2.0:1784189243.952084:0:92390:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:2.0:1784189243.952292:0:92390:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x30:0x0] (24/16) registered 00100000:10000000:2.0:1784189243.952472:0:92390:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:2.0:1784189243.952678:0:92390:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:3.0:1784189243.955569:0:92390:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2:0x0] (8/32) registered 00100000:10000000:3.0:1784189243.957290:0:92390:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/32) registered 00100000:10000000:3.0:1784189243.957787:0:92390:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/32) registered 00100000:10000000:3.0:1784189243.958100:0:92390:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/32) registered 00100000:10000000:3.0:1784189243.958598:0:92390:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/32) registered 00100000:10000000:3.0:1784189243.958865:0:92390:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/32) registered 00100000:10000000:3.0:1784189243.959353:0:92390:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/32) registered 00080000:01000000:3.0:1784189243.960462:0:92390:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0000: register osd-ldiskfs tunable parameters 00000020:00000080:3.0:1784189243.960816:0:92390:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:3.0:1784189243.960829:0:92390:0:(osd_handler.c:8929:osd_obd_connect()) connect #0 00000020:00000080:3.0:1784189243.960846:0:92390:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xcc1762b626f8bc90 00000020:01000004:3.0:1784189243.960856:0:92390:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0000 on device /dev/mapper/mds1_flakey 00000020:01000000:3.0:1784189243.960887:0:92390:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:3.0:1784189243.960894:0:92390:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9dbf46b0a800 from MGS 00000020:01000004:3.0:1784189243.960899:0:92390:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:3.0:1784189243.960912:0:92390:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff9dc0762999c0) 00000020:00000080:3.0:1784189243.960928:0:92390:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mgs with refcount 2 00000020:01000004:3.0:1784189243.961022:0:92390:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9dbf46b0a800 from MGS, refs=2 00080000:01000000:3.0:1784189243.961028:0:92390:0:(osd_handler.c:8929:osd_obd_connect()) connect #1 00000020:00000080:3.0:1784189243.961033:0:92390:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xcc1762b626f8bc9e 00010000:00010000:3.0:1784189243.961190:0:92390:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-MGS-3 is initialized 00000040:01000000:3.0:1784189243.966118:0:92390:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 10000000:01000000:0.0:1784189243.976453:0:92394:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:1.0:1784189243.978872:0:92390:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:1.0:1784189243.978959:0:92390:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1784189243.979845:0:92390:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:1.0:1784189243.980268:0:92390:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1784189243.980688:0:92390:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:1.0:1784189243.980698:0:92390:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:1.0:1784189243.981762:0:92390:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:1.0:1784189243.981775:0:92390:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:1.0:1784189243.982111:0:92390:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:1.0:1784189243.982117:0:92390:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:1.0:1784189243.982980:0:92390:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:1.0:1784189243.983014:0:92390:0:(obd_mount.c:392:lustre_start_mgc()) New MGS with live MGC 00000020:01000004:1.0:1784189243.983016:0:92390:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.112@tcp:Set MGC reconnect 2 10000000:01000000:1.0:1784189243.983020:0:92390:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.112@tcp 2/d0:i0:r0:or0:FULL 00000100:00080000:1.0:1784189243.983034:0:92390:0:(import.c:65:import_set_state_nolock()) ffff9dc07110c800 MGS: changing import state from FULL to DISCONN 00000100:02020000:1.0:1784189243.983041:0:92390:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.203.112@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00000100:00080000:1.0:1784189243.983045:0:92390:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.203.112@tcp not replayable, auto-deactivating 00000100:00080000:1.0:1784189243.983047:0:92390:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:1.0:1784189243.983061:0:92390:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9dc07b7e0000 x1870854458156416/t0(0) o400->MGC192.168.203.112@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1784189246 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784189243.983131:0:92390:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9dc05ed38700 x1870854458158592/t0(0) o400->MGC192.168.203.112@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1784189251 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784189243.983163:0:92390:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9dbf4a341f80 x1870854458160128/t0(0) o400->MGC192.168.203.112@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1784189256 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784189243.983268:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc05ed38700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:bd553d0d-03e2-4233-b06b-b55bbfa2b954:3641:1870854458158592:0@lo:400:kworker.0 10000000:01000000:1.0:1784189243.983290:0:92390:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:1.0:1784189243.983294:0:92390:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:1.0:1784189243.983295:0:92390:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:3.0:1784189243.983408:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc07b7e0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bd553d0d-03e2-4233-b06b-b55bbfa2b954:3642:1870854458156416:0@lo:400:kworker.0 00000100:00100000:2.0:1784189243.983468:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf4a341f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bd553d0d-03e2-4233-b06b-b55bbfa2b954:3640:1870854458160128:0@lo:400:kworker.0 00000100:00100000:1.0:1784189243.983643:0:92390:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:01000000:1.0:1784189243.984144:0:92390:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00010000:00010000:1.0:1784189243.984227:0:92390:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.112@tcp lock: ffff9dc07116f400/0xcc1762b626f8b86f lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0xcc1762b626f8b876 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1784189243.984241:0:92390:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.112@tcp lock: ffff9dc07116f400/0xcc1762b626f8b86f lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0xcc1762b626f8b876 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784189243.984249:0:92390:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:1.0:1784189243.984301:0:92390:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1784189243.984314:0:92390:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.112@tcp lock: ffff9dc07116f400/0xcc1762b626f8b86f lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0xcc1762b626f8b876 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189243.984360:0:92390:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.112@tcp lock: ffff9dc07116ee00/0xcc1762b626f8b7d5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x110e400000000 nid: local remote: 0xcc1762b626f8b7dc expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1784189243.984367:0:92390:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.112@tcp lock: ffff9dc07116ee00/0xcc1762b626f8b7d5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x110f400000000 nid: local remote: 0xcc1762b626f8b7dc expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784189243.984389:0:92390:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1784189243.984929:0:92390:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1784189243.984936:0:92390:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.112@tcp lock: ffff9dc07116ee00/0xcc1762b626f8b7d5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x590f400000000 nid: local remote: 0xcc1762b626f8b7dc expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189243.984950:0:92390:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.112@tcp lock: ffff9dc07116e800/0xcc1762b626f8b7f1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x110e400000000 nid: local remote: 0xcc1762b626f8b7f8 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1784189243.984958:0:92390:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.112@tcp lock: ffff9dc07116e800/0xcc1762b626f8b7f1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x110f400000000 nid: local remote: 0xcc1762b626f8b7f8 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784189243.984964:0:92390:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1784189243.985036:0:92390:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1784189243.985041:0:92390:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.112@tcp lock: ffff9dc07116e800/0xcc1762b626f8b7f1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x590f400000000 nid: local remote: 0xcc1762b626f8b7f8 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189243.985051:0:92390:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.112@tcp lock: ffff9dc05ec0e800/0xcc1762b626f8b81b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x110e400000000 nid: local remote: 0xcc1762b626f8b822 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1784189243.985058:0:92390:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.112@tcp lock: ffff9dc05ec0e800/0xcc1762b626f8b81b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x110f400000000 nid: local remote: 0xcc1762b626f8b822 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784189243.985063:0:92390:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1784189243.985129:0:92390:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1784189243.985134:0:92390:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.112@tcp lock: ffff9dc05ec0e800/0xcc1762b626f8b81b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x590f400000000 nid: local remote: 0xcc1762b626f8b822 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189243.985144:0:92390:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.112@tcp lock: ffff9dc058f66c00/0xcc1762b626f8b829 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x110e400000000 nid: local remote: 0xcc1762b626f8b830 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1784189243.985174:0:92390:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.112@tcp lock: ffff9dc058f66c00/0xcc1762b626f8b829 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x110f400000000 nid: local remote: 0xcc1762b626f8b830 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784189243.985178:0:92390:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1784189243.985305:0:92390:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1784189243.985311:0:92390:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.112@tcp lock: ffff9dc058f66c00/0xcc1762b626f8b829 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x590f400000000 nid: local remote: 0xcc1762b626f8b830 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189243.985344:0:92390:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.112@tcp lock: ffff9dc04a20a000/0xcc1762b626f8b845 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x110e400000000 nid: local remote: 0xcc1762b626f8b84c expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1784189243.985351:0:92390:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.112@tcp lock: ffff9dc04a20a000/0xcc1762b626f8b845 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x110f400000000 nid: local remote: 0xcc1762b626f8b84c expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784189243.985357:0:92390:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1784189243.985441:0:92390:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1784189243.985447:0:92390:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.112@tcp lock: ffff9dc04a20a000/0xcc1762b626f8b845 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x590f400000000 nid: local remote: 0xcc1762b626f8b84c expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189243.985458:0:92390:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.112@tcp lock: ffff9dc04a20ba00/0xcc1762b626f8b853 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x110e400000000 nid: local remote: 0xcc1762b626f8b85a expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1784189243.985465:0:92390:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.112@tcp lock: ffff9dc04a20ba00/0xcc1762b626f8b853 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x110f400000000 nid: local remote: 0xcc1762b626f8b85a expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784189243.985471:0:92390:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1784189243.985542:0:92390:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1784189243.985547:0:92390:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.112@tcp lock: ffff9dc04a20ba00/0xcc1762b626f8b853 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x590f400000000 nid: local remote: 0xcc1762b626f8b85a expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189243.985569:0:92390:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.112@tcp lock: ffff9dc07116fc00/0xcc1762b626f8b87d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0xcc1762b626f8b884 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1784189243.985576:0:92390:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.112@tcp lock: ffff9dc07116fc00/0xcc1762b626f8b87d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0xcc1762b626f8b884 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784189243.985581:0:92390:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1784189243.985659:0:92390:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1784189243.985665:0:92390:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.112@tcp lock: ffff9dc07116fc00/0xcc1762b626f8b87d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0xcc1762b626f8b884 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189243.985681:0:92390:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.112@tcp lock: ffff9dc05ec0f800/0xcc1762b626f8b7e3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0xcc1762b626f8b7ea expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1784189243.985688:0:92390:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.112@tcp lock: ffff9dc05ec0f800/0xcc1762b626f8b7e3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0xcc1762b626f8b7ea expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784189243.985693:0:92390:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1784189243.985826:0:92390:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1784189243.985832:0:92390:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.112@tcp lock: ffff9dc05ec0f800/0xcc1762b626f8b7e3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0xcc1762b626f8b7ea expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189243.985848:0:92390:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.112@tcp lock: ffff9dc05ec0fa00/0xcc1762b626f8b7ff lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0xcc1762b626f8b806 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1784189243.985855:0:92390:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.112@tcp lock: ffff9dc05ec0fa00/0xcc1762b626f8b7ff lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0xcc1762b626f8b806 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784189243.985861:0:92390:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 00010000:00010000:1.0:1784189243.985942:0:92390:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1784189243.985948:0:92390:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.112@tcp lock: ffff9dc05ec0fa00/0xcc1762b626f8b7ff lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0xcc1762b626f8b806 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189243.985965:0:92390:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.112@tcp lock: ffff9dc05ec0ea00/0xcc1762b626f8b80d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x110e400000000 nid: local remote: 0xcc1762b626f8b814 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1784189243.985971:0:92390:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.112@tcp lock: ffff9dc05ec0ea00/0xcc1762b626f8b80d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x110f400000000 nid: local remote: 0xcc1762b626f8b814 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784189243.985976:0:92390:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1784189243.986043:0:92390:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1784189243.986048:0:92390:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.112@tcp lock: ffff9dc05ec0ea00/0xcc1762b626f8b80d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x590f400000000 nid: local remote: 0xcc1762b626f8b814 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189243.986058:0:92390:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.112@tcp lock: ffff9dc04a20b200/0xcc1762b626f8b837 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x110e400000000 nid: local remote: 0xcc1762b626f8b83e expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1784189243.986064:0:92390:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.112@tcp lock: ffff9dc04a20b200/0xcc1762b626f8b837 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x110f400000000 nid: local remote: 0xcc1762b626f8b83e expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784189243.986070:0:92390:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1784189243.986138:0:92390:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1784189243.986143:0:92390:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.112@tcp lock: ffff9dc04a20b200/0xcc1762b626f8b837 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x590f400000000 nid: local remote: 0xcc1762b626f8b83e expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189243.986217:0:92390:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.112@tcp lock: ffff9dc058f66000/0xcc1762b626f8b861 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0xcc1762b626f8b868 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1784189243.986223:0:92390:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.112@tcp lock: ffff9dc058f66000/0xcc1762b626f8b861 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0xcc1762b626f8b868 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784189243.986239:0:92390:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1784189243.986307:0:92390:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1784189243.986312:0:92390:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.112@tcp lock: ffff9dc058f66000/0xcc1762b626f8b861 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0xcc1762b626f8b868 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1784189243.986353:0:92390:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffff9dc07110c800 already not connected (conn 64, was 0): DISCONN 00000100:00080000:1.0:1784189243.986360:0:92390:0:(import.c:65:import_set_state_nolock()) ffff9dc07110c800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1784189243.986368:0:92390:0:(import.c:510:import_select_connection()) MGC192.168.203.112@tcp: connect to NID 0@lo last attempt 3436 00000100:00080000:1.0:1784189243.986377:0:92390:0:(import.c:624:import_select_connection()) MGC192.168.203.112@tcp: import ffff9dc07110c800 using connection 192.168.203.112@tcp/0@lo 00000100:00100000:1.0:1784189243.986415:0:92390:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9dc071534700 x1870854458161536/t0(0) o250->MGC192.168.203.112@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1784189243.986449:0:92390:0:(recover.c:337:ptlrpc_recover_import()) MGS: recovery started, waiting 20 seconds 00000100:00100000:0.0:1784189243.986529:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc071534700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:bd553d0d-03e2-4233-b06b-b55bbfa2b954:3639:1870854458161536:0@lo:250:mount.lustre.0 00000100:00100000:0.0:1784189243.986643:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784189243.986833:0:92396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458161536 00000100:00100000:2.0:1784189243.986844:0:92396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458161536 00000100:00100000:2.0:1784189243.986893:0:92396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1784189243.986903:0:92396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf456b2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3639:x1870854458161536:12345-0@lo:250:mount.lustre.0 00010000:00080000:2.0:1784189243.986938:0:92396:0:(ldlm_lib.c:1445:target_handle_connect()) MGS: connection from bd553d0d-03e2-4233-b06b-b55bbfa2b954@0@lo t0 exp 0000000000000000 cur 3486 last 0 00000020:00000080:2.0:1784189243.986982:0:92396:0:(genops.c:1406:class_connect()) connect: client bd553d0d-03e2-4233-b06b-b55bbfa2b954, cookie 0xcc1762b626f8bca5 00000100:00080000:2.0:1784189243.987232:0:92396:0:(import.c:65:import_set_state_nolock()) ffff9dbf434ac000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1784189243.987362:0:92396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf456b2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd553d0d-03e2-4233-b06b-b55bbfa2b954+5:3639:x1870854458161536:12345-0@lo:250:mount.lustre.0 Request processed in 457us (718us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189243.987371:0:92396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1784189243.987499:0:3639:0:(client.c:3112:ptlrpc_free_committed()) MGC192.168.203.112@tcp: committing for last_committed 0 gen 27 00000100:00080000:1.0:1784189243.987510:0:3639:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.203.112@tcp: connect to target with instance 0 00000100:00080000:1.0:1784189243.987519:0:3639:0:(import.c:956:ptlrpc_connect_set_flags()) MGC192.168.203.112@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:1.0:1784189243.987524:0:3639:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:1.0:1784189243.987528:0:3639:0:(import.c:65:import_set_state_nolock()) ffff9dc07110c800 MGS: changing import state from CONNECTING to FULL 10000000:01000000:1.0:1784189243.987530:0:3639:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:1.0:1784189243.987956:0:3639:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:1.0:1784189243.987974:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc071534700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:bd553d0d-03e2-4233-b06b-b55bbfa2b954:3639:1870854458161536:0@lo:250:mount.lustre.0 00000100:00080000:2.0:1784189243.988062:0:92390:0:(recover.c:348:ptlrpc_recover_import()) MGS: recovery finished FULL, rc = 0 00000020:01000004:2.0:1784189243.988075:0:92390:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:2.0:1784189243.988120:0:92390:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds1_flakey 10000000:01000000:2.0:1784189243.988126:0:92390:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.112@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:2.0:1784189243.988344:0:92390:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.112@tcp ctxt 0 is initialized 00000020:01000004:2.0:1784189243.988380:0:92390:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.203.112@tcp, index=0000, flags=0x20005 00000020:01000004:2.0:1784189243.988386:0:92390:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1784189243.988388:0:92390:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1784189243.988389:0:92390:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1784189243.988390:0:92390:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1784189243.988392:0:92390:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1784189243.988393:0:92390:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1784189243.988395:0:92390:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1784189243.988397:0:92390:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1784189243.988398:0:92390:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1784189243.988400:0:92390:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1784189243.988403:0:92390:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:2.0:1784189243.988405:0:92390:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1784189243.988406:0:92390:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1784189243.988407:0:92390:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1784189243.988409:0:92390:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1784189243.988410:0:92390:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1784189243.988411:0:92390:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1784189243.988412:0:92390:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1784189243.988413:0:92390:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1784189243.988414:0:92390:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1784189243.988415:0:92390:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1784189243.988438:0:92390:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1784189243.988456:0:92390:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc07b7e3480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd553d0d-03e2-4233-b06b-b55bbfa2b954:92390:1870854458161664:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1784189243.988520:0:92390:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784189243.988557:0:92390:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dbf458650c0 going to sleep for 11 seconds 00000020:01000000:0.0:1784189243.988657:0:36:0:(tgt_mount.c:1626:tgt_import_update()) NID #0: 192.168.203.112@tcp 10000000:01000000:0.0:1784189243.988672:0:36:0:(mgc_request_server.c:464:mgc_set_info_async_server()) NID notify for lustre-OST0000 about 1 new NIDs 00000020:01000004:0.0:1784189243.988674:0:36:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: req 00000020:01000004:0.0:1784189243.988676:0:36:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1784189243.988677:0:36:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1784189243.988679:0:36:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1784189243.988680:0:36:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1784189243.988681:0:36:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1784189243.988683:0:36:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1784189243.988684:0:36:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1784189243.988685:0:36:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:01000000:0.0:1784189243.988733:0:36:0:(tgt_mount.c:1637:tgt_import_update()) lustre-OST0000: notify about 1 NIDs, rc = 0 10000000:01000000:0.0:1784189243.988741:0:36:0:(mgc_request_server.c:464:mgc_set_info_async_server()) NID notify for lustre-OST0001 about 1 new NIDs 00000020:01000004:0.0:1784189243.988744:0:36:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: req 00000020:01000004:0.0:1784189243.988753:0:36:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1784189243.988754:0:36:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1784189243.988755:0:36:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1784189243.988756:0:36:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1784189243.988757:0:36:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1784189243.988758:0:36:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1784189243.988760:0:36:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1784189243.988761:0:36:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:01000000:0.0:1784189243.988785:0:36:0:(tgt_mount.c:1637:tgt_import_update()) lustre-OST0001: notify about 1 NIDs, rc = 0 10000000:01000000:0.0:1784189243.988790:0:36:0:(mgc_request_server.c:464:mgc_set_info_async_server()) NID notify for lustre-MDT0001 about 1 new NIDs 00000020:01000004:0.0:1784189243.988792:0:36:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: req 00000020:01000004:0.0:1784189243.988793:0:36:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1784189243.988795:0:36:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1784189243.988796:0:36:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1784189243.988797:0:36:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1784189243.988798:0:36:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1784189243.988799:0:36:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1784189243.988800:0:36:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1784189243.988801:0:36:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:01000000:0.0:1784189243.988813:0:36:0:(tgt_mount.c:1637:tgt_import_update()) lustre-MDT0001: notify about 1 NIDs, rc = 0 00000100:00100000:0.0:1784189243.988840:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc07b5b2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:bd553d0d-03e2-4233-b06b-b55bbfa2b954:3641:1870854458162048:0@lo:253:kworker.0 00000100:00100000:0.0:1784189243.988874:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784189243.988894:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1784189243.988899:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc07b5b0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:bd553d0d-03e2-4233-b06b-b55bbfa2b954:3641:1870854458161920:0@lo:253:kworker.0 00000100:00100000:0.0:1784189243.988930:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784189243.988961:0:92397:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458161664 00000100:00100000:0.0:1784189243.988967:0:92397:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458161664 00000100:00100000:0.0:1784189243.989002:0:92397:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458162048 00000100:00100000:0.0:1784189243.989005:0:92397:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458162048 00000100:00100000:0.0:1784189243.989015:0:92397:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458161920 00000100:00100000:0.0:1784189243.989017:0:92397:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458161920 00000100:00100000:0.0:1784189243.989031:0:92397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1784189243.989040:0:92397:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf456b0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd553d0d-03e2-4233-b06b-b55bbfa2b954+7:92390:x1870854458161664:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1784189243.989090:0:92397:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1784189243.989099:0:92397:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:0.0:1784189243.989102:0:92397:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 00000100:00100000:2.0:1784189243.989313:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc07b5b1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:bd553d0d-03e2-4233-b06b-b55bbfa2b954:3643:1870854458161792:0@lo:253:kworker.0 00000100:00100000:2.0:1784189243.989379:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784189243.989414:0:92396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458161792 00000100:00100000:2.0:1784189243.989418:0:92396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458161792 00000100:00100000:2.0:1784189243.989438:0:92396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1784189243.989444:0:92396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf456b0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd553d0d-03e2-4233-b06b-b55bbfa2b954+8:3641:x1870854458162048:12345-0@lo:253:kworker.0 20000000:01000000:2.0:1784189243.989462:0:92396:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 10000000:01000000:2.0:1784189243.990014:0:92399:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:0.0:1784189243.990623:0:92397:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 116 20000000:01000000:0.0:1784189243.992136:0:92400:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:0.0:1784189243.992143:0:92400:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 1 20000000:01000000:0.0:1784189243.992212:0:92400:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:0.0:1784189243.992217:0:92400:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:0.0:1784189243.992480:0:92400:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 20000000:01000000:1.0:1784189243.992987:0:92397:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1784189243.993048:0:92396:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:1.0:1784189243.994858:0:92397:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:1.0:1784189243.995254:0:92397:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf456b0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd553d0d-03e2-4233-b06b-b55bbfa2b954+8:92390:x1870854458161664:12345-0@lo:253:mount.lustre.0 Request processed in 6207us (6727us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189243.995277:0:92397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1784189243.995473:0:92397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1784189243.995489:0:92397:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf456b2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd553d0d-03e2-4233-b06b-b55bbfa2b954+7:3641:x1870854458161920:12345-0@lo:253:kworker.0 20000000:01000000:1.0:1784189243.995548:0:92397:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:1.0:1784189243.995779:0:92397:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:3.0:1784189243.995925:0:92396:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1784189243.995942:0:92396:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 20000000:01000000:0.0:1784189243.996031:0:92399:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1784189243.996037:0:92399:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1784189243.996070:0:92399:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9dc04152d600/0xcc1762b626f8bcac lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 92399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189243.996090:0:92399:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dc04152d600/0xcc1762b626f8bcac lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 92399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1784189243.996103:0:92399:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.000065949s 00010000:00010000:0.0:1784189243.996109:0:92399:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9dc04152d600/0xcc1762b626f8bcac lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 92399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189243.996117:0:92399:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9dc04152d600/0xcc1762b626f8bcac lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 92399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189243.996124:0:92399:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9dc04152d600/0xcc1762b626f8bcac lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 92399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189243.996132:0:92399:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9dc04152d600/0xcc1762b626f8bcac lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 92399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189243.996140:0:92399:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc04152d600 already unused, calling callback (ffffffffc0b2e230) 00010000:00010000:0.0:1784189243.996145:0:92399:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9dc04152d600/0xcc1762b626f8bcac lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 92399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189243.996225:0:92399:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9dc04152d600/0xcc1762b626f8bcac lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 92399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189243.996251:0:92399:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9dc04152d600/0xcc1762b626f8bcac lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 92399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189243.996261:0:92399:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9dc04152d600/0xcc1762b626f8bcac lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 92399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189243.996267:0:92399:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dc04152d600/0xcc1762b626f8bcac lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 92399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1784189243.998352:0:92397:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1784189243.998371:0:92397:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:2.0:1784189243.998687:0:92390:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc07b7e3480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd553d0d-03e2-4233-b06b-b55bbfa2b954:92390:1870854458161664:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1784189243.998719:0:92390:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1784189243.998723:0:92390:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1784189243.998725:0:92390:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1784189243.998727:0:92390:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1784189243.998729:0:92390:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1784189243.998730:0:92390:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1784189243.998732:0:92390:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1784189243.998733:0:92390:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1784189243.998735:0:92390:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1784189243.998738:0:92390:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1784189243.998740:0:92390:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1784189243.998773:0:92390:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9dbf46b0a800 from lustre-MDT0000 10000000:01000000:2.0:1784189243.998816:0:92390:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:2.0:1784189243.998819:0:92390:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:2.0:1784189243.998831:0:92390:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9dbf46b0a800 10000000:01000000:2.0:1784189243.998836:0:92390:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1784189243.998842:0:92390:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff9dbf46b0a800 10000000:01000000:2.0:1784189243.998845:0:92390:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:2.0:1784189243.998849:0:92390:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-barrier-ffff9dbf46b0a800 from 1 10000000:01000000:2.0:1784189243.998853:0:92390:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:2.0:1784189243.998900:0:92390:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff9dbf4369c800/0xcc1762b626f8bcb3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 92390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189243.998932:0:92390:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: ffff9dbf4369c800/0xcc1762b626f8bcb3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 92390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189243.998944:0:92390:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: ffff9dbf4369c800/0xcc1762b626f8bcb3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 92390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784189243.998970:0:92390:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc07b7e3480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd553d0d-03e2-4233-b06b-b55bbfa2b954:92390:1870854458162176:0@lo:101:mount.lustre.0 20000000:01000000:0.0:1784189243.999056:0:92399:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1784189243.999061:0:92399:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1784189243.999078:0:92399:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9dc04152d800/0xcc1762b626f8bcba lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 92399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189243.999095:0:92399:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dc04152d800/0xcc1762b626f8bcba lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 92399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1784189243.999106:0:92399:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.000065949s 00010000:00010000:0.0:1784189243.999112:0:92399:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9dc04152d800/0xcc1762b626f8bcba lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 92399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189243.999118:0:92399:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9dc04152d800/0xcc1762b626f8bcba lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 92399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189243.999125:0:92399:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9dc04152d800/0xcc1762b626f8bcba lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 92399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189243.999133:0:92399:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9dc04152d800/0xcc1762b626f8bcba lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 92399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189243.999140:0:92399:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc04152d800 already unused, calling callback (ffffffffc0b2e230) 00010000:00010000:0.0:1784189243.999262:0:92399:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9dc04152d800/0xcc1762b626f8bcba lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 92399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189243.999271:0:92399:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9dc04152d800/0xcc1762b626f8bcba lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 92399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189243.999287:0:92399:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9dc04152d800/0xcc1762b626f8bcba lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 92399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189243.999296:0:92399:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9dc04152d800/0xcc1762b626f8bcba lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 92399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189243.999302:0:92399:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dc04152d800/0xcc1762b626f8bcba lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 92399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784189243.999513:0:92396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf456b0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd553d0d-03e2-4233-b06b-b55bbfa2b954+7:3641:x1870854458162048:12345-0@lo:253:kworker.0 Request processed in 10065us (10634us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189243.999531:0:92396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1784189243.999585:0:92396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1784189243.999597:0:92396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf456b1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd553d0d-03e2-4233-b06b-b55bbfa2b954+6:3643:x1870854458161792:12345-0@lo:253:kworker.0 20000000:01000000:3.0:1784189243.999641:0:92396:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:3.0:1784189243.999658:0:92396:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000020:01000004:0.0:1784189243.999798:0:3641:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: rep 00000020:01000004:0.0:1784189243.999800:0:3641:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1784189243.999802:0:3641:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1784189243.999803:0:3641:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1784189243.999804:0:3641:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1784189243.999806:0:3641:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1784189243.999807:0:3641:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1784189243.999809:0:3641:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1784189243.999810:0:3641:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000100:00100000:0.0:1784189243.999813:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc07b5b2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:bd553d0d-03e2-4233-b06b-b55bbfa2b954:3641:1870854458162048:0@lo:253:kworker.0 00000100:00100000:1.0:1784189243.999934:0:92397:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf456b2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd553d0d-03e2-4233-b06b-b55bbfa2b954+6:3641:x1870854458161920:12345-0@lo:253:kworker.0 Request processed in 4448us (11000us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189243.999942:0:92397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000020:01000004:0.0:1784189244.000079:0:3641:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: rep 00000020:01000004:0.0:1784189244.000081:0:3641:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1784189244.000082:0:3641:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1784189244.000083:0:3641:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1784189244.000084:0:3641:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1784189244.000085:0:3641:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1784189244.000087:0:3641:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1784189244.000088:0:3641:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1784189244.000089:0:3641:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000100:00100000:0.0:1784189244.000092:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc07b5b0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:bd553d0d-03e2-4233-b06b-b55bbfa2b954:3641:1870854458161920:0@lo:253:kworker.0 00000100:00100000:2.0:1784189244.000510:0:92390:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784189244.000588:0:92390:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dbf458653c0 going to sleep for 11 seconds 00000100:00100000:1.0:1784189244.000648:0:92398:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458162176 00000100:00100000:1.0:1784189244.000658:0:92398:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458162176 00000100:00100000:1.0:1784189244.000794:0:92398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1784189244.000804:0:92398:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf4a37c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd553d0d-03e2-4233-b06b-b55bbfa2b954+6:92390:x1870854458162176:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1784189244.000818:0:92398:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784189244.000840:0:92398:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dc0565e7c00/0xcc1762b626f8bcc1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xcc1762b626f8bcb3 expref: -99 pid: 92398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189244.000865:0:92398:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dc0565e7c00/0xcc1762b626f8bcc1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcc1762b626f8bcb3 expref: 7 pid: 92398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189244.000875:0:92398:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dc0565e7c00/0xcc1762b626f8bcc1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcc1762b626f8bcb3 expref: 7 pid: 92398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189244.000884:0:92398:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc0565e7c00, rc 0) 00000100:00100000:1.0:1784189244.000930:0:92398:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf4a37c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd553d0d-03e2-4233-b06b-b55bbfa2b954+7:92390:x1870854458162176:12345-0@lo:101:mount.lustre.0 Request processed in 128us (421us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189244.000937:0:92398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1784189244.000999:0:92390:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc07b7e3480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd553d0d-03e2-4233-b06b-b55bbfa2b954:92390:1870854458162176:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1784189244.001018:0:92390:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: ffff9dbf4369c800/0xcc1762b626f8bcb3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc1762b626f8bcc1 expref: -99 pid: 92390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189244.001027:0:92390:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: ffff9dbf4369c800/0xcc1762b626f8bcb3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcc1762b626f8bcc1 expref: -99 pid: 92390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784189244.001045:0:92390:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:2.0:1784189244.001062:0:92390:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff9dbf4369c800/0xcc1762b626f8bcb3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc1762b626f8bcc1 expref: -99 pid: 92390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189244.001069:0:92390:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: ffff9dbf4369c800/0xcc1762b626f8bcb3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc1762b626f8bcc1 expref: -99 pid: 92390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784189244.001077:0:92390:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:2.0:1784189244.001082:0:92390:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1784189244.001088:0:92390:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff9dbf46b0a800 10000000:01000000:2.0:1784189244.001091:0:92390:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:2.0:1784189244.001106:0:92390:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:2.0:1784189244.001109:0:92390:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1784189244.001136:0:92390:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff9dbf4369c600/0xcc1762b626f8bcc8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 92390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189244.001143:0:92390:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: ffff9dbf4369c600/0xcc1762b626f8bcc8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 92390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189244.001162:0:92390:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: ffff9dbf4369c600/0xcc1762b626f8bcc8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 92390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784189244.001183:0:92390:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc07b7e3480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd553d0d-03e2-4233-b06b-b55bbfa2b954:92390:1870854458162304:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1784189244.001215:0:92390:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 20000000:01000000:3.0:1784189244.002795:0:92396:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1784189244.002813:0:92396:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:3.0:1784189244.003107:0:92396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf456b1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd553d0d-03e2-4233-b06b-b55bbfa2b954+6:3643:x1870854458161792:12345-0@lo:253:kworker.0 Request processed in 3507us (13721us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189244.003119:0:92396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1784189244.003307:0:92390:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dbf458653c0 going to sleep for 11 seconds 00000020:01000004:2.0:1784189244.003367:0:3643:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: rep 00000020:01000004:2.0:1784189244.003370:0:3643:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1784189244.003372:0:3643:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1784189244.003373:0:3643:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1784189244.003374:0:3643:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1784189244.003376:0:3643:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1784189244.003378:0:3643:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1784189244.003380:0:3643:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1784189244.003381:0:3643:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000100:00100000:2.0:1784189244.003385:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc07b5b1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:bd553d0d-03e2-4233-b06b-b55bbfa2b954:3643:1870854458161792:0@lo:253:kworker.0 00000100:00100000:0.0:1784189244.003469:0:92397:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458162304 00000100:00100000:0.0:1784189244.003480:0:92397:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458162304 00000100:00100000:0.0:1784189244.003529:0:92397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1784189244.003540:0:92397:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf4a37f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd553d0d-03e2-4233-b06b-b55bbfa2b954+6:92390:x1870854458162304:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1784189244.003556:0:92397:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784189244.003578:0:92397:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dc04152ca00/0xcc1762b626f8bccf lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xcc1762b626f8bcc8 expref: -99 pid: 92397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189244.003609:0:92397:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dc04152ca00/0xcc1762b626f8bccf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcc1762b626f8bcc8 expref: 7 pid: 92397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189244.003630:0:92397:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dc04152ca00/0xcc1762b626f8bccf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcc1762b626f8bcc8 expref: 7 pid: 92397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189244.003641:0:92397:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc04152ca00, rc 0) 00000100:00100000:0.0:1784189244.003687:0:92397:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf4a37f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd553d0d-03e2-4233-b06b-b55bbfa2b954+7:92390:x1870854458162304:12345-0@lo:101:mount.lustre.0 Request processed in 149us (2472us total) trans 0 rc 0/0 00000100:00100000:0.0:1784189244.003693:0:92397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1784189244.003791:0:92390:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc07b7e3480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd553d0d-03e2-4233-b06b-b55bbfa2b954:92390:1870854458162304:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1784189244.003809:0:92390:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: ffff9dbf4369c600/0xcc1762b626f8bcc8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc1762b626f8bccf expref: -99 pid: 92390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189244.003818:0:92390:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: ffff9dbf4369c600/0xcc1762b626f8bcc8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcc1762b626f8bccf expref: -99 pid: 92390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784189244.003907:0:92390:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc07b7e3480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd553d0d-03e2-4233-b06b-b55bbfa2b954:92390:1870854458162432:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1784189244.003965:0:92390:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784189244.003981:0:92390:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dbf458653c0 going to sleep for 11 seconds 00000100:00100000:0.0:1784189244.004030:0:92397:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458162432 00000100:00100000:0.0:1784189244.004035:0:92397:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458162432 00000100:00100000:0.0:1784189244.004051:0:92397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1784189244.004056:0:92397:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf4a37fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd553d0d-03e2-4233-b06b-b55bbfa2b954+7:92390:x1870854458162432:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1784189244.004243:0:92397:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf4a37fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd553d0d-03e2-4233-b06b-b55bbfa2b954+8:92390:x1870854458162432:12345-0@lo:501:mount.lustre.0 Request processed in 186us (278us total) trans 0 rc 0/0 00000100:00100000:0.0:1784189244.004250:0:92397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 20000000:01000000:0.0:1784189244.004275:0:92399:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1784189244.004281:0:92399:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1784189244.004295:0:92399:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9dc04152ce00/0xcc1762b626f8bcd6 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 92399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189244.004312:0:92399:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dc04152ce00/0xcc1762b626f8bcd6 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 92399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1784189244.004356:0:92399:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.000076105s 00010000:00010000:0.0:1784189244.004361:0:92399:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9dc04152ce00/0xcc1762b626f8bcd6 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 92399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189244.004368:0:92399:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9dc04152ce00/0xcc1762b626f8bcd6 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 92399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189244.004375:0:92399:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9dc04152ce00/0xcc1762b626f8bcd6 lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 92399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189244.004382:0:92399:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9dc04152ce00/0xcc1762b626f8bcd6 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 92399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189244.004390:0:92399:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc04152ce00 already unused, calling callback (ffffffffc0b2e230) 00010000:00010000:0.0:1784189244.004395:0:92399:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9dc04152ce00/0xcc1762b626f8bcd6 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 92399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189244.004404:0:92399:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9dc04152ce00/0xcc1762b626f8bcd6 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 92399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189244.004416:0:92399:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9dc04152ce00/0xcc1762b626f8bcd6 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 92399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189244.004424:0:92399:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9dc04152ce00/0xcc1762b626f8bcd6 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 92399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189244.004431:0:92399:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dc04152ce00/0xcc1762b626f8bcd6 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 92399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784189244.004569:0:92390:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc07b7e3480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd553d0d-03e2-4233-b06b-b55bbfa2b954:92390:1870854458162432:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1784189244.004605:0:92390:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc07b7e3480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd553d0d-03e2-4233-b06b-b55bbfa2b954:92390:1870854458162560:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1784189244.004664:0:92390:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784189244.004689:0:92390:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dbf458653c0 going to sleep for 11 seconds 00000100:00100000:0.0:1784189244.004788:0:92397:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458162560 00000100:00100000:0.0:1784189244.004793:0:92397:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458162560 00000100:00100000:0.0:1784189244.004818:0:92397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1784189244.004824:0:92397:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf4a37f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd553d0d-03e2-4233-b06b-b55bbfa2b954+8:92390:x1870854458162560:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1784189244.005753:0:92397:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf4a37f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd553d0d-03e2-4233-b06b-b55bbfa2b954+8:92390:x1870854458162560:12345-0@lo:503:mount.lustre.0 Request processed in 923us (1083us total) trans 0 rc 0/0 00000100:00100000:0.0:1784189244.005765:0:92397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1784189244.005917:0:92390:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc07b7e3480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd553d0d-03e2-4233-b06b-b55bbfa2b954:92390:1870854458162560:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1784189244.007398:0:92401:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc07b7e3480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bd553d0d-03e2-4233-b06b-b55bbfa2b954:92401:1870854458162688:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1784189244.007691:0:92401:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784189244.007827:0:92401:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dbf45865b40 going to sleep for 11 seconds 00000100:00100000:0.0:1784189244.007870:0:92397:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458162688 00000100:00100000:0.0:1784189244.007879:0:92397:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458162688 00000100:00100000:0.0:1784189244.007980:0:92397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1784189244.007991:0:92397:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf4a37e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd553d0d-03e2-4233-b06b-b55bbfa2b954+8:92401:x1870854458162688:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1784189244.008860:0:92397:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf4a37e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd553d0d-03e2-4233-b06b-b55bbfa2b954+8:92401:x1870854458162688:12345-0@lo:502:llog_process_th.0 Request processed in 867us (1165us total) trans 0 rc 0/0 00000100:00100000:0.0:1784189244.008872:0:92397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1784189244.009023:0:92401:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc07b7e3480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bd553d0d-03e2-4233-b06b-b55bbfa2b954:92401:1870854458162688:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1784189244.009066:0:92401:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1784189244.009081:0:92401:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784189244.009084:0:92401:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:2.0:1784189244.009091:0:92401:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:2.0:1784189244.009094:0:92401:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1784189244.009114:0:92401:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff9dbf449f0000) 00000020:00000080:2.0:1784189244.009145:0:92401:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type lod with refcount 2 00000020:00000080:2.0:1784189244.009162:0:92401:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00080000:01000000:2.0:1784189244.009280:0:92401:0:(osd_handler.c:8929:osd_obd_connect()) connect #2 00000020:00000080:2.0:1784189244.009290:0:92401:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xcc1762b626f8bce4 00000020:00000080:2.0:1784189244.009584:0:92401:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:2.0:1784189244.009588:0:92401:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1784189244.009593:0:92401:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784189244.009594:0:92401:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:2.0:1784189244.009597:0:92401:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1784189244.009601:0:92401:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784189244.009623:0:92401:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:2.0:1784189244.009628:0:92401:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1784189244.009637:0:92401:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff9dbf449f4d40) 00000020:00000080:2.0:1784189244.009651:0:92401:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type mdt with refcount 2 00000020:00000080:2.0:1784189244.009655:0:92401:0:(obd_config.c:1470:class_process_config()) processing cmd: cf007 00000020:00000080:2.0:1784189244.009657:0:92401:0:(obd_config.c:1514:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:2.0:1784189244.009661:0:92401:0:(obd_config.c:1148:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:2.0:1784189244.009667:0:92401:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1784189244.009742:0:92401:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9dbf46b0a800 from lustre-MDT0000, refs=3 00000020:00000080:2.0:1784189244.009757:0:92401:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff9dc049be0000) 00000020:00000080:2.0:1784189244.009768:0:92401:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type mdd with refcount 2 00000004:01000000:2.0:1784189244.009833:0:92401:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:2.0:1784189244.009839:0:92401:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xcc1762b626f8bcf9 00000020:00000080:2.0:1784189244.009946:0:92401:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:2.0:1784189244.009954:0:92401:0:(mdd_device.c:1596:mdd_obd_connect()) connect #0 00000020:00000080:2.0:1784189244.009960:0:92401:0:(genops.c:1406:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0xcc1762b626f8bd00 00080000:01000000:2.0:1784189244.009965:0:92401:0:(osd_handler.c:8929:osd_obd_connect()) connect #3 00000020:00000080:2.0:1784189244.009969:0:92401:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xcc1762b626f8bd07 00010000:00010000:2.0:1784189244.086006:0:92401:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-4 is initialized 00000001:00080000:2.0:1784189244.086584:0:92401:0:(tgt_lastrcvd.c:1748:tgt_clients_data_init()) RCVRNG CLIENT uuid: lustre-MDT0001-mdtlov_UUID idx: 1 lr: 0 srv lr: 111669149699 lx: 0 gen 21 00000001:00080000:2.0:1784189244.086668:0:92401:0:(tgt_lastrcvd.c:1748:tgt_clients_data_init()) RCVRNG CLIENT uuid: debedd94-805c-42a0-a5e5-41758b2012e9 idx: 2 lr: 0 srv lr: 111669149699 lx: 0 gen 23 00000001:00000004:2.0:1784189244.086757:0:92401:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 27, last_transno is 111669149699 00000001:00080000:2.0:1784189244.087126:0:92401:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000001:00080000:2.0:1784189244.087217:0:92401:0:(tgt_lastrcvd.c:2283:tgt_reply_data_init()) lustre-MDT0000: restore reply ffff9dbf424c2cc0: xid 1870854458150144, transno 111669149699, client gen 21, slot idx 1 00000020:00000080:2.0:1784189244.088158:0:92401:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff9dc049be3380) 00000020:00000080:2.0:1784189244.088186:0:92401:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type qmt with refcount 2 00080000:01000000:2.0:1784189244.088292:0:92401:0:(osd_handler.c:8929:osd_obd_connect()) connect #4 00000020:00000080:2.0:1784189244.088300:0:92401:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xcc1762b626f8bd23 00000020:00000080:2.0:1784189244.088886:0:92401:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:2.0:1784189244.091505:0:92401:0:(genops.c:1406:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0xcc1762b626f8bd2a 00000020:00000080:3.0:1784189244.097289:0:92401:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:3.0:1784189244.097307:0:92401:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1784189244.097330:0:92401:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784189244.097333:0:92401:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:3.0:1784189244.097338:0:92401:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1784189244.097350:0:92401:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #8 00000020:01000000:3.0:1784189244.097352:0:92401:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1784189244.097353:0:92401:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1784189244.097355:0:92401:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1784189244.097358:0:92401:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784189244.097360:0:92401:0:(obd_config.c:1561:class_process_config()) marker 8 (0x6) lustre sys.timeout 00000020:01000000:3.0:1784189244.097363:0:92401:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1784189244.097368:0:92401:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784189244.097369:0:92401:0:(obd_config.c:1561:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:3.0:1784189244.097374:0:92401:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000004:01000000:3.0:1784189244.097440:0:92401:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:3.0:1784189244.097460:0:92401:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1784189244.097463:0:92401:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784189244.097465:0:92401:0:(obd_config.c:1561:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:3.0:1784189244.097467:0:92401:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1784189244.097470:0:92401:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784189244.097471:0:92401:0:(obd_config.c:1561:class_process_config()) marker 17 (0x1) lustre-MDT0001 add osp 00000020:00000080:3.0:1784189244.097474:0:92401:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1784189244.097480:0:92401:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.203.112@tcp to nid 0x20000c0a8cb70 (192.168.203.112@tcp) 00000020:00000080:3.0:1784189244.097515:0:92401:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1784189244.097537:0:92401:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osp-MDT0000 (ffff9dbf431299c0) 00000020:00000080:3.0:1784189244.097565:0:92401:0:(obd_config.c:720:class_attach_name()) OBD: dev 21 attached type osp with refcount 2 00000020:00000080:3.0:1784189244.097571:0:92401:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1784189244.097658:0:92401:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0001-osp-MDT0000: connect to lustre-MDT0000-osd (lustre-MDT0001-osp-MDT0000) 00080000:01000000:3.0:1784189244.097666:0:92401:0:(osd_handler.c:8929:osd_obd_connect()) connect #5 00000020:00000080:3.0:1784189244.097673:0:92401:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xcc1762b626f8bd38 00010000:00080000:3.0:1784189244.098673:0:92401:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9dbf430fb800@lustre-MDT0001-osp-MDT0000: add connection 192.168.203.112@tcp at head 00010000:00010000:2.0:1784189244.103087:0:92401:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-osp-MDT0000-9 is initialized 00000020:00000080:3.0:1784189244.104183:0:92401:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1784189244.104202:0:92401:0:(obd_config.c:1470:class_process_config()) processing cmd: cf014 00000004:01000000:3.0:1784189244.104253:0:92401:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0001_UUID idx:1 gen:1 00000020:00000080:3.0:1784189244.104289:0:92401:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xcc1762b626f8bd3f 00000100:00080000:3.0:1784189244.104305:0:92401:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1784189244.104313:0:92401:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff9dbf430fb800 using connection 192.168.203.112@tcp/0@lo 00000100:00100000:3.0:1784189244.104414:0:92401:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9dc075f7ea00 x1870854458162816/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1784189244.104441:0:92401:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000100:00080000:3.0:1784189244.104479:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1784189244.104484:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1784189244.104486:0:36:0:(import.c:65:import_set_state_nolock()) ffff9dbf42271800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1784189244.104491:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3482 00000100:00080000:3.0:1784189244.104496:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 15s 00000100:00080000:3.0:1784189244.104501:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9dbf42271800 using connection 192.168.203.112@tcp/0@lo 00000100:00100000:3.0:1784189244.104515:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9dc075f7d180 x1870854458162944/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1784189244.104549:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1784189244.104553:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1784189244.104555:0:36:0:(import.c:65:import_set_state_nolock()) ffff9dbf425f4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1784189244.104558:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3482 00000100:00080000:3.0:1784189244.104561:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 15s 00000100:00080000:3.0:1784189244.104565:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9dbf425f4800 using connection 192.168.203.112@tcp/0@lo 00000100:00100000:3.0:1784189244.104577:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9dc075f7e300 x1870854458163200/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1784189244.104592:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1784189244.104594:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1784189244.104596:0:36:0:(import.c:65:import_set_state_nolock()) ffff9dbf436c4000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1784189244.104599:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3482 00000100:00080000:3.0:1784189244.104601:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 15s 00000100:00080000:3.0:1784189244.104623:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9dbf436c4000 using connection 192.168.203.112@tcp/0@lo 00000100:00100000:3.0:1784189244.104637:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9dc075f7c380 x1870854458163456/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1784189244.104668:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1784189244.104671:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1784189244.104672:0:36:0:(import.c:65:import_set_state_nolock()) ffff9dbf43690800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1784189244.104675:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3482 00000100:00080000:3.0:1784189244.104678:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 15s 00000100:00080000:3.0:1784189244.104682:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff9dbf43690800 using connection 192.168.203.112@tcp/0@lo 00000100:00100000:3.0:1784189244.104692:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9dc075f7ca80 x1870854458163840/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1784189244.104886:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc075f7ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3642:1870854458163072:0@lo:400:kworker.0 00000100:00100000:3.0:1784189244.104982:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784189244.105062:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1784189244.105068:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc075f7ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3642:1870854458163328:0@lo:400:kworker.0 00000100:00100000:3.0:1784189244.105094:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784189244.105203:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc075f7ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3639:1870854458162816:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1784189244.105248:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784189244.105279:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc075f7d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3639:1870854458162944:0@lo:38:kworker.0 00000100:00100000:3.0:1784189244.105623:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc075f7d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1870854458163584:0@lo:400:kworker.0 00000100:00100000:3.0:1784189244.105656:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784189244.105680:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1784189244.105687:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc075f7dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1870854458163712:0@lo:400:kworker.0 00000100:00100000:3.0:1784189244.105722:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784189244.105763:0:26164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458163584 00000100:00100000:3.0:1784189244.105773:0:26164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458163584 00000100:00100000:3.0:1784189244.105827:0:26164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458163712 00000100:00100000:3.0:1784189244.105831:0:26164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458163712 00000100:00100000:3.0:1784189244.105855:0:26164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2510 00000100:00100000:3.0:1784189244.105872:0:26164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc075f7df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0001-mdtlov_UUID+5:3640:x1870854458163584:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784189244.105935:0:26164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc075f7df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0001-mdtlov_UUID+5:3640:x1870854458163584:12345-0@lo:400:kworker.0 Request processed in 64us (277us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189244.105944:0:26164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2510 00000100:00100000:3.0:1784189244.105962:0:26164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2511 00000100:00100000:3.0:1784189244.105968:0:26164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc075f7f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0001-mdtlov_UUID+5:3640:x1870854458163712:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784189244.105995:0:26164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc075f7f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0001-mdtlov_UUID+5:3640:x1870854458163712:12345-0@lo:400:kworker.0 Request processed in 27us (272us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189244.106000:0:26164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2511 00000100:00100000:3.0:1784189244.106053:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc075f7dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1870854458163712:0@lo:400:kworker.0 00000100:00100000:3.0:1784189244.106065:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc075f7d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1870854458163584:0@lo:400:kworker.0 00000020:01000000:3.0:1784189244.106154:0:92401:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1784189244.106162:0:92401:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784189244.106164:0:92401:0:(obd_config.c:1561:class_process_config()) marker 17 (0x2) lustre-MDT0001 add osp 00000020:01000000:3.0:1784189244.106168:0:92401:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1784189244.106170:0:92401:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #19 00000020:01000000:3.0:1784189244.106172:0:92401:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1784189244.106174:0:92401:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1784189244.106175:0:92401:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1784189244.106178:0:92401:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784189244.106179:0:92401:0:(obd_config.c:1561:class_process_config()) marker 19 (0x6) lustre sys.timeout 00000020:01000000:3.0:1784189244.106182:0:92401:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1784189244.106188:0:92401:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:3.0:1784189244.106192:0:92401:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784189244.106194:0:92401:0:(obd_config.c:1561:class_process_config()) marker 22 (0x1) lustre-OST0000 add osc 00000020:00000080:3.0:1784189244.106197:0:92401:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1784189244.106201:0:92401:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.203.112@tcp to nid 0x20000c0a8cb70 (192.168.203.112@tcp) 00000020:01000000:3.0:1784189244.106229:0:92401:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1784189244.106238:0:92401:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1784189244.106258:0:92401:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff9dc07a903380) 00000020:00000080:3.0:1784189244.106288:0:92401:0:(obd_config.c:720:class_attach_name()) OBD: dev 22 attached type osp with refcount 2 00000020:00000080:3.0:1784189244.106294:0:92401:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1784189244.106421:0:92401:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:3.0:1784189244.106431:0:92401:0:(osd_handler.c:8929:osd_obd_connect()) connect #6 00000020:00000080:3.0:1784189244.106439:0:92401:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xcc1762b626f8bd4d 00010000:00080000:3.0:1784189244.106479:0:92401:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9dbf43d8a000@lustre-OST0000-osc-MDT0000: add connection 192.168.203.112@tcp at head 00010000:00010000:3.0:1784189244.106760:0:92401:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-10 is initialized 00000100:00100000:1.0:1784189244.107298:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000040:01000000:3.0:1784189244.108050:0:92401:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:3.0:1784189244.108283:0:92401:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000100:00100000:2.0:1784189244.110084:0:66171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458163072 00000100:00100000:2.0:1784189244.110102:0:66171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458163072 00000100:00100000:2.0:1784189244.110198:0:66171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458163328 00000100:00100000:2.0:1784189244.110202:0:66171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458163328 00000100:00100000:2.0:1784189244.110235:0:66171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1245 00000100:00100000:2.0:1784189244.110246:0:66171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc075f7d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1870854458163072:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784189244.110380:0:66171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc075f7d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1870854458163072:12345-0@lo:400:kworker.0 Request processed in 136us (5398us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189244.110388:0:66171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1245 00000100:00100000:2.0:1784189244.110407:0:66171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1246 00000100:00100000:2.0:1784189244.110413:0:66171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc075f7f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1870854458163328:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784189244.110439:0:66171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc075f7f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1870854458163328:12345-0@lo:400:kworker.0 Request processed in 27us (5345us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189244.110445:0:66171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1246 00000100:00100000:2.0:1784189244.110475:0:23826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458162816 00000100:00100000:2.0:1784189244.110479:0:23826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458162816 00000100:00100000:2.0:1784189244.110499:0:23826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3845 00000100:00100000:2.0:1784189244.110504:0:23826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc071534700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3639:x1870854458162816:12345-0@lo:38:llog_process_th.0 00010000:00080000:2.0:1784189244.110536:0:23826:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 3486 last 0 00000020:00000080:2.0:1784189244.110580:0:23826:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xcc1762b626f8bd54 00000004:00100000:2.0:1784189244.110599:0:23826:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1784189244.110786:0:23826:0:(import.c:65:import_set_state_nolock()) ffff9dc06bb5d800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1784189244.110829:0:23826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc071534700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3639:x1870854458162816:12345-0@lo:38:llog_process_th.0 Request processed in 324us (5580us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189244.110836:0:23826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3845 00000100:00080000:3.0:1784189244.111023:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1784189244.111079:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc075f7ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3642:1870854458163328:0@lo:400:kworker.0 00000100:00100000:3.0:1784189244.111095:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc075f7ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3642:1870854458163072:0@lo:400:kworker.0 00000040:00080000:2.0:1784189244.111422:0:92401:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1784189244.113048:0:92401:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].27, 64 off9920 00000100:00100000:1.0:1784189244.117487:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc075f7e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3639:1870854458163200:0@lo:38:kworker.0 00000100:00100000:1.0:1784189244.117577:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784189244.117597:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc075f7c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3639:1870854458163456:0@lo:38:kworker.0 00000100:00100000:1.0:1784189244.117635:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784189244.117652:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc075f7ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3639:1870854458163840:0@lo:38:kworker.0 00000100:00100000:1.0:1784189244.117673:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784189244.117737:0:3639:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1784189244.117752:0:3639:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-osp-MDT0000: connect to target with instance 19 00000100:00080000:1.0:1784189244.117764:0:3639:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-osp-MDT0000: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:1.0:1784189244.117771:0:3639:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:1.0:1784189244.117775:0:3639:0:(import.c:65:import_set_state_nolock()) ffff9dbf430fb800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1784189244.117796:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc075f7ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3639:1870854458162816:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1784189244.117853:0:68287:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458162944 00000100:00100000:1.0:1784189244.117861:0:68287:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458162944 00000100:00100000:1.0:1784189244.117898:0:68287:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458163200 00000100:00100000:1.0:1784189244.117901:0:68287:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458163200 00000100:00100000:1.0:1784189244.117910:0:68287:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458163840 00000100:00100000:1.0:1784189244.117912:0:68287:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458163840 00000100:00100000:1.0:1784189244.117928:0:68287:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1333 00000100:00100000:1.0:1784189244.117936:0:68287:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc071536d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3639:x1870854458162944:12345-0@lo:38:kworker.0 00000100:00100000:1.0:1784189244.118004:0:68287:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc071536d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3639:x1870854458162944:12345-0@lo:38:kworker.0 Request processed in 68us (10708us total) trans 0 rc -11/-11 00000100:00100000:1.0:1784189244.118012:0:68287:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1333 00000100:00100000:1.0:1784189244.118035:0:68287:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1334 00000100:00100000:1.0:1784189244.118039:0:68287:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc071535f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3639:x1870854458163200:12345-0@lo:38:kworker.0 00000100:00100000:1.0:1784189244.118084:0:68287:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc071535f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3639:x1870854458163200:12345-0@lo:38:kworker.0 Request processed in 42us (508us total) trans 0 rc -11/-11 00000100:00100000:1.0:1784189244.118090:0:68287:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1334 00000100:00100000:1.0:1784189244.118104:0:68287:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1335 00000100:00100000:1.0:1784189244.118107:0:68287:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc071534000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3639:x1870854458163840:12345-0@lo:38:kworker.0 00000100:00100000:1.0:1784189244.118132:0:68287:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc071534000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3639:x1870854458163840:12345-0@lo:38:kworker.0 Request processed in 23us (458us total) trans 0 rc -11/-11 00000100:00100000:1.0:1784189244.118138:0:68287:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1335 00000100:00080000:1.0:1784189244.118167:0:3639:0:(import.c:65:import_set_state_nolock()) ffff9dbf42271800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1784189244.118172:0:3639:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1784189244.118176:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc075f7d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3639:1870854458162944:0@lo:38:kworker.0 00000100:00080000:1.0:1784189244.118185:0:3639:0:(import.c:65:import_set_state_nolock()) ffff9dbf425f4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1784189244.118188:0:3639:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1784189244.118191:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc075f7e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3639:1870854458163200:0@lo:38:kworker.0 00000100:00080000:1.0:1784189244.118200:0:3639:0:(import.c:65:import_set_state_nolock()) ffff9dbf43690800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1784189244.118204:0:3639:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1784189244.118206:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc075f7ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3639:1870854458163840:0@lo:38:kworker.0 00000100:00100000:3.0:1784189244.118356:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458163456 00000100:00100000:3.0:1784189244.118361:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458163456 00000100:00100000:3.0:1784189244.118388:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3846 00000100:00100000:3.0:1784189244.118394:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc071534e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3639:x1870854458163456:12345-0@lo:38:kworker.0 00000100:00100000:3.0:1784189244.118440:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc071534e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3639:x1870854458163456:12345-0@lo:38:kworker.0 Request processed in 44us (803us total) trans 0 rc -11/-11 00000100:00100000:3.0:1784189244.118446:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3846 00000100:00080000:3.0:1784189244.118473:0:3639:0:(import.c:65:import_set_state_nolock()) ffff9dbf436c4000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1784189244.118477:0:3639:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:3.0:1784189244.118480:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc075f7c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3639:1870854458163456:0@lo:38:kworker.0 00000100:00100000:3.0:1784189244.118719:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc075f7c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1870854458163968:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1784189244.118763:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784189244.120148:0:23826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458163968 00000100:00100000:2.0:1784189244.120162:0:23826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458163968 00000100:00100000:2.0:1784189244.120227:0:23826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3847 00000100:00100000:2.0:1784189244.120238:0:23826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc075f7ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3642:x1870854458163968:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1784189244.120282:0:23826:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445568512 avail 1299329024 00000100:00100000:2.0:1784189244.120379:0:23826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc075f7ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3642:x1870854458163968:12345-0@lo:41:osp-pre-1-0.0 Request processed in 142us (1615us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189244.120386:0:23826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3847 00000100:00100000:2.0:1784189244.120445:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc075f7c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1870854458163968:0@lo:41:osp-pre-1-0.0 00000040:00080000:2.0:1784189244.124221:0:92401:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6c:0x0].1, 64 off8256 00000040:00080000:0.0:1784189244.125299:0:92407:0:(llog.c:805:llog_process_thread()) index: 27, lh_last_idx: 27 synced_idx: 27 lgh_last_idx: 27 00000040:00080000:0.0:1784189244.125306:0:92407:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x6c:0x0] at index 27 of catalog [0x1:0x2:0x0] 00000020:00000080:2.0:1784189244.126193:0:92401:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1784189244.126209:0:92401:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1784189244.126261:0:92401:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:2.0:1784189244.126293:0:92401:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xcc1762b626f8bd5b 00000100:00080000:2.0:1784189244.126307:0:92401:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1784189244.126315:0:92401:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9dbf43d8a000 using connection 192.168.203.112@tcp/0@lo 00000100:00100000:2.0:1784189244.126480:0:92401:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9dc07b7e3480 x1870854458164096/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1784189244.126515:0:92401:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:2.0:1784189244.126643:0:92401:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1784189244.126648:0:92401:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784189244.126650:0:92401:0:(obd_config.c:1561:class_process_config()) marker 22 (0x2) lustre-OST0000 add osc 00000020:01000000:2.0:1784189244.126654:0:92401:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1784189244.126657:0:92401:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #26 00000020:01000000:2.0:1784189244.126659:0:92401:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1784189244.126661:0:92401:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1784189244.126662:0:92401:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1784189244.126665:0:92401:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784189244.126667:0:92401:0:(obd_config.c:1561:class_process_config()) marker 26 (0x6) lustre sys.timeout 00000020:01000000:2.0:1784189244.126683:0:92401:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1784189244.126688:0:92401:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:2.0:1784189244.126693:0:92401:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784189244.126694:0:92401:0:(obd_config.c:1561:class_process_config()) marker 30 (0x1) lustre-OST0001 add osc 00000020:00000080:2.0:1784189244.126697:0:92401:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1784189244.126712:0:92401:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.203.112@tcp to nid 0x20000c0a8cb70 (192.168.203.112@tcp) 00000020:01000000:2.0:1784189244.126746:0:92401:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:2.0:1784189244.126750:0:92401:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1784189244.126766:0:92401:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff9dc049be19c0) 00000020:00000080:2.0:1784189244.126786:0:92401:0:(obd_config.c:720:class_attach_name()) OBD: dev 27 attached type osp with refcount 2 00000020:00000080:2.0:1784189244.126792:0:92401:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1784189244.126878:0:92401:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:2.0:1784189244.126885:0:92401:0:(osd_handler.c:8929:osd_obd_connect()) connect #7 00000020:00000080:2.0:1784189244.126891:0:92401:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xcc1762b626f8bd69 00010000:00080000:2.0:1784189244.126929:0:92401:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9dbf43692000@lustre-OST0001-osc-MDT0000: add connection 192.168.203.112@tcp at head 00010000:00010000:2.0:1784189244.127155:0:92401:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-11 is initialized 00000040:01000000:2.0:1784189244.127240:0:92401:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1784189244.127259:0:92401:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000100:00100000:3.0:1784189244.128590:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc07b7e3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3639:1870854458164096:0@lo:8:llog_process_th.0 00000100:00100000:3.0:1784189244.128712:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784189244.128831:0:26160:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458164096 00000100:00100000:1.0:1784189244.128842:0:26160:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458164096 00000100:00100000:1.0:1784189244.128889:0:26160:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4973 00000100:00100000:1.0:1784189244.128899:0:26160:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc075f7ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:0+-99:3639:x1870854458164096:12345-0@lo:8:llog_process_th.0 00010000:00080000:1.0:1784189244.128937:0:26160:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 3486 last 0 00000020:00000080:1.0:1784189244.128970:0:26160:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xcc1762b626f8bd70 00002000:00100000:1.0:1784189244.128987:0:26160:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff9dc047a85000 ocd_connect_flags: 0xa044401443000026 ocd_version: 21136a2 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:1.0:1784189244.129000:0:26160:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:1.0:1784189244.129004:0:26160:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1784189244.129065:0:26160:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1784189244.129095:0:26160:0:(import.c:65:import_set_state_nolock()) ffff9dc047a87000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1784189244.129158:0:26160:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc075f7ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+6:3639:x1870854458164096:12345-0@lo:8:llog_process_th.0 Request processed in 258us (446us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189244.129166:0:26160:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4973 00000100:00100000:3.0:1784189244.129712:0:3639:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1784189244.129725:0:3639:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 1 00000100:00080000:3.0:1784189244.129735:0:3639:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1784189244.129741:0:3639:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:3.0:1784189244.129744:0:3639:0:(import.c:65:import_set_state_nolock()) ffff9dbf43d8a000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1784189244.129770:0:3639:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1784189244.129777:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc07b7e3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3639:1870854458164096:0@lo:8:llog_process_th.0 00000004:00080000:3.0:1784189244.129809:0:92407:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1784189244.129871:0:92407:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 3486353551183ns, next at 0ns, rc = 0 00080000:00080000:3.0:1784189244.129879:0:92407:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00100000:2.0:1784189244.130022:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1784189244.130038:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc071536a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1870854458164224:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1784189244.130099:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784189244.130145:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458164224 00000100:00100000:2.0:1784189244.130151:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458164224 00000100:00100000:2.0:1784189244.130241:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2008 00000100:00100000:2.0:1784189244.130250:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc07b7e2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3642:x1870854458164224:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1784189244.130270:0:8432:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 211008 pending 0 free 3922481152 avail 3690958848 00000100:00100000:2.0:1784189244.130314:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc07b7e2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3642:x1870854458164224:12345-0@lo:13:osp-pre-0-0.0 Request processed in 65us (214us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189244.130341:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2008 00000100:00100000:2.0:1784189244.130396:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc071536a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1870854458164224:0@lo:13:osp-pre-0-0.0 00000040:00080000:2.0:1784189244.130629:0:92401:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1784189244.131012:0:92401:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].27, 64 off9920 00000040:00080000:2.0:1784189244.131155:0:92401:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6e:0x0].1, 64 off8256 00000100:00080000:1.0:1784189244.131801:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000040:00080000:3.0:1784189244.132162:0:92409:0:(llog.c:805:llog_process_thread()) index: 27, lh_last_idx: 27 synced_idx: 27 lgh_last_idx: 27 00000040:00080000:3.0:1784189244.132169:0:92409:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x6e:0x0] at index 27 of catalog [0x1:0x5:0x0] 00000004:00080000:3.0:1784189244.134256:0:92391:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00000020:00000080:3.0:1784189244.135279:0:92401:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1784189244.135298:0:92401:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1784189244.135380:0:92401:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:3.0:1784189244.135412:0:92401:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xcc1762b626f8bd77 00000100:00080000:3.0:1784189244.135426:0:92401:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1784189244.135433:0:92401:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9dbf43692000 using connection 192.168.203.112@tcp/0@lo 00000100:00100000:3.0:1784189244.135482:0:92401:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9dc075f7d500 x1870854458164352/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1784189244.135563:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc075f7d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3639:1870854458164352:0@lo:8:llog_process_th.0 00000100:00100000:0.0:1784189244.135668:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784189244.135801:0:26165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458164352 00000100:00100000:2.0:1784189244.135811:0:26165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458164352 00000100:00100000:2.0:1784189244.135858:0:26165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4974 00000100:00100000:2.0:1784189244.135867:0:26165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc07b5b0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:0+-99:3639:x1870854458164352:12345-0@lo:8:llog_process_th.0 00010000:00080000:2.0:1784189244.135900:0:26165:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 3486 last 0 00000020:00000080:2.0:1784189244.135937:0:26165:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xcc1762b626f8bd7e 00000100:00080000:3.0:1784189244.135998:0:92401:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:3.0:1784189244.136073:0:92401:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1784189244.136079:0:92401:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784189244.136081:0:92401:0:(obd_config.c:1561:class_process_config()) marker 30 (0x2) lustre-OST0001 add osc 00000020:01000000:3.0:1784189244.136084:0:92401:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1784189244.136088:0:92401:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784189244.136101:0:92401:0:(obd_config.c:1561:class_process_config()) marker 35 (0x1) lustre sys.timeout 00000020:00000080:3.0:1784189244.136105:0:92401:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1784189244.136107:0:92401:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1784189244.136110:0:92401:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1784189244.136112:0:92401:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784189244.136114:0:92401:0:(obd_config.c:1561:class_process_config()) marker 35 (0x2) lustre sys.timeout 00000020:01000000:3.0:1784189244.136117:0:92401:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1784189244.136119:0:92401:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784189244.136121:0:92401:0:(obd_config.c:1561:class_process_config()) marker 40 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1784189244.136125:0:92401:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:3.0:1784189244.136173:0:92401:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc075f7dc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bd553d0d-03e2-4233-b06b-b55bbfa2b954:92401:1870854458164480:0@lo:502:llog_process_th.0 00002000:00100000:2.0:1784189244.136494:0:26165:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff9dc04ba07800 ocd_connect_flags: 0xa044401443000026 ocd_version: 21136a2 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:2.0:1784189244.136501:0:26165:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:2.0:1784189244.136504:0:26165:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1784189244.136591:0:26165:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1784189244.136631:0:26165:0:(import.c:65:import_set_state_nolock()) ffff9dc04ba05800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1784189244.136771:0:26165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc07b5b0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+6:3639:x1870854458164352:12345-0@lo:8:llog_process_th.0 Request processed in 902us (1102us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189244.136781:0:26165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4974 00000100:00100000:0.0:1784189244.136873:0:3639:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1784189244.136884:0:3639:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 1 00000100:00080000:0.0:1784189244.136892:0:3639:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1784189244.136897:0:3639:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:0.0:1784189244.136900:0:3639:0:(import.c:65:import_set_state_nolock()) ffff9dbf43692000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1784189244.136953:0:3639:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1784189244.136960:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc075f7d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3639:1870854458164352:0@lo:8:llog_process_th.0 00000004:00080000:2.0:1784189244.137031:0:92409:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:2.0:1784189244.137104:0:92409:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 3486360784734ns, next at 0ns, rc = 0 00080000:00080000:2.0:1784189244.137111:0:92409:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00100000:2.0:1784189244.138094:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc071536a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1870854458164608:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1784189244.138338:0:92401:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784189244.138378:0:92401:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dc047e1df00 going to sleep for 11 seconds 00000100:00100000:3.0:1784189244.138408:0:92396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458164480 00000100:00100000:3.0:1784189244.138414:0:92396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458164480 00000100:00100000:3.0:1784189244.138456:0:92396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1784189244.138464:0:92396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf4a37d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd553d0d-03e2-4233-b06b-b55bbfa2b954+8:92401:x1870854458164480:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1784189244.138605:0:92396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf4a37d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd553d0d-03e2-4233-b06b-b55bbfa2b954+8:92401:x1870854458164480:12345-0@lo:502:llog_process_th.0 Request processed in 141us (267us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189244.138623:0:92396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000004:00080000:0.0:1784189244.138813:0:92391:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000100:00100000:2.0:1784189244.138911:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784189244.138950:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458164608 00000100:00100000:2.0:1784189244.138954:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458164608 00000100:00100000:2.0:1784189244.139003:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2009 00000100:00100000:2.0:1784189244.139009:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc07b7e0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3640:x1870854458164608:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1784189244.139037:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 211008 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1784189244.139077:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc07b7e0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3640:x1870854458164608:12345-0@lo:13:osp-pre-1-0.0 Request processed in 67us (165us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189244.139084:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2009 00000100:00100000:2.0:1784189244.139123:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc071536a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1870854458164608:0@lo:13:osp-pre-1-0.0 00000100:00080000:0.0:1784189244.139373:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1784189244.139479:0:92401:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc075f7dc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bd553d0d-03e2-4233-b06b-b55bbfa2b954:92401:1870854458164480:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1784189244.139583:0:92401:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1784189244.139593:0:92401:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784189244.139596:0:92401:0:(obd_config.c:1561:class_process_config()) marker 40 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1784189244.139602:0:92401:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 46 count 46 00000020:01000000:1.0:1784189244.139926:0:92390:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-45 (rc=0) 10000000:01000000:1.0:1784189244.139959:0:92390:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1784189244.139980:0:92390:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff9dbf4369c600/0xcc1762b626f8bcc8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc1762b626f8bccf expref: -99 pid: 92390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189244.139993:0:92390:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: ffff9dbf4369c600/0xcc1762b626f8bcc8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc1762b626f8bccf expref: -99 pid: 92390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784189244.140003:0:92390:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff9dbf46b0a800 from 1 10000000:01000000:1.0:1784189244.140006:0:92390:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1784189244.140048:0:92390:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff9dc0565e7600/0xcc1762b626f8bd85 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 92390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189244.140056:0:92390:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: ffff9dc0565e7600/0xcc1762b626f8bd85 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 92390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189244.140067:0:92390:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: ffff9dc0565e7600/0xcc1762b626f8bd85 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 92390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784189244.140088:0:92390:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc071536a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd553d0d-03e2-4233-b06b-b55bbfa2b954:92390:1870854458164736:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1784189244.140262:0:92390:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784189244.140380:0:92390:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dc0515ef900 going to sleep for 11 seconds 00000100:00100000:0.0:1784189244.140501:0:92397:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458164736 00000100:00100000:0.0:1784189244.140507:0:92397:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458164736 00000100:00100000:0.0:1784189244.140591:0:92397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1784189244.140602:0:92397:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf4a37c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd553d0d-03e2-4233-b06b-b55bbfa2b954+8:92390:x1870854458164736:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1784189244.140624:0:92397:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784189244.140641:0:92397:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dc04152ce00/0xcc1762b626f8bd8c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xcc1762b626f8bd85 expref: -99 pid: 92397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189244.140667:0:92397:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dc04152ce00/0xcc1762b626f8bd8c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcc1762b626f8bd85 expref: 9 pid: 92397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189244.140678:0:92397:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dc04152ce00/0xcc1762b626f8bd8c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcc1762b626f8bd85 expref: 9 pid: 92397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189244.140688:0:92397:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc04152ce00, rc 0) 00000100:00100000:0.0:1784189244.140740:0:92397:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf4a37c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd553d0d-03e2-4233-b06b-b55bbfa2b954+9:92390:x1870854458164736:12345-0@lo:101:mount.lustre.0 Request processed in 139us (477us total) trans 0 rc 0/0 00000100:00100000:0.0:1784189244.140746:0:92397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1784189244.140818:0:92390:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc071536a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd553d0d-03e2-4233-b06b-b55bbfa2b954:92390:1870854458164736:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1784189244.140834:0:92390:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: ffff9dc0565e7600/0xcc1762b626f8bd85 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc1762b626f8bd8c expref: -99 pid: 92390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189244.140843:0:92390:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: ffff9dc0565e7600/0xcc1762b626f8bd85 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcc1762b626f8bd8c expref: -99 pid: 92390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784189244.141435:0:92390:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc071536a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd553d0d-03e2-4233-b06b-b55bbfa2b954:92390:1870854458164864:0@lo:256:mount.lustre.0 00000100:00100000:1.0:1784189244.141484:0:92390:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784189244.141960:0:92390:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dc0515ef900 going to sleep for 11 seconds 00000100:00100000:3.0:1784189244.142043:0:92396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458164864 00000100:00100000:3.0:1784189244.142050:0:92396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458164864 00000100:00100000:2.0:1784189244.142274:0:92396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1784189244.142284:0:92396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf4a37f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd553d0d-03e2-4233-b06b-b55bbfa2b954+9:92390:x1870854458164864:12345-0@lo:256:mount.lustre.0 20000000:01000000:2.0:1784189244.142309:0:92396:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:2.0:1784189244.142360:0:92396:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1784189244.142365:0:92396:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:2.0:1784189244.142369:0:92396:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:2.0:1784189244.142371:0:92396:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 119 00000100:00100000:2.0:1784189244.142482:0:92396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf4a37f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd553d0d-03e2-4233-b06b-b55bbfa2b954+9:92390:x1870854458164864:12345-0@lo:256:mount.lustre.0 Request processed in 198us (996us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189244.142490:0:92396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1784189244.142576:0:92390:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc071536a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd553d0d-03e2-4233-b06b-b55bbfa2b954:92390:1870854458164864:0@lo:256:mount.lustre.0 10000000:01000000:1.0:1784189244.143250:0:92390:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1784189244.143273:0:92390:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff9dc0565e7600/0xcc1762b626f8bd85 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc1762b626f8bd8c expref: -99 pid: 92390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189244.143285:0:92390:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: ffff9dc0565e7600/0xcc1762b626f8bd85 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc1762b626f8bd8c expref: -99 pid: 92390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784189244.143294:0:92390:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9dbf46b0a800 from 1 10000000:01000000:1.0:1784189244.143298:0:92390:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1784189244.143369:0:92390:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff9dc0565e6a00/0xcc1762b626f8bd93 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 92390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189244.143378:0:92390:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: ffff9dc0565e6a00/0xcc1762b626f8bd93 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 92390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189244.143388:0:92390:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: ffff9dc0565e6a00/0xcc1762b626f8bd93 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 92390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784189244.143423:0:92390:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc071536a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd553d0d-03e2-4233-b06b-b55bbfa2b954:92390:1870854458164992:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1784189244.143471:0:92390:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784189244.143961:0:92390:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dc0515ef900 going to sleep for 11 seconds 00000100:00100000:0.0:1784189244.144041:0:92397:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458164992 00000100:00100000:0.0:1784189244.144050:0:92397:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458164992 00000100:00100000:0.0:1784189244.144093:0:92397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1784189244.144104:0:92397:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf43728450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd553d0d-03e2-4233-b06b-b55bbfa2b954+9:92390:x1870854458164992:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1784189244.144118:0:92397:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784189244.144187:0:92397:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dc04152d800/0xcc1762b626f8bd9a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xcc1762b626f8bd93 expref: -99 pid: 92397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189244.144218:0:92397:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dc04152d800/0xcc1762b626f8bd9a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcc1762b626f8bd93 expref: 10 pid: 92397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189244.144244:0:92397:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dc04152d800/0xcc1762b626f8bd9a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcc1762b626f8bd93 expref: 10 pid: 92397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189244.144255:0:92397:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc04152d800, rc 0) 00000100:00100000:0.0:1784189244.144315:0:92397:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf43728450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd553d0d-03e2-4233-b06b-b55bbfa2b954+10:92390:x1870854458164992:12345-0@lo:101:mount.lustre.0 Request processed in 212us (843us total) trans 0 rc 0/0 00000100:00100000:0.0:1784189244.144343:0:92397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00010000:0.0:1784189244.144425:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784189244.144507:0:92390:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc071536a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd553d0d-03e2-4233-b06b-b55bbfa2b954:92390:1870854458164992:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1784189244.144524:0:92390:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: ffff9dc0565e6a00/0xcc1762b626f8bd93 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc1762b626f8bd9a expref: -99 pid: 92390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189244.144534:0:92390:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: ffff9dc0565e6a00/0xcc1762b626f8bd93 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcc1762b626f8bd9a expref: -99 pid: 92390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784189244.144623:0:92390:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc071536a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd553d0d-03e2-4233-b06b-b55bbfa2b954:92390:1870854458165120:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1784189244.144654:0:92390:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784189244.144677:0:92390:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dc0515ef900 going to sleep for 11 seconds 00000100:00100000:0.0:1784189244.144788:0:92397:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458165120 00000100:00100000:0.0:1784189244.144793:0:92397:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458165120 00000100:00100000:0.0:1784189244.144812:0:92397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1784189244.144819:0:92397:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf43729850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd553d0d-03e2-4233-b06b-b55bbfa2b954+10:92390:x1870854458165120:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1784189244.144993:0:92397:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf43729850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd553d0d-03e2-4233-b06b-b55bbfa2b954+10:92390:x1870854458165120:12345-0@lo:501:mount.lustre.0 Request processed in 173us (337us total) trans 0 rc 0/0 00000100:00100000:0.0:1784189244.145001:0:92397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1784189244.145145:0:92390:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc071536a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd553d0d-03e2-4233-b06b-b55bbfa2b954:92390:1870854458165120:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1784189244.145180:0:92390:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc071536a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd553d0d-03e2-4233-b06b-b55bbfa2b954:92390:1870854458165248:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1784189244.145226:0:92390:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784189244.145239:0:92390:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dc0515ef900 going to sleep for 11 seconds 00000100:00100000:0.0:1784189244.145348:0:92397:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458165248 00000100:00100000:0.0:1784189244.145353:0:92397:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458165248 00000100:00100000:0.0:1784189244.145373:0:92397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1784189244.145379:0:92397:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf43729450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd553d0d-03e2-4233-b06b-b55bbfa2b954+10:92390:x1870854458165248:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1784189244.145474:0:92397:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf43729450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd553d0d-03e2-4233-b06b-b55bbfa2b954+10:92390:x1870854458165248:12345-0@lo:503:mount.lustre.0 Request processed in 94us (246us total) trans 0 rc 0/0 00000100:00100000:0.0:1784189244.145481:0:92397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1784189244.145780:0:92390:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc071536a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd553d0d-03e2-4233-b06b-b55bbfa2b954:92390:1870854458165248:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1784189244.146226:0:92411:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc071536a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bd553d0d-03e2-4233-b06b-b55bbfa2b954:92411:1870854458165376:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1784189244.146279:0:92411:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784189244.146314:0:92411:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dc0515ef600 going to sleep for 11 seconds 00000100:00100000:0.0:1784189244.146405:0:92397:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458165376 00000100:00100000:0.0:1784189244.146410:0:92397:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458165376 00000100:00100000:0.0:1784189244.146440:0:92397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1784189244.146447:0:92397:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf4372b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd553d0d-03e2-4233-b06b-b55bbfa2b954+10:92411:x1870854458165376:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1784189244.147220:0:92397:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf4372b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd553d0d-03e2-4233-b06b-b55bbfa2b954+10:92411:x1870854458165376:12345-0@lo:502:llog_process_th.0 Request processed in 771us (938us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189244.147231:0:92397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1784189244.147385:0:92411:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc071536a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bd553d0d-03e2-4233-b06b-b55bbfa2b954:92411:1870854458165376:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1784189244.147435:0:92411:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1784189244.147448:0:92411:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784189244.147452:0:92411:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1784189244.147468:0:92411:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9dbf46b0a800 00000020:00000080:2.0:1784189244.147472:0:92411:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1784189244.147482:0:92411:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1784189244.147491:0:92411:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784189244.147498:0:92411:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:2.0:1784189244.147502:0:92411:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1784189244.147505:0:92411:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784189244.147507:0:92411:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1784189244.147511:0:92411:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9dbf46b0a800 00000020:00000080:2.0:1784189244.147513:0:92411:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1784189244.147603:0:92411:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc07b7e2300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bd553d0d-03e2-4233-b06b-b55bbfa2b954:92411:1870854458165504:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1784189244.147662:0:92411:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784189244.147700:0:92411:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dc081c5c240 going to sleep for 11 seconds 00000100:00100000:1.0:1784189244.150296:0:92396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458165504 00000100:00100000:1.0:1784189244.150308:0:92396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458165504 00000100:00100000:1.0:1784189244.150420:0:92396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1784189244.150432:0:92396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf4372a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd553d0d-03e2-4233-b06b-b55bbfa2b954+10:92411:x1870854458165504:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1784189244.150887:0:92396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf4372a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd553d0d-03e2-4233-b06b-b55bbfa2b954+10:92411:x1870854458165504:12345-0@lo:502:llog_process_th.0 Request processed in 455us (3223us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189244.150898:0:92396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1784189244.151709:0:92411:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc07b7e2300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bd553d0d-03e2-4233-b06b-b55bbfa2b954:92411:1870854458165504:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1784189244.151760:0:92411:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1784189244.151770:0:92411:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784189244.151773:0:92411:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:2.0:1784189244.151778:0:92411:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:2.0:1784189244.151873:0:92390:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-6 (rc=0) 10000000:01000000:2.0:1784189244.151907:0:92390:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1784189244.151935:0:92390:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff9dc0565e6a00/0xcc1762b626f8bd93 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc1762b626f8bd9a expref: -99 pid: 92390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189244.151949:0:92390:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: ffff9dc0565e6a00/0xcc1762b626f8bd93 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc1762b626f8bd9a expref: -99 pid: 92390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784189244.152021:0:92390:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1784189244.152024:0:92390:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9dbf46b0a800 10000000:01000000:2.0:1784189244.152028:0:92390:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9dbf46b0a800 10000000:01000000:2.0:1784189244.152032:0:92390:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1784189244.152039:0:92390:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9dbf46b0a800 from 1 10000000:01000000:2.0:1784189244.152042:0:92390:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1784189244.152085:0:92390:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff9dbf4369d200/0xcc1762b626f8bda1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 92390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189244.152106:0:92390:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: ffff9dbf4369d200/0xcc1762b626f8bda1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 92390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189244.152119:0:92390:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: ffff9dbf4369d200/0xcc1762b626f8bda1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 92390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784189244.152145:0:92390:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc07b7e2300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd553d0d-03e2-4233-b06b-b55bbfa2b954:92390:1870854458165632:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1784189244.152210:0:92390:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784189244.152257:0:92390:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dc081c5c780 going to sleep for 11 seconds 00000100:00100000:1.0:1784189244.152507:0:92396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458165632 00000100:00100000:1.0:1784189244.152513:0:92396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458165632 00000100:00100000:1.0:1784189244.152552:0:92396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1784189244.152562:0:92396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf43728c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd553d0d-03e2-4233-b06b-b55bbfa2b954+10:92390:x1870854458165632:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1784189244.152578:0:92396:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784189244.152594:0:92396:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dc0565e7000/0xcc1762b626f8bda8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xcc1762b626f8bda1 expref: -99 pid: 92396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189244.152639:0:92396:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dc0565e7000/0xcc1762b626f8bda8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcc1762b626f8bda1 expref: 11 pid: 92396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189244.152652:0:92396:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dc0565e7000/0xcc1762b626f8bda8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcc1762b626f8bda1 expref: 11 pid: 92396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189244.152662:0:92396:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc0565e7000, rc 0) 00000100:00100000:1.0:1784189244.152868:0:92396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf43728c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd553d0d-03e2-4233-b06b-b55bbfa2b954+11:92390:x1870854458165632:12345-0@lo:101:mount.lustre.0 Request processed in 307us (658us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189244.152876:0:92396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1784189244.154002:0:92390:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc07b7e2300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd553d0d-03e2-4233-b06b-b55bbfa2b954:92390:1870854458165632:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1784189244.154031:0:92390:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: ffff9dbf4369d200/0xcc1762b626f8bda1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc1762b626f8bda8 expref: -99 pid: 92390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189244.154045:0:92390:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: ffff9dbf4369d200/0xcc1762b626f8bda1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xcc1762b626f8bda8 expref: -99 pid: 92390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784189244.154135:0:92390:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc07b7e2300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd553d0d-03e2-4233-b06b-b55bbfa2b954:92390:1870854458165760:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1784189244.154190:0:92390:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784189244.154219:0:92390:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dc081c5c780 going to sleep for 11 seconds 00000100:00100000:3.0:1784189244.154273:0:92398:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458165760 00000100:00100000:3.0:1784189244.154280:0:92398:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458165760 00000100:00100000:3.0:1784189244.154351:0:92398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1784189244.154362:0:92398:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf43729050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd553d0d-03e2-4233-b06b-b55bbfa2b954+11:92390:x1870854458165760:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1784189244.154528:0:92398:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf43729050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd553d0d-03e2-4233-b06b-b55bbfa2b954+11:92390:x1870854458165760:12345-0@lo:501:mount.lustre.0 Request processed in 168us (337us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189244.154550:0:92398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1784189244.154779:0:92390:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc07b7e2300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd553d0d-03e2-4233-b06b-b55bbfa2b954:92390:1870854458165760:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1784189244.154815:0:92390:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc07b7e2300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd553d0d-03e2-4233-b06b-b55bbfa2b954:92390:1870854458165888:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1784189244.154861:0:92390:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784189244.154964:0:92390:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dc081c5c780 going to sleep for 11 seconds 00000100:00100000:0.0:1784189244.159311:0:92397:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458165888 00000100:00100000:0.0:1784189244.159348:0:92397:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458165888 00000100:00100000:0.0:1784189244.159495:0:92397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1784189244.159508:0:92397:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf43728050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd553d0d-03e2-4233-b06b-b55bbfa2b954+11:92390:x1870854458165888:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1784189244.160498:0:92397:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf43728050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd553d0d-03e2-4233-b06b-b55bbfa2b954+11:92390:x1870854458165888:12345-0@lo:503:mount.lustre.0 Request processed in 988us (5631us total) trans 0 rc 0/0 00000100:00100000:0.0:1784189244.160512:0:92397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1784189244.160641:0:92390:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc07b7e2300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd553d0d-03e2-4233-b06b-b55bbfa2b954:92390:1870854458165888:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1784189244.161366:0:92413:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc07b7e2300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bd553d0d-03e2-4233-b06b-b55bbfa2b954:92413:1870854458166016:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1784189244.161438:0:92413:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784189244.161478:0:92413:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dc081c5c600 going to sleep for 11 seconds 00000100:00100000:0.0:1784189244.161560:0:92396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458166016 00000100:00100000:0.0:1784189244.161568:0:92396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458166016 00000100:00100000:0.0:1784189244.161630:0:92396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1784189244.161641:0:92396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf4372a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd553d0d-03e2-4233-b06b-b55bbfa2b954+11:92413:x1870854458166016:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1784189244.161843:0:92396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf4372a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd553d0d-03e2-4233-b06b-b55bbfa2b954+11:92413:x1870854458166016:12345-0@lo:502:llog_process_th.0 Request processed in 204us (405us total) trans 0 rc 0/0 00000100:00100000:0.0:1784189244.161852:0:92396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1784189244.162033:0:92413:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc07b7e2300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bd553d0d-03e2-4233-b06b-b55bbfa2b954:92413:1870854458166016:0@lo:502:llog_process_th.0 00000020:01000004:2.0:1784189244.162638:0:92413:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:2.0:1784189244.162662:0:92413:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff9dc075478000) 00000020:00000080:2.0:1784189244.162692:0:92413:0:(obd_config.c:720:class_attach_name()) OBD: dev 28 attached type lwp with refcount 2 00000020:01000004:2.0:1784189244.162929:0:92413:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9dbf46b0a800 from lustre-MDT0000, refs=4 00000020:01000004:2.0:1784189244.162934:0:92413:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9dbf46b0a800 from lustre-MDT0000, refs=4 00000020:01000004:2.0:1784189244.162937:0:92413:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9dbf46b0a800 4 00010000:00080000:2.0:1784189244.162971:0:92413:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9dbf42276000@lustre-MDT0000-lwp-MDT0000: add connection 192.168.203.112@tcp at head 00010000:00010000:2.0:1784189244.165279:0:92413:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-12 is initialized 00000020:00000080:2.0:1784189244.165447:0:92413:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:2.0:1784189244.166381:0:92413:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1784189244.166403:0:92413:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0xcc1762b626f8bdb6 00000100:00080000:2.0:1784189244.166416:0:92413:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1784189244.166424:0:92413:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff9dbf42276000 using connection 192.168.203.112@tcp/0@lo 00000100:00100000:2.0:1784189244.166807:0:92413:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9dc07b7e2300 x1870854458166144/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1784189244.166836:0:92413:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1784189244.168275:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc07b7e2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3639:1870854458166144:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1784189244.168397:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784189244.168477:0:68287:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458166144 00000100:00100000:0.0:1784189244.168487:0:68287:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458166144 00000100:00100000:0.0:1784189244.168533:0:68287:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1336 00000100:00100000:0.0:1784189244.168543:0:68287:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc07b5b2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3639:x1870854458166144:12345-0@lo:38:llog_process_th.0 00000100:00100000:0.0:1784189244.168622:0:68287:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc07b5b2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3639:x1870854458166144:12345-0@lo:38:llog_process_th.0 Request processed in 68us (213us total) trans 0 rc -11/-11 00000100:00100000:0.0:1784189244.168631:0:68287:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1336 00000100:00100000:0.0:1784189244.168677:0:3639:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1784189244.168687:0:3639:0:(import.c:65:import_set_state_nolock()) ffff9dbf42276000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1784189244.168692:0:3639:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:2.0:1784189244.169748:0:92413:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc07b7e1500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bd553d0d-03e2-4233-b06b-b55bbfa2b954:92413:1870854458166272:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1784189244.169823:0:92413:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784189244.169865:0:92397:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458166272 00000100:00100000:2.0:1784189244.169870:0:92397:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458166272 00000100:00100000:2.0:1784189244.169913:0:92397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1784189244.169922:0:92397:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf4372b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd553d0d-03e2-4233-b06b-b55bbfa2b954+11:92413:x1870854458166272:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1784189244.170060:0:92397:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf4372b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd553d0d-03e2-4233-b06b-b55bbfa2b954+11:92413:x1870854458166272:12345-0@lo:502:llog_process_th.0 Request processed in 138us (236us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189244.170075:0:92397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1784189244.170123:0:92413:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dc081c5c600 going to sleep for 11 seconds 00000100:00100000:2.0:1784189244.170157:0:92413:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc07b7e1500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bd553d0d-03e2-4233-b06b-b55bbfa2b954:92413:1870854458166272:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1784189244.170204:0:92413:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc07b7e1500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bd553d0d-03e2-4233-b06b-b55bbfa2b954:92413:1870854458166400:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1784189244.170237:0:92413:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784189244.170261:0:92413:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dc081c5c600 going to sleep for 11 seconds 00000100:00100000:3.0:1784189244.170491:0:92396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458166400 00000100:00100000:3.0:1784189244.170496:0:92396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458166400 00000100:00100000:3.0:1784189244.170527:0:92396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1784189244.170534:0:92396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf4372bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd553d0d-03e2-4233-b06b-b55bbfa2b954+11:92413:x1870854458166400:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1784189244.170623:0:92396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf4372bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd553d0d-03e2-4233-b06b-b55bbfa2b954+11:92413:x1870854458166400:12345-0@lo:502:llog_process_th.0 Request processed in 77us (374us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189244.170630:0:92396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1784189244.171797:0:92413:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc07b7e1500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bd553d0d-03e2-4233-b06b-b55bbfa2b954:92413:1870854458166400:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1784189244.171810:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc07b7e2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3639:1870854458166144:0@lo:38:llog_process_th.0 00000040:00080000:2.0:1784189244.171835:0:92413:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:2.0:1784189244.171930:0:92390:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:2.0:1784189244.171957:0:92390:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1784189244.171976:0:92390:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff9dbf4369d200/0xcc1762b626f8bda1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc1762b626f8bda8 expref: -99 pid: 92390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189244.171989:0:92390:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: ffff9dbf4369d200/0xcc1762b626f8bda1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc1762b626f8bda8 expref: -99 pid: 92390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1784189244.172057:0:92390:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1784189244.172060:0:92390:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1784189244.172061:0:92390:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1784189244.172063:0:92390:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1784189244.172064:0:92390:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1784189244.172065:0:92390:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1784189244.172067:0:92390:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1784189244.172068:0:92390:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1784189244.172070:0:92390:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1784189244.172072:0:92390:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1784189244.172076:0:92390:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:2.0:1784189244.172079:0:92390:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1784189244.172081:0:92390:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1784189244.172082:0:92390:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1784189244.172088:0:92390:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1784189244.172090:0:92390:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1784189244.172091:0:92390:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1784189244.172092:0:92390:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1784189244.172093:0:92390:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1784189244.172094:0:92390:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1784189244.172094:0:92390:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1784189244.172116:0:92390:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1784189244.172284:0:92390:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc07b7e1500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd553d0d-03e2-4233-b06b-b55bbfa2b954:92390:1870854458166528:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1784189244.172369:0:92390:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784189244.172400:0:92390:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dc081c5c240 going to sleep for 11 seconds 00000100:00100000:2.0:1784189244.172419:0:92398:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458166528 00000100:00100000:2.0:1784189244.172425:0:92398:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458166528 00000100:00100000:2.0:1784189244.172534:0:92398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1784189244.172544:0:92398:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf4372ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd553d0d-03e2-4233-b06b-b55bbfa2b954+11:92390:x1870854458166528:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1784189244.172576:0:92398:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:2.0:1784189244.172593:0:92398:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1784189244.181554:0:92398:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1784189244.181639:0:92398:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:2.0:1784189244.182549:0:92398:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf4372ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd553d0d-03e2-4233-b06b-b55bbfa2b954+11:92390:x1870854458166528:12345-0@lo:253:mount.lustre.0 Request processed in 9988us (10161us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189244.182566:0:92398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1784189244.182648:0:92390:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc07b7e1500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd553d0d-03e2-4233-b06b-b55bbfa2b954:92390:1870854458166528:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1784189244.182666:0:92390:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1784189244.182669:0:92390:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1784189244.182671:0:92390:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1784189244.182673:0:92390:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1784189244.182674:0:92390:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1784189244.182675:0:92390:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1784189244.182677:0:92390:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1784189244.182678:0:92390:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1784189244.182680:0:92390:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1784189244.182682:0:92390:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1784189244.182689:0:92390:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1784189244.182719:0:92390:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 20000000:01000000:1.0:1784189244.184165:0:92399:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1784189244.184174:0:92399:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1784189244.184202:0:92399:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9dc0565e7400/0xcc1762b626f8bdbd lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 92399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189244.184241:0:92399:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9dc04152ce00/0xcc1762b626f8bd8c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcc1762b626f8bd85 expref: 10 pid: 92397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189244.184251:0:92399:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9dc0565e7400/0xcc1762b626f8bdbd lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 92399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189244.184365:0:92399:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9dc04152ce00/0xcc1762b626f8bd8c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcc1762b626f8bd85 expref: 10 pid: 92397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189244.184383:0:92399:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9dc04152ce00/0xcc1762b626f8bd8c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcc1762b626f8bd85 expref: 10 pid: 92397 timeout: 3586 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784189244.184400:0:92399:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc071536a00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:92399:1870854458166656:0@lo:104: 00000100:00100000:1.0:1784189244.184589:0:92399:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784189244.184649:0:92399:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dc06bb82180 going to sleep for 11 seconds 00000100:00100000:2.0:1784189244.184886:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458166656 00000100:00100000:2.0:1784189244.184896:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458166656 00000100:00100000:2.0:1784189244.184944:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 313 00000100:00100000:2.0:1784189244.184955:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc05f02d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:bd553d0d-03e2-4233-b06b-b55bbfa2b954+3:92399:x1870854458166656:12345-0@lo:104: 00010000:00010000:2.0:1784189244.184971:0:6496:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.112@tcp lock: ffff9dc0565e7600/0xcc1762b626f8bd85 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xcc1762b626f8bd8c expref: -99 pid: 92390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189244.185036:0:6496:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1784189244.185043:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc05f02d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:bd553d0d-03e2-4233-b06b-b55bbfa2b954+3:92399:x1870854458166656:12345-0@lo:104: Request processed in 90us (455us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189244.185050:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 313 00010000:00010000:2.0:1784189244.185075:0:6501:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784189244.185082:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.112@tcp lock: ffff9dc0565e7600/0xcc1762b626f8bd85 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xcc1762b626f8bd8c expref: -99 pid: 92390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189244.185091:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc0565e7600 already unused, calling callback (ffffffffc114ac20) 10000000:00010000:2.0:1784189244.185096:0:6501:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.112@tcp lock: ffff9dc0565e7600/0xcc1762b626f8bd85 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xcc1762b626f8bd8c expref: -99 pid: 92390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189244.185105:0:6501:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.112@tcp lock: ffff9dc0565e7600/0xcc1762b626f8bd85 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xcc1762b626f8bd8c expref: -99 pid: 92390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1784189244.185113:0:6501:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.112@tcp lock: ffff9dc0565e7600/0xcc1762b626f8bd85 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xcc1762b626f8bd8c expref: -99 pid: 92390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784189244.185119:0:6501:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1784189244.185152:0:6501:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.112@tcp lock: ffff9dc0565e7600/0xcc1762b626f8bd85 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcc1762b626f8bd8c expref: -99 pid: 92390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189244.185168:0:6501:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1784189244.185192:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.112@tcp lock: ffff9dc0565e7600/0xcc1762b626f8bd85 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcc1762b626f8bd8c expref: -99 pid: 92390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189244.185200:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.112@tcp lock: ffff9dc0565e7600/0xcc1762b626f8bd85 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcc1762b626f8bd8c expref: -99 pid: 92390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189244.185216:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784189244.185217:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784189244.185219:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784189244.185227:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1784189244.185241:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc07b7e1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bd553d0d-03e2-4233-b06b-b55bbfa2b954:3640:1870854458166784:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1784189244.186423:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784189244.186637:0:92399:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc071536a00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:92399:1870854458166656:0@lo:104: 00010000:00010000:2.0:1784189244.186665:0:92399:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9dc0565e7400/0xcc1762b626f8bdbd lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 92399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784189244.187864:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458166784 00000100:00100000:1.0:1784189244.187875:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458166784 00010000:00010000:1.0:1784189244.187918:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9dc04152ce00/0xcc1762b626f8bd8c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcc1762b626f8bd85 expref: 11 pid: 92397 timeout: 3586 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784189244.187961:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2551 00000100:00100000:1.0:1784189244.187972:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc07b7e0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bd553d0d-03e2-4233-b06b-b55bbfa2b954+11:3640:x1870854458166784:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1784189244.187992:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784189244.187999:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9dc04152ce00/0xcc1762b626f8bd8c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcc1762b626f8bd85 expref: 11 pid: 92397 timeout: 3586 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189244.188013:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9dc04152ce00/0xcc1762b626f8bd8c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcc1762b626f8bd85 expref: 11 pid: 92397 timeout: 3586 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189244.188049:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dc04152ce00/0xcc1762b626f8bd8c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcc1762b626f8bd85 expref: 11 pid: 92397 timeout: 3586 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189244.188068:0:6498:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9dc0565e7400/0xcc1762b626f8bdbd lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 92399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189244.188078:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dc0565e7400/0xcc1762b626f8bdbd lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 92399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1784189244.188096:0:6498:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.003922784s 00010000:00010000:1.0:1784189244.188101:0:6498:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9dc0565e7400/0xcc1762b626f8bdbd lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 92399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189244.188109:0:6498:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9dc0565e7400/0xcc1762b626f8bdbd lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 92399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189244.188116:0:6498:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9dc0565e7400/0xcc1762b626f8bdbd lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 92399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189244.188124:0:6498:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9dc0565e7400/0xcc1762b626f8bdbd lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 92399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189244.188131:0:6498:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc0565e7400 already unused, calling callback (ffffffffc0b2e230) 00010000:00010000:1.0:1784189244.188135:0:6498:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9dc0565e7400/0xcc1762b626f8bdbd lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 92399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189244.188143:0:6498:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9dc0565e7400/0xcc1762b626f8bdbd lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 92399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189244.188160:0:6498:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9dc0565e7400/0xcc1762b626f8bdbd lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 92399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189244.188176:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784189244.188258:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc07b7e0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bd553d0d-03e2-4233-b06b-b55bbfa2b954+10:3640:x1870854458166784:12345-0@lo:103:ldlm_bl.0 Request processed in 287us (1838us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189244.188266:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2551 00010000:00010000:1.0:1784189244.190169:0:92399:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9dc0565e7400/0xcc1762b626f8bdbd lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 92399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189244.190189:0:92399:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9dc0565e7400/0xcc1762b626f8bdbd lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 92399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189244.190196:0:92399:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dc0565e7400/0xcc1762b626f8bdbd lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 92399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784189244.191833:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc07b7e1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bd553d0d-03e2-4233-b06b-b55bbfa2b954:3640:1870854458166784:0@lo:103:ldlm_bl.0 00000020:00080000:3.0:1784189244.215647:0:92390:0:(update_trans.c:1495:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 73014444062 00000020:00080000:3.0:1784189244.216607:0:92419:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 73014444062 00000040:01000000:1.0:1784189244.216619:0:92390:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:3.0:1784189244.216620:0:92419:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 73014444062 00000040:01000000:1.0:1784189244.217427:0:92420:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:3.0:1784189244.217825:0:92390:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osp-MDT0000 ctxt 16 is initialized 00000040:00080000:1.0:1784189244.217994:0:92420:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1784189244.219391:0:92421:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc075f7dc00 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:92421:1870854458166912:0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1784189244.219489:0:92421:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784189244.219541:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458166912 00000100:00100000:3.0:1784189244.219549:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458166912 00000100:00100000:3.0:1784189244.219625:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3848 00000100:00100000:3.0:1784189244.219635:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc075f7c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:92421:x1870854458166912:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1784189244.219731:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc075f7c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:92421:x1870854458166912:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 96us (241us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189244.219740:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3848 00000100:00100000:3.0:1784189244.219770:0:92421:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dc0760d8900 going to sleep for 11 seconds 00000100:00100000:3.0:1784189244.219803:0:92421:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc075f7dc00 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:92421:1870854458166912:0@lo:1000:lod0000_rec0001.0 00000040:01000000:3.0:1784189244.219838:0:92421:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:3.0:1784189244.219866:0:92421:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc075f7dc00 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:92421:1870854458167040:0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1784189244.219916:0:92421:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784189244.219934:0:92421:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dc0760d8900 going to sleep for 11 seconds 00000040:01000000:0.0:1784189244.220038:0:92390:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:0.0:1784189244.220224:0:92390:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:0.0:1784189244.221447:0:92390:0:(mdd_device.c:553:mdd_changelog_llog_init()) changelog starting index=0 00000100:00100000:2.0:1784189244.222042:0:23826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458167040 00000100:00100000:2.0:1784189244.222109:0:23826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458167040 00000100:00100000:2.0:1784189244.222173:0:23826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3849 00000100:00100000:2.0:1784189244.222183:0:23826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc075f7d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:92421:x1870854458167040:12345-0@lo:1000:lod0000_rec0001.0 00000040:00080000:1.0:1784189244.222189:0:92420:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x20000a810:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1784189244.222282:0:92420:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000100:00100000:2.0:1784189244.222411:0:23826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc075f7d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:92421:x1870854458167040:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 229us (2493us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189244.222419:0:23826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3849 00000040:01000000:0.0:1784189244.222487:0:92390:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:0.0:1784189244.222659:0:92390:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1784189244.223167:0:92421:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc075f7dc00 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:92421:1870854458167040:0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1784189244.223294:0:92421:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc07b7e1500 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:92421:1870854458167168:0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1784189244.224028:0:92421:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784189244.224230:0:92421:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dc0467bd3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1784189244.224286:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458167168 00000100:00100000:3.0:1784189244.224294:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458167168 00000100:00100000:2.0:1784189244.224546:0:23826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3850 00000100:00100000:2.0:1784189244.224828:0:23826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc07b7e3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:92421:x1870854458167168:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1784189244.225359:0:23826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc07b7e3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:92421:x1870854458167168:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 802us (1330us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189244.225368:0:23826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3850 00000040:00080000:0.0:1784189244.225477:0:92390:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000100:00100000:3.0:1784189244.225910:0:92421:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc07b7e1500 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:92421:1870854458167168:0@lo:1000:lod0000_rec0001.0 00000040:00080000:3.0:1784189244.226002:0:92421:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1784189244.228019:0:92390:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:1.0:1784189244.228111:0:92390:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:1.0:1784189244.228272:0:92390:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:1.0:1784189244.229195:0:92390:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x4e:0x0] (8/32) registered 00000040:00080000:3.0:1784189244.230295:0:92421:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x2400090a4:0x1:0x0] index 261376 count 1 00000004:00080000:3.0:1784189244.230412:0:92421:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osp-MDT0000 retrieved update log, duration 0, retries 0 00000004:00080000:3.0:1784189244.230417:0:92421:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00010000:00080000:0.0:1784189244.235495:0:92390:0:(ldlm_lib.c:3053:target_recovery_init()) RECOVERY: service lustre-MDT0000, 2 recoverable clients, last_transno 111669149699 00010000:00080000:0.0:1784189244.237064:0:92422:0:(ldlm_lib.c:2853:target_recovery_thread()) lustre-MDT0000: started recovery thread pid 92422 00010000:02000000:0.0:1784189244.237085:0:92422:0:(ldlm_lib.c:2335:target_recovery_overseer()) lustre-MDT0000: in recovery but waiting for the first client to connect 00010000:00080000:0.0:1784189244.237090:0:92422:0:(ldlm_lib.c:2545:check_for_recovery_ready()) connected 0 stale 0 max_recoverable_clients 2 abort 0 expired 0 00010000:00080000:0.0:1784189244.237095:0:92422:0:(ldlm_lib.c:2545:check_for_recovery_ready()) connected 0 stale 0 max_recoverable_clients 2 abort 0 expired 0 00000020:01000004:3.0:1784189244.237203:0:92390:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1784189244.237225:0:92390:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.112@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1784189244.237255:0:92390:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=46 00000080:00000004:3.0:1784189244.237289:0:92390:0:(super25.c:181:lustre_fill_super()) /dev/mapper/mds1_flakey: Mount complete 00000020:00000004:3.0:1784189244.238832:0:92390:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1784189244.239401:0:92390:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:0.0:1784189244.712984:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1784189244.715990:0:66945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436299904 00000100:00100000:3.0:1784189244.716004:0:66945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436299904 00000100:00100000:3.0:1784189244.716090:0:66945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1247 00000100:00100000:3.0:1784189244.716101:0:66945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc07b5b1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:debedd94-805c-42a0-a5e5-41758b2012e9+8:2399:x1870854436299904:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:3.0:1784189244.716183:0:66945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc07b5b1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:debedd94-805c-42a0-a5e5-41758b2012e9+8:2399:x1870854436299904:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 83us (3206us total) trans 0 rc 0/0 00000100:00080000:1.0:1784189244.716187:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1784189244.716191:0:66945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1247 00000100:00100000:3.0:1784189244.717164:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1784189244.717285:0:66170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436299776 00000100:00100000:0.0:1784189244.717292:0:66170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436299776 00000100:00100000:0.0:1784189244.717337:0:66170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1337 00000100:00100000:0.0:1784189244.717343:0:66170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc075f7c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2395:x1870854436299776:12345-192.168.203.12@tcp:38:kworker.0 00010000:00080000:0.0:1784189244.717371:0:66170:0:(ldlm_lib.c:938:target_handle_reconnect()) connect export for UUID 'debedd94-805c-42a0-a5e5-41758b2012e9' at ffff9dc07118e800, cookie 0xcc1762b626f8bd15 00010000:00080000:0.0:1784189244.717377:0:66170:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from debedd94-805c-42a0-a5e5-41758b2012e9@192.168.203.12@tcp recovering/t0 exp ffff9dc07118e800 cur 3486 last 1784189244 00010000:02000400:0.0:1784189244.717385:0:66170:0:(ldlm_lib.c:2036:target_start_recovery_timer()) lustre-MDT0000: Will be in recovery for at least 1:00, or until 2 clients reconnect 00010000:00080000:0.0:1784189244.717391:0:66170:0:(ldlm_lib.c:2100:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 70 seconds 00000004:00100000:0.0:1784189244.717409:0:66170:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:0.0:1784189244.717543:0:66170:0:(import.c:65:import_set_state_nolock()) ffff9dc050ae7000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1784189244.717590:0:66170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc075f7c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:debedd94-805c-42a0-a5e5-41758b2012e9+6:2395:x1870854436299776:12345-192.168.203.12@tcp:38:kworker.0 Request processed in 246us (430us total) trans 0 rc 0/0 00000100:00100000:0.0:1784189244.717598:0:66170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1337 00000100:00100000:2.0:1784189244.721728:0:66179:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dc06bb569c0 going to sleep for 0 seconds 00000100:00100000:0.0:1784189244.732520:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1784189244.732621:0:66171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436300032 00000100:00100000:3.0:1784189244.732640:0:66171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436300032 00000100:00100000:3.0:1784189244.732728:0:66171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1338 00000100:00100000:3.0:1784189244.732744:0:66171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc07b5b2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:debedd94-805c-42a0-a5e5-41758b2012e9+6:2395:x1870854436300032:12345-192.168.203.12@tcp:101:ldlm_lock_repla.0 00010000:00080000:3.0:1784189244.733049:0:66171:0:(ldlm_lib.c:3187:target_queue_recovery_request()) @@@ queue lock replay req req@ffff9dc07b5b2a00 x1870854436300032/t0(0) o101->debedd94-805c-42a0-a5e5-41758b2012e9@192.168.203.12@tcp:435/0 lens 328/0 e 0 to 0 dl 1784189255 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784189244.733106:0:66171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc07b5b2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:debedd94-805c-42a0-a5e5-41758b2012e9+6:2395:x1870854436300032:12345-192.168.203.12@tcp:101:ldlm_lock_repla.0 Request processed in 365us (594us total) trans 0 rc 0/-999 00000100:00100000:3.0:1784189244.733115:0:66171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1338 00010000:00080000:0.0:1784189244.733903:0:92422:0:(ldlm_lib.c:2545:check_for_recovery_ready()) connected 1 stale 0 max_recoverable_clients 2 abort 0 expired 0 00000100:00100000:3.0:1784189244.976924:0:75594:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dbf42691a80 going to sleep for 0 seconds 10000000:01000000:1.0:1784189245.040389:0:6510:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1784189245.040397:0:6510:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff9dbf46b0a800 from 120 10000000:01000000:1.0:1784189245.040402:0:6510:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1784189245.040448:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff9dc0565e6000/0xcc1762b626f8bdc4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189245.040459:0:6510:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: ffff9dc0565e6000/0xcc1762b626f8bdc4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189245.040486:0:6510:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: ffff9dc0565e6000/0xcc1762b626f8bdc4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784189245.040513:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc05f02f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458167296:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1784189245.040582:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784189245.040635:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dc06bb82480 going to sleep for 11 seconds 00000100:00100000:1.0:1784189245.040660:0:92397:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458167296 00000100:00100000:1.0:1784189245.040666:0:92397:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458167296 00000100:00100000:1.0:1784189245.040712:0:92397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1784189245.040721:0:92397:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf43728850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd553d0d-03e2-4233-b06b-b55bbfa2b954+10:6510:x1870854458167296:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784189245.040733:0:92397:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784189245.040747:0:92397:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dc0565e6e00/0xcc1762b626f8bdcb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xcc1762b626f8bdc4 expref: -99 pid: 92397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189245.040768:0:92397:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dc0565e6e00/0xcc1762b626f8bdcb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcc1762b626f8bdc4 expref: 11 pid: 92397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189245.040778:0:92397:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dc0565e6e00/0xcc1762b626f8bdcb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcc1762b626f8bdc4 expref: 11 pid: 92397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189245.040788:0:92397:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc0565e6e00, rc 0) 00000100:00100000:1.0:1784189245.040823:0:92397:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf43728850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd553d0d-03e2-4233-b06b-b55bbfa2b954+11:6510:x1870854458167296:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 104us (241us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189245.040829:0:92397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1784189245.040984:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc05f02f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458167296:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784189245.040999:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: ffff9dc0565e6000/0xcc1762b626f8bdc4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc1762b626f8bdcb expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189245.041015:0:6510:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: ffff9dc0565e6000/0xcc1762b626f8bdc4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcc1762b626f8bdcb expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784189245.041062:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc05f02f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458167424:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1784189245.041093:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784189245.041112:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dc06bb82480 going to sleep for 11 seconds 00000100:00100000:3.0:1784189245.043713:0:92398:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458167424 00000100:00100000:3.0:1784189245.043725:0:92398:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458167424 00000100:00100000:3.0:1784189245.043818:0:92398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1784189245.043828:0:92398:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf43729c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd553d0d-03e2-4233-b06b-b55bbfa2b954+11:6510:x1870854458167424:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1784189245.043851:0:92398:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1784189245.043996:0:92398:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1784189245.043999:0:92398:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 120 00000100:00100000:3.0:1784189245.044140:0:92398:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf43729c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd553d0d-03e2-4233-b06b-b55bbfa2b954+11:6510:x1870854458167424:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 313us (3045us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189245.044148:0:92398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1784189245.044241:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc05f02f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458167424:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1784189245.044298:0:6510:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1784189245.044309:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff9dc0565e6000/0xcc1762b626f8bdc4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc1762b626f8bdcb expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189245.044338:0:6510:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: ffff9dc0565e6000/0xcc1762b626f8bdc4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc1762b626f8bdcb expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784189245.044349:0:6510:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1784189245.044351:0:6510:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9dbf44675800 from 52 10000000:01000000:1.0:1784189245.044354:0:6510:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1784189245.044382:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff9dc0565e6400/0xcc1762b626f8bdd2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189245.044390:0:6510:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: ffff9dc0565e6400/0xcc1762b626f8bdd2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189245.044400:0:6510:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: ffff9dc0565e6400/0xcc1762b626f8bdd2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784189245.044419:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc05f02f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458167552:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1784189245.044464:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784189245.044515:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dbf44443780 going to sleep for 11 seconds 00000100:00100000:3.0:1784189245.045345:0:92396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458167552 00000100:00100000:3.0:1784189245.045353:0:92396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458167552 00000100:00100000:3.0:1784189245.045392:0:92396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1784189245.045401:0:92396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf4a252850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd553d0d-03e2-4233-b06b-b55bbfa2b954+11:6510:x1870854458167552:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784189245.045413:0:92396:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784189245.045430:0:92396:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dc0755a5a00/0xcc1762b626f8bdd9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xcc1762b626f8bdd2 expref: -99 pid: 92396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189245.045453:0:92396:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dc0755a5a00/0xcc1762b626f8bdd9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcc1762b626f8bdd2 expref: 12 pid: 92396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189245.045464:0:92396:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dc0755a5a00/0xcc1762b626f8bdd9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcc1762b626f8bdd2 expref: 12 pid: 92396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189245.045488:0:92396:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc0755a5a00, rc 0) 00000100:00100000:3.0:1784189245.045536:0:92396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf4a252850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd553d0d-03e2-4233-b06b-b55bbfa2b954+12:6510:x1870854458167552:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 136us (1071us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189245.045543:0:92396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1784189245.046906:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc05f02f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458167552:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784189245.046929:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: ffff9dc0565e6400/0xcc1762b626f8bdd2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc1762b626f8bdd9 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189245.046940:0:6510:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: ffff9dc0565e6400/0xcc1762b626f8bdd2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xcc1762b626f8bdd9 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784189245.047020:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc075f7ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458167680:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784189245.047066:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784189245.047101:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dc082158240 going to sleep for 11 seconds 00000100:00100000:1.0:1784189245.047600:0:92398:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458167680 00000100:00100000:1.0:1784189245.047615:0:92398:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458167680 00000100:00100000:1.0:1784189245.047654:0:92398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1784189245.047662:0:92398:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf4a252450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd553d0d-03e2-4233-b06b-b55bbfa2b954+12:6510:x1870854458167680:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1784189245.047790:0:92398:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf4a252450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd553d0d-03e2-4233-b06b-b55bbfa2b954+12:6510:x1870854458167680:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 127us (722us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189245.047798:0:92398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1784189245.049998:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc075f7ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458167680:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784189245.050060:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc075f7ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458167808:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1784189245.050131:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784189245.050173:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dc082158240 going to sleep for 11 seconds 00000100:00100000:1.0:1784189245.050716:0:92396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458167808 00000100:00100000:1.0:1784189245.050723:0:92396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458167808 00000100:00100000:1.0:1784189245.050766:0:92396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1784189245.050776:0:92396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf4a252c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd553d0d-03e2-4233-b06b-b55bbfa2b954+12:6510:x1870854458167808:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1784189245.050917:0:92396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf4a252c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd553d0d-03e2-4233-b06b-b55bbfa2b954+12:6510:x1870854458167808:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 141us (785us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189245.050927:0:92396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1784189245.052415:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc075f7ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458167808:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1784189245.053469:0:92472:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 51 00000020:01000000:3.0:1784189245.054929:0:6510:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 52-51 (rc=0) 10000000:01000000:3.0:1784189245.054970:0:6510:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1784189245.054981:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff9dc0565e6400/0xcc1762b626f8bdd2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc1762b626f8bdd9 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189245.054993:0:6510:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: ffff9dc0565e6400/0xcc1762b626f8bdd2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc1762b626f8bdd9 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784189245.055020:0:6510:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1784189245.055022:0:6510:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff9dbf44675800 from 117 10000000:01000000:3.0:1784189245.055025:0:6510:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1784189245.055060:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff9dc0755a5200/0xcc1762b626f8bde0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189245.055068:0:6510:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: ffff9dc0755a5200/0xcc1762b626f8bde0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189245.055078:0:6510:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: ffff9dc0755a5200/0xcc1762b626f8bde0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784189245.055103:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc075f7e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458167936:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1784189245.055174:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784189245.055222:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dc050243240 going to sleep for 11 seconds 00000100:00100000:1.0:1784189245.055295:0:92397:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458167936 00000100:00100000:1.0:1784189245.055302:0:92397:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458167936 00000100:00100000:1.0:1784189245.055374:0:92397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1784189245.055383:0:92397:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf4a251050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd553d0d-03e2-4233-b06b-b55bbfa2b954+12:6510:x1870854458167936:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784189245.055396:0:92397:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784189245.055410:0:92397:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dc0565e6200/0xcc1762b626f8bde7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xcc1762b626f8bde0 expref: -99 pid: 92397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189245.055433:0:92397:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dc0565e6200/0xcc1762b626f8bde7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcc1762b626f8bde0 expref: 13 pid: 92397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189245.055445:0:92397:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dc0565e6200/0xcc1762b626f8bde7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcc1762b626f8bde0 expref: 13 pid: 92397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189245.055461:0:92397:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc0565e6200, rc 0) 00000100:00100000:1.0:1784189245.055514:0:92397:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf4a251050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd553d0d-03e2-4233-b06b-b55bbfa2b954+13:6510:x1870854458167936:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 132us (340us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189245.055522:0:92397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1784189245.055786:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc075f7e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458167936:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784189245.055802:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: ffff9dc0755a5200/0xcc1762b626f8bde0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc1762b626f8bde7 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189245.055811:0:6510:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: ffff9dc0755a5200/0xcc1762b626f8bde0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xcc1762b626f8bde7 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784189245.055864:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc075f7e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458168064:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1784189245.055899:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784189245.055927:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dc050243240 going to sleep for 11 seconds 00000100:00100000:1.0:1784189245.055961:0:92398:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458168064 00000100:00100000:1.0:1784189245.055967:0:92398:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458168064 00000100:00100000:1.0:1784189245.056001:0:92398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1784189245.056009:0:92398:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf4a250850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd553d0d-03e2-4233-b06b-b55bbfa2b954+13:6510:x1870854458168064:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1784189245.056022:0:92398:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1784189245.056039:0:92398:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1784189245.056043:0:92398:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/4/3. 20000000:01000000:1.0:1784189245.056046:0:92398:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/4/3. 20000000:01000000:1.0:1784189245.056048:0:92398:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/4/3. 20000000:01000000:1.0:1784189245.056051:0:92398:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 120 00000100:00100000:1.0:1784189245.056139:0:92398:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf4a250850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd553d0d-03e2-4233-b06b-b55bbfa2b954+13:6510:x1870854458168064:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 130us (238us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189245.056147:0:92398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1784189245.056227:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc075f7e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458168064:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1784189245.056306:0:6510:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1784189245.056312:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff9dc0755a5200/0xcc1762b626f8bde0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc1762b626f8bde7 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189245.056365:0:6510:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: ffff9dc0755a5200/0xcc1762b626f8bde0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc1762b626f8bde7 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784189245.056373:0:6510:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:2.0:1784189245.056375:0:6510:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 46 10000000:01000000:2.0:1784189245.056378:0:6510:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:2.0:1784189245.056397:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff9dbf4369c000/0xcc1762b626f8bdee lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189245.056405:0:6510:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: ffff9dbf4369c000/0xcc1762b626f8bdee lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189245.056419:0:6510:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: ffff9dbf4369c000/0xcc1762b626f8bdee lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784189245.056433:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc07b7e1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458168192:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1784189245.056463:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784189245.056479:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dbf45865d80 going to sleep for 11 seconds 00000100:00100000:3.0:1784189245.057410:0:92396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458168192 00000100:00100000:3.0:1784189245.057422:0:92396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458168192 00000100:00100000:3.0:1784189245.057481:0:92396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1784189245.057493:0:92396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf4a253450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd553d0d-03e2-4233-b06b-b55bbfa2b954+13:6510:x1870854458168192:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784189245.057508:0:92396:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784189245.057528:0:92396:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dc0755a4e00/0xcc1762b626f8bdf5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xcc1762b626f8bdee expref: -99 pid: 92396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189245.057557:0:92396:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dc0755a4e00/0xcc1762b626f8bdf5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcc1762b626f8bdee expref: 14 pid: 92396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189245.057571:0:92396:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dc0755a4e00/0xcc1762b626f8bdf5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcc1762b626f8bdee expref: 14 pid: 92396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189245.057580:0:92396:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc0755a4e00, rc 0) 00000100:00100000:3.0:1784189245.057867:0:92396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf4a253450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd553d0d-03e2-4233-b06b-b55bbfa2b954+14:6510:x1870854458168192:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 374us (1400us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189245.057874:0:92396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1784189245.057987:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc07b7e1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458168192:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1784189245.058002:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: ffff9dbf4369c000/0xcc1762b626f8bdee lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc1762b626f8bdf5 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189245.058011:0:6510:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: ffff9dbf4369c000/0xcc1762b626f8bdee lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xcc1762b626f8bdf5 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784189245.058072:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc07b7e1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458168320:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1784189245.058099:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784189245.058120:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dbf45865d80 going to sleep for 11 seconds 00000100:00100000:3.0:1784189245.058180:0:92397:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458168320 00000100:00100000:3.0:1784189245.058185:0:92397:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458168320 00000100:00100000:3.0:1784189245.058222:0:92397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1784189245.058229:0:92397:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf4a251850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd553d0d-03e2-4233-b06b-b55bbfa2b954+14:6510:x1870854458168320:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784189245.059379:0:92397:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf4a251850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd553d0d-03e2-4233-b06b-b55bbfa2b954+14:6510:x1870854458168320:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 1144us (1273us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189245.059389:0:92397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1784189245.062523:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc07b7e1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458168320:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1784189245.062589:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc05f02ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458168448:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1784189245.062672:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784189245.062706:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dc041254900 going to sleep for 11 seconds 00000100:00100000:3.0:1784189245.062886:0:92398:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458168448 00000100:00100000:3.0:1784189245.062892:0:92398:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458168448 00000100:00100000:3.0:1784189245.062945:0:92398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1784189245.062954:0:92398:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf4a253850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd553d0d-03e2-4233-b06b-b55bbfa2b954+14:6510:x1870854458168448:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1784189245.065719:0:92398:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf4a253850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd553d0d-03e2-4233-b06b-b55bbfa2b954+14:6510:x1870854458168448:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 2756us (3038us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189245.065756:0:92398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1784189245.068541:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc05f02ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458168448:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1784189245.069838:0:92473:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 64768 count 46 00000020:01000000:1.0:1784189245.070018:0:6510:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 46-45 (rc=0) 10000000:01000000:1.0:1784189245.070043:0:6510:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:1.0:1784189245.070053:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff9dbf4369c000/0xcc1762b626f8bdee lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc1762b626f8bdf5 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189245.070078:0:6510:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: ffff9dbf4369c000/0xcc1762b626f8bdee lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc1762b626f8bdf5 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784189245.070088:0:6510:0:(mgc_request.c:611:do_requeue()) updating log lustre-barrier 10000000:01000000:1.0:1784189245.070090:0:6510:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-barrier-ffff9dbf44675800 from 1 10000000:01000000:1.0:1784189245.070093:0:6510:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:1.0:1784189245.070128:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff9dc0565e6600/0xcc1762b626f8bdfc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189245.070137:0:6510:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: ffff9dc0565e6600/0xcc1762b626f8bdfc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189245.070147:0:6510:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: ffff9dc0565e6600/0xcc1762b626f8bdfc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784189245.070171:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc05f02ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458168576:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1784189245.070236:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784189245.070361:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dc06bb82480 going to sleep for 11 seconds 00000100:00100000:3.0:1784189245.070642:0:92397:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458168576 00000100:00100000:3.0:1784189245.070649:0:92397:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458168576 00000100:00100000:3.0:1784189245.070731:0:92397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1784189245.070811:0:92397:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf4a251450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd553d0d-03e2-4233-b06b-b55bbfa2b954+14:6510:x1870854458168576:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784189245.070825:0:92397:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784189245.070839:0:92397:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dc0755a4c00/0xcc1762b626f8be03 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xcc1762b626f8bdfc expref: -99 pid: 92397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189245.070862:0:92397:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dc0755a4c00/0xcc1762b626f8be03 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcc1762b626f8bdfc expref: 15 pid: 92397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189245.070872:0:92397:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dc0755a4c00/0xcc1762b626f8be03 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcc1762b626f8bdfc expref: 15 pid: 92397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189245.070880:0:92397:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc0755a4c00, rc 0) 00000100:00100000:3.0:1784189245.070929:0:92397:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf4a251450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd553d0d-03e2-4233-b06b-b55bbfa2b954+15:6510:x1870854458168576:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 122us (692us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189245.070936:0:92397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1784189245.071015:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc05f02ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458168576:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784189245.071033:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: ffff9dc0565e6600/0xcc1762b626f8bdfc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc1762b626f8be03 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189245.071043:0:6510:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: ffff9dc0565e6600/0xcc1762b626f8bdfc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xcc1762b626f8be03 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784189245.071060:0:6510:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:1.0:1784189245.071064:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff9dc0565e6600/0xcc1762b626f8bdfc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc1762b626f8be03 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189245.071084:0:6510:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: ffff9dc0565e6600/0xcc1762b626f8bdfc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc1762b626f8be03 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784189245.071093:0:6510:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1784189245.071095:0:6510:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9dbf44675800 from 7 10000000:01000000:1.0:1784189245.071098:0:6510:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1784189245.071117:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff9dc0565e7e00/0xcc1762b626f8be0a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189245.071125:0:6510:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: ffff9dc0565e7e00/0xcc1762b626f8be0a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189245.071132:0:6510:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: ffff9dc0565e7e00/0xcc1762b626f8be0a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784189245.071147:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc05f02ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458168704:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1784189245.071175:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784189245.075256:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dc06bb82480 going to sleep for 11 seconds 00000100:00100000:2.0:1784189245.079259:0:92396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458168704 00000100:00100000:2.0:1784189245.079276:0:92396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458168704 00000100:00100000:2.0:1784189245.079356:0:92396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1784189245.079366:0:92396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf4a250050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd553d0d-03e2-4233-b06b-b55bbfa2b954+15:6510:x1870854458168704:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1784189245.079382:0:92396:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784189245.079404:0:92396:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dbf4369c200/0xcc1762b626f8be11 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xcc1762b626f8be0a expref: -99 pid: 92396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189245.079432:0:92396:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dbf4369c200/0xcc1762b626f8be11 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcc1762b626f8be0a expref: 16 pid: 92396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189245.079457:0:92396:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dbf4369c200/0xcc1762b626f8be11 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcc1762b626f8be0a expref: 16 pid: 92396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189245.079467:0:92396:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dbf4369c200, rc 0) 00000100:00100000:2.0:1784189245.079569:0:92396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf4a250050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd553d0d-03e2-4233-b06b-b55bbfa2b954+16:6510:x1870854458168704:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 204us (8392us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189245.079576:0:92396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1784189245.079877:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc05f02ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458168704:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784189245.079898:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: ffff9dc0565e7e00/0xcc1762b626f8be0a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc1762b626f8be11 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189245.079909:0:6510:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: ffff9dc0565e7e00/0xcc1762b626f8be0a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xcc1762b626f8be11 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784189245.080064:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc07b5b1880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458168832:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1784189245.080106:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784189245.080155:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dc0715a3600 going to sleep for 11 seconds 00000100:00100000:1.0:1784189245.084583:0:92398:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458168832 00000100:00100000:1.0:1784189245.084598:0:92398:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458168832 00000100:00100000:1.0:1784189245.084665:0:92398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1784189245.084674:0:92398:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf4a250450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd553d0d-03e2-4233-b06b-b55bbfa2b954+16:6510:x1870854458168832:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1784189245.084846:0:92398:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf4a250450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd553d0d-03e2-4233-b06b-b55bbfa2b954+16:6510:x1870854458168832:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 172us (4739us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189245.084864:0:92398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1784189245.084885:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc07b5b1880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458168832:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1784189245.084940:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc07b5b1880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458168960:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1784189245.085055:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784189245.085089:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dc0715a3600 going to sleep for 11 seconds 00000100:00100000:1.0:1784189245.085514:0:92398:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458168960 00000100:00100000:1.0:1784189245.085520:0:92398:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458168960 00000100:00100000:1.0:1784189245.085557:0:92398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1784189245.085572:0:92398:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf4a252050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd553d0d-03e2-4233-b06b-b55bbfa2b954+16:6510:x1870854458168960:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1784189245.085680:0:92398:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf4a252050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd553d0d-03e2-4233-b06b-b55bbfa2b954+16:6510:x1870854458168960:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 108us (693us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189245.085687:0:92398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1784189245.085710:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc07b5b1880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458168960:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1784189245.088589:0:92475:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:1.0:1784189245.089088:0:6510:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:1.0:1784189245.089112:0:6510:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1784189245.089123:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff9dc0565e7e00/0xcc1762b626f8be0a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc1762b626f8be11 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189245.089135:0:6510:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: ffff9dc0565e7e00/0xcc1762b626f8be0a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc1762b626f8be11 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784189245.089145:0:6510:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1784189245.089148:0:6510:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9dbf425f7000 from 52 10000000:01000000:1.0:1784189245.089151:0:6510:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1784189245.089192:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff9dc0565e7a00/0xcc1762b626f8be18 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189245.089199:0:6510:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: ffff9dc0565e7a00/0xcc1762b626f8be18 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189245.089210:0:6510:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: ffff9dc0565e7a00/0xcc1762b626f8be18 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784189245.089238:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc05f02fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458169088:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1784189245.089308:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784189245.092674:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dc071b6ab40 going to sleep for 11 seconds 00000100:00100000:0.0:1784189245.092916:0:92397:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458169088 00000100:00100000:0.0:1784189245.092925:0:92397:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458169088 00000100:00100000:0.0:1784189245.092991:0:92397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1784189245.093001:0:92397:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc056ab2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd553d0d-03e2-4233-b06b-b55bbfa2b954+16:6510:x1870854458169088:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784189245.093017:0:92397:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784189245.093036:0:92397:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dc04152d000/0xcc1762b626f8be1f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xcc1762b626f8be18 expref: -99 pid: 92397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189245.093066:0:92397:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dc04152d000/0xcc1762b626f8be1f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcc1762b626f8be18 expref: 17 pid: 92397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189245.093087:0:92397:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dc04152d000/0xcc1762b626f8be1f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcc1762b626f8be18 expref: 17 pid: 92397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189245.093097:0:92397:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc04152d000, rc 0) 00000100:00100000:0.0:1784189245.093176:0:92397:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc056ab2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd553d0d-03e2-4233-b06b-b55bbfa2b954+17:6510:x1870854458169088:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 176us (3868us total) trans 0 rc 0/0 00000100:00100000:0.0:1784189245.093183:0:92397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1784189245.096691:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc05f02fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458169088:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1784189245.096722:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: ffff9dc0565e7a00/0xcc1762b626f8be18 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc1762b626f8be1f expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189245.096740:0:6510:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: ffff9dc0565e7a00/0xcc1762b626f8be18 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xcc1762b626f8be1f expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784189245.097878:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc07b7e2300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458169216:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1784189245.097942:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784189245.097989:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dbf458659c0 going to sleep for 11 seconds 00000100:00100000:0.0:1784189245.098280:0:92396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458169216 00000100:00100000:0.0:1784189245.098288:0:92396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458169216 00000100:00100000:0.0:1784189245.098355:0:92396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1784189245.098363:0:92396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc056ab3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd553d0d-03e2-4233-b06b-b55bbfa2b954+17:6510:x1870854458169216:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1784189245.098523:0:92396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc056ab3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd553d0d-03e2-4233-b06b-b55bbfa2b954+17:6510:x1870854458169216:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 160us (580us total) trans 0 rc 0/0 00000100:00100000:0.0:1784189245.098530:0:92396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1784189245.103072:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc07b7e2300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458169216:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1784189245.103144:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc07b7e2300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458169344:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1784189245.103227:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784189245.103261:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dbf458659c0 going to sleep for 11 seconds 00000100:00100000:1.0:1784189245.103357:0:92398:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458169344 00000100:00100000:1.0:1784189245.103365:0:92398:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458169344 00000100:00100000:1.0:1784189245.103430:0:92398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1784189245.103441:0:92398:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc056ab3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd553d0d-03e2-4233-b06b-b55bbfa2b954+17:6510:x1870854458169344:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1784189245.103572:0:92398:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc056ab3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd553d0d-03e2-4233-b06b-b55bbfa2b954+17:6510:x1870854458169344:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 133us (344us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189245.103581:0:92398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1784189245.103776:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc07b7e2300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458169344:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1784189245.109370:0:92476:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 51 00000020:01000000:2.0:1784189245.109974:0:6510:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 52-51 (rc=0) 10000000:01000000:2.0:1784189245.110001:0:6510:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1784189245.110024:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff9dc0565e7a00/0xcc1762b626f8be18 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc1762b626f8be1f expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189245.110036:0:6510:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: ffff9dc0565e7a00/0xcc1762b626f8be18 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc1762b626f8be1f expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784189245.110047:0:6510:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:2.0:1784189245.110050:0:6510:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 11 10000000:01000000:2.0:1784189245.110053:0:6510:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:2.0:1784189245.110089:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff9dbf4369d600/0xcc1762b626f8be26 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189245.110096:0:6510:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: ffff9dbf4369d600/0xcc1762b626f8be26 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189245.110107:0:6510:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: ffff9dbf4369d600/0xcc1762b626f8be26 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784189245.110132:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc07b7e2300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458169472:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1784189245.110200:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784189245.110245:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dbf458659c0 going to sleep for 11 seconds 00000100:00100000:1.0:1784189245.111951:0:92397:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458169472 00000100:00100000:1.0:1784189245.111965:0:92397:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458169472 00000100:00100000:1.0:1784189245.112033:0:92397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1784189245.112044:0:92397:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc056ab1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd553d0d-03e2-4233-b06b-b55bbfa2b954+17:6510:x1870854458169472:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784189245.112061:0:92397:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784189245.112077:0:92397:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dc0565e6c00/0xcc1762b626f8be2d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xcc1762b626f8be26 expref: -99 pid: 92397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189245.112104:0:92397:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dc0565e6c00/0xcc1762b626f8be2d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcc1762b626f8be26 expref: 18 pid: 92397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189245.112114:0:92397:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dc0565e6c00/0xcc1762b626f8be2d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcc1762b626f8be26 expref: 18 pid: 92397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189245.112122:0:92397:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc0565e6c00, rc 0) 00000100:00100000:1.0:1784189245.112192:0:92397:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc056ab1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd553d0d-03e2-4233-b06b-b55bbfa2b954+18:6510:x1870854458169472:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 149us (1990us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189245.112199:0:92397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1784189245.112260:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc07b7e2300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458169472:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784189245.112277:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: ffff9dbf4369d600/0xcc1762b626f8be26 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc1762b626f8be2d expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189245.112303:0:6510:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: ffff9dbf4369d600/0xcc1762b626f8be26 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xcc1762b626f8be2d expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784189245.112394:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc05f02d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458169600:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1784189245.112426:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784189245.112451:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dc071b6a180 going to sleep for 11 seconds 00000100:00100000:1.0:1784189245.112464:0:92398:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458169600 00000100:00100000:1.0:1784189245.112467:0:92398:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458169600 00000100:00100000:1.0:1784189245.112490:0:92398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1784189245.112497:0:92398:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc056ab0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd553d0d-03e2-4233-b06b-b55bbfa2b954+18:6510:x1870854458169600:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1784189245.112633:0:92398:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc056ab0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd553d0d-03e2-4233-b06b-b55bbfa2b954+18:6510:x1870854458169600:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 135us (205us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189245.112640:0:92398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1784189245.112671:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc05f02d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458169600:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1784189245.112701:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc05f02d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458169728:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1784189245.114372:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784189245.114429:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dc071b6a180 going to sleep for 11 seconds 00000100:00100000:2.0:1784189245.115893:0:92398:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458169728 00000100:00100000:2.0:1784189245.115907:0:92398:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458169728 00000100:00100000:2.0:1784189245.115971:0:92398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1784189245.115982:0:92398:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc056ab0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd553d0d-03e2-4233-b06b-b55bbfa2b954+18:6510:x1870854458169728:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1784189245.124506:0:92398:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc056ab0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd553d0d-03e2-4233-b06b-b55bbfa2b954+18:6510:x1870854458169728:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 8515us (10129us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189245.124523:0:92398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1784189245.124663:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc05f02d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458169728:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1784189245.125902:0:92478:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 64768 count 11 00000020:01000000:0.0:1784189245.126059:0:6510:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 11-10 (rc=0) 10000000:01000000:0.0:1784189245.126082:0:6510:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:0.0:1784189245.126093:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff9dbf4369d600/0xcc1762b626f8be26 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc1762b626f8be2d expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189245.126104:0:6510:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: ffff9dbf4369d600/0xcc1762b626f8be26 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc1762b626f8be2d expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784189245.126114:0:6510:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1784189245.126117:0:6510:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9dbf425f7000 from 7 10000000:01000000:0.0:1784189245.126126:0:6510:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1784189245.126162:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff9dc04152c600/0xcc1762b626f8be34 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189245.126170:0:6510:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: ffff9dc04152c600/0xcc1762b626f8be34 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189245.126180:0:6510:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: ffff9dc04152c600/0xcc1762b626f8be34 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784189245.126203:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc07b5b1880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458169856:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1784189245.126255:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784189245.126290:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dbf45b9b3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1784189245.131415:0:92396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458169856 00000100:00100000:3.0:1784189245.131430:0:92396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458169856 00000100:00100000:3.0:1784189245.131494:0:92396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1784189245.131505:0:92396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc056ab3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd553d0d-03e2-4233-b06b-b55bbfa2b954+18:6510:x1870854458169856:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784189245.131521:0:92396:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784189245.131540:0:92396:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dc0755a4a00/0xcc1762b626f8be3b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xcc1762b626f8be34 expref: -99 pid: 92396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189245.131569:0:92396:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dc0755a4a00/0xcc1762b626f8be3b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcc1762b626f8be34 expref: 19 pid: 92396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189245.131593:0:92396:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dc0755a4a00/0xcc1762b626f8be3b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcc1762b626f8be34 expref: 19 pid: 92396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189245.131615:0:92396:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc0755a4a00, rc 0) 00000100:00100000:3.0:1784189245.131708:0:92396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc056ab3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd553d0d-03e2-4233-b06b-b55bbfa2b954+19:6510:x1870854458169856:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 205us (5451us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189245.131723:0:92396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1784189245.132097:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc07b5b1880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458169856:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784189245.132117:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: ffff9dc04152c600/0xcc1762b626f8be34 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc1762b626f8be3b expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189245.132126:0:6510:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: ffff9dc04152c600/0xcc1762b626f8be34 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xcc1762b626f8be3b expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784189245.132204:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc07b5b1880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458169984:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1784189245.132240:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784189245.132282:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dbf45b9b3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1784189245.132378:0:92398:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458169984 00000100:00100000:3.0:1784189245.132383:0:92398:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458169984 00000100:00100000:3.0:1784189245.132849:0:92398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1784189245.132858:0:92398:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc056ab3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd553d0d-03e2-4233-b06b-b55bbfa2b954+19:6510:x1870854458169984:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784189245.132973:0:92398:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc056ab3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd553d0d-03e2-4233-b06b-b55bbfa2b954+19:6510:x1870854458169984:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 116us (732us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189245.132980:0:92398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1784189245.133094:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc07b5b1880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458169984:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1784189245.133127:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc07b5b1880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458170112:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1784189245.133171:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784189245.133181:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dbf45b9b3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1784189245.133195:0:92396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458170112 00000100:00100000:0.0:1784189245.133204:0:92396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458170112 00000100:00100000:0.0:1784189245.133224:0:92396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1784189245.133230:0:92396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc056ab2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd553d0d-03e2-4233-b06b-b55bbfa2b954+20:6510:x1870854458170112:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1784189245.133306:0:92396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc056ab2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd553d0d-03e2-4233-b06b-b55bbfa2b954+20:6510:x1870854458170112:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 75us (134us total) trans 0 rc 0/0 00000100:00100000:0.0:1784189245.133313:0:92396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1784189245.133373:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc07b5b1880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458170112:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1784189245.136231:0:92479:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:0.0:1784189245.137255:0:6510:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:0.0:1784189245.137284:0:6510:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1784189245.137295:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff9dc04152c600/0xcc1762b626f8be34 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc1762b626f8be3b expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189245.137308:0:6510:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: ffff9dc04152c600/0xcc1762b626f8be34 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc1762b626f8be3b expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784189245.137674:0:6510:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1784189245.137678:0:6510:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9dc07b5d6800 from 52 10000000:01000000:0.0:1784189245.137681:0:6510:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1784189245.137931:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff9dc04152da00/0xcc1762b626f8be42 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189245.137942:0:6510:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: ffff9dc04152da00/0xcc1762b626f8be42 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189245.137955:0:6510:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: ffff9dc04152da00/0xcc1762b626f8be42 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784189245.137980:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc07b5b1880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458170240:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1784189245.138120:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784189245.138212:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dbf45b9b3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1784189245.138254:0:92396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458170240 00000100:00100000:3.0:1784189245.138261:0:92396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458170240 00000100:00100000:3.0:1784189245.138382:0:92396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1784189245.138467:0:92396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc056ab0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd553d0d-03e2-4233-b06b-b55bbfa2b954+19:6510:x1870854458170240:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784189245.138483:0:92396:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784189245.138499:0:92396:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dc0755a5e00/0xcc1762b626f8be49 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xcc1762b626f8be42 expref: -99 pid: 92396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189245.138523:0:92396:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dc0755a5e00/0xcc1762b626f8be49 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcc1762b626f8be42 expref: 20 pid: 92396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189245.138534:0:92396:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dc0755a5e00/0xcc1762b626f8be49 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcc1762b626f8be42 expref: 20 pid: 92396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189245.138550:0:92396:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc0755a5e00, rc 0) 00000100:00100000:3.0:1784189245.138833:0:92396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc056ab0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd553d0d-03e2-4233-b06b-b55bbfa2b954+20:6510:x1870854458170240:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 442us (712us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189245.138840:0:92396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1784189245.138977:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc07b5b1880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458170240:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784189245.138995:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: ffff9dc04152da00/0xcc1762b626f8be42 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc1762b626f8be49 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189245.139017:0:6510:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: ffff9dc04152da00/0xcc1762b626f8be42 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xcc1762b626f8be49 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784189245.139084:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc05f02c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458170368:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1784189245.139116:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784189245.139148:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dc071b6a300 going to sleep for 11 seconds 00000100:00100000:0.0:1784189245.139158:0:92397:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458170368 00000100:00100000:0.0:1784189245.139164:0:92397:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458170368 00000100:00100000:0.0:1784189245.139200:0:92397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1784189245.139208:0:92397:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc056ab1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd553d0d-03e2-4233-b06b-b55bbfa2b954+20:6510:x1870854458170368:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1784189245.139358:0:92397:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc056ab1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd553d0d-03e2-4233-b06b-b55bbfa2b954+20:6510:x1870854458170368:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 151us (241us total) trans 0 rc 0/0 00000100:00100000:0.0:1784189245.139366:0:92397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1784189245.142999:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc05f02c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458170368:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1784189245.143070:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc05f02c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458170496:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1784189245.143148:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784189245.143196:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dc071b6a300 going to sleep for 11 seconds 00000100:00100000:0.0:1784189245.144191:0:92396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458170496 00000100:00100000:0.0:1784189245.144203:0:92396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458170496 00000100:00100000:0.0:1784189245.144272:0:92396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1784189245.144283:0:92396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc056ab2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd553d0d-03e2-4233-b06b-b55bbfa2b954+20:6510:x1870854458170496:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1784189245.145416:0:92396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc056ab2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd553d0d-03e2-4233-b06b-b55bbfa2b954+20:6510:x1870854458170496:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 1129us (2262us total) trans 0 rc 0/0 00000100:00100000:0.0:1784189245.145429:0:92396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1784189245.150790:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc05f02c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458170496:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1784189245.157224:0:92480:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 51 00000020:01000000:1.0:1784189245.159126:0:6510:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 52-51 (rc=0) 10000000:01000000:1.0:1784189245.159165:0:6510:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1784189245.159176:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff9dc04152da00/0xcc1762b626f8be42 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc1762b626f8be49 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189245.159188:0:6510:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: ffff9dc04152da00/0xcc1762b626f8be42 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc1762b626f8be49 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784189245.159197:0:6510:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:1.0:1784189245.159199:0:6510:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 14 10000000:01000000:1.0:1784189245.159203:0:6510:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:1.0:1784189245.159241:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff9dc0565e6800/0xcc1762b626f8be50 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189245.159249:0:6510:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: ffff9dc0565e6800/0xcc1762b626f8be50 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189245.159272:0:6510:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: ffff9dc0565e6800/0xcc1762b626f8be50 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784189245.159296:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc05f02c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458170624:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1784189245.159384:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784189245.161210:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dc071b6a300 going to sleep for 11 seconds 00000100:00100000:2.0:1784189245.162049:0:92398:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458170624 00000100:00100000:2.0:1784189245.162060:0:92398:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458170624 00000100:00100000:2.0:1784189245.162115:0:92398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1784189245.162125:0:92398:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc056ab1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd553d0d-03e2-4233-b06b-b55bbfa2b954+20:6510:x1870854458170624:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1784189245.162154:0:92398:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784189245.162172:0:92398:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dbf4369d800/0xcc1762b626f8be57 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xcc1762b626f8be50 expref: -99 pid: 92398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189245.162200:0:92398:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dbf4369d800/0xcc1762b626f8be57 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcc1762b626f8be50 expref: 21 pid: 92398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189245.162224:0:92398:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dbf4369d800/0xcc1762b626f8be57 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcc1762b626f8be50 expref: 21 pid: 92398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189245.162233:0:92398:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dbf4369d800, rc 0) 00000100:00100000:2.0:1784189245.162309:0:92398:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc056ab1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd553d0d-03e2-4233-b06b-b55bbfa2b954+21:6510:x1870854458170624:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 185us (2924us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189245.162316:0:92398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1784189245.163007:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc05f02c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458170624:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784189245.163027:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: ffff9dc0565e6800/0xcc1762b626f8be50 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc1762b626f8be57 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189245.163037:0:6510:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: ffff9dc0565e6800/0xcc1762b626f8be50 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0xcc1762b626f8be57 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784189245.163111:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc07b5b0a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458170752:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1784189245.163154:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784189245.163194:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dbf45b9bc00 going to sleep for 11 seconds 00000100:00100000:2.0:1784189245.163802:0:92396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458170752 00000100:00100000:2.0:1784189245.163808:0:92396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458170752 00000100:00100000:2.0:1784189245.163848:0:92396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1784189245.163856:0:92396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc056ab1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd553d0d-03e2-4233-b06b-b55bbfa2b954+21:6510:x1870854458170752:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1784189245.164063:0:92396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc056ab1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd553d0d-03e2-4233-b06b-b55bbfa2b954+21:6510:x1870854458170752:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 207us (908us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189245.164072:0:92396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1784189245.164140:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc07b5b0a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458170752:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1784189245.164177:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc05f02ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458170880:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1784189245.164302:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784189245.164390:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dc071b6a180 going to sleep for 11 seconds 00000100:00100000:2.0:1784189245.164713:0:92397:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458170880 00000100:00100000:2.0:1784189245.164718:0:92397:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458170880 00000100:00100000:2.0:1784189245.164782:0:92397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1784189245.164791:0:92397:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc07cb56450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd553d0d-03e2-4233-b06b-b55bbfa2b954+21:6510:x1870854458170880:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1784189245.166360:0:92397:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc07cb56450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd553d0d-03e2-4233-b06b-b55bbfa2b954+21:6510:x1870854458170880:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 1564us (2051us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189245.166385:0:92397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1784189245.167949:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc05f02ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458170880:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1784189245.169143:0:92482:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 64768 count 14 00000020:01000000:1.0:1784189245.169793:0:6510:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 14-13 (rc=0) 10000000:01000000:1.0:1784189245.169818:0:6510:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:1.0:1784189245.169830:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff9dc0565e6800/0xcc1762b626f8be50 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc1762b626f8be57 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189245.169841:0:6510:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: ffff9dc0565e6800/0xcc1762b626f8be50 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc1762b626f8be57 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784189245.169851:0:6510:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1784189245.169854:0:6510:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9dc07b5d6800 from 7 10000000:01000000:1.0:1784189245.169856:0:6510:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1784189245.169895:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff9dc0565e7800/0xcc1762b626f8be5e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189245.169903:0:6510:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: ffff9dc0565e7800/0xcc1762b626f8be5e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189245.169928:0:6510:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: ffff9dc0565e7800/0xcc1762b626f8be5e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784189245.169953:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc05f02ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458171008:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1784189245.170016:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784189245.170088:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dc071b6a180 going to sleep for 11 seconds 00000100:00100000:2.0:1784189245.170130:0:92398:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458171008 00000100:00100000:2.0:1784189245.170136:0:92398:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458171008 00000100:00100000:2.0:1784189245.170209:0:92398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1784189245.170227:0:92398:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc07cb55450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd553d0d-03e2-4233-b06b-b55bbfa2b954+21:6510:x1870854458171008:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1784189245.170239:0:92398:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784189245.170252:0:92398:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dbf4369cc00/0xcc1762b626f8be65 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xcc1762b626f8be5e expref: -99 pid: 92398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189245.170274:0:92398:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dbf4369cc00/0xcc1762b626f8be65 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcc1762b626f8be5e expref: 22 pid: 92398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189245.170284:0:92398:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dbf4369cc00/0xcc1762b626f8be65 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcc1762b626f8be5e expref: 22 pid: 92398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189245.170293:0:92398:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dbf4369cc00, rc 0) 00000100:00100000:2.0:1784189245.170361:0:92398:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc07cb55450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd553d0d-03e2-4233-b06b-b55bbfa2b954+22:6510:x1870854458171008:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 135us (345us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189245.170368:0:92398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1784189245.170452:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc05f02ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458171008:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784189245.170485:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: ffff9dc0565e7800/0xcc1762b626f8be5e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc1762b626f8be65 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189245.170494:0:6510:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: ffff9dc0565e7800/0xcc1762b626f8be5e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xcc1762b626f8be65 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784189245.170549:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc07b5b3b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458171136:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1784189245.170578:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784189245.170895:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dbf45b9bc00 going to sleep for 11 seconds 00000100:00100000:1.0:1784189245.170934:0:92396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458171136 00000100:00100000:1.0:1784189245.170939:0:92396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458171136 00000100:00100000:1.0:1784189245.170964:0:92396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1784189245.170972:0:92396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc071342050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd553d0d-03e2-4233-b06b-b55bbfa2b954+22:6510:x1870854458171136:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1784189245.171088:0:92396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc071342050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd553d0d-03e2-4233-b06b-b55bbfa2b954+22:6510:x1870854458171136:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 117us (509us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189245.171095:0:92396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1784189245.171163:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc07b5b3b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458171136:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1784189245.171194:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc07b5b3b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458171264:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1784189245.171246:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784189245.171266:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dbf45b9bc00 going to sleep for 11 seconds 00000100:00100000:1.0:1784189245.171375:0:92396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458171264 00000100:00100000:1.0:1784189245.171379:0:92396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458171264 00000100:00100000:1.0:1784189245.171396:0:92396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1784189245.171401:0:92396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc07a90e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd553d0d-03e2-4233-b06b-b55bbfa2b954+22:6510:x1870854458171264:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1784189245.171488:0:92396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc07a90e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd553d0d-03e2-4233-b06b-b55bbfa2b954+22:6510:x1870854458171264:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 85us (241us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189245.171495:0:92396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1784189245.171769:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc07b5b3b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458171264:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1784189245.173116:0:92483:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:1.0:1784189245.173293:0:6510:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:1.0:1784189245.173332:0:6510:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1784189245.173344:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff9dc0565e7800/0xcc1762b626f8be5e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc1762b626f8be65 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189245.173355:0:6510:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: ffff9dc0565e7800/0xcc1762b626f8be5e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc1762b626f8be65 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784189245.173377:0:6510:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:1.0:1784189245.173380:0:6510:0:(mgc_request.c:1801:mgc_process_log()) Process log nodemap-ffff9dc06bb30000 from 1 10000000:01000000:1.0:1784189245.173382:0:6510:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:1.0:1784189245.173418:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff9dc0565e7600/0xcc1762b626f8be6c lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189245.173426:0:6510:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: ffff9dc0565e7600/0xcc1762b626f8be6c lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189245.173436:0:6510:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: ffff9dc0565e7600/0xcc1762b626f8be6c lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784189245.173459:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc05f02ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458171392:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1784189245.173533:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784189245.173565:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dc071b6a480 going to sleep for 11 seconds 00000100:00100000:1.0:1784189245.173582:0:92396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458171392 00000100:00100000:1.0:1784189245.173587:0:92396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458171392 00000100:00100000:1.0:1784189245.173837:0:92396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1784189245.173849:0:92396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc07a90cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd553d0d-03e2-4233-b06b-b55bbfa2b954+22:6510:x1870854458171392:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784189245.173862:0:92396:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784189245.173877:0:92396:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dc0565e7400/0xcc1762b626f8be73 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xcc1762b626f8be6c expref: -99 pid: 92396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189245.173901:0:92396:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dc0565e7400/0xcc1762b626f8be73 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcc1762b626f8be6c expref: 23 pid: 92396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189245.173911:0:92396:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dc0565e7400/0xcc1762b626f8be73 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcc1762b626f8be6c expref: 23 pid: 92396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189245.173935:0:92396:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc0565e7400, rc 0) 00000100:00100000:1.0:1784189245.173980:0:92396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc07a90cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd553d0d-03e2-4233-b06b-b55bbfa2b954+23:6510:x1870854458171392:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 133us (446us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189245.173987:0:92396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1784189245.174029:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc05f02ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458171392:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784189245.174042:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: ffff9dc0565e7600/0xcc1762b626f8be6c lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc1762b626f8be73 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189245.174050:0:6510:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: ffff9dc0565e7600/0xcc1762b626f8be6c lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcc1762b626f8be73 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784189245.174068:0:6510:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:1.0:1784189245.174071:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff9dc0565e7600/0xcc1762b626f8be6c lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc1762b626f8be73 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189245.174077:0:6510:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: ffff9dc0565e7600/0xcc1762b626f8be6c lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc1762b626f8be73 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784189245.174084:0:6510:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:1.0:1784189245.174085:0:6510:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-sptlrpc-ffff9dc06bb30000 from 1 10000000:01000000:1.0:1784189245.174088:0:6510:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1784189245.174103:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff9dc07116fc00/0xcc1762b626f8be7a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189245.174110:0:6510:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: ffff9dc07116fc00/0xcc1762b626f8be7a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189245.174117:0:6510:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: ffff9dc07116fc00/0xcc1762b626f8be7a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784189245.174136:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc05f02ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458171520:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1784189245.174163:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784189245.174182:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dc071b6a480 going to sleep for 11 seconds 00000100:00100000:1.0:1784189245.174193:0:92396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458171520 00000100:00100000:1.0:1784189245.174197:0:92396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458171520 00010000:00010000:0.0:1784189245.174392:0:26173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784189245.174554:0:92396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1784189245.174618:0:92396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc07a90d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd553d0d-03e2-4233-b06b-b55bbfa2b954+23:6510:x1870854458171520:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784189245.174753:0:92396:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784189245.174766:0:92396:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dc04152d600/0xcc1762b626f8be81 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xcc1762b626f8be7a expref: -99 pid: 92396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189245.174782:0:92396:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dc04152d600/0xcc1762b626f8be81 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcc1762b626f8be7a expref: 24 pid: 92396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189245.174790:0:92396:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dc04152d600/0xcc1762b626f8be81 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcc1762b626f8be7a expref: 24 pid: 92396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189245.174810:0:92396:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc04152d600, rc 0) 00000100:00100000:0.0:1784189245.174857:0:92396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc07a90d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd553d0d-03e2-4233-b06b-b55bbfa2b954+24:6510:x1870854458171520:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 295us (693us total) trans 0 rc 0/0 00000100:00100000:0.0:1784189245.174863:0:92396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1784189245.174933:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc05f02ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458171520:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784189245.174946:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: ffff9dc07116fc00/0xcc1762b626f8be7a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc1762b626f8be81 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189245.174953:0:6510:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: ffff9dc07116fc00/0xcc1762b626f8be7a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0xcc1762b626f8be81 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784189245.175014:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc05f02ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458171648:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1784189245.175044:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784189245.175075:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dc071b6a480 going to sleep for 11 seconds 00000100:00100000:2.0:1784189245.175120:0:92398:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458171648 00000100:00100000:2.0:1784189245.175126:0:92398:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458171648 00000100:00100000:2.0:1784189245.175168:0:92398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1784189245.175176:0:92398:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc07a90f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd553d0d-03e2-4233-b06b-b55bbfa2b954+24:6510:x1870854458171648:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1784189245.175430:0:92398:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc07a90f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd553d0d-03e2-4233-b06b-b55bbfa2b954+24:6510:x1870854458171648:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 254us (383us total) trans 0 rc -2/-2 00000100:00100000:2.0:1784189245.175437:0:92398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1784189245.175511:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc05f02ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458171648:0@lo:501:ll_cfg_requeue.0 10000000:01000000:1.0:1784189245.175537:0:6510:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1784189245.175543:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff9dc07116fc00/0xcc1762b626f8be7a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc1762b626f8be81 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189245.175551:0:6510:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: ffff9dc07116fc00/0xcc1762b626f8be7a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc1762b626f8be81 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784189245.744294:0:66179:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dc06bb569c0 going to sleep for 0 seconds 00000100:00100000:3.0:1784189245.999704:0:66178:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 2 min 2 max 256 00000100:00100000:1.0:1784189245.999704:0:75594:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dbf42691a80 going to sleep for 0 seconds 00000100:00100000:3.0:1784189245.999722:0:66178:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0002' 00010000:00010000:0.0:1784189246.192735:0:7454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784189246.769915:0:66179:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dc06bb569c0 going to sleep for 0 seconds 00000100:00100000:3.0:1784189247.032537:0:75594:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dbf42691a80 going to sleep for 0 seconds 00010000:00010000:1.0:1784189247.216593:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784189247.719727:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1784189247.719791:0:66169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436300160 00000100:00100000:2.0:1784189247.719800:0:66169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436300160 00000100:00100000:2.0:1784189247.719858:0:66169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1248 00000100:00100000:2.0:1784189247.719869:0:66169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc07b7e3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:debedd94-805c-42a0-a5e5-41758b2012e9+8:2397:x1870854436300160:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:2.0:1784189247.719936:0:66169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc07b7e3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:debedd94-805c-42a0-a5e5-41758b2012e9+8:2397:x1870854436300160:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 69us (218us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189247.719944:0:66169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1248 00000100:00080000:2.0:1784189247.719965:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1784189247.791430:0:66179:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dc06bb569c0 going to sleep for 0 seconds 00000100:00100000:1.0:1784189248.051314:0:75594:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dbf42691a80 going to sleep for 0 seconds 00010000:00010000:2.0:1784189248.242888:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784189248.559491:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc075f7d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1870854458171776:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1784189248.559562:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784189248.559639:0:9466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458171776 00000100:00100000:3.0:1784189248.559647:0:9466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458171776 00000100:00100000:3.0:1784189248.559702:0:9466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2010 00000100:00100000:3.0:1784189248.559711:0:9466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc075f7ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1870854458171776:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1784189248.559741:0:9466:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 211008 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1784189248.559786:0:9466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc075f7ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1870854458171776:12345-0@lo:13:osp-pre-1-1.0 Request processed in 76us (223us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189248.559794:0:9466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2010 00000100:00080000:3.0:1784189248.559813:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1784189248.559847:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc075f7d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1870854458171776:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1784189248.560450:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc05f02ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1870854458171904:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1784189248.560485:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784189248.560606:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458171904 00000100:00100000:0.0:1784189248.560613:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458171904 00000100:00100000:0.0:1784189248.560659:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2011 00000100:00100000:0.0:1784189248.560666:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc075f7d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1870854458171904:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1784189248.560686:0:8432:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 211008 pending 0 free 3922481152 avail 3690958848 00000100:00100000:0.0:1784189248.560723:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc075f7d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1870854458171904:12345-0@lo:13:osp-pre-0-1.0 Request processed in 58us (237us total) trans 0 rc 0/0 00000100:00100000:0.0:1784189248.560729:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2011 00000100:00080000:3.0:1784189248.560817:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1784189248.560845:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc05f02ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1870854458171904:0@lo:13:osp-pre-0-1.0 00000001:00100000:0.0:1784189248.572647:0:9506:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00100000:0.0:1784189248.572660:0:9506:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of debedd94-805c-42a0-a5e5-41758b2012e9 00000020:00000080:0.0:1784189248.572673:0:9506:0:(genops.c:906:class_export_put()) final put ffff9dc0477d1800/debedd94-805c-42a0-a5e5-41758b2012e9 00000020:00000080:1.0:1784189248.573868:0:63468:0:(genops.c:865:class_export_destroy()) destroying export ffff9dc0477d1800/debedd94-805c-42a0-a5e5-41758b2012e9 for lustre-OST0001 00000020:00000080:1.0:1784189248.573916:0:63468:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9dc0477d2000 for lustre-OST0001 00000001:00100000:3.0:1784189248.576022:0:8423:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00100000:3.0:1784189248.576035:0:8423:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of debedd94-805c-42a0-a5e5-41758b2012e9 00000020:00000080:3.0:1784189248.576039:0:8423:0:(genops.c:906:class_export_put()) final put ffff9dc06bb60800/debedd94-805c-42a0-a5e5-41758b2012e9 00000020:00000080:0.0:1784189248.577459:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9dc06bb60800/debedd94-805c-42a0-a5e5-41758b2012e9 for lustre-OST0000 00000020:00000080:0.0:1784189248.577516:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9dc0477d1000 for lustre-OST0000 00000001:02000400:3.0:1784189248.798374:0:92674:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg312-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:1.0:1784189248.815423:0:66179:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dc06bb569c0 going to sleep for 0 seconds 00000100:00100000:1.0:1784189249.079506:0:75594:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dbf42691a80 going to sleep for 0 seconds 00010000:00010000:0.0:1784189249.263483:0:26173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1784189249.585093:0:63468:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1784189249.585099:0:63468:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1784189249.585103:0:63468:0:(import.c:65:import_set_state_nolock()) ffff9dbf42271800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1784189249.585115:0:63468:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9dbf42271800 using connection 192.168.203.112@tcp/0@lo 00000100:00100000:3.0:1784189249.585137:0:63468:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9dc075f7ca80 x1870854458172160/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1784189249.585163:0:63468:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1784189249.585166:0:63468:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1784189249.585168:0:63468:0:(import.c:65:import_set_state_nolock()) ffff9dbf425f4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1784189249.585172:0:63468:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9dbf425f4800 using connection 192.168.203.112@tcp/0@lo 00000100:00100000:3.0:1784189249.585183:0:63468:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9dbf44acb100 x1870854458172416/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1784189249.585204:0:63468:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1784189249.585206:0:63468:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1784189249.585208:0:63468:0:(import.c:65:import_set_state_nolock()) ffff9dbf436c4000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1784189249.585213:0:63468:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9dbf436c4000 using connection 192.168.203.112@tcp/0@lo 00000100:00100000:3.0:1784189249.585224:0:63468:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9dbf44c8aa00 x1870854458172672/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1784189249.585243:0:63468:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1784189249.585259:0:63468:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1784189249.585261:0:63468:0:(import.c:65:import_set_state_nolock()) ffff9dbf43690800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1784189249.585266:0:63468:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff9dbf43690800 using connection 192.168.203.112@tcp/0@lo 00000100:00100000:3.0:1784189249.585280:0:63468:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9dc080e62a00 x1870854458173056/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1784189249.585303:0:63468:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1784189249.585306:0:63468:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1784189249.585308:0:63468:0:(import.c:65:import_set_state_nolock()) ffff9dbf42276000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1784189249.585312:0:63468:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff9dbf42276000 using connection 192.168.203.112@tcp/0@lo 00000100:00100000:3.0:1784189249.585346:0:63468:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9dc080df1880 x1870854458173568/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1784189249.585387:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc075f7e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bd553d0d-03e2-4233-b06b-b55bbfa2b954:3640:1870854458172032:0@lo:400:kworker.0 00000100:00100000:3.0:1784189249.585455:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784189249.585489:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc05659df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1870854458172928:0@lo:400:kworker.0 00000100:00100000:3.0:1784189249.585515:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784189249.585549:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1784189249.585554:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc075f7dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3640:1870854458172288:0@lo:400:kworker.0 00000100:00100000:0.0:1784189249.585778:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc05653a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1870854458172800:0@lo:400:kworker.0 00000100:00100000:0.0:1784189249.585863:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784189249.585883:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc080df2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1870854458173440:0@lo:400:kworker.0 00000100:00100000:0.0:1784189249.585903:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784189249.585920:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1784189249.585925:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf44c88700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3643:1870854458172544:0@lo:400:kworker.0 00000100:00100000:3.0:1784189249.586093:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784189249.586112:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc080e62680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1870854458173184:0@lo:400:kworker.0 00000100:00100000:3.0:1784189249.586136:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784189249.586172:0:68287:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458172288 00000100:00100000:3.0:1784189249.586178:0:68287:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458172288 00000100:00100000:3.0:1784189249.586226:0:68287:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1249 00000100:00100000:3.0:1784189249.586234:0:68287:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc080df3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1870854458172288:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784189249.586278:0:68287:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc080df3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1870854458172288:12345-0@lo:400:kworker.0 Request processed in 44us (184us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189249.586291:0:68287:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1249 00000100:00100000:3.0:1784189249.586331:0:26492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458173184 00000100:00100000:3.0:1784189249.586334:0:26492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458173184 00000100:00100000:3.0:1784189249.586359:0:26492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3851 00000100:00100000:3.0:1784189249.586365:0:26492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc05eda8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3640:x1870854458173184:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784189249.586397:0:26492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc05eda8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3640:x1870854458173184:12345-0@lo:400:kworker.0 Request processed in 33us (260us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189249.586403:0:26492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3851 00000100:00080000:3.0:1784189249.586417:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1784189249.586446:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc075f7dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3640:1870854458172288:0@lo:400:kworker.0 00000100:00100000:3.0:1784189249.586455:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc080e62680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1870854458173184:0@lo:400:kworker.0 00000100:00100000:0.0:1784189249.586544:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784189249.586587:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc080e63480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1870854458173312:0@lo:400:kworker.0 00000100:00100000:0.0:1784189249.586614:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784189249.586638:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc075f7ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3639:1870854458172160:0@lo:38:kworker.0 00000100:00100000:0.0:1784189249.586669:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784189249.586687:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf44acb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3639:1870854458172416:0@lo:38:kworker.0 00000100:00100000:0.0:1784189249.586707:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784189249.586723:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf44c8aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3639:1870854458172672:0@lo:38:kworker.0 00000100:00100000:0.0:1784189249.586743:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784189249.586760:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc080e62a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3639:1870854458173056:0@lo:38:kworker.0 00000100:00100000:0.0:1784189249.586780:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784189249.586918:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc080df1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3639:1870854458173568:0@lo:38:kworker.0 00000100:00100000:0.0:1784189249.586942:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784189249.587047:0:92396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458172032 00000100:00100000:0.0:1784189249.587052:0:92396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458172032 00000100:00100000:0.0:1784189249.587080:0:92396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1784189249.587087:0:92396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc07a90f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd553d0d-03e2-4233-b06b-b55bbfa2b954+24:3640:x1870854458172032:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784189249.587122:0:92396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc07a90f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd553d0d-03e2-4233-b06b-b55bbfa2b954+24:3640:x1870854458172032:12345-0@lo:400:kworker.0 Request processed in 35us (1666us total) trans 0 rc 0/0 00000100:00100000:0.0:1784189249.587129:0:92396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1784189249.587159:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458172928 00000100:00100000:0.0:1784189249.587162:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458172928 00000100:00100000:0.0:1784189249.587183:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458172800 00000100:00100000:0.0:1784189249.587186:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458172800 00000100:00100000:0.0:1784189249.587200:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458173440 00000100:00100000:0.0:1784189249.587203:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458173440 00000100:00100000:0.0:1784189249.587237:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458173312 00000100:00100000:0.0:1784189249.587240:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458173312 00000100:00100000:0.0:1784189249.587262:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2512 00000100:00100000:0.0:1784189249.587268:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc080df3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1870854458172928:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784189249.587300:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc080df3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1870854458172928:12345-0@lo:400:kworker.0 Request processed in 33us (1784us total) trans 0 rc 0/0 00000100:00100000:0.0:1784189249.587306:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2512 00000100:00100000:0.0:1784189249.587339:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2513 00000100:00100000:0.0:1784189249.587346:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc07b5b3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1870854458172800:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784189249.587377:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc07b5b3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1870854458172800:12345-0@lo:400:kworker.0 Request processed in 33us (1515us total) trans 0 rc 0/0 00000100:00100000:0.0:1784189249.587384:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2513 00000100:00100000:0.0:1784189249.587400:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2514 00000100:00100000:0.0:1784189249.587405:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc07b5b0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1870854458173440:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784189249.587432:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc07b5b0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1870854458173440:12345-0@lo:400:kworker.0 Request processed in 27us (1528us total) trans 0 rc 0/0 00000100:00100000:0.0:1784189249.587437:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2514 00000100:00100000:0.0:1784189249.587446:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2515 00000100:00100000:0.0:1784189249.587452:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc07b5b1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1870854458173312:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784189249.587477:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc07b5b1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1870854458173312:12345-0@lo:400:kworker.0 Request processed in 25us (862us total) trans 0 rc 0/0 00000100:00100000:0.0:1784189249.587482:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2515 00000100:00100000:0.0:1784189249.587502:0:66169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458172544 00000100:00100000:0.0:1784189249.587505:0:66169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458172544 00000100:00100000:0.0:1784189249.587522:0:66169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458172160 00000100:00100000:0.0:1784189249.587524:0:66169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458172160 00000100:00100000:0.0:1784189249.587531:0:66169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458172416 00000100:00100000:0.0:1784189249.587540:0:66169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458172416 00000100:00100000:0.0:1784189249.587550:0:66169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458173056 00000100:00100000:0.0:1784189249.587552:0:66169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458173056 00000100:00100000:0.0:1784189249.587558:0:66169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458173568 00000100:00100000:0.0:1784189249.587560:0:66169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458173568 00000100:00100000:0.0:1784189249.587579:0:66169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1250 00000100:00100000:0.0:1784189249.587585:0:66169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc07b5b2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1870854458172544:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784189249.587614:0:66169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc07b5b2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1870854458172544:12345-0@lo:400:kworker.0 Request processed in 30us (1070us total) trans 0 rc 0/0 00000100:00100000:0.0:1784189249.587619:0:66169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1250 00000100:00100000:0.0:1784189249.587630:0:66169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1339 00000100:00100000:0.0:1784189249.587634:0:66169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc07b5b3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3639:x1870854458172160:12345-0@lo:38:kworker.0 00000100:00100000:1.0:1784189249.587850:0:23826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458172672 00000100:00100000:1.0:1784189249.587855:0:23826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458172672 00000100:00100000:1.0:1784189249.587878:0:23826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3852 00000100:00100000:1.0:1784189249.587883:0:23826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc07b5b1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3639:x1870854458172672:12345-0@lo:38:kworker.0 00010000:00080000:1.0:1784189249.587899:0:23826:0:(ldlm_lib.c:938:target_handle_reconnect()) connect export for UUID 'lustre-MDT0001-mdtlov_UUID' at ffff9dc06b3eb000, cookie 0xcc1762b626f8bd0e 00010000:00080000:1.0:1784189249.587903:0:23826:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo recovering/t77309411356 exp ffff9dc06b3eb000 cur 3491 last 1784189244 00000004:00100000:1.0:1784189249.587919:0:23826:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1784189249.588054:0:23826:0:(import.c:65:import_set_state_nolock()) ffff9dc0477d1800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1784189249.588103:0:23826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc07b5b1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3639:x1870854458172672:12345-0@lo:38:kworker.0 Request processed in 219us (1358us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189249.588110:0:23826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3852 00000100:00100000:1.0:1784189249.588131:0:66170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1340 00000100:00100000:1.0:1784189249.588135:0:66170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc07b5b3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3639:x1870854458172416:12345-0@lo:38:kworker.0 00010000:00080000:1.0:1784189249.588148:0:66170:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo recovering/t0 exp 0000000000000000 cur 3491 last 0 00000020:00000080:1.0:1784189249.588175:0:66170:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0xcc1762b626f8be88 00000004:00100000:1.0:1784189249.588181:0:66170:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1784189249.588471:0:66170:0:(import.c:65:import_set_state_nolock()) ffff9dc0477d2000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1784189249.588503:0:66170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc07b5b3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3639:x1870854458172416:12345-0@lo:38:kworker.0 Request processed in 367us (1795us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189249.588509:0:66170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1340 00000100:00100000:1.0:1784189249.588533:0:66170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1341 00000100:00100000:1.0:1784189249.588536:0:66170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc07b5b0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3639:x1870854458173056:12345-0@lo:38:kworker.0 00010000:00080000:1.0:1784189249.588551:0:66170:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0001_UUID@0@lo recovering/t0 exp 0000000000000000 cur 3491 last 0 00000020:00000080:1.0:1784189249.588586:0:66170:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001_UUID, cookie 0xcc1762b626f8be8f 00000004:00100000:1.0:1784189249.588593:0:66170:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1784189249.588608:0:66170:0:(import.c:65:import_set_state_nolock()) ffff9dbf46d3d800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1784189249.588635:0:66170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc07b5b0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1870854458173056:12345-0@lo:38:kworker.0 Request processed in 97us (1854us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189249.588642:0:66170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1341 00000100:00100000:1.0:1784189249.588654:0:66170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1342 00000100:00100000:1.0:1784189249.588841:0:66170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc07b5b0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3639:x1870854458173568:12345-0@lo:38:kworker.0 00010000:00080000:1.0:1784189249.588856:0:66170:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo recovering/t0 exp 0000000000000000 cur 3491 last 0 00000020:00000080:1.0:1784189249.588878:0:66170:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0xcc1762b626f8be96 00000004:00100000:1.0:1784189249.588884:0:66170:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1784189249.588896:0:66170:0:(import.c:65:import_set_state_nolock()) ffff9dbf46d3f800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1784189249.588924:0:66170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc07b5b0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1870854458173568:12345-0@lo:38:kworker.0 Request processed in 83us (1981us total) trans 0 rc 0/0 00010000:00080000:0.0:1784189249.588990:0:66169:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo recovering/t0 exp 0000000000000000 cur 3491 last 0 00000020:00000080:0.0:1784189249.589015:0:66169:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0xcc1762b626f8be9d 00000004:00100000:0.0:1784189249.589021:0:66169:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1784189249.589036:0:66169:0:(import.c:65:import_set_state_nolock()) ffff9dc07b5d0000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1784189249.589066:0:66169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc07b5b3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1870854458172160:12345-0@lo:38:kworker.0 Request processed in 1430us (2396us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189249.589134:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc075f7e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bd553d0d-03e2-4233-b06b-b55bbfa2b954:3640:1870854458172032:0@lo:400:kworker.0 00000100:00100000:3.0:1784189249.589149:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc05659df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1870854458172928:0@lo:400:kworker.0 00000100:00080000:3.0:1784189249.589185:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1784189249.589190:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1784189249.589193:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1784189249.592025:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1784189249.592048:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc05eda9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1870854458173696:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1784189249.592121:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784189249.592167:0:26492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458173696 00000100:00100000:3.0:1784189249.592174:0:26492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458173696 00000100:00100000:3.0:1784189249.592232:0:26492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3853 00000100:00100000:3.0:1784189249.592240:0:26492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc07cb4cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3641:x1870854458173696:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1784189249.592277:0:26492:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445568512 avail 1299329024 00000100:00100000:3.0:1784189249.592351:0:26492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc07cb4cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3641:x1870854458173696:12345-0@lo:41:osp-pre-1-0.0 Request processed in 111us (229us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189249.592368:0:26492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3853 00000100:00100000:3.0:1784189249.593108:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc05eda9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1870854458173696:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1784189249.593300:0:66170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1342 00000100:00100000:1.0:1784189249.594118:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf44c88700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3643:1870854458172544:0@lo:400:kworker.0 00000100:00100000:1.0:1784189249.594140:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc080e63480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1870854458173312:0@lo:400:kworker.0 00000100:00100000:1.0:1784189249.594152:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc05653a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1870854458172800:0@lo:400:kworker.0 00000100:00100000:1.0:1784189249.594166:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc080df2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1870854458173440:0@lo:400:kworker.0 00010000:00080000:1.0:1784189249.594221:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dc075f7ca80 x1870854458172160/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1784189274 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1784189249.594249:0:3639:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 27 00010000:00080000:2.0:1784189249.595380:0:92422:0:(ldlm_lib.c:2545:check_for_recovery_ready()) connected 2 stale 0 max_recoverable_clients 2 abort 0 expired 0 00010000:00080000:2.0:1784189249.595389:0:92422:0:(ldlm_lib.c:2683:replay_request_or_update()) Waiting for transno 111669149700 00000020:00080000:2.0:1784189249.595395:0:92422:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1784189249.595399:0:92422:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 111669149700 00000020:00080000:2.0:1784189249.595402:0:92422:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1784189249.595404:0:92422:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 111669149700 00000100:00080000:1.0:1784189249.598165:0:3639:0:(import.c:1328:ptlrpc_connect_interpret()) @@@ lustre-MDT0000-lwp-OST0000: lwp recover req@ffff9dc075f7ca80 x1870854458172160/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1784189274 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1784189249.598178:0:3639:0:(import.c:65:import_set_state_nolock()) ffff9dbf42271800 lustre-MDT0000_UUID: changing import state from CONNECTING to RECOVER 00000100:00080000:1.0:1784189249.598183:0:3639:0:(import.c:65:import_set_state_nolock()) ffff9dbf42271800 lustre-MDT0000_UUID: changing import state from RECOVER to FULL 00000100:02000000:1.0:1784189249.598187:0:3639:0:(import.c:1743:ptlrpc_import_recovery_state_machine()) lustre-MDT0000-lwp-OST0000: Connection restored to 0@lo (at 0@lo) 00000100:00100000:1.0:1784189249.598193:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc075f7ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3639:1870854458172160:0@lo:38:kworker.0 00010000:00080000:1.0:1784189249.598227:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dbf44acb100 x1870854458172416/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1784189274 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1784189249.598244:0:3639:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 27 00000001:00100000:3.0:1784189249.600448:0:75588:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:0.0:1784189249.600645:0:66169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1339 00000100:00080000:1.0:1784189249.602444:0:3639:0:(import.c:1328:ptlrpc_connect_interpret()) @@@ lustre-MDT0000-lwp-OST0001: lwp recover req@ffff9dbf44acb100 x1870854458172416/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1784189274 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1784189249.602458:0:3639:0:(import.c:65:import_set_state_nolock()) ffff9dbf425f4800 lustre-MDT0000_UUID: changing import state from CONNECTING to RECOVER 00000100:00080000:1.0:1784189249.602464:0:3639:0:(import.c:65:import_set_state_nolock()) ffff9dbf425f4800 lustre-MDT0000_UUID: changing import state from RECOVER to FULL 00000100:02000000:1.0:1784189249.602468:0:3639:0:(import.c:1743:ptlrpc_import_recovery_state_machine()) lustre-MDT0000-lwp-OST0001: Connection restored to 0@lo (at 0@lo) 00000100:00100000:1.0:1784189249.602475:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf44acb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3639:1870854458172416:0@lo:38:kworker.0 00000100:00080000:1.0:1784189249.602517:0:3639:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-osp-MDT0001: connect to target with instance 27 00000100:00080000:1.0:1784189249.602528:0:3639:0:(import.c:65:import_set_state_nolock()) ffff9dbf436c4000 lustre-MDT0000_UUID: changing import state from CONNECTING to REPLAY 00000100:00080000:1.0:1784189249.602532:0:3639:0:(import.c:1700:ptlrpc_import_recovery_state_machine()) replay requested by lustre-MDT0000_UUID 00000100:00100000:1.0:1784189249.602535:0:3639:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 111669149699 gen 3 00000100:00080000:1.0:1784189249.602538:0:3639:0:(recover.c:53:ptlrpc_replay_next()) import ffff9dbf436c4000 from lustre-MDT0000_UUID committed 111669149699 last 0 00000100:00080000:1.0:1784189249.602541:0:3639:0:(import.c:65:import_set_state_nolock()) ffff9dbf436c4000 lustre-MDT0000_UUID: changing import state from REPLAY to REPLAY_LOCKS 00000100:00100000:3.0:1784189249.604686:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf44c8aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3639:1870854458172672:0@lo:38:kworker.0 00010000:00080000:3.0:1784189249.604725:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dc080e62a00 x1870854458173056/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1784189274 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1784189249.604741:0:3639:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0001: connect to target with instance 27 00010000:00080000:0.0:1784189249.605748:0:92709:0:(ldlm_request.c:2972:ldlm_lock_replay_thread()) lock replay thread lustre-MDT0000-osp-MDT0001 to lustre-MDT0000_UUID@0@lo 00010000:00010000:0.0:1784189249.605754:0:92709:0:(ldlm_request.c:2888:ldlm_cancel_unused_locks_for_replay()) Dropping as many unused locks as possible before replay for namespace lustre-MDT0000-osp-MDT0001 (0) 00010000:00010000:0.0:1784189249.605759:0:92709:0:(ldlm_request.c:2901:ldlm_cancel_unused_locks_for_replay()) Canceled 0 unused locks from namespace lustre-MDT0000-osp-MDT0001 00000100:00080000:3.0:1784189249.606421:0:3639:0:(import.c:1328:ptlrpc_connect_interpret()) @@@ lustre-MDT0000-lwp-MDT0001: lwp recover req@ffff9dc080e62a00 x1870854458173056/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1784189274 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1784189249.606434:0:3639:0:(import.c:65:import_set_state_nolock()) ffff9dbf43690800 lustre-MDT0000_UUID: changing import state from CONNECTING to RECOVER 00000100:00080000:3.0:1784189249.606440:0:3639:0:(import.c:65:import_set_state_nolock()) ffff9dbf43690800 lustre-MDT0000_UUID: changing import state from RECOVER to FULL 00000100:02000000:3.0:1784189249.606444:0:3639:0:(import.c:1743:ptlrpc_import_recovery_state_machine()) lustre-MDT0000-lwp-MDT0001: Connection restored to 0@lo (at 0@lo) 00000100:00080000:3.0:1784189249.606450:0:3639:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 00000000c4137496): req@ffff9dbf4a340700 x1870854458160000/t0(0) o700->lustre-MDT0000-lwp-MDT0001@0@lo:32/10 lens 264/248 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'mdt_seqm_0001.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784189249.606471:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc080e62a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3639:1870854458173056:0@lo:38:kworker.0 00010000:00080000:3.0:1784189249.606509:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dc080df1880 x1870854458173568/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1784189259 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1784189249.606523:0:3639:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 27 00000100:00080000:3.0:1784189249.606530:0:3639:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:3.0:1784189249.606534:0:3639:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1784189249.606536:0:3639:0:(import.c:65:import_set_state_nolock()) ffff9dbf42276000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1784189249.606540:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc080df1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3639:1870854458173568:0@lo:38:kworker.0 00000100:00080000:0.0:1784189249.606903:0:92709:0:(import.c:65:import_set_state_nolock()) ffff9dbf436c4000 lustre-MDT0000_UUID: changing import state from REPLAY_LOCKS to REPLAY_WAIT 00000100:00100000:1.0:1784189249.608213:0:66179:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784189249.608258:0:66179:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dc06bb569c0 going to sleep for 11 seconds 00000100:00100000:0.0:1784189249.608354:0:66176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458160000 00000100:00100000:0.0:1784189249.608362:0:66176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458160000 00000100:00100000:0.0:1784189249.608405:0:66176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1784189249.608415:0:66176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc05f02e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:66179:x1870854458160000:12345-0@lo:700:mdt_seqm_0001.0 00010000:00080000:0.0:1784189249.608440:0:66176:0:(ldlm_lib.c:3211:target_queue_recovery_request()) @@@ not queueing req@ffff9dc05f02e680 x1870854458160000/t0(0) o700->lustre-MDT0000-lwp-MDT0001_UUID@0@lo:440/0 lens 264/0 e 0 to 0 dl 1784189260 ref 1 fl Interpret:/200/ffffffff rc 0/-1 job:'mdt_seqm_0001.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784189249.609795:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc07b5b1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3639:1870854458173824:0@lo:400:ldlm_lock_repla.0 00000100:00100000:3.0:1784189249.609867:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784189249.610510:0:23826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458173824 00000100:00100000:0.0:1784189249.610517:0:23826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458173824 00000100:00100000:0.0:1784189249.610624:0:23826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3854 00000100:00100000:0.0:1784189249.610633:0:23826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc05eda9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3639:x1870854458173824:12345-0@lo:400:ldlm_lock_repla.0 00010000:00080000:0.0:1784189249.610654:0:23826:0:(ldlm_lib.c:3137:target_queue_recovery_request()) @@@ queue final req req@ffff9dc05eda9f80 x1870854458173824/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:440/0 lens 224/0 e 0 to 0 dl 1784189260 ref 2 fl Interpret:/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784189249.610748:0:23826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc05eda9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3639:x1870854458173824:12345-0@lo:400:ldlm_lock_repla.0 Request processed in 115us (880us total) trans 0 rc 0/-999 00000100:00100000:0.0:1784189249.610755:0:23826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3854 00000020:00080000:1.0:1784189249.623246:0:92422:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1784189249.623256:0:92422:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 2, connected: 2, completed: 2, queue_len: 0, req_transno: 0, next_transno: 111669149700 00010000:00080000:1.0:1784189249.623261:0:92422:0:(ldlm_lib.c:2262:check_for_next_transno()) waking for completed recovery 00000020:00080000:1.0:1784189249.623264:0:92422:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1784189249.623272:0:92422:0:(ldlm_lib.c:2452:target_next_replay_lock()) Waiting for lock 00010000:00080000:1.0:1784189249.623293:0:92422:0:(ldlm_lib.c:2282:check_for_next_lock()) waking for next lock 00010000:00080000:1.0:1784189249.623308:0:92422:0:(ldlm_lib.c:2888:target_recovery_thread()) @@@ processing lock from 192.168.203.12@tcp: req@ffff9dc07b5b2a00 x1870854436300032/t0(0) o101->debedd94-805c-42a0-a5e5-41758b2012e9@192.168.203.12@tcp:435/0 lens 328/0 e 0 to 0 dl 1784189255 ref 1 fl Complete:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00010000:1.0:1784189249.623360:0:92422:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784189249.623396:0:92422:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc07116e600/0xcc1762b626f8bea4 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbfc5de7fe6c3f52 expref: -99 pid: 92422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189249.623424:0:92422:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc07116e600/0xcc1762b626f8bea4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c3f52 expref: 7 pid: 92422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189249.623440:0:92422:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc07116e600/0xcc1762b626f8bea4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c3f52 expref: 7 pid: 92422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189249.623448:0:92422:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc07116e600, rc 0) 00010000:00080000:1.0:1784189249.623516:0:92422:0:(ldlm_lib.c:2100:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 101 seconds 00010000:00080000:1.0:1784189249.623529:0:92422:0:(ldlm_lib.c:2452:target_next_replay_lock()) Waiting for lock 40000000:02000000:1.0:1784189249.638041:0:66176:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000300000400-0x0000000340000400]:1:mdt 00000100:00100000:2.0:1784189249.642077:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1784189249.642128:0:66945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436300288 00000100:00100000:2.0:1784189249.642137:0:66945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436300288 00000100:00100000:2.0:1784189249.642192:0:66945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1251 00000100:00100000:2.0:1784189249.642202:0:66945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc07b7e0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:debedd94-805c-42a0-a5e5-41758b2012e9+7:2395:x1870854436300288:12345-192.168.203.12@tcp:400:ptlrpcd_rcv.0 00010000:00080000:2.0:1784189249.642222:0:66945:0:(ldlm_lib.c:3137:target_queue_recovery_request()) @@@ queue final req req@ffff9dc07b7e0000 x1870854436300288/t0(0) o400->debedd94-805c-42a0-a5e5-41758b2012e9@192.168.203.12@tcp:440/0 lens 224/0 e 0 to 0 dl 1784189260 ref 2 fl Interpret:H/2c0/ffffffff rc 0/-1 job:'ptlrpcd_rcv.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784189249.642239:0:66945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc07b7e0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:debedd94-805c-42a0-a5e5-41758b2012e9+7:2395:x1870854436300288:12345-192.168.203.12@tcp:400:ptlrpcd_rcv.0 Request processed in 40us (173us total) trans 0 rc 0/-999 00000100:00100000:2.0:1784189249.642246:0:66945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1251 00010000:00080000:2.0:1784189249.642262:0:92422:0:(ldlm_lib.c:2285:check_for_next_lock()) waking for completed lock replay 00000001:00000004:2.0:1784189249.642396:0:92422:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 27, last_transno is 115964116992 00000100:00100000:1.0:1784189249.654113:0:66176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc05f02e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:66179:x1870854458160000:12345-0@lo:700:mdt_seqm_0001.0 Request processed in 45688us (45893us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189249.654134:0:66176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1784189249.654666:0:66179:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf4a340700 pname:cluuid:pid:xid:nid:opc:job mdt_seqm_0001:lustre-MDT0000-lwp-MDT0001_UUID:66179:1870854458160000:0@lo:700:mdt_seqm_0001.0 40000000:02000000:3.0:1784189249.654680:0:66179:0:(fid_request.c:122:seq_client_rpc()) cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000300000400-0x0000000340000400]:1:mdt] 00000001:00100000:0.0:1784189249.662436:0:92391:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of debedd94-805c-42a0-a5e5-41758b2012e9 00000001:00100000:0.0:1784189249.662446:0:92391:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000001:00080000:0.0:1784189249.662488:0:92422:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00010000:00080000:0.0:1784189249.662527:0:92422:0:(ldlm_lib.c:1996:target_cancel_recovery_timer()) lustre-MDT0000: cancel recovery timer 00010000:00080000:0.0:1784189249.662541:0:92422:0:(ldlm_lib.c:2940:target_recovery_thread()) @@@ processing final ping from 0@lo: req@ffff9dc05eda9f80 x1870854458173824/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:440/0 lens 224/0 e 0 to 0 dl 1784189260 ref 1 fl Complete:/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00080000:0.0:1784189249.662772:0:92422:0:(ldlm_lib.c:2940:target_recovery_thread()) @@@ processing final ping from 192.168.203.12@tcp: req@ffff9dc07b7e0000 x1870854436300288/t0(0) o400->debedd94-805c-42a0-a5e5-41758b2012e9@192.168.203.12@tcp:440/0 lens 224/0 e 0 to 0 dl 1784189260 ref 1 fl Complete:H/2c0/ffffffff rc 0/-1 job:'ptlrpcd_rcv.0' uid:0 gid:0 projid:4294967295 00010000:02000000:0.0:1784189249.662828:0:92422:0:(ldlm_lib.c:1868:target_finish_recovery()) lustre-MDT0000: Recovery over after 0:05, of 2 clients 2 recovered and 0 were evicted. 00000100:00080000:3.0:1784189249.665140:0:3639:0:(import.c:65:import_set_state_nolock()) ffff9dbf436c4000 lustre-MDT0000_UUID: changing import state from REPLAY_WAIT to RECOVER 00000100:00080000:3.0:1784189249.665155:0:3639:0:(client.c:3234:ptlrpc_resend_req()) @@@ going to resend req@ffff9dc07b5b1c00 x1870854458173824/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1784189265 ref 1 fl Interpret:RQU/2c0/0 rc 0/0 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1784189249.665165:0:3639:0:(client.c:3243:ptlrpc_resend_req()) @@@ it has reply, so skip it req@ffff9dc07b5b1c00 x1870854458173824/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1784189265 ref 1 fl Interpret:RQU/2c0/0 rc 0/0 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1784189249.665171:0:3639:0:(import.c:65:import_set_state_nolock()) ffff9dbf436c4000 lustre-MDT0000_UUID: changing import state from RECOVER to FULL 00000100:02000000:3.0:1784189249.665188:0:3639:0:(import.c:1743:ptlrpc_import_recovery_state_machine()) lustre-MDT0000-osp-MDT0001: Connection restored to 0@lo (at 0@lo) 00000100:00080000:3.0:1784189249.665194:0:3639:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 00000000279ad887): req@ffff9dbf43e12300 x1870854458158208/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'osp_up0-1.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1784189249.665211:0:3639:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 00000000df863fab): req@ffff9dbf469b7100 x1870854458156544/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1784189246 ref 1 fl Rpc:RSQU/200/0 rc -107/-107 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784189249.665231:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc07b5b1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3639:1870854458173824:0@lo:400:ldlm_lock_repla.0 00000100:00100000:3.0:1784189249.665416:0:75594:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784189249.665439:0:75594:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dbf42691a80 going to sleep for 11 seconds 00000100:00100000:3.0:1784189249.665454:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc05edaad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1870854458173952:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1784189249.665474:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784189249.665512:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458158208 00000100:00100000:3.0:1784189249.665518:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458158208 00000100:00100000:3.0:1784189249.665550:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458173952 00000100:00100000:3.0:1784189249.665553:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458173952 00000100:00100000:3.0:1784189249.665586:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3855 00000100:00100000:3.0:1784189249.665594:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc05edaaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:75594:x1870854458158208:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:3.0:1784189249.665796:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3856 00000100:00100000:3.0:1784189249.665805:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc05eda8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3641:x1870854458173952:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1784189249.665826:0:8439:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445277696 avail 1299038208 00000100:00100000:3.0:1784189249.665873:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc05eda8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3641:x1870854458173952:12345-0@lo:41:osp-pre-0-1.0 Request processed in 68us (396us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189249.665879:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3856 00000100:00100000:3.0:1784189249.665916:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc05edaad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1870854458173952:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1784189249.666021:0:66179:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf464adf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0001:debedd94-805c-42a0-a5e5-41758b2012e9+7:71032:x1870854436296192:12345-192.168.203.12@tcp:700:cp.0 Request processed in 10048862us (10051887us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189249.666030:0:66179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 14 00000100:00100000:1.0:1784189249.667730:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784189249.669835:0:23826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458156544 00000100:00100000:1.0:1784189249.669848:0:23826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458156544 00000100:00100000:1.0:1784189249.669904:0:23826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3857 00000100:00100000:1.0:1784189249.669913:0:23826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc05f02dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3643:x1870854458156544:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1784189249.669942:0:23826:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445277696 avail 1299038208 00000100:00100000:1.0:1784189249.670008:0:23826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc05f02dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3643:x1870854458156544:12345-0@lo:41:osp-pre-0-1.0 Request processed in 96us (2281us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189249.670015:0:23826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3857 00000100:00100000:1.0:1784189249.670068:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf469b7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1870854458156544:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1784189249.673162:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc05edaaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:75594:x1870854458158208:12345-0@lo:1000:osp_up0-1.0 Request processed in 7561us (7739us total) trans 115964116993 rc 0/0 00000100:00100000:3.0:1784189249.673176:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3855 00000100:00100000:3.0:1784189249.673238:0:75594:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf43e12300 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:75594:1870854458158208:0@lo:1000:osp_up0-1.0 00000100:00100000:2.0:1784189249.681902:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1784189249.687435:0:66171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436300544 00000100:00100000:1.0:1784189249.687448:0:66171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436300544 00000100:00100000:1.0:1784189249.687522:0:66171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1343 00000100:00100000:1.0:1784189249.687533:0:66171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc07b7e1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:debedd94-805c-42a0-a5e5-41758b2012e9+7:71032:x1870854436300544:12345-192.168.203.12@tcp:101:cp.0 00010000:00010000:1.0:1784189249.687552:0:66171:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784189249.687588:0:66171:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9dc07116ec00/0xcc1762b626f8beab lrc: 2/0,0 mode: --/CW res: [0x240006991:0xc:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbfc5de7fe6c3f7c expref: -99 pid: 66171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1784189249.687784:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:1.0:1784189249.687834:0:66171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9dc07116e200/0xcc1762b626f8beb2 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189249.687843:0:66171:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff9dc07116e200/0xcc1762b626f8beb2 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x0 pid: 66171 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189249.687852:0:66171:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff9dc07116e200/0xcc1762b626f8beb2 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 66171 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784189249.687874:0:66171:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc05f02c700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:66171:1870854458174080:0@lo:101:mdt00_002.0 00000100:00100000:1.0:1784189249.687936:0:66171:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784189249.687995:0:66171:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dc050e11840 going to sleep for 11 seconds 00000100:00100000:2.0:1784189249.694846:0:23826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458174080 00000100:00100000:2.0:1784189249.694861:0:23826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458174080 00000100:00100000:2.0:1784189249.694921:0:23826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3858 00000100:00100000:2.0:1784189249.694931:0:23826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc05f02df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:66171:x1870854458174080:12345-0@lo:101:mdt00_002.0 00010000:00010000:2.0:1784189249.694954:0:23826:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784189249.694980:0:23826:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4369dc00/0xcc1762b626f8beb9 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcc1762b626f8beb2 expref: -99 pid: 23826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189249.695007:0:23826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4369dc00/0xcc1762b626f8beb9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xcc1762b626f8beb2 expref: 8 pid: 23826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189249.695022:0:23826:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4369dc00/0xcc1762b626f8beb9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xcc1762b626f8beb2 expref: 8 pid: 23826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189249.695030:0:23826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9dc0630a6700) 00010000:00010000:2.0:1784189249.695032:0:23826:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1784189249.695036:0:23826:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dbf4369dc00, rc 0) 00000100:00100000:2.0:1784189249.695106:0:23826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc05f02df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:66171:x1870854458174080:12345-0@lo:101:mdt00_002.0 Request processed in 177us (7169us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189249.695112:0:23826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3858 00000100:00100000:2.0:1784189249.695164:0:66171:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc05f02c700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:66171:1870854458174080:0@lo:101:mdt00_002.0 00010000:00010000:2.0:1784189249.695181:0:66171:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff9dc07116e200/0xcc1762b626f8beb2 lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xcc1762b626f8beb9 expref: -99 pid: 66171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189249.695191:0:66171:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9dc07116e200/0xcc1762b626f8beb2 lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xcc1762b626f8beb9 expref: -99 pid: 66171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1784189249.695225:0:66171:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00010000:00010000:2.0:1784189249.695233:0:66171:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9dc07116e200/0xcc1762b626f8beb2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xcc1762b626f8beb9 expref: -99 pid: 66171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189249.695240:0:66171:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-osp-MDT0001 lock: ffff9dc07116e200/0xcc1762b626f8beb2 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xcc1762b626f8beb9 expref: -99 pid: 66171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189249.695302:0:66171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9dbf4369c400/0xcc1762b626f8bec0 lrc: 3/0,1 mode: --/CW res: [0x240006991:0xc:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189249.695311:0:66171:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9dbf4369c400/0xcc1762b626f8bec0 lrc: 3/0,1 mode: CW/CW res: [0x240006991:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66171 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189249.695338:0:66171:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9dbf4369c400/0xcc1762b626f8bec0 lrc: 3/0,1 mode: CW/CW res: [0x240006991:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66171 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189249.695352:0:66171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9dbf4369da00/0xcc1762b626f8bec7 lrc: 3/0,1 mode: --/PW res: [0x240006991:0xc:0x0].0xb1bed465 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189249.695359:0:66171:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9dbf4369da00/0xcc1762b626f8bec7 lrc: 3/0,1 mode: PW/PW res: [0x240006991:0xc:0x0].0xb1bed465 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66171 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189249.695366:0:66171:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9dbf4369da00/0xcc1762b626f8bec7 lrc: 3/0,1 mode: PW/PW res: [0x240006991:0xc:0x0].0xb1bed465 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66171 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784189249.695501:0:66171:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc07b7e3800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:66171:1870854458174208:0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1784189249.695539:0:66171:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784189249.695561:0:66171:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dbf44cbc540 going to sleep for 11 seconds 00000100:00100000:2.0:1784189249.695588:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458174208 00000100:00100000:2.0:1784189249.695598:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458174208 00000100:00100000:2.0:1784189249.695627:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3859 00000100:00100000:2.0:1784189249.695634:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc07b7e2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:66171:x1870854458174208:12345-0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1784189249.697882:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc07b7e2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:66171:x1870854458174208:12345-0@lo:1000:mdt00_002.0 Request processed in 2239us (2333us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189249.697897:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3859 00000100:00100000:3.0:1784189249.698114:0:66171:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc07b7e3800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:66171:1870854458174208:0@lo:1000:mdt00_002.0 00000004:00080000:3.0:1784189249.698974:0:66171:0:(osp_internal.h:570:osp_update_last_fid()) Gap in objids: start=[0x280000400:0xd1:0x0], count =369 00000004:00080000:3.0:1784189249.698984:0:66171:0:(osp_object.c:1645:osp_create()) Writing gap [0x280000400:0xd1:0x0]+369 in llog 00000004:00080000:3.0:1784189249.699002:0:66171:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0x242:0x0], index 0: 0 00010000:00010000:3.0:1784189249.699178:0:66171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9dc0755a5c00/0xcc1762b626f8bece lrc: 3/1,0 mode: --/PR res: [0x2400090a5:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189249.699194:0:66171:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9dc0755a5c00/0xcc1762b626f8bece lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x1:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66171 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189249.699205:0:66171:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9dc0755a5c00/0xcc1762b626f8bece lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x1:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66171 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189249.699251:0:66171:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9dbf4369c400/0xcc1762b626f8bec0 lrc: 4/0,1 mode: CW/CW res: [0x240006991:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66171 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189249.699258:0:66171:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9dbf4369c400/0xcc1762b626f8bec0 lrc: 4/0,1 mode: CW/CW res: [0x240006991:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66171 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189249.699264:0:66171:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9dbf4369c400/0xcc1762b626f8bec0 lrc: 3/0,0 mode: CW/CW res: [0x240006991:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66171 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189249.699270:0:66171:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9dbf4369c400/0xcc1762b626f8bec0 lrc: 4/0,0 mode: CW/CW res: [0x240006991:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66171 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189249.699276:0:66171:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dbf4369c400 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:3.0:1784189249.699279:0:66171:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9dbf4369c400/0xcc1762b626f8bec0 lrc: 4/0,0 mode: CW/CW res: [0x240006991:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66171 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189249.699286:0:66171:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9dbf4369c400/0xcc1762b626f8bec0 lrc: 5/0,0 mode: CW/CW res: [0x240006991:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66171 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189249.699298:0:66171:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240006991:0xc:0x0].0x0 (ffff9dc074ae2200) 00010000:00010000:3.0:1784189249.699301:0:66171:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784189249.699305:0:66171:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9dbf4369c400/0xcc1762b626f8bec0 lrc: 3/0,0 mode: --/CW res: [0x240006991:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66171 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189249.699310:0:66171:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9dbf4369c400/0xcc1762b626f8bec0 lrc: 0/0,0 mode: --/CW res: [0x240006991:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66171 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1784189249.699349:0:66171:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000525b2e5f reply state 00000000bcb2033a transno 81604378741 ns: mdt-lustre-MDT0001_UUID lock: ffff9dbf4369da00/0xcc1762b626f8bec7 lrc: 3/0,1 mode: PW/PW res: [0x240006991:0xc:0x0].0xb1bed465 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66171 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189249.699361:0:66171:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9dbf4369da00/0xcc1762b626f8bec7 lrc: 3/0,1 mode: TXN/TXN res: [0x240006991:0xc:0x0].0xb1bed465 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66171 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189249.699373:0:66171:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240006991:0xc:0x0].0xb1bed465 (ffff9dc04a2a5a00) 00010000:00010000:3.0:1784189249.699375:0:66171:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1784189249.699378:0:66171:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1784189249.699413:0:66171:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9dc07116ec00/0xcc1762b626f8beab lrc: 0/0,0 mode: --/CW res: [0x240006991:0xc:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c3f7c expref: 10 pid: 66171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189249.699430:0:66171:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9dc0755a5c00/0xcc1762b626f8bece lrc: 3/0,0 mode: PR/PR res: [0x2400090a5:0x1:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c3f7c expref: 9 pid: 66171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189249.699437:0:66171:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x1:0x0].0x0 (ffff9dc07fab4c00) 00010000:00010000:3.0:1784189249.699439:0:66171:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1784189249.699442:0:66171:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc0755a5c00, rc 0) 00000100:00100000:3.0:1784189249.699501:0:66171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc07b7e1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:debedd94-805c-42a0-a5e5-41758b2012e9+10:71032:x1870854436300544:12345-192.168.203.12@tcp:101:cp.0 Request processed in 11969us (17611us total) trans 81604378741 rc 0/0 00000100:00100000:3.0:1784189249.699510:0:66171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1343 00000100:00100000:2.0:1784189249.704976:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1784189249.705047:0:26163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436300672 00000100:00100000:3.0:1784189249.705056:0:26163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436300672 00000100:00100000:3.0:1784189249.705093:0:26163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 4975 00000100:00100000:3.0:1784189249.705101:0:26163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc07b7e1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:0+-99:2395:x1870854436300672:12345-192.168.203.12@tcp:8:cp.0 00010000:00080000:3.0:1784189249.705133:0:26163:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0000: connection from debedd94-805c-42a0-a5e5-41758b2012e9@192.168.203.12@tcp t0 exp 0000000000000000 cur 3491 last 0 00000020:00000080:3.0:1784189249.705161:0:26163:0:(genops.c:1406:class_connect()) connect: client debedd94-805c-42a0-a5e5-41758b2012e9, cookie 0xcc1762b626f8bedc 00002000:00100000:3.0:1784189249.705171:0:26163:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli debedd94-805c-42a0-a5e5-41758b2012e9/ffff9dbf45128000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 21136a2 ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1784189249.705180:0:26163:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:3.0:1784189249.705244:0:26163:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1784189249.705268:0:26163:0:(import.c:65:import_set_state_nolock()) ffff9dbf45128800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1784189249.705365:0:26163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc07b7e1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:debedd94-805c-42a0-a5e5-41758b2012e9+6:2395:x1870854436300672:12345-192.168.203.12@tcp:8:cp.0 Request processed in 264us (397us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189249.705373:0:26163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 4975 00000004:00000080:1.0:1784189249.711992:0:92422:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffae09886cbe10 00100000:10000000:1.0:1784189249.712017:0:92422:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000004:00080000:0.0:1784189249.712972:0:92410:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x2c0000401:0x703:0x0] 00000100:00100000:0.0:1784189249.713027:0:92410:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc07b5b1c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:92410:1870854458174336:0@lo:5:osp-pre-1-0.0 00000100:00100000:0.0:1784189249.713090:0:92410:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784189249.713130:0:92410:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dc04673ff00 going to sleep for 11 seconds 00000004:00080000:1.0:1784189249.713409:0:92408:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x280000401:0x702:0x0] 00000100:00100000:1.0:1784189249.713430:0:92408:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc05f02d500 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:92408:1870854458174464:0@lo:5:osp-pre-0-0.0 00000100:00100000:1.0:1784189249.713458:0:92408:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784189249.713480:0:92408:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dc050e11cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1784189249.714116:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1784189249.714144:0:26168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458174336 00000100:00100000:1.0:1784189249.714152:0:26168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458174336 00000100:00100000:1.0:1784189249.714188:0:26168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458174464 00000100:00100000:1.0:1784189249.714191:0:26168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458174464 00000100:00100000:1.0:1784189249.714206:0:26168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436300800 00000100:00100000:1.0:1784189249.714208:0:26168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436300800 00000100:00100000:1.0:1784189249.714244:0:26168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4976 00000100:00100000:1.0:1784189249.714253:0:26168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc07b5b2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+5:92410:x1870854458174336:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:1.0:1784189249.714282:0:26168:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 1857 -> diff = -62 00002000:02000040:1.0:1784189249.714287:0:26168:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000401:1796 to 0x2c0000401:1857) 00000100:00080000:2.0:1784189249.718762:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1784189249.718804:0:26171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4977 00000100:00100000:2.0:1784189249.718824:0:26171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc05f02ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+5:92408:x1870854458174464:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:2.0:1784189249.718860:0:26171:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 1857 -> diff = -63 00002000:02000040:2.0:1784189249.718865:0:26171:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:1795 to 0x280000401:1857) 00000100:00100000:0.0:1784189249.719837:0:26164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 4978 00000100:00100000:0.0:1784189249.719853:0:26164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc05f02c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:debedd94-805c-42a0-a5e5-41758b2012e9+6:0:x1870854436300800:12345-192.168.203.12@tcp:101:cp.0 00010000:00010000:0.0:1784189249.719867:0:26164:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784189249.719890:0:26164:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000490fcfab/0xcc1762b626f8bee3 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x242:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xcbfc5de7fe6c3f83 expref: -99 pid: 26164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1784189249.719915:0:26164:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x242:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784189249.719934:0:26164:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x242:0x0].0x0 since=3491s v=(0 0) 00010000:00010000:0.0:1784189249.719938:0:26164:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x242:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784189249.719948:0:26164:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000490fcfab/0xcc1762b626f8bee3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x242:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c3f83 expref: 7 pid: 26164 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189249.719965:0:26164:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000490fcfab/0xcc1762b626f8bee3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x242:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c3f83 expref: 7 pid: 26164 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189249.719976:0:26164:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc04152d400, rc 0) 00000100:00100000:0.0:1784189249.720050:0:26164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc05f02c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:debedd94-805c-42a0-a5e5-41758b2012e9+7:0:x1870854436300800:12345-192.168.203.12@tcp:101:cp.0 Request processed in 203us (5936us total) trans 0 rc 0/0 00000100:00100000:0.0:1784189249.720057:0:26164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 4978 00002000:00010000:1.0:1784189249.727825:0:26168:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x741:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784189249.727837:0:26168:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000006c4aa/0xcc1762b626f8beea lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x741:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189249.727855:0:26168:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x741:0x0].0x0 since=3491s v=(0 0) 00010000:00010000:1.0:1784189249.727859:0:26168:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x741:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784189249.727866:0:26168:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000006c4aa/0xcc1762b626f8beea lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x741:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189249.727882:0:26168:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000006c4aa/0xcc1762b626f8beea lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x741:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189249.727906:0:26168:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000006c4aa/0xcc1762b626f8beea lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x741:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189249.727914:0:26168:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000006c4aa/0xcc1762b626f8beea lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x741:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189249.727936:0:26168:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1784189249.728045:0:26168:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x740:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784189249.728050:0:26168:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007ca946a3/0xcc1762b626f8bef1 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x740:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189249.728058:0:26168:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x740:0x0].0x0 since=3491s v=(0 0) 00010000:00010000:1.0:1784189249.728060:0:26168:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x740:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784189249.728064:0:26168:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007ca946a3/0xcc1762b626f8bef1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x740:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189249.728073:0:26168:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007ca946a3/0xcc1762b626f8bef1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x740:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189249.728080:0:26168:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007ca946a3/0xcc1762b626f8bef1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x740:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189249.728087:0:26168:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007ca946a3/0xcc1762b626f8bef1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x740:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189249.728113:0:26168:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1784189249.728124:0:6502:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1784189249.728130:0:6502:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000006c4aa/0xcc1762b626f8beea lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x741:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189249.728137:0:6502:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc07116e400 already unused, calling callback (ffffffffc0b2e230) 00010000:00010000:1.0:1784189249.728141:0:6502:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000006c4aa/0xcc1762b626f8beea lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x741:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189249.728150:0:6502:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000006c4aa/0xcc1762b626f8beea lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x741:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189249.728166:0:6502:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000006c4aa/0xcc1762b626f8beea lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x741:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189249.728173:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000006c4aa/0xcc1762b626f8beea lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x741:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189249.728191:0:6502:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784189249.728194:0:6502:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007ca946a3/0xcc1762b626f8bef1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x740:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189249.728200:0:6502:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc07116fa00 already unused, calling callback (ffffffffc0b2e230) 00010000:00010000:1.0:1784189249.728203:0:6502:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007ca946a3/0xcc1762b626f8bef1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x740:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189249.728222:0:6502:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007ca946a3/0xcc1762b626f8bef1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x740:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189249.728232:0:6502:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007ca946a3/0xcc1762b626f8bef1 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x740:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189249.728240:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007ca946a3/0xcc1762b626f8bef1 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x740:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189249.728251:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784189249.728253:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784189249.728255:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1784189249.728297:0:26168:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x73f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784189249.728303:0:26168:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d358cced/0xcc1762b626f8bef8 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x73f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189249.728312:0:26168:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x73f:0x0].0x0 since=3491s v=(0 0) 00010000:00010000:1.0:1784189249.728315:0:26168:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x73f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784189249.728355:0:26168:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d358cced/0xcc1762b626f8bef8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x73f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189249.728364:0:26168:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d358cced/0xcc1762b626f8bef8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x73f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189249.728372:0:26168:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d358cced/0xcc1762b626f8bef8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x73f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189249.728385:0:26168:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d358cced/0xcc1762b626f8bef8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x73f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189249.729702:0:26168:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1784189249.729715:0:6501:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784189249.729721:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d358cced/0xcc1762b626f8bef8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x73f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189249.729731:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc07116e000 already unused, calling callback (ffffffffc0b2e230) 00010000:00010000:1.0:1784189249.729735:0:6501:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d358cced/0xcc1762b626f8bef8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x73f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189249.729745:0:6501:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d358cced/0xcc1762b626f8bef8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x73f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189249.729759:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d358cced/0xcc1762b626f8bef8 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x73f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189249.729767:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d358cced/0xcc1762b626f8bef8 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x73f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189249.729784:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784189249.729786:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784189249.729787:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1784189249.729869:0:26168:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x73e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784189249.729885:0:26168:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000022fa77b/0xcc1762b626f8beff lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x73e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189249.729897:0:26168:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x73e:0x0].0x0 since=3491s v=(0 0) 00010000:00010000:1.0:1784189249.729901:0:26168:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x73e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784189249.729906:0:26168:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000022fa77b/0xcc1762b626f8beff lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x73e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189249.729918:0:26168:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000022fa77b/0xcc1762b626f8beff lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x73e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189249.729926:0:26168:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000022fa77b/0xcc1762b626f8beff lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x73e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189249.729934:0:26168:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000022fa77b/0xcc1762b626f8beff lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x73e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189249.729949:0:26168:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1784189249.729957:0:26173:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784189249.729961:0:26173:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000022fa77b/0xcc1762b626f8beff lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x73e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189249.729967:0:26173:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc07116f000 already unused, calling callback (ffffffffc0b2e230) 00010000:00010000:1.0:1784189249.729970:0:26173:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000022fa77b/0xcc1762b626f8beff lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x73e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189249.729977:0:26173:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000022fa77b/0xcc1762b626f8beff lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x73e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189249.729994:0:26173:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000022fa77b/0xcc1762b626f8beff lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x73e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189249.730001:0:26173:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000022fa77b/0xcc1762b626f8beff lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x73e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189249.730013:0:26173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784189249.730015:0:26173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784189249.730017:0:26173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1784189249.730058:0:26168:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x73d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784189249.730063:0:26168:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006c76bcb1/0xcc1762b626f8bf06 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x73d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189249.730071:0:26168:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x73d:0x0].0x0 since=3491s v=(0 0) 00010000:00010000:1.0:1784189249.730074:0:26168:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x73d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784189249.730078:0:26168:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006c76bcb1/0xcc1762b626f8bf06 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x73d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189249.730086:0:26168:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006c76bcb1/0xcc1762b626f8bf06 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x73d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189249.730094:0:26168:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006c76bcb1/0xcc1762b626f8bf06 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x73d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189249.730101:0:26168:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006c76bcb1/0xcc1762b626f8bf06 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x73d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189249.730126:0:26168:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1784189249.730134:0:6502:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784189249.730138:0:6502:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006c76bcb1/0xcc1762b626f8bf06 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x73d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189249.730144:0:6502:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc07116fe00 already unused, calling callback (ffffffffc0b2e230) 00010000:00010000:1.0:1784189249.730147:0:6502:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006c76bcb1/0xcc1762b626f8bf06 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x73d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189249.730154:0:6502:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006c76bcb1/0xcc1762b626f8bf06 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x73d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189249.730164:0:6502:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006c76bcb1/0xcc1762b626f8bf06 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x73d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189249.730171:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006c76bcb1/0xcc1762b626f8bf06 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x73d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189249.730183:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784189249.730184:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784189249.730186:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1784189249.730228:0:26168:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x73c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784189249.730233:0:26168:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d7af1b89/0xcc1762b626f8bf0d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x73c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189249.730240:0:26168:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x73c:0x0].0x0 since=3491s v=(0 0) 00010000:00010000:1.0:1784189249.730248:0:26168:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x73c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784189249.730252:0:26168:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d7af1b89/0xcc1762b626f8bf0d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x73c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189249.730262:0:26168:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d7af1b89/0xcc1762b626f8bf0d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x73c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189249.730270:0:26168:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d7af1b89/0xcc1762b626f8bf0d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x73c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189249.730276:0:26168:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d7af1b89/0xcc1762b626f8bf0d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x73c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189249.730288:0:26168:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1784189249.730294:0:6501:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784189249.730297:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d7af1b89/0xcc1762b626f8bf0d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x73c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189249.730303:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc07116f800 already unused, calling callback (ffffffffc0b2e230) 00010000:00010000:1.0:1784189249.730307:0:6501:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d7af1b89/0xcc1762b626f8bf0d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x73c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189249.730313:0:6501:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d7af1b89/0xcc1762b626f8bf0d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x73c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189249.730342:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d7af1b89/0xcc1762b626f8bf0d lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x73c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189249.730360:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d7af1b89/0xcc1762b626f8bf0d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x73c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189249.730372:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784189249.730374:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784189249.730375:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1784189249.730417:0:26168:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x73b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784189249.730422:0:26168:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000004c81696/0xcc1762b626f8bf14 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x73b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189249.730429:0:26168:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x73b:0x0].0x0 since=3491s v=(0 0) 00010000:00010000:1.0:1784189249.730432:0:26168:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x73b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784189249.730436:0:26168:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000004c81696/0xcc1762b626f8bf14 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x73b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189249.730445:0:26168:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000004c81696/0xcc1762b626f8bf14 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x73b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189249.730452:0:26168:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000004c81696/0xcc1762b626f8bf14 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x73b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189249.730458:0:26168:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000004c81696/0xcc1762b626f8bf14 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x73b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189249.730471:0:26168:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1784189249.730484:0:26173:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784189249.730488:0:26173:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000004c81696/0xcc1762b626f8bf14 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x73b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189249.730495:0:26173:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc07116ea00 already unused, calling callback (ffffffffc0b2e230) 00010000:00010000:1.0:1784189249.730498:0:26173:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000004c81696/0xcc1762b626f8bf14 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x73b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189249.730506:0:26173:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000004c81696/0xcc1762b626f8bf14 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x73b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189249.730515:0:26173:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000004c81696/0xcc1762b626f8bf14 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x73b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189249.730522:0:26173:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000004c81696/0xcc1762b626f8bf14 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x73b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189249.730535:0:26173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784189249.730537:0:26173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784189249.730538:0:26173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784189249.730710:0:7454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1784189249.735515:0:26168:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x73a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784189249.735528:0:26168:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000091d4841/0xcc1762b626f8bf1b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x73a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189249.735545:0:26168:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x73a:0x0].0x0 since=3491s v=(0 0) 00010000:00010000:1.0:1784189249.735549:0:26168:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x73a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784189249.735555:0:26168:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000091d4841/0xcc1762b626f8bf1b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x73a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189249.735594:0:26168:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000091d4841/0xcc1762b626f8bf1b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x73a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189249.735604:0:26168:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000091d4841/0xcc1762b626f8bf1b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x73a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189249.735612:0:26168:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000091d4841/0xcc1762b626f8bf1b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x73a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189249.735840:0:26168:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1784189249.735924:0:26168:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x739:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784189249.735929:0:26168:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d638fecc/0xcc1762b626f8bf22 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x739:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189249.735937:0:26168:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x739:0x0].0x0 since=3491s v=(0 0) 00010000:00010000:1.0:1784189249.735940:0:26168:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x739:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784189249.735944:0:26168:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d638fecc/0xcc1762b626f8bf22 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x739:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189249.735953:0:26168:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d638fecc/0xcc1762b626f8bf22 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x739:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189249.735960:0:26168:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d638fecc/0xcc1762b626f8bf22 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x739:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189249.735978:0:26168:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d638fecc/0xcc1762b626f8bf22 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x739:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189249.736925:0:6502:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1784189249.736934:0:6502:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000091d4841/0xcc1762b626f8bf1b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x73a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189249.736945:0:6502:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc07116f200 already unused, calling callback (ffffffffc0b2e230) 00010000:00010000:0.0:1784189249.736949:0:6502:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000091d4841/0xcc1762b626f8bf1b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x73a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189249.736965:0:6502:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000091d4841/0xcc1762b626f8bf1b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x73a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189249.736981:0:6502:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000091d4841/0xcc1762b626f8bf1b lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x73a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189249.736988:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000091d4841/0xcc1762b626f8bf1b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x73a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189249.737041:0:6502:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784189249.737046:0:6502:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d638fecc/0xcc1762b626f8bf22 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x739:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189249.737052:0:6502:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc07116f600 already unused, calling callback (ffffffffc0b2e230) 00010000:00010000:0.0:1784189249.737056:0:6502:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d638fecc/0xcc1762b626f8bf22 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x739:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189249.737063:0:6502:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d638fecc/0xcc1762b626f8bf22 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x739:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189249.737073:0:6502:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d638fecc/0xcc1762b626f8bf22 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x739:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189249.737081:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784189249.737082:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784189249.737089:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784189249.737178:0:26168:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1784189249.737183:0:26168:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d638fecc/0xcc1762b626f8bf22 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x739:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1784189249.737272:0:26168:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x738:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784189249.737278:0:26168:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006a15f861/0xcc1762b626f8bf29 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x738:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189249.737287:0:26168:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x738:0x0].0x0 since=3491s v=(0 0) 00010000:00010000:1.0:1784189249.737290:0:26168:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x738:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784189249.737295:0:26168:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006a15f861/0xcc1762b626f8bf29 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x738:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189249.737305:0:26168:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006a15f861/0xcc1762b626f8bf29 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x738:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189249.737312:0:26168:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006a15f861/0xcc1762b626f8bf29 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x738:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189249.737344:0:26168:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006a15f861/0xcc1762b626f8bf29 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x738:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189249.737425:0:6501:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784189249.737431:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006a15f861/0xcc1762b626f8bf29 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x738:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189249.737438:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc07116f400 already unused, calling callback (ffffffffc0b2e230) 00010000:00010000:0.0:1784189249.737441:0:6501:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006a15f861/0xcc1762b626f8bf29 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x738:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189249.737448:0:6501:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006a15f861/0xcc1762b626f8bf29 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x738:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189249.737459:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006a15f861/0xcc1762b626f8bf29 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x738:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189249.737466:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784189249.737467:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784189249.737469:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784189249.737525:0:26168:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1784189249.737530:0:26168:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006a15f861/0xcc1762b626f8bf29 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x738:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1784189249.737591:0:26168:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x737:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784189249.737597:0:26168:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000005567574/0xcc1762b626f8bf30 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x737:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189249.737605:0:26168:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x737:0x0].0x0 since=3491s v=(0 0) 00010000:00010000:1.0:1784189249.737608:0:26168:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x737:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784189249.737612:0:26168:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000005567574/0xcc1762b626f8bf30 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x737:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189249.737622:0:26168:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000005567574/0xcc1762b626f8bf30 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x737:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189249.737630:0:26168:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000005567574/0xcc1762b626f8bf30 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x737:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189249.737638:0:26168:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000005567574/0xcc1762b626f8bf30 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x737:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189249.737850:0:26173:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784189249.737855:0:26173:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000005567574/0xcc1762b626f8bf30 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x737:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189249.737863:0:26173:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc07116ee00 already unused, calling callback (ffffffffc0b2e230) 00010000:00010000:0.0:1784189249.737865:0:26173:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000005567574/0xcc1762b626f8bf30 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x737:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189249.738233:0:26173:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000005567574/0xcc1762b626f8bf30 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x737:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189249.738260:0:26173:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000005567574/0xcc1762b626f8bf30 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x737:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189249.738269:0:26173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784189249.738270:0:26173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784189249.738272:0:26173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784189249.738406:0:26168:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1784189249.738411:0:26168:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000005567574/0xcc1762b626f8bf30 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x737:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1784189249.738503:0:26168:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x736:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784189249.738509:0:26168:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000067956617/0xcc1762b626f8bf37 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x736:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189249.738518:0:26168:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x736:0x0].0x0 since=3491s v=(0 0) 00010000:00010000:1.0:1784189249.738522:0:26168:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x736:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784189249.738526:0:26168:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000067956617/0xcc1762b626f8bf37 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x736:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189249.738535:0:26168:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000067956617/0xcc1762b626f8bf37 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x736:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189249.738542:0:26168:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000067956617/0xcc1762b626f8bf37 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x736:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189249.738549:0:26168:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000067956617/0xcc1762b626f8bf37 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x736:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189249.738635:0:7454:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784189249.738640:0:7454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000067956617/0xcc1762b626f8bf37 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x736:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189249.738648:0:7454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc07116e800 already unused, calling callback (ffffffffc0b2e230) 00010000:00010000:0.0:1784189249.738652:0:7454:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000067956617/0xcc1762b626f8bf37 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x736:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189249.738820:0:7454:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000067956617/0xcc1762b626f8bf37 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x736:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189249.738832:0:7454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000067956617/0xcc1762b626f8bf37 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x736:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189249.738841:0:7454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784189249.738843:0:7454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784189249.738845:0:7454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784189249.738909:0:26168:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1784189249.738915:0:26168:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000067956617/0xcc1762b626f8bf37 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x736:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1784189249.738973:0:26168:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x735:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784189249.738978:0:26168:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ff507323/0xcc1762b626f8bf3e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x735:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189249.738996:0:26168:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x735:0x0].0x0 since=3491s v=(0 0) 00010000:00010000:1.0:1784189249.738999:0:26168:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x735:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784189249.739004:0:26168:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ff507323/0xcc1762b626f8bf3e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x735:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189249.739013:0:26168:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ff507323/0xcc1762b626f8bf3e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x735:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189249.739019:0:26168:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ff507323/0xcc1762b626f8bf3e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x735:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189249.739026:0:26168:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ff507323/0xcc1762b626f8bf3e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x735:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189249.739055:0:6502:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784189249.739060:0:6502:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ff507323/0xcc1762b626f8bf3e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x735:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189249.739076:0:6502:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc042d67800 already unused, calling callback (ffffffffc0b2e230) 00010000:00010000:0.0:1784189249.739079:0:6502:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ff507323/0xcc1762b626f8bf3e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x735:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189249.739087:0:6502:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ff507323/0xcc1762b626f8bf3e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x735:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189249.739097:0:6502:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ff507323/0xcc1762b626f8bf3e lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x735:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189249.739105:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784189249.739107:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784189249.739109:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784189249.739162:0:26168:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1784189249.739167:0:26168:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ff507323/0xcc1762b626f8bf3e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x735:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1784189249.739216:0:26168:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x734:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784189249.739220:0:26168:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000089abf352/0xcc1762b626f8bf45 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x734:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189249.739228:0:26168:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x734:0x0].0x0 since=3491s v=(0 0) 00010000:00010000:1.0:1784189249.739230:0:26168:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x734:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784189249.739234:0:26168:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000089abf352/0xcc1762b626f8bf45 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x734:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189249.739249:0:26168:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000089abf352/0xcc1762b626f8bf45 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x734:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189249.739257:0:26168:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000089abf352/0xcc1762b626f8bf45 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x734:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189249.739264:0:26168:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000089abf352/0xcc1762b626f8bf45 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x734:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189249.739291:0:6501:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784189249.739296:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000089abf352/0xcc1762b626f8bf45 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x734:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189249.739302:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc042d67c00 already unused, calling callback (ffffffffc0b2e230) 00010000:00010000:0.0:1784189249.739305:0:6501:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000089abf352/0xcc1762b626f8bf45 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x734:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189249.739314:0:6501:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000089abf352/0xcc1762b626f8bf45 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x734:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189249.739387:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000089abf352/0xcc1762b626f8bf45 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x734:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189249.739401:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784189249.739403:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784189249.739404:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784189249.739468:0:26168:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1784189249.739473:0:26168:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000089abf352/0xcc1762b626f8bf45 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x734:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1784189249.739521:0:26168:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x733:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784189249.739527:0:26168:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000030c99bec/0xcc1762b626f8bf4c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x733:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189249.739534:0:26168:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x733:0x0].0x0 since=3491s v=(0 0) 00010000:00010000:1.0:1784189249.739537:0:26168:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x733:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784189249.739541:0:26168:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000030c99bec/0xcc1762b626f8bf4c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x733:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189249.739551:0:26168:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000030c99bec/0xcc1762b626f8bf4c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x733:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189249.740414:0:26168:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000030c99bec/0xcc1762b626f8bf4c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x733:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189249.740424:0:26168:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000030c99bec/0xcc1762b626f8bf4c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x733:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189249.740478:0:26173:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784189249.740484:0:26173:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000030c99bec/0xcc1762b626f8bf4c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x733:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189249.740492:0:26173:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc042d66800 already unused, calling callback (ffffffffc0b2e230) 00010000:00010000:0.0:1784189249.740496:0:26173:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000030c99bec/0xcc1762b626f8bf4c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x733:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189249.740503:0:26173:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000030c99bec/0xcc1762b626f8bf4c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x733:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189249.740516:0:26173:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000030c99bec/0xcc1762b626f8bf4c lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x733:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189249.740524:0:26173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784189249.740526:0:26173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784189249.740528:0:26173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784189249.740659:0:26168:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1784189249.740665:0:26168:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000030c99bec/0xcc1762b626f8bf4c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x733:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1784189249.740904:0:26168:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x732:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784189249.740910:0:26168:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002453cd12/0xcc1762b626f8bf53 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x732:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189249.740921:0:26168:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x732:0x0].0x0 since=3491s v=(0 0) 00010000:00010000:1.0:1784189249.740924:0:26168:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x732:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784189249.740928:0:26168:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002453cd12/0xcc1762b626f8bf53 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x732:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189249.740939:0:26168:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002453cd12/0xcc1762b626f8bf53 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x732:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189249.740947:0:26168:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002453cd12/0xcc1762b626f8bf53 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x732:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189249.740969:0:26168:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002453cd12/0xcc1762b626f8bf53 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x732:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189249.740999:0:7454:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784189249.741004:0:7454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002453cd12/0xcc1762b626f8bf53 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x732:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189249.741011:0:7454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc042d66000 already unused, calling callback (ffffffffc0b2e230) 00010000:00010000:0.0:1784189249.741014:0:7454:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002453cd12/0xcc1762b626f8bf53 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x732:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189249.741027:0:7454:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002453cd12/0xcc1762b626f8bf53 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x732:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189249.741038:0:7454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002453cd12/0xcc1762b626f8bf53 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x732:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189249.741045:0:7454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784189249.741046:0:7454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784189249.741048:0:7454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784189249.741109:0:26168:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1784189249.741115:0:26168:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002453cd12/0xcc1762b626f8bf53 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x732:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1784189249.741168:0:26168:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x731:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784189249.741185:0:26168:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001f62eb6a/0xcc1762b626f8bf5a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x731:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189249.741192:0:26168:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x731:0x0].0x0 since=3491s v=(0 0) 00010000:00010000:1.0:1784189249.741195:0:26168:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x731:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784189249.741199:0:26168:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001f62eb6a/0xcc1762b626f8bf5a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x731:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189249.741207:0:26168:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001f62eb6a/0xcc1762b626f8bf5a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x731:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189249.741213:0:26168:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001f62eb6a/0xcc1762b626f8bf5a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x731:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189249.741220:0:26168:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001f62eb6a/0xcc1762b626f8bf5a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x731:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189249.741306:0:6502:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784189249.741312:0:6502:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001f62eb6a/0xcc1762b626f8bf5a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x731:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189249.741379:0:6502:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc042d67000 already unused, calling callback (ffffffffc0b2e230) 00010000:00010000:0.0:1784189249.741383:0:6502:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001f62eb6a/0xcc1762b626f8bf5a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x731:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189249.741392:0:6502:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001f62eb6a/0xcc1762b626f8bf5a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x731:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189249.741402:0:6502:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001f62eb6a/0xcc1762b626f8bf5a lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x731:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189249.741409:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784189249.741411:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784189249.741856:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784189249.741987:0:26168:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1784189249.741993:0:26168:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001f62eb6a/0xcc1762b626f8bf5a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x731:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1784189249.742058:0:26168:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x730:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784189249.742063:0:26168:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000011321ff9/0xcc1762b626f8bf61 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x730:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189249.742071:0:26168:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x730:0x0].0x0 since=3491s v=(0 0) 00010000:00010000:1.0:1784189249.742074:0:26168:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x730:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784189249.742078:0:26168:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000011321ff9/0xcc1762b626f8bf61 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x730:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189249.742087:0:26168:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000011321ff9/0xcc1762b626f8bf61 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x730:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189249.742094:0:26168:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000011321ff9/0xcc1762b626f8bf61 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x730:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189249.742100:0:26168:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000011321ff9/0xcc1762b626f8bf61 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x730:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189249.742130:0:6501:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784189249.742135:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000011321ff9/0xcc1762b626f8bf61 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x730:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189249.742141:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc042d67e00 already unused, calling callback (ffffffffc0b2e230) 00010000:00010000:0.0:1784189249.742144:0:6501:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000011321ff9/0xcc1762b626f8bf61 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x730:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189249.742151:0:6501:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000011321ff9/0xcc1762b626f8bf61 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x730:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189249.742162:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000011321ff9/0xcc1762b626f8bf61 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x730:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189249.742170:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784189249.742171:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784189249.742172:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784189249.742232:0:26168:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1784189249.742236:0:26168:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000011321ff9/0xcc1762b626f8bf61 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x730:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1784189249.742299:0:26168:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x72f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784189249.742304:0:26168:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000435f2555/0xcc1762b626f8bf68 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x72f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189249.742312:0:26168:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x72f:0x0].0x0 since=3491s v=(0 0) 00010000:00010000:1.0:1784189249.742315:0:26168:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x72f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784189249.742378:0:26168:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000435f2555/0xcc1762b626f8bf68 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x72f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189249.742388:0:26168:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000435f2555/0xcc1762b626f8bf68 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x72f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189249.742395:0:26168:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000435f2555/0xcc1762b626f8bf68 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x72f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189249.742401:0:26168:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000435f2555/0xcc1762b626f8bf68 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x72f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189249.742443:0:26173:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784189249.742448:0:26173:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000435f2555/0xcc1762b626f8bf68 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x72f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189249.742455:0:26173:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc042d66a00 already unused, calling callback (ffffffffc0b2e230) 00010000:00010000:0.0:1784189249.742458:0:26173:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000435f2555/0xcc1762b626f8bf68 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x72f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189249.742466:0:26173:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000435f2555/0xcc1762b626f8bf68 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x72f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189249.742490:0:26173:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000435f2555/0xcc1762b626f8bf68 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x72f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189249.742497:0:26173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784189249.742499:0:26173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784189249.742501:0:26173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784189249.742557:0:26168:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1784189249.742562:0:26168:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000435f2555/0xcc1762b626f8bf68 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x72f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1784189249.742633:0:26168:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x72e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784189249.742638:0:26168:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dad20162/0xcc1762b626f8bf6f lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x72e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189249.742793:0:26168:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x72e:0x0].0x0 since=3491s v=(0 0) 00010000:00010000:1.0:1784189249.742796:0:26168:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x72e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784189249.742801:0:26168:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dad20162/0xcc1762b626f8bf6f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x72e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189249.742810:0:26168:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000dad20162/0xcc1762b626f8bf6f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x72e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189249.742817:0:26168:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dad20162/0xcc1762b626f8bf6f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x72e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189249.742825:0:26168:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000dad20162/0xcc1762b626f8bf6f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x72e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189249.742854:0:7454:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784189249.742859:0:7454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000dad20162/0xcc1762b626f8bf6f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x72e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189249.742865:0:7454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc042d66c00 already unused, calling callback (ffffffffc0b2e230) 00010000:00010000:0.0:1784189249.742868:0:7454:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000dad20162/0xcc1762b626f8bf6f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x72e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189249.742874:0:7454:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000dad20162/0xcc1762b626f8bf6f lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x72e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189249.742883:0:7454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000dad20162/0xcc1762b626f8bf6f lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x72e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189249.742891:0:7454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784189249.742892:0:7454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784189249.742894:0:7454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784189249.743009:0:26168:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1784189249.743014:0:26168:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000dad20162/0xcc1762b626f8bf6f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x72e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1784189249.743070:0:26168:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x72d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784189249.743075:0:26168:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008f2946f7/0xcc1762b626f8bf76 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x72d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189249.743083:0:26168:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x72d:0x0].0x0 since=3491s v=(0 0) 00010000:00010000:1.0:1784189249.743086:0:26168:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x72d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784189249.743090:0:26168:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008f2946f7/0xcc1762b626f8bf76 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x72d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189249.743105:0:26168:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008f2946f7/0xcc1762b626f8bf76 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x72d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189249.743113:0:26168:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008f2946f7/0xcc1762b626f8bf76 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x72d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189249.743119:0:26168:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008f2946f7/0xcc1762b626f8bf76 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x72d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189249.743206:0:6502:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784189249.743211:0:6502:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008f2946f7/0xcc1762b626f8bf76 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x72d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189249.743229:0:6502:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc042d66400 already unused, calling callback (ffffffffc0b2e230) 00010000:00010000:0.0:1784189249.743232:0:6502:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008f2946f7/0xcc1762b626f8bf76 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x72d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189249.743239:0:6502:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008f2946f7/0xcc1762b626f8bf76 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x72d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189249.743250:0:6502:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008f2946f7/0xcc1762b626f8bf76 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x72d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189249.743257:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784189249.743258:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784189249.743259:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784189249.743314:0:26168:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1784189249.743344:0:26168:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008f2946f7/0xcc1762b626f8bf76 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x72d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1784189249.743395:0:26168:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x72c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784189249.743400:0:26168:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009e262e78/0xcc1762b626f8bf7d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x72c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189249.743408:0:26168:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x72c:0x0].0x0 since=3491s v=(0 0) 00010000:00010000:1.0:1784189249.743411:0:26168:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x72c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784189249.743415:0:26168:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009e262e78/0xcc1762b626f8bf7d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x72c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189249.743423:0:26168:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009e262e78/0xcc1762b626f8bf7d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x72c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189249.743442:0:26168:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009e262e78/0xcc1762b626f8bf7d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x72c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189249.743449:0:26168:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009e262e78/0xcc1762b626f8bf7d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x72c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189249.743520:0:6501:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784189249.743525:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009e262e78/0xcc1762b626f8bf7d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x72c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189249.743532:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc042d66600 already unused, calling callback (ffffffffc0b2e230) 00010000:00010000:0.0:1784189249.743535:0:6501:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009e262e78/0xcc1762b626f8bf7d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x72c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189249.743543:0:6501:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009e262e78/0xcc1762b626f8bf7d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x72c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189249.743553:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009e262e78/0xcc1762b626f8bf7d lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x72c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189249.743635:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784189249.743638:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784189249.743640:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784189249.743873:0:26168:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1784189249.743878:0:26168:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009e262e78/0xcc1762b626f8bf7d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x72c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1784189249.743933:0:26168:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x72b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784189249.743939:0:26168:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000041bf25cb/0xcc1762b626f8bf84 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x72b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189249.743947:0:26168:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x72b:0x0].0x0 since=3491s v=(0 0) 00010000:00010000:1.0:1784189249.743950:0:26168:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x72b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784189249.743954:0:26168:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000041bf25cb/0xcc1762b626f8bf84 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x72b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189249.743963:0:26168:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000041bf25cb/0xcc1762b626f8bf84 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x72b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189249.743971:0:26168:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000041bf25cb/0xcc1762b626f8bf84 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x72b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189249.743990:0:26168:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000041bf25cb/0xcc1762b626f8bf84 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x72b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189249.744019:0:26173:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784189249.744024:0:26173:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000041bf25cb/0xcc1762b626f8bf84 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x72b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189249.744031:0:26173:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc042d67200 already unused, calling callback (ffffffffc0b2e230) 00010000:00010000:0.0:1784189249.744034:0:26173:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000041bf25cb/0xcc1762b626f8bf84 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x72b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189249.744041:0:26173:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000041bf25cb/0xcc1762b626f8bf84 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x72b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189249.744052:0:26173:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000041bf25cb/0xcc1762b626f8bf84 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x72b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189249.744060:0:26173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784189249.744061:0:26173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784189249.744063:0:26173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784189249.744117:0:26168:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1784189249.744122:0:26168:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000041bf25cb/0xcc1762b626f8bf84 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x72b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1784189249.744174:0:26168:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x72a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784189249.744179:0:26168:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d9badbf5/0xcc1762b626f8bf8b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x72a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189249.744186:0:26168:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x72a:0x0].0x0 since=3491s v=(0 0) 00010000:00010000:1.0:1784189249.744189:0:26168:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x72a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784189249.744193:0:26168:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d9badbf5/0xcc1762b626f8bf8b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x72a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189249.744201:0:26168:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d9badbf5/0xcc1762b626f8bf8b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x72a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189249.744208:0:26168:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d9badbf5/0xcc1762b626f8bf8b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x72a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189249.744213:0:26168:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d9badbf5/0xcc1762b626f8bf8b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x72a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189249.744252:0:7454:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784189249.744257:0:7454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d9badbf5/0xcc1762b626f8bf8b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x72a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189249.744263:0:7454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc042d66200 already unused, calling callback (ffffffffc0b2e230) 00010000:00010000:0.0:1784189249.744266:0:7454:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d9badbf5/0xcc1762b626f8bf8b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x72a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189249.744278:0:7454:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d9badbf5/0xcc1762b626f8bf8b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x72a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189249.744288:0:7454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d9badbf5/0xcc1762b626f8bf8b lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x72a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189249.744296:0:7454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784189249.744297:0:7454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784189249.744299:0:7454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784189249.744423:0:26168:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1784189249.744429:0:26168:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d9badbf5/0xcc1762b626f8bf8b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x72a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1784189249.744483:0:26168:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x729:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784189249.744488:0:26168:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000092974359/0xcc1762b626f8bf92 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x729:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189249.744495:0:26168:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x729:0x0].0x0 since=3491s v=(0 0) 00010000:00010000:1.0:1784189249.744498:0:26168:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x729:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784189249.744501:0:26168:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000092974359/0xcc1762b626f8bf92 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x729:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189249.744509:0:26168:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000092974359/0xcc1762b626f8bf92 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x729:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189249.744516:0:26168:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000092974359/0xcc1762b626f8bf92 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x729:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189249.744522:0:26168:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000092974359/0xcc1762b626f8bf92 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x729:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189249.744546:0:6502:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784189249.744551:0:6502:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000092974359/0xcc1762b626f8bf92 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x729:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189249.744558:0:6502:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc042d67a00 already unused, calling callback (ffffffffc0b2e230) 00010000:00010000:0.0:1784189249.744561:0:6502:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000092974359/0xcc1762b626f8bf92 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x729:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189249.744642:0:6502:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000092974359/0xcc1762b626f8bf92 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x729:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189249.744676:0:6502:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000092974359/0xcc1762b626f8bf92 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x729:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189249.744846:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784189249.744848:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784189249.744855:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784189249.744913:0:26168:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1784189249.744918:0:26168:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000092974359/0xcc1762b626f8bf92 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x729:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1784189249.744980:0:26168:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x728:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784189249.744985:0:26168:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004bf593ac/0xcc1762b626f8bf99 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x728:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189249.744994:0:26168:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x728:0x0].0x0 since=3491s v=(0 0) 00010000:00010000:1.0:1784189249.744997:0:26168:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x728:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784189249.745001:0:26168:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004bf593ac/0xcc1762b626f8bf99 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x728:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189249.745009:0:26168:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004bf593ac/0xcc1762b626f8bf99 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x728:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189249.745017:0:26168:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004bf593ac/0xcc1762b626f8bf99 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x728:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189249.745024:0:26168:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004bf593ac/0xcc1762b626f8bf99 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x728:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189249.745872:0:6501:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784189249.745881:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004bf593ac/0xcc1762b626f8bf99 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x728:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189249.745892:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc042d67600 already unused, calling callback (ffffffffc0b2e230) 00010000:00010000:0.0:1784189249.745896:0:6501:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004bf593ac/0xcc1762b626f8bf99 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x728:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189249.745905:0:6501:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004bf593ac/0xcc1762b626f8bf99 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x728:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189249.745919:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004bf593ac/0xcc1762b626f8bf99 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x728:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189249.745929:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784189249.745931:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784189249.745933:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784189249.745988:0:26168:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1784189249.745993:0:26168:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004bf593ac/0xcc1762b626f8bf99 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x728:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1784189249.746071:0:26168:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x727:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784189249.746077:0:26168:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c6d40e55/0xcc1762b626f8bfa0 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x727:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189249.746098:0:26168:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x727:0x0].0x0 since=3491s v=(0 0) 00010000:00010000:1.0:1784189249.746102:0:26168:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x727:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784189249.746107:0:26168:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c6d40e55/0xcc1762b626f8bfa0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x727:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189249.746117:0:26168:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c6d40e55/0xcc1762b626f8bfa0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x727:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189249.746124:0:26168:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c6d40e55/0xcc1762b626f8bfa0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x727:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189249.746132:0:26168:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c6d40e55/0xcc1762b626f8bfa0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x727:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189249.746277:0:26168:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1784189249.746336:0:26168:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x726:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784189249.746342:0:26168:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000778f0c98/0xcc1762b626f8bfa7 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x726:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189249.746350:0:26168:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x726:0x0].0x0 since=3491s v=(0 0) 00010000:00010000:1.0:1784189249.746353:0:26168:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x726:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784189249.746356:0:26168:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000778f0c98/0xcc1762b626f8bfa7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x726:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189249.746365:0:26168:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000778f0c98/0xcc1762b626f8bfa7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x726:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189249.746384:0:26168:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000778f0c98/0xcc1762b626f8bfa7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x726:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189249.746392:0:26168:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000778f0c98/0xcc1762b626f8bfa7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x726:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189249.746428:0:7454:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1784189249.746434:0:7454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c6d40e55/0xcc1762b626f8bfa0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x727:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189249.746441:0:7454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc042d67400 already unused, calling callback (ffffffffc0b2e230) 00010000:00010000:3.0:1784189249.746444:0:7454:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c6d40e55/0xcc1762b626f8bfa0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x727:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189249.746452:0:7454:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c6d40e55/0xcc1762b626f8bfa0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x727:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189249.746464:0:7454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c6d40e55/0xcc1762b626f8bfa0 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x727:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189249.746470:0:7454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c6d40e55/0xcc1762b626f8bfa0 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x727:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189249.746484:0:7454:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784189249.746487:0:7454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000778f0c98/0xcc1762b626f8bfa7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x726:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189249.746494:0:7454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc042d66e00 already unused, calling callback (ffffffffc0b2e230) 00010000:00010000:3.0:1784189249.746496:0:7454:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000778f0c98/0xcc1762b626f8bfa7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x726:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189249.746515:0:7454:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000778f0c98/0xcc1762b626f8bfa7 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x726:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189249.746526:0:7454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000778f0c98/0xcc1762b626f8bfa7 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x726:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189249.746534:0:7454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784189249.746535:0:7454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784189249.746537:0:7454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1784189249.746649:0:26171:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x741:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1784189249.746664:0:26171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008cc5f086/0xcc1762b626f8bfae lrc: 3/0,1 mode: --/PW res: [0x280000401:0x741:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189249.746673:0:26171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x741:0x0].0x0 since=3491s v=(0 0) 00010000:00010000:2.0:1784189249.746676:0:26171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x741:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784189249.746686:0:26171:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008cc5f086/0xcc1762b626f8bfae lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x741:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189249.746697:0:26171:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008cc5f086/0xcc1762b626f8bfae lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x741:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189249.746705:0:26171:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008cc5f086/0xcc1762b626f8bfae lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x741:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189249.746733:0:26171:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008cc5f086/0xcc1762b626f8bfae lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x741:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189249.746752:0:26171:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1784189249.746810:0:26171:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x740:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1784189249.746815:0:26171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d9b1520e/0xcc1762b626f8bfb5 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x740:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189249.746823:0:26171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x740:0x0].0x0 since=3491s v=(0 0) 00010000:00010000:2.0:1784189249.746826:0:26171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x740:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784189249.746830:0:26171:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d9b1520e/0xcc1762b626f8bfb5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x740:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189249.746839:0:26171:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d9b1520e/0xcc1762b626f8bfb5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x740:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189249.746846:0:26171:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d9b1520e/0xcc1762b626f8bfb5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x740:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189249.746852:0:26171:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d9b1520e/0xcc1762b626f8bfb5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x740:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189249.746865:0:26171:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1784189249.746874:0:6501:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1784189249.746877:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008cc5f086/0xcc1762b626f8bfae lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x741:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189249.746890:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dbf4369ce00 already unused, calling callback (ffffffffc0b2e230) 00010000:00010000:2.0:1784189249.746893:0:6501:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008cc5f086/0xcc1762b626f8bfae lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x741:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189249.746900:0:6501:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008cc5f086/0xcc1762b626f8bfae lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x741:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189249.746909:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008cc5f086/0xcc1762b626f8bfae lrc: 1/0,0 mode: --/PW res: [0x280000401:0x741:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189249.746915:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008cc5f086/0xcc1762b626f8bfae lrc: 0/0,0 mode: --/PW res: [0x280000401:0x741:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189249.746929:0:6501:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784189249.746931:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d9b1520e/0xcc1762b626f8bfb5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x740:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189249.746937:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dbf4369d000 already unused, calling callback (ffffffffc0b2e230) 00010000:00010000:2.0:1784189249.746940:0:6501:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d9b1520e/0xcc1762b626f8bfb5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x740:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189249.746947:0:6501:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d9b1520e/0xcc1762b626f8bfb5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x740:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189249.746955:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d9b1520e/0xcc1762b626f8bfb5 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x740:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189249.746967:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d9b1520e/0xcc1762b626f8bfb5 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x740:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189249.746978:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784189249.746979:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784189249.746981:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784189249.747047:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00002000:00010000:2.0:1784189249.747105:0:26171:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x73f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1784189249.747110:0:26171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ba033d24/0xcc1762b626f8bfbc lrc: 3/0,1 mode: --/PW res: [0x280000401:0x73f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189249.747118:0:26171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x73f:0x0].0x0 since=3491s v=(0 0) 00010000:00010000:2.0:1784189249.747120:0:26171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x73f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784189249.747124:0:26171:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ba033d24/0xcc1762b626f8bfbc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x73f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189249.747133:0:26171:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ba033d24/0xcc1762b626f8bfbc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x73f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189249.747140:0:26171:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ba033d24/0xcc1762b626f8bfbc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x73f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189249.747146:0:26171:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ba033d24/0xcc1762b626f8bfbc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x73f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189249.747158:0:26171:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1784189249.747171:0:7454:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784189249.747175:0:7454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ba033d24/0xcc1762b626f8bfbc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x73f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189249.747180:0:7454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dbf4369d400 already unused, calling callback (ffffffffc0b2e230) 00010000:00010000:2.0:1784189249.747182:0:7454:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ba033d24/0xcc1762b626f8bfbc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x73f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189249.747189:0:7454:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ba033d24/0xcc1762b626f8bfbc lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x73f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189249.747198:0:7454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ba033d24/0xcc1762b626f8bfbc lrc: 1/0,0 mode: --/PW res: [0x280000401:0x73f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189249.747204:0:7454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ba033d24/0xcc1762b626f8bfbc lrc: 0/0,0 mode: --/PW res: [0x280000401:0x73f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189249.747215:0:7454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784189249.747217:0:7454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784189249.747218:0:7454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1784189249.747259:0:26171:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x73e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1784189249.747264:0:26171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f23aca89/0xcc1762b626f8bfc3 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x73e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189249.747272:0:26171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x73e:0x0].0x0 since=3491s v=(0 0) 00010000:00010000:2.0:1784189249.747275:0:26171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x73e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784189249.747279:0:26171:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f23aca89/0xcc1762b626f8bfc3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x73e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189249.747296:0:26171:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f23aca89/0xcc1762b626f8bfc3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x73e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189249.747304:0:26171:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f23aca89/0xcc1762b626f8bfc3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x73e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189249.747310:0:26171:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f23aca89/0xcc1762b626f8bfc3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x73e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189249.747369:0:26171:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1784189249.747390:0:6501:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784189249.747395:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f23aca89/0xcc1762b626f8bfc3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x73e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189249.747402:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dbf4369de00 already unused, calling callback (ffffffffc0b2e230) 00010000:00010000:2.0:1784189249.747405:0:6501:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f23aca89/0xcc1762b626f8bfc3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x73e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189249.747412:0:6501:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f23aca89/0xcc1762b626f8bfc3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x73e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189249.747422:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f23aca89/0xcc1762b626f8bfc3 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x73e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189249.747428:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f23aca89/0xcc1762b626f8bfc3 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x73e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189249.747447:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784189249.747449:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784189249.747451:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1784189249.747517:0:26171:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x73d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1784189249.747522:0:26171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009430fa1b/0xcc1762b626f8bfca lrc: 3/0,1 mode: --/PW res: [0x280000401:0x73d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189249.747530:0:26171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x73d:0x0].0x0 since=3491s v=(0 0) 00010000:00010000:2.0:1784189249.747532:0:26171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x73d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784189249.747536:0:26171:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009430fa1b/0xcc1762b626f8bfca lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x73d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189249.747545:0:26171:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009430fa1b/0xcc1762b626f8bfca lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x73d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189249.747553:0:26171:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009430fa1b/0xcc1762b626f8bfca lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x73d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189249.747561:0:26171:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009430fa1b/0xcc1762b626f8bfca lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x73d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189249.747587:0:26171:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1784189249.747593:0:7454:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784189249.747597:0:7454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009430fa1b/0xcc1762b626f8bfca lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x73d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189249.747615:0:7454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc04a20b200 already unused, calling callback (ffffffffc0b2e230) 00010000:00010000:2.0:1784189249.747619:0:7454:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009430fa1b/0xcc1762b626f8bfca lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x73d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189249.747626:0:7454:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009430fa1b/0xcc1762b626f8bfca lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x73d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189249.747635:0:7454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009430fa1b/0xcc1762b626f8bfca lrc: 1/0,0 mode: --/PW res: [0x280000401:0x73d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189249.747642:0:7454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009430fa1b/0xcc1762b626f8bfca lrc: 0/0,0 mode: --/PW res: [0x280000401:0x73d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189249.747654:0:7454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784189249.747656:0:7454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784189249.747658:0:7454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1784189249.747701:0:26171:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x73c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1784189249.747706:0:26171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c6b3e208/0xcc1762b626f8bfd1 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x73c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189249.747714:0:26171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x73c:0x0].0x0 since=3491s v=(0 0) 00010000:00010000:2.0:1784189249.747717:0:26171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x73c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784189249.747721:0:26171:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c6b3e208/0xcc1762b626f8bfd1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x73c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189249.747729:0:26171:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c6b3e208/0xcc1762b626f8bfd1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x73c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189249.747743:0:26171:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c6b3e208/0xcc1762b626f8bfd1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x73c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189249.747750:0:26171:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c6b3e208/0xcc1762b626f8bfd1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x73c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189249.747763:0:26171:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1784189249.747769:0:6501:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784189249.747773:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c6b3e208/0xcc1762b626f8bfd1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x73c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189249.747780:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc04a20ba00 already unused, calling callback (ffffffffc0b2e230) 00010000:00010000:2.0:1784189249.747783:0:6501:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c6b3e208/0xcc1762b626f8bfd1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x73c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189249.747790:0:6501:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c6b3e208/0xcc1762b626f8bfd1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x73c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189249.747800:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c6b3e208/0xcc1762b626f8bfd1 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x73c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189249.747807:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c6b3e208/0xcc1762b626f8bfd1 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x73c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189249.747819:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784189249.747826:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784189249.747828:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1784189249.747869:0:26171:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x73b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1784189249.747874:0:26171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000456ffdbd/0xcc1762b626f8bfd8 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x73b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189249.747882:0:26171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x73b:0x0].0x0 since=3491s v=(0 0) 00010000:00010000:2.0:1784189249.747885:0:26171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x73b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784189249.747889:0:26171:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000456ffdbd/0xcc1762b626f8bfd8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x73b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189249.747897:0:26171:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000456ffdbd/0xcc1762b626f8bfd8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x73b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189249.747904:0:26171:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000456ffdbd/0xcc1762b626f8bfd8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x73b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189249.747910:0:26171:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000456ffdbd/0xcc1762b626f8bfd8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x73b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189249.747921:0:26171:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1784189249.747927:0:7454:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784189249.747930:0:7454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000456ffdbd/0xcc1762b626f8bfd8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x73b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189249.747936:0:7454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc04a20a000 already unused, calling callback (ffffffffc0b2e230) 00010000:00010000:2.0:1784189249.747939:0:7454:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000456ffdbd/0xcc1762b626f8bfd8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x73b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189249.747954:0:7454:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000456ffdbd/0xcc1762b626f8bfd8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x73b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189249.747964:0:7454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000456ffdbd/0xcc1762b626f8bfd8 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x73b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189249.747970:0:7454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000456ffdbd/0xcc1762b626f8bfd8 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x73b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189249.747982:0:7454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784189249.747984:0:7454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784189249.747986:0:7454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1784189249.748025:0:26171:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x73a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1784189249.748030:0:26171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000041e819fd/0xcc1762b626f8bfdf lrc: 3/0,1 mode: --/PW res: [0x280000401:0x73a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189249.748037:0:26171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x73a:0x0].0x0 since=3491s v=(0 0) 00010000:00010000:2.0:1784189249.748040:0:26171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x73a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784189249.748043:0:26171:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000041e819fd/0xcc1762b626f8bfdf lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x73a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189249.748051:0:26171:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000041e819fd/0xcc1762b626f8bfdf lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x73a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189249.748058:0:26171:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000041e819fd/0xcc1762b626f8bfdf lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x73a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189249.748071:0:26171:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000041e819fd/0xcc1762b626f8bfdf lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x73a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189249.748088:0:26171:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1784189249.748097:0:6501:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784189249.748102:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000041e819fd/0xcc1762b626f8bfdf lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x73a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189249.748109:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc04a20a200 already unused, calling callback (ffffffffc0b2e230) 00010000:00010000:2.0:1784189249.748112:0:6501:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000041e819fd/0xcc1762b626f8bfdf lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x73a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189249.748121:0:6501:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000041e819fd/0xcc1762b626f8bfdf lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x73a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189249.748130:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000041e819fd/0xcc1762b626f8bfdf lrc: 1/0,0 mode: --/PW res: [0x280000401:0x73a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189249.748136:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000041e819fd/0xcc1762b626f8bfdf lrc: 0/0,0 mode: --/PW res: [0x280000401:0x73a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189249.748147:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784189249.748149:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784189249.748150:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1784189249.748186:0:26171:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x739:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1784189249.748196:0:26171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003341b3a2/0xcc1762b626f8bfe6 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x739:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189249.748204:0:26171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x739:0x0].0x0 since=3491s v=(0 0) 00010000:00010000:2.0:1784189249.748207:0:26171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x739:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784189249.748210:0:26171:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003341b3a2/0xcc1762b626f8bfe6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x739:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189249.748219:0:26171:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003341b3a2/0xcc1762b626f8bfe6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x739:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189249.748226:0:26171:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003341b3a2/0xcc1762b626f8bfe6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x739:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189249.748232:0:26171:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003341b3a2/0xcc1762b626f8bfe6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x739:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189249.748244:0:26171:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1784189249.748250:0:7454:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784189249.748254:0:7454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003341b3a2/0xcc1762b626f8bfe6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x739:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189249.748261:0:7454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc04a20b600 already unused, calling callback (ffffffffc0b2e230) 00010000:00010000:2.0:1784189249.748264:0:7454:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003341b3a2/0xcc1762b626f8bfe6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x739:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189249.748271:0:7454:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003341b3a2/0xcc1762b626f8bfe6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x739:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189249.748288:0:7454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003341b3a2/0xcc1762b626f8bfe6 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x739:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189249.748295:0:7454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003341b3a2/0xcc1762b626f8bfe6 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x739:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189249.748306:0:7454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784189249.748308:0:7454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784189249.748309:0:7454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784189249.748990:0:14684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436300928 00000100:00100000:3.0:1784189249.749001:0:14684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436300928 00000100:00100000:3.0:1784189249.749262:0:14684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 4979 00000100:00100000:3.0:1784189249.749273:0:14684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc07b7e3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:debedd94-805c-42a0-a5e5-41758b2012e9+7:71032:x1870854436300928:12345-192.168.203.12@tcp:101:cp.0 00010000:00010000:3.0:1784189249.749290:0:14684:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784189249.749305:0:14684:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000283735d0/0xcc1762b626f8bfed lrc: 2/0,0 mode: --/PW res: [0x280000400:0x242:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xcbfc5de7fe6c3f8a expref: -99 pid: 14684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189249.749346:0:14684:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000490fcfab/0xcc1762b626f8bee3 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x242:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c3f83 expref: 8 pid: 26164 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189249.749354:0:14684:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x242:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784189249.749358:0:14684:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x242:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784189249.749363:0:14684:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000283735d0/0xcc1762b626f8bfed lrc: 4/0,0 mode: --/PW res: [0x280000400:0x242:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c3f8a expref: 8 pid: 14684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189249.749409:0:14684:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000490fcfab/0xcc1762b626f8bee3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x242:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c3f83 expref: 8 pid: 26164 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189249.749424:0:14684:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000490fcfab/0xcc1762b626f8bee3 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x242:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c3f83 expref: 8 pid: 26164 timeout: 3591 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784189249.749439:0:14684:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc05edaad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:14684:1870854458174592:192.168.203.12@tcp:104: 00000100:00100000:3.0:1784189249.749516:0:14684:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dc08113fd80 going to sleep for 11 seconds 00010000:00010000:3.0:1784189249.749532:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784189249.750177:0:26173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784189249.750363:0:26168:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1784189249.750371:0:26168:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000778f0c98/0xcc1762b626f8bfa7 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x726:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1784189249.751383:0:26168:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x725:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784189249.751393:0:26168:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008c7612c6/0xcc1762b626f8bff4 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x725:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189249.751405:0:26168:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x725:0x0].0x0 since=3491s v=(0 0) 00010000:00010000:1.0:1784189249.751409:0:26168:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x725:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784189249.751415:0:26168:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008c7612c6/0xcc1762b626f8bff4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x725:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189249.751433:0:26168:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008c7612c6/0xcc1762b626f8bff4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x725:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189249.751444:0:26168:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008c7612c6/0xcc1762b626f8bff4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x725:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189249.751466:0:26168:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008c7612c6/0xcc1762b626f8bff4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x725:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189249.751486:0:26168:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1784189249.751532:0:26168:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x724:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784189249.751537:0:26168:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000045b5e7ac/0xcc1762b626f8bffb lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x724:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189249.751544:0:26168:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x724:0x0].0x0 since=3491s v=(0 0) 00010000:00010000:1.0:1784189249.751547:0:26168:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x724:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784189249.751552:0:26168:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000045b5e7ac/0xcc1762b626f8bffb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x724:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189249.751561:0:26168:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000045b5e7ac/0xcc1762b626f8bffb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x724:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189249.751646:0:26168:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000045b5e7ac/0xcc1762b626f8bffb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x724:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189249.751654:0:26168:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000045b5e7ac/0xcc1762b626f8bffb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x724:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189249.751834:0:26168:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1784189249.751847:0:6502:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1784189249.751853:0:6502:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008c7612c6/0xcc1762b626f8bff4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x725:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189249.751868:0:6502:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dbf4710e600 already unused, calling callback (ffffffffc0b2e230) 00010000:00010000:1.0:1784189249.751872:0:6502:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008c7612c6/0xcc1762b626f8bff4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x725:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189249.751881:0:6502:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008c7612c6/0xcc1762b626f8bff4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x725:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189249.751897:0:6502:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008c7612c6/0xcc1762b626f8bff4 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x725:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189249.751904:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008c7612c6/0xcc1762b626f8bff4 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x725:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189249.751924:0:6502:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784189249.751927:0:6502:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000045b5e7ac/0xcc1762b626f8bffb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x724:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189249.751933:0:6502:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dbf4710fe00 already unused, calling callback (ffffffffc0b2e230) 00010000:00010000:1.0:1784189249.751935:0:6502:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000045b5e7ac/0xcc1762b626f8bffb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x724:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189249.751941:0:6502:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000045b5e7ac/0xcc1762b626f8bffb lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x724:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189249.751949:0:6502:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000045b5e7ac/0xcc1762b626f8bffb lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x724:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189249.751962:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000045b5e7ac/0xcc1762b626f8bffb lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x724:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189249.751982:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784189249.751983:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784189249.751985:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1784189249.752035:0:26168:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x723:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784189249.752041:0:26168:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d2d1b2ae/0xcc1762b626f8c002 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x723:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189249.752049:0:26168:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x723:0x0].0x0 since=3491s v=(0 0) 00010000:00010000:1.0:1784189249.752052:0:26168:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x723:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784189249.752056:0:26168:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d2d1b2ae/0xcc1762b626f8c002 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x723:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189249.752064:0:26168:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d2d1b2ae/0xcc1762b626f8c002 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x723:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189249.752071:0:26168:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d2d1b2ae/0xcc1762b626f8c002 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x723:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189249.752077:0:26168:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d2d1b2ae/0xcc1762b626f8c002 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x723:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189249.752089:0:26168:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1784189249.752133:0:26168:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x722:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784189249.752138:0:26168:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000188f2591/0xcc1762b626f8c009 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x722:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189249.752145:0:26168:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x722:0x0].0x0 since=3491s v=(0 0) 00010000:00010000:1.0:1784189249.752147:0:26168:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x722:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784189249.752151:0:26168:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000188f2591/0xcc1762b626f8c009 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x722:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189249.752158:0:26168:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000188f2591/0xcc1762b626f8c009 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x722:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189249.752165:0:26168:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000188f2591/0xcc1762b626f8c009 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x722:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189249.752172:0:26168:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000188f2591/0xcc1762b626f8c009 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x722:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189249.752185:0:26168:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1784189249.752191:0:6502:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1784189249.752195:0:6502:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d2d1b2ae/0xcc1762b626f8c002 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x723:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189249.752201:0:6502:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dbf4710fc00 already unused, calling callback (ffffffffc0b2e230) 00010000:00010000:1.0:1784189249.752204:0:6502:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d2d1b2ae/0xcc1762b626f8c002 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x723:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189249.752221:0:6502:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d2d1b2ae/0xcc1762b626f8c002 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x723:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189249.752230:0:6502:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d2d1b2ae/0xcc1762b626f8c002 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x723:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189249.752236:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d2d1b2ae/0xcc1762b626f8c002 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x723:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189249.752250:0:6502:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784189249.752254:0:6502:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000188f2591/0xcc1762b626f8c009 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x722:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189249.752260:0:6502:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dbf4710e800 already unused, calling callback (ffffffffc0b2e230) 00010000:00010000:1.0:1784189249.752262:0:6502:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000188f2591/0xcc1762b626f8c009 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x722:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189249.752269:0:6502:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000188f2591/0xcc1762b626f8c009 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x722:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189249.752277:0:6502:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000188f2591/0xcc1762b626f8c009 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x722:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189249.752283:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000188f2591/0xcc1762b626f8c009 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x722:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189249.752306:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784189249.752308:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784189249.752309:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784189249.753333:0:26173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784189249.753341:0:7454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:1.0:1784189249.754014:0:26168:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x2c0000401:1795 00000100:00100000:1.0:1784189249.754150:0:26168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc07b5b2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+5:92410:x1870854458174336:12345-0@lo:5:osp-pre-1-0.0 Request processed in 39894us (41056us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189249.754162:0:26168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4976 00000100:00100000:0.0:1784189249.754395:0:92410:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc07b5b1c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:92410:1870854458174336:0@lo:5:osp-pre-1-0.0 00000004:00080000:0.0:1784189249.754410:0:92410:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x2c0000401:0x741:0x0] from OST, last_created [0x2c0000401:0x741:0x0]last_used is [0x2c0000401:0x703:0x0] 00000100:00100000:0.0:1784189249.754481:0:92410:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc07b5b1180 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:92410:1870854458174848:0@lo:5:osp-pre-1-0.0 00000100:00100000:0.0:1784189249.754521:0:92410:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784189249.754544:0:92410:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dc04673ff00 going to sleep for 11 seconds 00000100:00100000:0.0:1784189249.754560:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc07b5b1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1870854458174720:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1784189249.754617:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784189249.754668:0:26165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458174848 00000100:00100000:0.0:1784189249.754675:0:26165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458174848 00000100:00100000:0.0:1784189249.754709:0:26165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4980 00000100:00100000:0.0:1784189249.754718:0:26165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc07b5b0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+5:92410:x1870854458174848:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:0.0:1784189249.754753:0:26165:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000401 at 1858 00000100:00100000:3.0:1784189249.757354:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1784189249.757407:0:14684:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc05edaad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:14684:1870854458174592:192.168.203.12@tcp:104: 00010000:00010000:3.0:1784189249.757449:0:14684:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000283735d0/0xcc1762b626f8bfed lrc: 3/0,0 mode: --/PW res: [0x280000400:0x242:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c3f8a expref: 8 pid: 14684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189249.757468:0:14684:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc0755a4200, rc 0) 00000100:00100000:1.0:1784189249.757470:0:26172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436301056 00000100:00100000:1.0:1784189249.757477:0:26172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436301056 00010000:00010000:1.0:1784189249.757509:0:26172:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000490fcfab/0xcc1762b626f8bee3 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x242:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c3f83 expref: 9 pid: 26164 timeout: 3591 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784189249.757529:0:14684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc07b7e3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:debedd94-805c-42a0-a5e5-41758b2012e9+9:71032:x1870854436300928:12345-192.168.203.12@tcp:101:cp.0 Request processed in 8256us (10483us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189249.757538:0:14684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 4979 00000100:00100000:1.0:1784189249.757554:0:26172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 2552 00000100:00100000:1.0:1784189249.757574:0:26172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc0711a7450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:debedd94-805c-42a0-a5e5-41758b2012e9+8:2396:x1870854436301056:12345-192.168.203.12@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1784189249.757588:0:26172:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784189249.757607:0:26172:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000490fcfab/0xcc1762b626f8bee3 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x242:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c3f83 expref: 8 pid: 26164 timeout: 3591 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189249.757621:0:26172:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000490fcfab/0xcc1762b626f8bee3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x242:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c3f83 expref: 8 pid: 26164 timeout: 3591 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189249.757642:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784189249.757643:0:26172:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000490fcfab/0xcc1762b626f8bee3 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x242:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c3f83 expref: 8 pid: 26164 timeout: 3591 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189249.757657:0:26172:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x242:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784189249.757667:0:26172:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x242:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784189249.757676:0:26172:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000283735d0/0xcc1762b626f8bfed lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x242:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c3f8a expref: 7 pid: 14684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189249.757686:0:26172:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000283735d0/0xcc1762b626f8bfed lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x242:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c3f8a expref: 7 pid: 14684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189249.757717:0:26172:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000283735d0/0xcc1762b626f8bfed lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x242:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c3f8a expref: 7 pid: 14684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784189249.757730:0:26172:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc05f02e300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:26172:1870854458174976:192.168.203.12@tcp:105: 00000100:00100000:1.0:1784189249.757778:0:26172:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dc050e11c00 going to sleep for 11 seconds 00002000:00010000:3.0:1784189249.758479:0:26171:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x738:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784189249.758487:0:26171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000097385c8a/0xcc1762b626f8c010 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x738:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189249.758498:0:26171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x738:0x0].0x0 since=3491s v=(0 0) 00010000:00010000:3.0:1784189249.758509:0:26171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x738:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784189249.758514:0:26171:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000097385c8a/0xcc1762b626f8c010 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x738:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189249.758526:0:26171:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000097385c8a/0xcc1762b626f8c010 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x738:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189249.758534:0:26171:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000097385c8a/0xcc1762b626f8c010 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x738:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189249.758540:0:26171:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000097385c8a/0xcc1762b626f8c010 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x738:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189249.758560:0:26171:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1784189249.758788:0:6502:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00002000:00010000:3.0:1784189249.758791:0:26171:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x737:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784189249.758796:0:6502:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000097385c8a/0xcc1762b626f8c010 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x738:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189249.758799:0:26171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000043a4eaa4/0xcc1762b626f8c017 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x737:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189249.758814:0:6502:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc0755a5400 already unused, calling callback (ffffffffc0b2e230) 00010000:00010000:3.0:1784189249.758819:0:26171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x737:0x0].0x0 since=3491s v=(0 0) 00010000:00010000:1.0:1784189249.758820:0:6502:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000097385c8a/0xcc1762b626f8c010 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x738:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189249.758826:0:26171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x737:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784189249.758835:0:26171:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000043a4eaa4/0xcc1762b626f8c017 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x737:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189249.758839:0:6502:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000097385c8a/0xcc1762b626f8c010 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x738:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189249.758857:0:26171:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000043a4eaa4/0xcc1762b626f8c017 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x737:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189249.758864:0:6502:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000097385c8a/0xcc1762b626f8c010 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x738:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189249.758867:0:26171:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000043a4eaa4/0xcc1762b626f8c017 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x737:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189249.758874:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000097385c8a/0xcc1762b626f8c010 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x738:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189249.758882:0:26171:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000043a4eaa4/0xcc1762b626f8c017 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x737:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189249.758913:0:26171:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1784189249.758914:0:6502:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784189249.758919:0:6502:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000043a4eaa4/0xcc1762b626f8c017 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x737:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189249.758927:0:6502:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc0755a4000 already unused, calling callback (ffffffffc0b2e230) 00010000:00010000:1.0:1784189249.758932:0:6502:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000043a4eaa4/0xcc1762b626f8c017 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x737:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189249.758940:0:6502:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000043a4eaa4/0xcc1762b626f8c017 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x737:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189249.758951:0:6502:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000043a4eaa4/0xcc1762b626f8c017 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x737:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1784189249.758954:0:26171:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x736:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784189249.758966:0:26171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004cf1f60e/0xcc1762b626f8c01e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x736:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189249.758966:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000043a4eaa4/0xcc1762b626f8c017 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x737:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189249.758987:0:26171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x736:0x0].0x0 since=3491s v=(0 0) 00010000:00010000:3.0:1784189249.758990:0:26171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x736:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784189249.758992:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784189249.758995:0:26171:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004cf1f60e/0xcc1762b626f8c01e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x736:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189249.758996:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784189249.759000:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784189249.759010:0:26171:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004cf1f60e/0xcc1762b626f8c01e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x736:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189249.759018:0:26171:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004cf1f60e/0xcc1762b626f8c01e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x736:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189249.759026:0:26171:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004cf1f60e/0xcc1762b626f8c01e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x736:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189249.759040:0:26171:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1784189249.759076:0:26171:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x735:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784189249.759081:0:26171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e88c95bf/0xcc1762b626f8c025 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x735:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189249.759095:0:26171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x735:0x0].0x0 since=3491s v=(0 0) 00010000:00010000:3.0:1784189249.759098:0:26171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x735:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784189249.759102:0:26171:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e88c95bf/0xcc1762b626f8c025 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x735:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189249.759111:0:26171:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e88c95bf/0xcc1762b626f8c025 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x735:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189249.759120:0:26171:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e88c95bf/0xcc1762b626f8c025 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x735:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189249.759127:0:26171:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e88c95bf/0xcc1762b626f8c025 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x735:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189249.759141:0:26171:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1784189249.759149:0:6501:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1784189249.759154:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004cf1f60e/0xcc1762b626f8c01e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x736:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189249.759161:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc0755a4400 already unused, calling callback (ffffffffc0b2e230) 00010000:00010000:3.0:1784189249.759165:0:6501:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004cf1f60e/0xcc1762b626f8c01e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x736:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189249.759173:0:6501:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004cf1f60e/0xcc1762b626f8c01e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x736:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189249.759194:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004cf1f60e/0xcc1762b626f8c01e lrc: 1/0,0 mode: --/PW res: [0x280000401:0x736:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189249.759202:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004cf1f60e/0xcc1762b626f8c01e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x736:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189249.759216:0:6501:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784189249.759220:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e88c95bf/0xcc1762b626f8c025 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x735:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189249.759227:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc0755a5600 already unused, calling callback (ffffffffc0b2e230) 00010000:00010000:3.0:1784189249.759230:0:6501:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e88c95bf/0xcc1762b626f8c025 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x735:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189249.759237:0:6501:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e88c95bf/0xcc1762b626f8c025 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x735:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189249.759247:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e88c95bf/0xcc1762b626f8c025 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x735:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189249.759254:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e88c95bf/0xcc1762b626f8c025 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x735:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189249.759264:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784189249.759266:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784189249.759273:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1784189249.759335:0:26171:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x734:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784189249.759341:0:26171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000090219bd6/0xcc1762b626f8c02c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x734:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189249.759348:0:26171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x734:0x0].0x0 since=3491s v=(0 0) 00010000:00010000:3.0:1784189249.759351:0:26171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x734:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784189249.759355:0:26171:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000090219bd6/0xcc1762b626f8c02c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x734:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189249.759363:0:26171:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000090219bd6/0xcc1762b626f8c02c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x734:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189249.759370:0:26171:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000090219bd6/0xcc1762b626f8c02c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x734:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189249.759377:0:26171:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000090219bd6/0xcc1762b626f8c02c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x734:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189249.759391:0:26171:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1784189249.759391:0:26165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc07b5b0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+6:92410:x1870854458174848:12345-0@lo:5:osp-pre-1-0.0 Request processed in 4672us (4867us total) trans 4294968957 rc 0/0 00000100:00100000:0.0:1784189249.759401:0:26165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4980 00002000:00010000:3.0:1784189249.759424:0:26171:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x733:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00000100:00100000:0.0:1784189249.759434:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458174720 00000100:00100000:0.0:1784189249.759440:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458174720 00000100:00100000:0.0:1784189249.759472:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2012 00000100:00100000:0.0:1784189249.759480:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc07b5b1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3642:x1870854458174720:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1784189249.759500:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 210112 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1784189249.759533:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc07b5b1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3642:x1870854458174720:12345-0@lo:13:osp-pre-1-0.0 Request processed in 54us (4915us total) trans 0 rc 0/0 00000100:00100000:0.0:1784189249.759539:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2012 00000100:00100000:0.0:1784189249.759605:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc07b5b1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1870854458174720:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1784189249.759732:0:6502:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784189249.759738:0:6502:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000090219bd6/0xcc1762b626f8c02c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x734:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189249.759746:0:6502:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc0755a5800 already unused, calling callback (ffffffffc0b2e230) 00010000:00010000:1.0:1784189249.759756:0:6502:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000090219bd6/0xcc1762b626f8c02c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x734:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189249.759764:0:6502:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000090219bd6/0xcc1762b626f8c02c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x734:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189249.759774:0:6502:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000090219bd6/0xcc1762b626f8c02c lrc: 1/0,0 mode: --/PW res: [0x280000401:0x734:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189249.759781:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000090219bd6/0xcc1762b626f8c02c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x734:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189249.759793:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784189249.759794:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784189249.759796:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784189249.759941:0:92410:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc07b5b1180 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:92410:1870854458174848:0@lo:5:osp-pre-1-0.0 00000004:00080000:0.0:1784189249.759960:0:92410:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x2c0000401:0x741:0x0]-[0x2c0000401:0x761:0x0] 00010000:00010000:0.0:1784189249.759977:0:26173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784189249.759983:0:7454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784189249.764105:0:26171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000062d13dad/0xcc1762b626f8c033 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x733:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189249.764125:0:26171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x733:0x0].0x0 since=3491s v=(0 0) 00010000:00010000:3.0:1784189249.764129:0:26171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x733:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784189249.764135:0:26171:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000062d13dad/0xcc1762b626f8c033 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x733:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189249.764162:0:26171:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000062d13dad/0xcc1762b626f8c033 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x733:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189249.764173:0:26171:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000062d13dad/0xcc1762b626f8c033 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x733:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189249.764181:0:26171:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000062d13dad/0xcc1762b626f8c033 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x733:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189249.764210:0:26171:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1784189249.764314:0:26171:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x732:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784189249.764336:0:26171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b12f7059/0xcc1762b626f8c03a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x732:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189249.764344:0:26171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x732:0x0].0x0 since=3491s v=(0 0) 00010000:00010000:3.0:1784189249.764347:0:26171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x732:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784189249.764352:0:26171:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b12f7059/0xcc1762b626f8c03a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x732:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189249.764361:0:26171:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b12f7059/0xcc1762b626f8c03a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x732:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189249.764368:0:26171:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b12f7059/0xcc1762b626f8c03a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x732:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189249.764384:0:26171:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b12f7059/0xcc1762b626f8c03a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x732:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189249.764403:0:26171:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:3.0:1784189249.764443:0:26171:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x731:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784189249.764448:0:26171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000091d4841/0xcc1762b626f8c041 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x731:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189249.764455:0:26171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x731:0x0].0x0 since=3491s v=(0 0) 00010000:00010000:3.0:1784189249.764458:0:26171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x731:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784189249.764462:0:26171:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000091d4841/0xcc1762b626f8c041 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x731:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189249.764469:0:26171:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000091d4841/0xcc1762b626f8c041 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x731:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189249.764477:0:26171:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000091d4841/0xcc1762b626f8c041 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x731:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189249.764482:0:26171:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000091d4841/0xcc1762b626f8c041 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x731:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189249.764495:0:26171:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:3.0:1784189249.764531:0:26171:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x730:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784189249.764536:0:26171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000067956617/0xcc1762b626f8c048 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x730:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189249.764549:0:26171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x730:0x0].0x0 since=3491s v=(0 0) 00010000:00010000:3.0:1784189249.764552:0:26171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x730:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784189249.764555:0:26171:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000067956617/0xcc1762b626f8c048 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x730:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189249.764564:0:26171:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000067956617/0xcc1762b626f8c048 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x730:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189249.764588:0:26171:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000067956617/0xcc1762b626f8c048 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x730:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189249.764595:0:26171:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000067956617/0xcc1762b626f8c048 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x730:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189249.764608:0:26171:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00002000:00010000:3.0:1784189249.764647:0:26171:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x72f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784189249.764652:0:26171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000005567574/0xcc1762b626f8c04f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x72f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189249.764660:0:26171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x72f:0x0].0x0 since=3491s v=(0 0) 00010000:00010000:3.0:1784189249.764663:0:26171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x72f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784189249.764667:0:26171:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000005567574/0xcc1762b626f8c04f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x72f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189249.764676:0:26171:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000005567574/0xcc1762b626f8c04f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x72f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189249.764704:0:26171:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000005567574/0xcc1762b626f8c04f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x72f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189249.764711:0:26171:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000005567574/0xcc1762b626f8c04f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x72f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189249.764720:0:26171:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00002000:00010000:3.0:1784189249.764759:0:26171:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x72e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784189249.764764:0:26171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006a15f861/0xcc1762b626f8c056 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x72e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189249.764771:0:26171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x72e:0x0].0x0 since=3491s v=(0 0) 00010000:00010000:3.0:1784189249.764774:0:26171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x72e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784189249.764778:0:26171:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006a15f861/0xcc1762b626f8c056 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x72e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189249.764787:0:26171:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006a15f861/0xcc1762b626f8c056 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x72e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189249.764795:0:26171:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006a15f861/0xcc1762b626f8c056 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x72e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189249.764802:0:26171:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006a15f861/0xcc1762b626f8c056 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x72e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189249.764820:0:26173:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:3.0:1784189249.764821:0:26171:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00010000:00010000:0.0:1784189249.764837:0:26173:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000062d13dad/0xcc1762b626f8c033 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x733:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1784189249.764856:0:26171:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x72d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784189249.764856:0:26173:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc0755a5000 already unused, calling callback (ffffffffc0b2e230) 00010000:00010000:3.0:1784189249.764861:0:26171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d638fecc/0xcc1762b626f8c05d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x72d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189249.764861:0:26173:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000062d13dad/0xcc1762b626f8c033 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x733:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189249.764869:0:26171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x72d:0x0].0x0 since=3491s v=(0 0) 00010000:00010000:0.0:1784189249.764871:0:26173:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000062d13dad/0xcc1762b626f8c033 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x733:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189249.764872:0:26171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x72d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784189249.764876:0:26171:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d638fecc/0xcc1762b626f8c05d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x72d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189249.764883:0:26171:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d638fecc/0xcc1762b626f8c05d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x72d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189249.764887:0:26173:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000062d13dad/0xcc1762b626f8c033 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x733:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189249.764891:0:26171:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d638fecc/0xcc1762b626f8c05d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x72d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189249.764896:0:26173:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000062d13dad/0xcc1762b626f8c033 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x733:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189249.764899:0:26171:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d638fecc/0xcc1762b626f8c05d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x72d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189249.764906:0:26171:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to regular blp list, 6 blwis in pool 00010000:00010000:0.0:1784189249.764917:0:26173:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:0.0:1784189249.764920:0:26173:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b12f7059/0xcc1762b626f8c03a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x732:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189249.764926:0:26173:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc0755a4600 already unused, calling callback (ffffffffc0b2e230) 00010000:00010000:0.0:1784189249.764929:0:26173:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b12f7059/0xcc1762b626f8c03a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x732:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189249.764937:0:26173:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b12f7059/0xcc1762b626f8c03a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x732:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1784189249.764938:0:26171:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x72c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784189249.764942:0:26171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000004c81696/0xcc1762b626f8c064 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x72c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189249.764947:0:26173:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b12f7059/0xcc1762b626f8c03a lrc: 1/0,0 mode: --/PW res: [0x280000401:0x732:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189249.764949:0:26171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x72c:0x0].0x0 since=3491s v=(0 0) 00010000:00010000:3.0:1784189249.764956:0:26171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x72c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784189249.764959:0:26173:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b12f7059/0xcc1762b626f8c03a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x732:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189249.764960:0:26171:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000004c81696/0xcc1762b626f8c064 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x72c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189249.764970:0:26171:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000004c81696/0xcc1762b626f8c064 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x72c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189249.764974:0:26173:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:0.0:1784189249.764977:0:26173:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000091d4841/0xcc1762b626f8c041 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x731:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189249.764978:0:26171:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000004c81696/0xcc1762b626f8c064 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x72c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189249.764984:0:26173:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc07116f200 already unused, calling callback (ffffffffc0b2e230) 00010000:00010000:3.0:1784189249.764986:0:26171:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000004c81696/0xcc1762b626f8c064 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x72c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189249.764987:0:26173:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000091d4841/0xcc1762b626f8c041 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x731:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189249.764995:0:26171:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00010000:00010000:0.0:1784189249.764995:0:26173:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000091d4841/0xcc1762b626f8c041 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x731:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189249.765004:0:26173:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000091d4841/0xcc1762b626f8c041 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x731:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189249.765011:0:26173:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000091d4841/0xcc1762b626f8c041 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x731:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189249.765021:0:26173:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:0.0:1784189249.765025:0:26173:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000067956617/0xcc1762b626f8c048 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x730:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1784189249.765026:0:26171:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x72b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784189249.765031:0:26171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d7af1b89/0xcc1762b626f8c06b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x72b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189249.765031:0:26173:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc07116e800 already unused, calling callback (ffffffffc0b2e230) 00010000:00010000:3.0:1784189249.765038:0:26171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x72b:0x0].0x0 since=3491s v=(0 0) 00010000:00010000:0.0:1784189249.765039:0:26173:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000067956617/0xcc1762b626f8c048 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x730:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189249.765041:0:26171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x72b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784189249.765045:0:26171:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d7af1b89/0xcc1762b626f8c06b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x72b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189249.765047:0:26173:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000067956617/0xcc1762b626f8c048 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x730:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189249.765054:0:26171:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d7af1b89/0xcc1762b626f8c06b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x72b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189249.765057:0:26173:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000067956617/0xcc1762b626f8c048 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x730:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189249.765062:0:26171:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d7af1b89/0xcc1762b626f8c06b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x72b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189249.765064:0:26173:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000067956617/0xcc1762b626f8c048 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x730:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189249.765073:0:26171:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d7af1b89/0xcc1762b626f8c06b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x72b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189249.765076:0:26173:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1784189249.765079:0:26173:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000005567574/0xcc1762b626f8c04f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x72f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189249.765082:0:26171:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00010000:00010000:0.0:1784189249.765086:0:26173:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc07116ee00 already unused, calling callback (ffffffffc0b2e230) 00010000:00010000:0.0:1784189249.765089:0:26173:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000005567574/0xcc1762b626f8c04f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x72f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189249.765096:0:26173:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000005567574/0xcc1762b626f8c04f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x72f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189249.765105:0:26173:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000005567574/0xcc1762b626f8c04f lrc: 1/0,0 mode: --/PW res: [0x280000401:0x72f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1784189249.765112:0:26171:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x72a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784189249.765112:0:26173:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000005567574/0xcc1762b626f8c04f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x72f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189249.765116:0:26171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006c76bcb1/0xcc1762b626f8c072 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x72a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189249.765124:0:26171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x72a:0x0].0x0 since=3491s v=(0 0) 00010000:00010000:3.0:1784189249.765127:0:26171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x72a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784189249.765128:0:26173:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:3.0:1784189249.765131:0:26171:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006c76bcb1/0xcc1762b626f8c072 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x72a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189249.765132:0:26173:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006a15f861/0xcc1762b626f8c056 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x72e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189249.765139:0:26173:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc07116f400 already unused, calling callback (ffffffffc0b2e230) 00010000:00010000:3.0:1784189249.765140:0:26171:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006c76bcb1/0xcc1762b626f8c072 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x72a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189249.765142:0:26173:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006a15f861/0xcc1762b626f8c056 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x72e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189249.765148:0:26171:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006c76bcb1/0xcc1762b626f8c072 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x72a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189249.765150:0:26173:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006a15f861/0xcc1762b626f8c056 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x72e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189249.765156:0:26171:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006c76bcb1/0xcc1762b626f8c072 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x72a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189249.765160:0:26173:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006a15f861/0xcc1762b626f8c056 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x72e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189249.765163:0:26171:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00010000:00010000:0.0:1784189249.765166:0:26173:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006a15f861/0xcc1762b626f8c056 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x72e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189249.765175:0:26173:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1784189249.765178:0:26173:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d638fecc/0xcc1762b626f8c05d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x72d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189249.765185:0:26173:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc07116f600 already unused, calling callback (ffffffffc0b2e230) 00010000:00010000:0.0:1784189249.765188:0:26173:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d638fecc/0xcc1762b626f8c05d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x72d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1784189249.765191:0:26171:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x729:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784189249.765195:0:26171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000022fa77b/0xcc1762b626f8c079 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x729:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189249.765206:0:26171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x729:0x0].0x0 since=3491s v=(0 0) 00010000:00010000:0.0:1784189249.765206:0:26173:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d638fecc/0xcc1762b626f8c05d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x72d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189249.765209:0:26171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x729:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784189249.765214:0:26171:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000022fa77b/0xcc1762b626f8c079 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x729:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189249.765216:0:26173:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d638fecc/0xcc1762b626f8c05d lrc: 1/0,0 mode: --/PW res: [0x280000401:0x72d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189249.765222:0:26171:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000022fa77b/0xcc1762b626f8c079 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x729:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189249.765224:0:26173:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d638fecc/0xcc1762b626f8c05d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x72d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189249.765231:0:26171:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000022fa77b/0xcc1762b626f8c079 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x729:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189249.765235:0:26173:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1784189249.765238:0:26171:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000022fa77b/0xcc1762b626f8c079 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x729:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189249.765238:0:26173:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000004c81696/0xcc1762b626f8c064 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x72c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189249.765244:0:26173:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc07116ea00 already unused, calling callback (ffffffffc0b2e230) 00010000:00010000:3.0:1784189249.765247:0:26171:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:0.0:1784189249.765248:0:26173:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000004c81696/0xcc1762b626f8c064 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x72c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189249.765254:0:26173:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000004c81696/0xcc1762b626f8c064 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x72c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189249.765263:0:26173:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000004c81696/0xcc1762b626f8c064 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x72c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189249.765269:0:26173:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000004c81696/0xcc1762b626f8c064 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x72c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1784189249.765277:0:26171:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x728:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784189249.765281:0:26171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d358cced/0xcc1762b626f8c080 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x728:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189249.765288:0:26171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x728:0x0].0x0 since=3491s v=(0 0) 00010000:00010000:0.0:1784189249.765290:0:26173:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1784189249.765291:0:26171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x728:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784189249.765293:0:26173:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d7af1b89/0xcc1762b626f8c06b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x72b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189249.765295:0:26171:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d358cced/0xcc1762b626f8c080 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x728:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189249.765301:0:26173:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc07116f800 already unused, calling callback (ffffffffc0b2e230) 00010000:00010000:0.0:1784189249.765304:0:26173:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d7af1b89/0xcc1762b626f8c06b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x72b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189249.765305:0:26171:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d358cced/0xcc1762b626f8c080 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x728:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189249.765312:0:26173:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d7af1b89/0xcc1762b626f8c06b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x72b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189249.765340:0:26171:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d358cced/0xcc1762b626f8c080 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x728:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189249.765341:0:26173:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d7af1b89/0xcc1762b626f8c06b lrc: 1/0,0 mode: --/PW res: [0x280000401:0x72b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189249.765349:0:26171:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d358cced/0xcc1762b626f8c080 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x728:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189249.765350:0:26173:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d7af1b89/0xcc1762b626f8c06b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x72b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189249.765357:0:26171:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:0.0:1784189249.765361:0:26173:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1784189249.765363:0:26173:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006c76bcb1/0xcc1762b626f8c072 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x72a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189249.765368:0:26173:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc07116fe00 already unused, calling callback (ffffffffc0b2e230) 00010000:00010000:0.0:1784189249.765371:0:26173:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006c76bcb1/0xcc1762b626f8c072 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x72a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189249.765388:0:26173:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006c76bcb1/0xcc1762b626f8c072 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x72a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1784189249.765390:0:26171:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x727:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784189249.765394:0:26171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007ca946a3/0xcc1762b626f8c087 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x727:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189249.765398:0:26173:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006c76bcb1/0xcc1762b626f8c072 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x72a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189249.765401:0:26171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x727:0x0].0x0 since=3491s v=(0 0) 00010000:00010000:3.0:1784189249.765404:0:26171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x727:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784189249.765406:0:26173:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006c76bcb1/0xcc1762b626f8c072 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x72a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189249.765408:0:26171:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007ca946a3/0xcc1762b626f8c087 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x727:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189249.765416:0:26171:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007ca946a3/0xcc1762b626f8c087 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x727:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189249.765418:0:26173:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1784189249.765421:0:26173:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000022fa77b/0xcc1762b626f8c079 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x729:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189249.765425:0:26171:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007ca946a3/0xcc1762b626f8c087 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x727:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189249.765427:0:26173:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc07116f000 already unused, calling callback (ffffffffc0b2e230) 00010000:00010000:0.0:1784189249.765430:0:26173:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000022fa77b/0xcc1762b626f8c079 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x729:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189249.765437:0:26173:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000022fa77b/0xcc1762b626f8c079 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x729:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189249.765446:0:26173:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000022fa77b/0xcc1762b626f8c079 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x729:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189249.765452:0:26171:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007ca946a3/0xcc1762b626f8c087 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x727:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189249.765454:0:26173:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000022fa77b/0xcc1762b626f8c079 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x729:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189249.765473:0:26171:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1784189249.765477:0:26173:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1784189249.765480:0:26173:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d358cced/0xcc1762b626f8c080 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x728:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189249.765486:0:26173:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc07116e000 already unused, calling callback (ffffffffc0b2e230) 00010000:00010000:0.0:1784189249.765490:0:26173:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d358cced/0xcc1762b626f8c080 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x728:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189249.765497:0:26173:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d358cced/0xcc1762b626f8c080 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x728:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1784189249.765507:0:26171:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x726:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784189249.765507:0:26173:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d358cced/0xcc1762b626f8c080 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x728:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189249.765512:0:26171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000006c4aa/0xcc1762b626f8c08e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x726:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189249.765515:0:26173:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d358cced/0xcc1762b626f8c080 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x728:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189249.765520:0:26171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x726:0x0].0x0 since=3491s v=(0 0) 00010000:00010000:3.0:1784189249.765523:0:26171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x726:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784189249.765526:0:26171:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000006c4aa/0xcc1762b626f8c08e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x726:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189249.765526:0:26173:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784189249.765529:0:26173:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007ca946a3/0xcc1762b626f8c087 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x727:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189249.765535:0:26171:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000006c4aa/0xcc1762b626f8c08e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x726:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189249.765536:0:26173:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc07116fa00 already unused, calling callback (ffffffffc0b2e230) 00010000:00010000:0.0:1784189249.765539:0:26173:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007ca946a3/0xcc1762b626f8c087 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x727:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189249.765543:0:26171:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000006c4aa/0xcc1762b626f8c08e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x726:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189249.765550:0:26171:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000006c4aa/0xcc1762b626f8c08e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x726:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189249.765556:0:26173:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007ca946a3/0xcc1762b626f8c087 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x727:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189249.765559:0:26171:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1784189249.765577:0:26173:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007ca946a3/0xcc1762b626f8c087 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x727:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189249.765585:0:26173:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007ca946a3/0xcc1762b626f8c087 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x727:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189249.765598:0:26173:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00002000:00010000:3.0:1784189249.765601:0:26171:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x725:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784189249.765605:0:26171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a47d5412/0xcc1762b626f8c095 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x725:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189249.765611:0:26173:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000006c4aa/0xcc1762b626f8c08e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x726:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189249.765613:0:26171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x725:0x0].0x0 since=3491s v=(0 0) 00010000:00010000:0.0:1784189249.765617:0:26173:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc07116e400 already unused, calling callback (ffffffffc0b2e230) 00010000:00010000:3.0:1784189249.765620:0:26171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x725:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784189249.765620:0:26173:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000006c4aa/0xcc1762b626f8c08e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x726:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189249.765625:0:26171:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a47d5412/0xcc1762b626f8c095 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x725:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189249.765628:0:26173:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000006c4aa/0xcc1762b626f8c08e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x726:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189249.765634:0:26171:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a47d5412/0xcc1762b626f8c095 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x725:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189249.765637:0:26173:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000006c4aa/0xcc1762b626f8c08e lrc: 1/0,0 mode: --/PW res: [0x280000401:0x726:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189249.765642:0:26171:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a47d5412/0xcc1762b626f8c095 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x725:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189249.765649:0:26171:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a47d5412/0xcc1762b626f8c095 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x725:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189249.765657:0:26171:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1784189249.765697:0:26171:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x724:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784189249.765701:0:26171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f23aca89/0xcc1762b626f8c09c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x724:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189249.765708:0:26171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x724:0x0].0x0 since=3491s v=(0 0) 00010000:00010000:3.0:1784189249.765710:0:26171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x724:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784189249.765714:0:26171:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f23aca89/0xcc1762b626f8c09c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x724:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189249.765721:0:26171:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f23aca89/0xcc1762b626f8c09c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x724:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189249.765728:0:26171:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f23aca89/0xcc1762b626f8c09c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x724:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189249.765739:0:26171:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f23aca89/0xcc1762b626f8c09c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x724:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189249.765748:0:26171:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:3.0:1784189249.765785:0:26171:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x723:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784189249.765790:0:26171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ba033d24/0xcc1762b626f8c0a3 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x723:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189249.765797:0:26171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x723:0x0].0x0 since=3491s v=(0 0) 00010000:00010000:3.0:1784189249.765801:0:26171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x723:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784189249.765804:0:26171:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ba033d24/0xcc1762b626f8c0a3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x723:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189249.765813:0:26171:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ba033d24/0xcc1762b626f8c0a3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x723:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189249.765821:0:26171:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ba033d24/0xcc1762b626f8c0a3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x723:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189249.765828:0:26171:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ba033d24/0xcc1762b626f8c0a3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x723:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189249.765836:0:26171:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:3.0:1784189249.765869:0:26171:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x722:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784189249.765874:0:26171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d9b1520e/0xcc1762b626f8c0aa lrc: 3/0,1 mode: --/PW res: [0x280000401:0x722:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189249.765886:0:26171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x722:0x0].0x0 since=3491s v=(0 0) 00010000:00010000:3.0:1784189249.765889:0:26171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x722:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784189249.765894:0:26171:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d9b1520e/0xcc1762b626f8c0aa lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x722:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189249.765903:0:26171:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d9b1520e/0xcc1762b626f8c0aa lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x722:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189249.765911:0:26171:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d9b1520e/0xcc1762b626f8c0aa lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x722:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189249.765918:0:26171:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d9b1520e/0xcc1762b626f8c0aa lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x722:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189249.765926:0:26171:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00010000:00010000:1.0:1784189249.766127:0:6502:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:1.0:1784189249.766135:0:6502:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a47d5412/0xcc1762b626f8c095 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x725:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189249.766146:0:6502:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc07116ec00 already unused, calling callback (ffffffffc0b2e230) 00010000:00010000:1.0:1784189249.766151:0:6502:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a47d5412/0xcc1762b626f8c095 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x725:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189249.766162:0:6502:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a47d5412/0xcc1762b626f8c095 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x725:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00080000:3.0:1784189249.766163:0:26171:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x280000401:1794 00010000:00010000:1.0:1784189249.766180:0:6502:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a47d5412/0xcc1762b626f8c095 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x725:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189249.766193:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a47d5412/0xcc1762b626f8c095 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x725:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189249.766211:0:6502:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1784189249.766215:0:6502:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f23aca89/0xcc1762b626f8c09c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x724:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189249.766222:0:6502:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dbf4369de00 already unused, calling callback (ffffffffc0b2e230) 00010000:00010000:1.0:1784189249.766226:0:6502:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f23aca89/0xcc1762b626f8c09c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x724:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189249.766234:0:6502:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f23aca89/0xcc1762b626f8c09c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x724:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189249.766245:0:6502:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f23aca89/0xcc1762b626f8c09c lrc: 1/0,0 mode: --/PW res: [0x280000401:0x724:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189249.766252:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f23aca89/0xcc1762b626f8c09c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x724:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784189249.766256:0:26171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc05f02ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+5:92408:x1870854458174464:12345-0@lo:5:osp-pre-0-0.0 Request processed in 47438us (52793us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189249.766273:0:26171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4977 00010000:00010000:1.0:1784189249.766274:0:6502:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1784189249.766280:0:6502:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ba033d24/0xcc1762b626f8c0a3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x723:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189249.766287:0:6502:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dbf4369d400 already unused, calling callback (ffffffffc0b2e230) 00010000:00010000:1.0:1784189249.766298:0:6502:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ba033d24/0xcc1762b626f8c0a3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x723:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189249.766305:0:6502:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ba033d24/0xcc1762b626f8c0a3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x723:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189249.766316:0:6502:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ba033d24/0xcc1762b626f8c0a3 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x723:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189249.766343:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ba033d24/0xcc1762b626f8c0a3 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x723:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189249.766357:0:6502:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784189249.766361:0:6502:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d9b1520e/0xcc1762b626f8c0aa lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x722:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189249.766366:0:6502:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dbf4369d000 already unused, calling callback (ffffffffc0b2e230) 00010000:00010000:1.0:1784189249.766369:0:6502:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d9b1520e/0xcc1762b626f8c0aa lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x722:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189249.766376:0:7454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784189249.766383:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784189249.766446:0:6502:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d9b1520e/0xcc1762b626f8c0aa lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x722:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189249.766459:0:6502:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d9b1520e/0xcc1762b626f8c0aa lrc: 1/0,0 mode: --/PW res: [0x280000401:0x722:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189249.766466:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d9b1520e/0xcc1762b626f8c0aa lrc: 0/0,0 mode: --/PW res: [0x280000401:0x722:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189249.766484:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784189249.766486:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784189249.766487:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784189249.766523:0:92408:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc05f02d500 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:92408:1870854458174464:0@lo:5:osp-pre-0-0.0 00000004:00080000:1.0:1784189249.766538:0:92408:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x280000401:0x741:0x0] from OST, last_created [0x280000401:0x741:0x0]last_used is [0x280000401:0x702:0x0] 00000100:00100000:1.0:1784189249.766985:0:92408:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc05f02f480 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:92408:1870854458175232:0@lo:5:osp-pre-0-0.0 00000100:00100000:1.0:1784189249.767028:0:92408:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784189249.767054:0:92408:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dc050e11cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1784189249.767067:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1784189249.767077:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc05f02d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1870854458175104:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1784189249.767102:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784189249.767131:0:26162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458175232 00000100:00100000:1.0:1784189249.767137:0:26162:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458175232 00000100:00100000:1.0:1784189249.767178:0:26162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4981 00000100:00100000:1.0:1784189249.767186:0:26162:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc05f02c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+5:92408:x1870854458175232:12345-0@lo:5:osp-pre-0-0.0 00010000:00010000:0.0:1784189249.767199:0:26173:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000006c4aa/0xcc1762b626f8c08e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x726:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00080000:1.0:1784189249.767229:0:26162:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000401 at 1858 00010000:00010000:0.0:1784189249.767229:0:26173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784189249.767233:0:26173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784189249.767236:0:26173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784189249.767491:0:9466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458175104 00000100:00100000:0.0:1784189249.767496:0:9466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458175104 00000100:00100000:0.0:1784189249.767524:0:9466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2013 00000100:00100000:0.0:1784189249.767531:0:9466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc05f02f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3642:x1870854458175104:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1784189249.767544:0:9466:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8648768 pending 896 free 3922481152 avail 3690958848 00000100:00100000:0.0:1784189249.767595:0:9466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc05f02f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3642:x1870854458175104:12345-0@lo:13:osp-pre-0-0.0 Request processed in 65us (492us total) trans 0 rc 0/0 00000100:00100000:0.0:1784189249.767741:0:9466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2013 00000100:00100000:1.0:1784189249.769361:0:26162:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc05f02c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+6:92408:x1870854458175232:12345-0@lo:5:osp-pre-0-0.0 Request processed in 2170us (2327us total) trans 4294968954 rc 0/0 00000100:00100000:0.0:1784189249.769399:0:92408:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc05f02f480 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:92408:1870854458175232:0@lo:5:osp-pre-0-0.0 00000004:00080000:0.0:1784189249.769424:0:92408:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x280000401:0x741:0x0]-[0x280000401:0x761:0x0] 00000100:00100000:1.0:1784189249.769442:0:26162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4981 00000100:00100000:1.0:1784189249.769488:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc05f02d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1870854458175104:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1784189249.771959:0:26172:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc05f02e300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:26172:1870854458174976:192.168.203.12@tcp:105: 00010000:00010000:0.0:1784189249.771982:0:26172:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784189249.772047:0:26172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc0711a7450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:debedd94-805c-42a0-a5e5-41758b2012e9+7:2396:x1870854436301056:12345-192.168.203.12@tcp:103:ldlm_bl.0 Request processed in 14483us (14696us total) trans 0 rc 0/0 00000100:00100000:0.0:1784189249.772058:0:26172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 2552 00000100:00100000:2.0:1784189249.776411:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1784189249.776517:0:66172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436301312 00000100:00100000:2.0:1784189249.776526:0:66172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436301312 00000100:00100000:2.0:1784189249.776591:0:66172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 232 00000100:00100000:2.0:1784189249.776602:0:66172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc07b7e2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:debedd94-805c-42a0-a5e5-41758b2012e9+10:71032:x1870854436301312:12345-192.168.203.12@tcp:35:cp.0 00000001:00080000:2.0:1784189249.776837:0:66172:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 81604378742 00000100:00100000:2.0:1784189249.776950:0:66172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc07b7e2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:debedd94-805c-42a0-a5e5-41758b2012e9+12:71032:x1870854436301312:12345-192.168.203.12@tcp:35:cp.0 Request processed in 348us (546us total) trans 81604378743 rc 0/0 00000100:00100000:2.0:1784189249.776959:0:66172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 232 00000020:00080000:2.0:1784189249.776964:0:66172:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000020:00000004:3.0:1784189249.828664:0:92728:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1784189249.828879:0:92728:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1784189250.291864:0:7454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1784189250.969971:0:92778:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1784189250.971028:0:92778:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:0.0:1784189251.114189:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1784189251.117867:0:66169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436301440 00000100:00100000:3.0:1784189251.117889:0:66169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436301440 00000100:00100000:3.0:1784189251.118275:0:66169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1344 00000100:00100000:3.0:1784189251.118297:0:66169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc07b5b1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:debedd94-805c-42a0-a5e5-41758b2012e9+7:71294:x1870854436301440:12345-192.168.203.12@tcp:101:rm.0 00010000:00010000:3.0:1784189251.118344:0:66169:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784189251.118376:0:66169:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4369ce00/0xcc1762b626f8c0b1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbfc5de7fe6c3f91 expref: -99 pid: 66169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1784189251.134719:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00080000:3.0:1784189251.136046:0:66169:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 17606us 00010000:00010000:0.0:1784189251.165662:0:66169:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04152ce00/0xcc1762b626f8c0b8 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189251.165691:0:66169:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04152ce00/0xcc1762b626f8c0b8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189251.165709:0:66169:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04152ce00/0xcc1762b626f8c0b8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189251.165872:0:66169:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04152d200/0xcc1762b626f8c0bf lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189251.165883:0:66169:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04152d200/0xcc1762b626f8c0bf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189251.165891:0:66169:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04152d200/0xcc1762b626f8c0bf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784189251.166091:0:66169:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc05ed90700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:66169:1870854458175360:0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1784189251.166201:0:66169:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784189251.166251:0:66169:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dc04673fc00 going to sleep for 11 seconds 00000100:00100000:2.0:1784189251.166932:0:23826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458175360 00000100:00100000:2.0:1784189251.166944:0:23826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458175360 00000100:00100000:2.0:1784189251.167016:0:23826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3860 00000100:00100000:2.0:1784189251.167027:0:23826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc05ed90000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:66169:x1870854458175360:12345-0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1784189251.167157:0:23826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc05ed90000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:66169:x1870854458175360:12345-0@lo:1000:mdt00_000.0 Request processed in 131us (956us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189251.167180:0:23826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3860 00000100:00100000:0.0:1784189251.168043:0:66169:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc05ed90700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:66169:1870854458175360:0@lo:1000:mdt00_000.0 00010000:00010000:0.0:1784189251.168194:0:66169:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04152d400/0xcc1762b626f8c0c6 lrc: 3/1,0 mode: --/PR res: [0x240006991:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189251.168215:0:66169:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04152d400/0xcc1762b626f8c0c6 lrc: 3/1,0 mode: PR/PR res: [0x240006991:0xb:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189251.168229:0:66169:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04152d400/0xcc1762b626f8c0c6 lrc: 3/1,0 mode: PR/PR res: [0x240006991:0xb:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1784189251.168277:0:66169:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04152d400/0xcc1762b626f8c0c6 lrc: 3/1,0 mode: PR/PR res: [0x240006991:0xb:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189251.168297:0:66169:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04152ce00/0xcc1762b626f8c0b8 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189251.168304:0:66169:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04152ce00/0xcc1762b626f8c0b8 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189251.168370:0:66169:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04152ce00/0xcc1762b626f8c0b8 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189251.168377:0:66169:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04152ce00/0xcc1762b626f8c0b8 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189251.168384:0:66169:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc04152ce00 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:0.0:1784189251.168390:0:66169:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04152ce00/0xcc1762b626f8c0b8 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189251.168398:0:66169:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04152ce00/0xcc1762b626f8c0b8 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189251.168415:0:66169:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9dc0630a6700) 00010000:00010000:0.0:1784189251.168419:0:66169:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784189251.168425:0:66169:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04152ce00/0xcc1762b626f8c0b8 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189251.168433:0:66169:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04152ce00/0xcc1762b626f8c0b8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189251.168604:0:66169:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04152d200/0xcc1762b626f8c0bf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189251.168612:0:66169:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04152d200/0xcc1762b626f8c0bf lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189251.168618:0:66169:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04152d200/0xcc1762b626f8c0bf lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189251.168625:0:66169:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc04152d200 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:0.0:1784189251.168635:0:66169:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04152d200/0xcc1762b626f8c0bf lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189251.168641:0:66169:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04152d200/0xcc1762b626f8c0bf lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189251.168714:0:66169:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x8401ce4f (ffff9dc047db8000) 00010000:00010000:0.0:1784189251.168717:0:66169:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784189251.168720:0:66169:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04152d200/0xcc1762b626f8c0bf lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189251.168726:0:66169:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04152d200/0xcc1762b626f8c0bf lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189251.168967:0:66169:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4369ce00/0xcc1762b626f8c0b1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c3f91 expref: 9 pid: 66169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189251.168984:0:66169:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04152d400/0xcc1762b626f8c0c6 lrc: 3/0,0 mode: PR/PR res: [0x240006991:0xb:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c3f91 expref: 8 pid: 66169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189251.168992:0:66169:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240006991:0xb:0x0].0x0 (ffff9dc047db8600) 00010000:00010000:0.0:1784189251.168994:0:66169:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1784189251.168996:0:66169:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc04152d400, rc 0) 00000100:00100000:0.0:1784189251.169074:0:66169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc07b5b1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:debedd94-805c-42a0-a5e5-41758b2012e9+8:71294:x1870854436301440:12345-192.168.203.12@tcp:101:rm.0 Request processed in 50780us (54900us total) trans 0 rc 0/0 00000100:00100000:0.0:1784189251.169082:0:66169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1344 00000100:00100000:0.0:1784189251.189909:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1784189251.190515:0:68287:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436301568 00000100:00100000:2.0:1784189251.190531:0:68287:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436301568 00000100:00100000:2.0:1784189251.190635:0:68287:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1345 00000100:00080000:3.0:1784189251.190718:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1784189251.190803:0:68287:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc05ed90700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:debedd94-805c-42a0-a5e5-41758b2012e9+12:71294:x1870854436301568:12345-192.168.203.12@tcp:101:rm.0 00010000:00010000:2.0:1784189251.190838:0:68287:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784189251.190865:0:68287:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9dc04a20b000/0xcc1762b626f8c0cd lrc: 2/0,0 mode: --/CR res: [0x240006991:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbfc5de7fe6c3f98 expref: -99 pid: 68287 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189251.190945:0:68287:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9dc04a20ac00/0xcc1762b626f8c0d4 lrc: 3/1,0 mode: --/PR res: [0x240006991:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189251.190963:0:68287:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9dc04a20ac00/0xcc1762b626f8c0d4 lrc: 3/1,0 mode: PR/PR res: [0x240006991:0xb:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 68287 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189251.190977:0:68287:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9dc04a20ac00/0xcc1762b626f8c0d4 lrc: 3/1,0 mode: PR/PR res: [0x240006991:0xb:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 68287 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784189251.191042:0:68287:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240006991:0xb:0x0]: returning size 4096 00000004:00200000:2.0:1784189251.191046:0:68287:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00010000:00010000:2.0:1784189251.191091:0:68287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9dc04a20b000/0xcc1762b626f8c0cd lrc: 0/0,0 mode: --/CR res: [0x240006991:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c3f98 expref: 14 pid: 68287 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189251.191113:0:68287:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9dc04a20ac00/0xcc1762b626f8c0d4 lrc: 3/0,0 mode: PR/PR res: [0x240006991:0xb:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c3f98 expref: 13 pid: 68287 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189251.191122:0:68287:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240006991:0xb:0x0].0x0 (ffff9dc07fab4400) 00010000:00010000:2.0:1784189251.191124:0:68287:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1784189251.191150:0:68287:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc04a20ac00, rc 0) 00000100:00100000:2.0:1784189251.191235:0:68287:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc05ed90700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:debedd94-805c-42a0-a5e5-41758b2012e9+13:71294:x1870854436301568:12345-192.168.203.12@tcp:101:rm.0 Request processed in 590us (1339us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189251.191405:0:68287:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1345 00000100:00100000:2.0:1784189251.203279:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1784189251.203509:0:66171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436301824 00000100:00100000:3.0:1784189251.203523:0:66171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436301824 00000100:00100000:3.0:1784189251.203613:0:66171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1346 00000100:00100000:3.0:1784189251.203626:0:66171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc07b7e0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:debedd94-805c-42a0-a5e5-41758b2012e9+13:71294:x1870854436301824:12345-192.168.203.12@tcp:101:rm.0 00010000:00010000:3.0:1784189251.203664:0:66171:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784189251.203709:0:66171:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9dbf4369c400/0xcc1762b626f8c0db lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbfc5de7fe6c3f9f expref: -99 pid: 66171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784189251.203965:0:66171:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240006991:0xb:0x0]: returning size 4096 00010000:00010000:3.0:1784189251.204095:0:66171:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9dbf4369c400/0xcc1762b626f8c0db lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c3f9f expref: 15 pid: 66171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189251.204112:0:66171:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9dbf45994c00) 00010000:00010000:3.0:1784189251.204115:0:66171:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1784189251.204119:0:66171:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9dbf4369c400/0xcc1762b626f8c0db lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c3f9f expref: 15 pid: 66171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189251.204139:0:66171:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dbf4369c400, rc 0) 00000100:00100000:3.0:1784189251.204220:0:66171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc07b7e0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:debedd94-805c-42a0-a5e5-41758b2012e9+14:71294:x1870854436301824:12345-192.168.203.12@tcp:101:rm.0 Request processed in 597us (956us total) trans 81604378744 rc 301/301 00000100:00100000:3.0:1784189251.204512:0:66171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1346 00000100:00100000:0.0:1784189251.220491:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1784189251.220674:0:66172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436301952 00000100:00100000:2.0:1784189251.220694:0:66172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436301952 00000100:00100000:2.0:1784189251.220923:0:66172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 233 00000100:00100000:2.0:1784189251.220936:0:66172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc045a5c050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:debedd94-805c-42a0-a5e5-41758b2012e9+14:71294:x1870854436301952:12345-192.168.203.12@tcp:37:rm.0 00000100:00100000:3.0:1784189251.239843:0:66172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc045a5c050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:debedd94-805c-42a0-a5e5-41758b2012e9+14:71294:x1870854436301952:12345-192.168.203.12@tcp:37:rm.0 Request processed in 18891us (19350us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189251.239864:0:66172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 233 00000100:00100000:3.0:1784189251.257097:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1784189251.262436:0:66173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436302208 00000100:00100000:0.0:1784189251.262461:0:66173:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436302208 00000100:00100000:0.0:1784189251.262596:0:66173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 234 00000100:00100000:0.0:1784189251.262611:0:66173:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc05edaad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:debedd94-805c-42a0-a5e5-41758b2012e9+14:71294:x1870854436302208:12345-192.168.203.12@tcp:35:rm.0 00000100:00100000:0.0:1784189251.263206:0:66173:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc05edaad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:debedd94-805c-42a0-a5e5-41758b2012e9+15:71294:x1870854436302208:12345-192.168.203.12@tcp:35:rm.0 Request processed in 595us (6122us total) trans 81604378745 rc 0/0 00000100:00100000:0.0:1784189251.263216:0:66173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 234 00000100:00100000:0.0:1784189251.269428:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1784189251.274634:0:66169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436302464 00000100:00100000:3.0:1784189251.274665:0:66169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436302464 00000100:00100000:2.0:1784189251.274999:0:66169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1347 00000100:00100000:2.0:1784189251.275015:0:66169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc05ed91500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:debedd94-805c-42a0-a5e5-41758b2012e9+15:71294:x1870854436302464:12345-192.168.203.12@tcp:101:rm.0 00010000:00010000:2.0:1784189251.275052:0:66169:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784189251.275085:0:66169:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9dc04a20ae00/0xcc1762b626f8c0e9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbfc5de7fe6c3fa6 expref: -99 pid: 66169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189251.275230:0:66169:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9dc04a20b800/0xcc1762b626f8c0f0 lrc: 3/1,0 mode: --/CR res: [0x240006991:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189251.275260:0:66169:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9dc04a20b800/0xcc1762b626f8c0f0 lrc: 3/1,0 mode: CR/CR res: [0x240006991:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66169 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189251.275274:0:66169:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9dc04a20b800/0xcc1762b626f8c0f0 lrc: 3/1,0 mode: CR/CR res: [0x240006991:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66169 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784189251.275288:0:66169:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240006991:0xb:0x0]: returning size 4096 00010000:00010000:2.0:1784189251.275459:0:66169:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9dc04a20ae00/0xcc1762b626f8c0e9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c3fa6 expref: 18 pid: 66169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189251.275491:0:66169:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9dc04a20b800/0xcc1762b626f8c0f0 lrc: 3/0,0 mode: CR/CR res: [0x240006991:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c3fa6 expref: 17 pid: 66169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189251.275521:0:66169:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240006991:0xb:0x0].0x0 (ffff9dc07fab4400) 00010000:00010000:2.0:1784189251.275524:0:66169:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1784189251.275528:0:66169:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc04a20b800, rc 0) 00000100:00100000:2.0:1784189251.275634:0:66169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc05ed91500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:debedd94-805c-42a0-a5e5-41758b2012e9+17:71294:x1870854436302464:12345-192.168.203.12@tcp:101:rm.0 Request processed in 623us (6221us total) trans 81604378746 rc 0/0 00000100:00100000:2.0:1784189251.275644:0:66169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1347 00000100:00100000:1.0:1784189251.289846:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1784189251.290595:0:68287:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436302592 00000100:00100000:2.0:1784189251.290611:0:68287:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436302592 00000100:00100000:2.0:1784189251.290707:0:68287:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1348 00000100:00100000:2.0:1784189251.290720:0:68287:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc05f02d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:debedd94-805c-42a0-a5e5-41758b2012e9+17:71294:x1870854436302592:12345-192.168.203.12@tcp:101:rm.0 00010000:00010000:2.0:1784189251.290754:0:68287:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784189251.290794:0:68287:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9dc04a20ae00/0xcc1762b626f8c0fe lrc: 2/0,0 mode: --/CR res: [0x240006991:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbfc5de7fe6c3fad expref: -99 pid: 68287 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189251.290894:0:68287:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9dc04a20be00/0xcc1762b626f8c105 lrc: 3/1,0 mode: --/PR res: [0x240006991:0xc:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189251.290912:0:68287:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9dc04a20be00/0xcc1762b626f8c105 lrc: 3/1,0 mode: PR/PR res: [0x240006991:0xc:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 68287 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189251.290926:0:68287:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9dc04a20be00/0xcc1762b626f8c105 lrc: 3/1,0 mode: PR/PR res: [0x240006991:0xc:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 68287 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784189251.290996:0:68287:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240006991:0xc:0x0]: returning size 4096 00000004:00200000:2.0:1784189251.291000:0:68287:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1784189251.291027:0:68287:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff9dc04a20be00/0xcc1762b626f8c105 lrc: 3/1,0 mode: PR/PR res: [0x240006991:0xc:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 68287 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189251.291085:0:68287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9dc04a20ae00/0xcc1762b626f8c0fe lrc: 0/0,0 mode: --/CR res: [0x240006991:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c3fad expref: 19 pid: 68287 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189251.291110:0:68287:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9dc04a20be00/0xcc1762b626f8c105 lrc: 3/0,0 mode: PR/PR res: [0x240006991:0xc:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c3fad expref: 18 pid: 68287 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189251.291121:0:68287:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240006991:0xc:0x0].0x0 (ffff9dc074ae2200) 00010000:00010000:2.0:1784189251.291125:0:68287:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1784189251.291129:0:68287:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc04a20be00, rc 0) 00000100:00100000:2.0:1784189251.291221:0:68287:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc05f02d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:debedd94-805c-42a0-a5e5-41758b2012e9+18:71294:x1870854436302592:12345-192.168.203.12@tcp:101:rm.0 Request processed in 503us (1390us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189251.291231:0:68287:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1348 00000100:00100000:3.0:1784189251.296287:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1784189251.298919:0:66171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436302848 00000100:00100000:2.0:1784189251.298950:0:66171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436302848 00000100:00100000:2.0:1784189251.299063:0:66171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1349 00000100:00100000:2.0:1784189251.299076:0:66171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf44acb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:debedd94-805c-42a0-a5e5-41758b2012e9+18:71294:x1870854436302848:12345-192.168.203.12@tcp:101:rm.0 00010000:00010000:2.0:1784189251.299107:0:66171:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784189251.299136:0:66171:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9dc04a20ae00/0xcc1762b626f8c10c lrc: 2/0,0 mode: --/CR res: [0x240006991:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbfc5de7fe6c3fb4 expref: -99 pid: 66171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784189251.299291:0:66171:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240006991:0xc:0x0]: returning size 4096 00010000:00010000:2.0:1784189251.299463:0:66171:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9dc04a20ae00/0xcc1762b626f8c10c lrc: 1/0,0 mode: --/CR res: [0x240006991:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c3fb4 expref: 20 pid: 66171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189251.299482:0:66171:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240006991:0xb:0x0].0x0 (ffff9dc07fab4400) 00010000:00010000:2.0:1784189251.299486:0:66171:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1784189251.299512:0:66171:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9dc04a20ae00/0xcc1762b626f8c10c lrc: 0/0,0 mode: --/CR res: [0x240006991:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c3fb4 expref: 20 pid: 66171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189251.299530:0:66171:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc04a20ae00, rc 0) 00000100:00100000:2.0:1784189251.299640:0:66171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf44acb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:debedd94-805c-42a0-a5e5-41758b2012e9+19:71294:x1870854436302848:12345-192.168.203.12@tcp:101:rm.0 Request processed in 566us (3369us total) trans 81604378747 rc 301/301 00000100:00100000:2.0:1784189251.299649:0:66171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1349 00000100:00100000:0.0:1784189251.310621:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1784189251.310846:0:66173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436302976 00000100:00100000:1.0:1784189251.310878:0:66173:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436302976 00000100:00100000:1.0:1784189251.310965:0:66173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 235 00000100:00100000:1.0:1784189251.310980:0:66173:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc05ed92a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:debedd94-805c-42a0-a5e5-41758b2012e9+19:71294:x1870854436302976:12345-192.168.203.12@tcp:37:rm.0 00010000:00010000:3.0:1784189251.311647:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784189251.321047:0:66173:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc05ed92a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:debedd94-805c-42a0-a5e5-41758b2012e9+19:71294:x1870854436302976:12345-192.168.203.12@tcp:37:rm.0 Request processed in 10053us (10502us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189251.321068:0:66173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 235 00000100:00100000:3.0:1784189251.330635:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1784189251.330855:0:66172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436303232 00000100:00100000:2.0:1784189251.330870:0:66172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436303232 00000100:00100000:2.0:1784189251.330951:0:66172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 236 00000100:00100000:2.0:1784189251.330963:0:66172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf44c8aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:debedd94-805c-42a0-a5e5-41758b2012e9+19:71294:x1870854436303232:12345-192.168.203.12@tcp:35:rm.0 00000100:00100000:2.0:1784189251.331261:0:66172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf44c8aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:debedd94-805c-42a0-a5e5-41758b2012e9+20:71294:x1870854436303232:12345-192.168.203.12@tcp:35:rm.0 Request processed in 298us (640us total) trans 81604378748 rc 0/0 00000100:00100000:2.0:1784189251.331270:0:66172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 236 00000100:00100000:0.0:1784189251.345272:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1784189251.345810:0:66169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436303488 00000100:00100000:2.0:1784189251.345824:0:66169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436303488 00000100:00100000:2.0:1784189251.345974:0:66169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1350 00000100:00100000:2.0:1784189251.345987:0:66169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc05ed91f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:debedd94-805c-42a0-a5e5-41758b2012e9+20:71294:x1870854436303488:12345-192.168.203.12@tcp:101:rm.0 00010000:00010000:2.0:1784189251.346026:0:66169:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784189251.346056:0:66169:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9dc04a20ae00/0xcc1762b626f8c11a lrc: 2/0,0 mode: --/CR res: [0x240006991:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbfc5de7fe6c3fbb expref: -99 pid: 66169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189251.346214:0:66169:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9dc04a20a800/0xcc1762b626f8c121 lrc: 3/1,0 mode: --/CR res: [0x240006991:0xc:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189251.346234:0:66169:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9dc04a20a800/0xcc1762b626f8c121 lrc: 3/1,0 mode: CR/CR res: [0x240006991:0xc:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66169 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189251.346274:0:66169:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9dc04a20a800/0xcc1762b626f8c121 lrc: 3/1,0 mode: CR/CR res: [0x240006991:0xc:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66169 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784189251.346290:0:66169:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240006991:0xc:0x0]: returning size 4096 00010000:00010000:2.0:1784189251.346476:0:66169:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9dc04a20ae00/0xcc1762b626f8c11a lrc: 0/0,0 mode: --/CR res: [0x240006991:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c3fbb expref: 23 pid: 66169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189251.346502:0:66169:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9dc04a20a800/0xcc1762b626f8c121 lrc: 3/0,0 mode: CR/CR res: [0x240006991:0xc:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c3fbb expref: 22 pid: 66169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189251.346515:0:66169:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240006991:0xc:0x0].0x0 (ffff9dc074ae2200) 00010000:00010000:2.0:1784189251.346518:0:66169:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1784189251.346523:0:66169:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc04a20a800, rc 0) 00000100:00100000:2.0:1784189251.346635:0:66169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc05ed91f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:debedd94-805c-42a0-a5e5-41758b2012e9+22:71294:x1870854436303488:12345-192.168.203.12@tcp:101:rm.0 Request processed in 650us (1395us total) trans 81604378749 rc 0/0 00000100:00100000:2.0:1784189251.346651:0:66169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1350 00000100:00100000:0.0:1784189251.352073:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1784189251.352181:0:66945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436303616 00000100:00100000:3.0:1784189251.352200:0:66945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436303616 00000100:00100000:3.0:1784189251.353074:0:66945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1351 00000100:00100000:3.0:1784189251.353094:0:66945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc05ed91880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:debedd94-805c-42a0-a5e5-41758b2012e9+8:71294:x1870854436303616:12345-192.168.203.12@tcp:41:rm.0 00000004:00000024:3.0:1784189251.353179:0:66945:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 7846010880 avail 7382962176 00000100:00100000:2.0:1784189251.354136:0:66945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc05ed91880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:debedd94-805c-42a0-a5e5-41758b2012e9+8:71294:x1870854436303616:12345-192.168.203.12@tcp:41:rm.0 Request processed in 1044us (2072us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189251.354149:0:66945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1351 00000100:00100000:0.0:1784189251.357695:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1784189251.360166:0:66171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436303872 00000100:00100000:2.0:1784189251.360188:0:66171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436303872 00000100:00100000:2.0:1784189251.360378:0:66171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1352 00000100:00100000:2.0:1784189251.360392:0:66171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf470e3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:debedd94-805c-42a0-a5e5-41758b2012e9+22:71294:x1870854436303872:12345-192.168.203.12@tcp:36:rm.0 00010000:00010000:2.0:1784189251.360491:0:66171:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1784189251.360526:0:66171:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9dc0755a5c00/0xcc1762b626f8bece lrc: 0/0,0 mode: --/PR res: [0x2400090a5:0x1:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c3f7c expref: 22 pid: 66171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189251.360593:0:66171:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x1:0x0].0x0 (ffff9dc07fab4c00) 00010000:00010000:2.0:1784189251.360617:0:66171:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9dc04a20be00/0xcc1762b626f8c105 lrc: 0/0,0 mode: --/PR res: [0x240006991:0xc:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c3fad expref: 21 pid: 68287 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189251.360628:0:66171:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240006991:0xc:0x0].0x0 (ffff9dc074ae2200) 00010000:00010000:2.0:1784189251.360632:0:66171:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1784189251.360676:0:66171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9dc04a20ae00/0xcc1762b626f8c12f lrc: 3/0,1 mode: --/CW res: [0x240006991:0xc:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189251.360700:0:66171:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9dc04a20ae00/0xcc1762b626f8c12f lrc: 3/0,1 mode: CW/CW res: [0x240006991:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66171 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189251.360712:0:66171:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9dc04a20ae00/0xcc1762b626f8c12f lrc: 3/0,1 mode: CW/CW res: [0x240006991:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66171 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189251.360725:0:66171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9dc04a20a600/0xcc1762b626f8c136 lrc: 3/0,1 mode: --/PW res: [0x240006991:0xc:0x0].0xb1bed465 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189251.360733:0:66171:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9dc04a20a600/0xcc1762b626f8c136 lrc: 3/0,1 mode: PW/PW res: [0x240006991:0xc:0x0].0xb1bed465 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66171 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189251.360750:0:66171:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9dc04a20a600/0xcc1762b626f8c136 lrc: 3/0,1 mode: PW/PW res: [0x240006991:0xc:0x0].0xb1bed465 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66171 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189251.360864:0:66171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9dc04a20b000/0xcc1762b626f8c13d lrc: 3/0,1 mode: --/EX res: [0x2400090a5:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189251.360872:0:66171:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9dc04a20b000/0xcc1762b626f8c13d lrc: 3/0,1 mode: EX/EX res: [0x2400090a5:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66171 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189251.360890:0:66171:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9dc04a20b000/0xcc1762b626f8c13d lrc: 3/0,1 mode: EX/EX res: [0x2400090a5:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66171 initiator: MDT1 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1784189251.361172:0:66171:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x4c:0x0].2, 64 off8320 00000004:00080000:2.0:1784189251.361183:0:66171:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 3493584863048ns, next at 3494584860697ns, rc = 0 00010000:00010000:2.0:1784189251.361234:0:66171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9dc04a20a400/0xcc1762b626f8c144 lrc: 3/0,1 mode: --/PW res: [0x2400090a5:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189251.361243:0:66171:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9dc04a20a400/0xcc1762b626f8c144 lrc: 3/0,1 mode: PW/PW res: [0x2400090a5:0x1:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 66171 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189251.361252:0:66171:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9dc04a20a400/0xcc1762b626f8c144 lrc: 3/0,1 mode: PW/PW res: [0x2400090a5:0x1:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 66171 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189251.361260:0:66171:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9dc04a20a400/0xcc1762b626f8c144 lrc: 4/0,1 mode: PW/PW res: [0x2400090a5:0x1:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 66171 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189251.361267:0:66171:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9dc04a20a400/0xcc1762b626f8c144 lrc: 4/0,1 mode: PW/PW res: [0x2400090a5:0x1:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 66171 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189251.361274:0:66171:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9dc04a20a400/0xcc1762b626f8c144 lrc: 3/0,0 mode: PW/PW res: [0x2400090a5:0x1:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 66171 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189251.361302:0:66171:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1784189251.361365:0:6502:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784189251.361374:0:6502:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9dc04a20a400/0xcc1762b626f8c144 lrc: 2/0,0 mode: PW/PW res: [0x2400090a5:0x1:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 66171 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189251.361375:0:66171:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9dc04a20b000/0xcc1762b626f8c13d lrc: 3/0,1 mode: EX/EX res: [0x2400090a5:0x1:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66171 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189251.361382:0:66171:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9dc04a20b000/0xcc1762b626f8c13d lrc: 2/0,0 mode: EX/EX res: [0x2400090a5:0x1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66171 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189251.361388:0:66171:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9dc04a20b000/0xcc1762b626f8c13d lrc: 3/0,0 mode: EX/EX res: [0x2400090a5:0x1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66171 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189251.362890:0:6502:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc04a20a400 already unused, calling callback (ffffffffc0b2e230) 00010000:00010000:1.0:1784189251.362905:0:6502:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9dc04a20a400/0xcc1762b626f8c144 lrc: 2/0,0 mode: PW/PW res: [0x2400090a5:0x1:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 66171 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189251.362919:0:6502:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9dc04a20a400/0xcc1762b626f8c144 lrc: 3/0,0 mode: PW/PW res: [0x2400090a5:0x1:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 66171 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189251.362939:0:6502:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x1:0x0].0x0 (ffff9dc04a2a5400) 00010000:00010000:1.0:1784189251.362942:0:6502:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1784189251.362948:0:6502:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9dc04a20a400/0xcc1762b626f8c144 lrc: 1/0,0 mode: --/PW res: [0x2400090a5:0x1:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 66171 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189251.362954:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9dc04a20a400/0xcc1762b626f8c144 lrc: 0/0,0 mode: --/PW res: [0x2400090a5:0x1:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 66171 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189251.362980:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784189251.362982:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784189251.362984:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784189251.367858:0:66171:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc04a20b000 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:2.0:1784189251.367878:0:66171:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9dc04a20b000/0xcc1762b626f8c13d lrc: 3/0,0 mode: EX/EX res: [0x2400090a5:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66171 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189251.367895:0:66171:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9dc04a20b000/0xcc1762b626f8c13d lrc: 4/0,0 mode: EX/EX res: [0x2400090a5:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66171 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189251.367919:0:66171:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x1:0x0].0x0 (ffff9dc04a2a5400) 00010000:00010000:2.0:1784189251.367923:0:66171:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1784189251.367930:0:66171:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9dc04a20b000/0xcc1762b626f8c13d lrc: 2/0,0 mode: --/EX res: [0x2400090a5:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66171 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189251.367939:0:66171:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9dc04a20b000/0xcc1762b626f8c13d lrc: 0/0,0 mode: --/EX res: [0x2400090a5:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66171 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189251.367992:0:66171:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9dc04a20ae00/0xcc1762b626f8c12f lrc: 4/0,1 mode: CW/CW res: [0x240006991:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66171 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189251.368000:0:66171:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9dc04a20ae00/0xcc1762b626f8c12f lrc: 4/0,1 mode: CW/CW res: [0x240006991:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66171 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189251.368006:0:66171:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9dc04a20ae00/0xcc1762b626f8c12f lrc: 3/0,0 mode: CW/CW res: [0x240006991:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66171 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189251.368013:0:66171:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9dc04a20ae00/0xcc1762b626f8c12f lrc: 4/0,0 mode: CW/CW res: [0x240006991:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66171 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189251.368018:0:66171:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc04a20ae00 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:2.0:1784189251.368021:0:66171:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9dc04a20ae00/0xcc1762b626f8c12f lrc: 4/0,0 mode: CW/CW res: [0x240006991:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66171 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189251.368053:0:66171:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9dc04a20ae00/0xcc1762b626f8c12f lrc: 5/0,0 mode: CW/CW res: [0x240006991:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66171 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189251.368070:0:66171:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240006991:0xc:0x0].0x0 (ffff9dc074ae2200) 00010000:00010000:2.0:1784189251.368073:0:66171:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784189251.368076:0:66171:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9dc04a20ae00/0xcc1762b626f8c12f lrc: 3/0,0 mode: --/CW res: [0x240006991:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66171 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189251.368083:0:66171:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9dc04a20ae00/0xcc1762b626f8c12f lrc: 0/0,0 mode: --/CW res: [0x240006991:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66171 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1784189251.368098:0:66171:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000062bc7a94 reply state 00000000ca6b8797 transno 81604378750 ns: mdt-lustre-MDT0001_UUID lock: ffff9dc04a20a600/0xcc1762b626f8c136 lrc: 3/0,1 mode: PW/PW res: [0x240006991:0xc:0x0].0xb1bed465 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66171 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189251.368112:0:66171:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9dc04a20a600/0xcc1762b626f8c136 lrc: 3/0,1 mode: TXN/TXN res: [0x240006991:0xc:0x0].0xb1bed465 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66171 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189251.368121:0:66171:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240006991:0xc:0x0].0xb1bed465 (ffff9dc04a2a5a00) 00010000:00010000:2.0:1784189251.368124:0:66171:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1784189251.368127:0:66171:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1784189251.368270:0:66171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf470e3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:debedd94-805c-42a0-a5e5-41758b2012e9+22:71294:x1870854436303872:12345-192.168.203.12@tcp:36:rm.0 Request processed in 7874us (10581us total) trans 81604378750 rc 0/0 00000100:00100000:2.0:1784189251.368280:0:66171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1352 00000100:00100000:0.0:1784189251.374189:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1784189251.374278:0:66172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436304128 00000100:00100000:3.0:1784189251.374292:0:66172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436304128 00000100:00100000:3.0:1784189251.374630:0:66172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 237 00000100:00100000:3.0:1784189251.374644:0:66172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf470e0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:debedd94-805c-42a0-a5e5-41758b2012e9+22:71294:x1870854436304128:12345-192.168.203.12@tcp:35:rm.0 00000100:00100000:3.0:1784189251.374955:0:66172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf470e0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:debedd94-805c-42a0-a5e5-41758b2012e9+23:71294:x1870854436304128:12345-192.168.203.12@tcp:35:rm.0 Request processed in 313us (781us total) trans 81604378751 rc 0/0 00000100:00100000:3.0:1784189251.374965:0:66172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 237 00000100:00100000:1.0:1784189251.381687:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1784189251.381882:0:66169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436304384 00000100:00100000:2.0:1784189251.381896:0:66169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436304384 00000100:00100000:2.0:1784189251.381982:0:66169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1353 00000100:00100000:2.0:1784189251.381994:0:66169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc05f02ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:debedd94-805c-42a0-a5e5-41758b2012e9+23:71294:x1870854436304384:12345-192.168.203.12@tcp:36:rm.0 00010000:00010000:2.0:1784189251.382072:0:66169:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1784189251.382111:0:66169:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9dc04a20a800/0xcc1762b626f8c121 lrc: 0/0,0 mode: --/CR res: [0x240006991:0xc:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c3fbb expref: 23 pid: 66169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189251.382162:0:66169:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9dc04152c400/0xcc1762b626f8bc58 lrc: 0/0,0 mode: --/PR res: [0x240006991:0xc:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c3f67 expref: 22 pid: 66171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189251.382177:0:66169:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240006991:0xc:0x0].0x0 (ffff9dc074ae2200) 00010000:00010000:2.0:1784189251.382197:0:66169:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9dc04a20ac00/0xcc1762b626f8c0d4 lrc: 0/0,0 mode: --/PR res: [0x240006991:0xb:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c3f98 expref: 21 pid: 68287 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189251.382206:0:66169:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240006991:0xb:0x0].0x0 (ffff9dc07fab4400) 00010000:00010000:2.0:1784189251.382210:0:66169:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1784189251.382237:0:66169:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9dc04a20aa00/0xcc1762b626f8c14b lrc: 3/0,1 mode: --/CW res: [0x240006991:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189251.382252:0:66169:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9dc04a20aa00/0xcc1762b626f8c14b lrc: 3/0,1 mode: CW/CW res: [0x240006991:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66169 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189251.382263:0:66169:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9dc04a20aa00/0xcc1762b626f8c14b lrc: 3/0,1 mode: CW/CW res: [0x240006991:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66169 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189251.382282:0:66169:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9dc04a20b400/0xcc1762b626f8c152 lrc: 3/0,1 mode: --/PW res: [0x240006991:0xb:0x0].0xf7117594 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189251.382290:0:66169:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9dc04a20b400/0xcc1762b626f8c152 lrc: 3/0,1 mode: PW/PW res: [0x240006991:0xb:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66169 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189251.382296:0:66169:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9dc04a20b400/0xcc1762b626f8c152 lrc: 3/0,1 mode: PW/PW res: [0x240006991:0xb:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66169 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189251.383925:0:66169:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9dc04a20ae00/0xcc1762b626f8c159 lrc: 3/0,1 mode: --/EX res: [0x240006991:0xc:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189251.383974:0:66169:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9dc04a20ae00/0xcc1762b626f8c159 lrc: 3/0,1 mode: EX/EX res: [0x240006991:0xc:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66169 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189251.383987:0:66169:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9dc04a20ae00/0xcc1762b626f8c159 lrc: 3/0,1 mode: EX/EX res: [0x240006991:0xc:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66169 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784189251.384383:0:66169:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240006991:0xc:0x0]: returning size 4096 00010000:00010000:2.0:1784189251.384405:0:66169:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9dc04a20ae00/0xcc1762b626f8c159 lrc: 3/0,1 mode: EX/EX res: [0x240006991:0xc:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66169 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189251.384412:0:66169:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9dc04a20ae00/0xcc1762b626f8c159 lrc: 2/0,0 mode: EX/EX res: [0x240006991:0xc:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66169 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189251.384421:0:66169:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9dc04a20ae00/0xcc1762b626f8c159 lrc: 3/0,0 mode: EX/EX res: [0x240006991:0xc:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66169 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189251.384441:0:66169:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc04a20ae00 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:2.0:1784189251.385416:0:66169:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9dc04a20ae00/0xcc1762b626f8c159 lrc: 3/0,0 mode: EX/EX res: [0x240006991:0xc:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66169 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189251.385433:0:66169:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9dc04a20ae00/0xcc1762b626f8c159 lrc: 4/0,0 mode: EX/EX res: [0x240006991:0xc:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66169 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189251.385523:0:66169:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240006991:0xc:0x0].0x0 (ffff9dc04a2a5400) 00010000:00010000:2.0:1784189251.385527:0:66169:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1784189251.385534:0:66169:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9dc04a20ae00/0xcc1762b626f8c159 lrc: 2/0,0 mode: --/EX res: [0x240006991:0xc:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66169 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189251.385542:0:66169:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9dc04a20ae00/0xcc1762b626f8c159 lrc: 0/0,0 mode: --/EX res: [0x240006991:0xc:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66169 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189251.385597:0:66169:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9dc04a20aa00/0xcc1762b626f8c14b lrc: 4/0,1 mode: CW/CW res: [0x240006991:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66169 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189251.385623:0:66169:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9dc04a20aa00/0xcc1762b626f8c14b lrc: 4/0,1 mode: CW/CW res: [0x240006991:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66169 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189251.385630:0:66169:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9dc04a20aa00/0xcc1762b626f8c14b lrc: 3/0,0 mode: CW/CW res: [0x240006991:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66169 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189251.385637:0:66169:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9dc04a20aa00/0xcc1762b626f8c14b lrc: 4/0,0 mode: CW/CW res: [0x240006991:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66169 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189251.385781:0:66169:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc04a20aa00 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:2.0:1784189251.385785:0:66169:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9dc04a20aa00/0xcc1762b626f8c14b lrc: 4/0,0 mode: CW/CW res: [0x240006991:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66169 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189251.385791:0:66169:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9dc04a20aa00/0xcc1762b626f8c14b lrc: 5/0,0 mode: CW/CW res: [0x240006991:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66169 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189251.385800:0:66169:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240006991:0xb:0x0].0x0 (ffff9dc07fab4400) 00010000:00010000:2.0:1784189251.385803:0:66169:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784189251.385806:0:66169:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9dc04a20aa00/0xcc1762b626f8c14b lrc: 3/0,0 mode: --/CW res: [0x240006991:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66169 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189251.385812:0:66169:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9dc04a20aa00/0xcc1762b626f8c14b lrc: 0/0,0 mode: --/CW res: [0x240006991:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66169 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1784189251.385825:0:66169:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000b56e5617 reply state 0000000001a2c33d transno 81604378752 ns: mdt-lustre-MDT0001_UUID lock: ffff9dc04a20b400/0xcc1762b626f8c152 lrc: 3/0,1 mode: PW/PW res: [0x240006991:0xb:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66169 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189251.385839:0:66169:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9dc04a20b400/0xcc1762b626f8c152 lrc: 3/0,1 mode: TXN/TXN res: [0x240006991:0xb:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66169 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189251.385846:0:66169:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240006991:0xb:0x0].0xf7117594 (ffff9dc04a2a5600) 00010000:00010000:2.0:1784189251.385854:0:66169:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1784189251.385858:0:66169:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1784189251.386048:0:66169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc05f02ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:debedd94-805c-42a0-a5e5-41758b2012e9+22:71294:x1870854436304384:12345-192.168.203.12@tcp:36:rm.0 Request processed in 4050us (4370us total) trans 81604378752 rc 0/0 00000100:00100000:2.0:1784189251.386059:0:66169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1353 00000100:00100000:1.0:1784189251.400101:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1784189251.400182:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1784189251.400282:0:66173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436304768 00000100:00100000:0.0:1784189251.400296:0:66173:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436304768 00000100:00100000:0.0:1784189251.400403:0:66173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 238 00000100:00100000:0.0:1784189251.400415:0:66173:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc05f02c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:debedd94-805c-42a0-a5e5-41758b2012e9+22:71294:x1870854436304768:12345-192.168.203.12@tcp:35:rm.0 00000100:00100000:0.0:1784189251.400739:0:66173:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc05f02c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:debedd94-805c-42a0-a5e5-41758b2012e9+23:71294:x1870854436304768:12345-192.168.203.12@tcp:35:rm.0 Request processed in 326us (555us total) trans 81604378753 rc 0/0 00000100:00100000:0.0:1784189251.400749:0:66173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 238 00000100:00100000:2.0:1784189251.401922:0:7455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436304512 00000100:00100000:2.0:1784189251.401937:0:7455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436304512 00000100:00100000:2.0:1784189251.402003:0:7455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 708 00000100:00100000:2.0:1784189251.402013:0:7455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc05f02ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:debedd94-805c-42a0-a5e5-41758b2012e9+8:2397:x1870854436304512:12345-192.168.203.12@tcp:103:rm.0 00010000:00010000:2.0:1784189251.402030:0:7455:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784189251.402062:0:7455:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04152d400/0xcc1762b626f8c0c6 lrc: 0/0,0 mode: --/PR res: [0x240006991:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c3f91 expref: 8 pid: 66169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189251.402085:0:7455:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240006991:0xb:0x0].0x0 (ffff9dc047db8600) 00010000:00010000:2.0:1784189251.402098:0:7455:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784189251.402148:0:7455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc05f02ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:debedd94-805c-42a0-a5e5-41758b2012e9+7:2397:x1870854436304512:12345-192.168.203.12@tcp:103:rm.0 Request processed in 137us (2065us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189251.402156:0:7455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 708 00000100:00100000:1.0:1784189251.406250:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1784189251.406395:0:66945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436305024 00000100:00100000:2.0:1784189251.406411:0:66945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436305024 00000100:00100000:2.0:1784189251.406507:0:66945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1354 00000100:00100000:2.0:1784189251.406519:0:66945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc05f02d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:debedd94-805c-42a0-a5e5-41758b2012e9+23:71294:x1870854436305024:12345-192.168.203.12@tcp:36:rm.0 00010000:00010000:2.0:1784189251.406609:0:66945:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1784189251.406656:0:66945:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9dc04a20b800/0xcc1762b626f8c0f0 lrc: 0/0,0 mode: --/CR res: [0x240006991:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c3fa6 expref: 23 pid: 66169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189251.406694:0:66945:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9dc0755a4800/0xcc1762b626f8bc3c lrc: 0/0,0 mode: --/PR res: [0x240006991:0xb:0x0].0x0 bits 0x10/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c3f60 expref: 22 pid: 66170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189251.406729:0:66945:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240006991:0xb:0x0].0x0 (ffff9dc07fab4400) 00010000:00010000:2.0:1784189251.406744:0:66945:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1784189251.406814:0:66945:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9dc04a20aa00/0xcc1762b626f8c160 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189251.406825:0:66945:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff9dc04a20aa00/0xcc1762b626f8c160 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 66945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189251.406836:0:66945:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff9dc04a20aa00/0xcc1762b626f8c160 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x1000000000000 pid: 66945 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784189251.406863:0:66945:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc07b7e2680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:66945:1870854458175488:0@lo:101:mdt00_003.0 00000100:00100000:2.0:1784189251.406935:0:66945:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784189251.406978:0:66945:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dbf41086900 going to sleep for 11 seconds 00000100:00100000:1.0:1784189251.407278:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458175488 00000100:00100000:1.0:1784189251.407285:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458175488 00000100:00100000:1.0:1784189251.407367:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3861 00000100:00100000:1.0:1784189251.407376:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc071534700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:66945:x1870854458175488:12345-0@lo:101:mdt00_003.0 00010000:00010000:1.0:1784189251.407390:0:8439:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784189251.407408:0:8439:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4710e000/0xcc1762b626f8c167 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcc1762b626f8c160 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189251.407437:0:8439:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc07116e600/0xcc1762b626f8bea4 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c3f52 expref: 6 pid: 92422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189251.407461:0:8439:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4710e000/0xcc1762b626f8c167 lrc: 4/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xcc1762b626f8c160 expref: 9 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189251.407491:0:8439:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9dc07116e600/0xcc1762b626f8bea4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c3f52 expref: 6 pid: 92422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189251.407507:0:8439:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc07116e600/0xcc1762b626f8bea4 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c3f52 expref: 6 pid: 92422 timeout: 3593 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784189251.407520:0:8439:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc05f02fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000_UUID:8439:1870854458175616:192.168.203.12@tcp:104: 00000100:00100000:1.0:1784189251.407609:0:8439:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dc050e11840 going to sleep for 11 seconds 00000100:00100000:0.0:1784189251.412014:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1784189251.412142:0:8439:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc05f02fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000_UUID:8439:1870854458175616:192.168.203.12@tcp:104: 00010000:00010000:1.0:1784189251.412186:0:8439:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4710e000/0xcc1762b626f8c167 lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xcc1762b626f8c160 expref: 9 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189251.412228:0:8439:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9dc0630a6700) 00010000:00010000:1.0:1784189251.412231:0:8439:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784189251.412236:0:8439:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4710e000/0xcc1762b626f8c167 lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xcc1762b626f8c160 expref: 9 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189251.412248:0:8439:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dbf4710e000, rc 0) 00000100:00100000:1.0:1784189251.412356:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc071534700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:66945:x1870854458175488:12345-0@lo:101:mdt00_003.0 Request processed in 4980us (5420us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189251.412368:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3861 00000100:00100000:3.0:1784189251.412637:0:66945:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc07b7e2680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:66945:1870854458175488:0@lo:101:mdt00_003.0 00010000:00010000:3.0:1784189251.412675:0:66945:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9dc04a20aa00/0xcc1762b626f8c160 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xcc1762b626f8c167 expref: -99 pid: 66945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189251.412702:0:66945:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: lustre-MDT0000-osp-MDT0001 lock: ffff9dc04a20aa00/0xcc1762b626f8c160 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xcc1762b626f8c167 expref: -99 pid: 66945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784189251.413842:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436305152 00000100:00100000:2.0:1784189251.413856:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436305152 00010000:00010000:2.0:1784189251.413907:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc07116e600/0xcc1762b626f8bea4 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c3f52 expref: 7 pid: 92422 timeout: 3593 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784189251.413951:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 2553 00000100:00100000:2.0:1784189251.413961:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf470e3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:debedd94-805c-42a0-a5e5-41758b2012e9+7:2396:x1870854436305152:12345-192.168.203.12@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1784189251.413981:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784189251.413988:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9dc07116e600/0xcc1762b626f8bea4 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c3f52 expref: 7 pid: 92422 timeout: 3593 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189251.414002:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9dc07116e600/0xcc1762b626f8bea4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c3f52 expref: 7 pid: 92422 timeout: 3593 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189251.414048:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc07116e600/0xcc1762b626f8bea4 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c3f52 expref: 7 pid: 92422 timeout: 3593 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189251.414065:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9dc0630a6700) 00010000:00010000:2.0:1784189251.414072:0:6498:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4710e000/0xcc1762b626f8c167 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xcc1762b626f8c160 expref: 8 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189251.414085:0:6498:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4710e000/0xcc1762b626f8c167 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0xcc1762b626f8c160 expref: 8 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189251.414095:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4710e000/0xcc1762b626f8c167 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0xcc1762b626f8c160 expref: 8 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189251.414138:0:6498:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4710e000/0xcc1762b626f8c167 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xcc1762b626f8c160 expref: 8 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784189251.414154:0:6498:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc071534e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0000_UUID:6498:1870854458175744:0@lo:105: 00000100:00100000:2.0:1784189251.414226:0:6498:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784189251.414400:0:6498:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dbf41086900 going to sleep for 11 seconds 00000100:00100000:3.0:1784189251.414940:0:6496:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1784189251.414962:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458175744 00000100:00100000:3.0:1784189251.414969:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458175744 00000100:00100000:3.0:1784189251.415064:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 314 00000100:00100000:3.0:1784189251.415073:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf423b7c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0001-mdtlov_UUID+4:6498:x1870854458175744:12345-0@lo:105: 00010000:00010000:3.0:1784189251.415090:0:6496:0:(ldlm_lockd.c:2518:ldlm_callback_handler()) ### completion ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff9dc04a20aa00/0xcc1762b626f8c160 lrc: 5/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xcc1762b626f8c167 expref: -99 pid: 66945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189251.415101:0:6496:0:(ldlm_lockd.c:1968:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-MDT0000-osp-MDT0001 lock: ffff9dc04a20aa00/0xcc1762b626f8c160 lrc: 5/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xcc1762b626f8c167 expref: -99 pid: 66945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189251.415111:0:6496:0:(ldlm_lockd.c:2045:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-MDT0000-osp-MDT0001 lock: ffff9dc04a20aa00/0xcc1762b626f8c160 lrc: 5/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xcc1762b626f8c167 expref: -99 pid: 66945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189251.415121:0:6496:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9dc04a20aa00/0xcc1762b626f8c160 lrc: 5/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xcc1762b626f8c167 expref: -99 pid: 66945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189251.415129:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff9dc04a20aa00/0xcc1762b626f8c160 lrc: 6/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xcc1762b626f8c167 expref: -99 pid: 66945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189251.415138:0:6496:0:(ldlm_lockd.c:2073:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-MDT0000-osp-MDT0001 lock: ffff9dc04a20aa00/0xcc1762b626f8c160 lrc: 6/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1080000000000 nid: local remote: 0xcc1762b626f8c167 expref: -99 pid: 66945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189251.415169:0:6496:0:(ldlm_lockd.c:2084:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff9dc04a20aa00) 00000100:00100000:3.0:1784189251.415251:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf423b7c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0001-mdtlov_UUID+4:6498:x1870854458175744:12345-0@lo:105: Request processed in 178us (1023us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189251.415259:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 314 00010000:00010000:2.0:1784189251.415401:0:66945:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: lustre-MDT0000-osp-MDT0001 lock: ffff9dc04a20aa00/0xcc1762b626f8c160 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xcc1762b626f8c167 expref: -99 pid: 66945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189251.415413:0:66945:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9dc04a20aa00/0xcc1762b626f8c160 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xcc1762b626f8c167 expref: -99 pid: 66945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784189251.415827:0:6498:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc071534e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0000_UUID:6498:1870854458175744:0@lo:105: 00010000:00010000:0.0:1784189251.415847:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784189251.415912:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf470e3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:debedd94-805c-42a0-a5e5-41758b2012e9+6:2396:x1870854436305152:12345-192.168.203.12@tcp:103:ldlm_bl.0 Request processed in 1949us (3908us total) trans 0 rc 0/0 00000100:00100000:0.0:1784189251.415921:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 2553 00000004:00080000:2.0:1784189251.415991:0:66945:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00010000:00010000:2.0:1784189251.416048:0:66945:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9dc04a20ae00/0xcc1762b626f8c16e lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189251.416068:0:66945:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff9dc04a20ae00/0xcc1762b626f8c16e lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 66945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189251.416082:0:66945:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff9dc04a20ae00/0xcc1762b626f8c16e lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 66945 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784189251.416105:0:66945:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc071536a00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:66945:1870854458175872:0@lo:101:mdt00_003.0 00000100:00100000:2.0:1784189251.416154:0:66945:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784189251.416189:0:66945:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dbf41086600 going to sleep for 11 seconds 00000100:00100000:0.0:1784189251.416250:0:23826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458175872 00000100:00100000:0.0:1784189251.416257:0:23826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458175872 00000100:00100000:0.0:1784189251.416312:0:23826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3862 00000100:00100000:0.0:1784189251.416351:0:23826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc071534e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:66945:x1870854458175872:12345-0@lo:101:mdt00_003.0 00010000:00010000:0.0:1784189251.416372:0:23826:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784189251.416391:0:23826:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04152c800/0xcc1762b626f8c175 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcc1762b626f8c16e expref: -99 pid: 23826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189251.416416:0:23826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04152c800/0xcc1762b626f8c175 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xcc1762b626f8c16e expref: 10 pid: 23826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189251.416442:0:23826:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04152c800/0xcc1762b626f8c175 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xcc1762b626f8c16e expref: 10 pid: 23826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189251.416635:0:23826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x8401ce4f (ffff9dc047db8000) 00010000:00010000:0.0:1784189251.416648:0:23826:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784189251.416654:0:23826:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc04152c800, rc 0) 00000100:00100000:0.0:1784189251.416704:0:23826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc071534e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+10:66945:x1870854458175872:12345-0@lo:101:mdt00_003.0 Request processed in 385us (549us total) trans 0 rc 0/0 00000100:00100000:0.0:1784189251.416711:0:23826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3862 00000100:00100000:2.0:1784189251.416998:0:66945:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc071536a00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:66945:1870854458175872:0@lo:101:mdt00_003.0 00010000:00010000:2.0:1784189251.417016:0:66945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff9dc04a20ae00/0xcc1762b626f8c16e lrc: 4/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xcc1762b626f8c175 expref: -99 pid: 66945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189251.417029:0:66945:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9dc04a20ae00/0xcc1762b626f8c16e lrc: 4/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xcc1762b626f8c175 expref: -99 pid: 66945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1784189251.417050:0:66945:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00000100:00100000:2.0:1784189251.417101:0:66945:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc071536a00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:66945:1870854458176000:0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1784189251.417136:0:66945:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784189251.417154:0:66945:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dbf410866c0 going to sleep for 11 seconds 00000100:00100000:0.0:1784189251.417215:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458176000 00000100:00100000:0.0:1784189251.417221:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458176000 00000100:00100000:0.0:1784189251.417261:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3863 00000100:00100000:0.0:1784189251.417269:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc07b7e2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+10:66945:x1870854458176000:12345-0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1784189251.417368:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc07b7e2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+10:66945:x1870854458176000:12345-0@lo:1000:mdt00_003.0 Request processed in 100us (232us total) trans 0 rc 0/0 00000100:00100000:0.0:1784189251.417376:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3863 00000100:00100000:2.0:1784189251.417682:0:66945:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc071536a00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:66945:1870854458176000:0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1784189251.417736:0:66945:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc071536a00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:66945:1870854458176128:0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1784189251.417767:0:66945:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784189251.417781:0:66945:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dbf410866c0 going to sleep for 11 seconds 00000100:00100000:0.0:1784189251.417934:0:23826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458176128 00000100:00100000:0.0:1784189251.417940:0:23826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458176128 00000100:00100000:0.0:1784189251.417974:0:23826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3864 00000100:00100000:0.0:1784189251.417996:0:23826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc080e7c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+10:66945:x1870854458176128:12345-0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1784189251.418091:0:23826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc080e7c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+10:66945:x1870854458176128:12345-0@lo:1000:mdt00_003.0 Request processed in 96us (323us total) trans 0 rc 1/1 00000100:00100000:0.0:1784189251.418098:0:23826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3864 00000100:00100000:2.0:1784189251.419288:0:66945:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc071536a00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:66945:1870854458176128:0@lo:1000:mdt00_003.0 00010000:00010000:2.0:1784189251.419403:0:66945:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9dc04a20ac00/0xcc1762b626f8c17c lrc: 3/0,1 mode: --/EX res: [0x240006991:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189251.420080:0:66945:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff9dc04a20ac00/0xcc1762b626f8c17c lrc: 3/0,1 mode: --/EX res: [0x240006991:0xb:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 66945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189251.420099:0:66945:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff9dc04a20ac00/0xcc1762b626f8c17c lrc: 3/0,1 mode: --/EX res: [0x240006991:0xb:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 66945 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784189251.420127:0:66945:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc080e7ed80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:66945:1870854458176256:0@lo:101:mdt00_003.0 00000100:00100000:2.0:1784189251.420186:0:66945:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784189251.420220:0:66945:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dbf41086600 going to sleep for 11 seconds 00000100:00100000:0.0:1784189251.420576:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458176256 00000100:00100000:0.0:1784189251.420586:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458176256 00000100:00100000:0.0:1784189251.420653:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3865 00000100:00100000:0.0:1784189251.420662:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc080e7f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+10:66945:x1870854458176256:12345-0@lo:101:mdt00_003.0 00010000:00010000:0.0:1784189251.420787:0:8438:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784189251.420813:0:8438:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04152c200/0xcc1762b626f8c183 lrc: 2/0,0 mode: --/EX res: [0x240006991:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcc1762b626f8c17c expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189251.420847:0:8438:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04152c200/0xcc1762b626f8c183 lrc: 3/0,0 mode: EX/EX res: [0x240006991:0xb:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xcc1762b626f8c17c expref: 11 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189251.420865:0:8438:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04152c200/0xcc1762b626f8c183 lrc: 3/0,0 mode: EX/EX res: [0x240006991:0xb:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xcc1762b626f8c17c expref: 11 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189251.420874:0:8438:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240006991:0xb:0x0].0x0 (ffff9dc047db8800) 00010000:00010000:0.0:1784189251.420878:0:8438:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1784189251.420882:0:8438:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc04152c200, rc 0) 00000100:00100000:0.0:1784189251.420942:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc080e7f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+11:66945:x1870854458176256:12345-0@lo:101:mdt00_003.0 Request processed in 281us (755us total) trans 0 rc 0/0 00000100:00100000:0.0:1784189251.420950:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3865 00000100:00100000:3.0:1784189251.421043:0:66945:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc080e7ed80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:66945:1870854458176256:0@lo:101:mdt00_003.0 00010000:00010000:3.0:1784189251.421063:0:66945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff9dc04a20ac00/0xcc1762b626f8c17c lrc: 4/0,1 mode: EX/EX res: [0x240006991:0xb:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xcc1762b626f8c183 expref: -99 pid: 66945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189251.421075:0:66945:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9dc04a20ac00/0xcc1762b626f8c17c lrc: 4/0,1 mode: EX/EX res: [0x240006991:0xb:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xcc1762b626f8c183 expref: -99 pid: 66945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189251.421110:0:66945:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9dbf4369c400/0xcc1762b626f8c18a lrc: 3/0,1 mode: --/EX res: [0x240006991:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189251.421120:0:66945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9dbf4369c400/0xcc1762b626f8c18a lrc: 3/0,1 mode: EX/EX res: [0x240006991:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189251.421129:0:66945:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9dbf4369c400/0xcc1762b626f8c18a lrc: 3/0,1 mode: EX/EX res: [0x240006991:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66945 initiator: MDT1 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1784189251.421880:0:66945:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x2400090a0:0x2:0x0].3, 432 off36352 00000040:00080000:3.0:1784189251.421940:0:66945:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x2000088d1:0x2:0x0].3, 512 off36784 00000004:00080000:3.0:1784189251.421947:0:66945:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff9dc0718de9c0 with version 11 00000004:00080000:1.0:1784189251.422041:0:75594:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9dc05020c840 version 11 rpc_version 11 00000020:00100000:1.0:1784189251.422077:0:75594:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1784189251.422086:0:75594:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9dc05f02fb80 x1870854458176512/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 1760/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1784189251.422111:0:75594:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc05f02fb80 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:75594:1870854458176512:0@lo:1000:osp_up0-1.0 00000100:00100000:1.0:1784189251.422171:0:75594:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784189251.422207:0:75594:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dc050e11840 going to sleep for 11 seconds 00000100:00100000:2.0:1784189251.422299:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458176512 00000100:00100000:2.0:1784189251.422307:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458176512 00000100:00100000:2.0:1784189251.422370:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3866 00000100:00100000:2.0:1784189251.422379:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc05f02ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+11:75594:x1870854458176512:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:2.0:1784189251.431888:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc05f02ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+12:75594:x1870854458176512:12345-0@lo:1000:osp_up0-1.0 Request processed in 9494us (9700us total) trans 115964116994 rc 0/0 00000100:00100000:2.0:1784189251.431908:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3866 00000100:00100000:1.0:1784189251.432064:0:75594:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc05f02fb80 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:75594:1870854458176512:0@lo:1000:osp_up0-1.0 00000004:00200000:3.0:1784189251.432202:0:66945:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240006991:0xb:0x0]: returning size 4096 00010000:00010000:3.0:1784189251.432232:0:66945:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9dbf4369c400/0xcc1762b626f8c18a lrc: 3/0,1 mode: EX/EX res: [0x240006991:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189251.432245:0:66945:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9dbf4369c400/0xcc1762b626f8c18a lrc: 2/0,0 mode: EX/EX res: [0x240006991:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189251.432252:0:66945:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9dbf4369c400/0xcc1762b626f8c18a lrc: 3/0,0 mode: EX/EX res: [0x240006991:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189251.432278:0:66945:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dbf4369c400 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:3.0:1784189251.432283:0:66945:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9dbf4369c400/0xcc1762b626f8c18a lrc: 3/0,0 mode: EX/EX res: [0x240006991:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189251.432292:0:66945:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9dbf4369c400/0xcc1762b626f8c18a lrc: 4/0,0 mode: EX/EX res: [0x240006991:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189251.432311:0:66945:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240006991:0xb:0x0].0x0 (ffff9dbf45994c00) 00010000:00010000:3.0:1784189251.432314:0:66945:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784189251.432349:0:66945:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9dbf4369c400/0xcc1762b626f8c18a lrc: 2/0,0 mode: --/EX res: [0x240006991:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189251.432357:0:66945:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9dbf4369c400/0xcc1762b626f8c18a lrc: 0/0,0 mode: --/EX res: [0x240006991:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189251.432381:0:66945:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9dc04a20ac00/0xcc1762b626f8c17c lrc: 4/0,1 mode: EX/EX res: [0x240006991:0xb:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xcc1762b626f8c183 expref: -99 pid: 66945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189251.432390:0:66945:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9dc04a20ac00/0xcc1762b626f8c17c lrc: 4/0,1 mode: EX/EX res: [0x240006991:0xb:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xcc1762b626f8c183 expref: -99 pid: 66945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189251.432398:0:66945:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9dc04a20ac00/0xcc1762b626f8c17c lrc: 3/0,0 mode: EX/EX res: [0x240006991:0xb:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xcc1762b626f8c183 expref: -99 pid: 66945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189251.432436:0:66945:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:3.0:1784189251.432460:0:66945:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00010000:00010000:3.0:1784189251.432467:0:66945:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9dc04a20aa00/0xcc1762b626f8c160 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xcc1762b626f8c167 expref: -99 pid: 66945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189251.432485:0:66945:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9dc04a20aa00/0xcc1762b626f8c160 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xcc1762b626f8c167 expref: -99 pid: 66945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189251.432492:0:66945:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9dc04a20aa00/0xcc1762b626f8c160 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xcc1762b626f8c167 expref: -99 pid: 66945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189251.432507:0:66945:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000004:00080000:3.0:1784189251.432513:0:66945:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00010000:00010000:3.0:1784189251.432518:0:66945:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9dc04a20ae00/0xcc1762b626f8c16e lrc: 4/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xcc1762b626f8c175 expref: -99 pid: 66945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189251.432526:0:66945:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-osp-MDT0001 lock: ffff9dc04a20ae00/0xcc1762b626f8c16e lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xcc1762b626f8c175 expref: -99 pid: 66945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784189251.432628:0:66945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc05f02d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:debedd94-805c-42a0-a5e5-41758b2012e9+22:71294:x1870854436305024:12345-192.168.203.12@tcp:36:rm.0 Request processed in 26108us (26391us total) trans 81604378754 rc 0/0 00000100:00100000:3.0:1784189251.432637:0:66945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1354 00010000:00010000:1.0:1784189251.433920:0:26173:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1784189251.433935:0:26173:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff9dc04a20ac00/0xcc1762b626f8c17c lrc: 2/0,0 mode: EX/EX res: [0x240006991:0xb:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0xcc1762b626f8c183 expref: -99 pid: 66945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189251.433948:0:26173:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc04a20ac00 already unused, calling callback (ffffffffc1767ed0) 00010000:00010000:1.0:1784189251.433956:0:26173:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff9dc04a20ac00/0xcc1762b626f8c17c lrc: 3/0,0 mode: EX/EX res: [0x240006991:0xb:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xcc1762b626f8c183 expref: -99 pid: 66945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1784189251.433967:0:26173:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9dc04a20ac00/0xcc1762b626f8c17c lrc: 3/0,0 mode: EX/EX res: [0x240006991:0xb:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xcc1762b626f8c183 expref: -99 pid: 66945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189251.434030:0:26173:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff9dc04a20ac00/0xcc1762b626f8c17c lrc: 2/0,0 mode: --/EX res: [0x240006991:0xb:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xcc1762b626f8c183 expref: -99 pid: 66945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189251.434038:0:26173:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1784189251.434081:0:26173:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9dc04a20ac00/0xcc1762b626f8c17c lrc: 1/0,0 mode: --/EX res: [0x240006991:0xb:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xcc1762b626f8c183 expref: -99 pid: 66945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189251.434090:0:26173:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9dc04a20ac00/0xcc1762b626f8c17c lrc: 0/0,0 mode: --/EX res: [0x240006991:0xb:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xcc1762b626f8c183 expref: -99 pid: 66945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189251.434112:0:26173:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784189251.434117:0:26173:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff9dc04a20aa00/0xcc1762b626f8c160 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0xcc1762b626f8c167 expref: -99 pid: 66945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189251.434125:0:26173:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc04a20aa00 already unused, calling callback (ffffffffc1767ed0) 00010000:00010000:1.0:1784189251.434129:0:26173:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff9dc04a20aa00/0xcc1762b626f8c160 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xcc1762b626f8c167 expref: -99 pid: 66945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1784189251.434136:0:26173:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9dc04a20aa00/0xcc1762b626f8c160 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xcc1762b626f8c167 expref: -99 pid: 66945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189251.434154:0:26173:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff9dc04a20aa00/0xcc1762b626f8c160 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xcc1762b626f8c167 expref: -99 pid: 66945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189251.434160:0:26173:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1784189251.434166:0:26173:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9dc04a20aa00/0xcc1762b626f8c160 lrc: 1/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xcc1762b626f8c167 expref: -99 pid: 66945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189251.434184:0:26173:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9dc04a20aa00/0xcc1762b626f8c160 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xcc1762b626f8c167 expref: -99 pid: 66945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189251.434193:0:26173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784189251.434195:0:26173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784189251.434197:0:26173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784189251.434216:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc05f02d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1870854458176768:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1784189251.434286:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784189251.434363:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1784189251.434369:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc05f02f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1870854458176640:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1784189251.434394:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784189251.434437:0:25703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458176768 00000100:00100000:1.0:1784189251.434566:0:25703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458176768 00000100:00100000:1.0:1784189251.434622:0:25703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458176640 00000100:00100000:1.0:1784189251.434626:0:25703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458176640 00000100:00100000:1.0:1784189251.434766:0:25703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 709 00000100:00100000:1.0:1784189251.434778:0:25703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc05f02e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0001-mdtlov_UUID+13:3641:x1870854458176768:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1784189251.434796:0:25703:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784189251.434820:0:25703:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4710e000/0xcc1762b626f8c167 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xcc1762b626f8c160 expref: 13 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189251.434838:0:25703:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9dc0630a6700) 00010000:00010000:1.0:1784189251.434843:0:25703:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784189251.434880:0:25703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc05f02e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0001-mdtlov_UUID+12:3641:x1870854458176768:12345-0@lo:103:ldlm_bl.0 Request processed in 104us (594us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189251.434888:0:25703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 709 00000100:00100000:1.0:1784189251.434914:0:25703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 710 00000100:00100000:1.0:1784189251.434920:0:25703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc05653a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0001-mdtlov_UUID+11:3641:x1870854458176640:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1784189251.434928:0:25703:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784189251.434940:0:25703:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04152c200/0xcc1762b626f8c183 lrc: 0/0,0 mode: --/EX res: [0x240006991:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xcc1762b626f8c17c expref: 11 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189251.434953:0:25703:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240006991:0xb:0x0].0x0 (ffff9dc047db8800) 00010000:00010000:1.0:1784189251.434963:0:25703:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784189251.434982:0:25703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc05653a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0001-mdtlov_UUID+10:3641:x1870854458176640:12345-0@lo:103:ldlm_bl.0 Request processed in 62us (588us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189251.434989:0:25703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 710 00000100:00100000:1.0:1784189251.435036:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc05f02f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1870854458176640:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1784189251.435046:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc05f02d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1870854458176768:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1784189251.435141:0:7454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784189251.757014:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1784189251.757075:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1784189251.757168:0:92398:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436305280 00000100:00100000:2.0:1784189251.757181:0:92398:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436305280 00000100:00100000:2.0:1784189251.757242:0:92398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 61 00000100:00100000:2.0:1784189251.757253:0:92398:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc07a90c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0+-99:2395:x1870854436305280:12345-192.168.203.12@tcp:250:kworker.0 00010000:00080000:2.0:1784189251.757292:0:92398:0:(ldlm_lib.c:1445:target_handle_connect()) MGS: connection from 60f345e3-c70e-4f53-b5e7-c9671463c9a5@192.168.203.12@tcp t0 exp 0000000000000000 cur 3493 last 0 00000020:00000080:2.0:1784189251.757388:0:92398:0:(genops.c:1406:class_connect()) connect: client 60f345e3-c70e-4f53-b5e7-c9671463c9a5, cookie 0xcc1762b626f8c191 00000100:00080000:2.0:1784189251.757568:0:92398:0:(import.c:65:import_set_state_nolock()) ffff9dc07110d800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1784189251.757660:0:92398:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc07a90c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:60f345e3-c70e-4f53-b5e7-c9671463c9a5+5:2395:x1870854436305280:12345-192.168.203.12@tcp:250:kworker.0 Request processed in 406us (583us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189251.757792:0:92398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 61 00000100:00100000:3.0:1784189251.757893:0:26166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436305408 00000100:00100000:3.0:1784189251.757898:0:26166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436305408 00000100:00100000:3.0:1784189251.757966:0:26166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 2516 00000100:00100000:3.0:1784189251.757975:0:26166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf470e1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:debedd94-805c-42a0-a5e5-41758b2012e9+7:2397:x1870854436305408:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:3.0:1784189251.758011:0:26166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf470e1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:debedd94-805c-42a0-a5e5-41758b2012e9+7:2397:x1870854436305408:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 38us (1012us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189251.758018:0:26166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 2516 00000100:00080000:2.0:1784189251.758764:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1784189252.336901:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784189252.839013:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1784189252.840791:0:92397:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436305536 00000100:00100000:1.0:1784189252.840810:0:92397:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436305536 00000100:00100000:1.0:1784189252.842629:0:92397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 62 00000100:00100000:1.0:1784189252.842653:0:92397:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc07a90ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:60f345e3-c70e-4f53-b5e7-c9671463c9a5+5:70943:x1870854436305536:12345-192.168.203.12@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784189252.842679:0:92397:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784189252.842701:0:92397:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dbf4710ea00/0xcc1762b626f8c198 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xcbfc5de7fe6c3fc2 expref: -99 pid: 92397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189252.842740:0:92397:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dbf4710ea00/0xcc1762b626f8c198 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c3fc2 expref: 6 pid: 92397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189252.842752:0:92397:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dbf4710ea00/0xcc1762b626f8c198 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c3fc2 expref: 6 pid: 92397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189252.842775:0:92397:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dbf4710ea00, rc 0) 00000100:00100000:1.0:1784189252.842869:0:92397:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc07a90ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:60f345e3-c70e-4f53-b5e7-c9671463c9a5+6:70943:x1870854436305536:12345-192.168.203.12@tcp:101:ll_cfg_requeue.0 Request processed in 224us (3869us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189252.842877:0:92397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 62 00000100:00100000:3.0:1784189252.859345:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1784189252.859524:0:92396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436305664 00000100:00100000:1.0:1784189252.859538:0:92396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436305664 00000100:00100000:1.0:1784189252.859653:0:92396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 63 00000100:00100000:1.0:1784189252.859666:0:92396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc07a90c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:60f345e3-c70e-4f53-b5e7-c9671463c9a5+6:70943:x1870854436305664:12345-192.168.203.12@tcp:256:ll_cfg_requeue.0 20000000:01000000:1.0:1784189252.859702:0:92396:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 16384. 20000000:01000000:1.0:1784189252.859729:0:92396:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1784189252.859734:0:92396:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/4/3. 20000000:01000000:1.0:1784189252.859737:0:92396:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/4/3. 20000000:01000000:1.0:1784189252.859740:0:92396:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/4/3. 20000000:01000000:1.0:1784189252.859743:0:92396:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 120 00000100:00100000:3.0:1784189252.872649:0:92396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc07a90c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:60f345e3-c70e-4f53-b5e7-c9671463c9a5+6:70943:x1870854436305664:12345-192.168.203.12@tcp:256:ll_cfg_requeue.0 Request processed in 12968us (13322us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189252.872669:0:92396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 63 00000100:00100000:3.0:1784189252.877884:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1784189252.878040:0:92397:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436305792 00000100:00100000:2.0:1784189252.878054:0:92397:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436305792 00000100:00100000:2.0:1784189252.878116:0:92397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 64 00000100:00100000:2.0:1784189252.878128:0:92397:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf456b2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:60f345e3-c70e-4f53-b5e7-c9671463c9a5+6:70943:x1870854436305792:12345-192.168.203.12@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1784189252.878154:0:92397:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784189252.878180:0:92397:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dc04a20ba00/0xcc1762b626f8c19f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xcbfc5de7fe6c3fc9 expref: -99 pid: 92397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189252.878218:0:92397:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dc04a20ba00/0xcc1762b626f8c19f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c3fc9 expref: 7 pid: 92397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189252.878231:0:92397:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dc04a20ba00/0xcc1762b626f8c19f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c3fc9 expref: 7 pid: 92397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189252.878242:0:92397:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc04a20ba00, rc 0) 00000100:00100000:2.0:1784189252.878312:0:92397:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf456b2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:60f345e3-c70e-4f53-b5e7-c9671463c9a5+7:70943:x1870854436305792:12345-192.168.203.12@tcp:101:ll_cfg_requeue.0 Request processed in 185us (442us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189252.878341:0:92397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 64 00000100:00100000:3.0:1784189252.880790:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1784189252.881764:0:92396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436305920 00000100:00100000:2.0:1784189252.881780:0:92396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436305920 00000100:00100000:2.0:1784189252.881861:0:92396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 65 00000100:00100000:2.0:1784189252.881874:0:92396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf456b0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:60f345e3-c70e-4f53-b5e7-c9671463c9a5+7:70943:x1870854436305920:12345-192.168.203.12@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1784189252.882091:0:92396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf456b0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:60f345e3-c70e-4f53-b5e7-c9671463c9a5+8:70943:x1870854436305920:12345-192.168.203.12@tcp:501:ll_cfg_requeue.0 Request processed in 218us (1313us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189252.882124:0:92396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 65 00000100:00100000:0.0:1784189252.890362:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1784189252.890495:0:92398:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436306048 00000100:00100000:1.0:1784189252.890508:0:92398:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436306048 00000100:00100000:1.0:1784189252.890593:0:92398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 66 00000100:00100000:1.0:1784189252.890606:0:92398:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf456b0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:60f345e3-c70e-4f53-b5e7-c9671463c9a5+8:70943:x1870854436306048:12345-192.168.203.12@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1784189252.890795:0:92398:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf456b0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:60f345e3-c70e-4f53-b5e7-c9671463c9a5+8:70943:x1870854436306048:12345-192.168.203.12@tcp:503:ll_cfg_requeue.0 Request processed in 191us (477us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189252.890804:0:92398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 66 00000100:00100000:1.0:1784189252.907902:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1784189252.909195:0:92397:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436306176 00000100:00100000:2.0:1784189252.909211:0:92397:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436306176 00000100:00100000:2.0:1784189252.909287:0:92397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 67 00000100:00100000:2.0:1784189252.909302:0:92397:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf456b2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:60f345e3-c70e-4f53-b5e7-c9671463c9a5+8:70943:x1870854436306176:12345-192.168.203.12@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1784189252.909352:0:92397:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784189252.909377:0:92397:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dc04a20a000/0xcc1762b626f8c1a6 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xcbfc5de7fe6c3fd0 expref: -99 pid: 92397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189252.909415:0:92397:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dc04a20a000/0xcc1762b626f8c1a6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c3fd0 expref: 9 pid: 92397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189252.909429:0:92397:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dc04a20a000/0xcc1762b626f8c1a6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c3fd0 expref: 9 pid: 92397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189252.909441:0:92397:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc04a20a000, rc 0) 00000100:00100000:2.0:1784189252.909520:0:92397:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf456b2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:60f345e3-c70e-4f53-b5e7-c9671463c9a5+9:70943:x1870854436306176:12345-192.168.203.12@tcp:101:ll_cfg_requeue.0 Request processed in 221us (1628us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189252.909528:0:92397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 67 00000100:00100000:1.0:1784189252.913693:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1784189252.913793:0:92396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436306304 00000100:00100000:2.0:1784189252.913807:0:92396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436306304 00000100:00100000:2.0:1784189252.913878:0:92396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 68 00000100:00100000:2.0:1784189252.913890:0:92396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf4a37c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:60f345e3-c70e-4f53-b5e7-c9671463c9a5+9:70943:x1870854436306304:12345-192.168.203.12@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1784189252.914091:0:92396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf4a37c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:60f345e3-c70e-4f53-b5e7-c9671463c9a5+9:70943:x1870854436306304:12345-192.168.203.12@tcp:501:ll_cfg_requeue.0 Request processed in 202us (412us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189252.914100:0:92396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 68 00000100:00100000:2.0:1784189252.928688:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1784189252.930175:0:92398:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436306432 00000100:00100000:3.0:1784189252.930194:0:92398:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436306432 00000100:00100000:3.0:1784189252.930284:0:92398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 69 00000100:00100000:3.0:1784189252.930297:0:92398:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf4a37f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:60f345e3-c70e-4f53-b5e7-c9671463c9a5+9:70943:x1870854436306432:12345-192.168.203.12@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1784189252.930524:0:92398:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf4a37f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:60f345e3-c70e-4f53-b5e7-c9671463c9a5+9:70943:x1870854436306432:12345-192.168.203.12@tcp:503:ll_cfg_requeue.0 Request processed in 229us (1850us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189252.930534:0:92398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 69 00000100:00100000:2.0:1784189252.949926:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1784189252.950631:0:92397:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436306560 00000100:00100000:0.0:1784189252.950646:0:92397:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436306560 00000100:00100000:0.0:1784189252.950713:0:92397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 70 00000100:00100000:0.0:1784189252.950724:0:92397:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf4a37fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:60f345e3-c70e-4f53-b5e7-c9671463c9a5+9:70943:x1870854436306560:12345-192.168.203.12@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784189252.950746:0:92397:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784189252.950769:0:92397:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dc04152c400/0xcc1762b626f8c1ad lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0xcbfc5de7fe6c3fd7 expref: -99 pid: 92397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189252.950806:0:92397:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dc04152c400/0xcc1762b626f8c1ad lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c3fd7 expref: 10 pid: 92397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189252.950818:0:92397:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dc04152c400/0xcc1762b626f8c1ad lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c3fd7 expref: 10 pid: 92397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189252.950829:0:92397:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc04152c400, rc 0) 00000100:00100000:0.0:1784189252.950900:0:92397:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf4a37fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:60f345e3-c70e-4f53-b5e7-c9671463c9a5+10:70943:x1870854436306560:12345-192.168.203.12@tcp:101:ll_cfg_requeue.0 Request processed in 177us (989us total) trans 0 rc 0/0 00000100:00100000:0.0:1784189252.950908:0:92397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 70 00000100:00100000:0.0:1784189252.957881:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1784189252.959638:0:92396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436306688 00000100:00100000:2.0:1784189252.959657:0:92396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436306688 00000100:00100000:2.0:1784189252.959733:0:92396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 71 00000100:00100000:2.0:1784189252.959746:0:92396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf4a37f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:60f345e3-c70e-4f53-b5e7-c9671463c9a5+10:70943:x1870854436306688:12345-192.168.203.12@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1784189252.959928:0:92396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf4a37f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:60f345e3-c70e-4f53-b5e7-c9671463c9a5+10:70943:x1870854436306688:12345-192.168.203.12@tcp:501:ll_cfg_requeue.0 Request processed in 184us (2060us total) trans 0 rc -2/-2 00000100:00100000:2.0:1784189252.959937:0:92396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 71 00010000:00010000:1.0:1784189253.361354:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1784189253.680484:0:75597:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 3495904092896ns, next at 3496904089899ns, rc = 0 00000100:00100000:1.0:1784189253.680572:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf44c88700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1870854458176896:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1784189253.680676:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784189253.681133:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458176896 00000100:00100000:0.0:1784189253.681143:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458176896 00000100:00100000:0.0:1784189253.681230:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2014 00000100:00100000:0.0:1784189253.681242:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc05f02d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1870854458176896:12345-0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1784189253.681258:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf470e2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1870854458177024:0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1784189253.681280:0:8432:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8647872 pending 0 free 3922481152 avail 3690958848 00000100:00100000:3.0:1784189253.681295:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1784189253.681356:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1784189253.681356:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc05f02d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1870854458176896:12345-0@lo:13:osp-pre-0-1.0 Request processed in 116us (679us total) trans 0 rc 0/0 00000100:00100000:0.0:1784189253.681365:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2014 00000100:00100000:0.0:1784189253.681394:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458177024 00000100:00100000:0.0:1784189253.681405:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458177024 00000100:00100000:3.0:1784189253.681411:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf44c88700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1870854458176896:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1784189253.681432:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2015 00000100:00100000:0.0:1784189253.681438:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf44c89c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1870854458177024:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1784189253.681454:0:8432:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 210112 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1784189253.681488:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf44c89c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1870854458177024:12345-0@lo:13:osp-pre-1-1.0 Request processed in 50us (192us total) trans 0 rc 0/0 00000100:00100000:0.0:1784189253.681494:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2015 00000100:00080000:0.0:1784189253.681515:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1784189253.681547:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf470e2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1870854458177024:0@lo:13:osp-pre-1-1.0 00010000:00010000:1.0:1784189254.385914:0:26173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784189254.703747:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf44c88700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1870854458177152:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1784189254.703841:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784189254.703912:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458177152 00000100:00100000:2.0:1784189254.703928:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458177152 00000100:00100000:0.0:1784189254.703977:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf470e1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3642:1870854458177408:0@lo:400:kworker.0 00000100:00100000:2.0:1784189254.704006:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3867 00000100:00100000:2.0:1784189254.704018:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc080df1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+10:3640:x1870854458177152:12345-0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1784189254.704057:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf470e2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3640:1870854458177664:0@lo:400:kworker.0 00000004:00000024:2.0:1784189254.704062:0:8438:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445281792 avail 1299042304 00000100:00100000:1.0:1784189254.704498:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf470e2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3643:1870854458177536:0@lo:400:kworker.0 00000100:00100000:0.0:1784189254.704574:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784189254.704600:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf470e1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1870854458177920:0@lo:400:kworker.0 00000100:00100000:0.0:1784189254.704625:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784189254.704643:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf470e1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1870854458178432:0@lo:400:kworker.0 00000100:00100000:0.0:1784189254.705929:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784189254.705982:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc05f02f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1870854458178944:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1784189254.706399:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784189254.706475:0:26492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458177920 00000100:00100000:0.0:1784189254.706485:0:26492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458177920 00000100:00100000:0.0:1784189254.706543:0:26492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458178432 00000100:00100000:0.0:1784189254.706546:0:26492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458178432 00000100:00100000:0.0:1784189254.706561:0:26492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458178944 00000100:00100000:0.0:1784189254.706564:0:26492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458178944 00000100:00100000:0.0:1784189254.706579:0:26492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3868 00000100:00100000:0.0:1784189254.706590:0:26492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf46434380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+11:3642:x1870854458177920:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784189254.706668:0:26492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf46434380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+11:3642:x1870854458177920:12345-0@lo:400:kworker.0 Request processed in 78us (2040us total) trans 0 rc 0/0 00000100:00100000:0.0:1784189254.706694:0:26492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3868 00000100:00100000:0.0:1784189254.706862:0:26492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3869 00000100:00100000:0.0:1784189254.706869:0:26492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf46435180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3642:x1870854458178432:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784189254.706905:0:26492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf46435180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3642:x1870854458178432:12345-0@lo:400:kworker.0 Request processed in 37us (982us total) trans 0 rc 0/0 00000100:00100000:0.0:1784189254.706912:0:26492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3869 00000100:00100000:0.0:1784189254.706923:0:26492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3870 00000100:00100000:0.0:1784189254.706928:0:26492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf46434000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3642:x1870854458178944:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1784189254.706955:0:26492:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445576704 avail 1299337216 00000100:00100000:0.0:1784189254.706985:0:26492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf46434000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3642:x1870854458178944:12345-0@lo:41:osp-pre-1-0.0 Request processed in 57us (974us total) trans 0 rc 0/0 00000100:00100000:0.0:1784189254.706991:0:26492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3870 00000100:00100000:0.0:1784189254.707099:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc05f02f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1870854458178944:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1784189254.707112:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf470e1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1870854458177920:0@lo:400:kworker.0 00000100:00100000:0.0:1784189254.707121:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf470e1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1870854458178432:0@lo:400:kworker.0 00000100:00100000:0.0:1784189254.707232:0:66171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458177408 00000100:00100000:0.0:1784189254.707237:0:66171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458177408 00000100:00100000:0.0:1784189254.707283:0:66171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1252 00000100:00100000:0.0:1784189254.707289:0:66171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf46435f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3642:x1870854458177408:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784189254.707500:0:66171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf46435f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3642:x1870854458177408:12345-0@lo:400:kworker.0 Request processed in 210us (2925us total) trans 0 rc 0/0 00000100:00100000:0.0:1784189254.707508:0:66171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1252 00000100:00080000:0.0:1784189254.707544:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1784189254.707571:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf470e1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3642:1870854458177408:0@lo:400:kworker.0 00000100:00100000:2.0:1784189254.711949:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc080df1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+10:3640:x1870854458177152:12345-0@lo:41:osp-pre-0-1.0 Request processed in 7925us (8099us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189254.711966:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3867 00000100:00100000:1.0:1784189254.713383:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784189254.713565:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf470e0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1870854458178048:0@lo:400:kworker.0 00000100:00100000:1.0:1784189254.713618:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784189254.713642:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf470e2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1870854458178560:0@lo:400:kworker.0 00000100:00100000:1.0:1784189254.713666:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784189254.713734:0:26223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458178048 00000100:00100000:1.0:1784189254.713744:0:26223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458178048 00000100:00100000:1.0:1784189254.713804:0:26223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458178560 00000100:00100000:1.0:1784189254.713807:0:26223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458178560 00000100:00100000:1.0:1784189254.713844:0:26223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2517 00000100:00100000:1.0:1784189254.713852:0:26223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf46954000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0001-mdtlov_UUID+5:3643:x1870854458178048:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784189254.713916:0:26223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf46954000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0001-mdtlov_UUID+5:3643:x1870854458178048:12345-0@lo:400:kworker.0 Request processed in 64us (296us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189254.713923:0:26223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2517 00000100:00100000:1.0:1784189254.713941:0:26223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2518 00000100:00100000:1.0:1784189254.713947:0:26223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf46955f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0000-mdtlov_UUID+6:3643:x1870854458178560:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784189254.713972:0:26223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf46955f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0000-mdtlov_UUID+6:3643:x1870854458178560:12345-0@lo:400:kworker.0 Request processed in 26us (306us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189254.713978:0:26223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2518 00000100:00080000:1.0:1784189254.713999:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1784189254.714392:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf470e0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1870854458178048:0@lo:400:kworker.0 00000100:00100000:1.0:1784189254.714404:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf470e2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1870854458178560:0@lo:400:kworker.0 00000100:00100000:3.0:1784189254.714517:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784189254.714626:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf470e2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:bd553d0d-03e2-4233-b06b-b55bbfa2b954:3641:1870854458177280:0@lo:400:kworker.0 00000100:00100000:3.0:1784189254.714653:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf470e3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1870854458178176:0@lo:400:kworker.0 00000100:00100000:3.0:1784189254.714719:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784189254.714732:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784189254.714760:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf470e0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1870854458178688:0@lo:400:kworker.0 00000100:00100000:2.0:1784189254.714794:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf470e0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3641:1870854458177792:0@lo:400:kworker.0 00000100:00100000:3.0:1784189254.714817:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784189254.714858:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784189254.714885:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf44c88700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1870854458177152:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1784189254.714925:0:26164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458178176 00000100:00100000:3.0:1784189254.714930:0:26164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458178176 00000100:00100000:3.0:1784189254.714966:0:26164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458178688 00000100:00100000:3.0:1784189254.714968:0:26164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458178688 00000100:00100000:3.0:1784189254.714994:0:26164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2519 00000100:00100000:3.0:1784189254.715001:0:26164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc080df1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0001-mdtlov_UUID+5:3640:x1870854458178176:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784189254.715417:0:26164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc080df1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0001-mdtlov_UUID+5:3640:x1870854458178176:12345-0@lo:400:kworker.0 Request processed in 415us (698us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189254.715425:0:26164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2519 00000100:00100000:3.0:1784189254.715443:0:26164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2520 00000100:00100000:3.0:1784189254.715450:0:26164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc05659df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+6:3640:x1870854458178688:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784189254.715479:0:26164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc05659df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+6:3640:x1870854458178688:12345-0@lo:400:kworker.0 Request processed in 29us (663us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189254.715484:0:26164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2520 00000100:00100000:3.0:1784189254.715515:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf470e3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1870854458178176:0@lo:400:kworker.0 00000100:00100000:3.0:1784189254.715537:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf470e0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1870854458178688:0@lo:400:kworker.0 00000100:00100000:0.0:1784189254.715628:0:66169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458177536 00000100:00100000:0.0:1784189254.715635:0:66169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458177536 00000100:00100000:0.0:1784189254.715671:0:66169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458177664 00000100:00100000:0.0:1784189254.715674:0:66169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458177664 00000100:00100000:0.0:1784189254.715712:0:66169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1253 00000100:00100000:0.0:1784189254.715720:0:66169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc05f02f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1870854458177536:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784189254.715768:0:66169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc05f02f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1870854458177536:12345-0@lo:400:kworker.0 Request processed in 49us (2393us total) trans 0 rc 0/0 00000100:00100000:0.0:1784189254.715775:0:66169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1253 00000100:00100000:0.0:1784189254.715804:0:66169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1254 00000100:00100000:0.0:1784189254.715811:0:66169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc080df2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3640:x1870854458177664:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784189254.715844:0:66169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc080df2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3640:x1870854458177664:12345-0@lo:400:kworker.0 Request processed in 33us (1327us total) trans 0 rc 0/0 00000100:00100000:0.0:1784189254.715851:0:66169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1254 00000100:00080000:0.0:1784189254.715898:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1784189254.715902:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1784189254.715905:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1784189254.715935:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf470e2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3643:1870854458177536:0@lo:400:kworker.0 00000100:00100000:3.0:1784189254.716059:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf470e2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3640:1870854458177664:0@lo:400:kworker.0 00000100:00100000:3.0:1784189254.716462:0:92398:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458177280 00000100:00100000:3.0:1784189254.716469:0:92398:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458177280 00000100:00100000:3.0:1784189254.716510:0:92398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1784189254.716518:0:92398:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf456b1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd553d0d-03e2-4233-b06b-b55bbfa2b954+24:3641:x1870854458177280:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784189254.716571:0:92398:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf456b1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd553d0d-03e2-4233-b06b-b55bbfa2b954+24:3641:x1870854458177280:12345-0@lo:400:kworker.0 Request processed in 54us (1842us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189254.716591:0:92398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1784189254.723153:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf470e1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3641:1870854458178304:0@lo:400:kworker.0 00000100:00100000:2.0:1784189254.723217:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784189254.732945:0:68287:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458177792 00000100:00100000:0.0:1784189254.732945:0:66170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458178304 00000100:00100000:1.0:1784189254.732967:0:68287:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458177792 00000100:00100000:0.0:1784189254.732967:0:66170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458178304 00000100:00100000:0.0:1784189254.733047:0:66170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1255 00000100:00100000:0.0:1784189254.733058:0:66170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc080e7c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1870854458178304:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784189254.733162:0:66170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc080e7c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1870854458178304:12345-0@lo:400:kworker.0 Request processed in 106us (9944us total) trans 0 rc 0/0 00000100:00100000:0.0:1784189254.733170:0:66170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1255 00000100:00100000:1.0:1784189254.733441:0:66945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1256 00000100:00100000:1.0:1784189254.733457:0:66945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc080e7e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1870854458177792:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1784189254.733469:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1784189254.733558:0:66945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc080e7e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1870854458177792:12345-0@lo:400:kworker.0 Request processed in 106us (18706us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189254.733566:0:66945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1256 00000100:00100000:2.0:1784189254.741782:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf470e1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3641:1870854458178304:0@lo:400:kworker.0 00000100:00100000:2.0:1784189254.741798:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf470e3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3641:1870854458178816:0@lo:400:kworker.0 00000100:00100000:2.0:1784189254.741871:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784189254.741921:0:66170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458178816 00000100:00100000:2.0:1784189254.741926:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf470e2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:bd553d0d-03e2-4233-b06b-b55bbfa2b954:3641:1870854458177280:0@lo:400:kworker.0 00000100:00100000:0.0:1784189254.741937:0:66170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458178816 00000100:00100000:2.0:1784189254.741943:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf470e0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3641:1870854458177792:0@lo:400:kworker.0 00000100:00100000:0.0:1784189254.741999:0:66170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1257 00000100:00100000:0.0:1784189254.742010:0:66170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc080e7ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1870854458178816:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784189254.742074:0:66170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc080e7ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1870854458178816:12345-0@lo:400:kworker.0 Request processed in 66us (202us total) trans 0 rc 0/0 00000100:00100000:0.0:1784189254.742081:0:66170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1257 00000100:00100000:2.0:1784189254.745667:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf470e3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3641:1870854458178816:0@lo:400:kworker.0 00000100:00100000:0.0:1784189255.223441:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1784189255.223462:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf470e3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1870854458179072:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1784189255.223700:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784189255.223785:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458179072 00000100:00100000:2.0:1784189255.223793:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458179072 00000100:00100000:2.0:1784189255.223847:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2016 00000100:00100000:2.0:1784189255.223859:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf470e0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3642:x1870854458179072:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1784189255.223887:0:8432:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8647872 pending 0 free 3922481152 avail 3690958848 00000100:00100000:2.0:1784189255.223932:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf470e0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3642:x1870854458179072:12345-0@lo:13:osp-pre-0-0.0 Request processed in 76us (232us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189255.223938:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2016 00000100:00100000:1.0:1784189255.224183:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1784189255.224194:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf46957100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1870854458179200:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1784189255.224225:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784189255.224283:0:9466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458179200 00000100:00100000:0.0:1784189255.224287:0:9466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458179200 00000100:00100000:0.0:1784189255.224359:0:9466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2017 00000100:00100000:0.0:1784189255.224367:0:9466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf46956300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3641:x1870854458179200:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1784189255.224383:0:9466:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 210112 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1784189255.224418:0:9466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf46956300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3641:x1870854458179200:12345-0@lo:13:osp-pre-1-0.0 Request processed in 52us (192us total) trans 0 rc 0/0 00000100:00100000:0.0:1784189255.224437:0:9466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2017 00000100:00100000:0.0:1784189255.224484:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf46957100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1870854458179200:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1784189255.224517:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf470e3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1870854458179072:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1784189255.407412:0:7454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1784189255.735822:0:75588:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 3 committed 00010000:00010000:0.0:1784189255.735903:0:75588:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff9dc04a20ae00/0xcc1762b626f8c16e lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xcc1762b626f8c175 expref: -99 pid: 66945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1784189255.735919:0:75588:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9dc04a20ae00/0xcc1762b626f8c16e lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xcc1762b626f8c175 expref: -99 pid: 66945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189255.735968:0:75588:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff9dc04a20ae00/0xcc1762b626f8c16e lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xcc1762b626f8c175 expref: -99 pid: 66945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189255.735974:0:75588:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1784189255.735988:0:75588:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9dc04a20ae00/0xcc1762b626f8c16e lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xcc1762b626f8c175 expref: -99 pid: 66945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784189255.736000:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf46957800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1870854458179456:0@lo:6:osp-syn-0-1.0 00000001:00080000:0.0:1784189255.736006:0:75588:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 81604378754 is committed 00000004:00080000:0.0:1784189255.736020:0:75588:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 2 committed 00000100:00100000:1.0:1784189255.736061:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784189255.736089:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf470e3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1870854458179328:0@lo:103:jbd2/dm-1-8.0 00000100:00100000:1.0:1784189255.736108:0:26160:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458179456 00000100:00100000:1.0:1784189255.736114:0:26160:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458179456 00000100:00100000:0.0:1784189255.736118:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784189255.736161:0:26160:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4982 00000100:00100000:1.0:1784189255.736170:0:26160:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf46954e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:3641:x1870854458179456:12345-0@lo:6:osp-syn-0-1.0 00002000:00080000:1.0:1784189255.736196:0:26160:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:578 count 1 00010000:00010000:1.0:1784189255.736220:0:26160:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d369237c/0xcc1762b626f8c1b4 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x242:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189255.736241:0:26160:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000283735d0/0xcc1762b626f8bfed lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x242:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c3f8a expref: 6 pid: 14684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189255.736249:0:26160:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x242:0x0].0x0 since=6s v=(0 0) 00010000:00010000:1.0:1784189255.736253:0:26160:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x242:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1784189255.736257:0:26160:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d369237c/0xcc1762b626f8c1b4 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x242:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189255.736290:0:26160:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000283735d0/0xcc1762b626f8bfed lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x242:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000030020 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c3f8a expref: 6 pid: 14684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189255.736303:0:26160:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000283735d0/0xcc1762b626f8bfed lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x242:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400030020 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c3f8a expref: 6 pid: 14684 timeout: 3597 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784189255.736343:0:26160:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf46957480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:26160:1870854458179584:192.168.203.12@tcp:104: 00000100:00100000:1.0:1784189255.736400:0:26160:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dbf4330f600 going to sleep for 11 seconds 00000100:00100000:1.0:1784189255.736417:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458179328 00000100:00100000:1.0:1784189255.736420:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458179328 00000100:00100000:1.0:1784189255.736453:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 711 00000100:00100000:1.0:1784189255.736460:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf470e2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0001-mdtlov_UUID+10:3642:x1870854458179328:12345-0@lo:103:jbd2/dm-1-8.0 00010000:00010000:1.0:1784189255.736471:0:6499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784189255.736488:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04152c800/0xcc1762b626f8c175 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xcc1762b626f8c16e expref: 10 pid: 23826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189255.736503:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x8401ce4f (ffff9dc047db8000) 00010000:00010000:1.0:1784189255.736511:0:6499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784189255.736557:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf470e2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0001-mdtlov_UUID+9:3642:x1870854458179328:12345-0@lo:103:jbd2/dm-1-8.0 Request processed in 96us (437us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189255.736564:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 711 00000100:00080000:1.0:1784189255.736586:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1784189255.736716:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf470e3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1870854458179328:0@lo:103:jbd2/dm-1-8.0 00010000:00010000:2.0:1784189255.737941:0:3627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9dbf4369da00/0xcc1762b626f8bec7 lrc: 3/0,1 mode: TXN/TXN res: [0x240006991:0xc:0x0].0xb1bed465 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66171 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189255.737955:0:3627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9dbf4369da00/0xcc1762b626f8bec7 lrc: 2/0,0 mode: TXN/TXN res: [0x240006991:0xc:0x0].0xb1bed465 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66171 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189255.737963:0:3627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9dbf4369da00/0xcc1762b626f8bec7 lrc: 3/0,0 mode: TXN/TXN res: [0x240006991:0xc:0x0].0xb1bed465 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66171 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189255.737969:0:3627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dbf4369da00 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:2.0:1784189255.737974:0:3627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9dbf4369da00/0xcc1762b626f8bec7 lrc: 3/0,0 mode: TXN/TXN res: [0x240006991:0xc:0x0].0xb1bed465 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66171 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189255.737981:0:3627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9dbf4369da00/0xcc1762b626f8bec7 lrc: 4/0,0 mode: TXN/TXN res: [0x240006991:0xc:0x0].0xb1bed465 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66171 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189255.738008:0:3627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240006991:0xc:0x0].0xb1bed465 (ffff9dc04a2a5a00) 00010000:00010000:2.0:1784189255.738011:0:3627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784189255.738016:0:3627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9dbf4369da00/0xcc1762b626f8bec7 lrc: 2/0,0 mode: --/TXN res: [0x240006991:0xc:0x0].0xb1bed465 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66171 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189255.738022:0:3627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9dbf4369da00/0xcc1762b626f8bec7 lrc: 0/0,0 mode: --/TXN res: [0x240006991:0xc:0x0].0xb1bed465 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66171 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189255.738041:0:3627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9dc04a20a600/0xcc1762b626f8c136 lrc: 3/0,1 mode: TXN/TXN res: [0x240006991:0xc:0x0].0xb1bed465 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66171 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189255.738047:0:3627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9dc04a20a600/0xcc1762b626f8c136 lrc: 2/0,0 mode: TXN/TXN res: [0x240006991:0xc:0x0].0xb1bed465 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66171 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189255.738053:0:3627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9dc04a20a600/0xcc1762b626f8c136 lrc: 3/0,0 mode: TXN/TXN res: [0x240006991:0xc:0x0].0xb1bed465 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66171 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189255.738059:0:3627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc04a20a600 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:2.0:1784189255.738062:0:3627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9dc04a20a600/0xcc1762b626f8c136 lrc: 3/0,0 mode: TXN/TXN res: [0x240006991:0xc:0x0].0xb1bed465 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66171 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189255.738068:0:3627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9dc04a20a600/0xcc1762b626f8c136 lrc: 4/0,0 mode: TXN/TXN res: [0x240006991:0xc:0x0].0xb1bed465 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66171 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189255.738076:0:3627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240006991:0xc:0x0].0xb1bed465 (ffff9dc04a2a5a00) 00010000:00010000:2.0:1784189255.738078:0:3627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784189255.738081:0:3627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9dc04a20a600/0xcc1762b626f8c136 lrc: 2/0,0 mode: --/TXN res: [0x240006991:0xc:0x0].0xb1bed465 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66171 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189255.738087:0:3627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9dc04a20a600/0xcc1762b626f8c136 lrc: 0/0,0 mode: --/TXN res: [0x240006991:0xc:0x0].0xb1bed465 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66171 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189255.738113:0:3627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9dc04a20b400/0xcc1762b626f8c152 lrc: 3/0,1 mode: TXN/TXN res: [0x240006991:0xb:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66169 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189255.738119:0:3627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9dc04a20b400/0xcc1762b626f8c152 lrc: 2/0,0 mode: TXN/TXN res: [0x240006991:0xb:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66169 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189255.738126:0:3627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9dc04a20b400/0xcc1762b626f8c152 lrc: 3/0,0 mode: TXN/TXN res: [0x240006991:0xb:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66169 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189255.738130:0:3627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc04a20b400 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:2.0:1784189255.738133:0:3627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9dc04a20b400/0xcc1762b626f8c152 lrc: 3/0,0 mode: TXN/TXN res: [0x240006991:0xb:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66169 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189255.738139:0:3627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9dc04a20b400/0xcc1762b626f8c152 lrc: 4/0,0 mode: TXN/TXN res: [0x240006991:0xb:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66169 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189255.738147:0:3627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240006991:0xb:0x0].0xf7117594 (ffff9dc04a2a5600) 00010000:00010000:2.0:1784189255.738149:0:3627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784189255.738152:0:3627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9dc04a20b400/0xcc1762b626f8c152 lrc: 2/0,0 mode: --/TXN res: [0x240006991:0xb:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66169 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189255.738157:0:3627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9dc04a20b400/0xcc1762b626f8c152 lrc: 0/0,0 mode: --/TXN res: [0x240006991:0xb:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66169 initiator: MDT1 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1784189255.739923:0:8423:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294968954 is committed 00000001:00100000:1.0:1784189255.739978:0:8423:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of debedd94-805c-42a0-a5e5-41758b2012e9 00000001:00080000:0.0:1784189255.740170:0:9506:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294968957 is committed 00000001:00080000:1.0:1784189255.740279:0:92391:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 115964116994 is committed 00000100:00100000:1.0:1784189255.746244:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1784189255.746283:0:25703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436306816 00000100:00100000:1.0:1784189255.746291:0:25703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436306816 00010000:00010000:1.0:1784189255.746359:0:25703:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000283735d0/0xcc1762b626f8bfed lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x242:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400030020 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c3f8a expref: 6 pid: 14684 timeout: 3597 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784189255.746397:0:25703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 2554 00000100:00100000:1.0:1784189255.746405:0:25703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf46955880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:debedd94-805c-42a0-a5e5-41758b2012e9+6:2399:x1870854436306816:12345-192.168.203.12@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1784189255.746419:0:25703:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784189255.746424:0:25703:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000283735d0/0xcc1762b626f8bfed lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x242:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400030020 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c3f8a expref: 6 pid: 14684 timeout: 3597 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189255.746439:0:25703:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000283735d0/0xcc1762b626f8bfed lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x242:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400030020 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c3f8a expref: 6 pid: 14684 timeout: 3597 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189255.746464:0:25703:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x242:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1784189255.746469:0:25703:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x242:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1784189255.746475:0:25703:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000d369237c/0xcc1762b626f8c1b4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x242:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189255.746485:0:25703:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d369237c/0xcc1762b626f8c1b4 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x242:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189255.746508:0:25703:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784189255.746569:0:25703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf46955880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:debedd94-805c-42a0-a5e5-41758b2012e9+6:2399:x1870854436306816:12345-192.168.203.12@tcp:103:ldlm_bl.0 Request processed in 164us (336us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189255.746587:0:25703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 2554 00000100:00080000:1.0:1784189255.746681:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1784189255.748193:0:26160:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000283735d0/0xcc1762b626f8bfed lrc: 0/0,0 mode: --/PW res: [0x280000400:0x242:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400030020 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c3f8a expref: 5 pid: 14684 timeout: 3597 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784189255.748217:0:26160:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf46957480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:26160:1870854458179584:192.168.203.12@tcp:104: 00010000:00010000:3.0:1784189255.748239:0:26160:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000d369237c/0xcc1762b626f8c1b4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x242:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189255.748250:0:26160:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000d369237c/0xcc1762b626f8c1b4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x242:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189255.748258:0:26160:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d369237c/0xcc1762b626f8c1b4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x242:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189255.748269:0:26160:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d369237c/0xcc1762b626f8c1b4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x242:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189255.748277:0:26160:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d369237c/0xcc1762b626f8c1b4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x242:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189255.748310:0:26160:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1784189255.748537:0:26160:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf46954e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+6:3641:x1870854458179456:12345-0@lo:6:osp-syn-0-1.0 Request processed in 12366us (12474us total) trans 4294968955 rc 0/0 00000100:00100000:3.0:1784189255.748548:0:26160:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4982 00010000:00010000:2.0:1784189255.748829:0:6501:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784189255.748836:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d369237c/0xcc1762b626f8c1b4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x242:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189255.748845:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dbf4710f600 already unused, calling callback (ffffffffc0b2e230) 00010000:00010000:2.0:1784189255.748850:0:6501:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d369237c/0xcc1762b626f8c1b4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x242:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189255.748871:0:6501:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d369237c/0xcc1762b626f8c1b4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x242:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189255.748887:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d369237c/0xcc1762b626f8c1b4 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x242:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189255.748895:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d369237c/0xcc1762b626f8c1b4 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x242:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189255.748921:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784189255.748923:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784189255.748925:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1784189255.750049:0:3641:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9dbf46957800/2, rc 0, transno 4294968955 00000100:00100000:1.0:1784189255.750061:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf46957800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1870854458179456:0@lo:6:osp-syn-0-1.0 00010000:00010000:1.0:1784189256.431553:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784189257.004068:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1784189257.004183:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1784189257.004215:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1784189257.004226:0:68287:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436307200 00000100:00100000:0.0:1784189257.004235:0:68287:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436307200 00000100:00100000:1.0:1784189257.004238:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1784189257.004257:0:66945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436307072 00000100:00100000:1.0:1784189257.004272:0:66945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436307072 00000100:00100000:0.0:1784189257.004295:0:68287:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1258 00000100:00100000:1.0:1784189257.004301:0:66945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1259 00000100:00100000:0.0:1784189257.004304:0:68287:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf46954380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:debedd94-805c-42a0-a5e5-41758b2012e9+5:2396:x1870854436307200:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:1.0:1784189257.004307:0:66945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf46956a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:debedd94-805c-42a0-a5e5-41758b2012e9+6:2396:x1870854436307072:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:0.0:1784189257.004398:0:68287:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf46954380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:debedd94-805c-42a0-a5e5-41758b2012e9+5:2396:x1870854436307200:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 94us (214us total) trans 0 rc 0/0 00000100:00100000:0.0:1784189257.004415:0:68287:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1258 00000100:00080000:0.0:1784189257.004558:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1784189257.004562:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1784189257.004573:0:26168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436307328 00000100:00100000:0.0:1784189257.004577:0:26168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436307328 00000100:00100000:0.0:1784189257.004609:0:26168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 2521 00000100:00100000:0.0:1784189257.004615:0:26168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf46954a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:debedd94-805c-42a0-a5e5-41758b2012e9+5:2396:x1870854436307328:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:3.0:1784189257.006690:0:92397:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436306944 00000100:00100000:3.0:1784189257.006708:0:92397:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436306944 00000100:00100000:3.0:1784189257.006825:0:92397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 73 00000100:00100000:3.0:1784189257.006836:0:92397:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf4a37e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:60f345e3-c70e-4f53-b5e7-c9671463c9a5+10:2396:x1870854436306944:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:1.0:1784189257.006947:0:66945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf46956a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:debedd94-805c-42a0-a5e5-41758b2012e9+6:2396:x1870854436307072:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 2637us (2728us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189257.006957:0:66945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1259 00000100:00080000:1.0:1784189257.007118:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1784189257.008209:0:26168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf46954a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:debedd94-805c-42a0-a5e5-41758b2012e9+5:2396:x1870854436307328:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 3586us (3961us total) trans 0 rc 0/0 00000100:00100000:0.0:1784189257.008227:0:26168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 2521 00000100:00100000:3.0:1784189257.009609:0:92397:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf4a37e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:60f345e3-c70e-4f53-b5e7-c9671463c9a5+10:2396:x1870854436306944:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 2767us (5541us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189257.009622:0:92397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 73 00010000:00010000:1.0:1784189257.465876:0:26173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1784189257.666790:0:92974:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == replay-single test 134: replay creation of a file created in a pool ========================================================== 04:07:35 (1784189255) 00010000:00010000:2.0:1784189258.483460:0:7454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1784189258.593975:0:93022:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866bc len=0 uarg=00007ffee59cd790 20000000:00000080:0.0:1784189258.594001:0:93022:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866bc len=576 karg=ffff9dc071b3ec00 uarg=0000000000000000 00000040:00100000:0.0:1784189258.598177:0:93022:0:(llog.c:1072:llog_reverse_process()) index 51 : idx 49 00000040:00100000:0.0:1784189258.598193:0:93022:0:(llog.c:1072:llog_reverse_process()) index 47 : idx 1 00000040:00080000:0.0:1784189258.598532:0:93022:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].52, 224 off17176 20000000:01000000:0.0:1784189258.598562:0:93022:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xce020 lustre pool_134 (null) (null) 00000040:00080000:0.0:1784189258.598581:0:93022:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].53, 112 off17288 00000040:00080000:0.0:1784189258.598598:0:93022:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].54, 224 off17512 00000040:00080000:0.0:1784189258.598701:0:93022:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].46, 224 off16208 20000000:01000000:0.0:1784189258.598710:0:93022:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xce020 lustre pool_134 (null) (null) 00000040:00080000:0.0:1784189258.598725:0:93022:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].47, 120 off16328 00000040:00080000:0.0:1784189258.598981:0:93022:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].49, 224 off16608 00000040:00080000:0.0:1784189258.601953:0:93022:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].46, 224 off16240 20000000:01000000:0.0:1784189258.601994:0:93022:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xce020 lustre pool_134 (null) (null) 00000040:00080000:0.0:1784189258.602042:0:93022:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].47, 120 off16360 00000040:00080000:0.0:1784189258.602261:0:93022:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].49, 224 off16608 10000000:01000000:0.0:1784189258.602305:0:93022:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:0.0:1784189258.602558:0:93022:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9dc04152ce00/0xcc1762b626f8c1bb lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 93022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189258.602582:0:93022:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9dc04152ca00/0xcc1762b626f8bccf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcc1762b626f8bcc8 expref: 23 pid: 92397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189258.602590:0:93022:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9dc0565e7000/0xcc1762b626f8bda8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcc1762b626f8bda1 expref: 23 pid: 92396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189258.602599:0:93022:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9dc0755a5a00/0xcc1762b626f8bdd9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcc1762b626f8bdd2 expref: 23 pid: 92396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189258.602606:0:93022:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9dc0755a4e00/0xcc1762b626f8bdf5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcc1762b626f8bdee expref: 23 pid: 92396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189258.602621:0:93022:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9dc04152d000/0xcc1762b626f8be1f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcc1762b626f8be18 expref: 23 pid: 92397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189258.602629:0:93022:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9dc0565e6c00/0xcc1762b626f8be2d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcc1762b626f8be26 expref: 23 pid: 92397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189258.602636:0:93022:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9dc0755a5e00/0xcc1762b626f8be49 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcc1762b626f8be42 expref: 23 pid: 92396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189258.602643:0:93022:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9dbf4369d800/0xcc1762b626f8be57 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcc1762b626f8be50 expref: 23 pid: 92398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189258.602649:0:93022:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9dc04152d600/0xcc1762b626f8be81 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcc1762b626f8be7a expref: 23 pid: 92396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189258.602659:0:93022:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9dc04a20ba00/0xcc1762b626f8c19f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c3fc9 expref: 9 pid: 92397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189258.602667:0:93022:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9dc04152c400/0xcc1762b626f8c1ad lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c3fd7 expref: 9 pid: 92397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189258.602677:0:93022:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9dc04152ce00/0xcc1762b626f8c1bb lrc: 14/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 93022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189258.602731:0:93022:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9dc04152c400/0xcc1762b626f8c1ad lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c3fd7 expref: 9 pid: 92397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189258.602753:0:93022:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9dc04152c400/0xcc1762b626f8c1ad lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c3fd7 expref: 9 pid: 92397 timeout: 3600 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784189258.602784:0:93022:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf470e1880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:93022:1870854458179712:192.168.203.12@tcp:104: 00010000:00010000:0.0:1784189258.602946:0:93022:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9dc04a20ba00/0xcc1762b626f8c19f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c3fc9 expref: 9 pid: 92397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189258.602955:0:93022:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9dc04a20ba00/0xcc1762b626f8c19f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c3fc9 expref: 9 pid: 92397 timeout: 3600 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784189258.602964:0:93022:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf470e2a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:93022:1870854458179840:192.168.203.12@tcp:104: 00010000:00010000:0.0:1784189258.603000:0:93022:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9dc04152d600/0xcc1762b626f8be81 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcc1762b626f8be7a expref: 23 pid: 92396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189258.603009:0:93022:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9dc04152d600/0xcc1762b626f8be81 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcc1762b626f8be7a expref: 23 pid: 92396 timeout: 3600 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784189258.603019:0:93022:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf470e2d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:93022:1870854458179968:0@lo:104: 00000100:00100000:0.0:1784189258.603073:0:93022:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1784189258.605695:0:93022:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9dbf4369d800/0xcc1762b626f8be57 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcc1762b626f8be50 expref: 23 pid: 92398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189258.605718:0:93022:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9dbf4369d800/0xcc1762b626f8be57 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcc1762b626f8be50 expref: 23 pid: 92398 timeout: 3600 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784189258.605735:0:93022:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf470e3100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:93022:1870854458180096:0@lo:104: 00000100:00100000:0.0:1784189258.605803:0:93022:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1784189258.610130:0:93022:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9dc0755a5e00/0xcc1762b626f8be49 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcc1762b626f8be42 expref: 23 pid: 92396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189258.610155:0:93022:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9dc0755a5e00/0xcc1762b626f8be49 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcc1762b626f8be42 expref: 23 pid: 92396 timeout: 3600 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784189258.610196:0:93022:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf470e0380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:93022:1870854458180224:0@lo:104: 00000100:00100000:0.0:1784189258.610275:0:93022:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784189258.611262:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458179968 00000100:00100000:2.0:1784189258.611276:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458179968 00000100:00100000:2.0:1784189258.611372:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458180096 00000100:00100000:2.0:1784189258.611376:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458180096 00000100:00100000:2.0:1784189258.611396:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 315 00000100:00100000:2.0:1784189258.611407:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf470e0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:bd553d0d-03e2-4233-b06b-b55bbfa2b954+4:93022:x1870854458179968:12345-0@lo:104: 00010000:00010000:2.0:1784189258.611427:0:6497:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.112@tcp lock: ffff9dc07116fc00/0xcc1762b626f8be7a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xcc1762b626f8be81 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784189258.611593:0:49501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 316 00000100:00100000:1.0:1784189258.611604:0:49501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf470e2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:bd553d0d-03e2-4233-b06b-b55bbfa2b954+4:93022:x1870854458180096:12345-0@lo:104: 00010000:00010000:1.0:1784189258.611613:0:49501:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.112@tcp lock: ffff9dc0565e6800/0xcc1762b626f8be50 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xcc1762b626f8be57 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189258.611673:0:49501:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1784189258.611678:0:49501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf470e2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:bd553d0d-03e2-4233-b06b-b55bbfa2b954+4:93022:x1870854458180096:12345-0@lo:104: Request processed in 78us (5876us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189258.611703:0:49501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 316 00010000:00010000:2.0:1784189258.612107:0:6501:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784189258.612115:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.112@tcp lock: ffff9dc0565e6800/0xcc1762b626f8be50 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xcc1762b626f8be57 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189258.612125:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc0565e6800 already unused, calling callback (ffffffffc114ac20) 10000000:00010000:2.0:1784189258.612138:0:6501:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.112@tcp lock: ffff9dc0565e6800/0xcc1762b626f8be50 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400400000000 nid: local remote: 0xcc1762b626f8be57 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189258.612148:0:6501:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.112@tcp lock: ffff9dc0565e6800/0xcc1762b626f8be50 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1408400000000 nid: local remote: 0xcc1762b626f8be57 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1784189258.612156:0:6501:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.112@tcp lock: ffff9dc0565e6800/0xcc1762b626f8be50 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1409400000000 nid: local remote: 0xcc1762b626f8be57 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784189258.612162:0:6501:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1784189258.612215:0:6501:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.112@tcp lock: ffff9dc0565e6800/0xcc1762b626f8be50 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcc1762b626f8be57 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189258.612222:0:6501:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1784189258.612259:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.112@tcp lock: ffff9dc0565e6800/0xcc1762b626f8be50 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcc1762b626f8be57 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189258.612267:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.112@tcp lock: ffff9dc0565e6800/0xcc1762b626f8be50 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcc1762b626f8be57 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189258.612284:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784189258.612286:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784189258.612288:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784189258.612306:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc080e7dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:bd553d0d-03e2-4233-b06b-b55bbfa2b954:3643:1870854458180352:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1784189258.612376:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784189258.612429:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458180352 00000100:00100000:2.0:1784189258.612435:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458180352 00010000:00010000:2.0:1784189258.612462:0:6500:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9dbf4369d800/0xcc1762b626f8be57 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcc1762b626f8be50 expref: 24 pid: 92398 timeout: 3600 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784189258.612487:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2555 00000100:00100000:2.0:1784189258.612512:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc0711a7c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bd553d0d-03e2-4233-b06b-b55bbfa2b954+24:3643:x1870854458180352:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1784189258.612527:0:6500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784189258.612533:0:6500:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9dbf4369d800/0xcc1762b626f8be57 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcc1762b626f8be50 expref: 24 pid: 92398 timeout: 3600 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189258.612543:0:6500:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9dbf4369d800/0xcc1762b626f8be57 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcc1762b626f8be50 expref: 24 pid: 92398 timeout: 3600 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189258.612563:0:6500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784189258.612810:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc0711a7c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bd553d0d-03e2-4233-b06b-b55bbfa2b954+24:3643:x1870854458180352:12345-0@lo:103:ldlm_bl.0 Request processed in 298us (432us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189258.612818:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2555 00000100:00100000:2.0:1784189258.612905:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc080e7dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:bd553d0d-03e2-4233-b06b-b55bbfa2b954:3643:1870854458180352:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1784189258.612943:0:6497:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1784189258.612950:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf470e0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:bd553d0d-03e2-4233-b06b-b55bbfa2b954+3:93022:x1870854458179968:12345-0@lo:104: Request processed in 1544us (9877us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189258.612958:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 315 00010000:00010000:1.0:1784189258.613008:0:6502:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784189258.613014:0:6502:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.112@tcp lock: ffff9dc07116fc00/0xcc1762b626f8be7a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400000000000 nid: local remote: 0xcc1762b626f8be81 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189258.613022:0:6502:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc07116fc00 already unused, calling callback (ffffffffc114ac20) 10000000:00010000:1.0:1784189258.613027:0:6502:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.112@tcp lock: ffff9dc07116fc00/0xcc1762b626f8be7a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400400000000 nid: local remote: 0xcc1762b626f8be81 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189258.613034:0:6502:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.112@tcp lock: ffff9dc07116fc00/0xcc1762b626f8be7a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1408400000000 nid: local remote: 0xcc1762b626f8be81 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1784189258.613041:0:6502:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.112@tcp lock: ffff9dc07116fc00/0xcc1762b626f8be7a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1409400000000 nid: local remote: 0xcc1762b626f8be81 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784189258.613047:0:6502:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1784189258.613080:0:6502:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.112@tcp lock: ffff9dc07116fc00/0xcc1762b626f8be7a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcc1762b626f8be81 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189258.613087:0:6502:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1784189258.613105:0:6502:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.112@tcp lock: ffff9dc07116fc00/0xcc1762b626f8be7a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcc1762b626f8be81 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189258.613113:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.112@tcp lock: ffff9dc07116fc00/0xcc1762b626f8be7a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcc1762b626f8be81 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189258.613125:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784189258.613127:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784189258.613129:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784189258.613141:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf46955500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bd553d0d-03e2-4233-b06b-b55bbfa2b954:3640:1870854458180480:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1784189258.613184:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784189258.613223:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458180480 00000100:00100000:1.0:1784189258.613228:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458180480 00010000:00010000:1.0:1784189258.613258:0:6499:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9dc04152d600/0xcc1762b626f8be81 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcc1762b626f8be7a expref: 24 pid: 92396 timeout: 3600 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784189258.613280:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2556 00000100:00100000:1.0:1784189258.613288:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf46954700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bd553d0d-03e2-4233-b06b-b55bbfa2b954+24:3640:x1870854458180480:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1784189258.613298:0:6499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784189258.613302:0:6499:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9dc04152d600/0xcc1762b626f8be81 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcc1762b626f8be7a expref: 24 pid: 92396 timeout: 3600 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189258.613312:0:6499:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9dc04152d600/0xcc1762b626f8be81 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcc1762b626f8be7a expref: 24 pid: 92396 timeout: 3600 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189258.613350:0:6499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784189258.613379:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf46954700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bd553d0d-03e2-4233-b06b-b55bbfa2b954+24:3640:x1870854458180480:12345-0@lo:103:ldlm_bl.0 Request processed in 92us (195us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189258.613386:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2556 00000100:00100000:1.0:1784189258.613421:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf46955500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bd553d0d-03e2-4233-b06b-b55bbfa2b954:3640:1870854458180480:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1784189258.613775:0:93022:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9dc0565e6c00/0xcc1762b626f8be2d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcc1762b626f8be26 expref: 23 pid: 92397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189258.613787:0:93022:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9dc0565e6c00/0xcc1762b626f8be2d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcc1762b626f8be26 expref: 23 pid: 92397 timeout: 3600 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784189258.613797:0:93022:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf470e1f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:93022:1870854458180608:0@lo:104: 00000100:00100000:0.0:1784189258.613832:0:93022:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1784189258.613857:0:93022:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9dc04152d000/0xcc1762b626f8be1f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcc1762b626f8be18 expref: 23 pid: 92397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189258.613866:0:93022:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9dc04152d000/0xcc1762b626f8be1f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcc1762b626f8be18 expref: 23 pid: 92397 timeout: 3600 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784189258.613875:0:93022:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf470e3b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:93022:1870854458180736:0@lo:104: 00000100:00100000:0.0:1784189258.613897:0:93022:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1784189258.613915:0:93022:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9dc0755a4e00/0xcc1762b626f8bdf5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcc1762b626f8bdee expref: 23 pid: 92396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189258.613923:0:93022:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9dc0755a4e00/0xcc1762b626f8bdf5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcc1762b626f8bdee expref: 23 pid: 92396 timeout: 3600 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784189258.613932:0:93022:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf470e3800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:93022:1870854458180864:0@lo:104: 00000100:00100000:0.0:1784189258.613955:0:93022:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1784189258.613972:0:93022:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9dc0755a5a00/0xcc1762b626f8bdd9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcc1762b626f8bdd2 expref: 23 pid: 92396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189258.613995:0:93022:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9dc0755a5a00/0xcc1762b626f8bdd9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcc1762b626f8bdd2 expref: 23 pid: 92396 timeout: 3600 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784189258.614004:0:93022:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc050540e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:93022:1870854458180992:0@lo:104: 00000100:00100000:0.0:1784189258.614032:0:93022:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1784189258.614052:0:93022:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9dc0565e7000/0xcc1762b626f8bda8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcc1762b626f8bda1 expref: 23 pid: 92396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189258.614060:0:93022:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9dc0565e7000/0xcc1762b626f8bda8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcc1762b626f8bda1 expref: 23 pid: 92396 timeout: 3600 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784189258.614069:0:93022:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc050542680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:93022:1870854458181120:0@lo:104: 00010000:00010000:0.0:1784189258.614097:0:93022:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9dc04152ca00/0xcc1762b626f8bccf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcc1762b626f8bcc8 expref: 23 pid: 92397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189258.614106:0:93022:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9dc04152ca00/0xcc1762b626f8bccf lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcc1762b626f8bcc8 expref: 23 pid: 92397 timeout: 3600 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784189258.614114:0:93022:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc050541880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:93022:1870854458181248:0@lo:104: 00000100:00100000:0.0:1784189258.614134:0:93022:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dc05a5b1d80 going to sleep for 11 seconds 00010000:00010000:0.0:1784189258.614154:0:93022:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dc04152d600/0xcc1762b626f8be81 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcc1762b626f8be7a expref: 23 pid: 92396 timeout: 3600 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784189258.614169:0:93022:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf470e2d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:93022:1870854458179968:0@lo:104: 00010000:00010000:0.0:1784189258.614180:0:93022:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dbf4369d800/0xcc1762b626f8be57 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcc1762b626f8be50 expref: 22 pid: 92398 timeout: 3600 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784189258.614189:0:93022:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf470e3100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:93022:1870854458180096:0@lo:104: 00000100:00100000:2.0:1784189258.614282:0:6497:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1784189258.614302:0:6497:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784189258.614313:0:6497:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784189258.614355:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458180224 00000100:00100000:2.0:1784189258.614361:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458180224 00000100:00100000:2.0:1784189258.614389:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458180608 00000100:00100000:2.0:1784189258.614392:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458180608 00000100:00100000:2.0:1784189258.614402:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458180736 00000100:00100000:2.0:1784189258.614404:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458180736 00000100:00100000:2.0:1784189258.614414:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458180864 00000100:00100000:2.0:1784189258.614416:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458180864 00000100:00100000:2.0:1784189258.614425:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458180992 00000100:00100000:2.0:1784189258.614428:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458180992 00000100:00100000:2.0:1784189258.614450:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458181120 00000100:00100000:2.0:1784189258.614453:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458181120 00000100:00100000:2.0:1784189258.614463:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458181248 00000100:00100000:2.0:1784189258.614465:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458181248 00000100:00100000:2.0:1784189258.614476:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 317 00000100:00100000:2.0:1784189258.614484:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf470e1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:bd553d0d-03e2-4233-b06b-b55bbfa2b954+9:93022:x1870854458180224:12345-0@lo:104: 00010000:00010000:2.0:1784189258.615019:0:6497:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.112@tcp lock: ffff9dc04152da00/0xcc1762b626f8be42 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xcc1762b626f8be49 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189258.615097:0:6497:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1784189258.615103:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf470e1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:bd553d0d-03e2-4233-b06b-b55bbfa2b954+9:93022:x1870854458180224:12345-0@lo:104: Request processed in 620us (4828us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189258.615111:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 317 00010000:00010000:2.0:1784189258.615139:0:26173:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784189258.615146:0:26173:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.112@tcp lock: ffff9dc04152da00/0xcc1762b626f8be42 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xcc1762b626f8be49 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189258.615154:0:26173:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc04152da00 already unused, calling callback (ffffffffc114ac20) 10000000:00010000:2.0:1784189258.615158:0:26173:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.112@tcp lock: ffff9dc04152da00/0xcc1762b626f8be42 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0xcc1762b626f8be49 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189258.615168:0:26173:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.112@tcp lock: ffff9dc04152da00/0xcc1762b626f8be42 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0xcc1762b626f8be49 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1784189258.615176:0:26173:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.112@tcp lock: ffff9dc04152da00/0xcc1762b626f8be42 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0xcc1762b626f8be49 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784189258.615183:0:26173:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1784189258.615218:0:26173:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.112@tcp lock: ffff9dc04152da00/0xcc1762b626f8be42 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcc1762b626f8be49 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189258.615237:0:26173:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1784189258.615361:0:49501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 318 00000100:00100000:1.0:1784189258.615374:0:49501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf470e1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:bd553d0d-03e2-4233-b06b-b55bbfa2b954+8:93022:x1870854458180608:12345-0@lo:104: 00010000:00010000:1.0:1784189258.615383:0:49501:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.112@tcp lock: ffff9dbf4369d600/0xcc1762b626f8be26 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xcc1762b626f8be2d expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189258.615427:0:49501:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1784189258.615432:0:49501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf470e1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:bd553d0d-03e2-4233-b06b-b55bbfa2b954+8:93022:x1870854458180608:12345-0@lo:104: Request processed in 64us (1601us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189258.615448:0:49501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 318 00000100:00100000:1.0:1784189258.615463:0:49501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 319 00000100:00100000:1.0:1784189258.615469:0:49501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf470e2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:bd553d0d-03e2-4233-b06b-b55bbfa2b954+7:93022:x1870854458180736:12345-0@lo:104: 00010000:00010000:1.0:1784189258.615477:0:49501:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.112@tcp lock: ffff9dc0565e7a00/0xcc1762b626f8be18 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xcc1762b626f8be1f expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189258.615527:0:49501:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1784189258.615531:0:49501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf470e2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:bd553d0d-03e2-4233-b06b-b55bbfa2b954+7:93022:x1870854458180736:12345-0@lo:104: Request processed in 63us (1634us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189258.615537:0:49501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 319 00000100:00100000:1.0:1784189258.615551:0:49501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 320 00000100:00100000:1.0:1784189258.615557:0:49501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc050541180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:bd553d0d-03e2-4233-b06b-b55bbfa2b954+6:93022:x1870854458180864:12345-0@lo:104: 00010000:00010000:1.0:1784189258.615565:0:49501:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.112@tcp lock: ffff9dbf4369c000/0xcc1762b626f8bdee lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xcc1762b626f8bdf5 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189258.615693:0:26173:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.112@tcp lock: ffff9dc04152da00/0xcc1762b626f8be42 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcc1762b626f8be49 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189258.615701:0:26173:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.112@tcp lock: ffff9dc04152da00/0xcc1762b626f8be42 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcc1762b626f8be49 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189258.615717:0:26173:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1784189258.615720:0:26173:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.112@tcp lock: ffff9dbf4369d600/0xcc1762b626f8be26 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0xcc1762b626f8be2d expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189258.615727:0:26173:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dbf4369d600 already unused, calling callback (ffffffffc114ac20) 10000000:00010000:2.0:1784189258.615730:0:26173:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.112@tcp lock: ffff9dbf4369d600/0xcc1762b626f8be26 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0xcc1762b626f8be2d expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189258.615737:0:26173:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.112@tcp lock: ffff9dbf4369d600/0xcc1762b626f8be26 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0xcc1762b626f8be2d expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1784189258.615744:0:26173:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.112@tcp lock: ffff9dbf4369d600/0xcc1762b626f8be26 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0xcc1762b626f8be2d expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784189258.615750:0:26173:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1784189258.615767:0:26173:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.112@tcp lock: ffff9dbf4369d600/0xcc1762b626f8be26 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcc1762b626f8be2d expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189258.615773:0:26173:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1784189258.615790:0:26173:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.112@tcp lock: ffff9dbf4369d600/0xcc1762b626f8be26 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcc1762b626f8be2d expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189258.615796:0:26173:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.112@tcp lock: ffff9dbf4369d600/0xcc1762b626f8be26 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcc1762b626f8be2d expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189258.615813:0:26173:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784189258.615817:0:26173:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.112@tcp lock: ffff9dc0565e7a00/0xcc1762b626f8be18 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xcc1762b626f8be1f expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189258.615823:0:26173:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc0565e7a00 already unused, calling callback (ffffffffc114ac20) 10000000:00010000:2.0:1784189258.615826:0:26173:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.112@tcp lock: ffff9dc0565e7a00/0xcc1762b626f8be18 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0xcc1762b626f8be1f expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189258.615833:0:26173:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.112@tcp lock: ffff9dc0565e7a00/0xcc1762b626f8be18 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0xcc1762b626f8be1f expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1784189258.615839:0:26173:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.112@tcp lock: ffff9dc0565e7a00/0xcc1762b626f8be18 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0xcc1762b626f8be1f expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784189258.615845:0:26173:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1784189258.615860:0:26173:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.112@tcp lock: ffff9dc0565e7a00/0xcc1762b626f8be18 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcc1762b626f8be1f expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189258.615866:0:26173:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1784189258.615873:0:26173:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.112@tcp lock: ffff9dc0565e7a00/0xcc1762b626f8be18 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcc1762b626f8be1f expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189258.615880:0:26173:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.112@tcp lock: ffff9dc0565e7a00/0xcc1762b626f8be18 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcc1762b626f8be1f expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189258.615890:0:26173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784189258.615891:0:26173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784189258.615893:0:26173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784189258.615901:0:7454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784189258.615923:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc080e7df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bd553d0d-03e2-4233-b06b-b55bbfa2b954:3642:1870854458181504:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1784189258.616080:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784189258.616123:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1784189258.616130:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc080e7f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bd553d0d-03e2-4233-b06b-b55bbfa2b954:3642:1870854458181632:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1784189258.616154:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784189258.616184:0:25703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458181504 00000100:00100000:2.0:1784189258.616191:0:25703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458181504 00010000:00010000:2.0:1784189258.616217:0:25703:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9dc0565e6c00/0xcc1762b626f8be2d lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcc1762b626f8be26 expref: 22 pid: 92397 timeout: 3600 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784189258.616255:0:25703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458181632 00000100:00100000:2.0:1784189258.616259:0:25703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458181632 00010000:00010000:2.0:1784189258.616271:0:25703:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9dc04152d000/0xcc1762b626f8be1f lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcc1762b626f8be18 expref: 23 pid: 92397 timeout: 3600 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784189258.616291:0:25703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2557 00000100:00100000:2.0:1784189258.616297:0:25703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc080e7c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:bd553d0d-03e2-4233-b06b-b55bbfa2b954+23:3642:x1870854458181504:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1784189258.616309:0:25703:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784189258.616314:0:25703:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9dc0565e6c00/0xcc1762b626f8be2d lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcc1762b626f8be26 expref: 23 pid: 92397 timeout: 3600 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189258.616341:0:25703:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9dc0565e6c00/0xcc1762b626f8be2d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcc1762b626f8be26 expref: 23 pid: 92397 timeout: 3600 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189258.616362:0:25703:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784189258.616389:0:25703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc080e7c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:bd553d0d-03e2-4233-b06b-b55bbfa2b954+23:3642:x1870854458181504:12345-0@lo:103:ldlm_bl.0 Request processed in 93us (310us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189258.616395:0:25703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2557 00000100:00100000:2.0:1784189258.616408:0:25703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2558 00000100:00100000:2.0:1784189258.616421:0:25703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc080e7ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:bd553d0d-03e2-4233-b06b-b55bbfa2b954+22:3642:x1870854458181632:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1784189258.616428:0:25703:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784189258.616432:0:25703:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9dc04152d000/0xcc1762b626f8be1f lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcc1762b626f8be18 expref: 22 pid: 92397 timeout: 3600 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189258.616440:0:25703:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9dc04152d000/0xcc1762b626f8be1f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcc1762b626f8be18 expref: 22 pid: 92397 timeout: 3600 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189258.616449:0:25703:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784189258.616468:0:25703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc080e7ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:bd553d0d-03e2-4233-b06b-b55bbfa2b954+22:3642:x1870854458181632:12345-0@lo:103:ldlm_bl.0 Request processed in 48us (314us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189258.616473:0:25703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2558 00000100:00100000:2.0:1784189258.616508:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc080e7e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:bd553d0d-03e2-4233-b06b-b55bbfa2b954:3641:1870854458181376:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1784189258.616532:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784189258.616562:0:7455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458181376 00000100:00100000:2.0:1784189258.616566:0:7455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458181376 00010000:00010000:2.0:1784189258.616577:0:7455:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9dc0755a5e00/0xcc1762b626f8be49 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcc1762b626f8be42 expref: 22 pid: 92396 timeout: 3600 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784189258.616711:0:7455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2559 00000100:00100000:2.0:1784189258.616718:0:7455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc05f02ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bd553d0d-03e2-4233-b06b-b55bbfa2b954+22:3641:x1870854458181376:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1784189258.616726:0:7455:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784189258.616730:0:7455:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9dc0755a5e00/0xcc1762b626f8be49 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcc1762b626f8be42 expref: 22 pid: 92396 timeout: 3600 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189258.616739:0:7455:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9dc0755a5e00/0xcc1762b626f8be49 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcc1762b626f8be42 expref: 22 pid: 92396 timeout: 3600 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189258.616750:0:7455:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784189258.616787:0:7455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc05f02ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bd553d0d-03e2-4233-b06b-b55bbfa2b954+22:3641:x1870854458181376:12345-0@lo:103:ldlm_bl.0 Request processed in 70us (253us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189258.616793:0:7455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2559 00010000:00010000:2.0:1784189258.616820:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784189258.616843:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc080e7e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:bd553d0d-03e2-4233-b06b-b55bbfa2b954:3641:1870854458181376:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1784189258.616870:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc080e7f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bd553d0d-03e2-4233-b06b-b55bbfa2b954:3642:1870854458181632:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1784189258.616876:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc080e7df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bd553d0d-03e2-4233-b06b-b55bbfa2b954:3642:1870854458181504:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1784189258.616929:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 321 00000100:00100000:2.0:1784189258.616937:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc04914a850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:bd553d0d-03e2-4233-b06b-b55bbfa2b954+6:93022:x1870854458180992:12345-0@lo:104: 00010000:00010000:2.0:1784189258.616947:0:6497:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.112@tcp lock: ffff9dc0565e6400/0xcc1762b626f8bdd2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xcc1762b626f8bdd9 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189258.616986:0:6497:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1784189258.616991:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc04914a850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:bd553d0d-03e2-4233-b06b-b55bbfa2b954+6:93022:x1870854458180992:12345-0@lo:104: Request processed in 56us (2959us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189258.616998:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 321 00010000:00010000:2.0:1784189258.617012:0:6502:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784189258.617018:0:6502:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.112@tcp lock: ffff9dc0565e6400/0xcc1762b626f8bdd2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xcc1762b626f8bdd9 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189258.617025:0:6502:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc0565e6400 already unused, calling callback (ffffffffc114ac20) 10000000:00010000:2.0:1784189258.617028:0:6502:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.112@tcp lock: ffff9dc0565e6400/0xcc1762b626f8bdd2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xcc1762b626f8bdd9 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189258.617037:0:6502:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.112@tcp lock: ffff9dc0565e6400/0xcc1762b626f8bdd2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xcc1762b626f8bdd9 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1784189258.617055:0:6502:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.112@tcp lock: ffff9dc0565e6400/0xcc1762b626f8bdd2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xcc1762b626f8bdd9 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784189258.617061:0:6502:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1784189258.617086:0:6502:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.112@tcp lock: ffff9dc0565e6400/0xcc1762b626f8bdd2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcc1762b626f8bdd9 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189258.617092:0:6502:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1784189258.617104:0:6502:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.112@tcp lock: ffff9dc0565e6400/0xcc1762b626f8bdd2 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcc1762b626f8bdd9 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189258.617112:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.112@tcp lock: ffff9dc0565e6400/0xcc1762b626f8bdd2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcc1762b626f8bdd9 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189258.617123:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784189258.617124:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784189258.617126:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784189258.617136:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1784189258.617143:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc05f02e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:bd553d0d-03e2-4233-b06b-b55bbfa2b954:3641:1870854458181760:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1784189258.617167:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784189258.617191:0:25703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458181760 00000100:00100000:2.0:1784189258.617195:0:25703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458181760 00010000:00010000:2.0:1784189258.617209:0:25703:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9dc0755a5a00/0xcc1762b626f8bdd9 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcc1762b626f8bdd2 expref: 22 pid: 92396 timeout: 3600 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784189258.617227:0:25703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2560 00000100:00100000:2.0:1784189258.617233:0:25703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc080e7df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:bd553d0d-03e2-4233-b06b-b55bbfa2b954+22:3641:x1870854458181760:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1784189258.617241:0:25703:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784189258.617251:0:25703:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9dc0755a5a00/0xcc1762b626f8bdd9 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcc1762b626f8bdd2 expref: 22 pid: 92396 timeout: 3600 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189258.617260:0:25703:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9dc0755a5a00/0xcc1762b626f8bdd9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcc1762b626f8bdd2 expref: 22 pid: 92396 timeout: 3600 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189258.617272:0:25703:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784189258.617298:0:25703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc080e7df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:bd553d0d-03e2-4233-b06b-b55bbfa2b954+22:3641:x1870854458181760:12345-0@lo:103:ldlm_bl.0 Request processed in 65us (130us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189258.617305:0:25703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2560 00000100:00100000:2.0:1784189258.617366:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc05f02e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:bd553d0d-03e2-4233-b06b-b55bbfa2b954:3641:1870854458181760:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1784189258.617387:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 322 00000100:00100000:2.0:1784189258.617395:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc080e7dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:bd553d0d-03e2-4233-b06b-b55bbfa2b954+5:93022:x1870854458181120:12345-0@lo:104: 00010000:00010000:2.0:1784189258.617402:0:6497:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.112@tcp lock: ffff9dbf4369d200/0xcc1762b626f8bda1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xcc1762b626f8bda8 expref: -99 pid: 92390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189258.617440:0:6497:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1784189258.617445:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc080e7dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:bd553d0d-03e2-4233-b06b-b55bbfa2b954+5:93022:x1870854458181120:12345-0@lo:104: Request processed in 52us (3143us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189258.617450:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 322 00010000:00010000:2.0:1784189258.617462:0:26173:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784189258.617466:0:26173:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.112@tcp lock: ffff9dbf4369d200/0xcc1762b626f8bda1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xcc1762b626f8bda8 expref: -99 pid: 92390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189258.617474:0:26173:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dbf4369d200 already unused, calling callback (ffffffffc114ac20) 10000000:00010000:2.0:1784189258.617477:0:26173:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.112@tcp lock: ffff9dbf4369d200/0xcc1762b626f8bda1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xcc1762b626f8bda8 expref: -99 pid: 92390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189258.617484:0:26173:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.112@tcp lock: ffff9dbf4369d200/0xcc1762b626f8bda1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xcc1762b626f8bda8 expref: -99 pid: 92390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1784189258.617509:0:26173:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.112@tcp lock: ffff9dbf4369d200/0xcc1762b626f8bda1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xcc1762b626f8bda8 expref: -99 pid: 92390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784189258.617514:0:26173:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1784189258.617534:0:26173:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.112@tcp lock: ffff9dbf4369d200/0xcc1762b626f8bda1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcc1762b626f8bda8 expref: -99 pid: 92390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189258.617539:0:26173:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1784189258.617549:0:26173:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.112@tcp lock: ffff9dbf4369d200/0xcc1762b626f8bda1 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcc1762b626f8bda8 expref: -99 pid: 92390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189258.617555:0:26173:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.112@tcp lock: ffff9dbf4369d200/0xcc1762b626f8bda1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcc1762b626f8bda8 expref: -99 pid: 92390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189258.617564:0:26173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784189258.617566:0:26173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784189258.617567:0:26173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784189258.617577:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1784189258.617893:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 323 00000100:00100000:3.0:1784189258.617903:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc080e7fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:bd553d0d-03e2-4233-b06b-b55bbfa2b954+4:93022:x1870854458181248:12345-0@lo:104: 00010000:00010000:3.0:1784189258.617913:0:6496:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.112@tcp lock: ffff9dbf4369c600/0xcc1762b626f8bcc8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xcc1762b626f8bccf expref: -99 pid: 92390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189258.617955:0:6496:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1784189258.617960:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc080e7fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:bd553d0d-03e2-4233-b06b-b55bbfa2b954+4:93022:x1870854458181248:12345-0@lo:104: Request processed in 61us (3646us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189258.617966:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 323 00000100:00100000:3.0:1784189258.618241:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1784189258.618351:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00010000:00010000:3.0:1784189258.618370:0:7454:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784189258.618375:0:7454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.112@tcp lock: ffff9dbf4369c600/0xcc1762b626f8bcc8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xcc1762b626f8bccf expref: -99 pid: 92390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189258.618381:0:7454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dbf4369c600 already unused, calling callback (ffffffffc114ac20) 10000000:00010000:3.0:1784189258.618385:0:7454:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.112@tcp lock: ffff9dbf4369c600/0xcc1762b626f8bcc8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xcc1762b626f8bccf expref: -99 pid: 92390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189258.618393:0:7454:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.112@tcp lock: ffff9dbf4369c600/0xcc1762b626f8bcc8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xcc1762b626f8bccf expref: -99 pid: 92390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1784189258.618410:0:7454:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.112@tcp lock: ffff9dbf4369c600/0xcc1762b626f8bcc8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xcc1762b626f8bccf expref: -99 pid: 92390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784189258.618415:0:7454:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1784189258.618445:0:7454:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.112@tcp lock: ffff9dbf4369c600/0xcc1762b626f8bcc8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcc1762b626f8bccf expref: -99 pid: 92390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189258.618451:0:7454:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1784189258.618468:0:7454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.112@tcp lock: ffff9dbf4369c600/0xcc1762b626f8bcc8 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcc1762b626f8bccf expref: -99 pid: 92390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189258.618476:0:7454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.112@tcp lock: ffff9dbf4369c600/0xcc1762b626f8bcc8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcc1762b626f8bccf expref: -99 pid: 92390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189258.618488:0:7454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784189258.618490:0:7454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784189258.618492:0:7454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784189258.619273:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436307456 00000100:00100000:3.0:1784189258.619284:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436307456 00010000:00010000:3.0:1784189258.619345:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9dc04152c400/0xcc1762b626f8c1ad lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c3fd7 expref: 10 pid: 92397 timeout: 3600 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784189258.619378:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436307584 00000100:00100000:3.0:1784189258.619382:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436307584 00010000:00010000:3.0:1784189258.619397:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9dc04a20ba00/0xcc1762b626f8c19f lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c3fc9 expref: 11 pid: 92397 timeout: 3600 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784189258.619418:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 2561 00000100:00100000:3.0:1784189258.619427:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf44c88700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:60f345e3-c70e-4f53-b5e7-c9671463c9a5+11:2396:x1870854436307456:12345-192.168.203.12@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1784189258.619455:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784189258.619462:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9dc04152c400/0xcc1762b626f8c1ad lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c3fd7 expref: 11 pid: 92397 timeout: 3600 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189258.619473:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9dc04152c400/0xcc1762b626f8c1ad lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c3fd7 expref: 11 pid: 92397 timeout: 3600 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189258.619506:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784189258.619568:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf44c88700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:60f345e3-c70e-4f53-b5e7-c9671463c9a5+11:2396:x1870854436307456:12345-192.168.203.12@tcp:103:ldlm_bl.0 Request processed in 141us (1330us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189258.619576:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 2561 00000100:00100000:3.0:1784189258.619595:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 2562 00000100:00100000:3.0:1784189258.619601:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc0711a7850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:60f345e3-c70e-4f53-b5e7-c9671463c9a5+10:2396:x1870854436307584:12345-192.168.203.12@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1784189258.619610:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784189258.619615:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9dc04a20ba00/0xcc1762b626f8c19f lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c3fc9 expref: 10 pid: 92397 timeout: 3600 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189258.619623:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9dc04a20ba00/0xcc1762b626f8c19f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c3fc9 expref: 10 pid: 92397 timeout: 3600 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189258.619633:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784189258.619651:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc0711a7850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:60f345e3-c70e-4f53-b5e7-c9671463c9a5+10:2396:x1870854436307584:12345-192.168.203.12@tcp:103:ldlm_bl.0 Request processed in 50us (1300us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189258.619657:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 2562 00000100:00100000:3.0:1784189258.619803:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1784189258.619820:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc080e62a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:bd553d0d-03e2-4233-b06b-b55bbfa2b954:3643:1870854458182016:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1784189258.619861:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784189258.619909:0:7455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458182016 00000100:00100000:3.0:1784189258.619913:0:7455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458182016 00010000:00010000:3.0:1784189258.619929:0:7455:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9dc04152ca00/0xcc1762b626f8bccf lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcc1762b626f8bcc8 expref: 22 pid: 92397 timeout: 3600 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784189258.619952:0:7455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2563 00000100:00100000:3.0:1784189258.619957:0:7455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc080e63480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bd553d0d-03e2-4233-b06b-b55bbfa2b954+22:3643:x1870854458182016:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1784189258.619965:0:7455:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784189258.619970:0:7455:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9dc04152ca00/0xcc1762b626f8bccf lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcc1762b626f8bcc8 expref: 22 pid: 92397 timeout: 3600 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189258.619979:0:7455:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9dc04152ca00/0xcc1762b626f8bccf lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcc1762b626f8bcc8 expref: 22 pid: 92397 timeout: 3600 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189258.619991:0:7455:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784189258.620021:0:7455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc080e63480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bd553d0d-03e2-4233-b06b-b55bbfa2b954+22:3643:x1870854458182016:12345-0@lo:103:ldlm_bl.0 Request processed in 63us (159us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189258.620027:0:7455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2563 00000100:00100000:3.0:1784189258.620067:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc080e62a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:bd553d0d-03e2-4233-b06b-b55bbfa2b954:3643:1870854458182016:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1784189258.620718:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc080e7f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bd553d0d-03e2-4233-b06b-b55bbfa2b954:3640:1870854458181888:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1784189258.620762:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1784189258.621035:0:49501:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1784189258.621044:0:49501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc050541180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:bd553d0d-03e2-4233-b06b-b55bbfa2b954+3:93022:x1870854458180864:12345-0@lo:104: Request processed in 5485us (7086us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189258.621053:0:49501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 320 00000100:00100000:3.0:1784189258.621247:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458181888 00000100:00100000:3.0:1784189258.621254:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458181888 00010000:00010000:3.0:1784189258.621282:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9dc0565e7000/0xcc1762b626f8bda8 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcc1762b626f8bda1 expref: 22 pid: 92396 timeout: 3600 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784189258.621336:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2564 00000100:00100000:3.0:1784189258.621344:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc080e7e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bd553d0d-03e2-4233-b06b-b55bbfa2b954+22:3640:x1870854458181888:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1784189258.621355:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784189258.621360:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9dc0565e7000/0xcc1762b626f8bda8 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcc1762b626f8bda1 expref: 22 pid: 92396 timeout: 3600 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189258.621390:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9dc0565e7000/0xcc1762b626f8bda8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcc1762b626f8bda1 expref: 22 pid: 92396 timeout: 3600 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189258.621411:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784189258.621450:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc080e7e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bd553d0d-03e2-4233-b06b-b55bbfa2b954+22:3640:x1870854458181888:12345-0@lo:103:ldlm_bl.0 Request processed in 107us (688us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189258.621457:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2564 00000100:00100000:3.0:1784189258.621492:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc080e7f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bd553d0d-03e2-4233-b06b-b55bbfa2b954:3640:1870854458181888:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1784189258.621603:0:93022:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dc0755a5e00/0xcc1762b626f8be49 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcc1762b626f8be42 expref: 21 pid: 92396 timeout: 3600 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784189258.621619:0:93022:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf470e0380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:93022:1870854458180224:0@lo:104: 00010000:00010000:0.0:1784189258.621633:0:93022:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dc0565e6c00/0xcc1762b626f8be2d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcc1762b626f8be26 expref: 20 pid: 92397 timeout: 3600 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784189258.621642:0:93022:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf470e1f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:93022:1870854458180608:0@lo:104: 00010000:00010000:0.0:1784189258.621653:0:93022:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dc04152d000/0xcc1762b626f8be1f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcc1762b626f8be18 expref: 19 pid: 92397 timeout: 3600 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784189258.621663:0:93022:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf470e3b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:93022:1870854458180736:0@lo:104: 00000100:00100000:0.0:1784189258.621672:0:93022:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf470e3800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:93022:1870854458180864:0@lo:104: 00010000:00010000:0.0:1784189258.621682:0:93022:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dc0755a5a00/0xcc1762b626f8bdd9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcc1762b626f8bdd2 expref: 18 pid: 92396 timeout: 3600 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784189258.621691:0:93022:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc050540e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:93022:1870854458180992:0@lo:104: 00010000:00010000:0.0:1784189258.621703:0:93022:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dc0565e7000/0xcc1762b626f8bda8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcc1762b626f8bda1 expref: 17 pid: 92396 timeout: 3600 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784189258.621711:0:93022:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc050542680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:93022:1870854458181120:0@lo:104: 00010000:00010000:0.0:1784189258.621721:0:93022:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dc04152ca00/0xcc1762b626f8bccf lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcc1762b626f8bcc8 expref: 16 pid: 92397 timeout: 3600 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784189258.621732:0:93022:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc050541880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:93022:1870854458181248:0@lo:104: 00010000:00010000:0.0:1784189258.621749:0:93022:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dc04152c400/0xcc1762b626f8c1ad lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c3fd7 expref: 9 pid: 92397 timeout: 3600 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784189258.621772:0:93022:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf470e1880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:93022:1870854458179712:192.168.203.12@tcp:104: 00010000:00010000:0.0:1784189258.621787:0:93022:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dc04a20ba00/0xcc1762b626f8c19f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c3fc9 expref: 8 pid: 92397 timeout: 3600 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784189258.621796:0:93022:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf470e2a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:93022:1870854458179840:192.168.203.12@tcp:104: 00010000:00010000:0.0:1784189258.621841:0:93022:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9dc04152ce00/0xcc1762b626f8c1bb lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 93022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189258.624820:0:6501:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784189258.624837:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.112@tcp lock: ffff9dbf4369c000/0xcc1762b626f8bdee lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xcc1762b626f8bdf5 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189258.624852:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dbf4369c000 already unused, calling callback (ffffffffc114ac20) 10000000:00010000:2.0:1784189258.624857:0:6501:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.112@tcp lock: ffff9dbf4369c000/0xcc1762b626f8bdee lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xcc1762b626f8bdf5 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189258.624869:0:6501:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.112@tcp lock: ffff9dbf4369c000/0xcc1762b626f8bdee lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xcc1762b626f8bdf5 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1784189258.624900:0:6501:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.112@tcp lock: ffff9dbf4369c000/0xcc1762b626f8bdee lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xcc1762b626f8bdf5 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784189258.624906:0:6501:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1784189258.624981:0:6501:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.112@tcp lock: ffff9dbf4369c000/0xcc1762b626f8bdee lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcc1762b626f8bdf5 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189258.624988:0:6501:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1784189258.625025:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.112@tcp lock: ffff9dbf4369c000/0xcc1762b626f8bdee lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcc1762b626f8bdf5 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189258.625033:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.112@tcp lock: ffff9dbf4369c000/0xcc1762b626f8bdee lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcc1762b626f8bdf5 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189258.625060:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784189258.625062:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784189258.625065:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784189258.625089:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1784189258.625114:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc080e7f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bd553d0d-03e2-4233-b06b-b55bbfa2b954:3642:1870854458182144:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1784189258.625199:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784189258.625411:0:26172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458182144 00000100:00100000:2.0:1784189258.625421:0:26172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458182144 00010000:00010000:2.0:1784189258.625459:0:26172:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9dc0755a4e00/0xcc1762b626f8bdf5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcc1762b626f8bdee expref: 16 pid: 92396 timeout: 3600 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784189258.625507:0:26172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2565 00000100:00100000:2.0:1784189258.625518:0:26172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc080e7c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:bd553d0d-03e2-4233-b06b-b55bbfa2b954+16:3642:x1870854458182144:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1784189258.625533:0:26172:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784189258.625547:0:26172:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9dc0755a4e00/0xcc1762b626f8bdf5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcc1762b626f8bdee expref: 16 pid: 92396 timeout: 3600 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189258.625559:0:26172:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9dc0755a4e00/0xcc1762b626f8bdf5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcc1762b626f8bdee expref: 16 pid: 92396 timeout: 3600 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189258.625576:0:26172:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dc0755a4e00/0xcc1762b626f8bdf5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcc1762b626f8bdee expref: 16 pid: 92396 timeout: 3600 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189258.625678:0:26172:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9dc04152ce00/0xcc1762b626f8c1bb lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 93022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189258.625689:0:26172:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dc04152ce00/0xcc1762b626f8c1bb lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 93022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189258.625709:0:26172:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9dc04152ce00/0xcc1762b626f8c1bb lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 93022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189258.625717:0:26172:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9dc04152ce00/0xcc1762b626f8c1bb lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 93022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189258.625726:0:26172:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9dc04152ce00/0xcc1762b626f8c1bb lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 93022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189258.625733:0:26172:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9dc04152ce00/0xcc1762b626f8c1bb lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 93022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189258.625739:0:26172:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc04152ce00 already unused, calling callback (ffffffffc0b2e230) 00010000:00010000:2.0:1784189258.625744:0:26172:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9dc04152ce00/0xcc1762b626f8c1bb lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 93022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189258.625751:0:26172:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9dc04152ce00/0xcc1762b626f8c1bb lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 93022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189258.625784:0:26172:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9dc04152ce00/0xcc1762b626f8c1bb lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 93022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189258.625796:0:26172:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784189258.625840:0:26172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc080e7c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:bd553d0d-03e2-4233-b06b-b55bbfa2b954+15:3642:x1870854458182144:12345-0@lo:103:ldlm_bl.0 Request processed in 323us (640us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189258.625848:0:26172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2565 00000100:00100000:2.0:1784189258.625896:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc080e7f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bd553d0d-03e2-4233-b06b-b55bbfa2b954:3642:1870854458182144:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1784189258.627127:0:93022:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9dc04152ce00/0xcc1762b626f8c1bb lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 93022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189258.627145:0:93022:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9dc04152ce00/0xcc1762b626f8c1bb lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 93022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189258.627152:0:93022:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dc04152ce00/0xcc1762b626f8c1bb lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 93022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784189258.800677:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc080e62a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1870854458182272:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1784189258.800753:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784189258.800966:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc050541880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1870854458182400:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1784189258.803202:0:9466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458182272 00000100:00100000:3.0:1784189258.803217:0:9466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458182272 00000100:00100000:3.0:1784189258.803387:0:9466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2018 00000100:00100000:3.0:1784189258.803399:0:9466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc080e7f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3640:x1870854458182272:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1784189258.803429:0:9466:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8647872 pending 0 free 3922481152 avail 3690958848 00000100:00100000:3.0:1784189258.804022:0:9466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc080e7f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3640:x1870854458182272:12345-0@lo:13:osp-pre-0-1.0 Request processed in 121us (2762us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189258.804033:0:9466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2018 00000100:00100000:3.0:1784189258.804090:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc080e62a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1870854458182272:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1784189258.804256:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784189258.804605:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458182400 00000100:00100000:2.0:1784189258.804610:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458182400 00000100:00080000:1.0:1784189258.807927:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1784189258.807937:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1784189258.809116:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2019 00000100:00100000:2.0:1784189258.809133:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc050542680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1870854458182400:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1784189258.809166:0:8432:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 210112 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1784189258.809265:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc050542680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1870854458182400:12345-0@lo:13:osp-pre-1-1.0 Request processed in 139us (5008us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189258.809272:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2019 00000100:00100000:0.0:1784189258.809562:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc050541880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1870854458182400:0@lo:13:osp-pre-1-1.0 00010000:00010000:2.0:1784189259.504297:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784189259.823590:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1784189259.823613:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc080e62a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1870854458182528:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1784189259.823681:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784189259.823822:0:26492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458182528 00000100:00100000:0.0:1784189259.823830:0:26492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458182528 00000100:00100000:0.0:1784189259.823886:0:26492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3871 00000100:00100000:0.0:1784189259.823899:0:26492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf46955500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3643:x1870854458182528:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1784189259.823933:0:26492:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445249024 avail 1299009536 00000100:00100000:0.0:1784189259.823983:0:26492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf46955500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3643:x1870854458182528:12345-0@lo:41:osp-pre-0-1.0 Request processed in 89us (301us total) trans 0 rc 0/0 00000100:00100000:0.0:1784189259.823991:0:26492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3871 00000100:00100000:0.0:1784189259.824031:0:3643:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 115964116994 gen 3 00000004:00080000:0.0:1784189259.824036:0:3643:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 115964116993 committed transno 115964116994 00000004:00080000:0.0:1784189259.824054:0:3643:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 115964116994 committed transno 115964116994 00000020:00080000:0.0:1784189259.824061:0:3643:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0001-osd tmt ffff9dc0718de840 refcount 2 committed 0 result 0 batchid 77309411387 00000020:00080000:0.0:1784189259.824065:0:3643:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9dc074a0d800 obd lustre-MDT0000-osp-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff9dc0718de9c0 00000020:00080000:0.0:1784189259.824087:0:3643:0:(update_trans.c:71:top_multiple_thandle_dump()) cookie [0x2000088d1:0x2:0x0].3 00000020:00080000:0.0:1784189259.824090:0:3643:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9dc074a0de00 obd lustre-MDT0001-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9dc07631ae00 00000020:00080000:0.0:1784189259.824093:0:3643:0:(update_trans.c:71:top_multiple_thandle_dump()) cookie [0x2400090a0:0x2:0x0].3 00000100:00100000:0.0:1784189259.824120:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc080e62a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1870854458182528:0@lo:41:osp-pre-0-1.0 00000020:00080000:0.0:1784189259.824139:0:75608:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 77309411387 committed batchid 77309411386 00000020:00080000:0.0:1784189259.824197:0:75608:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 77309411386 00000100:00100000:1.0:1784189259.824477:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc080e62680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bd553d0d-03e2-4233-b06b-b55bbfa2b954:3640:1870854458182784:0@lo:400:kworker.0 00000100:00100000:1.0:1784189259.824522:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784189259.824558:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc075f7ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3640:1870854458183296:0@lo:400:kworker.0 00000100:00100000:1.0:1784189259.824588:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784189259.824604:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc075f7d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1870854458183808:0@lo:400:kworker.0 00000100:00100000:1.0:1784189259.824625:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784189259.824643:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1784189259.824649:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc080e62a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3640:1870854458182912:0@lo:400:kworker.0 00000100:00100000:1.0:1784189259.824671:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784189259.824690:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc075f7c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1870854458183424:0@lo:400:kworker.0 00000100:00100000:1.0:1784189259.824713:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784189259.824727:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc075f7e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1870854458183936:0@lo:400:kworker.0 00000100:00100000:1.0:1784189259.824747:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784189259.824773:0:68287:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458183296 00000100:00100000:1.0:1784189259.824778:0:68287:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458183296 00000100:00100000:1.0:1784189259.824819:0:68287:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458182912 00000100:00100000:1.0:1784189259.824823:0:68287:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458182912 00000100:00100000:1.0:1784189259.824843:0:68287:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1260 00000100:00100000:1.0:1784189259.824850:0:68287:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf46955880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1870854458183296:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784189259.824888:0:68287:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf46955880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1870854458183296:12345-0@lo:400:kworker.0 Request processed in 39us (299us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189259.824904:0:68287:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1260 00000100:00100000:1.0:1784189259.824919:0:68287:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1261 00000100:00100000:1.0:1784189259.824925:0:68287:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf46957100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1870854458182912:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784189259.824955:0:68287:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf46957100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1870854458182912:12345-0@lo:400:kworker.0 Request processed in 30us (283us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189259.824960:0:68287:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1261 00000100:00080000:1.0:1784189259.824976:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1784189259.824981:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1784189259.825008:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc080e62a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3640:1870854458182912:0@lo:400:kworker.0 00000100:00100000:1.0:1784189259.825018:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc075f7ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3640:1870854458183296:0@lo:400:kworker.0 00000100:00100000:3.0:1784189259.825091:0:92396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458182784 00000100:00100000:3.0:1784189259.825095:0:92396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458182784 00000100:00100000:3.0:1784189259.825131:0:92396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1784189259.825138:0:92396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf4a37d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd553d0d-03e2-4233-b06b-b55bbfa2b954+15:3640:x1870854458182784:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784189259.825177:0:92396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf4a37d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd553d0d-03e2-4233-b06b-b55bbfa2b954+15:3640:x1870854458182784:12345-0@lo:400:kworker.0 Request processed in 39us (655us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189259.825183:0:92396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1784189259.825222:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc080e62680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bd553d0d-03e2-4233-b06b-b55bbfa2b954:3640:1870854458182784:0@lo:400:kworker.0 00000100:00100000:0.0:1784189259.825566:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458183808 00000100:00100000:0.0:1784189259.825570:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458183808 00000100:00100000:0.0:1784189259.825609:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3872 00000100:00100000:0.0:1784189259.825617:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf46957480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3640:x1870854458183808:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784189259.825668:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf46957480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3640:x1870854458183808:12345-0@lo:400:kworker.0 Request processed in 53us (1041us total) trans 0 rc 0/0 00000100:00100000:0.0:1784189259.825675:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3872 00000100:00100000:0.0:1784189259.825693:0:26165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458183424 00000100:00100000:0.0:1784189259.825696:0:26165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458183424 00000100:00100000:0.0:1784189259.825717:0:26165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458183936 00000100:00100000:0.0:1784189259.825720:0:26165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458183936 00000100:00100000:0.0:1784189259.825745:0:26165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2522 00000100:00100000:0.0:1784189259.825751:0:26165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf470e2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0001-mdtlov_UUID+6:3640:x1870854458183424:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784189259.825781:0:26165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf470e2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0001-mdtlov_UUID+6:3640:x1870854458183424:12345-0@lo:400:kworker.0 Request processed in 30us (1068us total) trans 0 rc 0/0 00000100:00100000:0.0:1784189259.825788:0:26165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2522 00000100:00100000:0.0:1784189259.825799:0:26165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2523 00000100:00100000:0.0:1784189259.825805:0:26165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf470e1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+5:3640:x1870854458183936:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784189259.825830:0:26165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf470e1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+5:3640:x1870854458183936:12345-0@lo:400:kworker.0 Request processed in 26us (1083us total) trans 0 rc 0/0 00000100:00100000:0.0:1784189259.825847:0:26165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2523 00000100:00080000:0.0:1784189259.825867:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1784189259.825877:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf46954700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1870854458182656:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1784189259.825909:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784189259.825929:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc075f7f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3643:1870854458183168:0@lo:400:kworker.0 00000100:00100000:0.0:1784189259.825950:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784189259.825967:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc075f7c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3643:1870854458183680:0@lo:400:kworker.0 00000100:00100000:0.0:1784189259.825984:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784189259.825997:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc056eaca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3643:1870854458184192:0@lo:400:kworker.0 00000100:00100000:0.0:1784189259.826013:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784189259.826027:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:0.0:1784189259.826031:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf44c88700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3643:1870854458183040:0@lo:400:kworker.0 00000100:00100000:0.0:1784189259.826049:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784189259.826062:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc075f7ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1870854458183552:0@lo:400:kworker.0 00000100:00100000:0.0:1784189259.826079:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784189259.826092:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc075f7dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1870854458184064:0@lo:400:kworker.0 00000100:00100000:0.0:1784189259.826110:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784189259.826135:0:66169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458183168 00000100:00100000:0.0:1784189259.826139:0:66169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458183168 00000100:00100000:0.0:1784189259.826166:0:66169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458183680 00000100:00100000:0.0:1784189259.826168:0:66169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458183680 00000100:00100000:0.0:1784189259.826179:0:66169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458184192 00000100:00100000:0.0:1784189259.826181:0:66169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458184192 00000100:00100000:0.0:1784189259.826191:0:66169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458183040 00000100:00100000:0.0:1784189259.826194:0:66169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458183040 00000100:00100000:0.0:1784189259.826206:0:66169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1262 00000100:00100000:0.0:1784189259.826220:0:66169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc050540e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1870854458183168:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784189259.826253:0:66169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc050540e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1870854458183168:12345-0@lo:400:kworker.0 Request processed in 34us (302us total) trans 0 rc 0/0 00000100:00100000:0.0:1784189259.826259:0:66169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1262 00000100:00100000:0.0:1784189259.826271:0:66169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1263 00000100:00100000:0.0:1784189259.826276:0:66169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc050540700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1870854458183680:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784189259.826299:0:66169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc050540700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1870854458183680:12345-0@lo:400:kworker.0 Request processed in 23us (314us total) trans 0 rc 0/0 00000100:00100000:0.0:1784189259.826304:0:66169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1263 00000100:00100000:0.0:1784189259.826314:0:66169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1264 00000100:00100000:0.0:1784189259.826350:0:66169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc050542d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1870854458184192:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784189259.826372:0:66169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc050542d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1870854458184192:12345-0@lo:400:kworker.0 Request processed in 54us (358us total) trans 0 rc 0/0 00000100:00100000:0.0:1784189259.826377:0:66169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1264 00000100:00100000:0.0:1784189259.826386:0:66169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1265 00000100:00100000:0.0:1784189259.826391:0:66169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc050541f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1870854458183040:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784189259.826410:0:66169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc050541f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1870854458183040:12345-0@lo:400:kworker.0 Request processed in 19us (360us total) trans 0 rc 0/0 00000100:00100000:0.0:1784189259.826414:0:66169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1265 00000100:00100000:0.0:1784189259.826428:0:26166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458183552 00000100:00100000:0.0:1784189259.826431:0:26166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458183552 00000100:00100000:0.0:1784189259.826446:0:26166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458184064 00000100:00100000:0.0:1784189259.826448:0:26166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458184064 00000100:00100000:0.0:1784189259.826463:0:26166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2524 00000100:00100000:0.0:1784189259.826468:0:26166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc050542300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+5:3643:x1870854458183552:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784189259.826504:0:26166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc050542300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+5:3643:x1870854458183552:12345-0@lo:400:kworker.0 Request processed in 36us (423us total) trans 0 rc 0/0 00000100:00100000:0.0:1784189259.826516:0:26166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2524 00000100:00100000:0.0:1784189259.826528:0:26166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2525 00000100:00100000:0.0:1784189259.826533:0:26166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc050540a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+5:3643:x1870854458184064:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784189259.826562:0:26166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc050540a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+5:3643:x1870854458184064:12345-0@lo:400:kworker.0 Request processed in 29us (451us total) trans 0 rc 0/0 00000100:00100000:0.0:1784189259.826567:0:26166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2525 00000100:00100000:0.0:1784189259.826589:0:26492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458182656 00000100:00100000:0.0:1784189259.826592:0:26492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458182656 00000100:00100000:0.0:1784189259.826615:0:26492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3873 00000100:00100000:0.0:1784189259.826621:0:26492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc050541880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3643:x1870854458182656:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1784189259.826641:0:26492:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445576704 avail 1299337216 00000100:00100000:0.0:1784189259.826668:0:26492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc050541880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3643:x1870854458182656:12345-0@lo:41:osp-pre-1-0.0 Request processed in 47us (758us total) trans 0 rc 0/0 00000100:00100000:0.0:1784189259.826673:0:26492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3873 00000100:00080000:0.0:1784189259.826691:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1784189259.826693:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1784189259.826695:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1784189259.826725:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf44c88700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3643:1870854458183040:0@lo:400:kworker.0 00000100:00100000:0.0:1784189259.826735:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc075f7ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1870854458183552:0@lo:400:kworker.0 00000100:00100000:0.0:1784189259.826742:0:3643:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294968957 gen 2 00000100:00100000:0.0:1784189259.826755:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc075f7dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1870854458184064:0@lo:400:kworker.0 00000100:00100000:0.0:1784189259.826768:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf46954700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1870854458182656:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1784189259.826776:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc075f7f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3643:1870854458183168:0@lo:400:kworker.0 00000100:00100000:0.0:1784189259.826784:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc075f7c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3643:1870854458183680:0@lo:400:kworker.0 00000100:00100000:0.0:1784189259.826799:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc056eaca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3643:1870854458184192:0@lo:400:kworker.0 00000100:00100000:3.0:1784189259.826978:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc075f7c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1870854458183424:0@lo:400:kworker.0 00000100:00100000:3.0:1784189259.826987:0:3640:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294968954 gen 2 00000100:00100000:3.0:1784189259.826995:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc075f7e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1870854458183936:0@lo:400:kworker.0 00000100:00100000:3.0:1784189259.827004:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc075f7d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1870854458183808:0@lo:400:kworker.0 00000100:00100000:1.0:1784189259.943134:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1784189259.943373:0:92397:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436307712 00000100:00100000:3.0:1784189259.943387:0:92397:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436307712 00000100:00100000:3.0:1784189259.943461:0:92397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 75 00000100:00100000:3.0:1784189259.943473:0:92397:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf4a37c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:60f345e3-c70e-4f53-b5e7-c9671463c9a5+8:70943:x1870854436307712:12345-192.168.203.12@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784189259.943506:0:92397:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784189259.943535:0:92397:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dbf4369ce00/0xcc1762b626f8c1c2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xcbfc5de7fe6c3fde expref: -99 pid: 92397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189259.943579:0:92397:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dbf4369ce00/0xcc1762b626f8c1c2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c3fde expref: 9 pid: 92397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189259.943593:0:92397:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dbf4369ce00/0xcc1762b626f8c1c2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c3fde expref: 9 pid: 92397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189259.943605:0:92397:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dbf4369ce00, rc 0) 00000100:00100000:3.0:1784189259.943684:0:92397:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf4a37c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:60f345e3-c70e-4f53-b5e7-c9671463c9a5+9:70943:x1870854436307712:12345-192.168.203.12@tcp:101:ll_cfg_requeue.0 Request processed in 212us (563us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189259.943691:0:92397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 75 00000100:00100000:3.0:1784189259.946659:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1784189259.946832:0:92398:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436307840 00000100:00100000:1.0:1784189259.946845:0:92398:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436307840 00000100:00100000:1.0:1784189259.947014:0:92398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 76 00000100:00100000:1.0:1784189259.947027:0:92398:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf4a37f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:60f345e3-c70e-4f53-b5e7-c9671463c9a5+9:70943:x1870854436307840:12345-192.168.203.12@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1784189259.947276:0:92398:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf4a37f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:60f345e3-c70e-4f53-b5e7-c9671463c9a5+9:70943:x1870854436307840:12345-192.168.203.12@tcp:501:ll_cfg_requeue.0 Request processed in 250us (629us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189259.947285:0:92398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 76 00000100:00100000:1.0:1784189259.950061:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1784189259.950287:0:92396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436307968 00000100:00100000:0.0:1784189259.950298:0:92396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436307968 00000100:00100000:0.0:1784189259.953753:0:92396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 77 00000100:00100000:0.0:1784189259.953777:0:92396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf43728450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:60f345e3-c70e-4f53-b5e7-c9671463c9a5+9:70943:x1870854436307968:12345-192.168.203.12@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1784189259.955804:0:92396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf43728450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:60f345e3-c70e-4f53-b5e7-c9671463c9a5+9:70943:x1870854436307968:12345-192.168.203.12@tcp:503:ll_cfg_requeue.0 Request processed in 2023us (5743us total) trans 0 rc 0/0 00000100:00100000:0.0:1784189259.955820:0:92396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 77 00000100:00100000:2.0:1784189259.961796:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1784189259.962056:0:92398:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436308096 00000100:00100000:1.0:1784189259.962070:0:92398:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436308096 00000100:00100000:1.0:1784189259.962151:0:92398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 78 00000100:00100000:1.0:1784189259.962164:0:92398:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf43729850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:60f345e3-c70e-4f53-b5e7-c9671463c9a5+9:71889:x1870854436308096:12345-192.168.203.12@tcp:502:llog_process_th.0 00000100:00100000:1.0:1784189259.962419:0:92398:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf43729850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:60f345e3-c70e-4f53-b5e7-c9671463c9a5+9:71889:x1870854436308096:12345-192.168.203.12@tcp:502:llog_process_th.0 Request processed in 255us (636us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189259.962436:0:92398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 78 00000100:00100000:3.0:1784189259.967126:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1784189259.968370:0:92396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436308224 00000100:00100000:0.0:1784189259.968388:0:92396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436308224 00000100:00100000:0.0:1784189259.968481:0:92396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 79 00000100:00100000:0.0:1784189259.968502:0:92396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf43729450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:60f345e3-c70e-4f53-b5e7-c9671463c9a5+9:71889:x1870854436308224:12345-192.168.203.12@tcp:502:llog_process_th.0 00000100:00100000:0.0:1784189259.968713:0:92396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf43729450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:60f345e3-c70e-4f53-b5e7-c9671463c9a5+9:71889:x1870854436308224:12345-192.168.203.12@tcp:502:llog_process_th.0 Request processed in 212us (1601us total) trans 0 rc 0/0 00000100:00100000:0.0:1784189259.968722:0:92396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 79 00000100:00100000:3.0:1784189259.973807:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1784189259.974610:0:92398:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436308352 00000100:00100000:1.0:1784189259.974634:0:92398:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436308352 00000100:00100000:1.0:1784189259.974711:0:92398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 80 00000100:00100000:1.0:1784189259.974723:0:92398:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf4372b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:60f345e3-c70e-4f53-b5e7-c9671463c9a5+9:70943:x1870854436308352:12345-192.168.203.12@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784189259.974744:0:92398:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784189259.974767:0:92398:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dbf4710f000/0xcc1762b626f8c1c9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xcbfc5de7fe6c3fe5 expref: -99 pid: 92398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189259.974802:0:92398:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dbf4710f000/0xcc1762b626f8c1c9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c3fe5 expref: 10 pid: 92398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189259.974815:0:92398:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dbf4710f000/0xcc1762b626f8c1c9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c3fe5 expref: 10 pid: 92398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189259.974827:0:92398:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dbf4710f000, rc 0) 00000100:00100000:1.0:1784189259.974928:0:92398:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf4372b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:60f345e3-c70e-4f53-b5e7-c9671463c9a5+10:70943:x1870854436308352:12345-192.168.203.12@tcp:101:ll_cfg_requeue.0 Request processed in 207us (1136us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189259.974936:0:92398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 80 00000100:00100000:2.0:1784189259.982862:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1784189259.983558:0:92396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436308480 00000100:00100000:0.0:1784189259.983687:0:92396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436308480 00000100:00100000:0.0:1784189259.983805:0:92396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 81 00000100:00100000:0.0:1784189259.983819:0:92396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf4372a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:60f345e3-c70e-4f53-b5e7-c9671463c9a5+10:70943:x1870854436308480:12345-192.168.203.12@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1784189259.984514:0:92396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf4372a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:60f345e3-c70e-4f53-b5e7-c9671463c9a5+10:70943:x1870854436308480:12345-192.168.203.12@tcp:501:ll_cfg_requeue.0 Request processed in 694us (1663us total) trans 0 rc -2/-2 00000100:00100000:0.0:1784189259.984527:0:92396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 81 10000000:01000000:0.0:1784189260.210390:0:6510:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1784189260.210401:0:6510:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9dbf46b0a800 from 52 10000000:01000000:0.0:1784189260.210408:0:6510:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1784189260.210499:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff9dc04152ca00/0xcc1762b626f8c1d0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189260.210513:0:6510:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: ffff9dc04152ca00/0xcc1762b626f8c1d0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189260.210528:0:6510:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: ffff9dc04152ca00/0xcc1762b626f8c1d0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784189260.210572:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc050543800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458184320:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1784189260.210668:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784189260.210725:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dc0756ea540 going to sleep for 11 seconds 00000100:00100000:3.0:1784189260.210824:0:92397:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458184320 00000100:00100000:3.0:1784189260.210841:0:92397:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458184320 00000100:00100000:3.0:1784189260.210913:0:92397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1784189260.210924:0:92397:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf43728c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd553d0d-03e2-4233-b06b-b55bbfa2b954+15:6510:x1870854458184320:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784189260.210940:0:92397:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784189260.210956:0:92397:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dbf4369c600/0xcc1762b626f8c1d7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xcc1762b626f8c1d0 expref: -99 pid: 92397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189260.210986:0:92397:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dbf4369c600/0xcc1762b626f8c1d7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcc1762b626f8c1d0 expref: 16 pid: 92397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189260.210997:0:92397:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dbf4369c600/0xcc1762b626f8c1d7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcc1762b626f8c1d0 expref: 16 pid: 92397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189260.211007:0:92397:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dbf4369c600, rc 0) 00000100:00100000:3.0:1784189260.211068:0:92397:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf43728c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd553d0d-03e2-4233-b06b-b55bbfa2b954+16:6510:x1870854458184320:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 144us (399us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189260.211075:0:92397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1784189260.211340:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc050543800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458184320:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784189260.211357:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: ffff9dc04152ca00/0xcc1762b626f8c1d0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc1762b626f8c1d7 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189260.211368:0:6510:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: ffff9dc04152ca00/0xcc1762b626f8c1d0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcc1762b626f8c1d7 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784189260.211439:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc050543800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458184448:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1784189260.211465:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784189260.211504:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dc0756ea540 going to sleep for 11 seconds 00000100:00100000:3.0:1784189260.211661:0:92396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458184448 00000100:00100000:3.0:1784189260.211666:0:92396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458184448 00000100:00100000:3.0:1784189260.211696:0:92396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1784189260.211703:0:92396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf43729050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd553d0d-03e2-4233-b06b-b55bbfa2b954+16:6510:x1870854458184448:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784189260.211851:0:92396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf43729050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd553d0d-03e2-4233-b06b-b55bbfa2b954+16:6510:x1870854458184448:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 148us (385us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189260.211859:0:92396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1784189260.212004:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc050543800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458184448:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1784189260.212040:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc080e7ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458184576:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1784189260.212097:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784189260.212126:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dc0515efc00 going to sleep for 11 seconds 00000100:00100000:3.0:1784189260.212346:0:92396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458184576 00000100:00100000:3.0:1784189260.212351:0:92396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458184576 00000100:00100000:3.0:1784189260.212381:0:92396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1784189260.212388:0:92396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf43728050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd553d0d-03e2-4233-b06b-b55bbfa2b954+16:6510:x1870854458184576:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1784189260.212498:0:92396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf43728050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd553d0d-03e2-4233-b06b-b55bbfa2b954+16:6510:x1870854458184576:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 111us (400us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189260.212506:0:92396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1784189260.212772:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc080e7ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458184576:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1784189260.213278:0:93024:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc080e7ed80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bd553d0d-03e2-4233-b06b-b55bbfa2b954:93024:1870854458184704:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1784189260.213341:0:93024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784189260.213376:0:93024:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dc0515efcc0 going to sleep for 11 seconds 00000100:00100000:1.0:1784189260.213580:0:92398:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458184704 00000100:00100000:1.0:1784189260.213587:0:92398:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458184704 00000100:00100000:1.0:1784189260.213627:0:92398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1784189260.213635:0:92398:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf4372a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd553d0d-03e2-4233-b06b-b55bbfa2b954+16:93024:x1870854458184704:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1784189260.213749:0:92398:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf4372a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd553d0d-03e2-4233-b06b-b55bbfa2b954+16:93024:x1870854458184704:12345-0@lo:502:llog_process_th.0 Request processed in 114us (407us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189260.213756:0:92398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1784189260.213926:0:93024:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc080e7ed80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bd553d0d-03e2-4233-b06b-b55bbfa2b954:93024:1870854458184704:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1784189260.213973:0:93024:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc080e7ed80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bd553d0d-03e2-4233-b06b-b55bbfa2b954:93024:1870854458184832:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1784189260.214007:0:93024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784189260.214031:0:93024:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dc045243f00 going to sleep for 11 seconds 00000100:00100000:3.0:1784189260.214130:0:92396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458184832 00000100:00100000:3.0:1784189260.214135:0:92396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458184832 00000100:00100000:3.0:1784189260.214175:0:92396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1784189260.214183:0:92396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf4372b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd553d0d-03e2-4233-b06b-b55bbfa2b954+16:93024:x1870854458184832:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1784189260.214272:0:92396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf4372b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd553d0d-03e2-4233-b06b-b55bbfa2b954+16:93024:x1870854458184832:12345-0@lo:502:llog_process_th.0 Request processed in 89us (263us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189260.214279:0:92396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1784189260.214590:0:93024:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc080e7ed80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bd553d0d-03e2-4233-b06b-b55bbfa2b954:93024:1870854458184832:0@lo:502:llog_process_th.0 00000040:00080000:2.0:1784189260.214611:0:93024:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 55 count 54 00000020:01000000:0.0:1784189260.214852:0:6510:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 52-54 (rc=0) 10000000:01000000:0.0:1784189260.214878:0:6510:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1784189260.214901:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff9dc04152ca00/0xcc1762b626f8c1d0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc1762b626f8c1d7 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189260.214914:0:6510:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: ffff9dc04152ca00/0xcc1762b626f8c1d0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc1762b626f8c1d7 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784189260.214939:0:6510:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:0.0:1784189260.214942:0:6510:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 46 10000000:01000000:0.0:1784189260.214945:0:6510:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1784189260.214976:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff9dc04152d000/0xcc1762b626f8c1de lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189260.214985:0:6510:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: ffff9dc04152d000/0xcc1762b626f8c1de lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189260.214995:0:6510:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: ffff9dc04152d000/0xcc1762b626f8c1de lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784189260.215012:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc050543b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458184960:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1784189260.215059:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784189260.215089:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dc0756ea240 going to sleep for 11 seconds 00000100:00100000:3.0:1784189260.215276:0:92396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458184960 00000100:00100000:3.0:1784189260.215282:0:92396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458184960 00000100:00100000:3.0:1784189260.215355:0:92396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1784189260.215364:0:92396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf4372bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd553d0d-03e2-4233-b06b-b55bbfa2b954+16:6510:x1870854458184960:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784189260.215375:0:92396:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784189260.215391:0:92396:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dbf4369c400/0xcc1762b626f8c1e5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xcc1762b626f8c1de expref: -99 pid: 92396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189260.215416:0:92396:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dbf4369c400/0xcc1762b626f8c1e5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcc1762b626f8c1de expref: 17 pid: 92396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189260.215427:0:92396:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dbf4369c400/0xcc1762b626f8c1e5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcc1762b626f8c1de expref: 17 pid: 92396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189260.215436:0:92396:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dbf4369c400, rc 0) 00000100:00100000:3.0:1784189260.215478:0:92396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf4372bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd553d0d-03e2-4233-b06b-b55bbfa2b954+17:6510:x1870854458184960:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 116us (429us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189260.215504:0:92396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1784189260.215688:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc050543b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458184960:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784189260.215703:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: ffff9dc04152d000/0xcc1762b626f8c1de lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc1762b626f8c1e5 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189260.215713:0:6510:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: ffff9dc04152d000/0xcc1762b626f8c1de lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xcc1762b626f8c1e5 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784189260.215780:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc050543b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458185088:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1784189260.215807:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784189260.215837:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dc0756ea240 going to sleep for 11 seconds 00000100:00100000:3.0:1784189260.216036:0:92397:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458185088 00000100:00100000:3.0:1784189260.216042:0:92397:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458185088 00000100:00100000:3.0:1784189260.216125:0:92397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1784189260.216133:0:92397:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf4372ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd553d0d-03e2-4233-b06b-b55bbfa2b954+17:6510:x1870854458185088:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784189260.216279:0:92397:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf4372ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd553d0d-03e2-4233-b06b-b55bbfa2b954+17:6510:x1870854458185088:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 147us (470us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189260.216287:0:92397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1784189260.216365:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc050543b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458185088:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1784189260.216400:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc080e7ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458185216:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1784189260.216449:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784189260.220269:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dc0515efcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1784189260.224689:0:92396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458185216 00000100:00100000:0.0:1784189260.224710:0:92396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458185216 00000100:00100000:0.0:1784189260.224817:0:92396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1784189260.224829:0:92396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf43728850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd553d0d-03e2-4233-b06b-b55bbfa2b954+17:6510:x1870854458185216:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1784189260.225713:0:92396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf43728850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd553d0d-03e2-4233-b06b-b55bbfa2b954+17:6510:x1870854458185216:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 883us (9260us total) trans 0 rc 0/0 00000100:00100000:0.0:1784189260.225724:0:92396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1784189260.225824:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc080e7ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458185216:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1784189260.227147:0:93025:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc056eaf100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bd553d0d-03e2-4233-b06b-b55bbfa2b954:93025:1870854458185344:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1784189260.227299:0:93025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784189260.227424:0:93025:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dc081c5c180 going to sleep for 11 seconds 00000100:00100000:0.0:1784189260.227766:0:92396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458185344 00000100:00100000:0.0:1784189260.227773:0:92396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458185344 00000100:00100000:0.0:1784189260.227827:0:92396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1784189260.227837:0:92396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf43729c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd553d0d-03e2-4233-b06b-b55bbfa2b954+17:93025:x1870854458185344:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1784189260.228147:0:92396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf43729c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd553d0d-03e2-4233-b06b-b55bbfa2b954+17:93025:x1870854458185344:12345-0@lo:502:llog_process_th.0 Request processed in 310us (848us total) trans 0 rc 0/0 00000100:00100000:0.0:1784189260.228155:0:92396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1784189260.228337:0:93025:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc056eaf100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bd553d0d-03e2-4233-b06b-b55bbfa2b954:93025:1870854458185344:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1784189260.228391:0:93025:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1784189260.228405:0:93025:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784189260.228408:0:93025:0:(obd_config.c:1561:class_process_config()) marker 43 (0x1) lustre-MDT0000-m new lustre.pool_134 00000020:00000080:3.0:1784189260.228416:0:93025:0:(obd_config.c:1470:class_process_config()) processing cmd: ce020 00020000:01000000:3.0:1784189260.228521:0:93025:0:(lod_pool.c:475:lod_pool_new()) pool_134 is pool #1 00080000:10000000:3.0:1784189260.229568:0:93025:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x50:0x0] (8/32) registered 00080000:10000000:3.0:1784189260.234441:0:93025:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x51:0x0] (8/32) registered 00080000:10000000:3.0:1784189260.237915:0:93025:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x52:0x0] (8/32) registered 00000100:00100000:3.0:1784189260.244553:0:93025:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc056eaf100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bd553d0d-03e2-4233-b06b-b55bbfa2b954:93025:1870854458185472:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1784189260.244678:0:93025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784189260.244736:0:93025:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dc0713f29c0 going to sleep for 11 seconds 00000100:00100000:1.0:1784189260.244910:0:92398:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458185472 00000100:00100000:1.0:1784189260.244919:0:92398:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458185472 00000100:00100000:1.0:1784189260.244977:0:92398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1784189260.244987:0:92398:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf4a252850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd553d0d-03e2-4233-b06b-b55bbfa2b954+17:93025:x1870854458185472:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1784189260.245205:0:92398:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf4a252850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd553d0d-03e2-4233-b06b-b55bbfa2b954+17:93025:x1870854458185472:12345-0@lo:502:llog_process_th.0 Request processed in 219us (527us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189260.245215:0:92398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1784189260.245365:0:93025:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc056eaf100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bd553d0d-03e2-4233-b06b-b55bbfa2b954:93025:1870854458185472:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1784189260.245430:0:93025:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc050542a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bd553d0d-03e2-4233-b06b-b55bbfa2b954:93025:1870854458185600:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1784189260.245469:0:93025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784189260.245503:0:93025:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dc0756ea240 going to sleep for 11 seconds 00000100:00100000:1.0:1784189260.245556:0:92396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458185600 00000100:00100000:1.0:1784189260.245560:0:92396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458185600 00000100:00100000:1.0:1784189260.245599:0:92396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1784189260.245606:0:92396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf4a252450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd553d0d-03e2-4233-b06b-b55bbfa2b954+17:93025:x1870854458185600:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1784189260.245752:0:92396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf4a252450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd553d0d-03e2-4233-b06b-b55bbfa2b954+17:93025:x1870854458185600:12345-0@lo:502:llog_process_th.0 Request processed in 146us (281us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189260.245760:0:92396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1784189260.247816:0:93025:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc050542a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bd553d0d-03e2-4233-b06b-b55bbfa2b954:93025:1870854458185600:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1784189260.247874:0:93025:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1784189260.247885:0:93025:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784189260.247888:0:93025:0:(obd_config.c:1561:class_process_config()) marker 43 (0x2) lustre-MDT0000-m new lustre.pool_134 00000040:00080000:2.0:1784189260.247893:0:93025:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 50 count 49 00000020:01000000:0.0:1784189260.250409:0:6510:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 46-49 (rc=0) 10000000:01000000:0.0:1784189260.250459:0:6510:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1784189260.250474:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff9dc04152d000/0xcc1762b626f8c1de lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc1762b626f8c1e5 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189260.250499:0:6510:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: ffff9dc04152d000/0xcc1762b626f8c1de lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc1762b626f8c1e5 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784189260.254736:0:6510:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1784189260.254747:0:6510:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9dbf44675800 from 52 10000000:01000000:2.0:1784189260.254754:0:6510:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1784189260.254823:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff9dc04a20ac00/0xcc1762b626f8c1ec lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189260.254862:0:6510:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: ffff9dc04a20ac00/0xcc1762b626f8c1ec lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189260.254878:0:6510:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: ffff9dc04a20ac00/0xcc1762b626f8c1ec lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784189260.254914:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc080e7df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458185728:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1784189260.255136:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784189260.255462:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dc045243f00 going to sleep for 11 seconds 00000100:00100000:1.0:1784189260.255763:0:92396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458185728 00000100:00100000:1.0:1784189260.255773:0:92396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458185728 00000100:00100000:1.0:1784189260.255839:0:92396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1784189260.255850:0:92396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf4a252c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd553d0d-03e2-4233-b06b-b55bbfa2b954+17:6510:x1870854458185728:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784189260.255867:0:92396:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784189260.255885:0:92396:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dbf4710e000/0xcc1762b626f8c1f3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xcc1762b626f8c1ec expref: -99 pid: 92396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189260.255916:0:92396:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dbf4710e000/0xcc1762b626f8c1f3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcc1762b626f8c1ec expref: 18 pid: 92396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189260.255928:0:92396:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dbf4710e000/0xcc1762b626f8c1f3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcc1762b626f8c1ec expref: 18 pid: 92396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189260.255953:0:92396:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dbf4710e000, rc 0) 00000100:00100000:1.0:1784189260.256025:0:92396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf4a252c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd553d0d-03e2-4233-b06b-b55bbfa2b954+18:6510:x1870854458185728:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 176us (889us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189260.256033:0:92396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1784189260.256148:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc080e7df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458185728:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784189260.256169:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: ffff9dc04a20ac00/0xcc1762b626f8c1ec lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc1762b626f8c1f3 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189260.256187:0:6510:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: ffff9dc04a20ac00/0xcc1762b626f8c1ec lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xcc1762b626f8c1f3 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784189260.256282:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc056ead500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458185856:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784189260.256315:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784189260.256360:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dc0713f2b40 going to sleep for 11 seconds 00000100:00100000:1.0:1784189260.256457:0:92397:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458185856 00000100:00100000:1.0:1784189260.256462:0:92397:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458185856 00000100:00100000:1.0:1784189260.256500:0:92397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1784189260.256507:0:92397:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf4a251050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd553d0d-03e2-4233-b06b-b55bbfa2b954+18:6510:x1870854458185856:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1784189260.256656:0:92397:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf4a251050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd553d0d-03e2-4233-b06b-b55bbfa2b954+18:6510:x1870854458185856:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 149us (340us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189260.256664:0:92397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1784189260.256779:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc056ead500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458185856:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784189260.256835:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc056ead500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458185984:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1784189260.256876:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784189260.256905:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dc0713f2b40 going to sleep for 11 seconds 00000100:00100000:3.0:1784189260.256917:0:92396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458185984 00000100:00100000:3.0:1784189260.256921:0:92396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458185984 00000100:00100000:3.0:1784189260.256949:0:92396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1784189260.256955:0:92396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf4a250850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd553d0d-03e2-4233-b06b-b55bbfa2b954+18:6510:x1870854458185984:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1784189260.257045:0:92396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf4a250850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd553d0d-03e2-4233-b06b-b55bbfa2b954+18:6510:x1870854458185984:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 90us (167us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189260.257051:0:92396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1784189260.257087:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc056ead500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458185984:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1784189260.257383:0:93026:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc056ead500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bd553d0d-03e2-4233-b06b-b55bbfa2b954:93026:1870854458186112:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1784189260.257419:0:93026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784189260.257445:0:93026:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dc0713f2780 going to sleep for 11 seconds 00000100:00100000:1.0:1784189260.257500:0:92396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458186112 00000100:00100000:1.0:1784189260.257505:0:92396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458186112 00000100:00100000:1.0:1784189260.257536:0:92396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1784189260.257543:0:92396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf4a253450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd553d0d-03e2-4233-b06b-b55bbfa2b954+18:93026:x1870854458186112:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1784189260.257655:0:92396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf4a253450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd553d0d-03e2-4233-b06b-b55bbfa2b954+18:93026:x1870854458186112:12345-0@lo:502:llog_process_th.0 Request processed in 112us (234us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189260.257662:0:92396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1784189260.258221:0:93026:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc056ead500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bd553d0d-03e2-4233-b06b-b55bbfa2b954:93026:1870854458186112:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1784189260.258282:0:93026:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc056ead500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bd553d0d-03e2-4233-b06b-b55bbfa2b954:93026:1870854458186240:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1784189260.258353:0:93026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784189260.258381:0:93026:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dc0713f2780 going to sleep for 11 seconds 00000100:00100000:1.0:1784189260.258435:0:92397:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458186240 00000100:00100000:1.0:1784189260.258441:0:92397:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458186240 00000100:00100000:1.0:1784189260.258468:0:92397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1784189260.258474:0:92397:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf4a251850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd553d0d-03e2-4233-b06b-b55bbfa2b954+18:93026:x1870854458186240:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1784189260.258641:0:92397:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf4a251850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd553d0d-03e2-4233-b06b-b55bbfa2b954+18:93026:x1870854458186240:12345-0@lo:502:llog_process_th.0 Request processed in 165us (287us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189260.258649:0:92397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1784189260.258848:0:93026:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc056ead500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bd553d0d-03e2-4233-b06b-b55bbfa2b954:93026:1870854458186240:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1784189260.258873:0:93026:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 55 count 54 00000020:01000000:0.0:1784189260.259089:0:6510:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 52-54 (rc=0) 10000000:01000000:0.0:1784189260.259189:0:6510:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1784189260.259201:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff9dc04a20ac00/0xcc1762b626f8c1ec lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc1762b626f8c1f3 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189260.259213:0:6510:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: ffff9dc04a20ac00/0xcc1762b626f8c1ec lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc1762b626f8c1f3 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784189260.259223:0:6510:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:0.0:1784189260.259226:0:6510:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 46 10000000:01000000:0.0:1784189260.259230:0:6510:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:0.0:1784189260.259264:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff9dc04152d600/0xcc1762b626f8c1fa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189260.259273:0:6510:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: ffff9dc04152d600/0xcc1762b626f8c1fa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189260.259283:0:6510:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: ffff9dc04152d600/0xcc1762b626f8c1fa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784189260.259301:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc050541c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458186368:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1784189260.259444:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784189260.259528:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dc0756ea240 going to sleep for 11 seconds 00000100:00100000:1.0:1784189260.263083:0:92396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458186368 00000100:00100000:1.0:1784189260.263104:0:92396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458186368 00000100:00100000:1.0:1784189260.263280:0:92396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1784189260.263294:0:92396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf4a253850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd553d0d-03e2-4233-b06b-b55bbfa2b954+18:6510:x1870854458186368:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784189260.263315:0:92396:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784189260.263400:0:92396:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dbf4710f600/0xcc1762b626f8c201 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xcc1762b626f8c1fa expref: -99 pid: 92396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189260.263437:0:92396:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dbf4710f600/0xcc1762b626f8c201 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcc1762b626f8c1fa expref: 19 pid: 92396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189260.263449:0:92396:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dbf4710f600/0xcc1762b626f8c201 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcc1762b626f8c1fa expref: 19 pid: 92396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189260.263460:0:92396:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dbf4710f600, rc 0) 00000100:00100000:1.0:1784189260.263563:0:92396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf4a253850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd553d0d-03e2-4233-b06b-b55bbfa2b954+19:6510:x1870854458186368:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 272us (4117us total) trans 0 rc 0/0 00000100:00100000:0.0:1784189260.263687:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc050541c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458186368:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784189260.263711:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: ffff9dc04152d600/0xcc1762b626f8c1fa lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc1762b626f8c201 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189260.263723:0:6510:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: ffff9dc04152d600/0xcc1762b626f8c1fa lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xcc1762b626f8c201 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784189260.263820:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc050541c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458186496:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1784189260.263880:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784189260.263903:0:92396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1784189260.265632:0:92396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458186496 00000100:00100000:0.0:1784189260.265636:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dc0756ea240 going to sleep for 11 seconds 00000100:00100000:1.0:1784189260.265648:0:92396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458186496 00000100:00100000:3.0:1784189260.266214:0:92397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1784189260.266231:0:92397:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf4a251450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd553d0d-03e2-4233-b06b-b55bbfa2b954+19:6510:x1870854458186496:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784189260.266924:0:92397:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf4a251450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd553d0d-03e2-4233-b06b-b55bbfa2b954+19:6510:x1870854458186496:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 696us (3041us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189260.266934:0:92397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1784189260.267553:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc050541c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458186496:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1784189260.267635:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc050541c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458186624:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1784189260.267715:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784189260.268509:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dc0756ea240 going to sleep for 11 seconds 00000100:00100000:2.0:1784189260.268563:0:92398:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458186624 00000100:00100000:2.0:1784189260.268579:0:92398:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458186624 00000100:00100000:2.0:1784189260.268630:0:92398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1784189260.268652:0:92398:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf4a250050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd553d0d-03e2-4233-b06b-b55bbfa2b954+19:6510:x1870854458186624:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1784189260.268805:0:92398:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf4a250050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd553d0d-03e2-4233-b06b-b55bbfa2b954+19:6510:x1870854458186624:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 166us (1089us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189260.268813:0:92398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1784189260.269011:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc050541c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458186624:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1784189260.270163:0:93027:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc050541c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bd553d0d-03e2-4233-b06b-b55bbfa2b954:93027:1870854458186752:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1784189260.272142:0:93027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784189260.272502:0:93027:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dc0756ea540 going to sleep for 11 seconds 00000100:00100000:1.0:1784189260.273217:0:92396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458186752 00000100:00100000:1.0:1784189260.273229:0:92396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458186752 00000100:00100000:1.0:1784189260.273308:0:92396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1784189260.284364:0:92396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf4a250450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd553d0d-03e2-4233-b06b-b55bbfa2b954+19:93027:x1870854458186752:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1784189260.285855:0:92396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf4a250450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd553d0d-03e2-4233-b06b-b55bbfa2b954+19:93027:x1870854458186752:12345-0@lo:502:llog_process_th.0 Request processed in 12530us (13713us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189260.285871:0:92396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1784189260.286145:0:93027:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc050541c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bd553d0d-03e2-4233-b06b-b55bbfa2b954:93027:1870854458186752:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1784189260.286204:0:93027:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1784189260.286217:0:93027:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784189260.286220:0:93027:0:(obd_config.c:1561:class_process_config()) marker 44 (0x1) lustre-MDT0001-m new lustre.pool_134 00000020:00000080:0.0:1784189260.286228:0:93027:0:(obd_config.c:1470:class_process_config()) processing cmd: ce020 00020000:01000000:0.0:1784189260.286312:0:93027:0:(lod_pool.c:475:lod_pool_new()) pool_134 is pool #1 00000100:00100000:0.0:1784189260.286389:0:93027:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc050541c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bd553d0d-03e2-4233-b06b-b55bbfa2b954:93027:1870854458186880:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1784189260.286446:0:93027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784189260.286497:0:93027:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dbf44443780 going to sleep for 11 seconds 00000100:00100000:2.0:1784189260.287376:0:92398:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458186880 00000100:00100000:2.0:1784189260.287389:0:92398:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458186880 00000100:00100000:2.0:1784189260.287455:0:92398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1784189260.287466:0:92398:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf4a252050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd553d0d-03e2-4233-b06b-b55bbfa2b954+19:93027:x1870854458186880:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1784189260.287791:0:92398:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf4a252050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd553d0d-03e2-4233-b06b-b55bbfa2b954+19:93027:x1870854458186880:12345-0@lo:502:llog_process_th.0 Request processed in 326us (1344us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189260.287800:0:92398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1784189260.288085:0:93027:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc050541c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bd553d0d-03e2-4233-b06b-b55bbfa2b954:93027:1870854458186880:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1784189260.288162:0:93027:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf470e3800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bd553d0d-03e2-4233-b06b-b55bbfa2b954:93027:1870854458187008:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1784189260.288271:0:93027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784189260.288310:0:93027:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dc047e1d300 going to sleep for 11 seconds 00000100:00100000:3.0:1784189260.288812:0:92396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458187008 00000100:00100000:3.0:1784189260.288819:0:92396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458187008 00000100:00100000:3.0:1784189260.288868:0:92396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1784189260.288877:0:92396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc056ab2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd553d0d-03e2-4233-b06b-b55bbfa2b954+19:93027:x1870854458187008:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1784189260.289075:0:92396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc056ab2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd553d0d-03e2-4233-b06b-b55bbfa2b954+19:93027:x1870854458187008:12345-0@lo:502:llog_process_th.0 Request processed in 199us (804us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189260.289083:0:92396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1784189260.289640:0:93027:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf470e3800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bd553d0d-03e2-4233-b06b-b55bbfa2b954:93027:1870854458187008:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1784189260.289676:0:93027:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1784189260.289685:0:93027:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784189260.289688:0:93027:0:(obd_config.c:1561:class_process_config()) marker 44 (0x2) lustre-MDT0001-m new lustre.pool_134 00000040:00080000:1.0:1784189260.289692:0:93027:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 50 count 49 00000020:01000000:2.0:1784189260.290145:0:6510:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 46-49 (rc=0) 10000000:01000000:2.0:1784189260.290171:0:6510:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:2.0:1784189260.290185:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff9dc04152d600/0xcc1762b626f8c1fa lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc1762b626f8c201 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189260.290209:0:6510:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: ffff9dc04152d600/0xcc1762b626f8c1fa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc1762b626f8c201 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784189260.290221:0:6510:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1784189260.290224:0:6510:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9dbf425f7000 from 52 10000000:01000000:2.0:1784189260.290228:0:6510:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1784189260.293547:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff9dc04152c400/0xcc1762b626f8c208 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189260.293695:0:6510:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: ffff9dc04152c400/0xcc1762b626f8c208 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189260.293713:0:6510:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: ffff9dc04152c400/0xcc1762b626f8c208 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784189260.293771:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc080e7df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458187136:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1784189260.293869:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784189260.293919:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dc0756ea540 going to sleep for 11 seconds 00000100:00100000:1.0:1784189260.294780:0:92397:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458187136 00000100:00100000:1.0:1784189260.294792:0:92397:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458187136 00000100:00100000:1.0:1784189260.294860:0:92397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1784189260.294870:0:92397:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc056ab3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd553d0d-03e2-4233-b06b-b55bbfa2b954+19:6510:x1870854458187136:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784189260.294889:0:92397:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784189260.294910:0:92397:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dbf4710ec00/0xcc1762b626f8c20f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xcc1762b626f8c208 expref: -99 pid: 92397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189260.294944:0:92397:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dbf4710ec00/0xcc1762b626f8c20f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcc1762b626f8c208 expref: 20 pid: 92397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189260.294956:0:92397:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dbf4710ec00/0xcc1762b626f8c20f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcc1762b626f8c208 expref: 20 pid: 92397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189260.294966:0:92397:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dbf4710ec00, rc 0) 00000100:00100000:1.0:1784189260.295042:0:92397:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc056ab3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd553d0d-03e2-4233-b06b-b55bbfa2b954+20:6510:x1870854458187136:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 173us (1173us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189260.295050:0:92397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1784189260.295377:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc080e7df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458187136:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784189260.295399:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: ffff9dc04152c400/0xcc1762b626f8c208 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc1762b626f8c20f expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189260.295411:0:6510:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: ffff9dc04152c400/0xcc1762b626f8c208 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xcc1762b626f8c20f expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784189260.295516:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc050540000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458187264:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1784189260.295554:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784189260.295696:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dc0756ea540 going to sleep for 11 seconds 00000100:00100000:3.0:1784189260.302385:0:92396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458187264 00000100:00100000:3.0:1784189260.302405:0:92396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458187264 00000100:00100000:3.0:1784189260.302517:0:92396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1784189260.302530:0:92396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc056ab3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd553d0d-03e2-4233-b06b-b55bbfa2b954+20:6510:x1870854458187264:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784189260.303514:0:92396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc056ab3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd553d0d-03e2-4233-b06b-b55bbfa2b954+20:6510:x1870854458187264:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 981us (7953us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189260.303527:0:92396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1784189260.303708:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc050540000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458187264:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1784189260.303775:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc050540000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458187392:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1784189260.303861:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784189260.303908:0:92397:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458187392 00000100:00100000:0.0:1784189260.303909:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dc0756ea540 going to sleep for 11 seconds 00000100:00100000:1.0:1784189260.303924:0:92397:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458187392 00000100:00100000:1.0:1784189260.303982:0:92397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1784189260.303991:0:92397:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc056ab1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd553d0d-03e2-4233-b06b-b55bbfa2b954+20:6510:x1870854458187392:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1784189260.304102:0:92397:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc056ab1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd553d0d-03e2-4233-b06b-b55bbfa2b954+20:6510:x1870854458187392:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 111us (240us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189260.304115:0:92397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1784189260.304357:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc050540000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458187392:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1784189260.308179:0:93028:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc050540000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bd553d0d-03e2-4233-b06b-b55bbfa2b954:93028:1870854458187520:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1784189260.308517:0:93028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784189260.308621:0:93028:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dc0756ea240 going to sleep for 11 seconds 00000100:00100000:3.0:1784189260.308918:0:92396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458187520 00000100:00100000:3.0:1784189260.308928:0:92396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458187520 00000100:00100000:3.0:1784189260.309048:0:92396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1784189260.309060:0:92396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc056ab0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd553d0d-03e2-4233-b06b-b55bbfa2b954+20:93028:x1870854458187520:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1784189260.309263:0:92396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc056ab0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd553d0d-03e2-4233-b06b-b55bbfa2b954+20:93028:x1870854458187520:12345-0@lo:502:llog_process_th.0 Request processed in 204us (746us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189260.309272:0:92396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1784189260.309392:0:93028:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc050540000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bd553d0d-03e2-4233-b06b-b55bbfa2b954:93028:1870854458187520:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1784189260.309456:0:93028:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf470e3800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bd553d0d-03e2-4233-b06b-b55bbfa2b954:93028:1870854458187648:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1784189260.309609:0:93028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784189260.309988:0:93028:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dc047e1da80 going to sleep for 11 seconds 00000100:00100000:0.0:1784189260.310072:0:92398:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458187648 00000100:00100000:0.0:1784189260.310079:0:92398:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458187648 00000100:00100000:0.0:1784189260.310112:0:92398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1784189260.310127:0:92398:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc056ab0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd553d0d-03e2-4233-b06b-b55bbfa2b954+20:93028:x1870854458187648:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1784189260.310238:0:92398:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc056ab0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd553d0d-03e2-4233-b06b-b55bbfa2b954+20:93028:x1870854458187648:12345-0@lo:502:llog_process_th.0 Request processed in 110us (628us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189260.310365:0:93028:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf470e3800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bd553d0d-03e2-4233-b06b-b55bbfa2b954:93028:1870854458187648:0@lo:502:llog_process_th.0 00000040:00080000:1.0:1784189260.310418:0:93028:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 55 count 54 00000100:00100000:0.0:1784189260.312495:0:92398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000020:01000000:3.0:1784189260.312818:0:6510:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 52-54 (rc=0) 10000000:01000000:3.0:1784189260.312878:0:6510:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1784189260.312893:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff9dc04152c400/0xcc1762b626f8c208 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc1762b626f8c20f expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189260.312907:0:6510:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: ffff9dc04152c400/0xcc1762b626f8c208 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc1762b626f8c20f expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784189260.312919:0:6510:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:3.0:1784189260.312922:0:6510:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 11 10000000:01000000:3.0:1784189260.312926:0:6510:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:3.0:1784189260.312971:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff9dbf4369d000/0xcc1762b626f8c216 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189260.312980:0:6510:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: ffff9dbf4369d000/0xcc1762b626f8c216 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189260.312991:0:6510:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: ffff9dbf4369d000/0xcc1762b626f8c216 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784189260.313018:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc056ead500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458187776:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1784189260.313086:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784189260.313165:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dc0713f2480 going to sleep for 11 seconds 00000100:00100000:2.0:1784189260.313763:0:92397:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458187776 00000100:00100000:2.0:1784189260.313774:0:92397:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458187776 00000100:00100000:1.0:1784189260.313873:0:92396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1784189260.313887:0:92396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc056ab3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd553d0d-03e2-4233-b06b-b55bbfa2b954+20:6510:x1870854458187776:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784189260.313905:0:92396:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784189260.313925:0:92396:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dbf4710f800/0xcc1762b626f8c21d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xcc1762b626f8c216 expref: -99 pid: 92396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189260.313956:0:92396:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dbf4710f800/0xcc1762b626f8c21d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcc1762b626f8c216 expref: 21 pid: 92396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189260.313969:0:92396:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dbf4710f800/0xcc1762b626f8c21d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcc1762b626f8c216 expref: 21 pid: 92396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189260.313978:0:92396:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dbf4710f800, rc 0) 00000100:00100000:1.0:1784189260.314046:0:92396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc056ab3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd553d0d-03e2-4233-b06b-b55bbfa2b954+21:6510:x1870854458187776:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 162us (960us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189260.314069:0:92396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1784189260.314177:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc056ead500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458187776:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784189260.314203:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: ffff9dbf4369d000/0xcc1762b626f8c216 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc1762b626f8c21d expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189260.314213:0:6510:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: ffff9dbf4369d000/0xcc1762b626f8c216 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xcc1762b626f8c21d expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784189260.314355:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc056ead500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458187904:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784189260.314390:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784189260.314476:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dc0713f2480 going to sleep for 11 seconds 00000100:00100000:2.0:1784189260.314795:0:92397:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458187904 00000100:00100000:2.0:1784189260.314802:0:92397:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458187904 00000100:00100000:1.0:1784189260.314853:0:92396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1784189260.314862:0:92396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc056ab2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd553d0d-03e2-4233-b06b-b55bbfa2b954+21:6510:x1870854458187904:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1784189260.315009:0:92396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc056ab2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd553d0d-03e2-4233-b06b-b55bbfa2b954+21:6510:x1870854458187904:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 148us (618us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189260.315016:0:92396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1784189260.315090:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc056ead500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458187904:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784189260.315137:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc056ead500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458188032:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1784189260.315183:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784189260.315236:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dc0713f2480 going to sleep for 11 seconds 00000100:00100000:2.0:1784189260.315344:0:92397:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458188032 00000100:00100000:2.0:1784189260.315349:0:92397:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458188032 00000100:00100000:2.0:1784189260.315368:0:92397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1784189260.315374:0:92397:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc056ab3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd553d0d-03e2-4233-b06b-b55bbfa2b954+21:6510:x1870854458188032:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1784189260.315473:0:92397:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc056ab3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd553d0d-03e2-4233-b06b-b55bbfa2b954+21:6510:x1870854458188032:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 98us (289us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189260.315489:0:92397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1784189260.315885:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc056ead500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458188032:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1784189260.317025:0:93029:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 64768 count 11 00000020:01000000:2.0:1784189260.317380:0:6510:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 11-10 (rc=0) 10000000:01000000:2.0:1784189260.317408:0:6510:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:2.0:1784189260.317421:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff9dbf4369d000/0xcc1762b626f8c216 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc1762b626f8c21d expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189260.317435:0:6510:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: ffff9dbf4369d000/0xcc1762b626f8c216 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc1762b626f8c21d expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784189260.317447:0:6510:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1784189260.317450:0:6510:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9dc07b5d6800 from 52 10000000:01000000:2.0:1784189260.317454:0:6510:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1784189260.317577:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff9dc04a20a600/0xcc1762b626f8c224 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189260.317588:0:6510:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: ffff9dc04a20a600/0xcc1762b626f8c224 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189260.317600:0:6510:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: ffff9dc04a20a600/0xcc1762b626f8c224 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784189260.317627:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc080e7ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458188160:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1784189260.317884:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784189260.317935:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dc041254600 going to sleep for 11 seconds 00000100:00100000:3.0:1784189260.317999:0:92397:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458188160 00000100:00100000:3.0:1784189260.318008:0:92397:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458188160 00000100:00100000:3.0:1784189260.318104:0:92397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1784189260.318115:0:92397:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc056ab0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd553d0d-03e2-4233-b06b-b55bbfa2b954+21:6510:x1870854458188160:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784189260.318132:0:92397:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784189260.318161:0:92397:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dbf4369d400/0xcc1762b626f8c22b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xcc1762b626f8c224 expref: -99 pid: 92397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189260.318192:0:92397:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dbf4369d400/0xcc1762b626f8c22b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcc1762b626f8c224 expref: 22 pid: 92397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189260.318204:0:92397:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dbf4369d400/0xcc1762b626f8c22b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcc1762b626f8c224 expref: 22 pid: 92397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189260.318222:0:92397:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dbf4369d400, rc 0) 00000100:00100000:3.0:1784189260.318280:0:92397:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc056ab0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd553d0d-03e2-4233-b06b-b55bbfa2b954+22:6510:x1870854458188160:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 167us (396us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189260.318288:0:92397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1784189260.318380:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc080e7ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458188160:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1784189260.318397:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: ffff9dc04a20a600/0xcc1762b626f8c224 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc1762b626f8c22b expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189260.318408:0:6510:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: ffff9dc04a20a600/0xcc1762b626f8c224 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xcc1762b626f8c22b expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784189260.318477:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc080e7ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458188288:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1784189260.318527:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784189260.319096:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dc041254600 going to sleep for 11 seconds 00000100:00100000:0.0:1784189260.319141:0:92398:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458188288 00000100:00100000:0.0:1784189260.319147:0:92398:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458188288 00000100:00100000:0.0:1784189260.319180:0:92398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1784189260.319189:0:92398:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc056ab1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd553d0d-03e2-4233-b06b-b55bbfa2b954+22:6510:x1870854458188288:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1784189260.319399:0:92398:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc056ab1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd553d0d-03e2-4233-b06b-b55bbfa2b954+22:6510:x1870854458188288:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 210us (870us total) trans 0 rc 0/0 00000100:00100000:0.0:1784189260.319407:0:92398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1784189260.319780:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc080e7ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458188288:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1784189260.319830:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc080e7ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458188416:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1784189260.319887:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784189260.319918:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dc041254600 going to sleep for 11 seconds 00000100:00100000:1.0:1784189260.320024:0:92398:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458188416 00000100:00100000:1.0:1784189260.320030:0:92398:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458188416 00000100:00100000:1.0:1784189260.320069:0:92398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:1.0:1784189260.320077:0:92398:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc056ab2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd553d0d-03e2-4233-b06b-b55bbfa2b954+22:6510:x1870854458188416:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1784189260.320175:0:92398:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc056ab2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd553d0d-03e2-4233-b06b-b55bbfa2b954+22:6510:x1870854458188416:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 99us (287us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189260.320182:0:92398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:2.0:1784189260.320366:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc080e7ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458188416:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1784189260.321042:0:93030:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf470e3800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bd553d0d-03e2-4233-b06b-b55bbfa2b954:93030:1870854458188544:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1784189260.321094:0:93030:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784189260.321278:0:93030:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dc0760d8180 going to sleep for 11 seconds 00000100:00100000:3.0:1784189260.321781:0:92397:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458188544 00000100:00100000:3.0:1784189260.321790:0:92397:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458188544 00000100:00100000:0.0:1784189260.321906:0:92398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:0.0:1784189260.321918:0:92398:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc056ab1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd553d0d-03e2-4233-b06b-b55bbfa2b954+22:93030:x1870854458188544:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1784189260.322072:0:92398:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc056ab1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd553d0d-03e2-4233-b06b-b55bbfa2b954+22:93030:x1870854458188544:12345-0@lo:502:llog_process_th.0 Request processed in 157us (977us total) trans 0 rc 0/0 00000100:00100000:0.0:1784189260.322080:0:92398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:1.0:1784189260.322300:0:93030:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf470e3800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bd553d0d-03e2-4233-b06b-b55bbfa2b954:93030:1870854458188544:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1784189260.322920:0:93030:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf470e3800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bd553d0d-03e2-4233-b06b-b55bbfa2b954:93030:1870854458188672:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1784189260.322975:0:93030:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784189260.323013:0:93030:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dc0760d8180 going to sleep for 11 seconds 00000100:00100000:0.0:1784189260.323452:0:92398:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458188672 00000100:00100000:0.0:1784189260.323461:0:92398:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458188672 00000100:00100000:0.0:1784189260.323738:0:92398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:0.0:1784189260.323749:0:92398:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc056ab1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd553d0d-03e2-4233-b06b-b55bbfa2b954+22:93030:x1870854458188672:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1784189260.323900:0:92398:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc056ab1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd553d0d-03e2-4233-b06b-b55bbfa2b954+22:93030:x1870854458188672:12345-0@lo:502:llog_process_th.0 Request processed in 152us (923us total) trans 0 rc 0/0 00000100:00100000:0.0:1784189260.323908:0:92398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:2.0:1784189260.324872:0:93030:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf470e3800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bd553d0d-03e2-4233-b06b-b55bbfa2b954:93030:1870854458188672:0@lo:502:llog_process_th.0 00000040:00080000:2.0:1784189260.324925:0:93030:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 55 count 54 00000020:01000000:3.0:1784189260.325055:0:6510:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 52-54 (rc=0) 10000000:01000000:3.0:1784189260.325092:0:6510:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1784189260.325106:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff9dc04a20a600/0xcc1762b626f8c224 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc1762b626f8c22b expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189260.325132:0:6510:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: ffff9dc04a20a600/0xcc1762b626f8c224 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc1762b626f8c22b expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784189260.325143:0:6510:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:3.0:1784189260.325146:0:6510:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 14 10000000:01000000:3.0:1784189260.325149:0:6510:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:3.0:1784189260.325201:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff9dbf4369de00/0xcc1762b626f8c232 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189260.325210:0:6510:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: ffff9dbf4369de00/0xcc1762b626f8c232 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189260.325221:0:6510:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: ffff9dbf4369de00/0xcc1762b626f8c232 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784189260.325246:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc056ead500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458188800:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1784189260.325309:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784189260.325382:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dc0713f2a80 going to sleep for 11 seconds 00000100:00100000:0.0:1784189260.325937:0:92396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458188800 00000100:00100000:0.0:1784189260.325946:0:92396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458188800 00000100:00100000:0.0:1784189260.326010:0:92396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:0.0:1784189260.326028:0:92396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc07cb56450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd553d0d-03e2-4233-b06b-b55bbfa2b954+22:6510:x1870854458188800:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784189260.326045:0:92396:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784189260.326063:0:92396:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dc04152ce00/0xcc1762b626f8c239 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xcc1762b626f8c232 expref: -99 pid: 92396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189260.326093:0:92396:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dc04152ce00/0xcc1762b626f8c239 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcc1762b626f8c232 expref: 23 pid: 92396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189260.326104:0:92396:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dc04152ce00/0xcc1762b626f8c239 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcc1762b626f8c232 expref: 23 pid: 92396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189260.326114:0:92396:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc04152ce00, rc 0) 00000100:00100000:0.0:1784189260.326173:0:92396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc07cb56450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd553d0d-03e2-4233-b06b-b55bbfa2b954+23:6510:x1870854458188800:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 147us (864us total) trans 0 rc 0/0 00000100:00100000:0.0:1784189260.326180:0:92396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:2.0:1784189260.326215:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc056ead500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458188800:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1784189260.326236:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: ffff9dbf4369de00/0xcc1762b626f8c232 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc1762b626f8c239 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189260.326258:0:6510:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: ffff9dbf4369de00/0xcc1762b626f8c232 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0xcc1762b626f8c239 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784189260.326394:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc080e7ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458188928:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1784189260.326428:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784189260.326451:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dc041254600 going to sleep for 11 seconds 00000100:00100000:3.0:1784189260.328793:0:92397:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458188928 00000100:00100000:3.0:1784189260.328810:0:92397:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458188928 00000100:00100000:3.0:1784189260.328890:0:92397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:3.0:1784189260.328901:0:92397:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc07cb55450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd553d0d-03e2-4233-b06b-b55bbfa2b954+23:6510:x1870854458188928:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784189260.329136:0:92397:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc07cb55450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd553d0d-03e2-4233-b06b-b55bbfa2b954+23:6510:x1870854458188928:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 236us (2706us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189260.329145:0:92397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:2.0:1784189260.329266:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc080e7ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458188928:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1784189260.329356:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc080e7ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458189056:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1784189260.329426:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784189260.329460:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dc041254600 going to sleep for 11 seconds 00000100:00100000:1.0:1784189260.329539:0:92396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458189056 00000100:00100000:1.0:1784189260.329545:0:92396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458189056 00000100:00100000:0.0:1784189260.329658:0:92396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:0.0:1784189260.329670:0:92396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc071342050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd553d0d-03e2-4233-b06b-b55bbfa2b954+23:6510:x1870854458189056:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1784189260.329776:0:92396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc071342050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd553d0d-03e2-4233-b06b-b55bbfa2b954+23:6510:x1870854458189056:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 110us (351us total) trans 0 rc 0/0 00000100:00100000:0.0:1784189260.329785:0:92396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:2.0:1784189260.329807:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc080e7ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458189056:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1784189260.331005:0:93031:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 64768 count 14 00000020:01000000:2.0:1784189260.331682:0:6510:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 14-13 (rc=0) 10000000:01000000:2.0:1784189260.331716:0:6510:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:2.0:1784189260.331729:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff9dbf4369de00/0xcc1762b626f8c232 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc1762b626f8c239 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189260.331743:0:6510:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: ffff9dbf4369de00/0xcc1762b626f8c232 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc1762b626f8c239 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784189260.331790:0:6510:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:2.0:1784189260.331793:0:6510:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-sptlrpc-ffff9dc06bb30000 from 1 10000000:01000000:2.0:1784189260.331797:0:6510:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1784189260.331842:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff9dc04a20b400/0xcc1762b626f8c240 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189260.331851:0:6510:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: ffff9dc04a20b400/0xcc1762b626f8c240 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189260.331864:0:6510:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: ffff9dc04a20b400/0xcc1762b626f8c240 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784189260.331892:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc080e7ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458189184:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1784189260.331969:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784189260.332023:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dc041254600 going to sleep for 11 seconds 00000100:00100000:0.0:1784189260.332080:0:92398:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458189184 00000100:00100000:0.0:1784189260.332089:0:92398:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458189184 00000100:00100000:0.0:1784189260.332153:0:92398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:0.0:1784189260.332163:0:92398:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc07a90e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd553d0d-03e2-4233-b06b-b55bbfa2b954+23:6510:x1870854458189184:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784189260.332178:0:92398:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784189260.332194:0:92398:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dc04152da00/0xcc1762b626f8c247 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0xcc1762b626f8c240 expref: -99 pid: 92398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189260.332236:0:92398:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dc04152da00/0xcc1762b626f8c247 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcc1762b626f8c240 expref: 24 pid: 92398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189260.332249:0:92398:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dc04152da00/0xcc1762b626f8c247 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcc1762b626f8c240 expref: 24 pid: 92398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189260.332259:0:92398:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc04152da00, rc 0) 00000100:00100000:0.0:1784189260.332306:0:92398:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc07a90e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd553d0d-03e2-4233-b06b-b55bbfa2b954+24:6510:x1870854458189184:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 145us (337us total) trans 0 rc 0/0 00000100:00100000:0.0:1784189260.332313:0:92398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:3.0:1784189260.332402:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc080e7ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458189184:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784189260.332420:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: ffff9dc04a20b400/0xcc1762b626f8c240 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc1762b626f8c247 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189260.332430:0:6510:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: ffff9dc04a20b400/0xcc1762b626f8c240 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0xcc1762b626f8c247 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784189260.332508:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc056eadf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458189312:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784189260.332538:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784189260.332576:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dc0713f2540 going to sleep for 11 seconds 00000100:00100000:0.0:1784189260.332631:0:92397:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458189312 00000100:00100000:0.0:1784189260.332636:0:92397:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458189312 00000100:00100000:0.0:1784189260.332662:0:92397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:0.0:1784189260.332668:0:92397:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc07a90cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd553d0d-03e2-4233-b06b-b55bbfa2b954+24:6510:x1870854458189312:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1784189260.332757:0:92397:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc07a90cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd553d0d-03e2-4233-b06b-b55bbfa2b954+24:6510:x1870854458189312:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 89us (219us total) trans 0 rc -2/-2 00000100:00100000:0.0:1784189260.332765:0:92397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:2.0:1784189260.332834:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc056eadf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458189312:0@lo:501:ll_cfg_requeue.0 10000000:01000000:2.0:1784189260.332897:0:6510:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1784189260.332903:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff9dc04a20b400/0xcc1762b626f8c240 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc1762b626f8c247 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189260.332912:0:6510:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: ffff9dc04a20b400/0xcc1762b626f8c240 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc1762b626f8c247 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784189260.335576:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1784189260.335604:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc050543480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1870854458189440:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1784189260.335689:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784189260.335737:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458189440 00000100:00100000:0.0:1784189260.335740:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf470e3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1870854458189568:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1784189260.335748:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458189440 00000100:00100000:0.0:1784189260.335774:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784189260.335815:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458189568 00000100:00100000:3.0:1784189260.335819:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458189568 00000100:00100000:3.0:1784189260.335839:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2020 00000100:00100000:3.0:1784189260.335848:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc050543100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1870854458189440:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1784189260.335875:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8647872 pending 0 free 3922481152 avail 3690958848 00000100:00100000:3.0:1784189260.335935:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc050543100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1870854458189440:12345-0@lo:13:osp-pre-0-0.0 Request processed in 87us (245us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189260.335961:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2020 00000100:00100000:3.0:1784189260.335979:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2021 00000100:00100000:3.0:1784189260.335985:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc050540000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1870854458189568:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1784189260.335996:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 210112 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1784189260.336026:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc050540000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1870854458189568:12345-0@lo:13:osp-pre-1-0.0 Request processed in 41us (252us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189260.336033:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2021 00000100:00100000:0.0:1784189260.336055:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc050543480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1870854458189440:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1784189260.336087:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf470e3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1870854458189568:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1784189260.528967:0:26173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784189261.555449:0:7454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1784189261.872920:0:8423:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294968955 is committed 00000100:00100000:3.0:1784189262.119840:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1784189262.119880:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1784189262.119909:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1784189262.119929:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1784189262.119972:0:26167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436308992 00000100:00100000:3.0:1784189262.119980:0:26167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436308992 00000100:00100000:3.0:1784189262.120037:0:26167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 2526 00000100:00100000:3.0:1784189262.120046:0:26167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc056eae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:debedd94-805c-42a0-a5e5-41758b2012e9+5:2398:x1870854436308992:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:3.0:1784189262.120105:0:26167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc056eae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:debedd94-805c-42a0-a5e5-41758b2012e9+5:2398:x1870854436308992:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 61us (224us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189262.120122:0:26167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 2526 00000100:00080000:3.0:1784189262.120140:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1784189262.120439:0:66169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436308736 00000100:00100000:2.0:1784189262.120445:0:66169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436308736 00000100:00100000:2.0:1784189262.120489:0:66169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436308864 00000100:00100000:2.0:1784189262.120505:0:66169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436308864 00000100:00100000:2.0:1784189262.120530:0:66169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1266 00000100:00100000:2.0:1784189262.120537:0:66169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc056eae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:debedd94-805c-42a0-a5e5-41758b2012e9+6:2398:x1870854436308736:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:2.0:1784189262.120585:0:66169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc056eae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:debedd94-805c-42a0-a5e5-41758b2012e9+6:2398:x1870854436308736:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 49us (754us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189262.120592:0:66169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1266 00000100:00100000:2.0:1784189262.120605:0:66169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1267 00000100:00100000:2.0:1784189262.120611:0:66169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc056eaf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:debedd94-805c-42a0-a5e5-41758b2012e9+5:2398:x1870854436308864:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:2.0:1784189262.120637:0:66169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc056eaf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:debedd94-805c-42a0-a5e5-41758b2012e9+5:2398:x1870854436308864:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 26us (707us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189262.120642:0:66169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1267 00000100:00100000:2.0:1784189262.120661:0:92396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436308608 00000100:00100000:2.0:1784189262.120664:0:92396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436308608 00000100:00100000:2.0:1784189262.120688:0:92396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 122 00000100:00100000:2.0:1784189262.120693:0:92396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc07a90d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:60f345e3-c70e-4f53-b5e7-c9671463c9a5+10:2398:x1870854436308608:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:2.0:1784189262.120716:0:92396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc07a90d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:60f345e3-c70e-4f53-b5e7-c9671463c9a5+10:2398:x1870854436308608:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 23us (806us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189262.120722:0:92396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 122 00000100:00080000:3.0:1784189262.121089:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1784189262.121093:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000020:00000080:3.0:1784189262.423221:0:93129:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866bc len=0 uarg=00007ffcacd2cce0 20000000:00000080:3.0:1784189262.423238:0:93129:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866bc len=576 karg=ffff9dc0755a8400 uarg=0000000000000000 00000040:00100000:3.0:1784189262.423948:0:93129:0:(llog.c:1072:llog_reverse_process()) index 54 : idx 49 20000000:01000000:3.0:1784189262.423953:0:93129:0:(mgs_llog.c:963:mgs_search_pool_cb()) Matched pool rec 53 cmd:0xce020 lustre.pool_134 00000040:00080000:3.0:1784189262.424042:0:93129:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].55, 224 off17736 20000000:01000000:3.0:1784189262.424074:0:93129:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xce021 lustre pool_134 lustre-OST0001_UUID (null) 00000040:00080000:3.0:1784189262.424093:0:93129:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].56, 136 off17872 00000040:00080000:3.0:1784189262.424108:0:93129:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].57, 224 off18096 00000040:00080000:3.0:1784189262.424168:0:93129:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].50, 224 off16832 20000000:01000000:3.0:1784189262.424177:0:93129:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xce021 lustre pool_134 lustre-OST0001_UUID (null) 00000040:00080000:3.0:1784189262.424190:0:93129:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].51, 144 off16976 00000040:00080000:3.0:1784189262.424203:0:93129:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].52, 224 off17200 00000040:00080000:3.0:1784189262.424252:0:93129:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].50, 224 off16832 20000000:01000000:3.0:1784189262.424261:0:93129:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xce021 lustre pool_134 lustre-OST0001_UUID (null) 00000040:00080000:3.0:1784189262.424272:0:93129:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].51, 144 off16976 00000040:00080000:3.0:1784189262.424286:0:93129:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].52, 224 off17200 10000000:01000000:3.0:1784189262.424296:0:93129:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:3.0:1784189262.424314:0:93129:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9dbf4369d200/0xcc1762b626f8c24e lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 93129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189262.424379:0:93129:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9dbf4369ce00/0xcc1762b626f8c1c2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c3fde expref: 9 pid: 92397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189262.424388:0:93129:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9dbf4710f000/0xcc1762b626f8c1c9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c3fe5 expref: 9 pid: 92398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189262.424397:0:93129:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9dbf4369c600/0xcc1762b626f8c1d7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcc1762b626f8c1d0 expref: 23 pid: 92397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189262.424403:0:93129:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9dbf4369c400/0xcc1762b626f8c1e5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcc1762b626f8c1de expref: 23 pid: 92396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189262.424410:0:93129:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9dbf4710e000/0xcc1762b626f8c1f3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcc1762b626f8c1ec expref: 23 pid: 92396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189262.424416:0:93129:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9dbf4710f600/0xcc1762b626f8c201 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcc1762b626f8c1fa expref: 23 pid: 92396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189262.424430:0:93129:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9dbf4710ec00/0xcc1762b626f8c20f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcc1762b626f8c208 expref: 23 pid: 92397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189262.424437:0:93129:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9dbf4710f800/0xcc1762b626f8c21d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcc1762b626f8c216 expref: 23 pid: 92396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189262.425030:0:93129:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9dbf4369d400/0xcc1762b626f8c22b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcc1762b626f8c224 expref: 23 pid: 92397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189262.425035:0:93129:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9dc04152ce00/0xcc1762b626f8c239 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcc1762b626f8c232 expref: 23 pid: 92396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189262.425039:0:93129:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9dc04152da00/0xcc1762b626f8c247 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcc1762b626f8c240 expref: 23 pid: 92398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189262.425044:0:93129:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9dbf4369d200/0xcc1762b626f8c24e lrc: 14/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 93129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189262.425077:0:93129:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9dc04152da00/0xcc1762b626f8c247 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcc1762b626f8c240 expref: 23 pid: 92398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189262.425086:0:93129:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9dc04152da00/0xcc1762b626f8c247 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcc1762b626f8c240 expref: 23 pid: 92398 timeout: 3604 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784189262.425096:0:93129:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc056eaf800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:93129:1870854458189696:0@lo:104: 00000100:00100000:3.0:1784189262.425242:0:93129:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1784189262.425388:0:93129:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9dc04152ce00/0xcc1762b626f8c239 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcc1762b626f8c232 expref: 23 pid: 92396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189262.425406:0:93129:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9dc04152ce00/0xcc1762b626f8c239 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcc1762b626f8c232 expref: 23 pid: 92396 timeout: 3604 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784189262.425413:0:93129:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc056eaed80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:93129:1870854458189824:0@lo:104: 00000100:00100000:3.0:1784189262.425431:0:93129:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784189262.426293:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458189696 00000100:00100000:2.0:1784189262.426302:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458189696 00010000:00010000:3.0:1784189262.426348:0:93129:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9dbf4369d400/0xcc1762b626f8c22b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcc1762b626f8c224 expref: 23 pid: 92397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189262.426357:0:93129:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9dbf4369d400/0xcc1762b626f8c22b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcc1762b626f8c224 expref: 23 pid: 92397 timeout: 3604 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784189262.426367:0:93129:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc056ead880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:93129:1870854458189952:0@lo:104: 00000100:00100000:3.0:1784189262.426395:0:93129:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784189262.430099:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458189824 00000100:00100000:2.0:1784189262.430112:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458189824 00000100:00100000:2.0:1784189262.430158:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458189952 00010000:00010000:3.0:1784189262.430161:0:93129:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9dbf4710f800/0xcc1762b626f8c21d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcc1762b626f8c216 expref: 23 pid: 92396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784189262.430161:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458189952 00000100:00100000:2.0:1784189262.430174:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 324 00010000:00010000:3.0:1784189262.430176:0:93129:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9dbf4710f800/0xcc1762b626f8c21d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcc1762b626f8c216 expref: 23 pid: 92396 timeout: 3604 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784189262.430181:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc056eadc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:bd553d0d-03e2-4233-b06b-b55bbfa2b954+5:93129:x1870854458189696:12345-0@lo:104: 00000100:00100000:3.0:1784189262.430189:0:93129:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc056eac380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:93129:1870854458190080:0@lo:104: 00010000:00010000:2.0:1784189262.430209:0:6496:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.112@tcp lock: ffff9dc04a20b400/0xcc1762b626f8c240 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xcc1762b626f8c247 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784189262.430239:0:93129:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1784189262.430255:0:93129:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9dbf4710ec00/0xcc1762b626f8c20f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcc1762b626f8c208 expref: 23 pid: 92397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189262.430257:0:6496:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1784189262.430262:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc056eadc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:bd553d0d-03e2-4233-b06b-b55bbfa2b954+5:93129:x1870854458189696:12345-0@lo:104: Request processed in 82us (5114us total) trans 0 rc 0/0 00010000:00010000:3.0:1784189262.430263:0:93129:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9dbf4710ec00/0xcc1762b626f8c20f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcc1762b626f8c208 expref: 23 pid: 92397 timeout: 3604 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784189262.430269:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 324 00000100:00100000:3.0:1784189262.430271:0:93129:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc056eac700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:93129:1870854458190208:0@lo:104: 00000100:00100000:2.0:1784189262.430284:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458190080 00000100:00100000:2.0:1784189262.430286:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458190080 00000100:00100000:2.0:1784189262.430298:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 325 00000100:00100000:3.0:1784189262.430300:0:93129:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784189262.430303:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc056eace00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:bd553d0d-03e2-4233-b06b-b55bbfa2b954+5:93129:x1870854458189824:12345-0@lo:104: 00010000:00010000:2.0:1784189262.430311:0:6496:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.112@tcp lock: ffff9dbf4369de00/0xcc1762b626f8c232 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xcc1762b626f8c239 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189262.430330:0:93129:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9dbf4710f600/0xcc1762b626f8c201 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcc1762b626f8c1fa expref: 23 pid: 92396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189262.430339:0:93129:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9dbf4710f600/0xcc1762b626f8c201 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcc1762b626f8c1fa expref: 23 pid: 92396 timeout: 3604 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784189262.430347:0:93129:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc056eaea00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:93129:1870854458190336:0@lo:104: 00010000:00010000:2.0:1784189262.430357:0:6496:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1784189262.430361:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc056eace00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:bd553d0d-03e2-4233-b06b-b55bbfa2b954+5:93129:x1870854458189824:12345-0@lo:104: Request processed in 58us (4929us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189262.430367:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 325 00010000:00010000:3.0:1784189262.430375:0:93129:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9dbf4710e000/0xcc1762b626f8c1f3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcc1762b626f8c1ec expref: 23 pid: 92396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189262.430383:0:93129:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9dbf4710e000/0xcc1762b626f8c1f3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcc1762b626f8c1ec expref: 23 pid: 92396 timeout: 3604 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784189262.430385:0:6496:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1784189262.430391:0:93129:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc056eac000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:93129:1870854458190464:0@lo:104: 00000100:00100000:2.0:1784189262.430399:0:6496:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784189262.430407:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458190208 00000100:00100000:3.0:1784189262.430410:0:93129:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784189262.430410:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458190208 00000100:00100000:2.0:1784189262.430422:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458190336 00010000:00010000:3.0:1784189262.430425:0:93129:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9dbf4369c400/0xcc1762b626f8c1e5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcc1762b626f8c1de expref: 23 pid: 92396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784189262.430425:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458190336 00000100:00100000:2.0:1784189262.430432:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458190464 00010000:00010000:3.0:1784189262.430433:0:93129:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9dbf4369c400/0xcc1762b626f8c1e5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcc1762b626f8c1de expref: 23 pid: 92396 timeout: 3604 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784189262.430434:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458190464 00000100:00100000:3.0:1784189262.430441:0:93129:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc056ead500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:93129:1870854458190592:0@lo:104: 00000100:00100000:2.0:1784189262.430443:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 326 00000100:00100000:2.0:1784189262.430447:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc056eafb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:bd553d0d-03e2-4233-b06b-b55bbfa2b954+7:93129:x1870854458189952:12345-0@lo:104: 00010000:00010000:2.0:1784189262.430455:0:6496:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.112@tcp lock: ffff9dc04a20a600/0xcc1762b626f8c224 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xcc1762b626f8c22b expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784189262.430458:0:93129:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1784189262.430486:0:93129:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9dbf4369c600/0xcc1762b626f8c1d7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcc1762b626f8c1d0 expref: 23 pid: 92397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189262.430494:0:93129:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9dbf4369c600/0xcc1762b626f8c1d7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcc1762b626f8c1d0 expref: 23 pid: 92397 timeout: 3604 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189262.430506:0:6496:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1784189262.430511:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc056eafb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:bd553d0d-03e2-4233-b06b-b55bbfa2b954+7:93129:x1870854458189952:12345-0@lo:104: Request processed in 63us (4115us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189262.430514:0:93129:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc056eaca80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:93129:1870854458190720:0@lo:104: 00000100:00100000:2.0:1784189262.430516:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 326 00000100:00100000:2.0:1784189262.430527:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458190592 00000100:00100000:2.0:1784189262.430530:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458190592 00000100:00100000:3.0:1784189262.430537:0:93129:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784189262.430541:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458190720 00000100:00100000:2.0:1784189262.430543:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458190720 00010000:00010000:3.0:1784189262.430557:0:93129:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9dbf4710f000/0xcc1762b626f8c1c9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c3fe5 expref: 9 pid: 92398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784189262.430564:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 327 00010000:00010000:3.0:1784189262.430566:0:93129:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9dbf4710f000/0xcc1762b626f8c1c9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c3fe5 expref: 9 pid: 92398 timeout: 3604 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784189262.430570:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc056ead180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:bd553d0d-03e2-4233-b06b-b55bbfa2b954+8:93129:x1870854458190080:12345-0@lo:104: 00010000:00010000:2.0:1784189262.430577:0:6496:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.112@tcp lock: ffff9dbf4369d000/0xcc1762b626f8c216 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xcc1762b626f8c21d expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784189262.430586:0:93129:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc056477480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:93129:1870854458190848:192.168.203.12@tcp:104: 00010000:00010000:2.0:1784189262.430607:0:6496:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:2.0:1784189262.430612:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc056ead180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:bd553d0d-03e2-4233-b06b-b55bbfa2b954+8:93129:x1870854458190080:12345-0@lo:104: Request processed in 43us (373us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189262.430617:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 327 00000100:00100000:2.0:1784189262.430629:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 328 00000100:00100000:2.0:1784189262.430634:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf43601050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:bd553d0d-03e2-4233-b06b-b55bbfa2b954+7:93129:x1870854458190208:12345-0@lo:104: 00010000:00010000:2.0:1784189262.430641:0:6496:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.112@tcp lock: ffff9dc04152c400/0xcc1762b626f8c208 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xcc1762b626f8c20f expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189262.430663:0:6496:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:2.0:1784189262.430667:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf43601050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:bd553d0d-03e2-4233-b06b-b55bbfa2b954+7:93129:x1870854458190208:12345-0@lo:104: Request processed in 34us (367us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189262.430672:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 328 00000100:00100000:2.0:1784189262.430734:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 329 00000100:00100000:2.0:1784189262.430747:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc080e7ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:bd553d0d-03e2-4233-b06b-b55bbfa2b954+6:93129:x1870854458190336:12345-0@lo:104: 00010000:00010000:3.0:1784189262.430751:0:93129:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9dbf4369ce00/0xcc1762b626f8c1c2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c3fde expref: 9 pid: 92397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189262.430754:0:6496:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.112@tcp lock: ffff9dc04152d600/0xcc1762b626f8c1fa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xcc1762b626f8c201 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189262.430759:0:93129:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9dbf4369ce00/0xcc1762b626f8c1c2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c3fde expref: 9 pid: 92397 timeout: 3604 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784189262.430767:0:93129:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc056475180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:93129:1870854458190976:192.168.203.12@tcp:104: 00010000:00010000:2.0:1784189262.430778:0:6496:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to priority blp list, 6 blwis in pool 00000100:00100000:2.0:1784189262.430782:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc080e7ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:bd553d0d-03e2-4233-b06b-b55bbfa2b954+6:93129:x1870854458190336:12345-0@lo:104: Request processed in 38us (383us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189262.430818:0:93129:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dc048b2d000 going to sleep for 11 seconds 00000100:00100000:3.0:1784189262.430838:0:93129:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc056eaf800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:93129:1870854458189696:0@lo:104: 00000100:00100000:3.0:1784189262.430847:0:93129:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc056eaed80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:93129:1870854458189824:0@lo:104: 00000100:00100000:3.0:1784189262.430854:0:93129:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc056ead880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:93129:1870854458189952:0@lo:104: 00000100:00100000:3.0:1784189262.430861:0:93129:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc056eac380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:93129:1870854458190080:0@lo:104: 00000100:00100000:3.0:1784189262.430939:0:93129:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc056eac700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:93129:1870854458190208:0@lo:104: 00000100:00100000:3.0:1784189262.430947:0:93129:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc056eaea00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:93129:1870854458190336:0@lo:104: 00000100:00100000:2.0:1784189262.431099:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 329 00000100:00100000:2.0:1784189262.431114:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 330 00000100:00100000:2.0:1784189262.431120:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc056eadf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:bd553d0d-03e2-4233-b06b-b55bbfa2b954+5:93129:x1870854458190464:12345-0@lo:104: 00010000:00010000:2.0:1784189262.431128:0:6496:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.112@tcp lock: ffff9dc04a20ac00/0xcc1762b626f8c1ec lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xcc1762b626f8c1f3 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189262.431166:0:6496:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to priority blp list, 7 blwis in pool 00000100:00100000:2.0:1784189262.431171:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc056eadf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:bd553d0d-03e2-4233-b06b-b55bbfa2b954+5:93129:x1870854458190464:12345-0@lo:104: Request processed in 52us (760us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189262.431177:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 330 00000100:00100000:2.0:1784189262.431189:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 331 00000100:00100000:2.0:1784189262.431194:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc056eaf100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:bd553d0d-03e2-4233-b06b-b55bbfa2b954+4:93129:x1870854458190592:12345-0@lo:104: 00010000:00010000:2.0:1784189262.431201:0:6496:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.112@tcp lock: ffff9dc04152d000/0xcc1762b626f8c1de lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xcc1762b626f8c1e5 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189262.431226:0:6496:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/8 locks to priority blp list, 8 blwis in pool 00000100:00100000:2.0:1784189262.431230:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc056eaf100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:bd553d0d-03e2-4233-b06b-b55bbfa2b954+4:93129:x1870854458190592:12345-0@lo:104: Request processed in 37us (772us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189262.431236:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 331 00000100:00100000:2.0:1784189262.431247:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 332 00000100:00100000:2.0:1784189262.431260:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc056475880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:bd553d0d-03e2-4233-b06b-b55bbfa2b954+3:93129:x1870854458190720:12345-0@lo:104: 00010000:00010000:2.0:1784189262.431267:0:6496:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.112@tcp lock: ffff9dc04152ca00/0xcc1762b626f8c1d0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xcc1762b626f8c1d7 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189262.431295:0:6496:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/9 locks to priority blp list, 9 blwis in pool 00000100:00100000:2.0:1784189262.431299:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc056475880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:bd553d0d-03e2-4233-b06b-b55bbfa2b954+3:93129:x1870854458190720:12345-0@lo:104: Request processed in 41us (762us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189262.431304:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 332 00010000:00010000:2.0:1784189262.431345:0:6501:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 8 total in blp. (8 blwis in pool) 00010000:00010000:2.0:1784189262.431351:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.112@tcp lock: ffff9dc04a20b400/0xcc1762b626f8c240 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xcc1762b626f8c247 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189262.431358:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc04a20b400 already unused, calling callback (ffffffffc114ac20) 10000000:00010000:2.0:1784189262.431362:0:6501:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.112@tcp lock: ffff9dc04a20b400/0xcc1762b626f8c240 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400400000000 nid: local remote: 0xcc1762b626f8c247 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189262.431370:0:6501:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.112@tcp lock: ffff9dc04a20b400/0xcc1762b626f8c240 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1408400000000 nid: local remote: 0xcc1762b626f8c247 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1784189262.431377:0:6501:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.112@tcp lock: ffff9dc04a20b400/0xcc1762b626f8c240 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1409400000000 nid: local remote: 0xcc1762b626f8c247 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784189262.431384:0:6501:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1784189262.431411:0:6501:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.112@tcp lock: ffff9dc04a20b400/0xcc1762b626f8c240 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcc1762b626f8c247 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189262.431417:0:6501:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1784189262.431438:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.112@tcp lock: ffff9dc04a20b400/0xcc1762b626f8c240 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcc1762b626f8c247 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189262.431455:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.112@tcp lock: ffff9dc04a20b400/0xcc1762b626f8c240 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcc1762b626f8c247 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189262.431478:0:6501:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 7 total in blp. (7 blwis in pool) 00010000:00010000:2.0:1784189262.431482:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.112@tcp lock: ffff9dbf4369de00/0xcc1762b626f8c232 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400000000000 nid: local remote: 0xcc1762b626f8c239 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189262.431488:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dbf4369de00 already unused, calling callback (ffffffffc114ac20) 00000100:00100000:3.0:1784189262.431490:0:93129:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc056eac000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:93129:1870854458190464:0@lo:104: 10000000:00010000:2.0:1784189262.431491:0:6501:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.112@tcp lock: ffff9dbf4369de00/0xcc1762b626f8c232 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400400000000 nid: local remote: 0xcc1762b626f8c239 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784189262.431498:0:93129:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc056ead500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:93129:1870854458190592:0@lo:104: 00010000:00010000:2.0:1784189262.431498:0:6501:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.112@tcp lock: ffff9dbf4369de00/0xcc1762b626f8c232 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1408400000000 nid: local remote: 0xcc1762b626f8c239 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1784189262.431504:0:6501:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.112@tcp lock: ffff9dbf4369de00/0xcc1762b626f8c232 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1409400000000 nid: local remote: 0xcc1762b626f8c239 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784189262.431509:0:6501:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:3.0:1784189262.431512:0:93129:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc056eaca80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:93129:1870854458190720:0@lo:104: 00010000:00010000:2.0:1784189262.431531:0:6501:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.112@tcp lock: ffff9dbf4369de00/0xcc1762b626f8c232 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcc1762b626f8c239 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189262.431537:0:6501:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1784189262.431544:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.112@tcp lock: ffff9dbf4369de00/0xcc1762b626f8c232 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcc1762b626f8c239 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189262.431555:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.112@tcp lock: ffff9dbf4369de00/0xcc1762b626f8c232 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcc1762b626f8c239 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189262.431564:0:6501:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:2.0:1784189262.431573:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.112@tcp lock: ffff9dc04a20a600/0xcc1762b626f8c224 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xcc1762b626f8c22b expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189262.431579:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc04a20a600 already unused, calling callback (ffffffffc114ac20) 10000000:00010000:2.0:1784189262.431582:0:6501:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.112@tcp lock: ffff9dc04a20a600/0xcc1762b626f8c224 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0xcc1762b626f8c22b expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189262.431588:0:6501:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.112@tcp lock: ffff9dc04a20a600/0xcc1762b626f8c224 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0xcc1762b626f8c22b expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1784189262.431595:0:6501:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.112@tcp lock: ffff9dc04a20a600/0xcc1762b626f8c224 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0xcc1762b626f8c22b expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784189262.431600:0:6501:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1784189262.431624:0:6501:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.112@tcp lock: ffff9dc04a20a600/0xcc1762b626f8c224 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcc1762b626f8c22b expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189262.431630:0:6501:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1784189262.431646:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.112@tcp lock: ffff9dc04a20a600/0xcc1762b626f8c224 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcc1762b626f8c22b expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189262.431652:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.112@tcp lock: ffff9dc04a20a600/0xcc1762b626f8c224 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcc1762b626f8c22b expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189262.431662:0:6501:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:2.0:1784189262.431665:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.112@tcp lock: ffff9dbf4369d000/0xcc1762b626f8c216 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0xcc1762b626f8c21d expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189262.431671:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dbf4369d000 already unused, calling callback (ffffffffc114ac20) 10000000:00010000:2.0:1784189262.431674:0:6501:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.112@tcp lock: ffff9dbf4369d000/0xcc1762b626f8c216 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0xcc1762b626f8c21d expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189262.431691:0:6501:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.112@tcp lock: ffff9dbf4369d000/0xcc1762b626f8c216 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0xcc1762b626f8c21d expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1784189262.431698:0:6501:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.112@tcp lock: ffff9dbf4369d000/0xcc1762b626f8c216 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0xcc1762b626f8c21d expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784189262.431703:0:6501:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1784189262.431732:0:6501:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.112@tcp lock: ffff9dbf4369d000/0xcc1762b626f8c216 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcc1762b626f8c21d expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189262.431737:0:6501:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1784189262.431743:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.112@tcp lock: ffff9dbf4369d000/0xcc1762b626f8c216 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcc1762b626f8c21d expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189262.431750:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.112@tcp lock: ffff9dbf4369d000/0xcc1762b626f8c216 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcc1762b626f8c21d expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189262.431759:0:6501:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:2.0:1784189262.431762:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.112@tcp lock: ffff9dc04152c400/0xcc1762b626f8c208 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xcc1762b626f8c20f expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189262.431767:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc04152c400 already unused, calling callback (ffffffffc114ac20) 10000000:00010000:2.0:1784189262.431770:0:6501:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.112@tcp lock: ffff9dc04152c400/0xcc1762b626f8c208 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0xcc1762b626f8c20f expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189262.431777:0:6501:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.112@tcp lock: ffff9dc04152c400/0xcc1762b626f8c208 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0xcc1762b626f8c20f expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1784189262.431783:0:6501:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.112@tcp lock: ffff9dc04152c400/0xcc1762b626f8c208 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0xcc1762b626f8c20f expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784189262.431954:0:6501:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1784189262.431978:0:6501:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.112@tcp lock: ffff9dc04152c400/0xcc1762b626f8c208 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcc1762b626f8c20f expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189262.431984:0:6501:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1784189262.431989:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.112@tcp lock: ffff9dc04152c400/0xcc1762b626f8c208 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcc1762b626f8c20f expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189262.431994:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.112@tcp lock: ffff9dc04152c400/0xcc1762b626f8c208 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcc1762b626f8c20f expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189262.432004:0:6501:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1784189262.432008:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.112@tcp lock: ffff9dc04152d600/0xcc1762b626f8c1fa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xcc1762b626f8c201 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189262.432013:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc04152d600 already unused, calling callback (ffffffffc114ac20) 10000000:00010000:2.0:1784189262.432016:0:6501:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.112@tcp lock: ffff9dc04152d600/0xcc1762b626f8c1fa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xcc1762b626f8c201 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189262.432022:0:6501:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.112@tcp lock: ffff9dc04152d600/0xcc1762b626f8c1fa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xcc1762b626f8c201 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1784189262.432029:0:6501:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.112@tcp lock: ffff9dc04152d600/0xcc1762b626f8c1fa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xcc1762b626f8c201 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784189262.432034:0:6501:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1784189262.432057:0:6501:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.112@tcp lock: ffff9dc04152d600/0xcc1762b626f8c1fa lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcc1762b626f8c201 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189262.432062:0:6501:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1784189262.432072:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.112@tcp lock: ffff9dc04152d600/0xcc1762b626f8c1fa lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcc1762b626f8c201 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189262.432077:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.112@tcp lock: ffff9dc04152d600/0xcc1762b626f8c1fa lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcc1762b626f8c201 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189262.432087:0:6501:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1784189262.432089:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.112@tcp lock: ffff9dc04a20ac00/0xcc1762b626f8c1ec lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xcc1762b626f8c1f3 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189262.432094:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc04a20ac00 already unused, calling callback (ffffffffc114ac20) 10000000:00010000:2.0:1784189262.432096:0:6501:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.112@tcp lock: ffff9dc04a20ac00/0xcc1762b626f8c1ec lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xcc1762b626f8c1f3 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189262.432103:0:6501:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.112@tcp lock: ffff9dc04a20ac00/0xcc1762b626f8c1ec lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xcc1762b626f8c1f3 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1784189262.432108:0:6501:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.112@tcp lock: ffff9dc04a20ac00/0xcc1762b626f8c1ec lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xcc1762b626f8c1f3 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784189262.432113:0:6501:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1784189262.432124:0:6501:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.112@tcp lock: ffff9dc04a20ac00/0xcc1762b626f8c1ec lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcc1762b626f8c1f3 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189262.432129:0:6501:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1784189262.432132:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.112@tcp lock: ffff9dc04a20ac00/0xcc1762b626f8c1ec lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcc1762b626f8c1f3 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189262.432137:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.112@tcp lock: ffff9dc04a20ac00/0xcc1762b626f8c1ec lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcc1762b626f8c1f3 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189262.432144:0:6501:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1784189262.432152:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.112@tcp lock: ffff9dc04152d000/0xcc1762b626f8c1de lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xcc1762b626f8c1e5 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189262.432158:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc04152d000 already unused, calling callback (ffffffffc114ac20) 10000000:00010000:2.0:1784189262.432161:0:6501:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.112@tcp lock: ffff9dc04152d000/0xcc1762b626f8c1de lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xcc1762b626f8c1e5 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189262.432168:0:6501:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.112@tcp lock: ffff9dc04152d000/0xcc1762b626f8c1de lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xcc1762b626f8c1e5 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1784189262.432174:0:6501:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.112@tcp lock: ffff9dc04152d000/0xcc1762b626f8c1de lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xcc1762b626f8c1e5 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784189262.432179:0:6501:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1784189262.432193:0:6501:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.112@tcp lock: ffff9dc04152d000/0xcc1762b626f8c1de lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcc1762b626f8c1e5 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189262.432199:0:6501:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1784189262.432206:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.112@tcp lock: ffff9dc04152d000/0xcc1762b626f8c1de lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcc1762b626f8c1e5 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189262.432212:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.112@tcp lock: ffff9dc04152d000/0xcc1762b626f8c1de lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcc1762b626f8c1e5 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189262.432221:0:6501:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784189262.432223:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.112@tcp lock: ffff9dc04152ca00/0xcc1762b626f8c1d0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xcc1762b626f8c1d7 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189262.432228:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc04152ca00 already unused, calling callback (ffffffffc114ac20) 10000000:00010000:2.0:1784189262.432231:0:6501:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.112@tcp lock: ffff9dc04152ca00/0xcc1762b626f8c1d0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xcc1762b626f8c1d7 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189262.432248:0:6501:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.112@tcp lock: ffff9dc04152ca00/0xcc1762b626f8c1d0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xcc1762b626f8c1d7 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1784189262.432254:0:6501:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.112@tcp lock: ffff9dc04152ca00/0xcc1762b626f8c1d0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xcc1762b626f8c1d7 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784189262.432259:0:6501:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1784189262.432273:0:6501:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.112@tcp lock: ffff9dc04152ca00/0xcc1762b626f8c1d0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcc1762b626f8c1d7 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189262.432278:0:6501:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1784189262.432284:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.112@tcp lock: ffff9dc04152ca00/0xcc1762b626f8c1d0 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcc1762b626f8c1d7 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189262.432290:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.112@tcp lock: ffff9dc04152ca00/0xcc1762b626f8c1d0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcc1762b626f8c1d7 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189262.432303:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784189262.432305:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784189262.432307:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784189262.432314:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784189262.432338:0:26173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784189262.432344:0:7454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784189262.432357:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc080e7dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bd553d0d-03e2-4233-b06b-b55bbfa2b954:3642:1870854458191104:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1784189262.432398:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784189262.432427:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc056eace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bd553d0d-03e2-4233-b06b-b55bbfa2b954:3642:1870854458191616:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1784189262.432446:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784189262.432460:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc05f02fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bd553d0d-03e2-4233-b06b-b55bbfa2b954:3642:1870854458192128:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1784189262.432499:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784189262.432528:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1784189262.432534:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc080e7fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bd553d0d-03e2-4233-b06b-b55bbfa2b954:3642:1870854458191232:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1784189262.432557:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784189262.432579:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc056eafb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bd553d0d-03e2-4233-b06b-b55bbfa2b954:3642:1870854458191744:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1784189262.432600:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784189262.432627:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc080e7df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bd553d0d-03e2-4233-b06b-b55bbfa2b954:3640:1870854458191360:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1784189262.432648:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784189262.432662:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc056ead180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bd553d0d-03e2-4233-b06b-b55bbfa2b954:3640:1870854458191872:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1784189262.432678:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784189262.432687:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1784189262.432692:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc056eadc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bd553d0d-03e2-4233-b06b-b55bbfa2b954:3640:1870854458191488:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1784189262.432709:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784189262.432717:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc05f02f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bd553d0d-03e2-4233-b06b-b55bbfa2b954:3640:1870854458192000:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1784189262.432732:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784189262.432754:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458191104 00000100:00100000:2.0:1784189262.432759:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458191104 00010000:00010000:2.0:1784189262.432784:0:6500:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9dc04152da00/0xcc1762b626f8c247 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcc1762b626f8c240 expref: 24 pid: 92398 timeout: 3604 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784189262.433134:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458191616 00000100:00100000:2.0:1784189262.433137:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458191616 00010000:00010000:2.0:1784189262.433154:0:6500:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9dbf4710ec00/0xcc1762b626f8c20f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcc1762b626f8c208 expref: 25 pid: 92397 timeout: 3604 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784189262.433165:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458192128 00000100:00100000:2.0:1784189262.433168:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458192128 00010000:00010000:2.0:1784189262.433187:0:6500:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9dbf4369c600/0xcc1762b626f8c1d7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcc1762b626f8c1d0 expref: 26 pid: 92397 timeout: 3604 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784189262.433198:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458191232 00000100:00100000:2.0:1784189262.433201:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458191232 00010000:00010000:2.0:1784189262.433210:0:6500:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9dc04152ce00/0xcc1762b626f8c239 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcc1762b626f8c232 expref: 27 pid: 92396 timeout: 3604 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784189262.433220:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458191744 00000100:00100000:2.0:1784189262.433222:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458191744 00010000:00010000:2.0:1784189262.433231:0:6500:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9dbf4710f600/0xcc1762b626f8c201 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcc1762b626f8c1fa expref: 28 pid: 92396 timeout: 3604 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784189262.433240:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458191360 00000100:00100000:2.0:1784189262.433242:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458191360 00010000:00010000:2.0:1784189262.433251:0:6500:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9dbf4369d400/0xcc1762b626f8c22b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcc1762b626f8c224 expref: 29 pid: 92397 timeout: 3604 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784189262.433262:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458191872 00000100:00100000:2.0:1784189262.433264:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458191872 00000100:00100000:3.0:1784189262.433272:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458191488 00010000:00010000:2.0:1784189262.433273:0:6500:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9dbf4710e000/0xcc1762b626f8c1f3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcc1762b626f8c1ec expref: 30 pid: 92396 timeout: 3604 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784189262.433276:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458191488 00000100:00100000:2.0:1784189262.433281:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458192000 00000100:00100000:2.0:1784189262.433283:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458192000 00010000:00010000:3.0:1784189262.433290:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9dbf4710f800/0xcc1762b626f8c21d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcc1762b626f8c216 expref: 32 pid: 92396 timeout: 3604 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189262.433291:0:6500:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9dbf4369c400/0xcc1762b626f8c1e5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcc1762b626f8c1de expref: 32 pid: 92396 timeout: 3604 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784189262.433303:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2566 00000100:00100000:2.0:1784189262.433309:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc05f02ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bd553d0d-03e2-4233-b06b-b55bbfa2b954+32:3642:x1870854458191104:12345-0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1784189262.433311:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2567 00000100:00100000:3.0:1784189262.433315:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc05f02e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bd553d0d-03e2-4233-b06b-b55bbfa2b954+32:3642:x1870854458191616:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1784189262.433338:0:6500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784189262.433341:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784189262.433344:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9dbf4710ec00/0xcc1762b626f8c20f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 16 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcc1762b626f8c208 expref: 32 pid: 92397 timeout: 3604 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189262.433344:0:6500:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9dc04152da00/0xcc1762b626f8c247 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcc1762b626f8c240 expref: 32 pid: 92398 timeout: 3604 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189262.433354:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9dbf4710ec00/0xcc1762b626f8c20f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 15 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcc1762b626f8c208 expref: 32 pid: 92397 timeout: 3604 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784189262.433423:0:7455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2568 00000100:00100000:1.0:1784189262.433433:0:7455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc05653a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bd553d0d-03e2-4233-b06b-b55bbfa2b954+32:3642:x1870854458192128:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1784189262.433450:0:7455:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784189262.433454:0:7455:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9dbf4369c600/0xcc1762b626f8c1d7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 16 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcc1762b626f8c1d0 expref: 32 pid: 92397 timeout: 3604 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189262.433684:0:6500:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9dc04152da00/0xcc1762b626f8c247 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 16 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcc1762b626f8c240 expref: 32 pid: 92398 timeout: 3604 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189262.433699:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dc04152da00/0xcc1762b626f8c247 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 16 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcc1762b626f8c240 expref: 32 pid: 92398 timeout: 3604 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189262.433715:0:6500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784189262.433768:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc05f02ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bd553d0d-03e2-4233-b06b-b55bbfa2b954+31:3642:x1870854458191104:12345-0@lo:103:ldlm_bl.0 Request processed in 458us (1369us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189262.433776:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2566 00000100:00100000:2.0:1784189262.433804:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2569 00000100:00100000:2.0:1784189262.433810:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc0711a5450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bd553d0d-03e2-4233-b06b-b55bbfa2b954+30:3642:x1870854458191232:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1784189262.433819:0:6500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784189262.433823:0:6500:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9dc04152ce00/0xcc1762b626f8c239 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 15 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcc1762b626f8c232 expref: 30 pid: 92396 timeout: 3604 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189262.433831:0:6500:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9dc04152ce00/0xcc1762b626f8c239 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 15 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcc1762b626f8c232 expref: 30 pid: 92396 timeout: 3604 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189262.433840:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dc04152ce00/0xcc1762b626f8c239 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 15 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcc1762b626f8c232 expref: 30 pid: 92396 timeout: 3604 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189262.433850:0:6500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784189262.433987:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc0711a5450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bd553d0d-03e2-4233-b06b-b55bbfa2b954+29:3642:x1870854458191232:12345-0@lo:103:ldlm_bl.0 Request processed in 177us (1428us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189262.433994:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2569 00000100:00100000:2.0:1784189262.434012:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2570 00000100:00100000:2.0:1784189262.434017:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc071536a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bd553d0d-03e2-4233-b06b-b55bbfa2b954+28:3642:x1870854458191744:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1784189262.434033:0:6500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784189262.434037:0:6500:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9dbf4710f600/0xcc1762b626f8c201 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcc1762b626f8c1fa expref: 28 pid: 92396 timeout: 3604 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189262.434045:0:6500:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9dbf4710f600/0xcc1762b626f8c201 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcc1762b626f8c1fa expref: 28 pid: 92396 timeout: 3604 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189262.434055:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dbf4710f600/0xcc1762b626f8c201 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcc1762b626f8c1fa expref: 28 pid: 92396 timeout: 3604 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189262.434075:0:6500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784189262.434099:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc071536a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bd553d0d-03e2-4233-b06b-b55bbfa2b954+27:3642:x1870854458191744:12345-0@lo:103:ldlm_bl.0 Request processed in 82us (1498us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189262.434105:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2570 00000100:00100000:2.0:1784189262.434117:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2571 00000100:00100000:2.0:1784189262.434122:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc07016c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bd553d0d-03e2-4233-b06b-b55bbfa2b954+26:3640:x1870854458191360:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1784189262.434130:0:6500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784189262.434134:0:6500:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9dbf4369d400/0xcc1762b626f8c22b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcc1762b626f8c224 expref: 26 pid: 92397 timeout: 3604 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189262.434143:0:6500:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9dbf4369d400/0xcc1762b626f8c22b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcc1762b626f8c224 expref: 26 pid: 92397 timeout: 3604 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189262.434153:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dbf4369d400/0xcc1762b626f8c22b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcc1762b626f8c224 expref: 26 pid: 92397 timeout: 3604 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189262.434161:0:6500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784189262.434190:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc07016c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bd553d0d-03e2-4233-b06b-b55bbfa2b954+25:3640:x1870854458191360:12345-0@lo:103:ldlm_bl.0 Request processed in 68us (1540us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189262.434205:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2571 00000100:00100000:2.0:1784189262.434218:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2572 00000100:00100000:2.0:1784189262.434223:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc07016f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bd553d0d-03e2-4233-b06b-b55bbfa2b954+24:3640:x1870854458191872:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1784189262.434232:0:6500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784189262.434237:0:6500:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9dbf4710e000/0xcc1762b626f8c1f3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcc1762b626f8c1ec expref: 24 pid: 92396 timeout: 3604 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189262.434246:0:6500:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9dbf4710e000/0xcc1762b626f8c1f3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcc1762b626f8c1ec expref: 24 pid: 92396 timeout: 3604 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189262.434255:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dbf4710e000/0xcc1762b626f8c1f3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcc1762b626f8c1ec expref: 24 pid: 92396 timeout: 3604 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189262.434264:0:6500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784189262.434286:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc07016f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bd553d0d-03e2-4233-b06b-b55bbfa2b954+23:3640:x1870854458191872:12345-0@lo:103:ldlm_bl.0 Request processed in 63us (1606us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189262.434292:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2572 00000100:00100000:2.0:1784189262.434304:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2573 00000100:00100000:2.0:1784189262.434310:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc07016ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bd553d0d-03e2-4233-b06b-b55bbfa2b954+22:3640:x1870854458192000:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1784189262.434337:0:6500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784189262.434342:0:6500:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9dbf4369c400/0xcc1762b626f8c1e5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcc1762b626f8c1de expref: 22 pid: 92396 timeout: 3604 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189262.434350:0:6500:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9dbf4369c400/0xcc1762b626f8c1e5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcc1762b626f8c1de expref: 22 pid: 92396 timeout: 3604 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189262.434360:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dbf4369c400/0xcc1762b626f8c1e5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcc1762b626f8c1de expref: 22 pid: 92396 timeout: 3604 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189262.434379:0:6500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784189262.434404:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc07016ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bd553d0d-03e2-4233-b06b-b55bbfa2b954+21:3640:x1870854458192000:12345-0@lo:103:ldlm_bl.0 Request processed in 94us (1671us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189262.434410:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2573 00000100:00100000:2.0:1784189262.434423:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2574 00000100:00100000:2.0:1784189262.434429:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc07016d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bd553d0d-03e2-4233-b06b-b55bbfa2b954+20:3640:x1870854458191488:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1784189262.434437:0:6500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784189262.434441:0:6500:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9dbf4710f800/0xcc1762b626f8c21d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcc1762b626f8c216 expref: 20 pid: 92396 timeout: 3604 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189262.434449:0:6500:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9dbf4710f800/0xcc1762b626f8c21d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcc1762b626f8c216 expref: 20 pid: 92396 timeout: 3604 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189262.434458:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dbf4710f800/0xcc1762b626f8c21d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcc1762b626f8c216 expref: 20 pid: 92396 timeout: 3604 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189262.434484:0:6500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784189262.434507:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc07016d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bd553d0d-03e2-4233-b06b-b55bbfa2b954+19:3640:x1870854458191488:12345-0@lo:103:ldlm_bl.0 Request processed in 79us (1797us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189262.434513:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2574 00000100:00100000:2.0:1784189262.434973:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc056eadc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bd553d0d-03e2-4233-b06b-b55bbfa2b954:3640:1870854458191488:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1784189262.434983:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc05f02f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bd553d0d-03e2-4233-b06b-b55bbfa2b954:3640:1870854458192000:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1784189262.434989:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc080e7df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bd553d0d-03e2-4233-b06b-b55bbfa2b954:3640:1870854458191360:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1784189262.434996:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc056ead180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bd553d0d-03e2-4233-b06b-b55bbfa2b954:3640:1870854458191872:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1784189262.435192:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc080e7fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bd553d0d-03e2-4233-b06b-b55bbfa2b954:3642:1870854458191232:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1784189262.435211:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc056eafb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bd553d0d-03e2-4233-b06b-b55bbfa2b954:3642:1870854458191744:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1784189262.435217:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc080e7dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bd553d0d-03e2-4233-b06b-b55bbfa2b954:3642:1870854458191104:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1784189262.436553:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dbf4710ec00/0xcc1762b626f8c20f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcc1762b626f8c208 expref: 18 pid: 92397 timeout: 3604 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784189262.436846:0:93129:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc056477480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:93129:1870854458190848:192.168.203.12@tcp:104: 00000100:00100000:0.0:1784189262.436858:0:93129:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc056475180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:93129:1870854458190976:192.168.203.12@tcp:104: 00010000:00010000:0.0:1784189262.437086:0:93129:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9dbf4369d200/0xcc1762b626f8c24e lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 93129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189262.437143:0:7455:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9dbf4369c600/0xcc1762b626f8c1d7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcc1762b626f8c1d0 expref: 18 pid: 92397 timeout: 3604 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189262.437159:0:7455:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dbf4369c600/0xcc1762b626f8c1d7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcc1762b626f8c1d0 expref: 18 pid: 92397 timeout: 3604 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189262.437175:0:7455:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784189262.437268:0:7455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc05653a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bd553d0d-03e2-4233-b06b-b55bbfa2b954+17:3642:x1870854458192128:12345-0@lo:103:ldlm_bl.0 Request processed in 3837us (4767us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189262.437277:0:7455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2568 00000100:00100000:0.0:1784189262.437430:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc05f02fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bd553d0d-03e2-4233-b06b-b55bbfa2b954:3642:1870854458192128:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1784189262.439438:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784189262.439519:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc05f02e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bd553d0d-03e2-4233-b06b-b55bbfa2b954+15:3642:x1870854458191616:12345-0@lo:103:ldlm_bl.0 Request processed in 6200us (7069us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189262.439528:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2567 00000100:00100000:0.0:1784189262.439809:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc056eace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bd553d0d-03e2-4233-b06b-b55bbfa2b954:3642:1870854458191616:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1784189262.440832:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1784189262.440996:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436309120 00000100:00100000:2.0:1784189262.441016:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436309120 00010000:00010000:2.0:1784189262.441056:0:6500:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9dbf4369ce00/0xcc1762b626f8c1c2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c3fde expref: 10 pid: 92397 timeout: 3604 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784189262.441096:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 2575 00000100:00100000:2.0:1784189262.441104:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc056475180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:60f345e3-c70e-4f53-b5e7-c9671463c9a5+10:2396:x1870854436309120:12345-192.168.203.12@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1784189262.441118:0:6500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784189262.441123:0:6500:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9dbf4369ce00/0xcc1762b626f8c1c2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c3fde expref: 10 pid: 92397 timeout: 3604 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189262.441134:0:6500:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9dbf4369ce00/0xcc1762b626f8c1c2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c3fde expref: 10 pid: 92397 timeout: 3604 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189262.441150:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dbf4369ce00/0xcc1762b626f8c1c2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c3fde expref: 10 pid: 92397 timeout: 3604 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189262.441164:0:6500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784189262.441217:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc056475180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:60f345e3-c70e-4f53-b5e7-c9671463c9a5+9:2396:x1870854436309120:12345-192.168.203.12@tcp:103:ldlm_bl.0 Request processed in 113us (390us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189262.441224:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 2575 00000100:00100000:2.0:1784189262.451181:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1784189262.451267:0:26172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436309248 00000100:00100000:0.0:1784189262.451277:0:26172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436309248 00010000:00010000:0.0:1784189262.451316:0:26172:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9dbf4710f000/0xcc1762b626f8c1c9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c3fe5 expref: 9 pid: 92398 timeout: 3604 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784189262.451400:0:26172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 2576 00000100:00100000:0.0:1784189262.451410:0:26172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc07113b850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:60f345e3-c70e-4f53-b5e7-c9671463c9a5+9:2396:x1870854436309248:12345-192.168.203.12@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1784189262.451427:0:26172:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784189262.451433:0:26172:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9dbf4710f000/0xcc1762b626f8c1c9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c3fe5 expref: 9 pid: 92398 timeout: 3604 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189262.451446:0:26172:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9dbf4710f000/0xcc1762b626f8c1c9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c3fe5 expref: 9 pid: 92398 timeout: 3604 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189262.451473:0:26172:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dbf4710f000/0xcc1762b626f8c1c9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c3fe5 expref: 9 pid: 92398 timeout: 3604 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189262.451520:0:26172:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9dbf4369d200/0xcc1762b626f8c24e lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 93129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189262.451528:0:26172:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dbf4369d200/0xcc1762b626f8c24e lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 93129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189262.451546:0:26172:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9dbf4369d200/0xcc1762b626f8c24e lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 93129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189262.451563:0:26172:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9dbf4369d200/0xcc1762b626f8c24e lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 93129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189262.451570:0:26172:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9dbf4369d200/0xcc1762b626f8c24e lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 93129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189262.451772:0:26172:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9dbf4369d200/0xcc1762b626f8c24e lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 93129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189262.451782:0:26172:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dbf4369d200 already unused, calling callback (ffffffffc0b2e230) 00010000:00010000:0.0:1784189262.451786:0:26172:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9dbf4369d200/0xcc1762b626f8c24e lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 93129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189262.451794:0:26172:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9dbf4369d200/0xcc1762b626f8c24e lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 93129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189262.451816:0:26172:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9dbf4369d200/0xcc1762b626f8c24e lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 93129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189262.451828:0:26172:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1784189262.451946:0:93129:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9dbf4369d200/0xcc1762b626f8c24e lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 93129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189262.451955:0:93129:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9dbf4369d200/0xcc1762b626f8c24e lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 93129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189262.451961:0:93129:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dbf4369d200/0xcc1762b626f8c24e lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 93129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784189262.452805:0:26172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc07113b850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:60f345e3-c70e-4f53-b5e7-c9671463c9a5+8:2396:x1870854436309248:12345-192.168.203.12@tcp:103:ldlm_bl.0 Request processed in 1393us (1630us total) trans 0 rc 0/0 00000100:00100000:0.0:1784189262.452823:0:26172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 2576 00010000:00010000:2.0:1784189262.577133:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784189263.599681:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1784189263.727618:0:6510:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1784189263.727636:0:6510:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9dbf46b0a800 from 55 10000000:01000000:3.0:1784189263.727642:0:6510:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1784189263.727691:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff9dbf4369d800/0xcc1762b626f8c255 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189263.727703:0:6510:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: ffff9dbf4369d800/0xcc1762b626f8c255 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189263.727713:0:6510:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: ffff9dbf4369d800/0xcc1762b626f8c255 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784189263.727740:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc056477480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458192256:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1784189263.727818:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784189263.727997:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dc048b2d840 going to sleep for 11 seconds 00000100:00100000:1.0:1784189263.734693:0:92398:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458192256 00000100:00100000:1.0:1784189263.734707:0:92398:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458192256 00000100:00100000:1.0:1784189263.734842:0:92398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:1.0:1784189263.734852:0:92398:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc07a90f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd553d0d-03e2-4233-b06b-b55bbfa2b954+15:6510:x1870854458192256:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784189263.734869:0:92398:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784189263.734887:0:92398:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dbf4710e600/0xcc1762b626f8c25c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xcc1762b626f8c255 expref: -99 pid: 92398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189263.734913:0:92398:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dbf4710e600/0xcc1762b626f8c25c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcc1762b626f8c255 expref: 16 pid: 92398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189263.734924:0:92398:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dbf4710e600/0xcc1762b626f8c25c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcc1762b626f8c255 expref: 16 pid: 92398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189263.734933:0:92398:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dbf4710e600, rc 0) 00000100:00100000:1.0:1784189263.735041:0:92398:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc07a90f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd553d0d-03e2-4233-b06b-b55bbfa2b954+16:6510:x1870854458192256:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 190us (7222us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189263.735049:0:92398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:3.0:1784189263.735155:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc056477480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458192256:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784189263.735173:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: ffff9dbf4369d800/0xcc1762b626f8c255 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc1762b626f8c25c expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189263.735182:0:6510:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: ffff9dbf4369d800/0xcc1762b626f8c255 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcc1762b626f8c25c expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784189263.735265:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc056477480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458192384:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784189263.735298:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784189263.735906:0:92396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458192384 00000100:00100000:2.0:1784189263.735912:0:92396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458192384 00000100:00100000:3.0:1784189263.735922:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dc048b2d840 going to sleep for 11 seconds 00000100:00100000:0.0:1784189263.735962:0:92397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:0.0:1784189263.735973:0:92397:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc07a90f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd553d0d-03e2-4233-b06b-b55bbfa2b954+16:6510:x1870854458192384:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1784189263.736381:0:92397:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc07a90f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd553d0d-03e2-4233-b06b-b55bbfa2b954+16:6510:x1870854458192384:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 410us (1081us total) trans 0 rc 0/0 00000100:00100000:0.0:1784189263.736388:0:92397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:3.0:1784189263.736415:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc056477480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458192384:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784189263.736447:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc056477480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458192512:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1784189263.736511:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784189263.736580:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dc048b2d840 going to sleep for 11 seconds 00000100:00100000:2.0:1784189263.736805:0:92396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458192512 00000100:00100000:2.0:1784189263.736810:0:92396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458192512 00000100:00100000:2.0:1784189263.736844:0:92396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:2.0:1784189263.736852:0:92396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc07a90c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd553d0d-03e2-4233-b06b-b55bbfa2b954+16:6510:x1870854458192512:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1784189263.737048:0:92396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc07a90c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd553d0d-03e2-4233-b06b-b55bbfa2b954+16:6510:x1870854458192512:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 196us (535us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189263.737054:0:92396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:3.0:1784189263.737217:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc056477480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458192512:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1784189263.737776:0:93130:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc050543480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bd553d0d-03e2-4233-b06b-b55bbfa2b954:93130:1870854458192640:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1784189263.737817:0:93130:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784189263.737888:0:93130:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dc07569fcc0 going to sleep for 11 seconds 00000100:00100000:2.0:1784189263.737921:0:92397:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458192640 00000100:00100000:2.0:1784189263.737926:0:92397:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458192640 00000100:00100000:2.0:1784189263.737991:0:92397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:2.0:1784189263.738006:0:92397:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc07a90ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd553d0d-03e2-4233-b06b-b55bbfa2b954+16:93130:x1870854458192640:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1784189263.738096:0:92397:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc07a90ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd553d0d-03e2-4233-b06b-b55bbfa2b954+16:93130:x1870854458192640:12345-0@lo:502:llog_process_th.0 Request processed in 98us (277us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189263.738104:0:92397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:0.0:1784189263.738168:0:93130:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc050543480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bd553d0d-03e2-4233-b06b-b55bbfa2b954:93130:1870854458192640:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1784189263.738205:0:93130:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc050543480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bd553d0d-03e2-4233-b06b-b55bbfa2b954:93130:1870854458192768:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1784189263.738236:0:93130:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784189263.738474:0:93130:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dc07569fcc0 going to sleep for 11 seconds 00000100:00100000:1.0:1784189263.738545:0:92398:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458192768 00000100:00100000:1.0:1784189263.738550:0:92398:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458192768 00000100:00100000:1.0:1784189263.738572:0:92398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:1.0:1784189263.738578:0:92398:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc07a90c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd553d0d-03e2-4233-b06b-b55bbfa2b954+16:93130:x1870854458192768:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1784189263.738777:0:92398:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc07a90c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd553d0d-03e2-4233-b06b-b55bbfa2b954+16:93130:x1870854458192768:12345-0@lo:502:llog_process_th.0 Request processed in 199us (539us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189263.738785:0:92398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:0.0:1784189263.738958:0:93130:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc050543480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bd553d0d-03e2-4233-b06b-b55bbfa2b954:93130:1870854458192768:0@lo:502:llog_process_th.0 00000040:00080000:0.0:1784189263.738977:0:93130:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 58 count 57 00000020:01000000:1.0:1784189263.739173:0:6510:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 55-57 (rc=0) 10000000:01000000:1.0:1784189263.739195:0:6510:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1784189263.739203:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff9dbf4369d800/0xcc1762b626f8c255 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc1762b626f8c25c expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189263.739212:0:6510:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: ffff9dbf4369d800/0xcc1762b626f8c255 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc1762b626f8c25c expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784189263.739221:0:6510:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:1.0:1784189263.739224:0:6510:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 50 10000000:01000000:1.0:1784189263.739227:0:6510:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1784189263.739251:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff9dbf4710e400/0xcc1762b626f8c263 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189263.739259:0:6510:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: ffff9dbf4710e400/0xcc1762b626f8c263 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189263.739268:0:6510:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: ffff9dbf4710e400/0xcc1762b626f8c263 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784189263.739295:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf470e1f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458192896:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1784189263.739353:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784189263.739371:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dc074a76180 going to sleep for 11 seconds 00000100:00100000:0.0:1784189263.739438:0:92398:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458192896 00000100:00100000:0.0:1784189263.739442:0:92398:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458192896 00000100:00100000:0.0:1784189263.739474:0:92398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:0.0:1784189263.739480:0:92398:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf456b2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd553d0d-03e2-4233-b06b-b55bbfa2b954+16:6510:x1870854458192896:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784189263.739488:0:92398:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784189263.739501:0:92398:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dc04152ce00/0xcc1762b626f8c26a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xcc1762b626f8c263 expref: -99 pid: 92398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189263.739521:0:92398:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dc04152ce00/0xcc1762b626f8c26a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcc1762b626f8c263 expref: 17 pid: 92398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189263.739538:0:92398:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dc04152ce00/0xcc1762b626f8c26a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcc1762b626f8c263 expref: 17 pid: 92398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189263.739548:0:92398:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc04152ce00, rc 0) 00000100:00100000:0.0:1784189263.739579:0:92398:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf456b2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd553d0d-03e2-4233-b06b-b55bbfa2b954+17:6510:x1870854458192896:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 99us (225us total) trans 0 rc 0/0 00000100:00100000:0.0:1784189263.739585:0:92398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:1.0:1784189263.739828:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf470e1f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458192896:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784189263.739840:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: ffff9dbf4710e400/0xcc1762b626f8c263 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc1762b626f8c26a expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189263.739849:0:6510:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: ffff9dbf4710e400/0xcc1762b626f8c263 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xcc1762b626f8c26a expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784189263.739898:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf470e1f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458193024:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1784189263.739921:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784189263.739946:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dc074a76180 going to sleep for 11 seconds 00000100:00100000:2.0:1784189263.741350:0:92397:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458193024 00000100:00100000:2.0:1784189263.741359:0:92397:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458193024 00000100:00100000:2.0:1784189263.741403:0:92397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:2.0:1784189263.741411:0:92397:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf456b0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd553d0d-03e2-4233-b06b-b55bbfa2b954+17:6510:x1870854458193024:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1784189263.741562:0:92397:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf456b0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd553d0d-03e2-4233-b06b-b55bbfa2b954+17:6510:x1870854458193024:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 151us (1639us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189263.741570:0:92397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:1.0:1784189263.741700:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf470e1f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458193024:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1784189263.741750:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf470e1f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458193152:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1784189263.741796:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784189263.741817:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dc074a76180 going to sleep for 11 seconds 00000100:00100000:2.0:1784189263.741907:0:92397:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458193152 00000100:00100000:2.0:1784189263.741912:0:92397:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458193152 00000100:00100000:2.0:1784189263.741929:0:92397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:2.0:1784189263.741935:0:92397:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf456b0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd553d0d-03e2-4233-b06b-b55bbfa2b954+17:6510:x1870854458193152:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1784189263.742167:0:92397:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf456b0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd553d0d-03e2-4233-b06b-b55bbfa2b954+17:6510:x1870854458193152:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 231us (369us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189263.742174:0:92397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:1.0:1784189263.742314:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf470e1f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458193152:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1784189263.742966:0:93131:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf470e1f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bd553d0d-03e2-4233-b06b-b55bbfa2b954:93131:1870854458193280:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1784189263.743069:0:93131:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784189263.743342:0:92397:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458193280 00000100:00100000:2.0:1784189263.743348:0:92397:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458193280 00000100:00100000:2.0:1784189263.743388:0:92397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:2.0:1784189263.743396:0:92397:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf456b2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd553d0d-03e2-4233-b06b-b55bbfa2b954+17:93131:x1870854458193280:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1784189263.743498:0:92397:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf456b2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd553d0d-03e2-4233-b06b-b55bbfa2b954+17:93131:x1870854458193280:12345-0@lo:502:llog_process_th.0 Request processed in 103us (428us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189263.743506:0:92397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:1.0:1784189263.746794:0:93131:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dc074a76180 going to sleep for 11 seconds 00000100:00100000:1.0:1784189263.746833:0:93131:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf470e1f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bd553d0d-03e2-4233-b06b-b55bbfa2b954:93131:1870854458193280:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1784189263.746877:0:93131:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1784189263.746901:0:93131:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784189263.746903:0:93131:0:(obd_config.c:1561:class_process_config()) marker 46 (0x1) lustre-MDT0000-m add lustre.pool_134.lustre-OST0001_UUID 00000020:00000080:1.0:1784189263.746911:0:93131:0:(obd_config.c:1470:class_process_config()) processing cmd: ce021 00020000:01000000:1.0:1784189263.746929:0:93131:0:(lod_pool.c:594:lod_pool_add()) Added lustre-OST0001_UUID to pool_134 as member 1 00000100:00100000:1.0:1784189263.748000:0:93131:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf470e1f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bd553d0d-03e2-4233-b06b-b55bbfa2b954:93131:1870854458193408:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1784189263.748076:0:93131:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:01000004:3.0:1784189263.748156:0:93132:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9dbf46b0a800 from lustre-MDT0000, refs=4 00000020:01000004:3.0:1784189263.748160:0:93132:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9dbf46b0a800 4 00000100:00100000:1.0:1784189263.748403:0:93131:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dc05a5b13c0 going to sleep for 11 seconds 00000100:00100000:3.0:1784189263.748735:0:92396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458193408 00000100:00100000:3.0:1784189263.748741:0:92396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458193408 00000100:00100000:3.0:1784189263.748793:0:92396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:3.0:1784189263.748802:0:92396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf4a37c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd553d0d-03e2-4233-b06b-b55bbfa2b954+17:93131:x1870854458193408:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1784189263.748924:0:92396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf4a37c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd553d0d-03e2-4233-b06b-b55bbfa2b954+17:93131:x1870854458193408:12345-0@lo:502:llog_process_th.0 Request processed in 123us (847us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189263.748933:0:92396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:1.0:1784189263.750447:0:93131:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf470e1f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bd553d0d-03e2-4233-b06b-b55bbfa2b954:93131:1870854458193408:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1784189263.750718:0:93131:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1784189263.750729:0:93131:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784189263.750731:0:93131:0:(obd_config.c:1561:class_process_config()) marker 46 (0x2) lustre-MDT0000-m add lustre.pool_134.lustre-OST0001_UUID 00000040:00080000:0.0:1784189263.750737:0:93131:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 53 count 52 00000020:01000000:1.0:1784189263.750963:0:6510:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 50-52 (rc=0) 10000000:01000000:1.0:1784189263.750987:0:6510:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1784189263.750997:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff9dbf4710e400/0xcc1762b626f8c263 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc1762b626f8c26a expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189263.751070:0:6510:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: ffff9dbf4710e400/0xcc1762b626f8c263 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc1762b626f8c26a expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784189263.751194:0:6510:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1784189263.751197:0:6510:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9dbf44675800 from 55 10000000:01000000:0.0:1784189263.751200:0:6510:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1784189263.751235:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff9dc04152da00/0xcc1762b626f8c271 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189263.751243:0:6510:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: ffff9dc04152da00/0xcc1762b626f8c271 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189263.751251:0:6510:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: ffff9dc04152da00/0xcc1762b626f8c271 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784189263.751271:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc050543480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458193536:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1784189263.751428:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784189263.751508:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dc07569f840 going to sleep for 11 seconds 00000100:00100000:1.0:1784189263.751543:0:92398:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458193536 00000100:00100000:1.0:1784189263.751548:0:92398:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458193536 00000100:00100000:1.0:1784189263.752364:0:92398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:1.0:1784189263.752375:0:92398:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf4a37f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd553d0d-03e2-4233-b06b-b55bbfa2b954+17:6510:x1870854458193536:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784189263.752390:0:92398:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784189263.752405:0:92398:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dbf4710fe00/0xcc1762b626f8c278 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xcc1762b626f8c271 expref: -99 pid: 92398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189263.752429:0:92398:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dbf4710fe00/0xcc1762b626f8c278 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcc1762b626f8c271 expref: 18 pid: 92398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189263.752439:0:92398:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dbf4710fe00/0xcc1762b626f8c278 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcc1762b626f8c271 expref: 18 pid: 92398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189263.752474:0:92398:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dbf4710fe00, rc 0) 00000100:00100000:1.0:1784189263.752528:0:92398:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf4a37f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd553d0d-03e2-4233-b06b-b55bbfa2b954+18:6510:x1870854458193536:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 155us (1100us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189263.752535:0:92398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:0.0:1784189263.752642:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc050543480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458193536:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784189263.752658:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: ffff9dc04152da00/0xcc1762b626f8c271 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc1762b626f8c278 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189263.752673:0:6510:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: ffff9dc04152da00/0xcc1762b626f8c271 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xcc1762b626f8c278 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784189263.752837:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc050543480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458193664:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1784189263.752865:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784189263.753111:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dc07569f840 going to sleep for 11 seconds 00000100:00100000:3.0:1784189263.753222:0:92396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458193664 00000100:00100000:3.0:1784189263.753228:0:92396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458193664 00000100:00100000:3.0:1784189263.753255:0:92396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:3.0:1784189263.753261:0:92396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf4a37fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd553d0d-03e2-4233-b06b-b55bbfa2b954+18:6510:x1870854458193664:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784189263.753401:0:92396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf4a37fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd553d0d-03e2-4233-b06b-b55bbfa2b954+18:6510:x1870854458193664:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 139us (534us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189263.753408:0:92396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:0.0:1784189263.753548:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc050543480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458193664:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1784189263.753579:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc050543480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458193792:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1784189263.753798:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784189263.753823:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dc07569f840 going to sleep for 11 seconds 00000100:00100000:3.0:1784189263.753857:0:92396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458193792 00000100:00100000:3.0:1784189263.753861:0:92396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458193792 00000100:00100000:3.0:1784189263.753924:0:92396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:3.0:1784189263.753931:0:92396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf4a37f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd553d0d-03e2-4233-b06b-b55bbfa2b954+18:6510:x1870854458193792:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1784189263.754159:0:92396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf4a37f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd553d0d-03e2-4233-b06b-b55bbfa2b954+18:6510:x1870854458193792:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 228us (360us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189263.754166:0:92396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:0.0:1784189263.754273:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc050543480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458193792:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1784189263.754711:0:93133:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc050543480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bd553d0d-03e2-4233-b06b-b55bbfa2b954:93133:1870854458193920:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1784189263.754750:0:93133:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784189263.754776:0:93133:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dc07569f9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1784189263.754821:0:92398:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458193920 00000100:00100000:1.0:1784189263.754826:0:92398:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458193920 00000100:00100000:1.0:1784189263.754859:0:92398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:1.0:1784189263.754867:0:92398:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf456b1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd553d0d-03e2-4233-b06b-b55bbfa2b954+18:93133:x1870854458193920:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1784189263.754958:0:92398:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf456b1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd553d0d-03e2-4233-b06b-b55bbfa2b954+18:93133:x1870854458193920:12345-0@lo:502:llog_process_th.0 Request processed in 92us (207us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189263.754965:0:92398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:0.0:1784189263.755117:0:93133:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc050543480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bd553d0d-03e2-4233-b06b-b55bbfa2b954:93133:1870854458193920:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1784189263.755155:0:93133:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc050543480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bd553d0d-03e2-4233-b06b-b55bbfa2b954:93133:1870854458194048:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1784189263.755185:0:93133:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784189263.755202:0:93133:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dc07569f9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1784189263.755246:0:92398:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458194048 00000100:00100000:1.0:1784189263.755250:0:92398:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458194048 00000100:00100000:1.0:1784189263.755278:0:92398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:1.0:1784189263.755283:0:92398:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf4a37e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd553d0d-03e2-4233-b06b-b55bbfa2b954+18:93133:x1870854458194048:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1784189263.755373:0:92398:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf4a37e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd553d0d-03e2-4233-b06b-b55bbfa2b954+18:93133:x1870854458194048:12345-0@lo:502:llog_process_th.0 Request processed in 88us (187us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189263.755380:0:92398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:0.0:1784189263.755550:0:93133:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc050543480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bd553d0d-03e2-4233-b06b-b55bbfa2b954:93133:1870854458194048:0@lo:502:llog_process_th.0 00000040:00080000:0.0:1784189263.755568:0:93133:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 58 count 57 00000020:01000000:1.0:1784189263.755762:0:6510:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 55-57 (rc=0) 10000000:01000000:1.0:1784189263.755782:0:6510:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1784189263.755791:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff9dc04152da00/0xcc1762b626f8c271 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc1762b626f8c278 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189263.755801:0:6510:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: ffff9dc04152da00/0xcc1762b626f8c271 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc1762b626f8c278 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784189263.755821:0:6510:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:1.0:1784189263.755823:0:6510:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 50 10000000:01000000:1.0:1784189263.755825:0:6510:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:1.0:1784189263.755848:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff9dbf4710fc00/0xcc1762b626f8c27f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189263.755854:0:6510:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: ffff9dbf4710fc00/0xcc1762b626f8c27f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189263.755862:0:6510:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: ffff9dbf4710fc00/0xcc1762b626f8c27f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784189263.755874:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf470e1f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458194176:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1784189263.755900:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784189263.755928:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dbf4535af00 going to sleep for 11 seconds 00000100:00100000:0.0:1784189263.756082:0:92398:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458194176 00000100:00100000:0.0:1784189263.756086:0:92398:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458194176 00000100:00100000:0.0:1784189263.756115:0:92398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:0.0:1784189263.756130:0:92398:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf4a37d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd553d0d-03e2-4233-b06b-b55bbfa2b954+18:6510:x1870854458194176:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784189263.756139:0:92398:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784189263.756150:0:92398:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dc04152ca00/0xcc1762b626f8c286 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xcc1762b626f8c27f expref: -99 pid: 92398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189263.756171:0:92398:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dc04152ca00/0xcc1762b626f8c286 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcc1762b626f8c27f expref: 19 pid: 92398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189263.756180:0:92398:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dc04152ca00/0xcc1762b626f8c286 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcc1762b626f8c27f expref: 19 pid: 92398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189263.756189:0:92398:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc04152ca00, rc 0) 00000100:00100000:0.0:1784189263.756224:0:92398:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf4a37d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd553d0d-03e2-4233-b06b-b55bbfa2b954+19:6510:x1870854458194176:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 96us (322us total) trans 0 rc 0/0 00000100:00100000:0.0:1784189263.756230:0:92398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:1.0:1784189263.756511:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf470e1f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458194176:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784189263.756524:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: ffff9dbf4710fc00/0xcc1762b626f8c27f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc1762b626f8c286 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189263.756533:0:6510:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: ffff9dbf4710fc00/0xcc1762b626f8c27f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xcc1762b626f8c286 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784189263.756583:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf470e1f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458194304:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1784189263.756608:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784189263.756645:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dbf4535af00 going to sleep for 11 seconds 00000100:00100000:0.0:1784189263.756746:0:92398:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458194304 00000100:00100000:0.0:1784189263.756750:0:92398:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458194304 00000100:00100000:0.0:1784189263.756787:0:92398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:0.0:1784189263.756792:0:92398:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf4a37c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd553d0d-03e2-4233-b06b-b55bbfa2b954+19:6510:x1870854458194304:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1784189263.756936:0:92398:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf4a37c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd553d0d-03e2-4233-b06b-b55bbfa2b954+19:6510:x1870854458194304:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 143us (325us total) trans 0 rc 0/0 00000100:00100000:0.0:1784189263.756946:0:92398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:1.0:1784189263.757093:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf470e1f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458194304:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1784189263.757119:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf470e1f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458194432:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1784189263.757176:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784189263.757194:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dbf4535af00 going to sleep for 11 seconds 00000100:00100000:0.0:1784189263.757275:0:92397:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458194432 00000100:00100000:0.0:1784189263.757279:0:92397:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458194432 00000100:00100000:0.0:1784189263.757306:0:92397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:0.0:1784189263.757312:0:92397:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf4a37f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd553d0d-03e2-4233-b06b-b55bbfa2b954+19:6510:x1870854458194432:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1784189263.757847:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf470e1f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458194432:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1784189263.758273:0:93134:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc07016df80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bd553d0d-03e2-4233-b06b-b55bbfa2b954:93134:1870854458194560:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1784189263.758315:0:93134:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784189263.758375:0:93134:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dbf464c2300 going to sleep for 11 seconds 00000100:00100000:0.0:1784189263.759436:0:92397:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf4a37f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd553d0d-03e2-4233-b06b-b55bbfa2b954+19:6510:x1870854458194432:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 244us (382us total) trans 0 rc 0/0 00000100:00100000:0.0:1784189263.759472:0:92397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:0.0:1784189263.759526:0:92397:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458194560 00000100:00100000:0.0:1784189263.759534:0:92397:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458194560 00000100:00100000:0.0:1784189263.759564:0:92397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:0.0:1784189263.759571:0:92397:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf43728450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd553d0d-03e2-4233-b06b-b55bbfa2b954+19:93134:x1870854458194560:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1784189263.760758:0:92397:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf43728450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd553d0d-03e2-4233-b06b-b55bbfa2b954+19:93134:x1870854458194560:12345-0@lo:502:llog_process_th.0 Request processed in 1180us (2435us total) trans 0 rc 0/0 00000100:00100000:0.0:1784189263.760767:0:92397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:2.0:1784189263.770211:0:93134:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc07016df80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bd553d0d-03e2-4233-b06b-b55bbfa2b954:93134:1870854458194560:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1784189263.771201:0:93134:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1784189263.771219:0:93134:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784189263.771222:0:93134:0:(obd_config.c:1561:class_process_config()) marker 47 (0x1) lustre-MDT0001-m add lustre.pool_134.lustre-OST0001_UUID 00000020:00000080:3.0:1784189263.771232:0:93134:0:(obd_config.c:1470:class_process_config()) processing cmd: ce021 00020000:01000000:3.0:1784189263.771248:0:93134:0:(lod_pool.c:594:lod_pool_add()) Added lustre-OST0001_UUID to pool_134 as member 1 00000100:00100000:3.0:1784189263.771295:0:93134:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc056477480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bd553d0d-03e2-4233-b06b-b55bbfa2b954:93134:1870854458194688:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1784189263.771801:0:93134:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784189263.771843:0:93134:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dc048b2d840 going to sleep for 11 seconds 00000100:00100000:1.0:1784189263.771922:0:92398:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458194688 00000100:00100000:1.0:1784189263.771929:0:92398:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458194688 00000100:00100000:1.0:1784189263.771987:0:92398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:1.0:1784189263.771995:0:92398:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf43729850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd553d0d-03e2-4233-b06b-b55bbfa2b954+19:93134:x1870854458194688:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1784189263.772142:0:92398:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf43729850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd553d0d-03e2-4233-b06b-b55bbfa2b954+19:93134:x1870854458194688:12345-0@lo:502:llog_process_th.0 Request processed in 147us (341us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189263.772150:0:92398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:2.0:1784189263.772300:0:93134:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc056477480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bd553d0d-03e2-4233-b06b-b55bbfa2b954:93134:1870854458194688:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1784189263.772345:0:93134:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1784189263.772351:0:93134:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784189263.772353:0:93134:0:(obd_config.c:1561:class_process_config()) marker 47 (0x2) lustre-MDT0001-m add lustre.pool_134.lustre-OST0001_UUID 00000040:00080000:2.0:1784189263.772366:0:93134:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 53 count 52 00000020:01000000:1.0:1784189263.772932:0:6510:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 50-52 (rc=0) 10000000:01000000:1.0:1784189263.772970:0:6510:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:1.0:1784189263.772979:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff9dbf4710fc00/0xcc1762b626f8c27f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc1762b626f8c286 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189263.772991:0:6510:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: ffff9dbf4710fc00/0xcc1762b626f8c27f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc1762b626f8c286 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784189263.773114:0:6510:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1784189263.773117:0:6510:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9dbf425f7000 from 55 10000000:01000000:1.0:1784189263.773121:0:6510:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1784189263.773150:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff9dbf4710e800/0xcc1762b626f8c28d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189263.773158:0:6510:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: ffff9dbf4710e800/0xcc1762b626f8c28d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189263.773167:0:6510:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: ffff9dbf4710e800/0xcc1762b626f8c28d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784189263.773197:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf470e1f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458194816:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1784189263.773239:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784189263.773309:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dbf4535ac00 going to sleep for 11 seconds 00000100:00100000:2.0:1784189263.774288:0:92397:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458194816 00000100:00100000:2.0:1784189263.774298:0:92397:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458194816 00000100:00100000:2.0:1784189263.774417:0:92397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:2.0:1784189263.774428:0:92397:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf43729450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd553d0d-03e2-4233-b06b-b55bbfa2b954+19:6510:x1870854458194816:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1784189263.774441:0:92397:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784189263.774467:0:92397:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dc04a20ac00/0xcc1762b626f8c294 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xcc1762b626f8c28d expref: -99 pid: 92397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189263.774492:0:92397:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dc04a20ac00/0xcc1762b626f8c294 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcc1762b626f8c28d expref: 20 pid: 92397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189263.774503:0:92397:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dc04a20ac00/0xcc1762b626f8c294 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcc1762b626f8c28d expref: 20 pid: 92397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189263.774533:0:92397:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc04a20ac00, rc 0) 00000100:00100000:2.0:1784189263.774595:0:92397:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf43729450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd553d0d-03e2-4233-b06b-b55bbfa2b954+20:6510:x1870854458194816:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 170us (1355us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189263.774602:0:92397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:0.0:1784189263.776698:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf470e1f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458194816:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784189263.776728:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: ffff9dbf4710e800/0xcc1762b626f8c28d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc1762b626f8c294 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189263.776740:0:6510:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: ffff9dbf4710e800/0xcc1762b626f8c28d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xcc1762b626f8c294 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784189263.776825:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc050543480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458194944:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1784189263.776878:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784189263.776908:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dc07569f840 going to sleep for 11 seconds 00000100:00100000:3.0:1784189263.776969:0:92396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458194944 00000100:00100000:3.0:1784189263.776975:0:92396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458194944 00000100:00100000:3.0:1784189263.777010:0:92396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:3.0:1784189263.777018:0:92396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf4372b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd553d0d-03e2-4233-b06b-b55bbfa2b954+20:6510:x1870854458194944:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784189263.777189:0:92396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf4372b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd553d0d-03e2-4233-b06b-b55bbfa2b954+20:6510:x1870854458194944:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 158us (297us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189263.777198:0:92396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:0.0:1784189263.777600:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc050543480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458194944:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1784189263.777633:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc050543480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458195072:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1784189263.777679:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784189263.777701:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dc07569f840 going to sleep for 11 seconds 00000100:00100000:1.0:1784189263.777790:0:92398:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458195072 00000100:00100000:1.0:1784189263.777796:0:92398:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458195072 00000100:00100000:1.0:1784189263.777894:0:92398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1784189263.777901:0:92398:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf4372a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd553d0d-03e2-4233-b06b-b55bbfa2b954+20:6510:x1870854458195072:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1784189263.777988:0:92398:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf4372a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd553d0d-03e2-4233-b06b-b55bbfa2b954+20:6510:x1870854458195072:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 87us (308us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189263.777995:0:92398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:0.0:1784189263.778061:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc050543480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458195072:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1784189263.779092:0:93135:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc050543480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bd553d0d-03e2-4233-b06b-b55bbfa2b954:93135:1870854458195200:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1784189263.779153:0:93135:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784189263.779195:0:92396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458195200 00000100:00100000:3.0:1784189263.779201:0:92396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458195200 00000100:00100000:3.0:1784189263.779240:0:92396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:3.0:1784189263.779248:0:92396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf43728c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd553d0d-03e2-4233-b06b-b55bbfa2b954+20:93135:x1870854458195200:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1784189263.779353:0:92396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf43728c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd553d0d-03e2-4233-b06b-b55bbfa2b954+20:93135:x1870854458195200:12345-0@lo:502:llog_process_th.0 Request processed in 106us (199us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189263.779369:0:92396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1784189263.779607:0:93135:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dc07569f840 going to sleep for 11 seconds 00000100:00100000:0.0:1784189263.779628:0:93135:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc050543480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bd553d0d-03e2-4233-b06b-b55bbfa2b954:93135:1870854458195200:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1784189263.779669:0:93135:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc050543480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bd553d0d-03e2-4233-b06b-b55bbfa2b954:93135:1870854458195328:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1784189263.779702:0:93135:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784189263.779767:0:93135:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dc0467bd3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1784189263.783766:0:92397:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458195328 00000100:00100000:2.0:1784189263.783780:0:92397:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458195328 00000100:00100000:2.0:1784189263.783847:0:92397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:2.0:1784189263.783858:0:92397:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf43729050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd553d0d-03e2-4233-b06b-b55bbfa2b954+20:93135:x1870854458195328:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1784189263.784024:0:92397:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf43729050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd553d0d-03e2-4233-b06b-b55bbfa2b954+20:93135:x1870854458195328:12345-0@lo:502:llog_process_th.0 Request processed in 168us (4321us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189263.784032:0:92397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:0.0:1784189263.784300:0:93135:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc050543480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bd553d0d-03e2-4233-b06b-b55bbfa2b954:93135:1870854458195328:0@lo:502:llog_process_th.0 00000040:00080000:0.0:1784189263.784571:0:93135:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 58 count 57 00000020:01000000:1.0:1784189263.784736:0:6510:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 55-57 (rc=0) 10000000:01000000:1.0:1784189263.784758:0:6510:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1784189263.784768:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff9dbf4710e800/0xcc1762b626f8c28d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc1762b626f8c294 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189263.784778:0:6510:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: ffff9dbf4710e800/0xcc1762b626f8c28d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc1762b626f8c294 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784189263.784786:0:6510:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:1.0:1784189263.784789:0:6510:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 11 10000000:01000000:1.0:1784189263.784791:0:6510:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:1.0:1784189263.784822:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff9dbf4710f200/0xcc1762b626f8c29b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189263.784828:0:6510:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: ffff9dbf4710f200/0xcc1762b626f8c29b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189263.784837:0:6510:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: ffff9dbf4710f200/0xcc1762b626f8c29b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784189263.784867:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf470e0380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458195456:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1784189263.784906:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784189263.784941:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dbf4535ac00 going to sleep for 11 seconds 00000100:00100000:3.0:1784189263.784992:0:92396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458195456 00000100:00100000:3.0:1784189263.784997:0:92396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458195456 00000100:00100000:3.0:1784189263.785029:0:92396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:3.0:1784189263.785036:0:92396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf43728050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd553d0d-03e2-4233-b06b-b55bbfa2b954+20:6510:x1870854458195456:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784189263.785045:0:92396:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784189263.785062:0:92396:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dbf4369d200/0xcc1762b626f8c2a2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xcc1762b626f8c29b expref: -99 pid: 92396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189263.785083:0:92396:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dbf4369d200/0xcc1762b626f8c2a2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcc1762b626f8c29b expref: 21 pid: 92396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189263.785093:0:92396:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dbf4369d200/0xcc1762b626f8c2a2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcc1762b626f8c29b expref: 21 pid: 92396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189263.785102:0:92396:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dbf4369d200, rc 0) 00000100:00100000:3.0:1784189263.785139:0:92396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf43728050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd553d0d-03e2-4233-b06b-b55bbfa2b954+21:6510:x1870854458195456:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 103us (232us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189263.785145:0:92396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:1.0:1784189263.785293:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf470e0380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458195456:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784189263.785306:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: ffff9dbf4710f200/0xcc1762b626f8c29b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc1762b626f8c2a2 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189263.785314:0:6510:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: ffff9dbf4710f200/0xcc1762b626f8c29b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xcc1762b626f8c2a2 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784189263.785745:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf470e0380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458195584:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1784189263.785776:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784189263.785794:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dbf4535ac00 going to sleep for 11 seconds 00000100:00100000:0.0:1784189263.785870:0:92398:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458195584 00000100:00100000:0.0:1784189263.785874:0:92398:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458195584 00000100:00100000:0.0:1784189263.785905:0:92398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:0.0:1784189263.785912:0:92398:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf4372a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd553d0d-03e2-4233-b06b-b55bbfa2b954+21:6510:x1870854458195584:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1784189263.786028:0:92398:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf4372a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd553d0d-03e2-4233-b06b-b55bbfa2b954+21:6510:x1870854458195584:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 117us (251us total) trans 0 rc 0/0 00000100:00100000:0.0:1784189263.786034:0:92398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:1.0:1784189263.786103:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf470e0380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458195584:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1784189263.786130:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf470e0380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458195712:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1784189263.786163:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784189263.786199:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dbf4535ac00 going to sleep for 11 seconds 00000100:00100000:2.0:1784189263.786340:0:92397:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458195712 00000100:00100000:2.0:1784189263.786344:0:92397:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458195712 00000100:00100000:2.0:1784189263.786366:0:92397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:2.0:1784189263.786372:0:92397:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf4372b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd553d0d-03e2-4233-b06b-b55bbfa2b954+21:6510:x1870854458195712:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1784189263.786472:0:92397:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf4372b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd553d0d-03e2-4233-b06b-b55bbfa2b954+21:6510:x1870854458195712:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 99us (307us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189263.786479:0:92397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1784189263.786609:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf470e0380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458195712:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1784189263.788802:0:93136:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 64768 count 11 00000020:01000000:1.0:1784189263.789058:0:6510:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 11-10 (rc=0) 10000000:01000000:1.0:1784189263.789082:0:6510:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:1.0:1784189263.789093:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff9dbf4710f200/0xcc1762b626f8c29b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc1762b626f8c2a2 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189263.789103:0:6510:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: ffff9dbf4710f200/0xcc1762b626f8c29b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc1762b626f8c2a2 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784189263.789127:0:6510:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1784189263.789130:0:6510:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9dc07b5d6800 from 55 10000000:01000000:1.0:1784189263.789132:0:6510:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1784189263.789166:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff9dbf4710f000/0xcc1762b626f8c2a9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189263.789172:0:6510:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: ffff9dbf4710f000/0xcc1762b626f8c2a9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189263.789192:0:6510:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: ffff9dbf4710f000/0xcc1762b626f8c2a9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784189263.789215:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf470e0380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458195840:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1784189263.789271:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784189263.789315:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dc074ae8300 going to sleep for 11 seconds 00000100:00100000:3.0:1784189263.789651:0:92397:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458195840 00000100:00100000:3.0:1784189263.789659:0:92397:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458195840 00000100:00100000:3.0:1784189263.789706:0:92397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:3.0:1784189263.789715:0:92397:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf4372bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd553d0d-03e2-4233-b06b-b55bbfa2b954+21:6510:x1870854458195840:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784189263.789727:0:92397:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784189263.789738:0:92397:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dbf4369c000/0xcc1762b626f8c2b0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xcc1762b626f8c2a9 expref: -99 pid: 92397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189263.789760:0:92397:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dbf4369c000/0xcc1762b626f8c2b0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcc1762b626f8c2a9 expref: 22 pid: 92397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189263.789769:0:92397:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dbf4369c000/0xcc1762b626f8c2b0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcc1762b626f8c2a9 expref: 22 pid: 92397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189263.789776:0:92397:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dbf4369c000, rc 0) 00000100:00100000:3.0:1784189263.789818:0:92397:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf4372bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd553d0d-03e2-4233-b06b-b55bbfa2b954+22:6510:x1870854458195840:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 104us (547us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189263.789835:0:92397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1784189263.789942:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf470e0380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458195840:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784189263.789955:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: ffff9dbf4710f000/0xcc1762b626f8c2a9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc1762b626f8c2b0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189263.789964:0:6510:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: ffff9dbf4710f000/0xcc1762b626f8c2a9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xcc1762b626f8c2b0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784189263.790016:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf470e0380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458195968:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1784189263.790043:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784189263.790069:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dc074ae8300 going to sleep for 11 seconds 00000100:00100000:3.0:1784189263.790115:0:92396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458195968 00000100:00100000:3.0:1784189263.790119:0:92396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458195968 00000100:00100000:3.0:1784189263.790149:0:92396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:3.0:1784189263.790155:0:92396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf4372ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd553d0d-03e2-4233-b06b-b55bbfa2b954+22:6510:x1870854458195968:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784189263.790270:0:92396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf4372ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd553d0d-03e2-4233-b06b-b55bbfa2b954+22:6510:x1870854458195968:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 114us (225us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189263.790277:0:92396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:1.0:1784189263.790640:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf470e0380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458195968:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1784189263.790671:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf470e0380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458196096:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1784189263.790718:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784189263.790777:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dc074ae8300 going to sleep for 11 seconds 00000100:00100000:0.0:1784189263.790990:0:92398:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458196096 00000100:00100000:0.0:1784189263.790995:0:92398:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458196096 00000100:00100000:0.0:1784189263.791063:0:92398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1784189263.791071:0:92398:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf43728850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd553d0d-03e2-4233-b06b-b55bbfa2b954+22:6510:x1870854458196096:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1784189263.791161:0:92398:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf43728850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd553d0d-03e2-4233-b06b-b55bbfa2b954+22:6510:x1870854458196096:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 90us (440us total) trans 0 rc 0/0 00000100:00100000:0.0:1784189263.791168:0:92398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:1.0:1784189263.791249:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf470e0380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458196096:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1784189263.791842:0:93137:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf470e0380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bd553d0d-03e2-4233-b06b-b55bbfa2b954:93137:1870854458196224:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1784189263.791879:0:93137:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784189263.792089:0:93137:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dc074ae8540 going to sleep for 11 seconds 00000100:00100000:3.0:1784189263.792166:0:92396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458196224 00000100:00100000:3.0:1784189263.792174:0:92396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458196224 00000100:00100000:3.0:1784189263.792200:0:92396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1784189263.792207:0:92396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf43729c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd553d0d-03e2-4233-b06b-b55bbfa2b954+22:93137:x1870854458196224:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1784189263.792302:0:92396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf43729c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd553d0d-03e2-4233-b06b-b55bbfa2b954+22:93137:x1870854458196224:12345-0@lo:502:llog_process_th.0 Request processed in 95us (422us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189263.792310:0:92396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:1.0:1784189263.792609:0:93137:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf470e0380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bd553d0d-03e2-4233-b06b-b55bbfa2b954:93137:1870854458196224:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1784189263.792651:0:93137:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf470e0380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bd553d0d-03e2-4233-b06b-b55bbfa2b954:93137:1870854458196352:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1784189263.792683:0:93137:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784189263.792709:0:93137:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dc074ae8540 going to sleep for 11 seconds 00000100:00100000:3.0:1784189263.792755:0:92396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458196352 00000100:00100000:3.0:1784189263.792759:0:92396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458196352 00000100:00100000:3.0:1784189263.792777:0:92396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:3.0:1784189263.792782:0:92396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf4a252850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd553d0d-03e2-4233-b06b-b55bbfa2b954+22:93137:x1870854458196352:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1784189263.792862:0:92396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf4a252850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd553d0d-03e2-4233-b06b-b55bbfa2b954+22:93137:x1870854458196352:12345-0@lo:502:llog_process_th.0 Request processed in 78us (177us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189263.792869:0:92396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1784189263.792938:0:93137:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf470e0380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bd553d0d-03e2-4233-b06b-b55bbfa2b954:93137:1870854458196352:0@lo:502:llog_process_th.0 00000040:00080000:1.0:1784189263.792956:0:93137:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 58 count 57 00000020:01000000:3.0:1784189263.793179:0:6510:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 55-57 (rc=0) 10000000:01000000:3.0:1784189263.793200:0:6510:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1784189263.793209:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff9dbf4710f000/0xcc1762b626f8c2a9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc1762b626f8c2b0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189263.793225:0:6510:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: ffff9dbf4710f000/0xcc1762b626f8c2a9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc1762b626f8c2b0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784189263.793233:0:6510:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:3.0:1784189263.793235:0:6510:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 14 10000000:01000000:3.0:1784189263.793238:0:6510:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:3.0:1784189263.793261:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff9dbf4369d600/0xcc1762b626f8c2b7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189263.793268:0:6510:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: ffff9dbf4369d600/0xcc1762b626f8c2b7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189263.793276:0:6510:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: ffff9dbf4369d600/0xcc1762b626f8c2b7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784189263.793289:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc056477480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458196480:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1784189263.793315:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784189263.793667:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dc05876d000 going to sleep for 11 seconds 00000100:00100000:0.0:1784189263.793710:0:92396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458196480 00000100:00100000:0.0:1784189263.793715:0:92396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458196480 00000100:00100000:0.0:1784189263.793783:0:92396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:0.0:1784189263.793790:0:92396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf4a252450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd553d0d-03e2-4233-b06b-b55bbfa2b954+22:6510:x1870854458196480:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784189263.793800:0:92396:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784189263.793813:0:92396:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dc04152d000/0xcc1762b626f8c2be lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xcc1762b626f8c2b7 expref: -99 pid: 92396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189263.793833:0:92396:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dc04152d000/0xcc1762b626f8c2be lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcc1762b626f8c2b7 expref: 23 pid: 92396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189263.793842:0:92396:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dc04152d000/0xcc1762b626f8c2be lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcc1762b626f8c2b7 expref: 23 pid: 92396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189263.793849:0:92396:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc04152d000, rc 0) 00000100:00100000:0.0:1784189263.793886:0:92396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf4a252450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd553d0d-03e2-4233-b06b-b55bbfa2b954+23:6510:x1870854458196480:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 97us (570us total) trans 0 rc 0/0 00000100:00100000:0.0:1784189263.793892:0:92396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:3.0:1784189263.793952:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc056477480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458196480:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784189263.793966:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: ffff9dbf4369d600/0xcc1762b626f8c2b7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc1762b626f8c2be expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189263.793975:0:6510:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: ffff9dbf4369d600/0xcc1762b626f8c2b7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0xcc1762b626f8c2be expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784189263.794025:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc056477480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458196608:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784189263.794050:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784189263.794215:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dc05876d000 going to sleep for 11 seconds 00000100:00100000:2.0:1784189263.794255:0:92397:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458196608 00000100:00100000:2.0:1784189263.794259:0:92397:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458196608 00000100:00100000:0.0:1784189263.794891:0:92396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1784189263.794900:0:92396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf4a252c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd553d0d-03e2-4233-b06b-b55bbfa2b954+23:6510:x1870854458196608:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1784189263.795027:0:92396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf4a252c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd553d0d-03e2-4233-b06b-b55bbfa2b954+23:6510:x1870854458196608:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 128us (976us total) trans 0 rc 0/0 00000100:00100000:0.0:1784189263.795034:0:92396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:3.0:1784189263.795105:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc056477480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458196608:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784189263.795139:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc056477480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458196736:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1784189263.795181:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784189263.795199:0:92398:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458196736 00000100:00100000:3.0:1784189263.795203:0:92398:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458196736 00000100:00100000:3.0:1784189263.795222:0:92398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:3.0:1784189263.795228:0:92398:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf4a251050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd553d0d-03e2-4233-b06b-b55bbfa2b954+23:6510:x1870854458196736:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1784189263.795302:0:92398:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf4a251050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd553d0d-03e2-4233-b06b-b55bbfa2b954+23:6510:x1870854458196736:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 74us (120us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189263.795309:0:92398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:3.0:1784189263.795382:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dc05876d000 going to sleep for 11 seconds 00000100:00100000:3.0:1784189263.795394:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc056477480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458196736:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1784189263.796692:0:93138:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 64768 count 14 00000020:01000000:3.0:1784189263.796839:0:6510:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 14-13 (rc=0) 10000000:01000000:3.0:1784189263.796859:0:6510:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:3.0:1784189263.796868:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff9dbf4369d600/0xcc1762b626f8c2b7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc1762b626f8c2be expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189263.796879:0:6510:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: ffff9dbf4369d600/0xcc1762b626f8c2b7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc1762b626f8c2be expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784189263.796889:0:6510:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:3.0:1784189263.796891:0:6510:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-sptlrpc-ffff9dc06bb30000 from 1 10000000:01000000:3.0:1784189263.796893:0:6510:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1784189263.796924:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff9dbf4369da00/0xcc1762b626f8c2c5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189263.796933:0:6510:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: ffff9dbf4369da00/0xcc1762b626f8c2c5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189263.796953:0:6510:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: ffff9dbf4369da00/0xcc1762b626f8c2c5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784189263.796973:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc056477480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458196864:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1784189263.797022:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784189263.797058:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dc05876d000 going to sleep for 11 seconds 00000100:00100000:2.0:1784189263.797110:0:92398:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458196864 00000100:00100000:2.0:1784189263.797116:0:92398:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458196864 00000100:00100000:2.0:1784189263.797145:0:92398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:2.0:1784189263.797153:0:92398:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf4a250850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd553d0d-03e2-4233-b06b-b55bbfa2b954+23:6510:x1870854458196864:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1784189263.797163:0:92398:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784189263.797181:0:92398:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dc04a20a600/0xcc1762b626f8c2cc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xcc1762b626f8c2c5 expref: -99 pid: 92398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189263.797205:0:92398:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dc04a20a600/0xcc1762b626f8c2cc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcc1762b626f8c2c5 expref: 24 pid: 92398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189263.797215:0:92398:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dc04a20a600/0xcc1762b626f8c2cc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcc1762b626f8c2c5 expref: 24 pid: 92398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189263.797224:0:92398:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc04a20a600, rc 0) 00000100:00100000:2.0:1784189263.797265:0:92398:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf4a250850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd553d0d-03e2-4233-b06b-b55bbfa2b954+24:6510:x1870854458196864:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 112us (242us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189263.797271:0:92398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:3.0:1784189263.797520:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc056477480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458196864:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784189263.797534:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: ffff9dbf4369da00/0xcc1762b626f8c2c5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc1762b626f8c2cc expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189263.797542:0:6510:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: ffff9dbf4369da00/0xcc1762b626f8c2c5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0xcc1762b626f8c2cc expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784189263.797589:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc056477480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458196992:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784189263.797615:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784189263.797635:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dc05876d000 going to sleep for 11 seconds 00000100:00100000:2.0:1784189263.797698:0:92398:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458196992 00000100:00100000:2.0:1784189263.797702:0:92398:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458196992 00000100:00100000:2.0:1784189263.797720:0:92398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:2.0:1784189263.797724:0:92398:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf4a253450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd553d0d-03e2-4233-b06b-b55bbfa2b954+24:6510:x1870854458196992:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1784189263.797782:0:92398:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf4a253450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd553d0d-03e2-4233-b06b-b55bbfa2b954+24:6510:x1870854458196992:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 56us (165us total) trans 0 rc -2/-2 00000100:00100000:2.0:1784189263.797788:0:92398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:3.0:1784189263.797849:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc056477480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458196992:0@lo:501:ll_cfg_requeue.0 10000000:01000000:3.0:1784189263.797869:0:6510:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1784189263.797874:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff9dbf4369da00/0xcc1762b626f8c2c5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc1762b626f8c2cc expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189263.797881:0:6510:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: ffff9dbf4369da00/0xcc1762b626f8c2c5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc1762b626f8c2cc expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784189263.919580:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1784189263.919603:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc056477480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1870854458197120:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1784189263.919669:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784189263.919884:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf470e0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1870854458197248:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1784189263.919911:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784189263.919993:0:9466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458197120 00000100:00100000:1.0:1784189263.920001:0:9466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458197120 00000100:00100000:1.0:1784189263.920059:0:9466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458197248 00000100:00100000:1.0:1784189263.920063:0:9466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458197248 00000100:00100000:1.0:1784189263.920083:0:9466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2022 00000100:00100000:1.0:1784189263.920091:0:9466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc050543480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1870854458197120:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1784189263.920130:0:9466:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8647872 pending 0 free 3922481152 avail 3690958848 00000100:00100000:1.0:1784189263.920175:0:9466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc050543480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1870854458197120:12345-0@lo:13:osp-pre-0-1.0 Request processed in 84us (505us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189263.920182:0:9466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2022 00000100:00100000:1.0:1784189263.920198:0:9466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2023 00000100:00100000:1.0:1784189263.920204:0:9466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc050541c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1870854458197248:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1784189263.920234:0:9466:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 210112 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1784189263.920265:0:9466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc050541c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1870854458197248:12345-0@lo:13:osp-pre-1-1.0 Request processed in 61us (353us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189263.920271:0:9466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2023 00000100:00100000:1.0:1784189263.920429:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf470e0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1870854458197248:0@lo:13:osp-pre-1-1.0 00000100:00080000:0.0:1784189263.920547:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1784189263.920557:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1784189263.922731:0:3642:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294968955 gen 2 00000004:00080000:3.0:1784189263.922742:0:3642:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9dbf46957800, transno 4294968955 00000100:00100000:3.0:1784189263.922786:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc056477480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1870854458197120:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1784189264.231244:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1784189264.231355:0:92398:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436309376 00000100:00100000:0.0:1784189264.231366:0:92398:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436309376 00000100:00100000:0.0:1784189264.231433:0:92398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 161 00000100:00100000:0.0:1784189264.231444:0:92398:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf4a251850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:60f345e3-c70e-4f53-b5e7-c9671463c9a5+8:70943:x1870854436309376:12345-192.168.203.12@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784189264.231475:0:92398:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784189264.231493:0:92398:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dc04152d600/0xcc1762b626f8c2d3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xcbfc5de7fe6c3fec expref: -99 pid: 92398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189264.231522:0:92398:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dc04152d600/0xcc1762b626f8c2d3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c3fec expref: 9 pid: 92398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189264.231534:0:92398:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dc04152d600/0xcc1762b626f8c2d3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c3fec expref: 9 pid: 92398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189264.231543:0:92398:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc04152d600, rc 0) 00000100:00100000:0.0:1784189264.231603:0:92398:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf4a251850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:60f345e3-c70e-4f53-b5e7-c9671463c9a5+9:70943:x1870854436309376:12345-192.168.203.12@tcp:101:ll_cfg_requeue.0 Request processed in 160us (367us total) trans 0 rc 0/0 00000100:00100000:0.0:1784189264.231610:0:92398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 161 00000100:00100000:2.0:1784189264.238430:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1784189264.238950:0:92397:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436309504 00000100:00100000:1.0:1784189264.238961:0:92397:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436309504 00000100:00100000:1.0:1784189264.239020:0:92397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 162 00000100:00100000:1.0:1784189264.239030:0:92397:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf4a253850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:60f345e3-c70e-4f53-b5e7-c9671463c9a5+9:70943:x1870854436309504:12345-192.168.203.12@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1784189264.239187:0:92397:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf4a253850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:60f345e3-c70e-4f53-b5e7-c9671463c9a5+9:70943:x1870854436309504:12345-192.168.203.12@tcp:501:ll_cfg_requeue.0 Request processed in 158us (764us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189264.239195:0:92397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 162 00000100:00100000:1.0:1784189264.242163:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1784189264.242237:0:92396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436309632 00000100:00100000:3.0:1784189264.242246:0:92396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436309632 00000100:00100000:3.0:1784189264.242306:0:92396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 163 00000100:00100000:3.0:1784189264.242340:0:92396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf4a251450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:60f345e3-c70e-4f53-b5e7-c9671463c9a5+9:70943:x1870854436309632:12345-192.168.203.12@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1784189264.242504:0:92396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf4a251450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:60f345e3-c70e-4f53-b5e7-c9671463c9a5+9:70943:x1870854436309632:12345-192.168.203.12@tcp:503:ll_cfg_requeue.0 Request processed in 187us (348us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189264.242513:0:92396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 163 00000100:00100000:3.0:1784189264.248151:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1784189264.248251:0:92398:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436309760 00000100:00100000:0.0:1784189264.248261:0:92398:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436309760 00000100:00100000:0.0:1784189264.248352:0:92398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 164 00000100:00100000:0.0:1784189264.248361:0:92398:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf4a250050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:60f345e3-c70e-4f53-b5e7-c9671463c9a5+9:71933:x1870854436309760:12345-192.168.203.12@tcp:502:llog_process_th.0 00000100:00100000:0.0:1784189264.248547:0:92398:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf4a250050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:60f345e3-c70e-4f53-b5e7-c9671463c9a5+9:71933:x1870854436309760:12345-192.168.203.12@tcp:502:llog_process_th.0 Request processed in 187us (404us total) trans 0 rc 0/0 00000100:00100000:0.0:1784189264.248556:0:92398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 164 00000100:00100000:2.0:1784189264.255746:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1784189264.255879:0:92397:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436309888 00000100:00100000:1.0:1784189264.255888:0:92397:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436309888 00000100:00100000:1.0:1784189264.255943:0:92397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 165 00000100:00100000:1.0:1784189264.255952:0:92397:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf4a250450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:60f345e3-c70e-4f53-b5e7-c9671463c9a5+9:71933:x1870854436309888:12345-192.168.203.12@tcp:502:llog_process_th.0 00000100:00100000:1.0:1784189264.256092:0:92397:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf4a250450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:60f345e3-c70e-4f53-b5e7-c9671463c9a5+9:71933:x1870854436309888:12345-192.168.203.12@tcp:502:llog_process_th.0 Request processed in 140us (354us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189264.256100:0:92397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 165 00000100:00100000:1.0:1784189264.260416:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1784189264.260599:0:92396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436310016 00000100:00100000:3.0:1784189264.260607:0:92396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436310016 00000100:00100000:3.0:1784189264.260653:0:92396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 166 00000100:00100000:3.0:1784189264.260663:0:92396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf4a252050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:60f345e3-c70e-4f53-b5e7-c9671463c9a5+9:70943:x1870854436310016:12345-192.168.203.12@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784189264.260677:0:92396:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784189264.260694:0:92396:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dbf4369ce00/0xcc1762b626f8c2da lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0xcbfc5de7fe6c3ff3 expref: -99 pid: 92396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189264.260719:0:92396:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dbf4369ce00/0xcc1762b626f8c2da lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c3ff3 expref: 10 pid: 92396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189264.260729:0:92396:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dbf4369ce00/0xcc1762b626f8c2da lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c3ff3 expref: 10 pid: 92396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189264.260738:0:92396:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dbf4369ce00, rc 0) 00000100:00100000:3.0:1784189264.260791:0:92396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf4a252050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:60f345e3-c70e-4f53-b5e7-c9671463c9a5+10:70943:x1870854436310016:12345-192.168.203.12@tcp:101:ll_cfg_requeue.0 Request processed in 130us (383us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189264.260814:0:92396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 166 00000100:00100000:3.0:1784189264.267236:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1784189264.267387:0:92398:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436310144 00000100:00100000:0.0:1784189264.267405:0:92398:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436310144 00000100:00100000:0.0:1784189264.267767:0:92398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 167 00000100:00100000:0.0:1784189264.267778:0:92398:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc056ab2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:60f345e3-c70e-4f53-b5e7-c9671463c9a5+10:70943:x1870854436310144:12345-192.168.203.12@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1784189264.267892:0:92398:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc056ab2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:60f345e3-c70e-4f53-b5e7-c9671463c9a5+10:70943:x1870854436310144:12345-192.168.203.12@tcp:501:ll_cfg_requeue.0 Request processed in 116us (663us total) trans 0 rc -2/-2 00000100:00100000:0.0:1784189264.267900:0:92398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 167 00010000:00010000:2.0:1784189264.630745:0:26173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784189264.944054:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc056475180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3642:1870854458197504:0@lo:400:kworker.0 00000100:00100000:3.0:1784189264.944153:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784189264.944198:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf4367f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1870854458198016:0@lo:400:kworker.0 00000100:00100000:3.0:1784189264.944228:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784189264.944248:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf4367ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1870854458198528:0@lo:400:kworker.0 00000100:00100000:3.0:1784189264.944273:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784189264.944303:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1784189264.944310:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc05653a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3642:1870854458197632:0@lo:400:kworker.0 00000100:00100000:3.0:1784189264.944364:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784189264.944382:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf4367d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1870854458198144:0@lo:400:kworker.0 00000100:00100000:3.0:1784189264.944415:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784189264.944432:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf4367d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1870854458198656:0@lo:400:kworker.0 00000100:00100000:3.0:1784189264.944467:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784189264.944509:0:68287:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458197504 00000100:00100000:3.0:1784189264.944519:0:68287:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458197504 00000100:00100000:1.0:1784189264.944650:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf4367c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3640:1870854458197760:0@lo:400:kworker.0 00000100:00100000:1.0:1784189264.944685:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784189264.944720:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf4367f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1870854458198272:0@lo:400:kworker.0 00000100:00100000:1.0:1784189264.944762:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784189264.944783:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf4367f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1870854458198784:0@lo:400:kworker.0 00000100:00100000:1.0:1784189264.944806:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784189264.944834:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [1->0] 00000100:00100000:1.0:1784189264.944841:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc056477480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bd553d0d-03e2-4233-b06b-b55bbfa2b954:3640:1870854458197376:0@lo:400:kworker.0 00000100:00100000:1.0:1784189264.944871:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784189264.945027:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf4367c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3640:1870854458197888:0@lo:400:kworker.0 00000100:00100000:1.0:1784189264.945052:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784189264.945069:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf4367ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3640:1870854458198400:0@lo:400:kworker.0 00000100:00100000:1.0:1784189264.945091:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784189264.945108:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf425f9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3640:1870854458198912:0@lo:400:kworker.0 00000100:00100000:1.0:1784189264.945135:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784189264.945160:0:66171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458197632 00000100:00100000:1.0:1784189264.945165:0:66171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458197632 00000100:00100000:1.0:1784189264.945218:0:66171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458197760 00000100:00100000:1.0:1784189264.945221:0:66171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458197760 00000100:00100000:0.0:1784189264.945433:0:26159:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458198144 00000100:00100000:0.0:1784189264.945438:0:26159:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458198144 00000100:00100000:0.0:1784189264.945484:0:26159:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458198656 00000100:00100000:0.0:1784189264.945489:0:26159:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458198656 00000100:00100000:0.0:1784189264.945508:0:26159:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458198272 00000100:00100000:0.0:1784189264.945511:0:26159:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458198272 00000100:00100000:0.0:1784189264.945527:0:26159:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458198784 00000100:00100000:0.0:1784189264.945529:0:26159:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458198784 00000100:00100000:0.0:1784189264.945563:0:26159:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2527 00000100:00100000:0.0:1784189264.945572:0:26159:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc081cd3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3642:x1870854458198144:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784189264.945642:0:26159:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc081cd3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3642:x1870854458198144:12345-0@lo:400:kworker.0 Request processed in 70us (1226us total) trans 0 rc 0/0 00000100:00100000:0.0:1784189264.945649:0:26159:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2527 00000100:00100000:0.0:1784189264.945930:0:26159:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2528 00000100:00100000:0.0:1784189264.945938:0:26159:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf425f8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3642:x1870854458198656:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784189264.945969:0:26159:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf425f8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3642:x1870854458198656:12345-0@lo:400:kworker.0 Request processed in 32us (1502us total) trans 0 rc 0/0 00000100:00100000:0.0:1784189264.945974:0:26159:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2528 00000100:00100000:0.0:1784189264.945985:0:26159:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2529 00000100:00100000:0.0:1784189264.945990:0:26159:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf470e3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3640:x1870854458198272:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784189264.946025:0:26159:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf470e3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3640:x1870854458198272:12345-0@lo:400:kworker.0 Request processed in 35us (1263us total) trans 0 rc 0/0 00000100:00100000:0.0:1784189264.946059:0:26159:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2529 00000100:00100000:0.0:1784189264.946072:0:26159:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2530 00000100:00100000:0.0:1784189264.946079:0:26159:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf470e2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3640:x1870854458198784:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784189264.946109:0:26159:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf470e2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3640:x1870854458198784:12345-0@lo:400:kworker.0 Request processed in 32us (1304us total) trans 0 rc 0/0 00000100:00100000:0.0:1784189264.946115:0:26159:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2530 00000100:00100000:3.0:1784189264.948767:0:68287:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458197888 00000100:00100000:3.0:1784189264.948783:0:68287:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458197888 00000100:00100000:3.0:1784189264.948806:0:68287:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458198400 00000100:00100000:3.0:1784189264.948809:0:68287:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458198400 00000100:00100000:2.0:1784189264.949224:0:66169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458198912 00000100:00100000:2.0:1784189264.949230:0:66169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458198912 00000100:00100000:1.0:1784189264.949847:0:66171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1268 00000100:00100000:1.0:1784189264.949862:0:66171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf425fb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1870854458197632:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784189264.949990:0:66171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf425fb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1870854458197632:12345-0@lo:400:kworker.0 Request processed in 131us (5625us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189264.949999:0:66171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1268 00000100:00100000:1.0:1784189264.950021:0:66171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1269 00000100:00100000:1.0:1784189264.950029:0:66171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf425f9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3642:x1870854458197504:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784189264.950070:0:66171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf425f9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3642:x1870854458197504:12345-0@lo:400:kworker.0 Request processed in 42us (5917us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189264.950092:0:66171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1269 00000100:00100000:1.0:1784189264.950107:0:66171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1270 00000100:00100000:1.0:1784189264.950113:0:66171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf470e2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1870854458197888:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784189264.950144:0:66171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf470e2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1870854458197888:12345-0@lo:400:kworker.0 Request processed in 32us (5092us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189264.950149:0:66171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1270 00000100:00100000:1.0:1784189264.950160:0:66171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1271 00000100:00100000:1.0:1784189264.950166:0:66171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf470e0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3640:x1870854458197760:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784189264.950194:0:66171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf470e0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3640:x1870854458197760:12345-0@lo:400:kworker.0 Request processed in 28us (5508us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189264.950199:0:66171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1271 00000100:00100000:1.0:1784189264.950235:0:92397:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458197376 00000100:00100000:1.0:1784189264.950241:0:92397:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458197376 00000100:00100000:1.0:1784189264.950283:0:92397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:1.0:1784189264.950290:0:92397:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc056ab3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd553d0d-03e2-4233-b06b-b55bbfa2b954+24:3640:x1870854458197376:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784189264.950343:0:92397:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc056ab3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd553d0d-03e2-4233-b06b-b55bbfa2b954+24:3640:x1870854458197376:12345-0@lo:400:kworker.0 Request processed in 53us (5470us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189264.950350:0:92397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00080000:1.0:1784189264.950394:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1784189264.950400:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1784189264.950404:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1784189264.950407:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1784189264.950519:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc056477480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bd553d0d-03e2-4233-b06b-b55bbfa2b954:3640:1870854458197376:0@lo:400:kworker.0 00000100:00100000:1.0:1784189264.950788:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf4367c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3640:1870854458197888:0@lo:400:kworker.0 00000100:00100000:1.0:1784189264.950806:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf4367c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3640:1870854458197760:0@lo:400:kworker.0 00000100:00100000:1.0:1784189264.950833:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf4367f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1870854458198272:0@lo:400:kworker.0 00000100:00100000:1.0:1784189264.950846:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf4367f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1870854458198784:0@lo:400:kworker.0 00000100:00100000:1.0:1784189264.950977:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf470e1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1870854458199040:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1784189264.951025:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784189264.951162:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc05653a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3642:1870854458197632:0@lo:400:kworker.0 00000100:00100000:1.0:1784189264.951176:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf4367d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1870854458198144:0@lo:400:kworker.0 00000100:00100000:1.0:1784189264.951189:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf4367d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1870854458198656:0@lo:400:kworker.0 00000100:00100000:1.0:1784189264.951201:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc056475180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3642:1870854458197504:0@lo:400:kworker.0 00000100:00100000:1.0:1784189264.951229:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1784189264.951235:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf470e2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1870854458199168:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1784189264.951259:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784189264.951292:0:23826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458198016 00000100:00100000:1.0:1784189264.951297:0:23826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458198016 00000100:00100000:1.0:1784189264.951356:0:23826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458198528 00000100:00100000:1.0:1784189264.951359:0:23826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458198528 00000100:00100000:1.0:1784189264.951370:0:23826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458199040 00000100:00100000:1.0:1784189264.951372:0:23826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458199040 00000100:00100000:1.0:1784189264.951382:0:23826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458199168 00000100:00100000:1.0:1784189264.951384:0:23826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458199168 00000100:00100000:1.0:1784189264.951397:0:23826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3874 00000100:00100000:1.0:1784189264.951404:0:23826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf425fa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:3642:x1870854458198016:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784189264.951469:0:23826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf425fa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:3642:x1870854458198016:12345-0@lo:400:kworker.0 Request processed in 65us (7240us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189264.951477:0:23826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3874 00000100:00100000:1.0:1784189264.951501:0:23826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3875 00000100:00100000:1.0:1784189264.951507:0:23826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf425f8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3642:x1870854458198528:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784189264.951666:0:23826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf425f8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3642:x1870854458198528:12345-0@lo:400:kworker.0 Request processed in 159us (7392us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189264.951674:0:23826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3875 00000100:00100000:1.0:1784189264.951686:0:23826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3876 00000100:00100000:1.0:1784189264.951692:0:23826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf470e0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3642:x1870854458199040:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1784189264.951735:0:23826:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445576704 avail 1299337216 00000100:00100000:1.0:1784189264.951770:0:23826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf470e0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3642:x1870854458199040:12345-0@lo:41:osp-pre-1-0.0 Request processed in 79us (745us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189264.951777:0:23826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3876 00000100:00100000:1.0:1784189264.951788:0:23826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3877 00000100:00100000:1.0:1784189264.951794:0:23826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf470e1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3642:x1870854458199168:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1784189264.951811:0:23826:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445220352 avail 1298980864 00000100:00100000:1.0:1784189264.951839:0:23826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf470e1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3642:x1870854458199168:12345-0@lo:41:osp-pre-0-1.0 Request processed in 45us (579us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189264.951845:0:23826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3877 00000100:00100000:1.0:1784189264.951957:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf470e2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1870854458199168:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1784189264.951974:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf470e1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1870854458199040:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1784189264.951984:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf4367f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1870854458198016:0@lo:400:kworker.0 00000100:00100000:1.0:1784189264.951991:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf4367ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1870854458198528:0@lo:400:kworker.0 00000100:00100000:3.0:1784189264.953425:0:68287:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1272 00000100:00100000:3.0:1784189264.953438:0:68287:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf470e0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1870854458198400:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784189264.953663:0:68287:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf470e0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1870854458198400:12345-0@lo:400:kworker.0 Request processed in 228us (8570us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189264.953688:0:68287:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1272 00000100:00100000:3.0:1784189264.953811:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf4367ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3640:1870854458198400:0@lo:400:kworker.0 00000100:00100000:2.0:1784189264.954304:0:66169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1273 00000100:00100000:2.0:1784189264.954314:0:66169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf470e1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1870854458198912:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784189264.954384:0:66169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf470e1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1870854458198912:12345-0@lo:400:kworker.0 Request processed in 72us (9247us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189264.954400:0:66169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1273 00000100:00100000:3.0:1784189264.954628:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf425f9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3640:1870854458198912:0@lo:400:kworker.0 00000100:00100000:1.0:1784189265.459141:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1784189265.459177:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf470e1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1870854458199296:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1784189265.459276:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784189265.459720:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc07016df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1870854458199424:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1784189265.459754:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784189265.459885:0:9466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458199296 00000100:00100000:2.0:1784189265.459894:0:9466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458199296 00000100:00100000:2.0:1784189265.459951:0:9466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458199424 00000100:00100000:2.0:1784189265.459955:0:9466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458199424 00000100:00100000:2.0:1784189265.459972:0:9466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2024 00000100:00100000:2.0:1784189265.459982:0:9466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf470e2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1870854458199296:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1784189265.460011:0:9466:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 210112 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1784189265.460143:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2025 00000100:00100000:1.0:1784189265.460153:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf470e2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1870854458199424:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1784189265.460167:0:8432:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8647872 pending 0 free 3922481152 avail 3690958848 00000100:00100000:0.0:1784189265.460248:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf470e1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1870854458199296:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1784189265.462975:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf470e2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1870854458199424:12345-0@lo:13:osp-pre-0-0.0 Request processed in 2812us (3208us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189265.462993:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2025 00000100:00100000:2.0:1784189265.464307:0:9466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf470e2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1870854458199296:12345-0@lo:13:osp-pre-1-0.0 Request processed in 4315us (5020us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189265.464341:0:9466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2024 00000100:00100000:3.0:1784189265.465247:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc07016df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1870854458199424:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1784189265.539350:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1784189265.539399:0:66170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436310272 00000100:00100000:3.0:1784189265.539411:0:66170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436310272 00000100:00100000:3.0:1784189265.539505:0:66170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1355 00000100:00100000:3.0:1784189265.539517:0:66170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf425f9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:debedd94-805c-42a0-a5e5-41758b2012e9+6:71953:x1870854436310272:12345-192.168.203.12@tcp:101:mkdir.0 00010000:00010000:3.0:1784189265.539545:0:66170:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784189265.539574:0:66170:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4369d400/0xcc1762b626f8c2e1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbfc5de7fe6c3ffa expref: -99 pid: 66170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189265.539658:0:66170:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4369c400/0xcc1762b626f8c2e8 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189265.539676:0:66170:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4369c400/0xcc1762b626f8c2e8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189265.539696:0:66170:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4369c400/0xcc1762b626f8c2e8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784189265.539767:0:66170:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1784189265.539771:0:66170:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1784189265.539814:0:66170:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4369c400/0xcc1762b626f8c2e8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189265.539848:0:66170:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4369d400/0xcc1762b626f8c2e1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c3ffa expref: 8 pid: 66170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189265.539885:0:66170:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4369c400/0xcc1762b626f8c2e8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c3ffa expref: 7 pid: 66170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189265.539896:0:66170:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9dc0630a6700) 00010000:00010000:3.0:1784189265.539900:0:66170:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1784189265.539904:0:66170:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dbf4369c400, rc 0) 00000100:00100000:3.0:1784189265.539975:0:66170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf425f9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:debedd94-805c-42a0-a5e5-41758b2012e9+7:71953:x1870854436310272:12345-192.168.203.12@tcp:101:mkdir.0 Request processed in 460us (656us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189265.539983:0:66170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1355 00000100:00080000:3.0:1784189265.540010:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1784189265.554294:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1784189265.554360:0:66178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436310400 00000100:00100000:1.0:1784189265.554372:0:66178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436310400 00000100:00100000:1.0:1784189265.554457:0:66178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 15 00000100:00100000:1.0:1784189265.554469:0:66178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf470e1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:debedd94-805c-42a0-a5e5-41758b2012e9+7:71953:x1870854436310400:12345-192.168.203.12@tcp:700:mkdir.0 00000100:00100000:1.0:1784189265.555810:0:66178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf470e1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:debedd94-805c-42a0-a5e5-41758b2012e9+7:71953:x1870854436310400:12345-192.168.203.12@tcp:700:mkdir.0 Request processed in 1332us (1516us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189265.555825:0:66178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 15 00000100:00100000:0.0:1784189265.560780:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1784189265.561801:0:68287:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436310656 00000100:00100000:1.0:1784189265.561817:0:68287:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436310656 00000100:00100000:1.0:1784189265.561904:0:68287:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1356 00000100:00100000:1.0:1784189265.561917:0:68287:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc050542300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:debedd94-805c-42a0-a5e5-41758b2012e9+7:71953:x1870854436310656:12345-192.168.203.12@tcp:36:mkdir.0 00010000:00010000:1.0:1784189265.561997:0:68287:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784189265.562032:0:68287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4369c400/0xcc1762b626f8c2e8 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c3ffa expref: 7 pid: 66170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189265.562056:0:68287:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9dc0630a6700) 00010000:00010000:1.0:1784189265.562061:0:68287:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1784189265.562170:0:68287:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4710e200/0xcc1762b626f8c2ef lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189265.562187:0:68287:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4710e200/0xcc1762b626f8c2ef lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189265.562199:0:68287:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4710e200/0xcc1762b626f8c2ef lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189265.562218:0:68287:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4710fa00/0xcc1762b626f8c2f6 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x91905c78 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189265.562225:0:68287:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4710fa00/0xcc1762b626f8c2f6 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189265.562233:0:68287:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4710fa00/0xcc1762b626f8c2f6 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189265.565220:0:68287:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4710ec00/0xcc1762b626f8c2fd lrc: 3/0,1 mode: --/PW res: [0x20000cf21:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189265.565251:0:68287:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4710ec00/0xcc1762b626f8c2fd lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189265.565266:0:68287:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4710ec00/0xcc1762b626f8c2fd lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1784189265.565286:0:68287:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000d46c6bee reply state 00000000eadca8e0 transno 115964116995 ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4710ec00/0xcc1762b626f8c2fd lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189265.565301:0:68287:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4710ec00/0xcc1762b626f8c2fd lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189265.565309:0:68287:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x1:0x0].0x0 (ffff9dc0455f8400) 00010000:00010000:1.0:1784189265.565355:0:68287:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1784189265.565361:0:68287:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1784189265.565369:0:68287:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000cf21:0x1:0x0]: returning size 4096 00010000:00010000:1.0:1784189265.565382:0:68287:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4710e200/0xcc1762b626f8c2ef lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189265.565389:0:68287:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4710e200/0xcc1762b626f8c2ef lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189265.565397:0:68287:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4710e200/0xcc1762b626f8c2ef lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189265.565405:0:68287:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4710e200/0xcc1762b626f8c2ef lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189265.565412:0:68287:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dbf4710e200 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:1.0:1784189265.565417:0:68287:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4710e200/0xcc1762b626f8c2ef lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189265.565426:0:68287:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4710e200/0xcc1762b626f8c2ef lrc: 5/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189265.565451:0:68287:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9dc0630a6700) 00010000:00010000:1.0:1784189265.565455:0:68287:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784189265.565458:0:68287:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4710e200/0xcc1762b626f8c2ef lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189265.565465:0:68287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4710e200/0xcc1762b626f8c2ef lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1784189265.565482:0:68287:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000d46c6bee reply state 00000000eadca8e0 transno 115964116995 ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4710fa00/0xcc1762b626f8c2f6 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189265.565503:0:68287:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4710fa00/0xcc1762b626f8c2f6 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189265.565510:0:68287:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x91905c78 (ffff9dc0455f8d00) 00010000:00010000:1.0:1784189265.565512:0:68287:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1784189265.565515:0:68287:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:1.0:1784189265.567296:0:68287:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc050542300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:debedd94-805c-42a0-a5e5-41758b2012e9+8:71953:x1870854436310656:12345-192.168.203.12@tcp:36:mkdir.0 Request processed in 5368us (6518us total) trans 115964116995 rc 0/0 00000100:00100000:1.0:1784189265.567311:0:68287:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1356 00000100:00100000:2.0:1784189265.573181:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1784189265.573237:0:66945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436310784 00000100:00100000:2.0:1784189265.573249:0:66945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436310784 00000100:00100000:2.0:1784189265.573335:0:66945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1357 00000100:00100000:2.0:1784189265.573349:0:66945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc07016c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:debedd94-805c-42a0-a5e5-41758b2012e9+8:71953:x1870854436310784:12345-192.168.203.12@tcp:101:mkdir.0 00010000:00010000:2.0:1784189265.573380:0:66945:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784189265.573408:0:66945:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04a20be00/0xcc1762b626f8c304 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbfc5de7fe6c4001 expref: -99 pid: 66945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189265.573507:0:66945:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04a20b200/0xcc1762b626f8c30b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189265.573524:0:66945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04a20b200/0xcc1762b626f8c30b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189265.573538:0:66945:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04a20b200/0xcc1762b626f8c30b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784189265.573623:0:66945:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1784189265.573628:0:66945:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1784189265.573657:0:66945:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04a20b200/0xcc1762b626f8c30b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189265.573690:0:66945:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04a20be00/0xcc1762b626f8c304 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c4001 expref: 10 pid: 66945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189265.575504:0:66945:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04a20b200/0xcc1762b626f8c30b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c4001 expref: 9 pid: 66945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189265.575517:0:66945:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9dc0630a6700) 00010000:00010000:2.0:1784189265.575521:0:66945:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1784189265.575525:0:66945:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc04a20b200, rc 0) 00000100:00100000:2.0:1784189265.575678:0:66945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc07016c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:debedd94-805c-42a0-a5e5-41758b2012e9+9:71953:x1870854436310784:12345-192.168.203.12@tcp:101:mkdir.0 Request processed in 2330us (2508us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189265.575688:0:66945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1357 00000100:00100000:0.0:1784189265.583246:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1784189265.583770:0:66171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436311040 00000100:00100000:2.0:1784189265.583783:0:66171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436311040 00000100:00100000:2.0:1784189265.583853:0:66171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1358 00000100:00100000:2.0:1784189265.583866:0:66171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc050540a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:debedd94-805c-42a0-a5e5-41758b2012e9+9:71953:x1870854436311040:12345-192.168.203.12@tcp:101:mkdir.0 00010000:00010000:2.0:1784189265.583893:0:66171:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784189265.583919:0:66171:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04a20a200/0xcc1762b626f8c312 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbfc5de7fe6c4008 expref: -99 pid: 66171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189265.584016:0:66171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04a20b600/0xcc1762b626f8c319 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189265.584047:0:66171:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04a20b600/0xcc1762b626f8c319 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189265.584061:0:66171:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04a20b600/0xcc1762b626f8c319 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189265.584690:0:66171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04a20bc00/0xcc1762b626f8c320 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189265.584804:0:66171:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04a20bc00/0xcc1762b626f8c320 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189265.584815:0:66171:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04a20bc00/0xcc1762b626f8c320 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784189265.584966:0:66171:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000cf21:0x1:0x0]: returning size 4096 00010000:00010000:2.0:1784189265.585805:0:66171:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04a20b600/0xcc1762b626f8c319 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189265.585821:0:66171:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04a20b600/0xcc1762b626f8c319 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189265.585828:0:66171:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04a20b600/0xcc1762b626f8c319 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189265.585835:0:66171:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04a20b600/0xcc1762b626f8c319 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189265.585842:0:66171:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc04a20b600 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:2.0:1784189265.585848:0:66171:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04a20b600/0xcc1762b626f8c319 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189265.585869:0:66171:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04a20b600/0xcc1762b626f8c319 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189265.585888:0:66171:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9dc0630a6700) 00010000:00010000:2.0:1784189265.585891:0:66171:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784189265.585897:0:66171:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04a20b600/0xcc1762b626f8c319 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189265.585904:0:66171:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04a20b600/0xcc1762b626f8c319 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189265.585921:0:66171:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04a20bc00/0xcc1762b626f8c320 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189265.585926:0:66171:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04a20bc00/0xcc1762b626f8c320 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189265.585931:0:66171:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04a20bc00/0xcc1762b626f8c320 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189265.585936:0:66171:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc04a20bc00 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:2.0:1784189265.585939:0:66171:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04a20bc00/0xcc1762b626f8c320 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189265.585944:0:66171:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04a20bc00/0xcc1762b626f8c320 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189265.585951:0:66171:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x91905c78 (ffff9dc0455f8d00) 00010000:00010000:2.0:1784189265.585954:0:66171:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784189265.585956:0:66171:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04a20bc00/0xcc1762b626f8c320 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189265.585972:0:66171:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04a20bc00/0xcc1762b626f8c320 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189265.586033:0:66171:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04a20a200/0xcc1762b626f8c312 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c4008 expref: 11 pid: 66171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189265.586047:0:66171:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9dc0630a6700) 00010000:00010000:2.0:1784189265.586049:0:66171:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1784189265.586054:0:66171:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04a20a200/0xcc1762b626f8c312 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c4008 expref: 11 pid: 66171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189265.586931:0:66171:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc04a20a200, rc 0) 00000100:00100000:2.0:1784189265.587038:0:66171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc050540a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:debedd94-805c-42a0-a5e5-41758b2012e9+10:71953:x1870854436311040:12345-192.168.203.12@tcp:101:mkdir.0 Request processed in 3170us (3798us total) trans 115964116996 rc 301/301 00000100:00100000:2.0:1784189265.587049:0:66171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1358 00000100:00100000:1.0:1784189265.591148:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1784189265.591482:0:66181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436311168 00000100:00100000:3.0:1784189265.591494:0:66181:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436311168 00000100:00100000:2.0:1784189265.591700:0:66180:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 14 00000100:00100000:2.0:1784189265.591713:0:66180:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf470e1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:debedd94-805c-42a0-a5e5-41758b2012e9+5:71953:x1870854436311168:12345-192.168.203.12@tcp:900:mkdir.0 00000100:00100000:2.0:1784189265.591811:0:66180:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf470e1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:debedd94-805c-42a0-a5e5-41758b2012e9+5:71953:x1870854436311168:12345-192.168.203.12@tcp:900:mkdir.0 Request processed in 101us (680us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189265.591819:0:66180:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 14 00000100:00080000:1.0:1784189265.591928:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1784189265.604225:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1784189265.605176:0:66172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436311424 00000100:00100000:3.0:1784189265.605191:0:66172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436311424 00000100:00100000:3.0:1784189265.606175:0:66172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 239 00000100:00100000:3.0:1784189265.606193:0:66172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc07579c850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:debedd94-805c-42a0-a5e5-41758b2012e9+10:71953:x1870854436311424:12345-192.168.203.12@tcp:35:mkdir.0 00000100:00100000:3.0:1784189265.606578:0:66172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc07579c850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:debedd94-805c-42a0-a5e5-41758b2012e9+11:71953:x1870854436311424:12345-192.168.203.12@tcp:35:mkdir.0 Request processed in 384us (2359us total) trans 115964116997 rc 0/0 00000100:00100000:3.0:1784189265.606589:0:66172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 239 00000100:00100000:2.0:1784189265.612715:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1784189265.615422:0:68287:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436311680 00000100:00100000:3.0:1784189265.615642:0:68287:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436311680 00000100:00100000:3.0:1784189265.615925:0:68287:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1359 00000100:00100000:3.0:1784189265.615938:0:68287:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc07016d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:debedd94-805c-42a0-a5e5-41758b2012e9+5:71953:x1870854436311680:12345-192.168.203.12@tcp:36:mkdir.0 00000100:00100000:3.0:1784189265.616943:0:68287:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf425fb480 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:68287:1870854458199552:0@lo:1000:mdt00_004.0 00000100:00100000:3.0:1784189265.617052:0:68287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784189265.617885:0:68287:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dc0760d8180 going to sleep for 11 seconds 00000100:00100000:3.0:1784189265.617920:0:23826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458199552 00000100:00100000:3.0:1784189265.617929:0:23826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458199552 00000100:00100000:3.0:1784189265.617989:0:23826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3878 00000100:00100000:3.0:1784189265.617997:0:23826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc05edaad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:68287:x1870854458199552:12345-0@lo:1000:mdt00_004.0 00000100:00100000:3.0:1784189265.618847:0:23826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc05edaad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:68287:x1870854458199552:12345-0@lo:1000:mdt00_004.0 Request processed in 844us (1789us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189265.618859:0:23826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3878 00000100:00100000:1.0:1784189265.619229:0:68287:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf425fb480 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:68287:1870854458199552:0@lo:1000:mdt00_004.0 00000100:00100000:1.0:1784189265.619374:0:68287:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf470e3b80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:68287:1870854458199680:0@lo:1000:mdt00_004.0 00000100:00100000:1.0:1784189265.619424:0:68287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784189265.619459:0:68287:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dc0754d6480 going to sleep for 11 seconds 00000100:00100000:0.0:1784189265.619886:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458199680 00000100:00100000:0.0:1784189265.619895:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458199680 00000100:00100000:0.0:1784189265.619945:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3879 00000100:00100000:0.0:1784189265.619955:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf470e3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:68287:x1870854458199680:12345-0@lo:1000:mdt00_004.0 00000100:00100000:0.0:1784189265.620070:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf470e3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:68287:x1870854458199680:12345-0@lo:1000:mdt00_004.0 Request processed in 116us (647us total) trans 0 rc 0/0 00000100:00100000:0.0:1784189265.620077:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3879 00000100:00100000:3.0:1784189265.620219:0:68287:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf470e3b80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:68287:1870854458199680:0@lo:1000:mdt00_004.0 00000100:00100000:3.0:1784189265.620288:0:68287:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc05ed92a00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:68287:1870854458199808:0@lo:1000:mdt00_004.0 00000100:00100000:3.0:1784189265.621230:0:68287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784189265.621267:0:68287:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dbf445d3b40 going to sleep for 11 seconds 00000100:00100000:1.0:1784189265.621296:0:23826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458199808 00000100:00100000:1.0:1784189265.621304:0:23826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458199808 00000100:00100000:1.0:1784189265.621372:0:23826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3880 00000100:00100000:1.0:1784189265.621381:0:23826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc0762d5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:68287:x1870854458199808:12345-0@lo:1000:mdt00_004.0 00000100:00100000:0.0:1784189265.621803:0:68287:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc05ed92a00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:68287:1870854458199808:0@lo:1000:mdt00_004.0 00010000:00010000:0.0:1784189265.621890:0:68287:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9dc04152d200/0xcc1762b626f8c32e lrc: 3/0,1 mode: --/CW res: [0x20000cf21:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189265.621902:0:68287:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff9dc04152d200/0xcc1762b626f8c32e lrc: 3/0,1 mode: --/CW res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 68287 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189265.621914:0:68287:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff9dc04152d200/0xcc1762b626f8c32e lrc: 3/0,1 mode: --/CW res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 68287 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784189265.621934:0:68287:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc050542a00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:68287:1870854458199936:0@lo:101:mdt00_004.0 00000100:00100000:0.0:1784189265.621991:0:68287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784189265.622018:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458199936 00000100:00100000:0.0:1784189265.622023:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458199936 00000100:00100000:0.0:1784189265.622056:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3881 00000100:00100000:0.0:1784189265.622064:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc050543b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:68287:x1870854458199936:12345-0@lo:101:mdt00_004.0 00010000:00010000:0.0:1784189265.622076:0:8439:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784189265.622096:0:8439:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04152c400/0xcc1762b626f8c335 lrc: 2/0,0 mode: --/CW res: [0x20000cf21:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcc1762b626f8c32e expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189265.622122:0:8439:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4710ec00/0xcc1762b626f8c2fd lrc: 2/0,1 mode: TXN/TXN res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189265.622142:0:8439:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04152c400/0xcc1762b626f8c335 lrc: 4/0,0 mode: --/CW res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xcc1762b626f8c32e expref: 9 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189265.622162:0:8439:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4710ec00/0xcc1762b626f8c2fd lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000020 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00080000:00080000:0.0:1784189265.622198:0:8439:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0000: async commit OSD 00010000:00010000:0.0:1784189265.622244:0:8439:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04152c400/0xcc1762b626f8c335 lrc: 3/0,0 mode: --/CW res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xcc1762b626f8c32e expref: 9 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189265.622253:0:8439:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x1:0x0].0x0 (ffff9dc0455f8400) 00010000:00010000:0.0:1784189265.622257:0:8439:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784189265.622261:0:8439:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04152c400/0xcc1762b626f8c335 lrc: 3/0,0 mode: --/CW res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xcc1762b626f8c32e expref: 9 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189265.622269:0:8439:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc04152c400, rc 0) 00000100:00100000:0.0:1784189265.622298:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc050543b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:68287:x1870854458199936:12345-0@lo:101:mdt00_004.0 Request processed in 234us (306us total) trans 0 rc 0/0 00000100:00100000:0.0:1784189265.622313:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3881 00000100:00100000:0.0:1784189265.622364:0:68287:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dc043ca9540 going to sleep for 11 seconds 00000100:00100000:0.0:1784189265.622382:0:68287:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc050542a00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:68287:1870854458199936:0@lo:101:mdt00_004.0 00010000:00010000:0.0:1784189265.622399:0:68287:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9dc04152d200/0xcc1762b626f8c32e lrc: 4/0,1 mode: --/CW res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xcc1762b626f8c335 expref: -99 pid: 68287 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189265.622408:0:68287:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: lustre-MDT0000-osp-MDT0001 lock: ffff9dc04152d200/0xcc1762b626f8c32e lrc: 4/0,1 mode: --/CW res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xcc1762b626f8c335 expref: -99 pid: 68287 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784189265.622496:0:23826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc0762d5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:68287:x1870854458199808:12345-0@lo:1000:mdt00_004.0 Request processed in 1115us (1268us total) trans 0 rc -2/-2 00000100:00100000:1.0:1784189265.622507:0:23826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3880 00000001:00080000:3.0:1784189265.629016:0:92391:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 115964116997 is committed 00010000:00010000:0.0:1784189265.629194:0:3626:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4710fa00/0xcc1762b626f8c2f6 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189265.629214:0:3626:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4710fa00/0xcc1762b626f8c2f6 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189265.629223:0:3626:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4710fa00/0xcc1762b626f8c2f6 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189265.629230:0:3626:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dbf4710fa00 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:0.0:1784189265.629236:0:3626:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4710fa00/0xcc1762b626f8c2f6 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189265.629245:0:3626:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4710fa00/0xcc1762b626f8c2f6 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189265.629267:0:3626:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x91905c78 (ffff9dc0455f8d00) 00010000:00010000:0.0:1784189265.629270:0:3626:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784189265.629275:0:3626:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4710fa00/0xcc1762b626f8c2f6 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189265.629303:0:3626:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4710fa00/0xcc1762b626f8c2f6 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189265.629370:0:3626:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4710ec00/0xcc1762b626f8c2fd lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000020 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189265.629377:0:3626:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4710ec00/0xcc1762b626f8c2fd lrc: 2/0,0 mode: TXN/TXN res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000020 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189265.629383:0:3626:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4710ec00/0xcc1762b626f8c2fd lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000020 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189265.629388:0:3626:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dbf4710ec00 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:0.0:1784189265.629391:0:3626:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4710ec00/0xcc1762b626f8c2fd lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000020 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189265.629397:0:3626:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4710ec00/0xcc1762b626f8c2fd lrc: 4/0,0 mode: TXN/TXN res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000020 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189265.629407:0:3626:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x1:0x0].0x0 (ffff9dc0455f8400) 00010000:00010000:0.0:1784189265.629410:0:3626:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784189265.629418:0:3626:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04152c400/0xcc1762b626f8c335 lrc: 2/0,0 mode: --/CW res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xcc1762b626f8c32e expref: 7 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189265.629432:0:3626:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04152c400/0xcc1762b626f8c335 lrc: 2/0,0 mode: CW/CW res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0xcc1762b626f8c32e expref: 7 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189265.630060:0:3626:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04152c400/0xcc1762b626f8c335 lrc: 3/0,0 mode: CW/CW res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0xcc1762b626f8c32e expref: 7 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189265.630263:0:3626:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04152c400/0xcc1762b626f8c335 lrc: 3/0,0 mode: CW/CW res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xcc1762b626f8c32e expref: 7 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784189265.630285:0:3626:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc050543800 pname:cluuid:pid:xid:nid:opc:job ptlrpc_hr00_000:lustre-MDT0000_UUID:3626:1870854458200064:0@lo:105: 00000100:00100000:1.0:1784189265.632184:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784189265.632255:0:3626:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dc043ca9540 going to sleep for 11 seconds 00000100:00100000:2.0:1784189265.632586:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458200064 00000100:00100000:2.0:1784189265.632597:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458200064 00000100:00100000:2.0:1784189265.632676:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 333 00000100:00100000:2.0:1784189265.632687:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf470e3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0001-mdtlov_UUID+4:3626:x1870854458200064:12345-0@lo:105: 00010000:00010000:2.0:1784189265.633599:0:6496:0:(ldlm_lockd.c:2518:ldlm_callback_handler()) ### completion ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff9dc04152d200/0xcc1762b626f8c32e lrc: 5/0,1 mode: --/CW res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xcc1762b626f8c335 expref: -99 pid: 68287 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189265.633614:0:6496:0:(ldlm_lockd.c:1968:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-MDT0000-osp-MDT0001 lock: ffff9dc04152d200/0xcc1762b626f8c32e lrc: 5/0,1 mode: --/CW res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xcc1762b626f8c335 expref: -99 pid: 68287 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189265.634141:0:6496:0:(ldlm_lockd.c:2045:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-MDT0000-osp-MDT0001 lock: ffff9dc04152d200/0xcc1762b626f8c32e lrc: 5/0,1 mode: --/CW res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xcc1762b626f8c335 expref: -99 pid: 68287 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189265.634153:0:6496:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9dc04152d200/0xcc1762b626f8c32e lrc: 5/0,1 mode: CW/CW res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xcc1762b626f8c335 expref: -99 pid: 68287 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189265.634163:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff9dc04152d200/0xcc1762b626f8c32e lrc: 6/0,1 mode: CW/CW res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xcc1762b626f8c335 expref: -99 pid: 68287 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189265.634173:0:6496:0:(ldlm_lockd.c:2073:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-MDT0000-osp-MDT0001 lock: ffff9dc04152d200/0xcc1762b626f8c32e lrc: 6/0,1 mode: CW/CW res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1080000000000 nid: local remote: 0xcc1762b626f8c335 expref: -99 pid: 68287 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189265.634215:0:6496:0:(ldlm_lockd.c:2084:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff9dc04152d200) 00000100:00100000:1.0:1784189265.634406:0:3626:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc050543800 pname:cluuid:pid:xid:nid:opc:job ptlrpc_hr00_000:lustre-MDT0000_UUID:3626:1870854458200064:0@lo:105: 00010000:00010000:1.0:1784189265.634453:0:3626:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4710ec00/0xcc1762b626f8c2fd lrc: 2/0,0 mode: --/TXN res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000020 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189265.634462:0:3626:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4710ec00/0xcc1762b626f8c2fd lrc: 0/0,0 mode: --/TXN res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000020 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189265.634737:0:68287:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: lustre-MDT0000-osp-MDT0001 lock: ffff9dc04152d200/0xcc1762b626f8c32e lrc: 4/0,1 mode: CW/CW res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xcc1762b626f8c335 expref: -99 pid: 68287 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189265.634750:0:68287:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9dc04152d200/0xcc1762b626f8c32e lrc: 4/0,1 mode: CW/CW res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xcc1762b626f8c335 expref: -99 pid: 68287 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1784189265.634778:0:68287:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x20000cf21:0x1:0x0] 00000100:00100000:2.0:1784189265.634779:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf470e3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0001-mdtlov_UUID+4:3626:x1870854458200064:12345-0@lo:105: Request processed in 1634us (2154us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189265.634792:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 333 00010000:00010000:0.0:1784189265.634837:0:68287:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9dc04152c800/0xcc1762b626f8c33c lrc: 3/0,1 mode: --/PW res: [0x20000cf21:0x1:0x0].0xb04f75d6 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189265.634845:0:68287:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff9dc04152c800/0xcc1762b626f8c33c lrc: 3/0,1 mode: --/PW res: [0x20000cf21:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 68287 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189265.634855:0:68287:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff9dc04152c800/0xcc1762b626f8c33c lrc: 3/0,1 mode: --/PW res: [0x20000cf21:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 68287 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784189265.634877:0:68287:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc050542a00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:68287:1870854458200192:0@lo:101:mdt00_004.0 00000100:00100000:0.0:1784189265.634926:0:68287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784189265.634959:0:68287:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dc043ca9240 going to sleep for 11 seconds 00000100:00100000:3.0:1784189265.635163:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458200192 00000100:00100000:3.0:1784189265.635173:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458200192 00000100:00100000:3.0:1784189265.635233:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3882 00000100:00100000:3.0:1784189265.635243:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc050541180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:68287:x1870854458200192:12345-0@lo:101:mdt00_004.0 00010000:00010000:3.0:1784189265.635262:0:8438:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784189265.635280:0:8438:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4369d400/0xcc1762b626f8c343 lrc: 2/0,0 mode: --/PW res: [0x20000cf21:0x1:0x0].0xb04f75d6 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcc1762b626f8c33c expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189265.635307:0:8438:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4369d400/0xcc1762b626f8c343 lrc: 3/0,0 mode: PW/PW res: [0x20000cf21:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xcc1762b626f8c33c expref: 9 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189265.635377:0:8438:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4369d400/0xcc1762b626f8c343 lrc: 3/0,0 mode: PW/PW res: [0x20000cf21:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xcc1762b626f8c33c expref: 9 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189265.635403:0:8438:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x1:0x0].0xb04f75d6 (ffff9dbf45994e00) 00010000:00010000:3.0:1784189265.635407:0:8438:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784189265.635412:0:8438:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dbf4369d400, rc 0) 00000100:00100000:3.0:1784189265.635472:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc050541180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:68287:x1870854458200192:12345-0@lo:101:mdt00_004.0 Request processed in 230us (546us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189265.635479:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3882 00000100:00100000:0.0:1784189265.635571:0:68287:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc050542a00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:68287:1870854458200192:0@lo:101:mdt00_004.0 00010000:00010000:0.0:1784189265.635588:0:68287:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff9dc04152c800/0xcc1762b626f8c33c lrc: 4/0,1 mode: PW/PW res: [0x20000cf21:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xcc1762b626f8c343 expref: -99 pid: 68287 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189265.635613:0:68287:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9dc04152c800/0xcc1762b626f8c33c lrc: 4/0,1 mode: PW/PW res: [0x20000cf21:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xcc1762b626f8c343 expref: -99 pid: 68287 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1784189265.635743:0:68287:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x20000cf21:0x1:0x0] 00000100:00100000:0.0:1784189265.635785:0:68287:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc050542a00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:68287:1870854458200320:0@lo:1000:mdt00_004.0 00000100:00100000:0.0:1784189265.635818:0:68287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784189265.635844:0:68287:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dc043ca9840 going to sleep for 11 seconds 00000100:00100000:1.0:1784189265.635888:0:23826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458200320 00000100:00100000:1.0:1784189265.635893:0:23826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458200320 00000100:00100000:1.0:1784189265.635932:0:23826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3883 00000100:00100000:1.0:1784189265.635940:0:23826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc050543800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:68287:x1870854458200320:12345-0@lo:1000:mdt00_004.0 00000100:00100000:1.0:1784189265.636018:0:23826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc050543800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:68287:x1870854458200320:12345-0@lo:1000:mdt00_004.0 Request processed in 78us (198us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189265.636025:0:23826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3883 00000100:00100000:0.0:1784189265.636081:0:68287:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc050542a00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:68287:1870854458200320:0@lo:1000:mdt00_004.0 00000100:00100000:0.0:1784189265.636121:0:68287:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc050542a00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:68287:1870854458200448:0@lo:1000:mdt00_004.0 00000100:00100000:0.0:1784189265.636146:0:68287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784189265.636170:0:68287:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dc043ca9840 going to sleep for 11 seconds 00000100:00100000:1.0:1784189265.636209:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458200448 00000100:00100000:1.0:1784189265.636213:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458200448 00000100:00100000:1.0:1784189265.636244:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3884 00000100:00100000:1.0:1784189265.636251:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc05ed92a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:68287:x1870854458200448:12345-0@lo:1000:mdt00_004.0 00000100:00100000:1.0:1784189265.636357:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc05ed92a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:68287:x1870854458200448:12345-0@lo:1000:mdt00_004.0 Request processed in 106us (210us total) trans 0 rc -2/-2 00000100:00100000:1.0:1784189265.636364:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3884 00000100:00100000:0.0:1784189265.636428:0:68287:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc050542a00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:68287:1870854458200448:0@lo:1000:mdt00_004.0 00000100:00100000:0.0:1784189265.636713:0:68287:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc050542a00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:68287:1870854458200576:0@lo:1000:mdt00_004.0 00000100:00100000:0.0:1784189265.636739:0:68287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784189265.636793:0:68287:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dc043ca9840 going to sleep for 11 seconds 00000100:00100000:1.0:1784189265.640844:0:23826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458200576 00000100:00100000:1.0:1784189265.640867:0:23826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458200576 00000100:00100000:1.0:1784189265.641017:0:23826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3885 00000100:00100000:1.0:1784189265.641029:0:23826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc07b7e1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:68287:x1870854458200576:12345-0@lo:1000:mdt00_004.0 00000100:00100000:1.0:1784189265.641222:0:23826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc07b7e1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:68287:x1870854458200576:12345-0@lo:1000:mdt00_004.0 Request processed in 194us (4480us total) trans 0 rc -2/-2 00000100:00100000:1.0:1784189265.641231:0:23826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3885 00000100:00100000:3.0:1784189265.641362:0:68287:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc050542a00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:68287:1870854458200576:0@lo:1000:mdt00_004.0 00000100:00100000:3.0:1784189265.641493:0:68287:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc0762d4e00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:68287:1870854458200704:0@lo:1000:mdt00_004.0 00000100:00100000:3.0:1784189265.641540:0:68287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784189265.645854:0:68287:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dbf445d3240 going to sleep for 11 seconds 00000100:00100000:0.0:1784189265.648855:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458200704 00000100:00100000:0.0:1784189265.648878:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458200704 00000100:00100000:0.0:1784189265.648991:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3886 00000100:00100000:0.0:1784189265.649003:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc0762d7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:68287:x1870854458200704:12345-0@lo:1000:mdt00_004.0 00000100:00100000:0.0:1784189265.650760:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc0762d7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:68287:x1870854458200704:12345-0@lo:1000:mdt00_004.0 Request processed in 1748us (9209us total) trans 0 rc 0/0 00000100:00100000:0.0:1784189265.650777:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3886 00010000:00010000:0.0:1784189265.650875:0:7454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784189265.651632:0:68287:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc0762d4e00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:68287:1870854458200704:0@lo:1000:mdt00_004.0 00000100:00100000:3.0:1784189265.651764:0:68287:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc0762d4e00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:68287:1870854458200832:0@lo:1000:mdt00_004.0 00000100:00100000:3.0:1784189265.651828:0:68287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784189265.651859:0:68287:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dbf445d3240 going to sleep for 11 seconds 00000100:00100000:1.0:1784189265.652507:0:23826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458200832 00000100:00100000:1.0:1784189265.652546:0:23826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458200832 00000100:00100000:1.0:1784189265.652622:0:23826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3887 00000100:00100000:1.0:1784189265.652632:0:23826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc0762d7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:68287:x1870854458200832:12345-0@lo:1000:mdt00_004.0 00000100:00100000:1.0:1784189265.652783:0:23826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc0762d7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:68287:x1870854458200832:12345-0@lo:1000:mdt00_004.0 Request processed in 152us (955us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189265.652791:0:23826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3887 00000100:00100000:1.0:1784189265.652846:0:68287:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc0762d4e00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:68287:1870854458200832:0@lo:1000:mdt00_004.0 00000100:00100000:1.0:1784189265.652921:0:68287:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf470e0700 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:68287:1870854458200960:0@lo:1000:mdt00_004.0 00000100:00100000:1.0:1784189265.652955:0:68287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784189265.652983:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458200960 00000100:00100000:1.0:1784189265.652985:0:68287:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dc04673f540 going to sleep for 11 seconds 00000100:00100000:0.0:1784189265.652995:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458200960 00000100:00100000:0.0:1784189265.653047:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3888 00000100:00100000:0.0:1784189265.653053:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf470e1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:68287:x1870854458200960:12345-0@lo:1000:mdt00_004.0 00000100:00100000:0.0:1784189265.653121:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf470e1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:68287:x1870854458200960:12345-0@lo:1000:mdt00_004.0 Request processed in 68us (165us total) trans 0 rc 0/0 00000100:00100000:0.0:1784189265.653128:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3888 00000100:00100000:1.0:1784189265.654172:0:68287:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf470e0700 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:68287:1870854458200960:0@lo:1000:mdt00_004.0 00000040:00080000:1.0:1784189265.655912:0:68287:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x2400090a0:0x2:0x0].4, 968 off37320 00000040:00080000:1.0:1784189265.656019:0:68287:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x2000088d1:0x2:0x0].4, 1120 off37904 00000004:00080000:1.0:1784189265.656027:0:68287:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff9dc04673f540 with version 12 00000004:00080000:1.0:1784189265.656060:0:75594:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9dc05020c840 version 12 rpc_version 12 00000020:00100000:1.0:1784189265.656103:0:75594:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1784189265.656117:0:75594:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9dbf470e0700 x1870854458201216/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 2392/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1784189265.656147:0:75594:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf470e0700 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:75594:1870854458201216:0@lo:1000:osp_up0-1.0 00000100:00100000:1.0:1784189265.656246:0:75594:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784189265.656280:0:75594:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dc071388cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1784189265.657407:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458201216 00000100:00100000:0.0:1784189265.657423:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458201216 00000100:00100000:0.0:1784189265.657506:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3889 00000100:00100000:0.0:1784189265.657516:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf425fb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:75594:x1870854458201216:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:0.0:1784189265.658581:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf425fb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+10:75594:x1870854458201216:12345-0@lo:1000:osp_up0-1.0 Request processed in 1060us (2328us total) trans 115964116998 rc 0/0 00000100:00100000:0.0:1784189265.658596:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3889 00000100:00100000:0.0:1784189265.659031:0:75594:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf470e0700 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:75594:1870854458201216:0@lo:1000:osp_up0-1.0 00010000:00010000:1.0:1784189265.660024:0:68287:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9dbf4710ec00/0xcc1762b626f8c34a lrc: 3/0,1 mode: --/PW res: [0x2400090a5:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189265.660051:0:68287:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9dbf4710ec00/0xcc1762b626f8c34a lrc: 3/0,1 mode: PW/PW res: [0x2400090a5:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 68287 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189265.660087:0:68287:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9dbf4710ec00/0xcc1762b626f8c34a lrc: 3/0,1 mode: PW/PW res: [0x2400090a5:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 68287 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1784189265.660112:0:68287:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000bf7a9a73 reply state 00000000bde0b060 transno 81604378755 ns: mdt-lustre-MDT0001_UUID lock: ffff9dbf4710ec00/0xcc1762b626f8c34a lrc: 3/0,1 mode: PW/PW res: [0x2400090a5:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 68287 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189265.660126:0:68287:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9dbf4710ec00/0xcc1762b626f8c34a lrc: 3/0,1 mode: TXN/TXN res: [0x2400090a5:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 68287 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189265.660135:0:68287:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x2:0x0].0x0 (ffff9dc0455f8000) 00010000:00010000:1.0:1784189265.660138:0:68287:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1784189265.660143:0:68287:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1784189265.660151:0:68287:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2400090a5:0x2:0x0]: returning size 4096 00000004:00080000:1.0:1784189265.660163:0:68287:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x20000cf21:0x1:0x0] 00010000:00010000:1.0:1784189265.660387:0:68287:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9dc04152d200/0xcc1762b626f8c32e lrc: 4/0,1 mode: CW/CW res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xcc1762b626f8c335 expref: -99 pid: 68287 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189265.660399:0:68287:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9dc04152d200/0xcc1762b626f8c32e lrc: 4/0,1 mode: CW/CW res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xcc1762b626f8c335 expref: -99 pid: 68287 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189265.660407:0:68287:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9dc04152d200/0xcc1762b626f8c32e lrc: 3/0,0 mode: CW/CW res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xcc1762b626f8c335 expref: -99 pid: 68287 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189265.660432:0:68287:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:1.0:1784189265.660448:0:68287:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x20000cf21:0x1:0x0] 00010000:00010000:1.0:1784189265.660454:0:68287:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9dc04152c800/0xcc1762b626f8c33c lrc: 4/0,1 mode: PW/PW res: [0x20000cf21:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xcc1762b626f8c343 expref: -99 pid: 68287 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189265.660462:0:68287:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-osp-MDT0001 lock: ffff9dc04152c800/0xcc1762b626f8c33c lrc: 3/0,0 mode: PW/PW res: [0x20000cf21:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xcc1762b626f8c343 expref: -99 pid: 68287 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189265.660590:0:6501:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784189265.660599:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff9dc04152d200/0xcc1762b626f8c32e lrc: 2/0,0 mode: CW/CW res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0xcc1762b626f8c335 expref: -99 pid: 68287 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189265.660609:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc04152d200 already unused, calling callback (ffffffffc1767ed0) 00010000:00010000:3.0:1784189265.660628:0:6501:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff9dc04152d200/0xcc1762b626f8c32e lrc: 3/0,0 mode: CW/CW res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xcc1762b626f8c335 expref: -99 pid: 68287 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1784189265.660638:0:6501:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9dc04152d200/0xcc1762b626f8c32e lrc: 3/0,0 mode: CW/CW res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xcc1762b626f8c335 expref: -99 pid: 68287 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189265.660701:0:6501:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff9dc04152d200/0xcc1762b626f8c32e lrc: 2/0,0 mode: --/CW res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xcc1762b626f8c335 expref: -99 pid: 68287 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189265.660709:0:6501:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1784189265.660735:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9dc04152d200/0xcc1762b626f8c32e lrc: 1/0,0 mode: --/CW res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xcc1762b626f8c335 expref: -99 pid: 68287 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189265.660743:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9dc04152d200/0xcc1762b626f8c32e lrc: 0/0,0 mode: --/CW res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xcc1762b626f8c335 expref: -99 pid: 68287 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189265.660765:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784189265.660767:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784189265.660770:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784189265.660780:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1784189265.660800:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc0762d4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1870854458201344:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1784189265.660879:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784189265.660933:0:7455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458201344 00000100:00100000:3.0:1784189265.660941:0:7455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458201344 00000100:00100000:3.0:1784189265.660996:0:7455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 712 00000100:00100000:3.0:1784189265.661005:0:7455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc0762d6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0001-mdtlov_UUID+10:3643:x1870854458201344:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1784189265.661021:0:7455:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784189265.661055:0:7455:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04152c400/0xcc1762b626f8c335 lrc: 0/0,0 mode: --/CW res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xcc1762b626f8c32e expref: 10 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189265.661080:0:7455:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x1:0x0].0x0 (ffff9dc0455f8400) 00010000:00010000:3.0:1784189265.661090:0:7455:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784189265.661121:0:7455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc0762d6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0001-mdtlov_UUID+9:3643:x1870854458201344:12345-0@lo:103:ldlm_bl.0 Request processed in 117us (242us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189265.661136:0:7455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 712 00000100:00100000:3.0:1784189265.661195:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc0762d4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1870854458201344:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1784189265.662840:0:68287:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc07016d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:debedd94-805c-42a0-a5e5-41758b2012e9+7:71953:x1870854436311680:12345-192.168.203.12@tcp:36:mkdir.0 Request processed in 46892us (50126us total) trans 81604378755 rc 0/0 00000100:00100000:1.0:1784189265.662853:0:68287:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1359 00010000:00010000:0.0:1784189265.665649:0:75588:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff9dc04152c800/0xcc1762b626f8c33c lrc: 3/0,0 mode: PW/PW res: [0x20000cf21:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xcc1762b626f8c343 expref: -99 pid: 68287 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1784189265.665677:0:75588:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9dc04152c800/0xcc1762b626f8c33c lrc: 3/0,0 mode: PW/PW res: [0x20000cf21:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xcc1762b626f8c343 expref: -99 pid: 68287 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189265.665875:0:75588:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff9dc04152c800/0xcc1762b626f8c33c lrc: 2/0,0 mode: --/PW res: [0x20000cf21:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xcc1762b626f8c343 expref: -99 pid: 68287 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189265.665884:0:75588:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1784189265.665922:0:75588:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9dc04152c800/0xcc1762b626f8c33c lrc: 0/0,0 mode: --/PW res: [0x20000cf21:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xcc1762b626f8c343 expref: -99 pid: 68287 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1784189265.665950:0:75588:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 81604378755 is committed 00000020:00080000:0.0:1784189265.665984:0:75588:0:(update_trans.c:1348:distribute_txn_batchid_cb()) lustre-MDT0001: 77309411387 batchid updated 00000020:00080000:0.0:1784189265.666009:0:75608:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 77309411387 00000004:00080000:0.0:1784189265.666097:0:75608:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff9dc043ca99c0 with version 13 00000020:00080000:0.0:1784189265.666109:0:75608:0:(update_trans.c:1311:distribute_txn_cancel_records()) lustre-MDT0000-osp-MDT0001: batchid 77309411387 cancel update log [0x2000088d1:0x2:0x0].3: rc = 0 00000020:00080000:0.0:1784189265.666213:0:75608:0:(update_trans.c:1311:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 77309411387 cancel update log [0x2400090a0:0x2:0x0].3: rc = 0 00000020:00080000:0.0:1784189265.666223:0:75608:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 77309411387 00000004:00080000:0.0:1784189265.666232:0:75594:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9dc05020c840 version 13 rpc_version 13 00000020:00100000:0.0:1784189265.666254:0:75594:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1784189265.666267:0:75594:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9dc07b7e0a80 x1870854458201728/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1784189265.666291:0:75594:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc07b7e0a80 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:75594:1870854458201728:0@lo:1000:osp_up0-1.0 00000100:00100000:0.0:1784189265.667243:0:75594:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784189265.667283:0:75594:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dc043ca90c0 going to sleep for 11 seconds 00000100:00100000:3.0:1784189265.667717:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc07b7e2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1870854458201472:0@lo:103:jbd2/dm-1-8.0 00000100:00100000:3.0:1784189265.667764:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784189265.667815:0:25703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458201472 00000100:00100000:3.0:1784189265.667823:0:25703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458201472 00000100:00100000:3.0:1784189265.667886:0:25703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 713 00000100:00100000:3.0:1784189265.667895:0:25703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc0762d4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0001-mdtlov_UUID+9:3643:x1870854458201472:12345-0@lo:103:jbd2/dm-1-8.0 00010000:00010000:3.0:1784189265.667912:0:25703:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784189265.667940:0:25703:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4369d400/0xcc1762b626f8c343 lrc: 0/0,0 mode: --/PW res: [0x20000cf21:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xcc1762b626f8c33c expref: 9 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189265.667960:0:25703:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x1:0x0].0xb04f75d6 (ffff9dbf45994e00) 00010000:00010000:3.0:1784189265.667972:0:25703:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784189265.668010:0:25703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc0762d4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0001-mdtlov_UUID+8:3643:x1870854458201472:12345-0@lo:103:jbd2/dm-1-8.0 Request processed in 115us (244us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189265.668018:0:25703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 713 00000100:00100000:3.0:1784189265.668076:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc07b7e2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1870854458201472:0@lo:103:jbd2/dm-1-8.0 00010000:00010000:2.0:1784189265.668087:0:3627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9dbf4710ec00/0xcc1762b626f8c34a lrc: 3/0,1 mode: TXN/TXN res: [0x2400090a5:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 68287 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189265.668100:0:3627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9dbf4710ec00/0xcc1762b626f8c34a lrc: 2/0,0 mode: TXN/TXN res: [0x2400090a5:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 68287 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189265.668108:0:3627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9dbf4710ec00/0xcc1762b626f8c34a lrc: 3/0,0 mode: TXN/TXN res: [0x2400090a5:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 68287 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189265.668131:0:3627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dbf4710ec00 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:2.0:1784189265.668137:0:3627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9dbf4710ec00/0xcc1762b626f8c34a lrc: 3/0,0 mode: TXN/TXN res: [0x2400090a5:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 68287 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189265.668145:0:3627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9dbf4710ec00/0xcc1762b626f8c34a lrc: 4/0,0 mode: TXN/TXN res: [0x2400090a5:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 68287 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189265.668156:0:3627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x2:0x0].0x0 (ffff9dc0455f8000) 00010000:00010000:2.0:1784189265.668159:0:3627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784189265.668163:0:3627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9dbf4710ec00/0xcc1762b626f8c34a lrc: 2/0,0 mode: --/TXN res: [0x2400090a5:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 68287 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189265.668170:0:3627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9dbf4710ec00/0xcc1762b626f8c34a lrc: 0/0,0 mode: --/TXN res: [0x2400090a5:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 68287 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784189265.668505:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458201728 00000100:00100000:1.0:1784189265.668512:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458201728 00000100:00100000:1.0:1784189265.668561:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3890 00000100:00100000:1.0:1784189265.668569:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc07b7e3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:75594:x1870854458201728:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:1.0:1784189265.668805:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc07b7e3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:75594:x1870854458201728:12345-0@lo:1000:osp_up0-1.0 Request processed in 236us (1567us total) trans 115964116999 rc 0/0 00000100:00100000:1.0:1784189265.668813:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3890 00000100:00100000:2.0:1784189265.669280:0:75594:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc07b7e0a80 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:75594:1870854458201728:0@lo:1000:osp_up0-1.0 00000100:00100000:2.0:1784189265.671834:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1784189265.672047:0:66170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436311936 00000100:00100000:3.0:1784189265.672060:0:66170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436311936 00000100:00100000:3.0:1784189265.672140:0:66170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1360 00000100:00100000:3.0:1784189265.672151:0:66170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc07016f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:debedd94-805c-42a0-a5e5-41758b2012e9+7:71953:x1870854436311936:12345-192.168.203.12@tcp:36:mkdir.0 00010000:00010000:3.0:1784189265.672227:0:66170:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784189265.672263:0:66170:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04a20b200/0xcc1762b626f8c30b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c4001 expref: 7 pid: 66945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189265.672304:0:66170:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9dc0630a6700) 00010000:00010000:3.0:1784189265.672310:0:66170:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784189265.672609:0:66170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc07016f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:debedd94-805c-42a0-a5e5-41758b2012e9+6:71953:x1870854436311936:12345-192.168.203.12@tcp:36:mkdir.0 Request processed in 457us (786us total) trans 0 rc -17/-17 00000100:00100000:2.0:1784189265.672618:0:66170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1360 00000100:00100000:2.0:1784189265.675641:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1784189265.675782:0:66171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436312064 00000100:00100000:3.0:1784189265.675794:0:66171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436312064 00000100:00100000:3.0:1784189265.675871:0:66171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1361 00000100:00100000:3.0:1784189265.675883:0:66171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc07016f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:debedd94-805c-42a0-a5e5-41758b2012e9+6:71953:x1870854436312064:12345-192.168.203.12@tcp:101:mkdir.0 00010000:00010000:3.0:1784189265.675910:0:66171:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784189265.675937:0:66171:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4369d000/0xcc1762b626f8c351 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbfc5de7fe6c400f expref: -99 pid: 66171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189265.676024:0:66171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4369de00/0xcc1762b626f8c358 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189265.676041:0:66171:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4369de00/0xcc1762b626f8c358 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189265.676055:0:66171:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4369de00/0xcc1762b626f8c358 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784189265.678839:0:66171:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1784189265.678853:0:66171:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1784189265.678889:0:66171:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4369de00/0xcc1762b626f8c358 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189265.678945:0:66171:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4369d000/0xcc1762b626f8c351 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c400f expref: 8 pid: 66171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189265.678973:0:66171:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4369de00/0xcc1762b626f8c358 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c400f expref: 7 pid: 66171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189265.679007:0:66171:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9dc0630a6700) 00010000:00010000:3.0:1784189265.679010:0:66171:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1784189265.679014:0:66171:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dbf4369de00, rc 0) 00000100:00100000:2.0:1784189265.681900:0:66171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc07016f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:debedd94-805c-42a0-a5e5-41758b2012e9+7:71953:x1870854436312064:12345-192.168.203.12@tcp:101:mkdir.0 Request processed in 5999us (6252us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189265.681919:0:66171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1361 00000100:00100000:3.0:1784189265.684276:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1784189265.684493:0:68287:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436312192 00000100:00100000:1.0:1784189265.684506:0:68287:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436312192 00000100:00100000:1.0:1784189265.684589:0:68287:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1362 00000100:00100000:1.0:1784189265.684601:0:68287:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc0762d4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:debedd94-805c-42a0-a5e5-41758b2012e9+7:71953:x1870854436312192:12345-192.168.203.12@tcp:101:mkdir.0 00010000:00010000:1.0:1784189265.684640:0:68287:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784189265.684668:0:68287:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4710e000/0xcc1762b626f8c35f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbfc5de7fe6c4016 expref: -99 pid: 68287 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189265.684916:0:68287:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4710f800/0xcc1762b626f8c366 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189265.684933:0:68287:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4710f800/0xcc1762b626f8c366 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189265.684947:0:68287:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4710f800/0xcc1762b626f8c366 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189265.684991:0:68287:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4710e200/0xcc1762b626f8c36d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189265.684999:0:68287:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4710e200/0xcc1762b626f8c36d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189265.685007:0:68287:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4710e200/0xcc1762b626f8c36d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189265.685125:0:68287:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4710ec00/0xcc1762b626f8c374 lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189265.685134:0:68287:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4710ec00/0xcc1762b626f8c374 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189265.685141:0:68287:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4710ec00/0xcc1762b626f8c374 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784189265.685586:0:68287:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000cf21:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1784189265.685665:0:68287:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1784189265.685772:0:68287:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4710ec00/0xcc1762b626f8c374 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189265.685793:0:68287:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4710f800/0xcc1762b626f8c366 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189265.685801:0:68287:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4710f800/0xcc1762b626f8c366 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189265.685807:0:68287:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4710f800/0xcc1762b626f8c366 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189265.685839:0:68287:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4710f800/0xcc1762b626f8c366 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189265.685846:0:68287:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dbf4710f800 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:1.0:1784189265.685850:0:68287:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4710f800/0xcc1762b626f8c366 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189265.685858:0:68287:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4710f800/0xcc1762b626f8c366 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189265.685881:0:68287:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9dc0630a6700) 00010000:00010000:1.0:1784189265.685885:0:68287:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784189265.685889:0:68287:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4710f800/0xcc1762b626f8c366 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189265.685895:0:68287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4710f800/0xcc1762b626f8c366 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189265.685923:0:68287:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4710e200/0xcc1762b626f8c36d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189265.685929:0:68287:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4710e200/0xcc1762b626f8c36d lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189265.685935:0:68287:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4710e200/0xcc1762b626f8c36d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189265.685939:0:68287:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dbf4710e200 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:1.0:1784189265.685942:0:68287:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4710e200/0xcc1762b626f8c36d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189265.685958:0:68287:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4710e200/0xcc1762b626f8c36d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189265.685967:0:68287:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x91905c78 (ffff9dc0455f8f00) 00010000:00010000:1.0:1784189265.685970:0:68287:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784189265.685975:0:68287:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4710e200/0xcc1762b626f8c36d lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189265.685981:0:68287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4710e200/0xcc1762b626f8c36d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189265.686025:0:68287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4710e000/0xcc1762b626f8c35f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c4016 expref: 9 pid: 68287 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189265.686039:0:68287:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4710ec00/0xcc1762b626f8c374 lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c4016 expref: 8 pid: 68287 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189265.686047:0:68287:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x1:0x0].0x0 (ffff9dc0455f8800) 00010000:00010000:1.0:1784189265.686049:0:68287:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1784189265.686052:0:68287:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dbf4710ec00, rc 0) 00000100:00100000:1.0:1784189265.687346:0:68287:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc0762d4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:debedd94-805c-42a0-a5e5-41758b2012e9+8:71953:x1870854436312192:12345-192.168.203.12@tcp:101:mkdir.0 Request processed in 2739us (3075us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189265.687359:0:68287:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1362 00000100:00100000:1.0:1784189265.691413:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1784189265.692967:0:66169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436312448 00000100:00100000:0.0:1784189265.692981:0:66169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436312448 00000100:00100000:0.0:1784189265.693041:0:66169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1363 00000100:00100000:0.0:1784189265.693050:0:66169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc05653a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:debedd94-805c-42a0-a5e5-41758b2012e9+5:71953:x1870854436312448:12345-192.168.203.12@tcp:36:mkdir.0 00000100:00100000:0.0:1784189265.693176:0:66169:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc07b7e0e00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:66169:1870854458201856:0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1784189265.693234:0:66169:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784189265.693274:0:66169:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dc043ca90c0 going to sleep for 11 seconds 00000100:00100000:3.0:1784189265.693579:0:23826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458201856 00000100:00100000:3.0:1784189265.693584:0:23826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458201856 00000100:00100000:3.0:1784189265.693797:0:23826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3891 00000100:00100000:3.0:1784189265.693806:0:23826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc07b7e3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:66169:x1870854458201856:12345-0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1784189265.693897:0:23826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc07b7e3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:66169:x1870854458201856:12345-0@lo:1000:mdt00_000.0 Request processed in 92us (662us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189265.693906:0:23826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3891 00000100:00100000:1.0:1784189265.693941:0:66169:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc07b7e0e00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:66169:1870854458201856:0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1784189265.693994:0:66169:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf4367ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:66169:1870854458201984:0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1784189265.694023:0:66169:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784189265.694049:0:66169:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dc0760670c0 going to sleep for 11 seconds 00000100:00100000:0.0:1784189265.694195:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458201984 00000100:00100000:0.0:1784189265.694200:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458201984 00000100:00100000:0.0:1784189265.694262:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3892 00000100:00100000:0.0:1784189265.694269:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf4367ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:66169:x1870854458201984:12345-0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1784189265.694372:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf4367ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:66169:x1870854458201984:12345-0@lo:1000:mdt00_000.0 Request processed in 103us (347us total) trans 0 rc -2/-2 00000100:00100000:0.0:1784189265.694388:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3892 00000100:00100000:3.0:1784189265.694723:0:66169:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf4367ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:66169:1870854458201984:0@lo:1000:mdt00_000.0 00010000:00010000:3.0:1784189265.694778:0:66169:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9dbf4369d000/0xcc1762b626f8c37b lrc: 3/0,1 mode: --/CW res: [0x20000cf21:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189265.694788:0:66169:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff9dbf4369d000/0xcc1762b626f8c37b lrc: 3/0,1 mode: --/CW res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 66169 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189265.694798:0:66169:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff9dbf4369d000/0xcc1762b626f8c37b lrc: 3/0,1 mode: --/CW res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 66169 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784189265.694809:0:66169:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc0762d5f80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:66169:1870854458202112:0@lo:101:mdt00_000.0 00000100:00100000:3.0:1784189265.694836:0:66169:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784189265.699833:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458202112 00000100:00100000:1.0:1784189265.699846:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458202112 00000100:00100000:0.0:1784189265.699910:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3893 00000100:00100000:0.0:1784189265.699922:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc0762d5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:66169:x1870854458202112:12345-0@lo:101:mdt00_000.0 00010000:00010000:0.0:1784189265.699943:0:8439:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784189265.699965:0:8439:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04152c800/0xcc1762b626f8c382 lrc: 2/0,0 mode: --/CW res: [0x20000cf21:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcc1762b626f8c37b expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189265.699997:0:8439:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4710ec00/0xcc1762b626f8c374 lrc: 2/0,0 mode: PR/PR res: [0x20000cf21:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c4016 expref: 7 pid: 68287 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189265.700009:0:8439:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04152c800/0xcc1762b626f8c382 lrc: 4/0,0 mode: --/CW res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xcc1762b626f8c37b expref: 10 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189265.700043:0:8439:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4710ec00/0xcc1762b626f8c374 lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c4016 expref: 7 pid: 68287 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189265.700057:0:8439:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4710ec00/0xcc1762b626f8c374 lrc: 4/0,0 mode: PR/PR res: [0x20000cf21:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c4016 expref: 7 pid: 68287 timeout: 3607 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784189265.700071:0:8439:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc07b7e1880 pname:cluuid:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000_UUID:8439:1870854458202240:192.168.203.12@tcp:104: 00000100:00100000:0.0:1784189265.701003:0:8439:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dc043ca9240 going to sleep for 11 seconds 00000100:00100000:0.0:1784189265.707523:0:66169:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dbf445d3b40 going to sleep for 11 seconds 00000100:00100000:0.0:1784189265.719772:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1784189265.721604:0:8439:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc07b7e1880 pname:cluuid:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000_UUID:8439:1870854458202240:192.168.203.12@tcp:104: 00010000:00010000:1.0:1784189265.721650:0:8439:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04152c800/0xcc1762b626f8c382 lrc: 3/0,0 mode: --/CW res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xcc1762b626f8c37b expref: 10 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189265.721663:0:8439:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x1:0x0].0x0 (ffff9dc0455f8800) 00010000:00010000:1.0:1784189265.721666:0:8439:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784189265.721671:0:8439:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04152c800/0xcc1762b626f8c382 lrc: 3/0,0 mode: --/CW res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xcc1762b626f8c37b expref: 10 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189265.721681:0:8439:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc04152c800, rc 0) 00000100:00100000:1.0:1784189265.721744:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc0762d5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+10:66169:x1870854458202112:12345-0@lo:101:mdt00_000.0 Request processed in 21825us (26906us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189265.721753:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3893 00000100:00100000:2.0:1784189265.723669:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436312576 00000100:00100000:2.0:1784189265.723684:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436312576 00010000:00010000:2.0:1784189265.723726:0:6499:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4710ec00/0xcc1762b626f8c374 lrc: 4/0,0 mode: PR/PR res: [0x20000cf21:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c4016 expref: 8 pid: 68287 timeout: 3607 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784189265.723791:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 2577 00000100:00100000:2.0:1784189265.723801:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc07b7e1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:debedd94-805c-42a0-a5e5-41758b2012e9+8:2396:x1870854436312576:12345-192.168.203.12@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1784189265.723816:0:6499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784189265.723823:0:6499:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4710ec00/0xcc1762b626f8c374 lrc: 4/0,0 mode: PR/PR res: [0x20000cf21:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c4016 expref: 8 pid: 68287 timeout: 3607 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189265.723834:0:6499:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4710ec00/0xcc1762b626f8c374 lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c4016 expref: 8 pid: 68287 timeout: 3607 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189265.723856:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4710ec00/0xcc1762b626f8c374 lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c4016 expref: 8 pid: 68287 timeout: 3607 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189265.723873:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x1:0x0].0x0 (ffff9dc0455f8800) 00010000:00010000:2.0:1784189265.723879:0:6499:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04152c800/0xcc1762b626f8c382 lrc: 2/0,0 mode: --/CW res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xcc1762b626f8c37b expref: 9 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189265.723892:0:6499:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04152c800/0xcc1762b626f8c382 lrc: 2/0,0 mode: CW/CW res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0xcc1762b626f8c37b expref: 9 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189265.723900:0:6499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04152c800/0xcc1762b626f8c382 lrc: 3/0,0 mode: CW/CW res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0xcc1762b626f8c37b expref: 9 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189265.723933:0:6499:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04152c800/0xcc1762b626f8c382 lrc: 3/0,0 mode: CW/CW res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xcc1762b626f8c37b expref: 9 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784189265.723948:0:6499:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc07016e680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0000_UUID:6499:1870854458202368:0@lo:105: 00000100:00100000:2.0:1784189265.724015:0:6499:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784189265.724061:0:6499:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dc0761bb180 going to sleep for 11 seconds 00000100:00100000:0.0:1784189265.724670:0:66169:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc0762d5f80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:66169:1870854458202112:0@lo:101:mdt00_000.0 00010000:00010000:0.0:1784189265.724690:0:66169:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9dbf4369d000/0xcc1762b626f8c37b lrc: 4/0,1 mode: --/CW res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xcc1762b626f8c382 expref: -99 pid: 66169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189265.724716:0:66169:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: lustre-MDT0000-osp-MDT0001 lock: ffff9dbf4369d000/0xcc1762b626f8c37b lrc: 4/0,1 mode: --/CW res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xcc1762b626f8c382 expref: -99 pid: 66169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784189265.724847:0:49501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458202368 00000100:00100000:1.0:1784189265.724853:0:49501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458202368 00000100:00100000:1.0:1784189265.724896:0:49501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 334 00000100:00100000:1.0:1784189265.724903:0:49501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc07016e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:lustre-MDT0001-mdtlov_UUID+4:6499:x1870854458202368:12345-0@lo:105: 00010000:00010000:1.0:1784189265.724912:0:49501:0:(ldlm_lockd.c:2518:ldlm_callback_handler()) ### completion ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff9dbf4369d000/0xcc1762b626f8c37b lrc: 5/0,1 mode: --/CW res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xcc1762b626f8c382 expref: -99 pid: 66169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189265.724921:0:49501:0:(ldlm_lockd.c:1968:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-MDT0000-osp-MDT0001 lock: ffff9dbf4369d000/0xcc1762b626f8c37b lrc: 5/0,1 mode: --/CW res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xcc1762b626f8c382 expref: -99 pid: 66169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189265.724928:0:49501:0:(ldlm_lockd.c:2045:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-MDT0000-osp-MDT0001 lock: ffff9dbf4369d000/0xcc1762b626f8c37b lrc: 5/0,1 mode: --/CW res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xcc1762b626f8c382 expref: -99 pid: 66169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189265.724948:0:49501:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9dbf4369d000/0xcc1762b626f8c37b lrc: 5/0,1 mode: CW/CW res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xcc1762b626f8c382 expref: -99 pid: 66169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189265.724955:0:49501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff9dbf4369d000/0xcc1762b626f8c37b lrc: 6/0,1 mode: CW/CW res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xcc1762b626f8c382 expref: -99 pid: 66169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189265.724963:0:49501:0:(ldlm_lockd.c:2073:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-MDT0000-osp-MDT0001 lock: ffff9dbf4369d000/0xcc1762b626f8c37b lrc: 6/0,1 mode: CW/CW res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1080000000000 nid: local remote: 0xcc1762b626f8c382 expref: -99 pid: 66169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189265.724985:0:49501:0:(ldlm_lockd.c:2084:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff9dbf4369d000) 00000100:00100000:1.0:1784189265.725036:0:49501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc07016e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:lustre-MDT0001-mdtlov_UUID+4:6499:x1870854458202368:12345-0@lo:105: Request processed in 132us (1019us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189265.725043:0:49501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 334 00000100:00100000:1.0:1784189265.725075:0:6499:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc07016e680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0000_UUID:6499:1870854458202368:0@lo:105: 00010000:00010000:1.0:1784189265.725090:0:6499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784189265.725131:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc07b7e1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:debedd94-805c-42a0-a5e5-41758b2012e9+7:2396:x1870854436312576:12345-192.168.203.12@tcp:103:ldlm_bl.0 Request processed in 1331us (5366us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189265.725140:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 2577 00010000:00010000:2.0:1784189265.729398:0:66169:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: lustre-MDT0000-osp-MDT0001 lock: ffff9dbf4369d000/0xcc1762b626f8c37b lrc: 4/0,1 mode: CW/CW res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xcc1762b626f8c382 expref: -99 pid: 66169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189265.729535:0:66169:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9dbf4369d000/0xcc1762b626f8c37b lrc: 4/0,1 mode: CW/CW res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xcc1762b626f8c382 expref: -99 pid: 66169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1784189265.729565:0:66169:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x20000cf21:0x1:0x0] 00010000:00010000:2.0:1784189265.729619:0:66169:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9dc04a20b600/0xcc1762b626f8c389 lrc: 3/0,1 mode: --/PW res: [0x20000cf21:0x1:0x0].0x8f93a2f9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189265.729627:0:66169:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff9dc04a20b600/0xcc1762b626f8c389 lrc: 3/0,1 mode: --/PW res: [0x20000cf21:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 66169 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189265.729639:0:66169:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff9dc04a20b600/0xcc1762b626f8c389 lrc: 3/0,1 mode: --/PW res: [0x20000cf21:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 66169 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784189265.729663:0:66169:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc07016ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:66169:1870854458202496:0@lo:101:mdt00_000.0 00000100:00100000:2.0:1784189265.729793:0:66169:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784189265.729829:0:66169:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dc0761bb180 going to sleep for 11 seconds 00000100:00100000:0.0:1784189265.729868:0:26492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458202496 00000100:00100000:0.0:1784189265.729878:0:26492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458202496 00000100:00100000:0.0:1784189265.729940:0:26492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3894 00000100:00100000:0.0:1784189265.729950:0:26492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc07016ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+10:66169:x1870854458202496:12345-0@lo:101:mdt00_000.0 00010000:00010000:0.0:1784189265.729968:0:26492:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784189265.729986:0:26492:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04152c200/0xcc1762b626f8c390 lrc: 2/0,0 mode: --/PW res: [0x20000cf21:0x1:0x0].0x8f93a2f9 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcc1762b626f8c389 expref: -99 pid: 26492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189265.730013:0:26492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04152c200/0xcc1762b626f8c390 lrc: 3/0,0 mode: PW/PW res: [0x20000cf21:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xcc1762b626f8c389 expref: 11 pid: 26492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189265.730029:0:26492:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04152c200/0xcc1762b626f8c390 lrc: 3/0,0 mode: PW/PW res: [0x20000cf21:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xcc1762b626f8c389 expref: 11 pid: 26492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189265.730037:0:26492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x1:0x0].0x8f93a2f9 (ffff9dc074ae2700) 00010000:00010000:0.0:1784189265.730040:0:26492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784189265.730043:0:26492:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc04152c200, rc 0) 00000100:00100000:0.0:1784189265.730107:0:26492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc07016ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+11:66169:x1870854458202496:12345-0@lo:101:mdt00_000.0 Request processed in 148us (303us total) trans 0 rc 0/0 00000100:00100000:0.0:1784189265.730115:0:26492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3894 00000100:00100000:3.0:1784189265.730172:0:66169:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc07016ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:66169:1870854458202496:0@lo:101:mdt00_000.0 00010000:00010000:3.0:1784189265.730188:0:66169:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff9dc04a20b600/0xcc1762b626f8c389 lrc: 4/0,1 mode: PW/PW res: [0x20000cf21:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xcc1762b626f8c390 expref: -99 pid: 66169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189265.730215:0:66169:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9dc04a20b600/0xcc1762b626f8c389 lrc: 4/0,1 mode: PW/PW res: [0x20000cf21:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xcc1762b626f8c390 expref: -99 pid: 66169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1784189265.730231:0:66169:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x20000cf21:0x1:0x0] 00000100:00100000:3.0:1784189265.730280:0:66169:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc0762d4a80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:66169:1870854458202624:0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1784189265.730309:0:66169:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784189265.730355:0:66169:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dbf445d36c0 going to sleep for 11 seconds 00000100:00100000:0.0:1784189265.730393:0:23826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458202624 00000100:00100000:0.0:1784189265.730398:0:23826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458202624 00000100:00100000:0.0:1784189265.731092:0:23826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3895 00000100:00100000:0.0:1784189265.731111:0:23826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc0762d5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+11:66169:x1870854458202624:12345-0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1784189265.731237:0:23826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc0762d5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+11:66169:x1870854458202624:12345-0@lo:1000:mdt00_000.0 Request processed in 129us (926us total) trans 0 rc 0/0 00000100:00100000:0.0:1784189265.731244:0:23826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3895 00000100:00100000:3.0:1784189265.731368:0:66169:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc0762d4a80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:66169:1870854458202624:0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1784189265.731792:0:66169:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc0762d4a80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:66169:1870854458202752:0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1784189265.731837:0:66169:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784189265.731860:0:66169:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dc0761bb6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1784189265.731895:0:26492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458202752 00000100:00100000:0.0:1784189265.731900:0:26492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458202752 00000100:00100000:0.0:1784189265.731934:0:26492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3896 00000100:00100000:0.0:1784189265.731941:0:26492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc07016ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+11:66169:x1870854458202752:12345-0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1784189265.732029:0:26492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc07016ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+11:66169:x1870854458202752:12345-0@lo:1000:mdt00_000.0 Request processed in 88us (191us total) trans 0 rc -2/-2 00000100:00100000:0.0:1784189265.732036:0:26492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3896 00000100:00100000:3.0:1784189265.732079:0:66169:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc0762d4a80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:66169:1870854458202752:0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1784189265.732155:0:66169:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc0762d4a80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:66169:1870854458202880:0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1784189265.732183:0:66169:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784189265.732209:0:66169:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dbf445d36c0 going to sleep for 11 seconds 00000100:00100000:0.0:1784189265.732342:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458202880 00000100:00100000:0.0:1784189265.732346:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458202880 00000100:00100000:0.0:1784189265.732371:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3897 00000100:00100000:0.0:1784189265.732378:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc0762d4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+11:66169:x1870854458202880:12345-0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1784189265.732516:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc0762d4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+11:66169:x1870854458202880:12345-0@lo:1000:mdt00_000.0 Request processed in 138us (332us total) trans 0 rc -2/-2 00000100:00100000:0.0:1784189265.732523:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3897 00000100:00100000:0.0:1784189265.732552:0:66169:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc0762d4a80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:66169:1870854458202880:0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1784189265.732601:0:66169:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc07b7e3800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:66169:1870854458203008:0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1784189265.732626:0:66169:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784189265.732738:0:66169:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dc043ca9d80 going to sleep for 11 seconds 00000100:00100000:1.0:1784189265.733062:0:26492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458203008 00000100:00100000:1.0:1784189265.733067:0:26492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458203008 00000100:00100000:1.0:1784189265.733191:0:26492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3898 00000100:00100000:1.0:1784189265.733200:0:26492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc07b7e1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+11:66169:x1870854458203008:12345-0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1784189265.733272:0:26492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc07b7e1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+11:66169:x1870854458203008:12345-0@lo:1000:mdt00_000.0 Request processed in 73us (644us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189265.733279:0:26492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3898 00000100:00100000:1.0:1784189265.733538:0:66169:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc07b7e3800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:66169:1870854458203008:0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1784189265.733595:0:66169:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf4367f100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:66169:1870854458203136:0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1784189265.733621:0:66169:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784189265.733643:0:66169:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dbf43e3a780 going to sleep for 11 seconds 00000100:00100000:2.0:1784189265.733684:0:26492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458203136 00000100:00100000:2.0:1784189265.733697:0:26492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458203136 00000100:00100000:2.0:1784189265.733729:0:26492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3899 00000100:00100000:2.0:1784189265.733737:0:26492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf4367d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+11:66169:x1870854458203136:12345-0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1784189265.733793:0:26492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf4367d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+11:66169:x1870854458203136:12345-0@lo:1000:mdt00_000.0 Request processed in 57us (171us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189265.733816:0:26492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3899 00000100:00100000:1.0:1784189265.734035:0:66169:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf4367f100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:66169:1870854458203136:0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1784189265.734091:0:66169:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf4367f100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:66169:1870854458203264:0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1784189265.734114:0:66169:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784189265.734133:0:66169:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dbf43e3a000 going to sleep for 11 seconds 00000100:00100000:2.0:1784189265.734375:0:26492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458203264 00000100:00100000:2.0:1784189265.734380:0:26492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458203264 00000100:00100000:2.0:1784189265.734400:0:26492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3900 00000100:00100000:2.0:1784189265.734414:0:26492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf4367d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+11:66169:x1870854458203264:12345-0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1784189265.734472:0:26492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf4367d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+11:66169:x1870854458203264:12345-0@lo:1000:mdt00_000.0 Request processed in 66us (356us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189265.734479:0:26492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3900 00000100:00100000:1.0:1784189265.734595:0:66169:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf4367f100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:66169:1870854458203264:0@lo:1000:mdt00_000.0 00000040:00080000:1.0:1784189265.735907:0:66169:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x2400090a0:0x2:0x0].5, 968 off38288 00000040:00080000:1.0:1784189265.735980:0:66169:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x2000088d1:0x2:0x0].5, 1120 off39024 00000004:00080000:1.0:1784189265.735987:0:66169:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff9dbf43e3a780 with version 14 00000004:00080000:2.0:1784189265.736129:0:75594:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9dc05020c840 version 14 rpc_version 14 00000020:00100000:2.0:1784189265.736159:0:75594:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:2.0:1784189265.736168:0:75594:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9dc07016fb80 x1870854458203520/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 2136/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1784189265.736189:0:75594:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc07016fb80 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:75594:1870854458203520:0@lo:1000:osp_up0-1.0 00000100:00100000:2.0:1784189265.736241:0:75594:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784189265.736281:0:75594:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dc0761bb6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1784189265.736425:0:26492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458203520 00000100:00100000:1.0:1784189265.736431:0:26492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458203520 00000100:00100000:1.0:1784189265.736520:0:26492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3901 00000100:00100000:1.0:1784189265.736530:0:26492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc07016c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+11:75594:x1870854458203520:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:1.0:1784189265.737230:0:26492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc07016c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+12:75594:x1870854458203520:12345-0@lo:1000:osp_up0-1.0 Request processed in 700us (985us total) trans 115964117000 rc 0/0 00000100:00100000:1.0:1784189265.737239:0:26492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3901 00000100:00100000:2.0:1784189265.737406:0:75594:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc07016fb80 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:75594:1870854458203520:0@lo:1000:osp_up0-1.0 00010000:00010000:0.0:1784189265.737744:0:66169:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9dc04152d400/0xcc1762b626f8c397 lrc: 3/0,1 mode: --/PW res: [0x2400090a5:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189265.737763:0:66169:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9dc04152d400/0xcc1762b626f8c397 lrc: 3/0,1 mode: PW/PW res: [0x2400090a5:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66169 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189265.737789:0:66169:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9dc04152d400/0xcc1762b626f8c397 lrc: 3/0,1 mode: PW/PW res: [0x2400090a5:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66169 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1784189265.737815:0:66169:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000b49ed53a reply state 00000000b357ce02 transno 81604378756 ns: mdt-lustre-MDT0001_UUID lock: ffff9dc04152d400/0xcc1762b626f8c397 lrc: 3/0,1 mode: PW/PW res: [0x2400090a5:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66169 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189265.737828:0:66169:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9dc04152d400/0xcc1762b626f8c397 lrc: 3/0,1 mode: TXN/TXN res: [0x2400090a5:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66169 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189265.737835:0:66169:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x3:0x0].0x0 (ffff9dc074ae2600) 00010000:00010000:0.0:1784189265.737838:0:66169:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1784189265.737842:0:66169:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1784189265.737848:0:66169:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2400090a5:0x3:0x0]: returning size 4096 00000004:00080000:0.0:1784189265.737857:0:66169:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x20000cf21:0x1:0x0] 00010000:00010000:0.0:1784189265.737867:0:66169:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9dbf4369d000/0xcc1762b626f8c37b lrc: 4/0,1 mode: CW/CW res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xcc1762b626f8c382 expref: -99 pid: 66169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189265.737877:0:66169:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9dbf4369d000/0xcc1762b626f8c37b lrc: 4/0,1 mode: CW/CW res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xcc1762b626f8c382 expref: -99 pid: 66169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189265.737884:0:66169:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9dbf4369d000/0xcc1762b626f8c37b lrc: 3/0,0 mode: CW/CW res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xcc1762b626f8c382 expref: -99 pid: 66169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189265.737911:0:66169:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:0.0:1784189265.737916:0:66169:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x20000cf21:0x1:0x0] 00010000:00010000:0.0:1784189265.737921:0:66169:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9dc04a20b600/0xcc1762b626f8c389 lrc: 4/0,1 mode: PW/PW res: [0x20000cf21:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xcc1762b626f8c390 expref: -99 pid: 66169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189265.737929:0:66169:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-osp-MDT0001 lock: ffff9dc04a20b600/0xcc1762b626f8c389 lrc: 3/0,0 mode: PW/PW res: [0x20000cf21:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xcc1762b626f8c390 expref: -99 pid: 66169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784189265.738026:0:66169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc05653a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:debedd94-805c-42a0-a5e5-41758b2012e9+7:71953:x1870854436312448:12345-192.168.203.12@tcp:36:mkdir.0 Request processed in 44974us (46620us total) trans 81604378756 rc 0/0 00000100:00100000:0.0:1784189265.738034:0:66169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1363 00010000:00010000:2.0:1784189265.738110:0:6502:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784189265.738117:0:6502:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff9dbf4369d000/0xcc1762b626f8c37b lrc: 2/0,0 mode: CW/CW res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0xcc1762b626f8c382 expref: -99 pid: 66169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189265.738135:0:6502:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dbf4369d000 already unused, calling callback (ffffffffc1767ed0) 00010000:00010000:2.0:1784189265.738141:0:6502:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff9dbf4369d000/0xcc1762b626f8c37b lrc: 3/0,0 mode: CW/CW res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xcc1762b626f8c382 expref: -99 pid: 66169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1784189265.738150:0:6502:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9dbf4369d000/0xcc1762b626f8c37b lrc: 3/0,0 mode: CW/CW res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xcc1762b626f8c382 expref: -99 pid: 66169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189265.738196:0:6502:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff9dbf4369d000/0xcc1762b626f8c37b lrc: 2/0,0 mode: --/CW res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xcc1762b626f8c382 expref: -99 pid: 66169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189265.738202:0:6502:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1784189265.738230:0:6502:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9dbf4369d000/0xcc1762b626f8c37b lrc: 1/0,0 mode: --/CW res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xcc1762b626f8c382 expref: -99 pid: 66169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189265.738243:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9dbf4369d000/0xcc1762b626f8c37b lrc: 0/0,0 mode: --/CW res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xcc1762b626f8c382 expref: -99 pid: 66169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189265.738262:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784189265.738263:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784189265.738265:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784189265.738275:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1784189265.738287:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc07016dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1870854458203648:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1784189265.738353:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784189265.738394:0:7455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458203648 00000100:00100000:2.0:1784189265.738399:0:7455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458203648 00000100:00100000:2.0:1784189265.738451:0:7455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 714 00000100:00100000:2.0:1784189265.738461:0:7455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc07016d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0001-mdtlov_UUID+12:3641:x1870854458203648:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1784189265.738483:0:7455:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784189265.738501:0:7455:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04152c800/0xcc1762b626f8c382 lrc: 0/0,0 mode: --/CW res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xcc1762b626f8c37b expref: 12 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189265.738515:0:7455:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x1:0x0].0x0 (ffff9dc0455f8800) 00010000:00010000:2.0:1784189265.738523:0:7455:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784189265.738567:0:7455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc07016d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0001-mdtlov_UUID+11:3641:x1870854458203648:12345-0@lo:103:ldlm_bl.0 Request processed in 107us (213us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189265.738581:0:7455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 714 00000100:00100000:2.0:1784189265.738620:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc07016dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1870854458203648:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1784189265.768308:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1784189265.772981:0:66171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436312704 00000100:00100000:2.0:1784189265.772994:0:66171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436312704 00000100:00100000:2.0:1784189265.773064:0:66171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1364 00000100:00100000:2.0:1784189265.773074:0:66171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc07b7e0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:debedd94-805c-42a0-a5e5-41758b2012e9+7:71954:x1870854436312704:12345-192.168.203.12@tcp:101:lfs.0 00010000:00010000:2.0:1784189265.773093:0:66171:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784189265.773115:0:66171:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04a20b200/0xcc1762b626f8c39e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbfc5de7fe6c401d expref: -99 pid: 66171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189265.773179:0:66171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04a20bc00/0xcc1762b626f8c3a5 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189265.773195:0:66171:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04a20bc00/0xcc1762b626f8c3a5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189265.773206:0:66171:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04a20bc00/0xcc1762b626f8c3a5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189265.773220:0:66171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04a20a200/0xcc1762b626f8c3ac lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189265.773228:0:66171:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04a20a200/0xcc1762b626f8c3ac lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189265.773235:0:66171:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04a20a200/0xcc1762b626f8c3ac lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189265.773310:0:66171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04a20be00/0xcc1762b626f8c3b3 lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189265.773504:0:66171:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04a20be00/0xcc1762b626f8c3b3 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189265.773512:0:66171:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04a20be00/0xcc1762b626f8c3b3 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784189265.773798:0:66171:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000cf21:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1784189265.773802:0:66171:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1784189265.773837:0:66171:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04a20be00/0xcc1762b626f8c3b3 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189265.773851:0:66171:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04a20bc00/0xcc1762b626f8c3a5 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189265.773858:0:66171:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04a20bc00/0xcc1762b626f8c3a5 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189265.773865:0:66171:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04a20bc00/0xcc1762b626f8c3a5 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189265.773872:0:66171:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04a20bc00/0xcc1762b626f8c3a5 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189265.773877:0:66171:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc04a20bc00 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:2.0:1784189265.773883:0:66171:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04a20bc00/0xcc1762b626f8c3a5 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189265.773890:0:66171:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04a20bc00/0xcc1762b626f8c3a5 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189265.773903:0:66171:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9dc0630a6700) 00010000:00010000:2.0:1784189265.773912:0:66171:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784189265.773917:0:66171:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04a20bc00/0xcc1762b626f8c3a5 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189265.773925:0:66171:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04a20bc00/0xcc1762b626f8c3a5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189265.773940:0:66171:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04a20a200/0xcc1762b626f8c3ac lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189265.773946:0:66171:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04a20a200/0xcc1762b626f8c3ac lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189265.773952:0:66171:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04a20a200/0xcc1762b626f8c3ac lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189265.773957:0:66171:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc04a20a200 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:2.0:1784189265.773960:0:66171:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04a20a200/0xcc1762b626f8c3ac lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189265.773966:0:66171:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04a20a200/0xcc1762b626f8c3ac lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189265.773973:0:66171:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x91905c78 (ffff9dc07b032b00) 00010000:00010000:2.0:1784189265.773976:0:66171:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784189265.773979:0:66171:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04a20a200/0xcc1762b626f8c3ac lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189265.773985:0:66171:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04a20a200/0xcc1762b626f8c3ac lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189265.774018:0:66171:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04a20b200/0xcc1762b626f8c39e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c401d expref: 9 pid: 66171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189265.774045:0:66171:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04a20be00/0xcc1762b626f8c3b3 lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c401d expref: 8 pid: 66171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189265.774052:0:66171:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x1:0x0].0x0 (ffff9dc07b032200) 00010000:00010000:2.0:1784189265.774055:0:66171:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1784189265.774057:0:66171:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc04a20be00, rc 0) 00000100:00100000:2.0:1784189265.774173:0:66171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc07b7e0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:debedd94-805c-42a0-a5e5-41758b2012e9+8:71954:x1870854436312704:12345-192.168.203.12@tcp:101:lfs.0 Request processed in 1099us (5873us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189265.774181:0:66171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1364 00000100:00100000:1.0:1784189265.780292:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1784189265.784920:0:68287:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436312832 00000100:00100000:2.0:1784189265.784935:0:68287:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436312832 00000100:00100000:2.0:1784189265.785012:0:68287:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1365 00000100:00100000:2.0:1784189265.785025:0:68287:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf4367f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:debedd94-805c-42a0-a5e5-41758b2012e9+8:71954:x1870854436312832:12345-192.168.203.12@tcp:101:lfs.0 00010000:00010000:2.0:1784189265.785046:0:68287:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784189265.785067:0:68287:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04a20b000/0xcc1762b626f8c3ba lrc: 2/0,0 mode: --/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbfc5de7fe6c4024 expref: -99 pid: 68287 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189265.785134:0:68287:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04a20a800/0xcc1762b626f8c3c1 lrc: 3/1,0 mode: --/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189265.785147:0:68287:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04a20a800/0xcc1762b626f8c3c1 lrc: 3/1,0 mode: CR/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189265.785161:0:68287:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04a20a800/0xcc1762b626f8c3c1 lrc: 3/1,0 mode: CR/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189265.785255:0:68287:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04a20b400/0xcc1762b626f8c3c8 lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0x1:0x0].0xb04f75d6 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189265.785275:0:68287:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04a20b400/0xcc1762b626f8c3c8 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189265.785282:0:68287:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04a20b400/0xcc1762b626f8c3c8 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784189265.785424:0:68287:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc07016dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:68287:1870854458203776:0@lo:1000:mdt00_004.0 00000100:00100000:2.0:1784189265.785497:0:68287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784189265.785524:0:68287:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dc058ee5180 going to sleep for 11 seconds 00000100:00100000:0.0:1784189265.785718:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458203776 00000100:00100000:0.0:1784189265.785724:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458203776 00000100:00100000:0.0:1784189265.785761:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3902 00000100:00100000:0.0:1784189265.785769:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc07016ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:68287:x1870854458203776:12345-0@lo:1000:mdt00_004.0 00000100:00100000:0.0:1784189265.785846:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc07016ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:68287:x1870854458203776:12345-0@lo:1000:mdt00_004.0 Request processed in 77us (348us total) trans 0 rc 0/0 00000100:00100000:0.0:1784189265.785853:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3902 00000100:00100000:1.0:1784189265.785938:0:68287:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc07016dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:68287:1870854458203776:0@lo:1000:mdt00_004.0 00010000:00010000:1.0:1784189265.786018:0:68287:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4710f800/0xcc1762b626f8c3cf lrc: 3/1,0 mode: --/PR res: [0x2400090a5:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189265.786033:0:68287:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4710f800/0xcc1762b626f8c3cf lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x2:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189265.786060:0:68287:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4710f800/0xcc1762b626f8c3cf lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x2:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1784189265.786091:0:68287:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4710f800/0xcc1762b626f8c3cf lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x2:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189265.786107:0:68287:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04a20a800/0xcc1762b626f8c3c1 lrc: 4/1,0 mode: CR/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189265.786114:0:68287:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04a20a800/0xcc1762b626f8c3c1 lrc: 4/1,0 mode: CR/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189265.786122:0:68287:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04a20a800/0xcc1762b626f8c3c1 lrc: 3/0,0 mode: CR/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189265.786128:0:68287:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04a20a800/0xcc1762b626f8c3c1 lrc: 4/0,0 mode: CR/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189265.786135:0:68287:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc04a20a800 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:1.0:1784189265.786139:0:68287:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04a20a800/0xcc1762b626f8c3c1 lrc: 4/0,0 mode: CR/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189265.786147:0:68287:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04a20a800/0xcc1762b626f8c3c1 lrc: 5/0,0 mode: CR/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189265.786160:0:68287:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x1:0x0].0x0 (ffff9dc07b032200) 00010000:00010000:1.0:1784189265.786164:0:68287:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784189265.786169:0:68287:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04a20a800/0xcc1762b626f8c3c1 lrc: 3/0,0 mode: --/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189265.786175:0:68287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04a20a800/0xcc1762b626f8c3c1 lrc: 0/0,0 mode: --/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189265.786198:0:68287:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04a20b400/0xcc1762b626f8c3c8 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189265.786205:0:68287:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04a20b400/0xcc1762b626f8c3c8 lrc: 2/0,0 mode: PR/PR res: [0x20000cf21:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189265.786211:0:68287:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04a20b400/0xcc1762b626f8c3c8 lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189265.786215:0:68287:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc04a20b400 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:1.0:1784189265.786218:0:68287:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04a20b400/0xcc1762b626f8c3c8 lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189265.786224:0:68287:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04a20b400/0xcc1762b626f8c3c8 lrc: 4/0,0 mode: PR/PR res: [0x20000cf21:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189265.786231:0:68287:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x1:0x0].0xb04f75d6 (ffff9dc07b032900) 00010000:00010000:1.0:1784189265.786233:0:68287:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784189265.786235:0:68287:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04a20b400/0xcc1762b626f8c3c8 lrc: 2/0,0 mode: --/PR res: [0x20000cf21:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189265.786241:0:68287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04a20b400/0xcc1762b626f8c3c8 lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189265.786284:0:68287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04a20b000/0xcc1762b626f8c3ba lrc: 0/0,0 mode: --/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c4024 expref: 10 pid: 68287 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189265.786300:0:68287:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4710f800/0xcc1762b626f8c3cf lrc: 3/0,0 mode: PR/PR res: [0x2400090a5:0x2:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c4024 expref: 9 pid: 68287 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189265.786357:0:68287:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x2:0x0].0x0 (ffff9dc0455f8f00) 00010000:00010000:1.0:1784189265.786359:0:68287:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1784189265.786362:0:68287:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dbf4710f800, rc 0) 00000100:00100000:1.0:1784189265.786446:0:68287:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf4367f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:debedd94-805c-42a0-a5e5-41758b2012e9+9:71954:x1870854436312832:12345-192.168.203.12@tcp:101:lfs.0 Request processed in 1413us (6159us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189265.786454:0:68287:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1365 00000100:00100000:0.0:1784189265.792119:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1784189265.792228:0:66169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436312960 00000100:00100000:1.0:1784189265.792237:0:66169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436312960 00000100:00100000:1.0:1784189265.792303:0:66169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1366 00000100:00100000:1.0:1784189265.792314:0:66169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc07b7e2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:debedd94-805c-42a0-a5e5-41758b2012e9+7:71954:x1870854436312960:12345-192.168.203.12@tcp:101:lfs.0 00010000:00010000:1.0:1784189265.792380:0:66169:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784189265.792405:0:66169:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9dbf4710fa00/0xcc1762b626f8c3d6 lrc: 2/0,0 mode: --/CR res: [0x2400090a5:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbfc5de7fe6c402b expref: -99 pid: 66169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189265.792480:0:66169:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9dbf4710f600/0xcc1762b626f8c3dd lrc: 3/1,0 mode: --/PR res: [0x2400090a5:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189265.792495:0:66169:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9dbf4710f600/0xcc1762b626f8c3dd lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x2:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66169 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189265.792508:0:66169:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9dbf4710f600/0xcc1762b626f8c3dd lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x2:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66169 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784189265.792570:0:66169:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2400090a5:0x2:0x0]: returning size 4096 00000004:00200000:1.0:1784189265.792575:0:66169:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00010000:00010000:1.0:1784189265.792610:0:66169:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9dbf4710fa00/0xcc1762b626f8c3d6 lrc: 0/0,0 mode: --/CR res: [0x2400090a5:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c402b expref: 9 pid: 66169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189265.792672:0:66169:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9dbf4710f600/0xcc1762b626f8c3dd lrc: 3/0,0 mode: PR/PR res: [0x2400090a5:0x2:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c402b expref: 8 pid: 66169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189265.792680:0:66169:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x2:0x0].0x0 (ffff9dc0455f8300) 00010000:00010000:1.0:1784189265.792684:0:66169:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1784189265.792687:0:66169:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dbf4710f600, rc 0) 00000100:00100000:1.0:1784189265.792750:0:66169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc07b7e2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:debedd94-805c-42a0-a5e5-41758b2012e9+8:71954:x1870854436312960:12345-192.168.203.12@tcp:101:lfs.0 Request processed in 437us (640us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189265.792758:0:66169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1366 00000100:00100000:0.0:1784189265.800118:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1784189265.800217:0:66171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436313216 00000100:00100000:2.0:1784189265.800226:0:66171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436313216 00000100:00100000:2.0:1784189265.800286:0:66171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1367 00000100:00100000:2.0:1784189265.800295:0:66171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc07b7e3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:debedd94-805c-42a0-a5e5-41758b2012e9+8:71954:x1870854436313216:12345-192.168.203.12@tcp:101:lfs.0 00010000:00010000:2.0:1784189265.800314:0:66171:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784189265.800366:0:66171:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9dc04a20b200/0xcc1762b626f8c3e4 lrc: 2/0,0 mode: --/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbfc5de7fe6c4032 expref: -99 pid: 66171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784189265.800477:0:66171:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2400090a5:0x2:0x0]: returning size 4096 00010000:00010000:2.0:1784189265.800585:0:66171:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9dc04a20b200/0xcc1762b626f8c3e4 lrc: 1/0,0 mode: --/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c4032 expref: 10 pid: 66171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189265.800599:0:66171:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x1:0x0].0x0 (ffff9dc07b032b00) 00010000:00010000:2.0:1784189265.800602:0:66171:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1784189265.800606:0:66171:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9dc04a20b200/0xcc1762b626f8c3e4 lrc: 0/0,0 mode: --/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c4032 expref: 10 pid: 66171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189265.800799:0:66171:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc04a20b200, rc 0) 00000100:00100000:2.0:1784189265.800860:0:66171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc07b7e3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:debedd94-805c-42a0-a5e5-41758b2012e9+9:71954:x1870854436313216:12345-192.168.203.12@tcp:101:lfs.0 Request processed in 566us (749us total) trans 81604378757 rc 301/301 00000100:00100000:2.0:1784189265.800868:0:66171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1367 00000100:00100000:3.0:1784189265.803564:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1784189265.803665:0:68287:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436313472 00000100:00100000:1.0:1784189265.803674:0:68287:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436313472 00000100:00100000:1.0:1784189265.803734:0:68287:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1368 00000100:00100000:1.0:1784189265.803744:0:68287:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc0762d4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:debedd94-805c-42a0-a5e5-41758b2012e9+9:71954:x1870854436313472:12345-192.168.203.12@tcp:36:lfs.0 00010000:00010000:1.0:1784189265.803797:0:68287:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784189265.803820:0:68287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9dbf4710f600/0xcc1762b626f8c3dd lrc: 0/0,0 mode: --/PR res: [0x2400090a5:0x2:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c402b expref: 9 pid: 66169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189265.803847:0:68287:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x2:0x0].0x0 (ffff9dc0455f8300) 00010000:00010000:1.0:1784189265.803857:0:68287:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1784189265.803876:0:68287:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9dbf4710fa00/0xcc1762b626f8c3f2 lrc: 3/0,1 mode: --/PW res: [0x2400090a5:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189265.803889:0:68287:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9dbf4710fa00/0xcc1762b626f8c3f2 lrc: 3/0,1 mode: PW/PW res: [0x2400090a5:0x2:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 68287 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189265.803899:0:68287:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9dbf4710fa00/0xcc1762b626f8c3f2 lrc: 3/0,1 mode: PW/PW res: [0x2400090a5:0x2:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 68287 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1784189265.804057:0:68287:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000d03dd58b reply state 000000000cf7d24e transno 81604378758 ns: mdt-lustre-MDT0001_UUID lock: ffff9dbf4710fa00/0xcc1762b626f8c3f2 lrc: 3/0,1 mode: PW/PW res: [0x2400090a5:0x2:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 68287 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189265.804072:0:68287:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9dbf4710fa00/0xcc1762b626f8c3f2 lrc: 3/0,1 mode: TXN/TXN res: [0x2400090a5:0x2:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 68287 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189265.804079:0:68287:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x2:0x0].0x0 (ffff9dc0455f8100) 00010000:00010000:1.0:1784189265.804081:0:68287:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00000100:00100000:1.0:1784189265.804084:0:68287:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1784189265.804091:0:68287:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2400090a5:0x2:0x0]: returning size 4096 00000100:00100000:1.0:1784189265.804157:0:68287:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc0762d4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:debedd94-805c-42a0-a5e5-41758b2012e9+10:71954:x1870854436313472:12345-192.168.203.12@tcp:36:lfs.0 Request processed in 413us (598us total) trans 81604378758 rc 0/0 00000100:00100000:1.0:1784189265.804164:0:68287:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1368 00000100:00100000:0.0:1784189265.818960:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1784189265.819376:0:66173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436313728 00000100:00100000:1.0:1784189265.819386:0:66173:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436313728 00000100:00100000:1.0:1784189265.819454:0:66173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 240 00000100:00100000:1.0:1784189265.819466:0:66173:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc080df3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:debedd94-805c-42a0-a5e5-41758b2012e9+10:71954:x1870854436313728:12345-192.168.203.12@tcp:35:lfs.0 00000100:00100000:1.0:1784189265.820901:0:66173:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc080df3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:debedd94-805c-42a0-a5e5-41758b2012e9+11:71954:x1870854436313728:12345-192.168.203.12@tcp:35:lfs.0 Request processed in 1430us (1942us total) trans 81604378759 rc 0/0 00000100:00100000:1.0:1784189265.820913:0:66173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 240 00000100:00100000:2.0:1784189265.864910:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1784189265.866251:0:66170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436313856 00000100:00100000:3.0:1784189265.866263:0:66170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436313856 00000100:00100000:3.0:1784189265.866341:0:66170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1369 00000100:00100000:3.0:1784189265.866352:0:66170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc07016e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:debedd94-805c-42a0-a5e5-41758b2012e9+9:71955:x1870854436313856:12345-192.168.203.12@tcp:101:lfs.0 00010000:00010000:3.0:1784189265.866372:0:66170:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784189265.866392:0:66170:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4369d400/0xcc1762b626f8c3f9 lrc: 2/0,0 mode: --/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbfc5de7fe6c4039 expref: -99 pid: 66170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189265.866466:0:66170:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4369c600/0xcc1762b626f8c400 lrc: 3/1,0 mode: --/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189265.866492:0:66170:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4369c600/0xcc1762b626f8c400 lrc: 3/1,0 mode: CR/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189265.866514:0:66170:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4369c600/0xcc1762b626f8c400 lrc: 3/1,0 mode: CR/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189265.867032:0:66170:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4369d000/0xcc1762b626f8c407 lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0x1:0x0].0x8f93a2f9 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189265.867045:0:66170:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04152c200/0xcc1762b626f8c390 lrc: 2/0,0 mode: PW/PW res: [0x20000cf21:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xcc1762b626f8c389 expref: 10 pid: 26492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189265.867054:0:66170:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4369d000/0xcc1762b626f8c407 lrc: 4/1,0 mode: --/PR res: [0x20000cf21:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189265.867088:0:66170:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04152c200/0xcc1762b626f8c390 lrc: 3/0,0 mode: PW/PW res: [0x20000cf21:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 0@lo remote: 0xcc1762b626f8c389 expref: 10 pid: 26492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784189265.867111:0:66170:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc050542a00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:66170:1870854458203904:0@lo:104: 00000100:00100000:3.0:1784189265.867178:0:66170:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784189265.867216:0:66170:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dbf445d3300 going to sleep for 11 seconds 00000100:00100000:2.0:1784189265.867371:0:6496:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1784189265.867383:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458203904 00000100:00100000:2.0:1784189265.867387:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458203904 00000100:00100000:2.0:1784189265.867425:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 335 00000100:00100000:2.0:1784189265.867431:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc0762dbc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0001-mdtlov_UUID+4:66170:x1870854458203904:12345-0@lo:104: 00010000:00010000:2.0:1784189265.867454:0:6496:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff9dc04a20b600/0xcc1762b626f8c389 lrc: 3/0,0 mode: PW/PW res: [0x20000cf21:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0xcc1762b626f8c390 expref: -99 pid: 66169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189265.867514:0:6496:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1784189265.867520:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc0762dbc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0001-mdtlov_UUID+4:66170:x1870854458203904:12345-0@lo:104: Request processed in 89us (345us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189265.867542:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 335 00010000:00010000:2.0:1784189265.867626:0:26173:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784189265.867633:0:26173:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff9dc04a20b600/0xcc1762b626f8c389 lrc: 3/0,0 mode: PW/PW res: [0x20000cf21:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0xcc1762b626f8c390 expref: -99 pid: 66169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189265.867642:0:26173:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc04a20b600 already unused, calling callback (ffffffffc1767ed0) 00010000:00010000:2.0:1784189265.867647:0:26173:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff9dc04a20b600/0xcc1762b626f8c389 lrc: 4/0,0 mode: PW/PW res: [0x20000cf21:0x1:0x0].0x8f93a2f9 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x1408400000000 nid: local remote: 0xcc1762b626f8c390 expref: -99 pid: 66169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1784189265.867656:0:26173:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9dc04a20b600/0xcc1762b626f8c389 lrc: 4/0,0 mode: PW/PW res: [0x20000cf21:0x1:0x0].0x8f93a2f9 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x1409400000000 nid: local remote: 0xcc1762b626f8c390 expref: -99 pid: 66169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189265.867682:0:26173:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff9dc04a20b600/0xcc1762b626f8c389 lrc: 2/0,0 mode: --/PW res: [0x20000cf21:0x1:0x0].0x8f93a2f9 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xcc1762b626f8c390 expref: -99 pid: 66169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189265.867698:0:26173:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1784189265.867718:0:26173:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9dc04a20b600/0xcc1762b626f8c389 lrc: 1/0,0 mode: --/PW res: [0x20000cf21:0x1:0x0].0x8f93a2f9 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xcc1762b626f8c390 expref: -99 pid: 66169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189265.867727:0:26173:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9dc04a20b600/0xcc1762b626f8c389 lrc: 0/0,0 mode: --/PW res: [0x20000cf21:0x1:0x0].0x8f93a2f9 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xcc1762b626f8c390 expref: -99 pid: 66169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189265.867745:0:26173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784189265.867746:0:26173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784189265.867749:0:26173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784189265.867756:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1784189265.867766:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc07016e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1870854458204032:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1784189265.867795:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784189265.868216:0:25703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458204032 00000100:00100000:3.0:1784189265.868232:0:25703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458204032 00010000:00010000:3.0:1784189265.868256:0:25703:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04152c200/0xcc1762b626f8c390 lrc: 4/0,0 mode: PW/PW res: [0x20000cf21:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000400000020 nid: 0@lo remote: 0xcc1762b626f8c389 expref: 11 pid: 26492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784189265.868284:0:25703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2578 00000100:00100000:3.0:1784189265.868291:0:25703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc07016df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0001-mdtlov_UUID+11:3640:x1870854458204032:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1784189265.868301:0:25703:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1784189265.868972:0:66170:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc050542a00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:66170:1870854458203904:0@lo:104: 00010000:00010000:0.0:1784189265.868993:0:66170:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4369d000/0xcc1762b626f8c407 lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1784189265.875105:0:92391:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 115964117000 is committed 00010000:00010000:3.0:1784189265.875419:0:25703:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04152c200/0xcc1762b626f8c390 lrc: 0/0,0 mode: --/PW res: [0x20000cf21:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 0@lo remote: 0xcc1762b626f8c389 expref: 8 pid: 26492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189265.875470:0:25703:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x1:0x0].0x8f93a2f9 (ffff9dc074ae2700) 00010000:00010000:3.0:1784189265.875476:0:25703:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4369d000/0xcc1762b626f8c407 lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189265.875486:0:25703:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4369d000/0xcc1762b626f8c407 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189265.875493:0:25703:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4369d000/0xcc1762b626f8c407 lrc: 4/1,0 mode: PR/PR res: [0x20000cf21:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189265.875792:0:25703:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784189265.875873:0:25703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc07016df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0001-mdtlov_UUID+7:3640:x1870854458204032:12345-0@lo:103:ldlm_bl.0 Request processed in 7580us (8075us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189265.875883:0:25703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2578 00000100:00100000:2.0:1784189265.876029:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc07016e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1870854458204032:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1784189265.876083:0:66170:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4369d000/0xcc1762b626f8c407 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189265.876091:0:66170:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4369d000/0xcc1762b626f8c407 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784189265.876201:0:66170:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc080df1500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:66170:1870854458204160:0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1784189265.876354:0:66170:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784189265.876426:0:66170:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dc043ca9540 going to sleep for 11 seconds 00000100:00100000:1.0:1784189265.876807:0:26492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458204160 00000100:00100000:1.0:1784189265.876815:0:26492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458204160 00000100:00100000:1.0:1784189265.876895:0:26492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3903 00000100:00100000:1.0:1784189265.876904:0:26492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc05659df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:66170:x1870854458204160:12345-0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1784189265.877000:0:26492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc05659df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:66170:x1870854458204160:12345-0@lo:1000:mdt00_001.0 Request processed in 98us (646us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189265.877007:0:26492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3903 00000100:00100000:0.0:1784189265.877080:0:66170:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc080df1500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:66170:1870854458204160:0@lo:1000:mdt00_001.0 00010000:00010000:0.0:1784189265.877127:0:66170:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04152d200/0xcc1762b626f8c40e lrc: 3/1,0 mode: --/PR res: [0x2400090a5:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189265.877140:0:66170:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04152d200/0xcc1762b626f8c40e lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x3:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189265.877149:0:66170:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04152d200/0xcc1762b626f8c40e lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x3:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1784189265.877173:0:66170:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04152d200/0xcc1762b626f8c40e lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x3:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189265.877187:0:66170:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4369c600/0xcc1762b626f8c400 lrc: 4/1,0 mode: CR/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189265.877193:0:66170:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4369c600/0xcc1762b626f8c400 lrc: 4/1,0 mode: CR/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189265.877199:0:66170:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4369c600/0xcc1762b626f8c400 lrc: 3/0,0 mode: CR/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189265.877205:0:66170:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4369c600/0xcc1762b626f8c400 lrc: 4/0,0 mode: CR/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189265.877211:0:66170:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dbf4369c600 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:0.0:1784189265.877215:0:66170:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4369c600/0xcc1762b626f8c400 lrc: 4/0,0 mode: CR/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189265.877234:0:66170:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4369c600/0xcc1762b626f8c400 lrc: 5/0,0 mode: CR/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189265.877254:0:66170:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x1:0x0].0x0 (ffff9dc07b032200) 00010000:00010000:0.0:1784189265.877257:0:66170:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784189265.877262:0:66170:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4369c600/0xcc1762b626f8c400 lrc: 3/0,0 mode: --/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189265.877270:0:66170:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4369c600/0xcc1762b626f8c400 lrc: 0/0,0 mode: --/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189265.877282:0:66170:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4369d000/0xcc1762b626f8c407 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189265.877289:0:66170:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4369d000/0xcc1762b626f8c407 lrc: 2/0,0 mode: PR/PR res: [0x20000cf21:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189265.877295:0:66170:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4369d000/0xcc1762b626f8c407 lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189265.877300:0:66170:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dbf4369d000 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:0.0:1784189265.877303:0:66170:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4369d000/0xcc1762b626f8c407 lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189265.877309:0:66170:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4369d000/0xcc1762b626f8c407 lrc: 4/0,0 mode: PR/PR res: [0x20000cf21:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189265.877315:0:66170:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x1:0x0].0x8f93a2f9 (ffff9dc074ae2700) 00010000:00010000:0.0:1784189265.877351:0:66170:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784189265.877355:0:66170:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4369d000/0xcc1762b626f8c407 lrc: 2/0,0 mode: --/PR res: [0x20000cf21:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189265.877361:0:66170:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4369d000/0xcc1762b626f8c407 lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189265.877410:0:66170:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4369d400/0xcc1762b626f8c3f9 lrc: 0/0,0 mode: --/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c4039 expref: 11 pid: 66170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189265.877425:0:66170:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04152d200/0xcc1762b626f8c40e lrc: 3/0,0 mode: PR/PR res: [0x2400090a5:0x3:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c4039 expref: 10 pid: 66170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189265.877432:0:66170:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x3:0x0].0x0 (ffff9dc074ae2300) 00010000:00010000:0.0:1784189265.877448:0:66170:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1784189265.877451:0:66170:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc04152d200, rc 0) 00000100:00100000:0.0:1784189265.877496:0:66170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc07016e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:debedd94-805c-42a0-a5e5-41758b2012e9+10:71955:x1870854436313856:12345-192.168.203.12@tcp:101:lfs.0 Request processed in 11146us (12594us total) trans 0 rc 0/0 00000100:00100000:0.0:1784189265.877503:0:66170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1369 00000100:00100000:1.0:1784189265.887019:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1784189265.887106:0:66171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436313984 00000100:00100000:2.0:1784189265.887115:0:66171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436313984 00000100:00100000:2.0:1784189265.887212:0:66171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1370 00000100:00100000:2.0:1784189265.887234:0:66171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf4367f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:debedd94-805c-42a0-a5e5-41758b2012e9+11:71955:x1870854436313984:12345-192.168.203.12@tcp:101:lfs.0 00010000:00010000:2.0:1784189265.887256:0:66171:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784189265.887275:0:66171:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9dc04a20b200/0xcc1762b626f8c415 lrc: 2/0,0 mode: --/CR res: [0x2400090a5:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbfc5de7fe6c4040 expref: -99 pid: 66171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189265.887370:0:66171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9dc04a20bc00/0xcc1762b626f8c41c lrc: 3/1,0 mode: --/PR res: [0x2400090a5:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189265.887384:0:66171:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9dc04a20bc00/0xcc1762b626f8c41c lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66171 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189265.887412:0:66171:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9dc04a20bc00/0xcc1762b626f8c41c lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66171 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784189265.887475:0:66171:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2400090a5:0x3:0x0]: returning size 4096 00000004:00200000:2.0:1784189265.887479:0:66171:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00010000:00010000:2.0:1784189265.887513:0:66171:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9dc04a20b200/0xcc1762b626f8c415 lrc: 0/0,0 mode: --/CR res: [0x2400090a5:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c4040 expref: 13 pid: 66171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189265.887541:0:66171:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9dc04a20bc00/0xcc1762b626f8c41c lrc: 3/0,0 mode: PR/PR res: [0x2400090a5:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c4040 expref: 12 pid: 66171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189265.887551:0:66171:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x3:0x0].0x0 (ffff9dc074ae2600) 00010000:00010000:2.0:1784189265.887553:0:66171:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1784189265.887557:0:66171:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc04a20bc00, rc 0) 00000100:00100000:2.0:1784189265.887609:0:66171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf4367f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:debedd94-805c-42a0-a5e5-41758b2012e9+12:71955:x1870854436313984:12345-192.168.203.12@tcp:101:lfs.0 Request processed in 389us (599us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189265.887629:0:66171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1370 00000100:00100000:2.0:1784189265.901763:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1784189265.902022:0:66169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436314240 00000100:00100000:0.0:1784189265.902031:0:66169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436314240 00000100:00100000:0.0:1784189265.902102:0:66169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1371 00000100:00100000:0.0:1784189265.902112:0:66169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc07016e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:debedd94-805c-42a0-a5e5-41758b2012e9+12:71955:x1870854436314240:12345-192.168.203.12@tcp:101:lfs.0 00010000:00010000:0.0:1784189265.902131:0:66169:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784189265.902153:0:66169:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9dc04152c800/0xcc1762b626f8c423 lrc: 2/0,0 mode: --/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbfc5de7fe6c4047 expref: -99 pid: 66169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784189265.902246:0:66169:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2400090a5:0x3:0x0]: returning size 4096 00010000:00010000:0.0:1784189265.902395:0:66169:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9dc04152c800/0xcc1762b626f8c423 lrc: 1/0,0 mode: --/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c4047 expref: 14 pid: 66169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189265.902411:0:66169:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x1:0x0].0x0 (ffff9dc074ae2700) 00010000:00010000:0.0:1784189265.902414:0:66169:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1784189265.902433:0:66169:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9dc04152c800/0xcc1762b626f8c423 lrc: 0/0,0 mode: --/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c4047 expref: 14 pid: 66169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189265.902469:0:66169:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc04152c800, rc 0) 00000100:00100000:0.0:1784189265.902522:0:66169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc07016e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:debedd94-805c-42a0-a5e5-41758b2012e9+13:71955:x1870854436314240:12345-192.168.203.12@tcp:101:lfs.0 Request processed in 412us (769us total) trans 81604378760 rc 301/301 00000100:00100000:0.0:1784189265.902745:0:66169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1371 00000100:00100000:0.0:1784189265.908451:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1784189265.909026:0:66170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436314496 00000100:00100000:3.0:1784189265.909035:0:66170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436314496 00000100:00100000:3.0:1784189265.909085:0:66170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1372 00000100:00100000:3.0:1784189265.909096:0:66170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc080df1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:debedd94-805c-42a0-a5e5-41758b2012e9+13:71955:x1870854436314496:12345-192.168.203.12@tcp:36:lfs.0 00010000:00010000:3.0:1784189265.909151:0:66170:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784189265.909176:0:66170:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9dc04a20bc00/0xcc1762b626f8c41c lrc: 0/0,0 mode: --/PR res: [0x2400090a5:0x3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c4040 expref: 13 pid: 66171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189265.909194:0:66170:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x3:0x0].0x0 (ffff9dc074ae2600) 00010000:00010000:3.0:1784189265.909199:0:66170:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1784189265.909229:0:66170:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9dbf4369c400/0xcc1762b626f8c431 lrc: 3/0,1 mode: --/PW res: [0x2400090a5:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189265.909243:0:66170:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9dbf4369c400/0xcc1762b626f8c431 lrc: 3/0,1 mode: PW/PW res: [0x2400090a5:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66170 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189265.909266:0:66170:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9dbf4369c400/0xcc1762b626f8c431 lrc: 3/0,1 mode: PW/PW res: [0x2400090a5:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66170 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1784189265.909430:0:66170:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000441331c1 reply state 00000000082de23e transno 81604378761 ns: mdt-lustre-MDT0001_UUID lock: ffff9dbf4369c400/0xcc1762b626f8c431 lrc: 3/0,1 mode: PW/PW res: [0x2400090a5:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66170 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189265.909455:0:66170:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9dbf4369c400/0xcc1762b626f8c431 lrc: 3/0,1 mode: TXN/TXN res: [0x2400090a5:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66170 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189265.909462:0:66170:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x3:0x0].0x0 (ffff9dc074ae2600) 00010000:00010000:3.0:1784189265.909464:0:66170:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00000100:00100000:3.0:1784189265.909467:0:66170:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1784189265.909475:0:66170:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2400090a5:0x3:0x0]: returning size 4096 00000100:00100000:3.0:1784189265.909855:0:66170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc080df1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:debedd94-805c-42a0-a5e5-41758b2012e9+14:71955:x1870854436314496:12345-192.168.203.12@tcp:36:lfs.0 Request processed in 759us (1421us total) trans 81604378761 rc 0/0 00000100:00100000:3.0:1784189265.909863:0:66170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1372 00000100:00100000:1.0:1784189265.913812:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1784189265.913931:0:66172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436314752 00000100:00100000:3.0:1784189265.913940:0:66172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436314752 00000100:00100000:3.0:1784189265.913993:0:66172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 241 00000100:00100000:3.0:1784189265.914001:0:66172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf4367f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:debedd94-805c-42a0-a5e5-41758b2012e9+14:71955:x1870854436314752:12345-192.168.203.12@tcp:35:lfs.0 00000100:00100000:3.0:1784189265.914203:0:66172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf4367f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:debedd94-805c-42a0-a5e5-41758b2012e9+15:71955:x1870854436314752:12345-192.168.203.12@tcp:35:lfs.0 Request processed in 202us (398us total) trans 81604378762 rc 0/0 00000100:00100000:3.0:1784189265.914211:0:66172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 241 00000001:00080000:2.0:1784189266.664205:0:75588:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 81604378762 is committed 00010000:00010000:1.0:1784189266.670529:0:3626:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9dc04152d400/0xcc1762b626f8c397 lrc: 3/0,1 mode: TXN/TXN res: [0x2400090a5:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66169 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189266.670547:0:3626:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9dc04152d400/0xcc1762b626f8c397 lrc: 2/0,0 mode: TXN/TXN res: [0x2400090a5:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66169 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189266.670556:0:3626:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9dc04152d400/0xcc1762b626f8c397 lrc: 3/0,0 mode: TXN/TXN res: [0x2400090a5:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66169 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189266.670563:0:3626:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc04152d400 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:1.0:1784189266.670568:0:3626:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9dc04152d400/0xcc1762b626f8c397 lrc: 3/0,0 mode: TXN/TXN res: [0x2400090a5:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66169 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189266.670575:0:3626:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9dc04152d400/0xcc1762b626f8c397 lrc: 4/0,0 mode: TXN/TXN res: [0x2400090a5:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66169 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189266.670592:0:3626:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x3:0x0].0x0 (ffff9dc074ae2600) 00010000:00010000:1.0:1784189266.670595:0:3626:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784189266.670599:0:3626:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9dc04152d400/0xcc1762b626f8c397 lrc: 2/0,0 mode: --/TXN res: [0x2400090a5:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66169 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189266.670605:0:3626:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9dc04152d400/0xcc1762b626f8c397 lrc: 0/0,0 mode: --/TXN res: [0x2400090a5:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66169 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189266.670624:0:3626:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9dbf4710fa00/0xcc1762b626f8c3f2 lrc: 3/0,1 mode: TXN/TXN res: [0x2400090a5:0x2:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 68287 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189266.670630:0:3626:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9dbf4710fa00/0xcc1762b626f8c3f2 lrc: 2/0,0 mode: TXN/TXN res: [0x2400090a5:0x2:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 68287 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189266.670646:0:3626:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9dbf4710fa00/0xcc1762b626f8c3f2 lrc: 3/0,0 mode: TXN/TXN res: [0x2400090a5:0x2:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 68287 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189266.670660:0:3626:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dbf4710fa00 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:1.0:1784189266.670664:0:3626:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9dbf4710fa00/0xcc1762b626f8c3f2 lrc: 3/0,0 mode: TXN/TXN res: [0x2400090a5:0x2:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 68287 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189266.670670:0:3626:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9dbf4710fa00/0xcc1762b626f8c3f2 lrc: 4/0,0 mode: TXN/TXN res: [0x2400090a5:0x2:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 68287 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189266.670680:0:3626:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x2:0x0].0x0 (ffff9dc0455f8100) 00010000:00010000:1.0:1784189266.670682:0:3626:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1784189266.670685:0:3626:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9dbf4710fa00/0xcc1762b626f8c3f2 lrc: 2/0,0 mode: --/TXN res: [0x2400090a5:0x2:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 68287 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189266.670691:0:3626:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9dbf4710fa00/0xcc1762b626f8c3f2 lrc: 0/0,0 mode: --/TXN res: [0x2400090a5:0x2:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 68287 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189266.670719:0:3626:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9dbf4369c400/0xcc1762b626f8c431 lrc: 3/0,1 mode: TXN/TXN res: [0x2400090a5:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66170 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189266.670725:0:3626:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9dbf4369c400/0xcc1762b626f8c431 lrc: 2/0,0 mode: TXN/TXN res: [0x2400090a5:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66170 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189266.670731:0:3626:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9dbf4369c400/0xcc1762b626f8c431 lrc: 3/0,0 mode: TXN/TXN res: [0x2400090a5:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66170 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189266.670736:0:3626:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dbf4369c400 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:1.0:1784189266.670738:0:3626:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9dbf4369c400/0xcc1762b626f8c431 lrc: 3/0,0 mode: TXN/TXN res: [0x2400090a5:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66170 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189266.670743:0:3626:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9dbf4369c400/0xcc1762b626f8c431 lrc: 4/0,0 mode: TXN/TXN res: [0x2400090a5:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66170 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189266.670761:0:3626:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x3:0x0].0x0 (ffff9dc074ae2600) 00010000:00010000:1.0:1784189266.670764:0:3626:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1784189266.670766:0:3626:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9dbf4369c400/0xcc1762b626f8c431 lrc: 2/0,0 mode: --/TXN res: [0x2400090a5:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66170 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189266.670772:0:3626:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9dbf4369c400/0xcc1762b626f8c431 lrc: 0/0,0 mode: --/TXN res: [0x2400090a5:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66170 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189266.671414:0:7454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784189266.732023:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1784189266.732093:0:66171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436314880 00000100:00100000:3.0:1784189266.732103:0:66171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436314880 00000100:00100000:3.0:1784189266.732200:0:66171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1373 00000100:00100000:3.0:1784189266.732211:0:66171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc07016c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:debedd94-805c-42a0-a5e5-41758b2012e9+10:71964:x1870854436314880:12345-192.168.203.12@tcp:41:lfs.0 00000004:00000024:3.0:1784189266.732262:0:66171:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445203968 avail 1298964480 00000100:00100000:3.0:1784189266.732376:0:66171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc07016c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:debedd94-805c-42a0-a5e5-41758b2012e9+10:71964:x1870854436314880:12345-192.168.203.12@tcp:41:lfs.0 Request processed in 166us (362us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189266.732384:0:66171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1373 00000100:00100000:2.0:1784189266.737190:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1784189266.737274:0:66945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436315008 00000100:00100000:3.0:1784189266.737283:0:66945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436315008 00000100:00100000:3.0:1784189266.737713:0:66945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1374 00000100:00100000:3.0:1784189266.737729:0:66945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc07016f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:debedd94-805c-42a0-a5e5-41758b2012e9+5:71964:x1870854436315008:12345-192.168.203.12@tcp:41:lfs.0 00000004:00000024:3.0:1784189266.737771:0:66945:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445568512 avail 1299329024 00000100:00100000:3.0:1784189266.737849:0:66945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc07016f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:debedd94-805c-42a0-a5e5-41758b2012e9+5:71964:x1870854436315008:12345-192.168.203.12@tcp:41:lfs.0 Request processed in 121us (665us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189266.737857:0:66945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1374 00000100:00100000:1.0:1784189266.742905:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1784189266.742956:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436315136 00000100:00100000:2.0:1784189266.742967:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436315136 00000100:00100000:2.0:1784189266.743042:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 2026 00000100:00100000:2.0:1784189266.743054:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf4367c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:debedd94-805c-42a0-a5e5-41758b2012e9+5:71964:x1870854436315136:12345-192.168.203.12@tcp:13:lfs.0 00002000:00000024:2.0:1784189266.743086:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8647872 pending 0 free 3922481152 avail 3690958848 00000100:00100000:2.0:1784189266.743151:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf4367c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:debedd94-805c-42a0-a5e5-41758b2012e9+5:71964:x1870854436315136:12345-192.168.203.12@tcp:13:lfs.0 Request processed in 100us (255us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189266.743165:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 2026 00000100:00080000:1.0:1784189266.743227:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1784189266.746932:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1784189266.748044:0:26168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436315264 00000100:00100000:0.0:1784189266.748056:0:26168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436315264 00000100:00100000:0.0:1784189266.748100:0:26168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 4983 00000100:00100000:0.0:1784189266.748110:0:26168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf4367c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:0+-99:2395:x1870854436315264:12345-192.168.203.12@tcp:8:lfs.0 00010000:00080000:0.0:1784189266.748145:0:26168:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0001: connection from debedd94-805c-42a0-a5e5-41758b2012e9@192.168.203.12@tcp t0 exp 0000000000000000 cur 3508 last 0 00000020:00000080:0.0:1784189266.748190:0:26168:0:(genops.c:1406:class_connect()) connect: client debedd94-805c-42a0-a5e5-41758b2012e9, cookie 0xcc1762b626f8c438 00002000:00100000:0.0:1784189266.748203:0:26168:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli debedd94-805c-42a0-a5e5-41758b2012e9/ffff9dc07118d800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 21136a2 ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1784189266.748223:0:26168:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1784189266.748298:0:26168:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1784189266.748364:0:26168:0:(import.c:65:import_set_state_nolock()) ffff9dc07118c800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1784189266.748444:0:26168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf4367c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:debedd94-805c-42a0-a5e5-41758b2012e9+6:2395:x1870854436315264:12345-192.168.203.12@tcp:8:lfs.0 Request processed in 333us (1530us total) trans 0 rc 0/0 00000100:00100000:0.0:1784189266.748452:0:26168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 4983 00000100:00100000:2.0:1784189266.755293:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1784189266.761839:0:9466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436315392 00000100:00100000:1.0:1784189266.761854:0:9466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436315392 00000100:00100000:1.0:1784189266.761927:0:9466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 2027 00000100:00100000:1.0:1784189266.761939:0:9466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc07016ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:debedd94-805c-42a0-a5e5-41758b2012e9+6:71964:x1870854436315392:12345-192.168.203.12@tcp:13:lfs.0 00002000:00000024:1.0:1784189266.761965:0:9466:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8647872 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1784189266.762035:0:9466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc07016ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:debedd94-805c-42a0-a5e5-41758b2012e9+6:71964:x1870854436315392:12345-192.168.203.12@tcp:13:lfs.0 Request processed in 98us (6748us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189266.762044:0:9466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 2027 00000100:00080000:0.0:1784189266.762272:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1784189266.871891:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1784189266.871959:0:68287:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436315648 00000100:00100000:3.0:1784189266.871968:0:68287:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436315648 00000100:00100000:3.0:1784189266.872720:0:68287:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1375 00000100:00100000:3.0:1784189266.872733:0:68287:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf4367ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:debedd94-805c-42a0-a5e5-41758b2012e9+10:71971:x1870854436315648:12345-192.168.203.12@tcp:36:mcreate.0 00010000:00010000:3.0:1784189266.872793:0:68287:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784189266.872824:0:68287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4369de00/0xcc1762b626f8c358 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c400f expref: 10 pid: 66171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189266.872841:0:68287:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9dc0630a6700) 00010000:00010000:3.0:1784189266.872845:0:68287:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1784189266.872899:0:68287:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4369d000/0xcc1762b626f8c43f lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189266.872912:0:68287:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4369d000/0xcc1762b626f8c43f lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189266.872930:0:68287:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4369d000/0xcc1762b626f8c43f lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189266.872945:0:68287:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4369d400/0xcc1762b626f8c446 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x21e7de2f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189266.872952:0:68287:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4369d400/0xcc1762b626f8c446 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x21e7de2f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189266.872958:0:68287:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4369d400/0xcc1762b626f8c446 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x21e7de2f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189266.874673:0:68287:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4369d000/0xcc1762b626f8c43f lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189266.874689:0:68287:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4369d000/0xcc1762b626f8c43f lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189266.874695:0:68287:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4369d000/0xcc1762b626f8c43f lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189266.874703:0:68287:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4369d000/0xcc1762b626f8c43f lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189266.874708:0:68287:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dbf4369d000 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:3.0:1784189266.874713:0:68287:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4369d000/0xcc1762b626f8c43f lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189266.874721:0:68287:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4369d000/0xcc1762b626f8c43f lrc: 5/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189266.874736:0:68287:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9dc0630a6700) 00010000:00010000:3.0:1784189266.874746:0:68287:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784189266.874751:0:68287:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4369d000/0xcc1762b626f8c43f lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189266.874757:0:68287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4369d000/0xcc1762b626f8c43f lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1784189266.874771:0:68287:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000e370daca reply state 00000000896c4311 transno 115964117001 ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4369d400/0xcc1762b626f8c446 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x21e7de2f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189266.874785:0:68287:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4369d400/0xcc1762b626f8c446 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x21e7de2f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189266.874792:0:68287:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x21e7de2f (ffff9dbf45994b00) 00010000:00010000:3.0:1784189266.874794:0:68287:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1784189266.874798:0:68287:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1784189266.874955:0:68287:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf4367ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:debedd94-805c-42a0-a5e5-41758b2012e9+11:71971:x1870854436315648:12345-192.168.203.12@tcp:36:mcreate.0 Request processed in 2221us (3069us total) trans 115964117001 rc 0/0 00000100:00100000:3.0:1784189266.874964:0:68287:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1375 00000100:00100000:0.0:1784189266.919692:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1784189266.919729:0:66171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436315776 00000100:00100000:0.0:1784189266.919737:0:66171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436315776 00000100:00100000:0.0:1784189266.919796:0:66171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1376 00000100:00100000:0.0:1784189266.919910:0:66171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc071537800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:debedd94-805c-42a0-a5e5-41758b2012e9+11:71974:x1870854436315776:12345-192.168.203.12@tcp:101:rm.0 00010000:00010000:0.0:1784189266.919931:0:66171:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784189266.919949:0:66171:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04152c800/0xcc1762b626f8c44d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbfc5de7fe6c404e expref: -99 pid: 66171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189266.920004:0:66171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04152c400/0xcc1762b626f8c454 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189266.920017:0:66171:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04152c400/0xcc1762b626f8c454 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189266.920028:0:66171:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04152c400/0xcc1762b626f8c454 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784189266.920068:0:66171:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1784189266.920072:0:66171:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1784189266.920087:0:66171:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04152c400/0xcc1762b626f8c454 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189266.920110:0:66171:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04152c800/0xcc1762b626f8c44d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c404e expref: 13 pid: 66171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189266.920129:0:66171:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04152c400/0xcc1762b626f8c454 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c404e expref: 12 pid: 66171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189266.920136:0:66171:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9dc0630a6700) 00010000:00010000:0.0:1784189266.920139:0:66171:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1784189266.920143:0:66171:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc04152c400, rc 0) 00000100:00100000:0.0:1784189266.920196:0:66171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc071537800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:debedd94-805c-42a0-a5e5-41758b2012e9+12:71974:x1870854436315776:12345-192.168.203.12@tcp:101:rm.0 Request processed in 289us (510us total) trans 0 rc 0/0 00000100:00100000:0.0:1784189266.920211:0:66171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1376 00000100:00100000:0.0:1784189266.925705:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1784189266.926203:0:66945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436315904 00000100:00100000:3.0:1784189266.926213:0:66945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436315904 00000100:00100000:3.0:1784189266.926278:0:66945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1377 00000100:00100000:3.0:1784189266.926288:0:66945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc071536a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:debedd94-805c-42a0-a5e5-41758b2012e9+12:71974:x1870854436315904:12345-192.168.203.12@tcp:101:rm.0 00010000:00010000:3.0:1784189266.926308:0:66945:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784189266.926343:0:66945:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4369d000/0xcc1762b626f8c45b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbfc5de7fe6c4055 expref: -99 pid: 66945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189266.926411:0:66945:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4369de00/0xcc1762b626f8c462 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189266.926532:0:66945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4369de00/0xcc1762b626f8c462 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189266.926617:0:66945:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4369de00/0xcc1762b626f8c462 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189266.926631:0:66945:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4369c600/0xcc1762b626f8c469 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x21e7de2f bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189266.926640:0:66945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4369c600/0xcc1762b626f8c469 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x21e7de2f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189266.926646:0:66945:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4369c600/0xcc1762b626f8c469 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x21e7de2f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189266.926723:0:66945:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4369c400/0xcc1762b626f8c470 lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189266.926731:0:66945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4369c400/0xcc1762b626f8c470 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x3:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189266.926738:0:66945:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4369c400/0xcc1762b626f8c470 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x3:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784189266.926778:0:66945:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000cf21:0x3:0x0]: returning size 0 00000004:00200000:3.0:1784189266.926781:0:66945:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1784189266.926799:0:66945:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4369c400/0xcc1762b626f8c470 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x3:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189266.926811:0:66945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4369c400/0xcc1762b626f8c470 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189266.926820:0:66945:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4369de00/0xcc1762b626f8c462 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189266.926836:0:66945:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4369de00/0xcc1762b626f8c462 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189266.926842:0:66945:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4369de00/0xcc1762b626f8c462 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189266.926848:0:66945:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4369de00/0xcc1762b626f8c462 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189266.926854:0:66945:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dbf4369de00 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:3.0:1784189266.926858:0:66945:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4369de00/0xcc1762b626f8c462 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189266.926865:0:66945:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4369de00/0xcc1762b626f8c462 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189266.926876:0:66945:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9dc0630a6700) 00010000:00010000:3.0:1784189266.926879:0:66945:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784189266.926882:0:66945:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4369de00/0xcc1762b626f8c462 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189266.926889:0:66945:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4369de00/0xcc1762b626f8c462 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189266.926903:0:66945:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4369c600/0xcc1762b626f8c469 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x21e7de2f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189266.926909:0:66945:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4369c600/0xcc1762b626f8c469 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x21e7de2f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189266.926915:0:66945:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4369c600/0xcc1762b626f8c469 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x21e7de2f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189266.926923:0:66945:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dbf4369c600 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:3.0:1784189266.926926:0:66945:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4369c600/0xcc1762b626f8c469 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x21e7de2f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189266.926932:0:66945:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4369c600/0xcc1762b626f8c469 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x21e7de2f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189266.926939:0:66945:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x21e7de2f (ffff9dbf45994b00) 00010000:00010000:3.0:1784189266.926941:0:66945:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784189266.926944:0:66945:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4369c600/0xcc1762b626f8c469 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x21e7de2f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189266.926949:0:66945:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4369c600/0xcc1762b626f8c469 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x21e7de2f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189266.926971:0:66945:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4369d000/0xcc1762b626f8c45b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c4055 expref: 14 pid: 66945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189266.926982:0:66945:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4369c400/0xcc1762b626f8c470 lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c4055 expref: 13 pid: 66945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189266.926988:0:66945:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x3:0x0].0x0 (ffff9dbf45994e00) 00010000:00010000:3.0:1784189266.926990:0:66945:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1784189266.926992:0:66945:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dbf4369c400, rc 0) 00000100:00100000:3.0:1784189266.927053:0:66945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc071536a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:debedd94-805c-42a0-a5e5-41758b2012e9+13:71974:x1870854436315904:12345-192.168.203.12@tcp:101:rm.0 Request processed in 766us (1355us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189266.927060:0:66945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1377 00000100:00100000:0.0:1784189266.940709:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1784189266.940783:0:68287:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436316160 00000100:00100000:3.0:1784189266.940807:0:68287:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436316160 00000100:00100000:3.0:1784189266.940867:0:68287:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1378 00000100:00100000:3.0:1784189266.940877:0:68287:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf46954000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:debedd94-805c-42a0-a5e5-41758b2012e9+13:71974:x1870854436316160:12345-192.168.203.12@tcp:36:rm.0 00010000:00010000:3.0:1784189266.940930:0:68287:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1784189266.940960:0:68287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4369c400/0xcc1762b626f8c470 lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c4055 expref: 13 pid: 66945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189266.940978:0:68287:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x3:0x0].0x0 (ffff9dbf45994e00) 00010000:00010000:3.0:1784189266.940993:0:68287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04152c400/0xcc1762b626f8c454 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c404e expref: 12 pid: 66171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189266.941001:0:68287:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9dc0630a6700) 00010000:00010000:3.0:1784189266.941004:0:68287:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1784189266.941023:0:68287:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc058f66000/0xcc1762b626f8c477 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189266.941036:0:68287:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc058f66000/0xcc1762b626f8c477 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189266.941045:0:68287:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc058f66000/0xcc1762b626f8c477 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189266.941055:0:68287:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc058f66c00/0xcc1762b626f8c47e lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x21e7de2f bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189266.941061:0:68287:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc058f66c00/0xcc1762b626f8c47e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x21e7de2f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189266.941068:0:68287:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc058f66c00/0xcc1762b626f8c47e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x21e7de2f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189266.941267:0:68287:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc058f67000/0xcc1762b626f8c485 lrc: 3/0,1 mode: --/EX res: [0x20000cf21:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189266.941277:0:68287:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc058f67000/0xcc1762b626f8c485 lrc: 3/0,1 mode: EX/EX res: [0x20000cf21:0x3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189266.941284:0:68287:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc058f67000/0xcc1762b626f8c485 lrc: 3/0,1 mode: EX/EX res: [0x20000cf21:0x3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189266.941667:0:68287:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc058f66600/0xcc1762b626f8c48c lrc: 3/0,1 mode: --/PW res: [0x20000cf21:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189266.941676:0:68287:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc058f66600/0xcc1762b626f8c48c lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189266.941684:0:68287:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc058f66600/0xcc1762b626f8c48c lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189266.941691:0:68287:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc058f66600/0xcc1762b626f8c48c lrc: 4/0,1 mode: PW/PW res: [0x20000cf21:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189266.941697:0:68287:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc058f66600/0xcc1762b626f8c48c lrc: 4/0,1 mode: PW/PW res: [0x20000cf21:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189266.941703:0:68287:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc058f66600/0xcc1762b626f8c48c lrc: 3/0,0 mode: PW/PW res: [0x20000cf21:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189266.941727:0:68287:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1784189266.941746:0:68287:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc058f67000/0xcc1762b626f8c485 lrc: 3/0,1 mode: EX/EX res: [0x20000cf21:0x3:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189266.941753:0:68287:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc058f67000/0xcc1762b626f8c485 lrc: 2/0,0 mode: EX/EX res: [0x20000cf21:0x3:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189266.941767:0:68287:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dc058f67000/0xcc1762b626f8c485 lrc: 3/0,0 mode: EX/EX res: [0x20000cf21:0x3:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189266.941767:0:6501:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784189266.941773:0:68287:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc058f67000 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:0.0:1784189266.941773:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dc058f66600/0xcc1762b626f8c48c lrc: 2/0,0 mode: PW/PW res: [0x20000cf21:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189266.941778:0:68287:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc058f67000/0xcc1762b626f8c485 lrc: 3/0,0 mode: EX/EX res: [0x20000cf21:0x3:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189266.941779:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc058f66600 already unused, calling callback (ffffffffc0b2e230) 00010000:00010000:3.0:1784189266.941786:0:68287:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc058f67000/0xcc1762b626f8c485 lrc: 4/0,0 mode: EX/EX res: [0x20000cf21:0x3:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189266.941791:0:6501:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc058f66600/0xcc1762b626f8c48c lrc: 2/0,0 mode: PW/PW res: [0x20000cf21:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189266.941795:0:68287:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x3:0x0].0x0 (ffff9dbf45994d00) 00010000:00010000:3.0:1784189266.941798:0:68287:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1784189266.941802:0:68287:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dc058f67000/0xcc1762b626f8c485 lrc: 2/0,0 mode: --/EX res: [0x20000cf21:0x3:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189266.941808:0:68287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc058f67000/0xcc1762b626f8c485 lrc: 0/0,0 mode: --/EX res: [0x20000cf21:0x3:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189266.941811:0:6501:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc058f66600/0xcc1762b626f8c48c lrc: 3/0,0 mode: PW/PW res: [0x20000cf21:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189266.941820:0:6501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x3:0x0].0x0 (ffff9dbf45994d00) 00010000:00010000:0.0:1784189266.941822:0:6501:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1784189266.941824:0:68287:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc058f66000/0xcc1762b626f8c477 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189266.941825:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dc058f66600/0xcc1762b626f8c48c lrc: 1/0,0 mode: --/PW res: [0x20000cf21:0x3:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189266.941831:0:68287:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc058f66000/0xcc1762b626f8c477 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189266.941831:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc058f66600/0xcc1762b626f8c48c lrc: 0/0,0 mode: --/PW res: [0x20000cf21:0x3:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189266.941837:0:68287:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc058f66000/0xcc1762b626f8c477 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189266.941842:0:68287:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dc058f66000/0xcc1762b626f8c477 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189266.941844:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784189266.941846:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784189266.941847:0:68287:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc058f66000 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:0.0:1784189266.941848:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784189266.941856:0:68287:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc058f66000/0xcc1762b626f8c477 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189266.941863:0:68287:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc058f66000/0xcc1762b626f8c477 lrc: 5/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189266.941871:0:68287:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9dc0630a6700) 00010000:00010000:3.0:1784189266.941873:0:68287:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784189266.941875:0:68287:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dc058f66000/0xcc1762b626f8c477 lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189266.941881:0:68287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc058f66000/0xcc1762b626f8c477 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1784189266.941891:0:68287:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000e46132b6 reply state 00000000dbc1ae71 transno 115964117002 ns: mdt-lustre-MDT0000_UUID lock: ffff9dc058f66c00/0xcc1762b626f8c47e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x21e7de2f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189266.941901:0:68287:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc058f66c00/0xcc1762b626f8c47e lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x21e7de2f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189266.941907:0:68287:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x21e7de2f (ffff9dbf45994b00) 00010000:00010000:3.0:1784189266.941909:0:68287:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1784189266.941912:0:68287:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1784189266.941990:0:68287:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf46954000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:debedd94-805c-42a0-a5e5-41758b2012e9+13:71974:x1870854436316160:12345-192.168.203.12@tcp:36:rm.0 Request processed in 1113us (1288us total) trans 115964117002 rc 0/0 00000100:00100000:3.0:1784189266.941998:0:68287:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1378 00000100:00100000:1.0:1784189267.241228:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1784189267.241267:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1784189267.241302:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1784189267.241354:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436316672 00000100:00100000:1.0:1784189267.241362:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436316672 00000100:00100000:1.0:1784189267.241414:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 2531 00000100:00100000:1.0:1784189267.241433:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc056475180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:debedd94-805c-42a0-a5e5-41758b2012e9+5:2396:x1870854436316672:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:3.0:1784189267.241451:0:92396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436316288 00000100:00100000:3.0:1784189267.241455:0:92396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436316288 00000100:00100000:3.0:1784189267.241482:0:92396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 169 00000100:00100000:3.0:1784189267.241488:0:92396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc056ab3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:60f345e3-c70e-4f53-b5e7-c9671463c9a5+10:2397:x1870854436316288:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:3.0:1784189267.241513:0:92396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc056ab3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:60f345e3-c70e-4f53-b5e7-c9671463c9a5+10:2397:x1870854436316288:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 24us (292us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189267.241513:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc056475180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:debedd94-805c-42a0-a5e5-41758b2012e9+5:2396:x1870854436316672:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 90us (210us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189267.241521:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 2531 00000100:00100000:3.0:1784189267.241525:0:92396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 169 00000100:00100000:1.0:1784189267.241559:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1784189267.241628:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1784189267.241683:0:26162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436316800 00000100:00100000:1.0:1784189267.241687:0:26162:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436316800 00000100:00100000:3.0:1784189267.241701:0:66169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436316416 00000100:00100000:3.0:1784189267.241705:0:66169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436316416 00000100:00100000:1.0:1784189267.241712:0:26162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 2532 00000100:00100000:1.0:1784189267.241717:0:26162:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc075f7df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:debedd94-805c-42a0-a5e5-41758b2012e9+6:2397:x1870854436316800:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:3.0:1784189267.241737:0:66169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436316544 00000100:00100000:3.0:1784189267.241740:0:66169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436316544 00000100:00100000:1.0:1784189267.241745:0:26162:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc075f7df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:debedd94-805c-42a0-a5e5-41758b2012e9+6:2397:x1870854436316800:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 28us (117us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189267.241751:0:26162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 2532 00000100:00100000:3.0:1784189267.241761:0:66169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1274 00000100:00100000:3.0:1784189267.241768:0:66169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc056475880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:debedd94-805c-42a0-a5e5-41758b2012e9+13:2396:x1870854436316416:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:3.0:1784189267.241829:0:66169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc056475880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:debedd94-805c-42a0-a5e5-41758b2012e9+13:2396:x1870854436316416:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 61us (560us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189267.241836:0:66169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1274 00000100:00100000:3.0:1784189267.241850:0:66169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1275 00000100:00100000:3.0:1784189267.241856:0:66169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc056477480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:debedd94-805c-42a0-a5e5-41758b2012e9+5:2397:x1870854436316544:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:3.0:1784189267.241881:0:66169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc056477480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:debedd94-805c-42a0-a5e5-41758b2012e9+5:2397:x1870854436316544:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 26us (323us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189267.241887:0:66169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1275 00000100:00080000:3.0:1784189267.241903:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1784189267.241907:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1784189267.697812:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784189268.719586:0:26173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784189269.039578:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1784189269.039601:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf46955f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1870854458204288:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1784189269.039678:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784189269.039718:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458204288 00000100:00100000:3.0:1784189269.039726:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458204288 00000100:00100000:3.0:1784189269.039802:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2028 00000100:00100000:3.0:1784189269.039812:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf46954e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1870854458204288:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1784189269.039839:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8647872 pending 0 free 3922481152 avail 3690958848 00000100:00100000:3.0:1784189269.039886:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf46954e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1870854458204288:12345-0@lo:13:osp-pre-0-1.0 Request processed in 74us (207us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189269.039895:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2028 00000100:00080000:0.0:1784189269.040131:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1784189269.040168:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf46955f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1870854458204288:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1784189269.040631:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1784189269.040642:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc075f7f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1870854458204416:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1784189269.040677:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784189269.040708:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458204416 00000100:00100000:1.0:1784189269.040713:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458204416 00000100:00100000:1.0:1784189269.040747:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2029 00000100:00100000:1.0:1784189269.040754:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc075f7ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1870854458204416:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1784189269.040773:0:8432:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8647872 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1784189269.040818:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc075f7ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1870854458204416:12345-0@lo:13:osp-pre-1-1.0 Request processed in 64us (139us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189269.040824:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2029 00000100:00100000:1.0:1784189269.040857:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc075f7f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1870854458204416:0@lo:13:osp-pre-1-1.0 00000100:00080000:0.0:1784189269.041820:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1784189269.744926:0:7454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784189270.064196:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc050542a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bd553d0d-03e2-4233-b06b-b55bbfa2b954:3640:1870854458204544:0@lo:400:kworker.0 00000100:00100000:2.0:1784189270.064261:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784189270.064274:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf4262dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3643:1870854458204928:0@lo:400:kworker.0 00000100:00100000:3.0:1784189270.064303:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784189270.064337:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf4262e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1870854458205440:0@lo:400:kworker.0 00000100:00100000:3.0:1784189270.064361:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784189270.064383:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf4262e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1870854458205952:0@lo:400:kworker.0 00000100:00100000:3.0:1784189270.064415:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784189270.064415:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf4262f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3641:1870854458204672:0@lo:400:kworker.0 00000100:00100000:3.0:1784189270.064436:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:3.0:1784189270.064442:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf4262df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3643:1870854458204800:0@lo:400:kworker.0 00000100:00100000:1.0:1784189270.064442:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784189270.064460:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf4262ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1870854458205184:0@lo:400:kworker.0 00000100:00100000:3.0:1784189270.064462:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784189270.064475:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf4262ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1870854458205312:0@lo:400:kworker.0 00000100:00100000:1.0:1784189270.064480:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784189270.064534:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf4262d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3640:1870854458205056:0@lo:400:kworker.0 00000100:00100000:0.0:1784189270.064630:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458205184 00000100:00100000:0.0:1784189270.064642:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458205184 00000100:00100000:0.0:1784189270.064826:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3904 00000100:00100000:0.0:1784189270.064836:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc075f7d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3641:x1870854458205184:12345-0@lo:400:kworker.0 00010000:00000080:0.0:1784189270.064910:0:8439:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9dc075f7d500 x1870854458205184/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:461/0 lens 224/224 e 0 to 0 dl 1784189281 ref 1 fl Interpret:/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784189270.064926:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784189270.064931:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf4262ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1870854458205696:0@lo:400:kworker.0 00000100:00100000:3.0:1784189270.064944:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf4262d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1870854458205824:0@lo:400:kworker.0 00000100:00100000:1.0:1784189270.064953:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784189270.064964:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784189270.064985:0:68287:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458204928 00000100:00100000:1.0:1784189270.064985:0:92398:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458204544 00000100:00100000:3.0:1784189270.064988:0:68287:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458204928 00000100:00100000:1.0:1784189270.064988:0:92398:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458204544 00000100:00100000:1.0:1784189270.065015:0:92398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:3.0:1784189270.065020:0:68287:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458204672 00000100:00100000:1.0:1784189270.065021:0:92398:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc056ab1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd553d0d-03e2-4233-b06b-b55bbfa2b954+24:3640:x1870854458204544:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784189270.065023:0:68287:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458204672 00000100:00100000:3.0:1784189270.065039:0:68287:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458204800 00000100:00100000:3.0:1784189270.065041:0:68287:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458204800 00000100:00100000:3.0:1784189270.065055:0:68287:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1276 00000100:00100000:1.0:1784189270.065055:0:92398:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc056ab1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd553d0d-03e2-4233-b06b-b55bbfa2b954+24:3640:x1870854458204544:12345-0@lo:400:kworker.0 Request processed in 34us (793us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189270.065060:0:68287:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf4262f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1870854458204928:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784189270.065062:0:92398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00010000:00000080:3.0:1784189270.065072:0:68287:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9dbf4262f100 x1870854458204928/t0(0) o400->lustre-MDT0000-lwp-OST0001_UUID@0@lo:461/0 lens 224/224 e 0 to 0 dl 1784189281 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784189270.065101:0:68287:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf4262f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1870854458204928:12345-0@lo:400:kworker.0 Request processed in 41us (797us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189270.065107:0:68287:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1276 00000100:00100000:3.0:1784189270.065130:0:68287:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1277 00000100:00100000:2.0:1784189270.065160:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784189270.065174:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf4262f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3640:1870854458205568:0@lo:400:kworker.0 00000100:00100000:2.0:1784189270.065195:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784189270.065205:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf4262fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3640:1870854458206080:0@lo:400:kworker.0 00000100:00100000:2.0:1784189270.065223:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784189270.065231:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc075f7d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3641:x1870854458205184:12345-0@lo:400:kworker.0 Request processed in 397us (750us total) trans 0 rc 0/0 00000100:00100000:0.0:1784189270.065237:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3904 00000100:00100000:2.0:1784189270.065244:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc050542a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bd553d0d-03e2-4233-b06b-b55bbfa2b954:3640:1870854458204544:0@lo:400:kworker.0 00000100:00100000:0.0:1784189270.065248:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458205696 00000100:00100000:0.0:1784189270.065251:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458205696 00000100:00100000:2.0:1784189270.065258:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1784189270.065263:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc075f7c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1870854458206208:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1784189270.065269:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3905 00000100:00100000:0.0:1784189270.065274:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc075f7e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3641:x1870854458205696:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784189270.065283:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784189270.065297:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc075f7e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3641:x1870854458205696:12345-0@lo:400:kworker.0 Request processed in 23us (343us total) trans 0 rc 0/0 00000100:00100000:0.0:1784189270.065303:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3905 00000100:00100000:0.0:1784189270.065313:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458206208 00000100:00100000:0.0:1784189270.065315:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458206208 00000100:00100000:0.0:1784189270.065348:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3906 00000100:00100000:0.0:1784189270.065353:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc050542a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3640:x1870854458206208:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1784189270.065375:0:8439:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445568512 avail 1299329024 00000100:00100000:0.0:1784189270.065426:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc050542a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3640:x1870854458206208:12345-0@lo:41:osp-pre-1-0.0 Request processed in 72us (141us total) trans 0 rc 0/0 00000100:00100000:0.0:1784189270.065432:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3906 00000100:00100000:2.0:1784189270.065450:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc075f7c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1870854458206208:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1784189270.065494:0:66169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1278 00000100:00100000:1.0:1784189270.065503:0:66169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf4262ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1870854458204800:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784189270.065534:0:66169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf4262ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1870854458204800:12345-0@lo:400:kworker.0 Request processed in 33us (1071us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189270.065540:0:66169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1278 00000100:00100000:1.0:1784189270.065553:0:66169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458205056 00000100:00100000:1.0:1784189270.065556:0:66169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458205056 00000100:00100000:1.0:1784189270.065570:0:66169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458205568 00000100:00100000:1.0:1784189270.065572:0:66169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458205568 00000100:00100000:1.0:1784189270.065582:0:66169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458206080 00000100:00100000:1.0:1784189270.065584:0:66169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458206080 00000100:00100000:1.0:1784189270.065596:0:66169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1279 00000100:00100000:1.0:1784189270.065601:0:66169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc07016d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1870854458205056:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784189270.065669:0:66169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc07016d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1870854458205056:12345-0@lo:400:kworker.0 Request processed in 67us (508us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189270.065682:0:66169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1279 00000100:00100000:1.0:1784189270.065696:0:66169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1280 00000100:00100000:1.0:1784189270.065701:0:66169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc07016dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1870854458205568:12345-0@lo:400:kworker.0 00010000:00000080:1.0:1784189270.065712:0:66169:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9dc07016dc00 x1870854458205568/t0(0) o400->lustre-MDT0000-lwp-MDT0001_UUID@0@lo:461/0 lens 224/224 e 0 to 0 dl 1784189281 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784189270.065724:0:68287:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc075f7f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1870854458204672:12345-0@lo:400:kworker.0 00010000:00000080:3.0:1784189270.065737:0:68287:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9dc075f7f100 x1870854458204672/t0(0) o400->lustre-MDT0000-lwp-OST0000_UUID@0@lo:461/0 lens 224/224 e 0 to 0 dl 1784189281 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784189270.065738:0:66169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc07016dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1870854458205568:12345-0@lo:400:kworker.0 Request processed in 38us (543us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189270.065744:0:66169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1280 00000100:00100000:1.0:1784189270.065755:0:66169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1281 00000100:00100000:1.0:1784189270.065761:0:66169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf470e3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1870854458206080:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784189270.065762:0:68287:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc075f7f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1870854458204672:12345-0@lo:400:kworker.0 Request processed in 627us (1320us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189270.065768:0:68287:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1277 00010000:00000080:1.0:1784189270.065770:0:66169:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9dbf470e3b80 x1870854458206080/t0(0) o400->lustre-MDT0000-lwp-MDT0000_UUID@0@lo:461/0 lens 224/224 e 0 to 0 dl 1784189281 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784189270.065786:0:26171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458205440 00000100:00100000:3.0:1784189270.065789:0:26171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458205440 00000100:00100000:3.0:1784189270.065811:0:26171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458205952 00000100:00100000:3.0:1784189270.065814:0:26171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458205952 00000100:00100000:3.0:1784189270.065832:0:26171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458205312 00000100:00100000:3.0:1784189270.065834:0:26171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458205312 00000100:00100000:3.0:1784189270.065849:0:26171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458205824 00000100:00100000:3.0:1784189270.065852:0:26171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458205824 00000100:00100000:1.0:1784189270.065869:0:66169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf470e3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1870854458206080:12345-0@lo:400:kworker.0 Request processed in 108us (644us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189270.065870:0:26171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2533 00000100:00100000:3.0:1784189270.065875:0:26171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf4262c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0001-mdtlov_UUID+5:3643:x1870854458205440:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784189270.065875:0:66169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1281 00000100:00100000:1.0:1784189270.065901:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc075f7c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1870854458206336:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1784189270.065904:0:26171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf4262c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0001-mdtlov_UUID+5:3643:x1870854458205440:12345-0@lo:400:kworker.0 Request processed in 28us (1542us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189270.065910:0:26171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2533 00000100:00100000:3.0:1784189270.065920:0:26171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2534 00000100:00100000:1.0:1784189270.065924:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784189270.065926:0:26171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf4262d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+5:3643:x1870854458205952:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784189270.065948:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458206336 00000100:00100000:3.0:1784189270.065950:0:26171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf4262d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+5:3643:x1870854458205952:12345-0@lo:400:kworker.0 Request processed in 24us (1534us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189270.065951:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458206336 00000100:00100000:3.0:1784189270.065956:0:26171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2534 00000100:00100000:3.0:1784189270.065966:0:26171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2535 00000100:00100000:1.0:1784189270.065971:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3907 00000100:00100000:3.0:1784189270.065972:0:26171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf4262c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0001-mdtlov_UUID+5:3643:x1870854458205312:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784189270.065975:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc075f7f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3642:x1870854458206336:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1784189270.065991:0:8438:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445203968 avail 1298964480 00010000:00000080:1.0:1784189270.066001:0:8438:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9dc075f7f480 x1870854458206336/t0(0) o41->lustre-MDT0001-mdtlov_UUID@0@lo:461/0 lens 224/368 e 0 to 0 dl 1784189281 ref 1 fl Interpret:/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784189270.066004:0:26171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf4262c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0001-mdtlov_UUID+5:3643:x1870854458205312:12345-0@lo:400:kworker.0 Request processed in 33us (1078us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189270.066011:0:26171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2535 00000100:00100000:3.0:1784189270.066021:0:26171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2536 00000100:00100000:3.0:1784189270.066026:0:26171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc05ed78a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+5:3643:x1870854458205824:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784189270.066039:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc075f7f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3642:x1870854458206336:12345-0@lo:41:osp-pre-0-1.0 Request processed in 63us (114us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189270.066045:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3907 00000100:00100000:3.0:1784189270.066046:0:26171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc05ed78a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+5:3643:x1870854458205824:12345-0@lo:400:kworker.0 Request processed in 21us (1082us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189270.066052:0:26171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2536 00000100:00100000:1.0:1784189270.066074:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc075f7c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1870854458206336:0@lo:41:osp-pre-0-1.0 00000100:00080000:3.0:1784189270.066079:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1784189270.066083:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1784189270.066085:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1784189270.066087:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1784189270.066095:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf4262f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3641:1870854458204672:0@lo:400:kworker.0 00000100:00100000:1.0:1784189270.066104:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf4262ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1870854458205184:0@lo:400:kworker.0 00000100:00100000:3.0:1784189270.066106:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf4262df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3643:1870854458204800:0@lo:400:kworker.0 00000100:00100000:1.0:1784189270.066112:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf4262ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1870854458205696:0@lo:400:kworker.0 00000100:00100000:3.0:1784189270.066114:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf4262ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1870854458205312:0@lo:400:kworker.0 00000100:00100000:3.0:1784189270.066122:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf4262d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1870854458205824:0@lo:400:kworker.0 00000100:00100000:3.0:1784189270.066131:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf4262dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3643:1870854458204928:0@lo:400:kworker.0 00000100:00100000:3.0:1784189270.066140:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf4262e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1870854458205440:0@lo:400:kworker.0 00000100:00100000:3.0:1784189270.066149:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf4262e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1870854458205952:0@lo:400:kworker.0 00000100:00100000:2.0:1784189270.066158:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf4262d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3640:1870854458205056:0@lo:400:kworker.0 00000100:00100000:2.0:1784189270.066166:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf4262f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3640:1870854458205568:0@lo:400:kworker.0 00000100:00100000:2.0:1784189270.066173:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf4262fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3640:1870854458206080:0@lo:400:kworker.0 00000100:00100000:2.0:1784189270.576641:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc075f7c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1870854458206464:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1784189270.576714:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784189270.576855:0:9466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458206464 00000100:00100000:1.0:1784189270.576863:0:9466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458206464 00000100:00100000:1.0:1784189270.576913:0:9466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2030 00000100:00100000:1.0:1784189270.576923:0:9466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc080e7ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1870854458206464:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1784189270.576943:0:9466:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8647872 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1784189270.576993:0:9466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc080e7ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1870854458206464:12345-0@lo:13:osp-pre-1-0.0 Request processed in 72us (278us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189270.577000:0:9466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2030 00000100:00100000:2.0:1784189270.577108:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc075f7c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1870854458206464:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1784189270.580708:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1784189270.580731:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc080e7d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1870854458206592:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1784189270.580796:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784189270.580840:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458206592 00000100:00100000:2.0:1784189270.580847:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458206592 00000100:00100000:2.0:1784189270.580889:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2031 00000100:00100000:2.0:1784189270.580898:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc080e7e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1870854458206592:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1784189270.580920:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8647872 pending 0 free 3922481152 avail 3690958848 00000100:00100000:2.0:1784189270.580959:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc080e7e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1870854458206592:12345-0@lo:13:osp-pre-0-0.0 Request processed in 62us (163us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189270.580967:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2031 00000100:00100000:2.0:1784189270.581007:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc080e7d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1870854458206592:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1784189270.767450:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784189271.793501:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1784189272.117180:0:93586:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: mds1 REPLAY BARRIER on lustre-MDT0000 00000100:00100000:1.0:1784189272.191461:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1784189272.192905:0:68287:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436316928 00000100:00100000:3.0:1784189272.192917:0:68287:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436316928 00000100:00100000:3.0:1784189272.193033:0:68287:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1379 00000100:00100000:3.0:1784189272.193045:0:68287:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc075f7dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:debedd94-805c-42a0-a5e5-41758b2012e9+13:72041:x1870854436316928:12345-192.168.203.12@tcp:101:touch.0 00010000:00010000:3.0:1784189272.193066:0:68287:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784189272.193108:0:68287:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc058f66000/0xcc1762b626f8c493 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbfc5de7fe6c405c expref: -99 pid: 68287 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189272.193177:0:68287:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc058f67000/0xcc1762b626f8c49a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189272.193192:0:68287:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc058f67000/0xcc1762b626f8c49a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189272.193203:0:68287:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc058f67000/0xcc1762b626f8c49a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784189272.193263:0:68287:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1784189272.193268:0:68287:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1784189272.193302:0:68287:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9dc058f67000/0xcc1762b626f8c49a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189272.193355:0:68287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc058f66000/0xcc1762b626f8c493 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c405c expref: 15 pid: 68287 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189272.193370:0:68287:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc058f67000/0xcc1762b626f8c49a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c405c expref: 14 pid: 68287 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189272.193378:0:68287:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9dc0630a6700) 00010000:00010000:3.0:1784189272.193381:0:68287:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1784189272.193394:0:68287:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc058f67000, rc 0) 00010000:00000080:3.0:1784189272.193403:0:68287:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9dc075f7dc00 x1870854436316928/t0(0) o101->debedd94-805c-42a0-a5e5-41758b2012e9@192.168.203.12@tcp:463/0 lens 576/688 e 0 to 0 dl 1784189283 ref 1 fl Interpret:/600/0 rc 0/0 job:'touch.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1784189272.193466:0:68287:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc075f7dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:debedd94-805c-42a0-a5e5-41758b2012e9+14:72041:x1870854436316928:12345-192.168.203.12@tcp:101:touch.0 Request processed in 423us (2015us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189272.193482:0:68287:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1379 00000100:00080000:0.0:1784189272.193782:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1784189272.198232:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1784189272.198276:0:66945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436317056 00000100:00100000:1.0:1784189272.198285:0:66945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436317056 00000100:00100000:1.0:1784189272.198355:0:66945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1380 00000100:00100000:1.0:1784189272.198365:0:66945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc075f7ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:debedd94-805c-42a0-a5e5-41758b2012e9+14:72041:x1870854436317056:12345-192.168.203.12@tcp:101:touch.0 00010000:00010000:1.0:1784189272.198393:0:66945:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784189272.198413:0:66945:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4710e000/0xcc1762b626f8c4a1 lrc: 2/0,0 mode: --/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbfc5de7fe6c4063 expref: -99 pid: 66945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189272.198495:0:66945:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4710e200/0xcc1762b626f8c4a8 lrc: 3/1,0 mode: --/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189272.198509:0:66945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4710e200/0xcc1762b626f8c4a8 lrc: 3/1,0 mode: CR/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189272.198520:0:66945:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4710e200/0xcc1762b626f8c4a8 lrc: 3/1,0 mode: CR/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189272.198534:0:66945:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4710ec00/0xcc1762b626f8c4af lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0x1:0x0].0xb04f75d6 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189272.198542:0:66945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4710ec00/0xcc1762b626f8c4af lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189272.198549:0:66945:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4710ec00/0xcc1762b626f8c4af lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189272.198598:0:66945:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4710f600/0xcc1762b626f8c4b6 lrc: 3/1,0 mode: --/PR res: [0x2400090a5:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189272.198606:0:66945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4710f600/0xcc1762b626f8c4b6 lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189272.198613:0:66945:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4710f600/0xcc1762b626f8c4b6 lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1784189272.198635:0:66945:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4710f600/0xcc1762b626f8c4b6 lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189272.198648:0:66945:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4710e200/0xcc1762b626f8c4a8 lrc: 4/1,0 mode: CR/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189272.198661:0:66945:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4710e200/0xcc1762b626f8c4a8 lrc: 4/1,0 mode: CR/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189272.198668:0:66945:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4710e200/0xcc1762b626f8c4a8 lrc: 3/0,0 mode: CR/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189272.198692:0:66945:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4710e200/0xcc1762b626f8c4a8 lrc: 4/0,0 mode: CR/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189272.198699:0:66945:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dbf4710e200 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:1.0:1784189272.198703:0:66945:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4710e200/0xcc1762b626f8c4a8 lrc: 4/0,0 mode: CR/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189272.198711:0:66945:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4710e200/0xcc1762b626f8c4a8 lrc: 5/0,0 mode: CR/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189272.198724:0:66945:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x1:0x0].0x0 (ffff9dc07b032200) 00010000:00010000:1.0:1784189272.198727:0:66945:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784189272.198732:0:66945:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4710e200/0xcc1762b626f8c4a8 lrc: 3/0,0 mode: --/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189272.198738:0:66945:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4710e200/0xcc1762b626f8c4a8 lrc: 0/0,0 mode: --/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189272.198750:0:66945:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4710ec00/0xcc1762b626f8c4af lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189272.198756:0:66945:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4710ec00/0xcc1762b626f8c4af lrc: 2/0,0 mode: PR/PR res: [0x20000cf21:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189272.198761:0:66945:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4710ec00/0xcc1762b626f8c4af lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189272.199178:0:66945:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dbf4710ec00 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:1.0:1784189272.199181:0:66945:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4710ec00/0xcc1762b626f8c4af lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189272.199187:0:66945:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4710ec00/0xcc1762b626f8c4af lrc: 4/0,0 mode: PR/PR res: [0x20000cf21:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189272.199195:0:66945:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x1:0x0].0xb04f75d6 (ffff9dc0455f8300) 00010000:00010000:1.0:1784189272.199198:0:66945:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784189272.199201:0:66945:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4710ec00/0xcc1762b626f8c4af lrc: 2/0,0 mode: --/PR res: [0x20000cf21:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189272.199207:0:66945:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4710ec00/0xcc1762b626f8c4af lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189272.199250:0:66945:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4710e000/0xcc1762b626f8c4a1 lrc: 0/0,0 mode: --/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c4063 expref: 16 pid: 66945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189272.199266:0:66945:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4710f600/0xcc1762b626f8c4b6 lrc: 3/0,0 mode: PR/PR res: [0x2400090a5:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c4063 expref: 15 pid: 66945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189272.199274:0:66945:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x2:0x0].0x0 (ffff9dc0455f8f00) 00010000:00010000:1.0:1784189272.199277:0:66945:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1784189272.199279:0:66945:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dbf4710f600, rc 0) 00010000:00000080:1.0:1784189272.199287:0:66945:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9dc075f7ce00 x1870854436317056/t0(0) o101->debedd94-805c-42a0-a5e5-41758b2012e9@192.168.203.12@tcp:463/0 lens 576/584 e 0 to 0 dl 1784189283 ref 1 fl Interpret:/600/0 rc 0/0 job:'touch.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1784189272.199378:0:66945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc075f7ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:debedd94-805c-42a0-a5e5-41758b2012e9+15:72041:x1870854436317056:12345-192.168.203.12@tcp:101:touch.0 Request processed in 1015us (1152us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189272.199406:0:66945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1380 00000100:00100000:2.0:1784189272.210937:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1784189272.211030:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1784189272.211061:0:26172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436317312 00000100:00100000:2.0:1784189272.211070:0:26172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436317312 00000100:00100000:2.0:1784189272.211139:0:26172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 715 00000100:00100000:2.0:1784189272.211149:0:26172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc080e7c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:debedd94-805c-42a0-a5e5-41758b2012e9+15:2396:x1870854436317312:12345-192.168.203.12@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1784189272.211165:0:26172:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784189272.211190:0:26172:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4710f600/0xcc1762b626f8c4b6 lrc: 0/0,0 mode: --/PR res: [0x2400090a5:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c4063 expref: 15 pid: 66945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189272.211218:0:26172:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x2:0x0].0x0 (ffff9dc0455f8f00) 00010000:00010000:2.0:1784189272.211232:0:26172:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784189272.211284:0:26172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc080e7c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:debedd94-805c-42a0-a5e5-41758b2012e9+14:2396:x1870854436317312:12345-192.168.203.12@tcp:103:ldlm_bl.0 Request processed in 136us (253us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189272.211293:0:26172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 715 00000100:00100000:0.0:1784189272.214185:0:66170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436317184 00000100:00100000:0.0:1784189272.214199:0:66170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436317184 00000100:00100000:0.0:1784189272.214559:0:66170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1381 00000100:00100000:0.0:1784189272.214570:0:66170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc080e7d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:debedd94-805c-42a0-a5e5-41758b2012e9+5:72041:x1870854436317184:12345-192.168.203.12@tcp:101:touch.0 00010000:00010000:0.0:1784189272.214589:0:66170:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784189272.214608:0:66170:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9dc04152c200/0xcc1762b626f8c4bd lrc: 2/0,0 mode: --/CR res: [0x2400090a5:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbfc5de7fe6c406a expref: -99 pid: 66170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189272.214662:0:66170:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9dc04152c800/0xcc1762b626f8c4c4 lrc: 3/1,0 mode: --/PR res: [0x2400090a5:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189272.214690:0:66170:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9dc04152c800/0xcc1762b626f8c4c4 lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x2:0x0].0x0 bits 0x10/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66170 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189272.214703:0:66170:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9dc04152c800/0xcc1762b626f8c4c4 lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x2:0x0].0x0 bits 0x10/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66170 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784189272.214748:0:66170:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2400090a5:0x2:0x0]: returning size 4096 00000004:00200000:0.0:1784189272.214752:0:66170:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00010000:00010000:0.0:1784189272.214804:0:66170:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9dc04152c200/0xcc1762b626f8c4bd lrc: 0/0,0 mode: --/CR res: [0x2400090a5:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c406a expref: 7 pid: 66170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189272.214820:0:66170:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9dc04152c800/0xcc1762b626f8c4c4 lrc: 3/0,0 mode: PR/PR res: [0x2400090a5:0x2:0x0].0x0 bits 0x10/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c406a expref: 6 pid: 66170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189272.214828:0:66170:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x2:0x0].0x0 (ffff9dc06adaa000) 00010000:00010000:0.0:1784189272.214831:0:66170:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 10 00010000:00010000:0.0:1784189272.214834:0:66170:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc04152c800, rc 0) 00000100:00100000:0.0:1784189272.214895:0:66170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc080e7d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:debedd94-805c-42a0-a5e5-41758b2012e9+6:72041:x1870854436317184:12345-192.168.203.12@tcp:101:touch.0 Request processed in 328us (3967us total) trans 0 rc 0/0 00000100:00100000:0.0:1784189272.214908:0:66170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1381 00000100:00080000:1.0:1784189272.215290:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1784189272.220425:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1784189272.220517:0:68287:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436317568 00000100:00100000:3.0:1784189272.220525:0:68287:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436317568 00000100:00100000:3.0:1784189272.220576:0:68287:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1382 00000100:00100000:3.0:1784189272.220586:0:68287:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc080e7dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:debedd94-805c-42a0-a5e5-41758b2012e9+6:72041:x1870854436317568:12345-192.168.203.12@tcp:101:touch.0 00010000:00010000:3.0:1784189272.220604:0:68287:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784189272.220622:0:68287:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9dc058f66000/0xcc1762b626f8c4cb lrc: 2/0,0 mode: --/CW res: [0x2400090a5:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbfc5de7fe6c4071 expref: -99 pid: 68287 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189272.220719:0:68287:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9dc058f67400/0xcc1762b626f8c4d2 lrc: 3/0,1 mode: --/CW res: [0x2400090a5:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189272.220732:0:68287:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9dc058f67400/0xcc1762b626f8c4d2 lrc: 3/0,1 mode: CW/CW res: [0x2400090a5:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 68287 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189272.220742:0:68287:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9dc058f67400/0xcc1762b626f8c4d2 lrc: 3/0,1 mode: CW/CW res: [0x2400090a5:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 68287 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189272.220755:0:68287:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9dc058f67200/0xcc1762b626f8c4d9 lrc: 3/0,1 mode: --/PW res: [0x2400090a5:0x2:0x0].0x9add8152 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189272.220761:0:68287:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9dc058f67200/0xcc1762b626f8c4d9 lrc: 3/0,1 mode: PW/PW res: [0x2400090a5:0x2:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 68287 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189272.220766:0:68287:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9dc058f67200/0xcc1762b626f8c4d9 lrc: 3/0,1 mode: PW/PW res: [0x2400090a5:0x2:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 68287 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784189272.221019:0:68287:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc05ed7b800 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:68287:1870854458206720:0@lo:1000:mdt00_004.0 00000100:00100000:3.0:1784189272.221068:0:68287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784189272.221184:0:68287:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dbf45b9b900 going to sleep for 11 seconds 00000100:00100000:0.0:1784189272.221272:0:26492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458206720 00000100:00100000:0.0:1784189272.221277:0:26492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458206720 00000100:00100000:0.0:1784189272.221316:0:26492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3908 00000100:00100000:0.0:1784189272.221346:0:26492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc05ed7ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:68287:x1870854458206720:12345-0@lo:1000:mdt00_004.0 00010000:00000080:0.0:1784189272.221380:0:26492:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9dc05ed7ad80 x1870854458206720/t0(0) o1000->lustre-MDT0001-mdtlov_UUID@0@lo:463/0 lens 328/4320 e 0 to 0 dl 1784189283 ref 1 fl Interpret:/200/0 rc 0/0 job:'mdt00_004.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784189272.221442:0:26492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc05ed7ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:68287:x1870854458206720:12345-0@lo:1000:mdt00_004.0 Request processed in 96us (372us total) trans 0 rc 0/0 00000100:00100000:0.0:1784189272.221450:0:26492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3908 00000100:00100000:3.0:1784189272.221464:0:68287:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc05ed7b800 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:68287:1870854458206720:0@lo:1000:mdt00_004.0 00000004:00080000:3.0:1784189272.221850:0:68287:0:(osp_internal.h:570:osp_update_last_fid()) Gap in objids: start=[0x2c0000400:0xd1:0x0], count =369 00000004:00080000:3.0:1784189272.221857:0:68287:0:(osp_object.c:1645:osp_create()) Writing gap [0x2c0000400:0xd1:0x0]+369 in llog 00000004:00080000:3.0:1784189272.221869:0:68287:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0x242:0x0], index 1: 0 00010000:00010000:3.0:1784189272.222007:0:68287:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9dc058f67e00/0xcc1762b626f8c4e0 lrc: 3/1,0 mode: --/PR res: [0x2400090a5:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189272.222017:0:68287:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9dc058f67e00/0xcc1762b626f8c4e0 lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 68287 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189272.222025:0:68287:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9dc058f67e00/0xcc1762b626f8c4e0 lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 68287 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189272.222056:0:68287:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9dc058f67400/0xcc1762b626f8c4d2 lrc: 4/0,1 mode: CW/CW res: [0x2400090a5:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 68287 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189272.222062:0:68287:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9dc058f67400/0xcc1762b626f8c4d2 lrc: 4/0,1 mode: CW/CW res: [0x2400090a5:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 68287 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189272.222067:0:68287:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9dc058f67400/0xcc1762b626f8c4d2 lrc: 3/0,0 mode: CW/CW res: [0x2400090a5:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 68287 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189272.222073:0:68287:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9dc058f67400/0xcc1762b626f8c4d2 lrc: 4/0,0 mode: CW/CW res: [0x2400090a5:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 68287 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189272.222078:0:68287:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc058f67400 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:3.0:1784189272.222151:0:68287:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9dc058f67400/0xcc1762b626f8c4d2 lrc: 4/0,0 mode: CW/CW res: [0x2400090a5:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 68287 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189272.222159:0:68287:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9dc058f67400/0xcc1762b626f8c4d2 lrc: 5/0,0 mode: CW/CW res: [0x2400090a5:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 68287 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189272.222184:0:68287:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x2:0x0].0x0 (ffff9dc06adaa000) 00010000:00010000:3.0:1784189272.222187:0:68287:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784189272.222191:0:68287:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9dc058f67400/0xcc1762b626f8c4d2 lrc: 3/0,0 mode: --/CW res: [0x2400090a5:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 68287 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189272.222198:0:68287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9dc058f67400/0xcc1762b626f8c4d2 lrc: 0/0,0 mode: --/CW res: [0x2400090a5:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 68287 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1784189272.222210:0:68287:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000b504c4e7 reply state 0000000032a07d14 transno 81604378763 ns: mdt-lustre-MDT0001_UUID lock: ffff9dc058f67200/0xcc1762b626f8c4d9 lrc: 3/0,1 mode: PW/PW res: [0x2400090a5:0x2:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 68287 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189272.222221:0:68287:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9dc058f67200/0xcc1762b626f8c4d9 lrc: 3/0,1 mode: TXN/TXN res: [0x2400090a5:0x2:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 68287 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189272.222228:0:68287:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x2:0x0].0x9add8152 (ffff9dbf45662700) 00010000:00010000:3.0:1784189272.222230:0:68287:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1784189272.222232:0:68287:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1784189272.222263:0:68287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9dc058f66000/0xcc1762b626f8c4cb lrc: 0/0,0 mode: --/CW res: [0x2400090a5:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c4071 expref: 9 pid: 68287 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189272.222277:0:68287:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9dc058f67e00/0xcc1762b626f8c4e0 lrc: 3/0,0 mode: PR/PR res: [0x2400090a5:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c4071 expref: 8 pid: 68287 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189272.222284:0:68287:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x4:0x0].0x0 (ffff9dbf45662800) 00010000:00010000:3.0:1784189272.222287:0:68287:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1784189272.222289:0:68287:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc058f67e00, rc 0) 00000100:00100000:3.0:1784189272.222562:0:68287:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc080e7dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:debedd94-805c-42a0-a5e5-41758b2012e9+9:72041:x1870854436317568:12345-192.168.203.12@tcp:101:touch.0 Request processed in 1976us (2145us total) trans 81604378763 rc 0/0 00000100:00100000:3.0:1784189272.222569:0:68287:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1382 00000100:00100000:3.0:1784189272.230156:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1784189272.230216:0:66171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436317824 00000100:00100000:1.0:1784189272.230225:0:66171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436317824 00000100:00100000:1.0:1784189272.230276:0:66171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1383 00000100:00100000:1.0:1784189272.230287:0:66171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc05ed7b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:debedd94-805c-42a0-a5e5-41758b2012e9+9:72041:x1870854436317824:12345-192.168.203.12@tcp:36:touch.0 00010000:00010000:1.0:1784189272.230362:0:66171:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784189272.230398:0:66171:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9dc058f67e00/0xcc1762b626f8c4e0 lrc: 0/0,0 mode: --/PR res: [0x2400090a5:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c4071 expref: 9 pid: 68287 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189272.230415:0:66171:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x4:0x0].0x0 (ffff9dbf45662800) 00010000:00010000:1.0:1784189272.230426:0:66171:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1784189272.231645:0:66171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9dbf4710e000/0xcc1762b626f8c4ee lrc: 3/0,1 mode: --/PW res: [0x2400090a5:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189272.231663:0:66171:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9dbf4710e000/0xcc1762b626f8c4ee lrc: 3/0,1 mode: PW/PW res: [0x2400090a5:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66171 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189272.231674:0:66171:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9dbf4710e000/0xcc1762b626f8c4ee lrc: 3/0,1 mode: PW/PW res: [0x2400090a5:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66171 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1784189272.231783:0:66171:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000004a1d39a9 reply state 0000000097784ddc transno 81604378764 ns: mdt-lustre-MDT0001_UUID lock: ffff9dbf4710e000/0xcc1762b626f8c4ee lrc: 3/0,1 mode: PW/PW res: [0x2400090a5:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66171 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189272.231796:0:66171:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9dbf4710e000/0xcc1762b626f8c4ee lrc: 3/0,1 mode: TXN/TXN res: [0x2400090a5:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66171 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189272.231803:0:66171:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x4:0x0].0x0 (ffff9dc0455f8300) 00010000:00010000:1.0:1784189272.231805:0:66171:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1784189272.231816:0:66171:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1784189272.231922:0:66171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc05ed7b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:debedd94-805c-42a0-a5e5-41758b2012e9+10:72041:x1870854436317824:12345-192.168.203.12@tcp:36:touch.0 Request processed in 1636us (1771us total) trans 81604378764 rc 0/0 00000100:00100000:1.0:1784189272.231931:0:66171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1383 00000100:00100000:2.0:1784189272.243654:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1784189272.243833:0:66170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436317952 00000100:00100000:0.0:1784189272.243842:0:66170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436317952 00000100:00100000:0.0:1784189272.243908:0:66170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1384 00000100:00100000:0.0:1784189272.243917:0:66170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc080e7fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:debedd94-805c-42a0-a5e5-41758b2012e9+10:72041:x1870854436317952:12345-192.168.203.12@tcp:101:touch.0 00010000:00010000:0.0:1784189272.243939:0:66170:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784189272.243956:0:66170:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9dc04152c400/0xcc1762b626f8c4f5 lrc: 2/0,0 mode: --/CR res: [0x2400090a5:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbfc5de7fe6c4078 expref: -99 pid: 66170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189272.244007:0:66170:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9dc04152c400/0xcc1762b626f8c4f5 lrc: 3/0,0 mode: CR/CR res: [0x2400090a5:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c4078 expref: 11 pid: 66170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189272.244020:0:66170:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9dc04152c400/0xcc1762b626f8c4f5 lrc: 3/0,0 mode: CR/CR res: [0x2400090a5:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c4078 expref: 11 pid: 66170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189272.244036:0:66170:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x4:0x0].0x0 (ffff9dc0455f8300) 00010000:00010000:0.0:1784189272.244040:0:66170:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1784189272.244050:0:66170:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc04152c400, rc 0) 00000100:00100000:0.0:1784189272.244110:0:66170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc080e7fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:debedd94-805c-42a0-a5e5-41758b2012e9+11:72041:x1870854436317952:12345-192.168.203.12@tcp:101:touch.0 Request processed in 188us (460us total) trans 0 rc 0/0 00000100:00100000:0.0:1784189272.244119:0:66170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1384 00000100:00100000:2.0:1784189272.261539:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1784189272.261570:0:26164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436318080 00000100:00100000:2.0:1784189272.261579:0:26164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436318080 00000100:00100000:2.0:1784189272.261633:0:26164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 4984 00000100:00100000:2.0:1784189272.261643:0:26164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc080e7df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:debedd94-805c-42a0-a5e5-41758b2012e9+6:2397:x1870854436318080:12345-192.168.203.12@tcp:2:touch.0 00000100:00080000:1.0:1784189272.263437:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00080000:3.0:1784189272.266409:0:9506:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294968958 is committed 00000001:00100000:3.0:1784189272.266421:0:9506:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of debedd94-805c-42a0-a5e5-41758b2012e9 00000100:00100000:1.0:1784189272.267968:0:26164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc080e7df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:debedd94-805c-42a0-a5e5-41758b2012e9+5:2397:x1870854436318080:12345-192.168.203.12@tcp:2:touch.0 Request processed in 6320us (6428us total) trans 4294968958 rc 0/0 00000100:00100000:1.0:1784189272.267980:0:26164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 4984 00000100:00100000:3.0:1784189272.270652:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1784189272.271771:0:66173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436318336 00000100:00100000:2.0:1784189272.271783:0:66173:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436318336 00000100:00100000:2.0:1784189272.271839:0:66173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 242 00000100:00100000:2.0:1784189272.271849:0:66173:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc05ed7aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:debedd94-805c-42a0-a5e5-41758b2012e9+11:72041:x1870854436318336:12345-192.168.203.12@tcp:35:touch.0 00000100:00100000:2.0:1784189272.272121:0:66173:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc05ed7aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:debedd94-805c-42a0-a5e5-41758b2012e9+12:72041:x1870854436318336:12345-192.168.203.12@tcp:35:touch.0 Request processed in 272us (1474us total) trans 81604378765 rc 0/0 00000100:00100000:2.0:1784189272.272129:0:66173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 242 00000100:00100000:3.0:1784189272.296497:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1784189272.296662:0:68287:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436318464 00000100:00100000:0.0:1784189272.296672:0:68287:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436318464 00000100:00100000:0.0:1784189272.296730:0:68287:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1385 00000100:00100000:0.0:1784189272.296739:0:68287:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc05ed7b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:debedd94-805c-42a0-a5e5-41758b2012e9+14:72042:x1870854436318464:12345-192.168.203.12@tcp:101:touch.0 00010000:00010000:0.0:1784189272.296758:0:68287:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784189272.296885:0:68287:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04152d400/0xcc1762b626f8c4fc lrc: 2/0,0 mode: --/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbfc5de7fe6c407f expref: -99 pid: 68287 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189272.296947:0:68287:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04152c200/0xcc1762b626f8c503 lrc: 3/1,0 mode: --/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189272.296962:0:68287:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04152c200/0xcc1762b626f8c503 lrc: 3/1,0 mode: CR/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189272.296973:0:68287:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04152c200/0xcc1762b626f8c503 lrc: 3/1,0 mode: CR/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189272.296989:0:68287:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc05ec0ea00/0xcc1762b626f8c50a lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0x1:0x0].0x8f93a2f9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189272.296996:0:68287:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc05ec0ea00/0xcc1762b626f8c50a lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189272.297003:0:68287:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc05ec0ea00/0xcc1762b626f8c50a lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189272.297053:0:68287:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc05ec0fa00/0xcc1762b626f8c511 lrc: 3/1,0 mode: --/PR res: [0x2400090a5:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189272.297073:0:68287:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc05ec0fa00/0xcc1762b626f8c511 lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189272.297080:0:68287:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc05ec0fa00/0xcc1762b626f8c511 lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1784189272.297102:0:68287:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9dc05ec0fa00/0xcc1762b626f8c511 lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189272.297122:0:68287:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04152c200/0xcc1762b626f8c503 lrc: 4/1,0 mode: CR/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189272.297129:0:68287:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04152c200/0xcc1762b626f8c503 lrc: 4/1,0 mode: CR/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189272.297135:0:68287:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04152c200/0xcc1762b626f8c503 lrc: 3/0,0 mode: CR/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189272.297142:0:68287:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04152c200/0xcc1762b626f8c503 lrc: 4/0,0 mode: CR/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189272.297148:0:68287:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc04152c200 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:0.0:1784189272.297152:0:68287:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04152c200/0xcc1762b626f8c503 lrc: 4/0,0 mode: CR/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189272.297160:0:68287:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04152c200/0xcc1762b626f8c503 lrc: 5/0,0 mode: CR/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189272.297171:0:68287:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x1:0x0].0x0 (ffff9dc07b032200) 00010000:00010000:0.0:1784189272.297174:0:68287:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784189272.297178:0:68287:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04152c200/0xcc1762b626f8c503 lrc: 3/0,0 mode: --/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189272.297190:0:68287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04152c200/0xcc1762b626f8c503 lrc: 0/0,0 mode: --/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189272.297205:0:68287:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc05ec0ea00/0xcc1762b626f8c50a lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189272.297211:0:68287:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc05ec0ea00/0xcc1762b626f8c50a lrc: 2/0,0 mode: PR/PR res: [0x20000cf21:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189272.297217:0:68287:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dc05ec0ea00/0xcc1762b626f8c50a lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189272.297222:0:68287:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc05ec0ea00 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:0.0:1784189272.297225:0:68287:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc05ec0ea00/0xcc1762b626f8c50a lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189272.297231:0:68287:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc05ec0ea00/0xcc1762b626f8c50a lrc: 4/0,0 mode: PR/PR res: [0x20000cf21:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189272.297239:0:68287:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x1:0x0].0x8f93a2f9 (ffff9dc06adaae00) 00010000:00010000:0.0:1784189272.297242:0:68287:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784189272.297245:0:68287:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dc05ec0ea00/0xcc1762b626f8c50a lrc: 2/0,0 mode: --/PR res: [0x20000cf21:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189272.297251:0:68287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc05ec0ea00/0xcc1762b626f8c50a lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189272.297283:0:68287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04152d400/0xcc1762b626f8c4fc lrc: 0/0,0 mode: --/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c407f expref: 16 pid: 68287 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189272.297309:0:68287:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc05ec0fa00/0xcc1762b626f8c511 lrc: 3/0,0 mode: PR/PR res: [0x2400090a5:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c407f expref: 15 pid: 68287 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189272.297412:0:68287:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x3:0x0].0x0 (ffff9dc074ae2300) 00010000:00010000:0.0:1784189272.297415:0:68287:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1784189272.297418:0:68287:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc05ec0fa00, rc 0) 00010000:00000080:0.0:1784189272.297426:0:68287:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9dc05ed7b100 x1870854436318464/t0(0) o101->debedd94-805c-42a0-a5e5-41758b2012e9@192.168.203.12@tcp:463/0 lens 576/584 e 0 to 0 dl 1784189283 ref 1 fl Interpret:/600/0 rc 0/0 job:'touch.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1784189272.297593:0:68287:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc05ed7b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:debedd94-805c-42a0-a5e5-41758b2012e9+15:72042:x1870854436318464:12345-192.168.203.12@tcp:101:touch.0 Request processed in 851us (1099us total) trans 0 rc 0/0 00000100:00100000:0.0:1784189272.297601:0:68287:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1385 00000100:00100000:2.0:1784189272.301311:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1784189272.301370:0:66169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436318592 00000100:00100000:1.0:1784189272.301396:0:66169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436318592 00000100:00100000:1.0:1784189272.301453:0:66169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1386 00000100:00100000:1.0:1784189272.301463:0:66169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc05f02c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:debedd94-805c-42a0-a5e5-41758b2012e9+12:72042:x1870854436318592:12345-192.168.203.12@tcp:101:touch.0 00010000:00010000:1.0:1784189272.301491:0:66169:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784189272.301517:0:66169:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9dbf4710ec00/0xcc1762b626f8c518 lrc: 2/0,0 mode: --/CR res: [0x2400090a5:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbfc5de7fe6c4086 expref: -99 pid: 66169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189272.301572:0:66169:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9dbf4710e200/0xcc1762b626f8c51f lrc: 3/1,0 mode: --/PR res: [0x2400090a5:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189272.301584:0:66169:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9dbf4710e200/0xcc1762b626f8c51f lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x3:0x0].0x0 bits 0x10/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66169 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189272.301595:0:66169:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9dbf4710e200/0xcc1762b626f8c51f lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x3:0x0].0x0 bits 0x10/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66169 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784189272.301638:0:66169:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2400090a5:0x3:0x0]: returning size 4096 00000004:00200000:1.0:1784189272.301641:0:66169:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00010000:00010000:1.0:1784189272.301675:0:66169:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9dbf4710ec00/0xcc1762b626f8c518 lrc: 0/0,0 mode: --/CR res: [0x2400090a5:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c4086 expref: 14 pid: 66169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189272.301710:0:66169:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9dbf4710e200/0xcc1762b626f8c51f lrc: 3/0,0 mode: PR/PR res: [0x2400090a5:0x3:0x0].0x0 bits 0x10/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c4086 expref: 13 pid: 66169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189272.301719:0:66169:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x3:0x0].0x0 (ffff9dc0455f8800) 00010000:00010000:1.0:1784189272.301722:0:66169:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 10 00010000:00010000:1.0:1784189272.301725:0:66169:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dbf4710e200, rc 0) 00000100:00100000:1.0:1784189272.301791:0:66169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc05f02c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:debedd94-805c-42a0-a5e5-41758b2012e9+13:72042:x1870854436318592:12345-192.168.203.12@tcp:101:touch.0 Request processed in 329us (487us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189272.301797:0:66169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1386 00000100:00100000:3.0:1784189272.302367:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1784189272.302437:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436318720 00000100:00100000:2.0:1784189272.302442:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436318720 00000100:00100000:2.0:1784189272.302489:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 716 00000100:00100000:2.0:1784189272.302497:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc07113b050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:debedd94-805c-42a0-a5e5-41758b2012e9+15:2396:x1870854436318720:12345-192.168.203.12@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1784189272.302509:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784189272.302526:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc05ec0fa00/0xcc1762b626f8c511 lrc: 0/0,0 mode: --/PR res: [0x2400090a5:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c407f expref: 15 pid: 68287 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189272.302551:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x3:0x0].0x0 (ffff9dc074ae2300) 00010000:00010000:2.0:1784189272.302554:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784189272.302590:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc07113b050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:debedd94-805c-42a0-a5e5-41758b2012e9+14:2396:x1870854436318720:12345-192.168.203.12@tcp:103:ldlm_bl.0 Request processed in 93us (223us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189272.302597:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 716 00000100:00100000:3.0:1784189272.305755:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1784189272.307083:0:66170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436318976 00000100:00100000:0.0:1784189272.307093:0:66170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436318976 00000100:00100000:0.0:1784189272.307190:0:66170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1387 00000100:00100000:0.0:1784189272.307201:0:66170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc05ed78380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:debedd94-805c-42a0-a5e5-41758b2012e9+13:72042:x1870854436318976:12345-192.168.203.12@tcp:101:touch.0 00010000:00010000:0.0:1784189272.307220:0:66170:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784189272.307240:0:66170:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9dc05ec0e800/0xcc1762b626f8c526 lrc: 2/0,0 mode: --/CW res: [0x2400090a5:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbfc5de7fe6c408d expref: -99 pid: 66170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189272.307357:0:66170:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9dc05ec0e400/0xcc1762b626f8c52d lrc: 3/0,1 mode: --/CW res: [0x2400090a5:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189272.307372:0:66170:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9dc05ec0e400/0xcc1762b626f8c52d lrc: 3/0,1 mode: CW/CW res: [0x2400090a5:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66170 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189272.307395:0:66170:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9dc05ec0e400/0xcc1762b626f8c52d lrc: 3/0,1 mode: CW/CW res: [0x2400090a5:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66170 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189272.307420:0:66170:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9dc05ec0f400/0xcc1762b626f8c534 lrc: 3/0,1 mode: --/PW res: [0x2400090a5:0x3:0x0].0x9add8152 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189272.307428:0:66170:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9dc05ec0f400/0xcc1762b626f8c534 lrc: 3/0,1 mode: PW/PW res: [0x2400090a5:0x3:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66170 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189272.307436:0:66170:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9dc05ec0f400/0xcc1762b626f8c534 lrc: 3/0,1 mode: PW/PW res: [0x2400090a5:0x3:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66170 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1784189272.307721:0:66170:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0x243:0x0], index 1: 0 00010000:00010000:0.0:1784189272.307924:0:66170:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9dc05ec0f600/0xcc1762b626f8c53b lrc: 3/1,0 mode: --/PR res: [0x2400090a5:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189272.308871:0:66170:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9dc05ec0f600/0xcc1762b626f8c53b lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66170 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189272.308880:0:66170:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9dc05ec0f600/0xcc1762b626f8c53b lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66170 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189272.308920:0:66170:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9dc05ec0e400/0xcc1762b626f8c52d lrc: 4/0,1 mode: CW/CW res: [0x2400090a5:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66170 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189272.308928:0:66170:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9dc05ec0e400/0xcc1762b626f8c52d lrc: 4/0,1 mode: CW/CW res: [0x2400090a5:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66170 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189272.308934:0:66170:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9dc05ec0e400/0xcc1762b626f8c52d lrc: 3/0,0 mode: CW/CW res: [0x2400090a5:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66170 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189272.308940:0:66170:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9dc05ec0e400/0xcc1762b626f8c52d lrc: 4/0,0 mode: CW/CW res: [0x2400090a5:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66170 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189272.308946:0:66170:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc05ec0e400 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:0.0:1784189272.308959:0:66170:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9dc05ec0e400/0xcc1762b626f8c52d lrc: 4/0,0 mode: CW/CW res: [0x2400090a5:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66170 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189272.308966:0:66170:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9dc05ec0e400/0xcc1762b626f8c52d lrc: 5/0,0 mode: CW/CW res: [0x2400090a5:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66170 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189272.308978:0:66170:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x3:0x0].0x0 (ffff9dc0455f8800) 00010000:00010000:0.0:1784189272.308981:0:66170:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784189272.308985:0:66170:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9dc05ec0e400/0xcc1762b626f8c52d lrc: 3/0,0 mode: --/CW res: [0x2400090a5:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66170 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189272.308991:0:66170:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9dc05ec0e400/0xcc1762b626f8c52d lrc: 0/0,0 mode: --/CW res: [0x2400090a5:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66170 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1784189272.309004:0:66170:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000e51732f2 reply state 00000000cf71f58a transno 81604378766 ns: mdt-lustre-MDT0001_UUID lock: ffff9dc05ec0f400/0xcc1762b626f8c534 lrc: 3/0,1 mode: PW/PW res: [0x2400090a5:0x3:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66170 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189272.309013:0:66170:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9dc05ec0f400/0xcc1762b626f8c534 lrc: 3/0,1 mode: TXN/TXN res: [0x2400090a5:0x3:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66170 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189272.309018:0:66170:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x3:0x0].0x9add8152 (ffff9dc06adaa300) 00010000:00010000:0.0:1784189272.309020:0:66170:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1784189272.309022:0:66170:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1784189272.309054:0:66170:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9dc05ec0e800/0xcc1762b626f8c526 lrc: 0/0,0 mode: --/CW res: [0x2400090a5:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c408d expref: 16 pid: 66170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189272.309068:0:66170:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9dc05ec0f600/0xcc1762b626f8c53b lrc: 3/0,0 mode: PR/PR res: [0x2400090a5:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c408d expref: 15 pid: 66170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189272.309076:0:66170:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x5:0x0].0x0 (ffff9dc06adaaf00) 00010000:00010000:0.0:1784189272.309078:0:66170:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1784189272.309087:0:66170:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc05ec0f600, rc 0) 00000100:00100000:0.0:1784189272.309158:0:66170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc05ed78380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:debedd94-805c-42a0-a5e5-41758b2012e9+16:72042:x1870854436318976:12345-192.168.203.12@tcp:101:touch.0 Request processed in 1958us (3410us total) trans 81604378766 rc 0/0 00000100:00100000:0.0:1784189272.309167:0:66170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1387 00000100:00100000:0.0:1784189272.313034:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1784189272.313104:0:68287:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436319232 00000100:00100000:3.0:1784189272.313113:0:68287:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436319232 00000100:00100000:3.0:1784189272.313168:0:68287:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1388 00000100:00100000:3.0:1784189272.313177:0:68287:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf46955f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:debedd94-805c-42a0-a5e5-41758b2012e9+16:72042:x1870854436319232:12345-192.168.203.12@tcp:36:touch.0 00010000:00010000:3.0:1784189272.313229:0:68287:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784189272.313255:0:68287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9dc05ec0f600/0xcc1762b626f8c53b lrc: 0/0,0 mode: --/PR res: [0x2400090a5:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c408d expref: 16 pid: 66170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189272.313274:0:68287:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x5:0x0].0x0 (ffff9dc06adaaf00) 00010000:00010000:3.0:1784189272.313285:0:68287:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1784189272.313361:0:68287:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9dc058f66000/0xcc1762b626f8c549 lrc: 3/0,1 mode: --/PW res: [0x2400090a5:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189272.313373:0:68287:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9dc058f66000/0xcc1762b626f8c549 lrc: 3/0,1 mode: PW/PW res: [0x2400090a5:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 68287 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189272.313392:0:68287:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9dc058f66000/0xcc1762b626f8c549 lrc: 3/0,1 mode: PW/PW res: [0x2400090a5:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 68287 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1784189272.313499:0:68287:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000f539baec reply state 0000000070f17ca8 transno 81604378767 ns: mdt-lustre-MDT0001_UUID lock: ffff9dc058f66000/0xcc1762b626f8c549 lrc: 3/0,1 mode: PW/PW res: [0x2400090a5:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 68287 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189272.313528:0:68287:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9dc058f66000/0xcc1762b626f8c549 lrc: 3/0,1 mode: TXN/TXN res: [0x2400090a5:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 68287 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189272.313535:0:68287:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x5:0x0].0x0 (ffff9dbf45662c00) 00010000:00010000:3.0:1784189272.313538:0:68287:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1784189272.313541:0:68287:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1784189272.313622:0:68287:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf46955f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:debedd94-805c-42a0-a5e5-41758b2012e9+17:72042:x1870854436319232:12345-192.168.203.12@tcp:36:touch.0 Request processed in 445us (595us total) trans 81604378767 rc 0/0 00000100:00100000:3.0:1784189272.313630:0:68287:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1388 00000100:00100000:3.0:1784189272.318279:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1784189272.318972:0:66169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436319360 00000100:00100000:1.0:1784189272.318981:0:66169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436319360 00000100:00100000:1.0:1784189272.319043:0:66169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1389 00000100:00100000:1.0:1784189272.319054:0:66169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc05ed7bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:debedd94-805c-42a0-a5e5-41758b2012e9+17:72042:x1870854436319360:12345-192.168.203.12@tcp:101:touch.0 00010000:00010000:1.0:1784189272.319075:0:66169:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784189272.319095:0:66169:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9dbf4710ec00/0xcc1762b626f8c550 lrc: 2/0,0 mode: --/CR res: [0x2400090a5:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbfc5de7fe6c4094 expref: -99 pid: 66169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189272.319149:0:66169:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9dbf4710ec00/0xcc1762b626f8c550 lrc: 3/0,0 mode: CR/CR res: [0x2400090a5:0x5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c4094 expref: 18 pid: 66169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189272.319163:0:66169:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9dbf4710ec00/0xcc1762b626f8c550 lrc: 3/0,0 mode: CR/CR res: [0x2400090a5:0x5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c4094 expref: 18 pid: 66169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189272.319180:0:66169:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x5:0x0].0x0 (ffff9dbf45662c00) 00010000:00010000:1.0:1784189272.319183:0:66169:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1784189272.319201:0:66169:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dbf4710ec00, rc 0) 00000100:00100000:1.0:1784189272.319272:0:66169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc05ed7bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:debedd94-805c-42a0-a5e5-41758b2012e9+18:72042:x1870854436319360:12345-192.168.203.12@tcp:101:touch.0 Request processed in 219us (1000us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189272.319279:0:66169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1389 00000100:00100000:0.0:1784189272.323157:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1784189272.323251:0:26161:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436319488 00000100:00100000:1.0:1784189272.323261:0:26161:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436319488 00000100:00100000:1.0:1784189272.323411:0:26161:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 4985 00000100:00100000:1.0:1784189272.323422:0:26161:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf46954a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:debedd94-805c-42a0-a5e5-41758b2012e9+5:2397:x1870854436319488:12345-192.168.203.12@tcp:2:touch.0 00000100:00100000:1.0:1784189272.323640:0:26161:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf46954a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:debedd94-805c-42a0-a5e5-41758b2012e9+6:2397:x1870854436319488:12345-192.168.203.12@tcp:2:touch.0 Request processed in 219us (492us total) trans 4294968959 rc 0/0 00000100:00100000:1.0:1784189272.323649:0:26161:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 4985 00000100:00100000:2.0:1784189272.330361:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1784189272.331174:0:66173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436319744 00000100:00100000:1.0:1784189272.331194:0:66173:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436319744 00000100:00100000:1.0:1784189272.331255:0:66173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 243 00000100:00100000:1.0:1784189272.331267:0:66173:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc05f02c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:debedd94-805c-42a0-a5e5-41758b2012e9+18:72042:x1870854436319744:12345-192.168.203.12@tcp:35:touch.0 00000100:00100000:1.0:1784189272.331578:0:66173:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc05f02c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:debedd94-805c-42a0-a5e5-41758b2012e9+19:72042:x1870854436319744:12345-192.168.203.12@tcp:35:touch.0 Request processed in 313us (1226us total) trans 81604378768 rc 0/0 00000100:00100000:1.0:1784189272.331587:0:66173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 243 00000100:00100000:3.0:1784189272.358366:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1784189272.358422:0:92397:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436319872 00000100:00100000:1.0:1784189272.358433:0:92397:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436319872 00000100:00100000:1.0:1784189272.358496:0:92397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 171 00000100:00100000:1.0:1784189272.358504:0:92397:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc056ab0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:60f345e3-c70e-4f53-b5e7-c9671463c9a5+10:2396:x1870854436319872:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:1.0:1784189272.358579:0:92397:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc056ab0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:60f345e3-c70e-4f53-b5e7-c9671463c9a5+10:2396:x1870854436319872:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 75us (222us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189272.358586:0:92397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 171 00000100:00100000:0.0:1784189272.359364:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1784189272.359525:0:26160:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436320000 00000100:00100000:3.0:1784189272.359532:0:26160:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436320000 00000100:00100000:3.0:1784189272.359588:0:26160:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 2537 00000100:00100000:3.0:1784189272.359596:0:26160:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf46957800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:debedd94-805c-42a0-a5e5-41758b2012e9+5:2396:x1870854436320000:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:3.0:1784189272.359639:0:26160:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf46957800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:debedd94-805c-42a0-a5e5-41758b2012e9+5:2396:x1870854436320000:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 43us (277us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189272.359646:0:26160:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 2537 00000100:00080000:0.0:1784189272.359673:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:0.0:1784189272.624011:0:92391:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 115964117002 is committed 00010000:00010000:2.0:1784189272.624080:0:3627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4369d400/0xcc1762b626f8c446 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x21e7de2f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189272.624094:0:3627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4369d400/0xcc1762b626f8c446 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x21e7de2f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189272.624102:0:3627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4369d400/0xcc1762b626f8c446 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x21e7de2f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189272.624108:0:3627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dbf4369d400 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:2.0:1784189272.624112:0:3627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4369d400/0xcc1762b626f8c446 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x21e7de2f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189272.624120:0:3627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4369d400/0xcc1762b626f8c446 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x21e7de2f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189272.624136:0:3627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x21e7de2f (ffff9dbf45994b00) 00010000:00010000:2.0:1784189272.624139:0:3627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784189272.624144:0:3627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4369d400/0xcc1762b626f8c446 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x21e7de2f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189272.624151:0:3627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4369d400/0xcc1762b626f8c446 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x21e7de2f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189272.624181:0:3627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc058f66c00/0xcc1762b626f8c47e lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x21e7de2f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189272.624187:0:3627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc058f66c00/0xcc1762b626f8c47e lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x21e7de2f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189272.624193:0:3627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dc058f66c00/0xcc1762b626f8c47e lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x21e7de2f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189272.624198:0:3627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc058f66c00 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:2.0:1784189272.624201:0:3627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc058f66c00/0xcc1762b626f8c47e lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x21e7de2f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189272.624207:0:3627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc058f66c00/0xcc1762b626f8c47e lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x21e7de2f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189272.624214:0:3627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x21e7de2f (ffff9dbf45994b00) 00010000:00010000:2.0:1784189272.624216:0:3627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784189272.624219:0:3627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dc058f66c00/0xcc1762b626f8c47e lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x21e7de2f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189272.624225:0:3627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc058f66c00/0xcc1762b626f8c47e lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x21e7de2f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189272.817745:0:26173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784189273.840848:0:7454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1784189273.861678:0:93684:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:2.0:1784189273.861741:0:93684:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff9dbf4369d800/0xcc1762b626f8c255 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc1762b626f8c25c expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189273.861755:0:93684:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff9dbf4369d800/0xcc1762b626f8c255 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0xcc1762b626f8c25c expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189273.861772:0:93684:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff9dbf4369d800/0xcc1762b626f8c255 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0xcc1762b626f8c25c expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189273.861779:0:93684:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.112@tcp lock: ffff9dbf4369d800/0xcc1762b626f8c255 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0xcc1762b626f8c25c expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189273.861801:0:93684:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1784189273.861806:0:93684:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:2.0:1784189273.861831:0:93684:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1784189273.861835:0:93684:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:2.0:1784189273.861839:0:93684:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1784189273.861860:0:93684:0:(import.c:65:import_set_state_nolock()) ffff9dbf42276000 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:1.0:1784189273.862074:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc05f02ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3639:1870854458206848:0@lo:39:umount.0 00000100:00100000:1.0:1784189273.862140:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1784189273.862261:0:6501:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784189273.862268:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.112@tcp lock: ffff9dbf4369d800/0xcc1762b626f8c255 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0xcc1762b626f8c25c expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189273.862276:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dbf4369d800 already unused, calling callback (ffffffffc114ac20) 10000000:00010000:3.0:1784189273.862280:0:6501:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.112@tcp lock: ffff9dbf4369d800/0xcc1762b626f8c255 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0xcc1762b626f8c25c expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189273.862298:0:6501:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.112@tcp lock: ffff9dbf4369d800/0xcc1762b626f8c255 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1008400000000 nid: local remote: 0xcc1762b626f8c25c expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1784189273.862305:0:6501:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.112@tcp lock: ffff9dbf4369d800/0xcc1762b626f8c255 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1009400000000 nid: local remote: 0xcc1762b626f8c25c expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784189273.862311:0:6501:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1784189273.862314:0:6501:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:3.0:1784189273.862337:0:6501:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:3.0:1784189273.862360:0:6501:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.112@tcp lock: ffff9dbf4369d800/0xcc1762b626f8c255 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0xcc1762b626f8c25c expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189273.862366:0:6501:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1784189273.862393:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.112@tcp lock: ffff9dbf4369d800/0xcc1762b626f8c255 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0xcc1762b626f8c25c expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189273.862401:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.112@tcp lock: ffff9dbf4369d800/0xcc1762b626f8c255 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0xcc1762b626f8c25c expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189273.862410:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784189273.862412:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784189273.862414:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784189273.862419:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1784189273.862428:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc05ed79880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bd553d0d-03e2-4233-b06b-b55bbfa2b954:3640:1870854458206976:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1784189273.862457:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784189273.862503:0:25703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458206976 00000100:00100000:3.0:1784189273.862508:0:25703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458206976 00000100:00100000:3.0:1784189273.862548:0:25703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 717 00000100:00100000:3.0:1784189273.862555:0:25703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf4693e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:bd553d0d-03e2-4233-b06b-b55bbfa2b954+24:3640:x1870854458206976:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1784189273.862572:0:25703:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784189273.862597:0:25703:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dbf4710e600/0xcc1762b626f8c25c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xcc1762b626f8c255 expref: 24 pid: 92398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189273.862609:0:25703:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784189273.862637:0:25703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf4693e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:bd553d0d-03e2-4233-b06b-b55bbfa2b954+23:3640:x1870854458206976:12345-0@lo:103:ldlm_bl.0 Request processed in 82us (180us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189273.862644:0:25703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 717 00000100:00100000:3.0:1784189273.862676:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc05ed79880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bd553d0d-03e2-4233-b06b-b55bbfa2b954:3640:1870854458206976:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1784189273.862842:0:66170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458206848 00000100:00100000:2.0:1784189273.862846:0:66170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458206848 00000100:00100000:2.0:1784189273.862880:0:66170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1390 00000100:00100000:2.0:1784189273.862886:0:66170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc075f7ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1870854458206848:12345-0@lo:39:umount.0 00000020:00000080:2.0:1784189273.862904:0:66170:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xcc1762b626f8be96 00000100:00080000:2.0:1784189273.862916:0:66170:0:(import.c:65:import_set_state_nolock()) ffff9dbf46d3f800 : changing import state from FULL to CLOSED 00010000:00000080:2.0:1784189273.862937:0:66170:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9dc075f7ca80 x1870854458206848/t0(0) o39->lustre-MDT0000-lwp-MDT0000_UUID@0@lo:464/0 lens 224/224 e 0 to 0 dl 1784189284 ref 1 fl Interpret:/200/0 rc 0/0 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784189273.862969:0:66170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc075f7ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+1:3639:x1870854458206848:12345-0@lo:39:umount.0 Request processed in 84us (830us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189273.862975:0:66170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1390 00000020:00000080:2.0:1784189273.862980:0:66170:0:(genops.c:906:class_export_put()) final put ffff9dbf46d39800/lustre-MDT0000-lwp-MDT0000_UUID 00010000:00010000:2.0:1784189273.863017:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1784189273.863090:0:3639:0:(import.c:65:import_set_state_nolock()) ffff9dbf42276000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:1.0:1784189273.863106:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc05f02ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3639:1870854458206848:0@lo:39:umount.0 00000020:00000080:1.0:1784189273.863124:0:63468:0:(genops.c:865:class_export_destroy()) destroying export ffff9dbf46d39800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000020:00000080:1.0:1784189273.863162:0:63468:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9dbf46d3f800 for lustre-MDT0000 00000100:00080000:2.0:1784189273.863255:0:93684:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1784189273.863259:0:93684:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:2.0:1784189273.863270:0:93684:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:2.0:1784189273.864388:0:93684:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff9dbf4710e400/0xcc1762b626f8c263 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc1762b626f8c26a expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189273.864403:0:93684:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff9dbf4710e400/0xcc1762b626f8c263 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0xcc1762b626f8c26a expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189273.864410:0:93684:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff9dbf4710e400/0xcc1762b626f8c263 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0xcc1762b626f8c26a expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189273.864417:0:93684:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.112@tcp lock: ffff9dbf4710e400/0xcc1762b626f8c263 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0xcc1762b626f8c26a expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189273.864436:0:93684:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1784189273.864441:0:93684:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff9dc0565e6000/0xcc1762b626f8bdc4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc1762b626f8bdcb expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189273.864448:0:93684:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff9dc0565e6000/0xcc1762b626f8bdc4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xcc1762b626f8bdcb expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189273.864454:0:93684:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff9dc0565e6000/0xcc1762b626f8bdc4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xcc1762b626f8bdcb expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189273.864573:0:93684:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.112@tcp lock: ffff9dc0565e6000/0xcc1762b626f8bdc4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xcc1762b626f8bdcb expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189273.864682:0:93684:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1784189273.864690:0:93684:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff9dc0565e6a00/0xcc1762b626f8bd93 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc1762b626f8bd9a expref: -99 pid: 92390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189273.864698:0:93684:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff9dc0565e6a00/0xcc1762b626f8bd93 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xcc1762b626f8bd9a expref: -99 pid: 92390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189273.864714:0:93684:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff9dc0565e6a00/0xcc1762b626f8bd93 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xcc1762b626f8bd9a expref: -99 pid: 92390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189273.864721:0:93684:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.112@tcp lock: ffff9dc0565e6a00/0xcc1762b626f8bd93 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xcc1762b626f8bd9a expref: -99 pid: 92390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189273.864827:0:26173:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1784189273.864834:0:26173:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.112@tcp lock: ffff9dbf4710e400/0xcc1762b626f8c263 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0xcc1762b626f8c26a expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189273.864841:0:26173:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dbf4710e400 already unused, calling callback (ffffffffc114ac20) 10000000:00010000:1.0:1784189273.864845:0:26173:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.112@tcp lock: ffff9dbf4710e400/0xcc1762b626f8c263 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0xcc1762b626f8c26a expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189273.864854:0:26173:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.112@tcp lock: ffff9dbf4710e400/0xcc1762b626f8c263 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1008400000000 nid: local remote: 0xcc1762b626f8c26a expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1784189273.864861:0:26173:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.112@tcp lock: ffff9dbf4710e400/0xcc1762b626f8c263 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1009400000000 nid: local remote: 0xcc1762b626f8c26a expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784189273.864867:0:26173:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1784189273.864870:0:26173:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 00010000:00010000:1.0:1784189273.864895:0:26173:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.112@tcp lock: ffff9dbf4710e400/0xcc1762b626f8c263 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0xcc1762b626f8c26a expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189273.864901:0:26173:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1784189273.864927:0:26173:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.112@tcp lock: ffff9dbf4710e400/0xcc1762b626f8c263 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0xcc1762b626f8c26a expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189273.864935:0:26173:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.112@tcp lock: ffff9dbf4710e400/0xcc1762b626f8c263 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0xcc1762b626f8c26a expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189273.864953:0:26173:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1784189273.864957:0:26173:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.112@tcp lock: ffff9dc0565e6000/0xcc1762b626f8bdc4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xcc1762b626f8bdcb expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189273.864963:0:26173:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc0565e6000 already unused, calling callback (ffffffffc114ac20) 10000000:00010000:1.0:1784189273.864966:0:26173:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.112@tcp lock: ffff9dc0565e6000/0xcc1762b626f8bdc4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xcc1762b626f8bdcb expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189273.864973:0:26173:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.112@tcp lock: ffff9dc0565e6000/0xcc1762b626f8bdc4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xcc1762b626f8bdcb expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1784189273.864980:0:26173:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.112@tcp lock: ffff9dc0565e6000/0xcc1762b626f8bdc4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xcc1762b626f8bdcb expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784189273.864985:0:26173:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:1.0:1784189273.864987:0:26173:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:1.0:1784189273.864989:0:26173:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:1.0:1784189273.865002:0:26173:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.112@tcp lock: ffff9dc0565e6000/0xcc1762b626f8bdc4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xcc1762b626f8bdcb expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189273.865007:0:26173:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1784189273.865013:0:26173:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.112@tcp lock: ffff9dc0565e6000/0xcc1762b626f8bdc4 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xcc1762b626f8bdcb expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189273.865020:0:26173:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.112@tcp lock: ffff9dc0565e6000/0xcc1762b626f8bdc4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xcc1762b626f8bdcb expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189273.865027:0:26173:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784189273.865030:0:26173:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.112@tcp lock: ffff9dc0565e6a00/0xcc1762b626f8bd93 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xcc1762b626f8bd9a expref: -99 pid: 92390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189273.865040:0:26173:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc0565e6a00 already unused, calling callback (ffffffffc114ac20) 10000000:00010000:1.0:1784189273.865043:0:26173:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.112@tcp lock: ffff9dc0565e6a00/0xcc1762b626f8bd93 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xcc1762b626f8bd9a expref: -99 pid: 92390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189273.865050:0:26173:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.112@tcp lock: ffff9dc0565e6a00/0xcc1762b626f8bd93 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0xcc1762b626f8bd9a expref: -99 pid: 92390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1784189273.865065:0:26173:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.112@tcp lock: ffff9dc0565e6a00/0xcc1762b626f8bd93 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0xcc1762b626f8bd9a expref: -99 pid: 92390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784189273.865070:0:26173:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:1.0:1784189273.865072:0:26173:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 00010000:00010000:1.0:1784189273.865083:0:26173:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.112@tcp lock: ffff9dc0565e6a00/0xcc1762b626f8bd93 lrc: 3/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xcc1762b626f8bd9a expref: -99 pid: 92390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189273.865089:0:26173:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1784189273.865102:0:26173:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.112@tcp lock: ffff9dc0565e6a00/0xcc1762b626f8bd93 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xcc1762b626f8bd9a expref: -99 pid: 92390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189273.865109:0:26173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784189273.865110:0:26173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784189273.865112:0:26173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784189273.865125:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc075f7c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:bd553d0d-03e2-4233-b06b-b55bbfa2b954:3643:1870854458207232:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1784189273.865175:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784189273.865212:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1784189273.865219:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc075f7c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:bd553d0d-03e2-4233-b06b-b55bbfa2b954:3643:1870854458207104:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1784189273.865240:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784189273.865261:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1784189273.865274:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf4262fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:bd553d0d-03e2-4233-b06b-b55bbfa2b954:3641:1870854458207360:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1784189273.865298:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784189273.865351:0:26172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458207232 00000100:00100000:1.0:1784189273.865357:0:26172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458207232 00000100:00100000:1.0:1784189273.865400:0:26172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458207104 00000100:00100000:1.0:1784189273.865403:0:26172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458207104 00000100:00100000:1.0:1784189273.865417:0:26172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458207360 00000100:00100000:1.0:1784189273.865419:0:26172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458207360 00000100:00100000:1.0:1784189273.865435:0:26172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 718 00000100:00100000:1.0:1784189273.865443:0:26172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf4262f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:bd553d0d-03e2-4233-b06b-b55bbfa2b954+25:3643:x1870854458207232:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1784189273.865454:0:26172:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784189273.865477:0:26172:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dc0565e6e00/0xcc1762b626f8bdcb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xcc1762b626f8bdc4 expref: 25 pid: 92397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189273.865489:0:26172:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784189273.865517:0:26172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf4262f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:bd553d0d-03e2-4233-b06b-b55bbfa2b954+24:3643:x1870854458207232:12345-0@lo:103:ldlm_bl.0 Request processed in 74us (342us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189273.865524:0:26172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 718 00000100:00100000:1.0:1784189273.865539:0:26172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 719 00000100:00100000:1.0:1784189273.865545:0:26172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf4262d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:bd553d0d-03e2-4233-b06b-b55bbfa2b954+23:3643:x1870854458207104:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1784189273.865551:0:26172:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784189273.865559:0:26172:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dc04152ce00/0xcc1762b626f8c26a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xcc1762b626f8c263 expref: 23 pid: 92398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189273.865568:0:26172:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784189273.865597:0:26172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf4262d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:bd553d0d-03e2-4233-b06b-b55bbfa2b954+22:3643:x1870854458207104:12345-0@lo:103:ldlm_bl.0 Request processed in 40us (344us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189273.865603:0:26172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 719 00000100:00100000:1.0:1784189273.865615:0:26172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 720 00000100:00100000:1.0:1784189273.865626:0:26172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf4262e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:bd553d0d-03e2-4233-b06b-b55bbfa2b954+21:3641:x1870854458207360:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1784189273.865635:0:26172:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784189273.865643:0:26172:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dc04152d800/0xcc1762b626f8bd9a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xcc1762b626f8bd93 expref: 21 pid: 92397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189273.865652:0:26172:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784189273.865673:0:26172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf4262e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:bd553d0d-03e2-4233-b06b-b55bbfa2b954+20:3641:x1870854458207360:12345-0@lo:103:ldlm_bl.0 Request processed in 48us (374us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189273.865679:0:26172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 720 00000100:00100000:1.0:1784189273.865711:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf4262fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:bd553d0d-03e2-4233-b06b-b55bbfa2b954:3641:1870854458207360:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1784189273.865731:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc075f7c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:bd553d0d-03e2-4233-b06b-b55bbfa2b954:3643:1870854458207104:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1784189273.865738:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc075f7c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:bd553d0d-03e2-4233-b06b-b55bbfa2b954:3643:1870854458207232:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1784189273.866282:0:93684:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1784189273.866289:0:93684:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.112@tcp lock: ffff9dc0565e6a00/0xcc1762b626f8bd93 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xcc1762b626f8bd9a expref: -99 pid: 92390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784189273.866301:0:93684:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:2.0:1784189273.866310:0:93684:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff9dbf4369c800/0xcc1762b626f8bcb3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc1762b626f8bcc1 expref: -99 pid: 92390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189273.866343:0:93684:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff9dbf4369c800/0xcc1762b626f8bcb3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xcc1762b626f8bcc1 expref: -99 pid: 92390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189273.866351:0:93684:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff9dbf4369c800/0xcc1762b626f8bcb3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xcc1762b626f8bcc1 expref: -99 pid: 92390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189273.866357:0:93684:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.112@tcp lock: ffff9dbf4369c800/0xcc1762b626f8bcb3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xcc1762b626f8bcc1 expref: -99 pid: 92390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189273.866380:0:93684:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1784189273.866384:0:93684:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 10000000:01000000:2.0:1784189273.866387:0:93684:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00000020:01000004:2.0:1784189273.866419:0:93684:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-MDT0000 00000020:01000000:2.0:1784189273.866423:0:93684:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='FA') 00000020:00000080:2.0:1784189273.866428:0:93684:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:02000400:2.0:1784189273.866441:0:93684:0:(obd_config.c:932:class_cleanup()) Failing over lustre-MDT0000 00010000:00010000:3.0:1784189273.867950:0:7454:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784189273.867961:0:7454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.112@tcp lock: ffff9dbf4369c800/0xcc1762b626f8bcb3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xcc1762b626f8bcc1 expref: -99 pid: 92390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189273.867970:0:7454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dbf4369c800 already unused, calling callback (ffffffffc114ac20) 10000000:00010000:3.0:1784189273.867974:0:7454:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.112@tcp lock: ffff9dbf4369c800/0xcc1762b626f8bcb3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xcc1762b626f8bcc1 expref: -99 pid: 92390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189273.867983:0:7454:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.112@tcp lock: ffff9dbf4369c800/0xcc1762b626f8bcb3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xcc1762b626f8bcc1 expref: -99 pid: 92390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1784189273.867990:0:7454:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.112@tcp lock: ffff9dbf4369c800/0xcc1762b626f8bcb3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xcc1762b626f8bcc1 expref: -99 pid: 92390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784189273.867995:0:7454:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:3.0:1784189273.867997:0:7454:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:3.0:1784189273.867999:0:7454:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:3.0:1784189273.868033:0:7454:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.112@tcp lock: ffff9dbf4369c800/0xcc1762b626f8bcb3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xcc1762b626f8bcc1 expref: -99 pid: 92390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189273.868106:0:7454:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1784189273.868132:0:7454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.112@tcp lock: ffff9dbf4369c800/0xcc1762b626f8bcb3 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xcc1762b626f8bcc1 expref: -99 pid: 92390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189273.868140:0:7454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.112@tcp lock: ffff9dbf4369c800/0xcc1762b626f8bcb3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xcc1762b626f8bcc1 expref: -99 pid: 92390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189273.868156:0:7454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784189273.868157:0:7454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784189273.868159:0:7454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784189273.868190:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf4693ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:bd553d0d-03e2-4233-b06b-b55bbfa2b954:3641:1870854458207488:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1784189273.868252:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784189273.868346:0:25703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458207488 00000100:00100000:3.0:1784189273.868354:0:25703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458207488 00000100:00100000:3.0:1784189273.868420:0:25703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 721 00000100:00100000:3.0:1784189273.868432:0:25703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf4693d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:bd553d0d-03e2-4233-b06b-b55bbfa2b954+20:3641:x1870854458207488:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1784189273.868445:0:25703:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784189273.868462:0:25703:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dc0565e7c00/0xcc1762b626f8bcc1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xcc1762b626f8bcb3 expref: 20 pid: 92398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189273.868473:0:25703:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784189273.868505:0:25703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf4693d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:bd553d0d-03e2-4233-b06b-b55bbfa2b954+19:3641:x1870854458207488:12345-0@lo:103:ldlm_bl.0 Request processed in 76us (254us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189273.868513:0:25703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 721 00000100:00100000:3.0:1784189273.868548:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf4693ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:bd553d0d-03e2-4233-b06b-b55bbfa2b954:3641:1870854458207488:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1784189273.868709:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784189273.869162:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00000080:2.0:1784189273.869974:0:93684:0:(mdt_handler.c:8168:mdt_iocontrol()) lustre-MDT0000: cmd=40086672 len=0 karg=0000000000000000 uarg=0000000000000000 00000020:00000080:2.0:1784189273.870682:0:93684:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 5/11 00000020:00080000:2.0:1784189273.870690:0:93684:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff9dc07b5d1800 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1784189273.870697:0:93684:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff9dbf430fc800 lustre-MDT0000-lwp-MDT0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1784189273.870702:0:93684:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff9dc0477d1000 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1784189273.870708:0:93684:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff9dc07118e800 debedd94-805c-42a0-a5e5-41758b2012e9 192.168.203.12@tcp 9 (0 0 4) 0 0 0 0: 0000000000000000 115964117002 stale:0 00000020:00080000:2.0:1784189273.870713:0:93684:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff9dc06b3eb000 lustre-MDT0001-mdtlov_UUID 0@lo 6 (0 0 1) 0 0 0 0: 0000000000000000 115964117000 stale:0 00000020:00080000:2.0:1784189273.870718:0:93684:0:(genops.c:1574:class_disconnect_exports()) OBD device 13 (ffff9dbf449f4d40) has exports, disconnecting them 00000020:00080000:2.0:1784189273.870722:0:93684:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9dc07b5d1800), last request at 1784189270 00000020:00000080:2.0:1784189273.870729:0:93684:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xcc1762b626f8be9d 00000100:00080000:2.0:1784189273.870736:0:93684:0:(import.c:65:import_set_state_nolock()) ffff9dc07b5d0000 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1784189273.870761:0:93684:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9dc07b5d1800): rc 0 00000020:00000080:2.0:1784189273.870764:0:93684:0:(genops.c:906:class_export_put()) final put ffff9dc07b5d1800/lustre-MDT0000-lwp-OST0000_UUID 00000020:00080000:2.0:1784189273.870779:0:93684:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9dbf430fc800), last request at 1784189249 00000020:00000080:2.0:1784189273.870782:0:93684:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xcc1762b626f8be8f 00000100:00080000:2.0:1784189273.870785:0:93684:0:(import.c:65:import_set_state_nolock()) ffff9dbf46d3d800 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1784189273.870792:0:93684:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9dbf430fc800): rc 0 00000020:00000080:2.0:1784189273.870794:0:93684:0:(genops.c:906:class_export_put()) final put ffff9dbf430fc800/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00080000:2.0:1784189273.870797:0:93684:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9dc0477d1000), last request at 1784189270 00000020:00000080:2.0:1784189273.870800:0:93684:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xcc1762b626f8be88 00000100:00080000:2.0:1784189273.870804:0:93684:0:(import.c:65:import_set_state_nolock()) ffff9dc0477d2000 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1784189273.870811:0:93684:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9dc0477d1000): rc 0 00000020:00000080:2.0:1784189273.870812:0:93684:0:(genops.c:906:class_export_put()) final put ffff9dc0477d1000/lustre-MDT0000-lwp-OST0001_UUID 00000020:00080000:2.0:1784189273.870816:0:93684:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 192.168.203.12@tcp (ffff9dc07118e800), last request at 1784189272 00000020:00000080:2.0:1784189273.870822:0:93684:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xcc1762b626f8bd15 00000020:00010000:2.0:1784189273.870844:0:93684:0:(genops.c:1942:obd_stale_export_put()) Put export ffff9dc07118e800: total 3 00000100:00080000:2.0:1784189273.870848:0:93684:0:(import.c:65:import_set_state_nolock()) ffff9dc050ae7000 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1784189273.870886:0:93684:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 192.168.203.12@tcp (ffff9dc07118e800): rc 0 00000020:00080000:2.0:1784189273.870890:0:93684:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9dc06b3eb000), last request at 1784189244 00000020:00000080:2.0:1784189273.870893:0:93684:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xcc1762b626f8bd0e 00000020:00010000:2.0:1784189273.870897:0:93684:0:(genops.c:1942:obd_stale_export_put()) Put export ffff9dc06b3eb000: total 3 00000100:00080000:2.0:1784189273.870899:0:93684:0:(import.c:65:import_set_state_nolock()) ffff9dc0477d1800 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1784189273.870905:0:93684:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9dc06b3eb000): rc 0 00000004:00000080:2.0:1784189273.870914:0:93684:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffae09855f3ae0 00000100:00080000:2.0:1784189273.870931:0:93684:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1784189273.870934:0:93684:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 3 00000020:00010000:3.0:1784189273.871418:0:26173:0:(genops.c:1928:obd_stale_export_get()) Get export ffff9dc07118e800: total 3 00010000:00010000:3.0:1784189273.871476:0:26173:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff9dc07118e800, canceled 0 locks, left on hash table 4. 00010000:00010000:3.0:1784189273.871516:0:26173:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc058f67000/0xcc1762b626f8c49a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c405c expref: 5 pid: 68287 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189273.871534:0:26173:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04152d200/0xcc1762b626f8c40e lrc: 0/0,0 mode: --/PR res: [0x2400090a5:0x3:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c4039 expref: 4 pid: 66170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189273.871555:0:26173:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4710f800/0xcc1762b626f8c3cf lrc: 0/0,0 mode: --/PR res: [0x2400090a5:0x2:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c4024 expref: 3 pid: 68287 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189273.871581:0:26173:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04a20be00/0xcc1762b626f8c3b3 lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c401d expref: 2 pid: 66171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189273.871606:0:26173:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff9dc07118e800, canceled 4 locks, left on hash table 0. 00000020:00010000:0.0:1784189273.872731:0:6501:0:(genops.c:1928:obd_stale_export_get()) Get export ffff9dc06b3eb000: total 3 00010000:00010000:0.0:1784189273.872785:0:6501:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff9dc06b3eb000, canceled 0 locks, left on hash table 1. 00010000:00010000:0.0:1784189273.872812:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4369dc00/0xcc1762b626f8beb9 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xcc1762b626f8beb2 expref: 2 pid: 23826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189273.872833:0:6501:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff9dc06b3eb000, canceled 1 locks, left on hash table 0. 00000100:00080000:2.0:1784189273.875387:0:93684:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000100:00080000:2.0:1784189273.875421:0:93684:0:(import.c:65:import_set_state_nolock()) ffff9dbf430fb800 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00010000:00010000:2.0:1784189273.876384:0:7454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1784189273.877692:0:93049:0:(genops.c:865:class_export_destroy()) destroying export ffff9dc07b5d1800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00000080:1.0:1784189273.877757:0:93049:0:(genops.c:865:class_export_destroy()) destroying export ffff9dbf430fc800/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000 00000020:00000080:1.0:1784189273.877784:0:93049:0:(genops.c:865:class_export_destroy()) destroying export ffff9dc0477d1000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000020:00000080:1.0:1784189273.877799:0:93049:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9dc07b5d0000 for lustre-MDT0000 00000020:00000080:1.0:1784189273.877802:0:93049:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9dbf46d3d800 for lustre-MDT0000 00000020:00000080:1.0:1784189273.877805:0:93049:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9dc0477d2000 for lustre-MDT0000 00010000:00010000:1.0:1784189273.877815:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784189273.877833:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc05f02c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3639:1870854458207616:0@lo:39:umount.0 00000100:00100000:1.0:1784189273.877901:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784189273.877951:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458207616 00000100:00100000:1.0:1784189273.877958:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458207616 00000100:00100000:1.0:1784189273.878002:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3909 00000100:00100000:1.0:1784189273.878009:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf4262fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3639:x1870854458207616:12345-0@lo:39:umount.0 00000020:00000080:1.0:1784189273.878047:0:8439:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xcc1762b626f8bd54 00000100:00080000:1.0:1784189273.878448:0:8439:0:(import.c:65:import_set_state_nolock()) ffff9dc06bb5d800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1784189273.878558:0:8439:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 19, last_transno is 81604378768 00000100:00100000:1.0:1784189273.878708:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf4262fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+3:3639:x1870854458207616:12345-0@lo:39:umount.0 Request processed in 697us (805us total) trans 81604378769 rc 0/0 00000100:00100000:1.0:1784189273.878717:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3909 00000100:00080000:1.0:1784189273.878757:0:3639:0:(import.c:65:import_set_state_nolock()) ffff9dbf430fb800 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:1.0:1784189273.878764:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc05f02c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3639:1870854458207616:0@lo:39:umount.0 00010000:00010000:2.0:1784189273.888412:0:7454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1784189273.889508:0:93684:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1784189273.889514:0:93684:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294968954 gen 3 00000004:00080000:2.0:1784189273.889539:0:93684:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:2.0:1784189273.889607:0:93684:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:2.0:1784189273.889635:0:93684:0:(import.c:65:import_set_state_nolock()) ffff9dbf43d8a000 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:2.0:1784189273.889651:0:93684:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1784189273.889653:0:93684:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294968957 gen 3 00000004:00080000:2.0:1784189273.889660:0:93684:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:2.0:1784189273.889715:0:93684:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:2.0:1784189273.889723:0:93684:0:(import.c:65:import_set_state_nolock()) ffff9dbf43692000 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:2.0:1784189273.889767:0:93684:0:(genops.c:1579:class_disconnect_exports()) OBD device 13 (ffff9dbf449f4d40) has no exports 00000100:00100000:1.0:1784189273.889909:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc05f02ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3639:1870854458207744:0@lo:9:umount.0 00000100:00100000:1.0:1784189273.889975:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784189273.890005:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc05f02e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3639:1870854458207872:0@lo:9:umount.0 00000100:00100000:1.0:1784189273.890026:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784189273.890073:0:26165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458207744 00000100:00100000:1.0:1784189273.890080:0:26165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458207744 00000100:00100000:1.0:1784189273.890136:0:26165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4986 00000100:00100000:1.0:1784189273.890144:0:26165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf4262e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+5:3639:x1870854458207744:12345-0@lo:9:umount.0 00000020:00000080:1.0:1784189273.890166:0:26165:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xcc1762b626f8bd70 00000100:00080000:1.0:1784189273.890172:0:26165:0:(import.c:65:import_set_state_nolock()) ffff9dc047a87000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1784189273.890209:0:26165:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294968955 00000100:00100000:1.0:1784189273.890366:0:26165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf4262e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+2:3639:x1870854458207744:12345-0@lo:9:umount.0 Request processed in 222us (390us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189273.890387:0:26165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4986 00000100:00100000:1.0:1784189273.890403:0:26165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458207872 00000100:00100000:1.0:1784189273.890406:0:26165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458207872 00000100:00100000:1.0:1784189273.890430:0:26165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4987 00000100:00100000:1.0:1784189273.890436:0:26165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf4262dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+5:3639:x1870854458207872:12345-0@lo:9:umount.0 00000020:00000080:1.0:1784189273.891124:0:26165:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xcc1762b626f8bd7e 00000100:00080000:1.0:1784189273.891133:0:26165:0:(import.c:65:import_set_state_nolock()) ffff9dc04ba05800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1784189273.891164:0:26165:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294968959 00000100:00100000:1.0:1784189273.891250:0:26165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf4262dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+2:3639:x1870854458207872:12345-0@lo:9:umount.0 Request processed in 813us (1222us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189273.891256:0:26165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4987 00010000:00010000:1.0:1784189273.891283:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1784189273.891308:0:3639:0:(import.c:65:import_set_state_nolock()) ffff9dbf43d8a000 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:1.0:1784189273.891334:0:3639:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:1.0:1784189273.891336:0:3639:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1784189273.891340:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc05f02ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3639:1870854458207744:0@lo:9:umount.0 00000100:00080000:1.0:1784189273.891351:0:3639:0:(import.c:65:import_set_state_nolock()) ffff9dbf43692000 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:1.0:1784189273.891357:0:3639:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:1.0:1784189273.891359:0:3639:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1784189273.891361:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc05f02e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3639:1870854458207872:0@lo:9:umount.0 00010000:00010000:1.0:1784189273.891406:0:7454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:2.0:1784189273.904689:0:93684:0:(genops.c:1579:class_disconnect_exports()) OBD device 13 (ffff9dbf449f4d40) has no exports 00000100:00080000:1.0:1784189273.924179:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1784189273.924190:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000020:00000080:3.0:1784189273.924727:0:26173:0:(genops.c:906:class_export_put()) final put ffff9dc07118e800/debedd94-805c-42a0-a5e5-41758b2012e9 00010000:00010000:3.0:1784189273.924792:0:26173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784189273.924795:0:26173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784189273.924797:0:26173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1784189273.927384:0:6501:0:(genops.c:906:class_export_put()) final put ffff9dc06b3eb000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1784189273.928450:0:63468:0:(genops.c:865:class_export_destroy()) destroying export ffff9dc07118e800/debedd94-805c-42a0-a5e5-41758b2012e9 for lustre-MDT0000 00000020:00000080:1.0:1784189273.928526:0:63468:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9dc050ae7000 for lustre-MDT0000 00010000:00010000:0.0:1784189273.930346:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784189273.930352:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784189273.930355:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1784189273.930402:0:93049:0:(genops.c:865:class_export_destroy()) destroying export ffff9dc06b3eb000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000 00000020:00000080:1.0:1784189273.930529:0:93049:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9dc0477d1800 for lustre-MDT0000 00000020:00000080:2.0:1784189273.961292:0:93684:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xcc1762b626f8bd2a 00000020:00000080:2.0:1784189273.961306:0:93684:0:(genops.c:906:class_export_put()) final put ffff9dc0755b3000/lustre-QMT0000_UUID 00000020:01000000:2.0:1784189273.963198:0:93684:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:2.0:1784189273.963666:0:93684:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1784189273.963679:0:93684:0:(obd_config.c:955:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1784189273.963683:0:93684:0:(genops.c:1579:class_disconnect_exports()) OBD device 15 (ffff9dc049be3380) has no exports 00000020:00000080:0.0:1784189273.963854:0:63468:0:(genops.c:865:class_export_destroy()) destroying export ffff9dc0755b3000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:0.0:1784189273.964243:0:93684:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xcc1762b626f8bd23 00000020:00000080:0.0:1784189273.964250:0:93684:0:(genops.c:906:class_export_put()) final put ffff9dbf43e9f800/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1784189273.964295:0:93684:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1784189273.964301:0:93684:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:0.0:1784189273.964303:0:93684:0:(genops.c:906:class_export_put()) final put ffff9dbf43e98000/lustre-QMT0000_UUID 00000020:00000080:0.0:1784189273.964304:0:93684:0:(genops.c:865:class_export_destroy()) destroying export ffff9dbf43e98000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:0.0:1784189273.964308:0:93684:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00000020:00000080:1.0:1784189273.964550:0:63468:0:(genops.c:865:class_export_destroy()) destroying export ffff9dbf43e9f800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:0.0:1784189273.964598:0:93684:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9dbf45b1dba0 - data ffff9dbf41c8d6c0/ffff9dc05f030c00 00000020:01000000:0.0:1784189273.964725:0:93684:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9dbf457f8a80 - data ffff9dc06bceb798/ffff9dc071342400 00000100:00080000:3.0:1784189274.033292:0:93684:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1784189274.033301:0:93684:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:3.0:1784189274.033316:0:93684:0:(client.c:3150:ptlrpc_free_committed()) @@@ free request with old gen req@ffff9dc05f02c700 x1870854458207616/t81604378769(81604378769) o39->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1784189283 ref 1 fl Complete:RNQU/204/0 rc 0/0 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784189274.033359:0:93684:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:3.0:1784189274.037213:0:93684:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1784189274.037220:0:93684:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294968954 gen 4 00000004:00080000:3.0:1784189274.037346:0:93684:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1784189274.037349:0:93684:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1784189274.038106:0:92407:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1784189274.038111:0:92407:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x6c:0x0] index 1 count 1 00000040:00080000:0.0:1784189274.038121:0:92407:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 27 count 2 00000100:00080000:3.0:1784189274.038817:0:93684:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1784189274.038821:0:93684:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294968957 gen 4 00000004:00080000:3.0:1784189274.038837:0:93684:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1784189274.038849:0:93684:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1784189274.039068:0:92409:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1784189274.039072:0:92409:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x6e:0x0] index 1 count 1 00000040:00080000:0.0:1784189274.039080:0:92409:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 27 count 2 00000020:00000080:0.0:1784189274.042036:0:93684:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xcc1762b626f8bce4 00000020:00000080:0.0:1784189274.042048:0:93684:0:(genops.c:906:class_export_put()) final put ffff9dc07118e000/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1784189274.042692:0:93684:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xcc1762b626f8bcf9 00000020:00000080:0.0:1784189274.042698:0:93684:0:(genops.c:906:class_export_put()) final put ffff9dc06b3ed000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:0.0:1784189274.042702:0:93684:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:0.0:1784189274.042707:0:93684:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1784189274.042717:0:93684:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1784189274.042721:0:93684:0:(genops.c:1579:class_disconnect_exports()) OBD device 12 (ffff9dbf449f0000) has no exports 00000004:01000000:0.0:1784189274.042907:0:93684:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:0.0:1784189274.042914:0:93684:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xcc1762b626f8bd77 00000020:00000080:0.0:1784189274.042918:0:93684:0:(genops.c:906:class_export_put()) final put ffff9dbf4726c000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:0.0:1784189274.042922:0:93684:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:0.0:1784189274.042926:0:93684:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1784189274.042933:0:93684:0:(obd_config.c:955:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1784189274.042936:0:93684:0:(genops.c:1579:class_disconnect_exports()) OBD device 27 (ffff9dc049be19c0) has no exports 00000020:00000080:0.0:1784189274.042941:0:93684:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xcc1762b626f8bd69 00000020:00000080:0.0:1784189274.042944:0:93684:0:(genops.c:906:class_export_put()) final put ffff9dbf43697000/lustre-MDT0000-osd_UUID 00010000:01000000:0.0:1784189274.043256:0:93684:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:0.0:1784189274.043260:0:93684:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1784189274.043263:0:93684:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294968957 gen 5 00000004:00080000:0.0:1784189274.043269:0:93684:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1784189274.043271:0:93684:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1784189274.043297:0:93684:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1784189274.043304:0:93684:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1784189274.043308:0:93684:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xcc1762b626f8bd5b 00000020:00000080:0.0:1784189274.043346:0:93684:0:(genops.c:906:class_export_put()) final put ffff9dbf4726a800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:0.0:1784189274.043350:0:93684:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:0.0:1784189274.043353:0:93684:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1784189274.043357:0:93684:0:(obd_config.c:955:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1784189274.043360:0:93684:0:(genops.c:1579:class_disconnect_exports()) OBD device 22 (ffff9dc07a903380) has no exports 00000020:00000080:0.0:1784189274.043364:0:93684:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xcc1762b626f8bd4d 00000020:00000080:0.0:1784189274.043366:0:93684:0:(genops.c:906:class_export_put()) final put ffff9dbf43d88000/lustre-MDT0000-osd_UUID 00010000:01000000:0.0:1784189274.043684:0:93684:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:0.0:1784189274.043688:0:93684:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1784189274.043690:0:93684:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294968954 gen 5 00000004:00080000:0.0:1784189274.043693:0:93684:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1784189274.043695:0:93684:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1784189274.043717:0:93684:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1784189274.043722:0:93684:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000004:01000000:0.0:1784189274.043731:0:93684:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:0.0:1784189274.043735:0:93684:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xcc1762b626f8bd3f 00000020:00000080:0.0:1784189274.043739:0:93684:0:(genops.c:906:class_export_put()) final put ffff9dc07118c000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:0.0:1784189274.043742:0:93684:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osp-MDT0000 (flags='') 00000020:00000080:0.0:1784189274.043745:0:93684:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1784189274.043749:0:93684:0:(obd_config.c:955:class_cleanup()) lustre-MDT0001-osp-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1784189274.043752:0:93684:0:(genops.c:1579:class_disconnect_exports()) OBD device 21 (ffff9dbf431299c0) has no exports 00000020:00000080:0.0:1784189274.043755:0:93684:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xcc1762b626f8bd38 00000020:00000080:0.0:1784189274.043758:0:93684:0:(genops.c:906:class_export_put()) final put ffff9dbf43693800/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1784189274.044549:0:63468:0:(genops.c:865:class_export_destroy()) destroying export ffff9dc07118e000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1784189274.044563:0:63468:0:(genops.c:865:class_export_destroy()) destroying export ffff9dc06b3ed000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:00000080:1.0:1784189274.044568:0:63468:0:(genops.c:865:class_export_destroy()) destroying export ffff9dbf4726c000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:00000080:1.0:1784189274.044573:0:63468:0:(genops.c:865:class_export_destroy()) destroying export ffff9dbf43697000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1784189274.044587:0:63468:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9dbf43692000 for lustre-OST0001-osc-MDT0000 00000020:00000080:1.0:1784189274.044592:0:63468:0:(genops.c:906:class_export_put()) final put ffff9dbf47268000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1784189274.044594:0:63468:0:(genops.c:865:class_export_destroy()) destroying export ffff9dbf47268000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:1.0:1784189274.044599:0:63468:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1784189274.044667:0:63468:0:(genops.c:865:class_export_destroy()) destroying export ffff9dbf4726a800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:00000080:1.0:1784189274.044672:0:63468:0:(genops.c:865:class_export_destroy()) destroying export ffff9dbf43d88000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1784189274.044675:0:63468:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9dbf43d8a000 for lustre-OST0000-osc-MDT0000 00000020:00000080:1.0:1784189274.044679:0:63468:0:(genops.c:906:class_export_put()) final put ffff9dc071557000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1784189274.044681:0:63468:0:(genops.c:865:class_export_destroy()) destroying export ffff9dc071557000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:1.0:1784189274.044684:0:63468:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1784189274.044706:0:63468:0:(genops.c:865:class_export_destroy()) destroying export ffff9dc07118c000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:00000080:1.0:1784189274.044710:0:63468:0:(genops.c:865:class_export_destroy()) destroying export ffff9dbf43693800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:1.0:1784189274.045356:0:93684:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0001-osp-MDT0000: client import never connected 00000100:00080000:1.0:1784189274.045360:0:93684:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1784189274.045363:0:93684:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:1.0:1784189274.045368:0:93684:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1784189274.045411:0:93684:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1784189274.045422:0:93684:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1784189274.045448:0:93684:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1784189274.045452:0:93684:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1784189274.045456:0:93684:0:(genops.c:906:class_export_put()) final put ffff9dc06b3ed800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1784189274.045458:0:93684:0:(genops.c:865:class_export_destroy()) destroying export ffff9dc06b3ed800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:1.0:1784189274.045463:0:93684:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1784189274.045526:0:93684:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xcc1762b626f8bd00 00000020:00000080:1.0:1784189274.045531:0:93684:0:(genops.c:906:class_export_put()) final put ffff9dc06b3e9800/lustre-MDD0000_UUID 00000020:01000000:1.0:1784189274.045535:0:93684:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:1.0:1784189274.045539:0:93684:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1784189274.045543:0:93684:0:(obd_config.c:955:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1784189274.045552:0:93684:0:(genops.c:1579:class_disconnect_exports()) OBD device 14 (ffff9dc049be0000) has no exports 00000020:00000080:1.0:1784189274.045570:0:93684:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1784189274.045574:0:93684:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:1.0:1784189274.045577:0:93684:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xcc1762b626f8bd07 00000020:00000080:1.0:1784189274.045580:0:93684:0:(genops.c:906:class_export_put()) final put ffff9dc06b3ea800/lustre-MDT0000-osd_UUID 00000020:01000004:1.0:1784189274.045586:0:93684:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9dbf46b0a800 from lustre-MDT0000, refs=3 00000020:01000004:1.0:1784189274.045589:0:93684:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9dbf46b0a800 3 00000020:01000004:1.0:1784189274.045592:0:93684:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9dbf46b0a800 from lustre-MDT0000 00000020:00000080:1.0:1784189274.045606:0:93684:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1784189274.045609:0:93684:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:1.0:1784189274.045611:0:93684:0:(genops.c:906:class_export_put()) final put ffff9dc07118b800/lustre-MDT0000_UUID 00000020:00000080:1.0:1784189274.045613:0:93684:0:(genops.c:865:class_export_destroy()) destroying export ffff9dc07118b800/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:1.0:1784189274.045619:0:93684:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:1.0:1784189274.045647:0:93684:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 3 references. 00000020:01000004:1.0:1784189274.045650:0:93684:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:1.0:1784189274.045653:0:93684:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:1.0:1784189274.045655:0:93684:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1784189274.045657:0:93684:0:(obd_config.c:955:class_cleanup()) MGS: forcing exports to disconnect: 2/5 00000020:00080000:1.0:1784189274.045666:0:93684:0:(genops.c:1840:print_export_data()) MGS: ACTIVE ffff9dbf43fcb000 60f345e3-c70e-4f53-b5e7-c9671463c9a5 192.168.203.12@tcp 9 (0 0 4) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1784189274.045672:0:93684:0:(genops.c:1840:print_export_data()) MGS: ACTIVE ffff9dbf434ae000 bd553d0d-03e2-4233-b06b-b55bbfa2b954 0@lo 18 (0 0 13) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1784189274.045676:0:93684:0:(genops.c:1574:class_disconnect_exports()) OBD device 3 (ffff9dc0762999c0) has exports, disconnecting them 00000020:00080000:1.0:1784189274.045681:0:93684:0:(genops.c:1549:class_disconnect_export_list()) MGS: disconnecting export at 192.168.203.12@tcp (ffff9dbf43fcb000), last request at 1784189251 00000020:00000080:1.0:1784189274.045699:0:93684:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xcc1762b626f8c191 00000020:00010000:1.0:1784189274.045703:0:93684:0:(genops.c:1942:obd_stale_export_put()) Put export ffff9dbf43fcb000: total 2 00000100:00080000:1.0:1784189274.045707:0:93684:0:(import.c:65:import_set_state_nolock()) ffff9dc07110d800 : changing import state from FULL to CLOSED 00000020:00080000:1.0:1784189274.045716:0:93684:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 192.168.203.12@tcp (ffff9dbf43fcb000): rc 0 00000020:00080000:1.0:1784189274.045719:0:93684:0:(genops.c:1549:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff9dbf434ae000), last request at 1784189243 00000020:00010000:1.0:1784189274.045755:0:6502:0:(genops.c:1928:obd_stale_export_get()) Get export ffff9dbf43fcb000: total 2 00010000:00010000:1.0:1784189274.045776:0:6502:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff9dbf43fcb000, canceled 0 locks, left on hash table 4. 00010000:00010000:1.0:1784189274.045801:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dc04152d600/0xcc1762b626f8c2d3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c3fec expref: 5 pid: 92398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189274.045824:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dbf4369ce00/0xcc1762b626f8c2da lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c3ff3 expref: 4 pid: 92396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189274.045835:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dbf4710ea00/0xcc1762b626f8c198 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c3fc2 expref: 3 pid: 92397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189274.045847:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dc04a20a000/0xcc1762b626f8c1a6 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c3fd0 expref: 2 pid: 92397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189274.045855:0:6502:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff9dbf43fcb000, canceled 4 locks, left on hash table 0. 00000020:00000080:1.0:1784189274.045872:0:6502:0:(genops.c:906:class_export_put()) final put ffff9dbf43fcb000/60f345e3-c70e-4f53-b5e7-c9671463c9a5 00010000:00010000:1.0:1784189274.045877:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784189274.045879:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784189274.045881:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1784189274.045891:0:93684:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xcc1762b626f8bca5 00000020:00010000:1.0:1784189274.045894:0:93684:0:(genops.c:1942:obd_stale_export_put()) Put export ffff9dbf434ae000: total 3 00000100:00080000:1.0:1784189274.045897:0:93684:0:(import.c:65:import_set_state_nolock()) ffff9dbf434ac000 : changing import state from FULL to CLOSED 00000020:00080000:1.0:1784189274.045905:0:93684:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9dbf434ae000): rc 0 00000020:00080000:1.0:1784189274.045909:0:93684:0:(genops.c:1579:class_disconnect_exports()) OBD device 3 (ffff9dc0762999c0) has no exports 00000020:00010000:1.0:1784189274.045914:0:7454:0:(genops.c:1928:obd_stale_export_get()) Get export ffff9dbf434ae000: total 3 00010000:00010000:1.0:1784189274.045916:0:7454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784189274.045934:0:7454:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff9dbf434ae000, canceled 0 locks, left on hash table 13. 00010000:00010000:1.0:1784189274.045950:0:7454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dc0565e6200/0xcc1762b626f8bde7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xcc1762b626f8bde0 expref: 14 pid: 92397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189274.045964:0:7454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dc04a20ac00/0xcc1762b626f8c294 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xcc1762b626f8c28d expref: 13 pid: 92397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189274.045975:0:7454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dbf4369d200/0xcc1762b626f8c2a2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xcc1762b626f8c29b expref: 12 pid: 92396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189274.045994:0:7454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dbf4369c000/0xcc1762b626f8c2b0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xcc1762b626f8c2a9 expref: 11 pid: 92397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189274.046005:0:7454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dbf4369cc00/0xcc1762b626f8be65 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xcc1762b626f8be5e expref: 10 pid: 92398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189274.046014:0:7454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dc04152d000/0xcc1762b626f8c2be lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xcc1762b626f8c2b7 expref: 9 pid: 92396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189274.046024:0:7454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dc0565e7400/0xcc1762b626f8be73 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xcc1762b626f8be6c expref: 8 pid: 92396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189274.046035:0:7454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dc0755a4c00/0xcc1762b626f8be03 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xcc1762b626f8bdfc expref: 7 pid: 92397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189274.046047:0:7454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dbf4369c200/0xcc1762b626f8be11 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xcc1762b626f8be0a expref: 6 pid: 92396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189274.046057:0:7454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dc04a20a600/0xcc1762b626f8c2cc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xcc1762b626f8c2c5 expref: 5 pid: 92398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189274.046067:0:7454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dc04152ca00/0xcc1762b626f8c286 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xcc1762b626f8c27f expref: 4 pid: 92398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189274.046077:0:7454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dc0755a4a00/0xcc1762b626f8be3b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xcc1762b626f8be34 expref: 3 pid: 92396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189274.046088:0:7454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dbf4710fe00/0xcc1762b626f8c278 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xcc1762b626f8c271 expref: 2 pid: 92398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189274.046119:0:7454:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff9dbf434ae000, canceled 13 locks, left on hash table 0. 00000020:00000080:1.0:1784189274.046132:0:7454:0:(genops.c:906:class_export_put()) final put ffff9dbf434ae000/bd553d0d-03e2-4233-b06b-b55bbfa2b954 00000020:00000080:3.0:1784189274.046331:0:63468:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9dbf430fb800 for lustre-MDT0001-osp-MDT0000 00000020:00000080:3.0:1784189274.046338:0:63468:0:(genops.c:906:class_export_put()) final put ffff9dc07118f000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1784189274.046340:0:63468:0:(genops.c:865:class_export_destroy()) destroying export ffff9dc07118f000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:01000000:3.0:1784189274.046345:0:63468:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osp-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1784189274.046403:0:63468:0:(genops.c:865:class_export_destroy()) destroying export ffff9dc06b3e9800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:3.0:1784189274.046407:0:63468:0:(genops.c:906:class_export_put()) final put ffff9dc07118a000/lustre-MDD0000_UUID 00000020:00000080:3.0:1784189274.046409:0:63468:0:(genops.c:865:class_export_destroy()) destroying export ffff9dc07118a000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:3.0:1784189274.046413:0:63468:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:00000080:3.0:1784189274.046450:0:63468:0:(genops.c:865:class_export_destroy()) destroying export ffff9dc06b3ea800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1784189274.046454:0:63468:0:(genops.c:865:class_export_destroy()) destroying export ffff9dbf43fcb000/60f345e3-c70e-4f53-b5e7-c9671463c9a5 for MGS 00000020:00000080:3.0:1784189274.046478:0:63468:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9dc07110d800 for MGS 00010000:00010000:1.0:1784189274.046832:0:7454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784189274.046835:0:7454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784189274.046837:0:7454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784189274.046894:0:92396:0:(service.c:3183:ptlrpc_main()) ll_mgs_0000: service thread [ffff9dc075669400:92396] 0 exiting: rc = 1 00000100:00100000:1.0:1784189274.046972:0:92397:0:(service.c:3183:ptlrpc_main()) ll_mgs_0001: service thread [ffff9dc075668a00:92397] 1 exiting: rc = 0 00000020:00000080:3.0:1784189274.047054:0:93049:0:(genops.c:865:class_export_destroy()) destroying export ffff9dbf434ae000/bd553d0d-03e2-4233-b06b-b55bbfa2b954 for MGS 00000020:00000080:3.0:1784189274.047078:0:93049:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9dbf434ac000 for MGS 00000100:00100000:2.0:1784189274.047283:0:92398:0:(service.c:3183:ptlrpc_main()) ll_mgs_0002: service thread [ffff9dc075668800:92398] 2 exiting: rc = 0 00000100:00100000:1.0:1784189274.047774:0:93684:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784189274.047782:0:93684:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784189274.047788:0:93684:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784189274.047794:0:93684:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784189274.047801:0:93684:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784189274.047807:0:93684:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784189274.047812:0:93684:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784189274.047818:0:93684:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784189274.047823:0:93684:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784189274.047828:0:93684:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784189274.047834:0:93684:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784189274.047839:0:93684:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784189274.047846:0:93684:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784189274.047851:0:93684:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784189274.047856:0:93684:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784189274.047862:0:93684:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784189274.047868:0:93684:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784189274.047873:0:93684:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784189274.047879:0:93684:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784189274.047884:0:93684:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784189274.047890:0:93684:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784189274.047895:0:93684:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784189274.047900:0:93684:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784189274.047905:0:93684:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784189274.047910:0:93684:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784189274.047926:0:93684:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784189274.047932:0:93684:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784189274.047937:0:93684:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784189274.047942:0:93684:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784189274.047947:0:93684:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784189274.047952:0:93684:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784189274.047957:0:93684:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784189274.047962:0:93684:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784189274.047967:0:93684:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784189274.047973:0:93684:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784189274.047979:0:93684:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784189274.047985:0:93684:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784189274.047991:0:93684:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784189274.047996:0:93684:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784189274.048002:0:93684:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784189274.048007:0:93684:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784189274.048012:0:93684:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784189274.048018:0:93684:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784189274.048023:0:93684:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784189274.048028:0:93684:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784189274.048034:0:93684:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784189274.048039:0:93684:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784189274.048045:0:93684:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784189274.048051:0:93684:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784189274.048058:0:93684:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784189274.048063:0:93684:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784189274.048068:0:93684:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784189274.048074:0:93684:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784189274.048080:0:93684:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784189274.048085:0:93684:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784189274.048092:0:93684:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784189274.048097:0:93684:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784189274.048104:0:93684:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784189274.048110:0:93684:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784189274.048117:0:93684:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784189274.048133:0:93684:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784189274.048217:0:93684:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784189274.048224:0:93684:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784189274.048231:0:93684:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:01000000:1.0:1784189274.049662:0:93684:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9dc0506ddf00 - data ffff9dc0704660d8/ffff9dc07fade400 00000020:01000000:1.0:1784189274.049779:0:93684:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9dc0569899c0 - data ffff9dc06bec45e8/ffff9dc07587d000 00000020:00000080:1.0:1784189274.050223:0:93684:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xcc1762b626f8bc9e 00000020:00000080:1.0:1784189274.050232:0:93684:0:(genops.c:906:class_export_put()) final put ffff9dc05ed5b800/lustre-MDT0000-osd_UUID 00000020:01000004:1.0:1784189274.050250:0:93684:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9dbf46b0a800 from MGS, refs=2 00000020:01000004:1.0:1784189274.050255:0:93684:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9dbf46b0a800 2 00000020:01000004:1.0:1784189274.050258:0:93684:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9dbf46b0a800 from MGS 00000020:00000080:1.0:1784189274.050279:0:93684:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1784189274.050285:0:93684:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:1.0:1784189274.050288:0:93684:0:(genops.c:906:class_export_put()) final put ffff9dbf44677800/MGS 00000020:00000080:1.0:1784189274.050290:0:93684:0:(genops.c:865:class_export_destroy()) destroying export ffff9dbf44677800/MGS for MGS 00000020:01000000:1.0:1784189274.050296:0:93684:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:1.0:1784189274.050395:0:93684:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:1.0:1784189274.050399:0:93684:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1784189274.050408:0:93684:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1784189274.050414:0:93684:0:(genops.c:1840:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff9dc07a884000 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1784189274.050420:0:93684:0:(genops.c:1574:class_disconnect_exports()) OBD device 28 (ffff9dc075478000) has exports, disconnecting them 00000020:00080000:1.0:1784189274.050425:0:93684:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff9dc07a884000), last request at 1784189244 00000020:00000080:1.0:1784189274.050429:0:93684:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xcc1762b626f8bdb6 00000020:00080000:1.0:1784189274.050438:0:93684:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9dc07a884000): rc 0 00000020:00000080:1.0:1784189274.050443:0:93684:0:(genops.c:906:class_export_put()) final put ffff9dc07a884000/lustre-MDT0000-lwp-MDT0000 00000020:00000080:3.0:1784189274.051089:0:63468:0:(genops.c:865:class_export_destroy()) destroying export ffff9dc05ed5b800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1784189274.051103:0:63468:0:(genops.c:865:class_export_destroy()) destroying export ffff9dc07a884000/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:0.0:1784189274.067413:0:93684:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:0.0:1784189274.067423:0:93684:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1784189274.067427:0:93684:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:0.0:1784189274.067435:0:93684:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1784189274.067602:0:93684:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1784189274.067615:0:93684:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:0.0:1784189274.067621:0:93684:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9dbf46b0a800 1 00000020:00000080:0.0:1784189274.067628:0:93684:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xcc1762b626f8bc90 00000020:00000080:0.0:1784189274.067635:0:93684:0:(genops.c:906:class_export_put()) final put ffff9dbf44673000/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1784189274.067664:0:63468:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9dbf42276000 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:3.0:1784189274.067671:0:63468:0:(genops.c:906:class_export_put()) final put ffff9dbf43fc9000/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:3.0:1784189274.067673:0:63468:0:(genops.c:865:class_export_destroy()) destroying export ffff9dbf43fc9000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:3.0:1784189274.067678:0:63468:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000000:0.0:1784189274.068047:0:93684:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:0.0:1784189274.068054:0:93684:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1784189274.068059:0:93684:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1784189274.068063:0:93684:0:(genops.c:1579:class_disconnect_exports()) OBD device 0 (ffff9dbf449f3380) has no exports 00000020:00000080:3.0:1784189274.069018:0:63468:0:(genops.c:865:class_export_destroy()) destroying export ffff9dbf44673000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1784189274.106338:0:93684:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1784189274.106351:0:93684:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:3.0:1784189274.106357:0:93684:0:(genops.c:906:class_export_put()) final put ffff9dbf46b09800/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1784189274.106361:0:93684:0:(genops.c:865:class_export_destroy()) destroying export ffff9dbf46b09800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:3.0:1784189274.107284:0:93684:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:3.0:1784189274.107900:0:93684:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9dbf46b0b800 00000020:02000400:3.0:1784189274.107963:0:93684:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-MDT0000 complete 00000100:00100000:1.0:1784189274.160546:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf4262d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1870854458208000:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1784189274.160612:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784189274.160662:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458208000 00000100:00100000:1.0:1784189274.160668:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458208000 00000100:00100000:1.0:1784189274.160717:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2032 00000100:00100000:1.0:1784189274.160725:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf4262ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1870854458208000:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1784189274.160759:0:8432:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8647872 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1784189274.160801:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf4262ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1870854458208000:12345-0@lo:13:osp-pre-1-1.0 Request processed in 77us (189us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189274.160808:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2032 00000100:00080000:1.0:1784189274.160828:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1784189274.160861:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf4262d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1870854458208000:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1784189274.161171:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1784189274.161179:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf4262d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1870854458208128:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1784189274.161206:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784189274.161231:0:9466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458208128 00000100:00100000:1.0:1784189274.161235:0:9466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458208128 00000100:00100000:1.0:1784189274.161261:0:9466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2033 00000100:00100000:1.0:1784189274.161267:0:9466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf4262df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1870854458208128:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1784189274.161283:0:9466:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8647872 pending 0 free 3922481152 avail 3690958848 00000100:00100000:1.0:1784189274.161311:0:9466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf4262df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1870854458208128:12345-0@lo:13:osp-pre-0-1.0 Request processed in 45us (105us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189274.161334:0:9466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2033 00000100:00080000:1.0:1784189274.161348:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1784189274.161378:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf4262d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1870854458208128:0@lo:13:osp-pre-0-1.0 00010000:00010000:1.0:1784189274.864719:0:26173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784189275.183601:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf4262d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1870854458208256:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1784189275.183680:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784189275.183710:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc075f7c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3640:1870854458208768:0@lo:400:kworker.0 00000100:00100000:1.0:1784189275.183736:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784189275.183752:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc080e62a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1870854458209280:0@lo:400:kworker.0 00000100:00100000:1.0:1784189275.183785:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784189275.183809:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1784189275.183815:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf4262ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bd553d0d-03e2-4233-b06b-b55bbfa2b954:3640:1870854458208384:0@lo:400:kworker.0 00000400:00000100:1.0:1784189275.183833:0:3640:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1870854458208384 offset 0 length 224: 4 00000100:00100000:1.0:1784189275.183858:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc075f7c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3640:1870854458208896:0@lo:400:kworker.0 00000100:00100000:1.0:1784189275.183877:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784189275.183906:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf44fad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3640:1870854458209408:0@lo:400:kworker.0 00000100:00100000:1.0:1784189275.183927:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784189275.183950:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf4262ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3642:1870854458208512:0@lo:400:kworker.0 00000100:00100000:1.0:1784189275.183974:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784189275.184083:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc080e63480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1870854458209024:0@lo:400:kworker.0 00000100:00100000:1.0:1784189275.184104:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784189275.184125:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1784189275.184131:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf4262f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3642:1870854458208640:0@lo:400:kworker.0 00000100:00100000:1.0:1784189275.184153:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784189275.184170:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc080e62680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1870854458209152:0@lo:400:kworker.0 00000100:00100000:1.0:1784189275.184195:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784189275.184225:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458208256 00000100:00100000:1.0:1784189275.184232:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458208256 00000100:00100000:1.0:1784189275.184260:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458209024 00000100:00100000:1.0:1784189275.184263:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458209024 00000100:00100000:1.0:1784189275.184280:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3910 00000100:00100000:1.0:1784189275.184287:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf44fac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3640:x1870854458208256:12345-0@lo:41:osp-pre-0-1.0 00000020:00080000:1.0:1784189275.184295:0:8438:0:(tgt_handler.c:807:tgt_request_handle()) operation 41 on unconnected OST from 12345-0@lo 00000100:00100000:1.0:1784189275.184457:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf44fac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3640:x1870854458208256:12345-0@lo:41:osp-pre-0-1.0 Request processed in 169us (776us total) trans 0 rc -107/-107 00000100:00100000:1.0:1784189275.184472:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3910 00000100:00100000:1.0:1784189275.184488:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3911 00000100:00100000:1.0:1784189275.184626:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf44faf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3642:x1870854458209024:12345-0@lo:400:kworker.0 00000020:00080000:1.0:1784189275.184640:0:8438:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:1.0:1784189275.184672:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf44faf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3642:x1870854458209024:12345-0@lo:400:kworker.0 Request processed in 46us (566us total) trans 0 rc -107/-107 00000100:00100000:1.0:1784189275.184678:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3911 00000100:00100000:1.0:1784189275.184698:0:66945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458208768 00000100:00100000:1.0:1784189275.184702:0:66945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458208768 00000100:00100000:1.0:1784189275.184717:0:66945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458208896 00000100:00100000:1.0:1784189275.184719:0:66945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458208896 00000100:00100000:1.0:1784189275.184742:0:66945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458209408 00000100:00100000:1.0:1784189275.184745:0:66945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458209408 00000100:00100000:1.0:1784189275.184751:0:66945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458208512 00000100:00100000:1.0:1784189275.184753:0:66945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458208512 00000100:00100000:1.0:1784189275.184759:0:66945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458208640 00000100:00100000:1.0:1784189275.184762:0:66945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458208640 00000100:00100000:1.0:1784189275.184774:0:66945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1282 00000100:00100000:1.0:1784189275.184779:0:66945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf44fae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1870854458208896:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784189275.184815:0:66945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf44fae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1870854458208896:12345-0@lo:400:kworker.0 Request processed in 36us (936us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189275.184821:0:66945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1282 00000100:00100000:1.0:1784189275.184832:0:66945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1283 00000100:00100000:1.0:1784189275.184837:0:66945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc06b98dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1870854458208640:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784189275.184862:0:66945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc06b98dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1870854458208640:12345-0@lo:400:kworker.0 Request processed in 25us (709us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189275.184868:0:66945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1283 00000100:00100000:1.0:1784189275.184888:0:66945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1391 00000100:00100000:1.0:1784189275.184892:0:66945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf44fac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3640:x1870854458208768:12345-0@lo:400:kworker.0 00000020:00080000:1.0:1784189275.184896:0:66945:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:1.0:1784189275.184919:0:66945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf44fac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3640:x1870854458208768:12345-0@lo:400:kworker.0 Request processed in 25us (1182us total) trans 0 rc -107/-107 00000100:00100000:1.0:1784189275.184924:0:66945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1391 00000100:00100000:1.0:1784189275.184935:0:66945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1392 00000100:00100000:1.0:1784189275.184938:0:66945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf44faca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3640:x1870854458209408:12345-0@lo:400:kworker.0 00000020:00080000:1.0:1784189275.184942:0:66945:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:1.0:1784189275.184964:0:66945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf44faca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3640:x1870854458209408:12345-0@lo:400:kworker.0 Request processed in 24us (1036us total) trans 0 rc -107/-107 00000100:00100000:1.0:1784189275.184970:0:66945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1392 00000100:00100000:1.0:1784189275.184982:0:66945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1393 00000100:00100000:1.0:1784189275.184985:0:66945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf44fad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3642:x1870854458208512:12345-0@lo:400:kworker.0 00000020:00080000:1.0:1784189275.184990:0:66945:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:1.0:1784189275.185010:0:66945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf44fad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3642:x1870854458208512:12345-0@lo:400:kworker.0 Request processed in 24us (1037us total) trans 0 rc -107/-107 00000100:00100000:1.0:1784189275.185015:0:66945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1393 00000100:00100000:1.0:1784189275.185033:0:26223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458209280 00000100:00100000:1.0:1784189275.185036:0:26223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458209280 00000100:00100000:1.0:1784189275.185061:0:26223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458209152 00000100:00100000:1.0:1784189275.185064:0:26223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458209152 00000100:00100000:1.0:1784189275.185084:0:26223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2538 00000100:00100000:1.0:1784189275.185090:0:26223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf44faea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0001-mdtlov_UUID+5:3640:x1870854458209280:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784189275.185119:0:26223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf44faea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0001-mdtlov_UUID+5:3640:x1870854458209280:12345-0@lo:400:kworker.0 Request processed in 30us (1333us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189275.185125:0:26223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2538 00000100:00100000:1.0:1784189275.185136:0:26223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2539 00000100:00100000:1.0:1784189275.185149:0:26223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc06b98d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0001-mdtlov_UUID+5:3642:x1870854458209152:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784189275.185180:0:26223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc06b98d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0001-mdtlov_UUID+5:3642:x1870854458209152:12345-0@lo:400:kworker.0 Request processed in 32us (984us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189275.185185:0:26223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2539 00000100:00100000:1.0:1784189275.185255:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf4262f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3642:1870854458208640:0@lo:400:kworker.0 00000100:00100000:1.0:1784189275.185268:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc080e62680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1870854458209152:0@lo:400:kworker.0 00000100:00080000:1.0:1784189275.185277:0:3642:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0000 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1784189275.185281:0:3642:0:(import.c:65:import_set_state_nolock()) ffff9dbf42271800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:1.0:1784189275.185285:0:3642:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:1.0:1784189275.185290:0:3642:0:(import.c:65:import_set_state_nolock()) ffff9dbf42271800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1784189275.185294:0:3642:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3491 00000100:00080000:1.0:1784189275.185299:0:3642:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9dbf42271800 using connection 192.168.203.112@tcp/0@lo 00000100:00100000:1.0:1784189275.185348:0:3642:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9dc06b98c700 x1870854458209536/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1784189275.185380:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf4262ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3642:1870854458208512:0@lo:400:kworker.0 00000100:00080000:1.0:1784189275.185392:0:3642:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-osp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1784189275.185395:0:3642:0:(import.c:65:import_set_state_nolock()) ffff9dbf436c4000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:1.0:1784189275.185398:0:3642:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:1.0:1784189275.185401:0:3642:0:(import.c:65:import_set_state_nolock()) ffff9dbf436c4000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1784189275.185405:0:3642:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3491 00000100:00080000:1.0:1784189275.185408:0:3642:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9dbf436c4000 using connection 192.168.203.112@tcp/0@lo 00000100:00100000:1.0:1784189275.185420:0:3642:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9dc06b98ed80 x1870854458209664/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1784189275.185438:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc080e63480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1870854458209024:0@lo:400:kworker.0 00000100:00080000:1.0:1784189275.185470:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1784189275.185489:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc06b98c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3639:1870854458209536:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:1.0:1784189275.185519:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784189275.185537:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc06b98ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3639:1870854458209664:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:1.0:1784189275.185558:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784189275.185583:0:66945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458209536 00000100:00100000:1.0:1784189275.185586:0:66945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458209536 00000100:00100000:1.0:1784189275.185604:0:66945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1394 00000100:00100000:1.0:1784189275.185608:0:66945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc06b98ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3639:x1870854458209536:12345-0@lo:38:ptlrpcd_00_02.0 00010000:00020000:1.0:1784189275.185625:0:66945:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1784189275.185654:0:66945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc06b98ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3639:x1870854458209536:12345-0@lo:38:ptlrpcd_00_02.0 Request processed in 44us (134us total) trans 0 rc -19/-19 00000100:00100000:1.0:1784189275.185660:0:66945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1394 00000100:00100000:1.0:1784189275.185676:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458209664 00000100:00100000:1.0:1784189275.185680:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458209664 00000100:00100000:1.0:1784189275.185695:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3912 00000100:00100000:1.0:1784189275.185699:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc06b98f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3639:x1870854458209664:12345-0@lo:38:ptlrpcd_00_02.0 00010000:00020000:1.0:1784189275.185708:0:8438:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1784189275.185735:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc06b98f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3639:x1870854458209664:12345-0@lo:38:ptlrpcd_00_02.0 Request processed in 35us (177us total) trans 0 rc -19/-19 00000100:00100000:1.0:1784189275.185742:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3912 00000100:00080000:1.0:1784189275.185766:0:3639:0:(import.c:65:import_set_state_nolock()) ffff9dbf42271800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1784189275.185770:0:3639:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1784189275.185780:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc06b98c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3639:1870854458209536:0@lo:38:ptlrpcd_00_02.0 00000100:00080000:1.0:1784189275.185789:0:3639:0:(import.c:65:import_set_state_nolock()) ffff9dbf436c4000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1784189275.185792:0:3639:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1784189275.185795:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc06b98ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3639:1870854458209664:0@lo:38:ptlrpcd_00_02.0 00000100:02020000:0.0:1784189275.186717:0:3640:0:(client.c:1492:ptlrpc_check_status()) lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 00000100:00080000:0.0:1784189275.186723:0:3640:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-osp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1784189275.186726:0:3640:0:(import.c:214:ptlrpc_set_import_discon()) osp: import ffff9dbf436c4000 already not connected (conn 70, was 69): DISCONN 00000100:00080000:0.0:1784189275.186737:0:3640:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1784189275.186740:0:3640:0:(import.c:65:import_set_state_nolock()) ffff9dbf425f4800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:0.0:1784189275.186743:0:3640:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:0.0:1784189275.186747:0:3640:0:(import.c:65:import_set_state_nolock()) ffff9dbf425f4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1784189275.186750:0:3640:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3491 00000100:00080000:0.0:1784189275.186756:0:3640:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9dbf425f4800 using connection 192.168.203.112@tcp/0@lo 00000100:00100000:0.0:1784189275.186777:0:3640:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9dbf46954700 x1870854458209792/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1784189275.186830:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf46954700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3639:1870854458209792:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:1.0:1784189275.186866:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784189275.187028:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc075f7c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3640:1870854458208768:0@lo:400:kworker.0 00000100:00100000:0.0:1784189275.187047:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc080e62a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1870854458209280:0@lo:400:kworker.0 00000100:00100000:0.0:1784189275.187072:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc075f7c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3640:1870854458208896:0@lo:400:kworker.0 00000100:00080000:0.0:1784189275.187082:0:3640:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1784189275.187085:0:3640:0:(import.c:65:import_set_state_nolock()) ffff9dbf43690800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:0.0:1784189275.187088:0:3640:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:0.0:1784189275.187090:0:3640:0:(import.c:65:import_set_state_nolock()) ffff9dbf43690800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1784189275.187094:0:3640:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3491 00000100:00080000:0.0:1784189275.187109:0:3640:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff9dbf43690800 using connection 192.168.203.112@tcp/0@lo 00000100:00100000:0.0:1784189275.187123:0:3640:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9dc075f7c700 x1870854458209920/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1784189275.187158:0:66170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458209792 00000100:00100000:2.0:1784189275.187164:0:66170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458209792 00000100:00100000:2.0:1784189275.187198:0:66170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1395 00000100:00100000:2.0:1784189275.187210:0:66170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc06b98ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3639:x1870854458209792:12345-0@lo:38:ptlrpcd_00_00.0 00010000:00020000:2.0:1784189275.187224:0:66170:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1784189275.187336:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc075f7c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3639:1870854458209920:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:1.0:1784189275.187375:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784189275.187424:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf44fad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3640:1870854458209408:0@lo:400:kworker.0 00000100:00100000:2.0:1784189275.187507:0:66170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc06b98ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3639:x1870854458209792:12345-0@lo:38:ptlrpcd_00_00.0 Request processed in 295us (638us total) trans 0 rc -19/-19 00000100:00100000:2.0:1784189275.187513:0:66170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1395 00000100:00100000:2.0:1784189275.187526:0:66170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458209920 00000100:00100000:2.0:1784189275.187529:0:66170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458209920 00000100:00100000:2.0:1784189275.187544:0:66170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1396 00000100:00100000:2.0:1784189275.187548:0:66170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc06b98c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3639:x1870854458209920:12345-0@lo:38:ptlrpcd_00_00.0 00010000:00020000:2.0:1784189275.187557:0:66170:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1784189275.187582:0:66170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc06b98c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3639:x1870854458209920:12345-0@lo:38:ptlrpcd_00_00.0 Request processed in 33us (207us total) trans 0 rc -19/-19 00000100:00100000:2.0:1784189275.187588:0:66170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1396 00000100:00080000:1.0:1784189275.187739:0:3639:0:(import.c:65:import_set_state_nolock()) ffff9dbf425f4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1784189275.187744:0:3639:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1784189275.187747:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf46954700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3639:1870854458209792:0@lo:38:ptlrpcd_00_00.0 00000100:00080000:1.0:1784189275.187762:0:3639:0:(import.c:65:import_set_state_nolock()) ffff9dbf43690800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1784189275.187765:0:3639:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1784189275.187768:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc075f7c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3639:1870854458209920:0@lo:38:ptlrpcd_00_00.0 00010000:00010000:0.0:1784189275.887768:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784189276.911636:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000400:00000100:0.0:1784189277.480551:0:3634:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-192.168.203.12@tcp portal 26 match 1870854436320128 offset 0 length 224: 4 00000100:00100000:0.0:1784189277.480598:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1784189277.480636:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1784189277.480658:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1784189277.480688:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1784189277.480717:0:66170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436320384 00000100:00100000:0.0:1784189277.480726:0:66170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436320384 00000100:00100000:0.0:1784189277.480794:0:66170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436320256 00000100:00100000:0.0:1784189277.480798:0:66170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436320256 00000100:00100000:0.0:1784189277.480834:0:66170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1284 00000100:00080000:1.0:1784189277.480891:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1784189277.480922:0:66170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc075f7c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:debedd94-805c-42a0-a5e5-41758b2012e9+19:2399:x1870854436320384:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:2.0:1784189277.481001:0:68287:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1397 00000100:00100000:0.0:1784189277.481004:0:66170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc075f7c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:debedd94-805c-42a0-a5e5-41758b2012e9+19:2399:x1870854436320384:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 158us (402us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189277.481020:0:68287:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf44fad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2399:x1870854436320256:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:0.0:1784189277.481020:0:66170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1284 00000020:00080000:2.0:1784189277.481036:0:68287:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-192.168.203.12@tcp 00000100:00100000:2.0:1784189277.481106:0:68287:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf44fad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2399:x1870854436320256:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 91us (445us total) trans 0 rc -107/-107 00000100:00100000:2.0:1784189277.481116:0:68287:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1397 00000100:00100000:2.0:1784189277.481194:0:26167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436320640 00000100:00100000:2.0:1784189277.481201:0:26167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436320640 00000100:00100000:2.0:1784189277.481248:0:26167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436320512 00000100:00100000:2.0:1784189277.481251:0:26167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436320512 00000100:00100000:2.0:1784189277.481281:0:26167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 2540 00000100:00080000:0.0:1784189277.481283:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1784189277.481290:0:26167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc075f7c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:debedd94-805c-42a0-a5e5-41758b2012e9+6:2399:x1870854436320640:12345-192.168.203.12@tcp:400:kworker.0 00000100:00080000:0.0:1784189277.481291:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1784189277.481377:0:26159:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 2541 00000100:00100000:0.0:1784189277.481390:0:26159:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf44c8aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:debedd94-805c-42a0-a5e5-41758b2012e9+5:2399:x1870854436320512:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:2.0:1784189277.481411:0:26167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc075f7c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:debedd94-805c-42a0-a5e5-41758b2012e9+6:2399:x1870854436320640:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 120us (771us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189277.481422:0:26167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 2540 00000100:00100000:0.0:1784189277.481441:0:26159:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf44c8aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:debedd94-805c-42a0-a5e5-41758b2012e9+5:2399:x1870854436320512:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 50us (747us total) trans 0 rc 0/0 00000100:00100000:0.0:1784189277.481451:0:26159:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 2541 00000100:00100000:0.0:1784189277.492209:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1784189277.492307:0:66169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436320768 00000100:00100000:1.0:1784189277.492367:0:66169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436320768 00000100:00100000:0.0:1784189277.492481:0:66170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1398 00000100:00100000:0.0:1784189277.492493:0:66170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf44c88700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2395:x1870854436320768:12345-192.168.203.12@tcp:38:ptlrpcd_01_01.0 00010000:00020000:0.0:1784189277.492518:0:66170:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.203.12@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1784189277.492643:0:66170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf44c88700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2395:x1870854436320768:12345-192.168.203.12@tcp:38:ptlrpcd_01_01.0 Request processed in 149us (445us total) trans 0 rc -19/-19 00000100:00100000:0.0:1784189277.492653:0:66170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1398 00000001:00100000:2.0:1784189277.746963:0:75588:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:2.0:1784189277.746980:0:75588:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 81604378769 is committed 00000020:00000080:2.0:1784189277.746985:0:75588:0:(genops.c:906:class_export_put()) final put ffff9dc04ffb1800/lustre-MDT0000-mdtlov_UUID 00000001:00080000:2.0:1784189277.747028:0:75588:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 81604378768 is committed 00010000:00010000:1.0:1784189277.747218:0:3626:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9dc058f67200/0xcc1762b626f8c4d9 lrc: 3/0,1 mode: TXN/TXN res: [0x2400090a5:0x2:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 68287 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189277.747236:0:3626:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9dc058f67200/0xcc1762b626f8c4d9 lrc: 2/0,0 mode: TXN/TXN res: [0x2400090a5:0x2:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 68287 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189277.747244:0:3626:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9dc058f67200/0xcc1762b626f8c4d9 lrc: 3/0,0 mode: TXN/TXN res: [0x2400090a5:0x2:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 68287 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189277.747278:0:3626:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc058f67200 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:1.0:1784189277.747284:0:3626:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9dc058f67200/0xcc1762b626f8c4d9 lrc: 3/0,0 mode: TXN/TXN res: [0x2400090a5:0x2:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 68287 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189277.747293:0:3626:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9dc058f67200/0xcc1762b626f8c4d9 lrc: 4/0,0 mode: TXN/TXN res: [0x2400090a5:0x2:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 68287 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189277.747314:0:3626:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x2:0x0].0x9add8152 (ffff9dbf45662700) 00010000:00010000:1.0:1784189277.747349:0:3626:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784189277.747357:0:3626:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9dc058f67200/0xcc1762b626f8c4d9 lrc: 2/0,0 mode: --/TXN res: [0x2400090a5:0x2:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 68287 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189277.747364:0:3626:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9dc058f67200/0xcc1762b626f8c4d9 lrc: 0/0,0 mode: --/TXN res: [0x2400090a5:0x2:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 68287 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189277.747402:0:3626:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9dbf4710e000/0xcc1762b626f8c4ee lrc: 3/0,1 mode: TXN/TXN res: [0x2400090a5:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66171 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189277.747409:0:3626:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9dbf4710e000/0xcc1762b626f8c4ee lrc: 2/0,0 mode: TXN/TXN res: [0x2400090a5:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66171 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189277.747416:0:3626:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9dbf4710e000/0xcc1762b626f8c4ee lrc: 3/0,0 mode: TXN/TXN res: [0x2400090a5:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66171 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189277.747421:0:3626:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dbf4710e000 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:1.0:1784189277.747424:0:3626:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9dbf4710e000/0xcc1762b626f8c4ee lrc: 3/0,0 mode: TXN/TXN res: [0x2400090a5:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66171 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189277.747431:0:3626:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9dbf4710e000/0xcc1762b626f8c4ee lrc: 4/0,0 mode: TXN/TXN res: [0x2400090a5:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66171 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189277.747455:0:3626:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x4:0x0].0x0 (ffff9dc0455f8300) 00010000:00010000:1.0:1784189277.747458:0:3626:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784189277.747462:0:3626:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9dbf4710e000/0xcc1762b626f8c4ee lrc: 2/0,0 mode: --/TXN res: [0x2400090a5:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66171 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189277.747468:0:3626:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9dbf4710e000/0xcc1762b626f8c4ee lrc: 0/0,0 mode: --/TXN res: [0x2400090a5:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66171 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189277.747484:0:3626:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9dc05ec0f400/0xcc1762b626f8c534 lrc: 3/0,1 mode: TXN/TXN res: [0x2400090a5:0x3:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66170 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189277.747490:0:3626:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9dc05ec0f400/0xcc1762b626f8c534 lrc: 2/0,0 mode: TXN/TXN res: [0x2400090a5:0x3:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66170 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189277.747496:0:3626:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9dc05ec0f400/0xcc1762b626f8c534 lrc: 3/0,0 mode: TXN/TXN res: [0x2400090a5:0x3:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66170 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189277.747501:0:3626:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc05ec0f400 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:1.0:1784189277.747504:0:3626:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9dc05ec0f400/0xcc1762b626f8c534 lrc: 3/0,0 mode: TXN/TXN res: [0x2400090a5:0x3:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66170 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189277.747510:0:3626:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9dc05ec0f400/0xcc1762b626f8c534 lrc: 4/0,0 mode: TXN/TXN res: [0x2400090a5:0x3:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66170 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189277.747518:0:3626:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x3:0x0].0x9add8152 (ffff9dc06adaa300) 00010000:00010000:1.0:1784189277.747521:0:3626:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784189277.747524:0:3626:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9dc05ec0f400/0xcc1762b626f8c534 lrc: 2/0,0 mode: --/TXN res: [0x2400090a5:0x3:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66170 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189277.747530:0:3626:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9dc05ec0f400/0xcc1762b626f8c534 lrc: 0/0,0 mode: --/TXN res: [0x2400090a5:0x3:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66170 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189277.747578:0:3626:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9dc058f66000/0xcc1762b626f8c549 lrc: 3/0,1 mode: TXN/TXN res: [0x2400090a5:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 68287 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189277.747585:0:3626:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9dc058f66000/0xcc1762b626f8c549 lrc: 2/0,0 mode: TXN/TXN res: [0x2400090a5:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 68287 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189277.747591:0:3626:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9dc058f66000/0xcc1762b626f8c549 lrc: 3/0,0 mode: TXN/TXN res: [0x2400090a5:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 68287 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189277.747596:0:3626:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc058f66000 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:1.0:1784189277.747599:0:3626:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9dc058f66000/0xcc1762b626f8c549 lrc: 3/0,0 mode: TXN/TXN res: [0x2400090a5:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 68287 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189277.747606:0:3626:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9dc058f66000/0xcc1762b626f8c549 lrc: 4/0,0 mode: TXN/TXN res: [0x2400090a5:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 68287 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189277.747614:0:3626:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x5:0x0].0x0 (ffff9dbf45662c00) 00010000:00010000:1.0:1784189277.747616:0:3626:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784189277.747619:0:3626:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9dc058f66000/0xcc1762b626f8c549 lrc: 2/0,0 mode: --/TXN res: [0x2400090a5:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 68287 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189277.747625:0:3626:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9dc058f66000/0xcc1762b626f8c549 lrc: 0/0,0 mode: --/TXN res: [0x2400090a5:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 68287 initiator: MDT1 lru_score: 0 lru_type: 0 00000020:00000080:3.0:1784189277.747990:0:63468:0:(genops.c:865:class_export_destroy()) destroying export ffff9dc04ffb1800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001 00000020:00000080:3.0:1784189277.748068:0:63468:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9dc06bb5d800 for lustre-MDT0001 00000001:00100000:0.0:1784189277.752071:0:9506:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1784189277.752080:0:9506:0:(genops.c:906:class_export_put()) final put ffff9dc04ba07800/lustre-MDT0000-mdtlov_UUID 00000001:00080000:0.0:1784189277.752105:0:9506:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294968959 is committed 00000020:00000080:2.0:1784189277.752155:0:93049:0:(genops.c:865:class_export_destroy()) destroying export ffff9dc04ba07800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:2.0:1784189277.752204:0:93049:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9dc04ba05800 for lustre-OST0001 00010000:00010000:1.0:1784189277.936529:0:7454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784189278.962027:0:26173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784189279.279700:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc05f02fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1870854458210048:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1784189279.279793:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784189279.281404:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458210048 00000100:00100000:2.0:1784189279.281416:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458210048 00000100:00100000:2.0:1784189279.281577:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2034 00000100:00100000:2.0:1784189279.281587:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc06b98df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1870854458210048:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1784189279.281618:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8647872 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1784189279.281700:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc06b98df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1870854458210048:12345-0@lo:13:osp-pre-1-1.0 Request processed in 115us (1907us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189279.281707:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2034 00000100:00080000:1.0:1784189279.282025:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1784189279.282069:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc05f02fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1870854458210048:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1784189279.282409:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1784189279.284302:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc07b5b0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1870854458210176:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1784189279.284396:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784189279.284561:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458210176 00000100:00100000:1.0:1784189279.284569:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458210176 00000100:00100000:1.0:1784189279.284748:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2035 00000100:00100000:1.0:1784189279.284758:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc05f02f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1870854458210176:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1784189279.284787:0:8432:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8647872 pending 0 free 3922481152 avail 3690958848 00000100:00100000:1.0:1784189279.284842:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc05f02f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1870854458210176:12345-0@lo:13:osp-pre-0-1.0 Request processed in 86us (446us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189279.284850:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2035 00000100:00100000:3.0:1784189279.285280:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc07b5b0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1870854458210176:0@lo:13:osp-pre-0-1.0 00000100:00080000:0.0:1784189279.285934:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00100000:3.0:1784189279.794667:0:8423:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1784189279.794680:0:8423:0:(genops.c:906:class_export_put()) final put ffff9dc047a85000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1784189279.794782:0:63468:0:(genops.c:865:class_export_destroy()) destroying export ffff9dc047a85000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:2.0:1784189279.794872:0:63468:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9dc047a87000 for lustre-OST0000 00010000:00010000:0.0:1784189279.983601:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1784189280.304431:0:93049:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1784189280.304440:0:93049:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1784189280.304445:0:93049:0:(import.c:65:import_set_state_nolock()) ffff9dbf42271800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1784189280.304455:0:93049:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3517 00000100:00080000:0.0:1784189280.304462:0:93049:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1784189280.304471:0:93049:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9dbf42271800 using connection 192.168.203.112@tcp/0@lo 00000100:00100000:0.0:1784189280.304499:0:93049:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9dc07b5b0e00 x1870854458210432/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1784189280.304541:0:93049:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1784189280.304544:0:93049:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1784189280.304546:0:93049:0:(import.c:65:import_set_state_nolock()) ffff9dbf425f4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1784189280.304549:0:93049:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3517 00000100:00080000:0.0:1784189280.304552:0:93049:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1784189280.304576:0:93049:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9dbf425f4800 using connection 192.168.203.112@tcp/0@lo 00000100:00100000:0.0:1784189280.304591:0:93049:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9dc07b5b2d80 x1870854458210688/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1784189280.304615:0:93049:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1784189280.304618:0:93049:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1784189280.304619:0:93049:0:(import.c:65:import_set_state_nolock()) ffff9dbf436c4000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1784189280.304624:0:93049:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3517 00000100:00080000:0.0:1784189280.304626:0:93049:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1784189280.304630:0:93049:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9dbf436c4000 using connection 192.168.203.112@tcp/0@lo 00000100:00100000:0.0:1784189280.304640:0:93049:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9dc07b5b1180 x1870854458210944/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1784189280.304666:0:93049:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1784189280.304669:0:93049:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1784189280.304671:0:93049:0:(import.c:65:import_set_state_nolock()) ffff9dbf43690800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1784189280.304674:0:93049:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3517 00000100:00080000:0.0:1784189280.304676:0:93049:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1784189280.304680:0:93049:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff9dbf43690800 using connection 192.168.203.112@tcp/0@lo 00000100:00100000:0.0:1784189280.304690:0:93049:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9dbf43f5ad80 x1870854458211328/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1784189280.304764:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc07b5b0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1870854458211072:0@lo:400:kworker.0 00000100:00100000:1.0:1784189280.304858:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784189280.304924:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1784189280.304930:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc07b5b0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3643:1870854458210816:0@lo:400:kworker.0 00000100:00100000:1.0:1784189280.304960:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784189280.305001:0:68287:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458210816 00000100:00100000:1.0:1784189280.305009:0:68287:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458210816 00000100:00100000:1.0:1784189280.305081:0:68287:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1285 00000100:00100000:1.0:1784189280.305092:0:68287:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc06b98c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1870854458210816:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784189280.305148:0:68287:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc06b98c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1870854458210816:12345-0@lo:400:kworker.0 Request processed in 59us (187us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189280.305156:0:68287:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1285 00000100:00100000:2.0:1784189280.305712:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc07b5b0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3639:1870854458210432:0@lo:38:kworker.0 00000100:00100000:2.0:1784189280.305757:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784189280.305783:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc07b5b2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3639:1870854458210688:0@lo:38:kworker.0 00000100:00100000:2.0:1784189280.305806:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784189280.305822:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc07b5b1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3639:1870854458210944:0@lo:38:kworker.0 00000100:00100000:2.0:1784189280.305846:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784189280.305863:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf43f5ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3639:1870854458211328:0@lo:38:kworker.0 00000100:00100000:2.0:1784189280.305883:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784189280.305917:0:66170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458210432 00000100:00100000:2.0:1784189280.305922:0:66170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458210432 00000100:00080000:1.0:1784189280.305985:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1784189280.306006:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc07b5b3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bd553d0d-03e2-4233-b06b-b55bbfa2b954:3640:1870854458210304:0@lo:400:kworker.0 00000400:00000100:1.0:1784189280.306034:0:3640:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1870854458210304 offset 0 length 224: 4 00000100:00100000:3.0:1784189280.306058:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc07b5b1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3641:1870854458210560:0@lo:400:kworker.0 00000100:00100000:1.0:1784189280.306065:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf43f58380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1870854458211200:0@lo:400:kworker.0 00000100:00100000:3.0:1784189280.306107:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784189280.306112:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784189280.306167:0:9982:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458211072 00000100:00100000:0.0:1784189280.306186:0:9982:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458211072 00000100:00100000:0.0:1784189280.306225:0:9982:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2542 00000100:00100000:0.0:1784189280.306233:0:9982:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc06b98ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3643:x1870854458211072:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784189280.306279:0:9982:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc06b98ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3643:x1870854458211072:12345-0@lo:400:kworker.0 Request processed in 47us (1422us total) trans 0 rc 0/0 00000100:00100000:0.0:1784189280.306297:0:9982:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2542 00000100:00100000:0.0:1784189280.306396:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc07b5b0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3643:1870854458210816:0@lo:400:kworker.0 00000100:00100000:0.0:1784189280.306409:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc07b5b0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1870854458211072:0@lo:400:kworker.0 00000100:00100000:1.0:1784189280.306532:0:26164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458211200 00000100:00100000:1.0:1784189280.306536:0:26164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458211200 00000100:00100000:1.0:1784189280.306566:0:26164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2543 00000100:00100000:1.0:1784189280.306573:0:26164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc06b98c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0001-mdtlov_UUID+5:3640:x1870854458211200:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784189280.306609:0:26164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc06b98c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0001-mdtlov_UUID+5:3640:x1870854458211200:12345-0@lo:400:kworker.0 Request processed in 36us (500us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189280.306616:0:26164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2543 00000100:00100000:1.0:1784189280.306641:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf43f58380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1870854458211200:0@lo:400:kworker.0 00000100:00100000:1.0:1784189280.306671:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458210944 00000100:00100000:1.0:1784189280.306675:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458210944 00000100:00100000:1.0:1784189280.306697:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3913 00000100:00100000:1.0:1784189280.306702:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc05f02e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3639:x1870854458210944:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1784189280.306724:0:8439:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1784189280.306757:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc05f02e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3639:x1870854458210944:12345-0@lo:38:kworker.0 Request processed in 54us (910us total) trans 0 rc -19/-19 00000100:00100000:1.0:1784189280.306763:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3913 00000100:00080000:3.0:1784189280.317542:0:3639:0:(import.c:65:import_set_state_nolock()) ffff9dbf436c4000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1784189280.317561:0:3639:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1784189280.317567:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc07b5b1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3639:1870854458210944:0@lo:38:kworker.0 00000100:00100000:2.0:1784189280.320618:0:66170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458210688 00000100:00100000:2.0:1784189280.320641:0:66170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458210688 00000100:00100000:2.0:1784189280.320707:0:66170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458211328 00000100:00100000:2.0:1784189280.320710:0:66170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458211328 00000100:00100000:2.0:1784189280.320722:0:66170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458210560 00000100:00100000:2.0:1784189280.320726:0:66170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458210560 00000100:00100000:2.0:1784189280.320806:0:66170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1286 00000100:00100000:2.0:1784189280.320818:0:66170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf4693ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1870854458210560:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784189280.320961:0:66170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf4693ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1870854458210560:12345-0@lo:400:kworker.0 Request processed in 145us (14853us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189280.320969:0:66170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1286 00000100:00100000:2.0:1784189280.320990:0:66170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1399 00000100:00100000:2.0:1784189280.320994:0:66170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc05f02fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3639:x1870854458210432:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1784189280.321021:0:66170:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1784189280.321063:0:66170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc05f02fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3639:x1870854458210432:12345-0@lo:38:kworker.0 Request processed in 67us (15304us total) trans 0 rc -19/-19 00000100:00100000:2.0:1784189280.321088:0:66170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1399 00000100:00100000:2.0:1784189280.321103:0:66170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1400 00000100:00100000:2.0:1784189280.321107:0:66170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc05f02c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3639:x1870854458210688:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1784189280.321118:0:66170:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1784189280.321145:0:66170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc05f02c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3639:x1870854458210688:12345-0@lo:38:kworker.0 Request processed in 36us (15338us total) trans 0 rc -19/-19 00000100:00100000:2.0:1784189280.321152:0:66170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1400 00000100:00100000:2.0:1784189280.321163:0:66170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1401 00000100:00100000:2.0:1784189280.321167:0:66170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc05f02ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3639:x1870854458211328:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1784189280.321354:0:66170:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1784189280.321387:0:66170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc05f02ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3639:x1870854458211328:12345-0@lo:38:kworker.0 Request processed in 218us (15502us total) trans 0 rc -19/-19 00000100:00100000:2.0:1784189280.321393:0:66170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1401 00000100:00080000:2.0:1784189280.321423:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1784189280.321465:0:3639:0:(import.c:65:import_set_state_nolock()) ffff9dbf42271800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1784189280.321471:0:3639:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1784189280.321475:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc07b5b0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3639:1870854458210432:0@lo:38:kworker.0 00000100:00080000:2.0:1784189280.321487:0:3639:0:(import.c:65:import_set_state_nolock()) ffff9dbf425f4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1784189280.321491:0:3639:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1784189280.321493:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc07b5b2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3639:1870854458210688:0@lo:38:kworker.0 00000100:00080000:2.0:1784189280.321502:0:3639:0:(import.c:65:import_set_state_nolock()) ffff9dbf43690800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1784189280.321505:0:3639:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1784189280.321508:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf43f5ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3639:1870854458211328:0@lo:38:kworker.0 00000100:00100000:2.0:1784189280.321577:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc07b5b1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3641:1870854458210560:0@lo:400:kworker.0 00010000:00010000:1.0:1784189281.008253:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784189282.033036:0:7454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784189282.607022:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000400:00000100:3.0:1784189282.607066:0:3633:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-192.168.203.12@tcp portal 26 match 1870854436320896 offset 0 length 224: 4 00000100:00100000:3.0:1784189282.607086:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1784189282.607114:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1784189282.607136:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1784189282.607175:0:26160:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436321280 00000100:00100000:3.0:1784189282.607185:0:26160:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436321280 00000100:00100000:3.0:1784189282.607268:0:26160:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436321408 00000100:00100000:3.0:1784189282.607272:0:26160:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436321408 00000100:00100000:1.0:1784189282.607288:0:26161:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 2544 00000100:00100000:1.0:1784189282.607314:0:26161:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf4693e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:debedd94-805c-42a0-a5e5-41758b2012e9+5:2398:x1870854436321280:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:0.0:1784189282.607352:0:66170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436321024 00000100:00100000:0.0:1784189282.607357:0:66170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436321024 00000100:00100000:0.0:1784189282.607382:0:66170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436321152 00000100:00100000:0.0:1784189282.607384:0:66170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436321152 00000100:00100000:0.0:1784189282.607413:0:66170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1287 00000100:00100000:0.0:1784189282.607420:0:66170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf4693fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:debedd94-805c-42a0-a5e5-41758b2012e9+9:2398:x1870854436321152:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:1.0:1784189282.607443:0:26161:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf4693e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:debedd94-805c-42a0-a5e5-41758b2012e9+5:2398:x1870854436321280:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 144us (354us total) trans 0 rc 0/0 00000100:00100000:0.0:1784189282.607450:0:66170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf4693fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:debedd94-805c-42a0-a5e5-41758b2012e9+9:2398:x1870854436321152:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 32us (336us total) trans 0 rc 0/0 00000100:00100000:0.0:1784189282.607457:0:66170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1287 00000100:00100000:2.0:1784189282.607512:0:66945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1402 00000100:00100000:2.0:1784189282.607519:0:66945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf4693c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2395:x1870854436321024:12345-192.168.203.12@tcp:38:kworker.0 00010000:00020000:2.0:1784189282.607542:0:66945:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.203.12@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1784189282.607573:0:66945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf4693c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2395:x1870854436321024:12345-192.168.203.12@tcp:38:kworker.0 Request processed in 53us (568us total) trans 0 rc -19/-19 00000100:00100000:2.0:1784189282.607579:0:66945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1402 00000100:00080000:2.0:1784189282.607606:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1784189282.607612:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1784189282.607614:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1784189282.608542:0:26160:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 2545 00000100:00100000:3.0:1784189282.608556:0:26160:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf4693f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:debedd94-805c-42a0-a5e5-41758b2012e9+5:2398:x1870854436321408:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:3.0:1784189282.608619:0:26160:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf4693f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:debedd94-805c-42a0-a5e5-41758b2012e9+5:2398:x1870854436321408:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 69us (1481us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189282.608626:0:26160:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 2545 00000100:00100000:1.0:1784189282.610432:0:26161:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 2544 00010000:00010000:1.0:1784189283.055984:0:26173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784189284.079593:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784189284.399733:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1784189284.399758:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc06b98e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1870854458211456:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1784189284.399896:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784189284.400065:0:9466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458211456 00000100:00100000:1.0:1784189284.400077:0:9466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458211456 00000100:00100000:1.0:1784189284.400360:0:9466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2036 00000100:00100000:1.0:1784189284.400372:0:9466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf4693ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1870854458211456:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1784189284.400412:0:9466:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8647872 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1784189284.400479:0:9466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf4693ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1870854458211456:12345-0@lo:13:osp-pre-1-1.0 Request processed in 110us (583us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189284.400487:0:9466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2036 00000100:00080000:3.0:1784189284.400570:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1784189284.400594:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc06b98e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1870854458211456:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1784189284.401310:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1784189284.401354:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf43f58e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1870854458211584:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1784189284.401412:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784189284.401537:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458211584 00000100:00100000:1.0:1784189284.401544:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458211584 00000100:00100000:1.0:1784189284.401612:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2037 00000100:00100000:1.0:1784189284.401621:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc05f02ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1870854458211584:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1784189284.401648:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8647872 pending 0 free 3922481152 avail 3690958848 00000100:00100000:1.0:1784189284.401692:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc05f02ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1870854458211584:12345-0@lo:13:osp-pre-0-1.0 Request processed in 73us (280us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189284.401699:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2037 00000100:00080000:2.0:1784189284.401943:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1784189284.401979:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf43f58e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1870854458211584:0@lo:13:osp-pre-0-1.0 00010000:00010000:1.0:1784189285.103655:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1784189285.425081:0:93049:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1784189285.425090:0:93049:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1784189285.425095:0:93049:0:(import.c:65:import_set_state_nolock()) ffff9dbf42271800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1784189285.425104:0:93049:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3522 00000100:00080000:3.0:1784189285.425112:0:93049:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1784189285.425130:0:93049:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9dbf42271800 using connection 192.168.203.112@tcp/0@lo 00000100:00100000:3.0:1784189285.425157:0:93049:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9dbf4693f800 x1870854458211840/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1784189285.425468:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf4693df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:bd553d0d-03e2-4233-b06b-b55bbfa2b954:3643:1870854458211712:0@lo:400:kworker.0 00000400:00000100:2.0:1784189285.425541:0:3643:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1870854458211712 offset 0 length 224: 4 00000100:00080000:3.0:1784189285.425915:0:93049:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1784189285.425920:0:93049:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1784189285.425922:0:93049:0:(import.c:65:import_set_state_nolock()) ffff9dbf425f4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1784189285.425926:0:93049:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3522 00000100:00080000:3.0:1784189285.425930:0:93049:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1784189285.425935:0:93049:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9dbf425f4800 using connection 192.168.203.112@tcp/0@lo 00000100:00100000:3.0:1784189285.425951:0:93049:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9dbf4693c380 x1870854458212096/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1784189285.425968:0:93049:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1784189285.425971:0:93049:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1784189285.425973:0:93049:0:(import.c:65:import_set_state_nolock()) ffff9dbf436c4000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1784189285.425978:0:93049:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3522 00000100:00080000:3.0:1784189285.425980:0:93049:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1784189285.425985:0:93049:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9dbf436c4000 using connection 192.168.203.112@tcp/0@lo 00000100:00100000:3.0:1784189285.426000:0:93049:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9dbf4693d180 x1870854458212352/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1784189285.426062:0:93049:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1784189285.426066:0:93049:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1784189285.426068:0:93049:0:(import.c:65:import_set_state_nolock()) ffff9dbf43690800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1784189285.426072:0:93049:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3522 00000100:00080000:3.0:1784189285.426075:0:93049:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1784189285.426079:0:93049:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff9dbf43690800 using connection 192.168.203.112@tcp/0@lo 00000100:00100000:3.0:1784189285.426091:0:93049:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9dc07fb36a00 x1870854458212736/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1784189285.426256:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf4693c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3641:1870854458212224:0@lo:400:kworker.0 00000100:00100000:1.0:1784189285.426515:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784189285.426525:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf4693f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3639:1870854458211840:0@lo:38:kworker.0 00000100:00100000:1.0:1784189285.426553:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1784189285.426562:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf4693dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3641:1870854458211968:0@lo:400:kworker.0 00000100:00100000:2.0:1784189285.426570:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784189285.426603:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf4693c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3639:1870854458212096:0@lo:38:kworker.0 00000100:00100000:1.0:1784189285.426603:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784189285.426637:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784189285.426640:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc05ed79880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1870854458212480:0@lo:400:kworker.0 00000100:00100000:2.0:1784189285.426661:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf4693d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3639:1870854458212352:0@lo:38:kworker.0 00000100:00100000:1.0:1784189285.426680:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784189285.426709:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784189285.426723:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458212480 00000100:00100000:1.0:1784189285.426733:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458212480 00000100:00100000:2.0:1784189285.426747:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc07fb36a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3639:1870854458212736:0@lo:38:kworker.0 00000100:00100000:2.0:1784189285.426777:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784189285.426795:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2546 00000100:00100000:1.0:1784189285.426807:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc06b98f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3642:x1870854458212480:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784189285.426816:0:66945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458212224 00000100:00100000:2.0:1784189285.426822:0:66945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458212224 00000100:00100000:2.0:1784189285.426866:0:66945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458211840 00000100:00100000:2.0:1784189285.426870:0:66945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458211840 00000100:00100000:2.0:1784189285.426883:0:66945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458211968 00000100:00100000:1.0:1784189285.426885:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc06b98f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3642:x1870854458212480:12345-0@lo:400:kworker.0 Request processed in 78us (202us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189285.426887:0:66945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458211968 00000100:00100000:1.0:1784189285.426899:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2546 00000100:00100000:2.0:1784189285.426906:0:66945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458212096 00000100:00100000:2.0:1784189285.426911:0:66945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458212096 00000100:00100000:2.0:1784189285.426923:0:66945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458212736 00000100:00100000:2.0:1784189285.426926:0:66945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458212736 00000100:00100000:2.0:1784189285.426940:0:66945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1288 00000100:00100000:2.0:1784189285.426947:0:66945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc06b98d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1870854458212224:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784189285.426961:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc05ed79880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1870854458212480:0@lo:400:kworker.0 00000100:00100000:2.0:1784189285.426993:0:66945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc06b98d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1870854458212224:12345-0@lo:400:kworker.0 Request processed in 44us (477us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189285.427001:0:66945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1288 00000100:00100000:1.0:1784189285.427007:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf4693c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3641:1870854458212224:0@lo:400:kworker.0 00000100:00100000:2.0:1784189285.427021:0:66945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1289 00000100:00100000:2.0:1784189285.427030:0:66945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc06b98d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1870854458211968:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784189285.427057:0:23826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458212352 00000100:00100000:1.0:1784189285.427062:0:23826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458212352 00000100:00100000:2.0:1784189285.427068:0:66945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc06b98d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1870854458211968:12345-0@lo:400:kworker.0 Request processed in 39us (468us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189285.427076:0:66945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1289 00000100:00100000:1.0:1784189285.427089:0:23826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3914 00000100:00100000:2.0:1784189285.427096:0:66945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1403 00000100:00100000:1.0:1784189285.427098:0:23826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc07cb4d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3639:x1870854458212352:12345-0@lo:38:kworker.0 00000100:00100000:2.0:1784189285.427105:0:66945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc0762d6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3639:x1870854458211840:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1784189285.427130:0:66945:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1784189285.427164:0:66945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc0762d6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3639:x1870854458211840:12345-0@lo:38:kworker.0 Request processed in 60us (595us total) trans 0 rc -19/-19 00000100:00100000:2.0:1784189285.427171:0:66945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1403 00000100:00100000:0.0:1784189285.427195:0:66170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1404 00000100:00100000:2.0:1784189285.427206:0:66945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1405 00000100:00100000:0.0:1784189285.427207:0:66170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc0762d4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3639:x1870854458212096:12345-0@lo:38:kworker.0 00000100:00100000:2.0:1784189285.427218:0:66945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc07b7e1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3639:x1870854458212736:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1784189285.427221:0:66170:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00010000:00020000:2.0:1784189285.427234:0:66945:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1784189285.427259:0:66170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc0762d4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3639:x1870854458212096:12345-0@lo:38:kworker.0 Request processed in 55us (621us total) trans 0 rc -19/-19 00000100:00100000:2.0:1784189285.427274:0:66945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc07b7e1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3639:x1870854458212736:12345-0@lo:38:kworker.0 Request processed in 57us (496us total) trans 0 rc -19/-19 00000100:00100000:0.0:1784189285.427345:0:66170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1404 00000100:00100000:2.0:1784189285.427353:0:66945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1405 00000100:00100000:0.0:1784189285.427550:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf4693dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3641:1870854458211968:0@lo:400:kworker.0 00000100:00080000:2.0:1784189285.427575:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1784189285.427605:0:3639:0:(import.c:65:import_set_state_nolock()) ffff9dbf42271800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1784189285.427611:0:3639:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1784189285.427614:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf4693f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3639:1870854458211840:0@lo:38:kworker.0 00000100:00080000:2.0:1784189285.427623:0:3639:0:(import.c:65:import_set_state_nolock()) ffff9dbf425f4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1784189285.427626:0:3639:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1784189285.427629:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf4693c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3639:1870854458212096:0@lo:38:kworker.0 00000100:00080000:2.0:1784189285.427635:0:3639:0:(import.c:65:import_set_state_nolock()) ffff9dbf43690800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1784189285.427638:0:3639:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1784189285.427641:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc07fb36a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3639:1870854458212736:0@lo:38:kworker.0 00000100:00100000:3.0:1784189285.428264:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc07fb35880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1870854458212608:0@lo:400:kworker.0 00000100:00100000:3.0:1784189285.428611:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784189285.428874:0:26162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458212608 00000100:00100000:0.0:1784189285.428881:0:26162:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458212608 00000100:00100000:0.0:1784189285.428939:0:26162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2547 00000100:00100000:0.0:1784189285.428948:0:26162:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc07fb37100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:3643:x1870854458212608:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784189285.429027:0:26162:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc07fb37100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:3643:x1870854458212608:12345-0@lo:400:kworker.0 Request processed in 80us (415us total) trans 0 rc 0/0 00000100:00100000:0.0:1784189285.429035:0:26162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2547 00000100:00100000:3.0:1784189285.429639:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc07fb35880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1870854458212608:0@lo:400:kworker.0 00010000:00020000:1.0:1784189285.430082:0:23826:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1784189285.431676:0:23826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc07cb4d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3639:x1870854458212352:12345-0@lo:38:kworker.0 Request processed in 4567us (4956us total) trans 0 rc -19/-19 00000100:00100000:1.0:1784189285.431695:0:23826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3914 00000100:00080000:2.0:1784189285.431777:0:3639:0:(import.c:65:import_set_state_nolock()) ffff9dbf436c4000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1784189285.431784:0:3639:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1784189285.431790:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf4693d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3639:1870854458212352:0@lo:38:kworker.0 00010000:00010000:1.0:1784189286.132573:0:7454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784189287.160388:0:26173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784189287.719688:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000400:00000100:3.0:1784189287.719730:0:3633:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-192.168.203.12@tcp portal 26 match 1870854436321536 offset 0 length 224: 4 00000100:00100000:3.0:1784189287.719750:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1784189287.719772:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1784189287.719797:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1784189287.719825:0:26171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436322048 00000100:00100000:3.0:1784189287.719834:0:26171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436322048 00000100:00100000:3.0:1784189287.719888:0:26171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436321920 00000100:00100000:3.0:1784189287.719892:0:26171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436321920 00000100:00100000:3.0:1784189287.719933:0:26171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 2548 00000100:00100000:3.0:1784189287.719944:0:26171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc07fb35500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:debedd94-805c-42a0-a5e5-41758b2012e9+5:2397:x1870854436322048:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:3.0:1784189287.720016:0:26171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc07fb35500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:debedd94-805c-42a0-a5e5-41758b2012e9+5:2397:x1870854436322048:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 73us (262us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189287.720036:0:26171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 2548 00000100:00100000:3.0:1784189287.720054:0:26171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 4988 00000100:00100000:3.0:1784189287.720061:0:26171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc07fb35180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:debedd94-805c-42a0-a5e5-41758b2012e9+5:2395:x1870854436321920:12345-192.168.203.12@tcp:9:kworker.0 00000020:00000080:3.0:1784189287.720079:0:26171:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xcc1762b626f8bedc 00000100:00080000:3.0:1784189287.720087:0:26171:0:(import.c:65:import_set_state_nolock()) ffff9dbf45128800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1784189287.720131:0:26171:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294968955 00000100:00100000:3.0:1784189287.720253:0:26171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc07fb35180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:debedd94-805c-42a0-a5e5-41758b2012e9+2:2395:x1870854436321920:12345-192.168.203.12@tcp:9:kworker.0 Request processed in 192us (455us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189287.720275:0:26171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 4988 00000100:00100000:3.0:1784189287.720296:0:66171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436321792 00000100:00100000:3.0:1784189287.720299:0:66171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436321792 00000100:00100000:3.0:1784189287.720558:0:66171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436321664 00000100:00100000:3.0:1784189287.720563:0:66171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436321664 00000100:00100000:2.0:1784189287.728469:0:66170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1290 00000100:00100000:2.0:1784189287.728487:0:66170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc07fb35880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:debedd94-805c-42a0-a5e5-41758b2012e9+9:2397:x1870854436321792:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:2.0:1784189287.728558:0:66170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc07fb35880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:debedd94-805c-42a0-a5e5-41758b2012e9+9:2397:x1870854436321792:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 78us (8881us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189287.728566:0:66170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1290 00000100:00100000:2.0:1784189287.728599:0:66170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1406 00000100:00100000:2.0:1784189287.728604:0:66170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc07fb35c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2395:x1870854436321664:12345-192.168.203.12@tcp:38:kworker.0 00010000:00020000:2.0:1784189287.728624:0:66170:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.203.12@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1784189287.728647:0:66170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc07fb35c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2395:x1870854436321664:12345-192.168.203.12@tcp:38:kworker.0 Request processed in 42us (8874us total) trans 0 rc -19/-19 00000100:00100000:2.0:1784189287.728652:0:66170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1406 00000100:00080000:2.0:1784189287.728717:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1784189287.728722:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1784189287.728724:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1784189287.728740:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784189288.181224:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784189289.201577:0:7454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784189289.520458:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc07b7e2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1870854458212864:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1784189289.520485:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf43f58000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1870854458212992:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1784189289.528720:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784189289.530279:0:9466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458212992 00000100:00100000:1.0:1784189289.530293:0:9466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458212992 00000100:00100000:1.0:1784189289.530387:0:9466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2038 00000100:00100000:1.0:1784189289.530398:0:9466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf43f58a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1870854458212992:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1784189289.530427:0:9466:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 210112 pending 0 free 3922481152 avail 3690958848 00000100:00100000:1.0:1784189289.530492:0:9466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf43f58a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1870854458212992:12345-0@lo:13:osp-pre-0-1.0 Request processed in 96us (1778us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189289.530499:0:9466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2038 00000100:00080000:2.0:1784189289.530615:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1784189289.530649:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784189289.531069:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458212864 00000100:00100000:2.0:1784189289.531074:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458212864 00000100:00100000:2.0:1784189289.531122:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2039 00000100:00100000:2.0:1784189289.531130:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc07fb36d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1870854458212864:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1784189289.531156:0:8432:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8647872 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1784189289.531195:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc07fb36d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1870854458212864:12345-0@lo:13:osp-pre-1-1.0 Request processed in 67us (547us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189289.531201:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2039 00000100:00100000:2.0:1784189289.531242:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc07b7e2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1870854458212864:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1784189289.531561:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf43f58000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1870854458212992:0@lo:13:osp-pre-0-1.0 00000100:00080000:3.0:1784189289.531996:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1784189290.226268:0:26173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1784189290.546843:0:63468:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1784189290.546850:0:63468:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1784189290.546853:0:63468:0:(import.c:65:import_set_state_nolock()) ffff9dbf42271800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1784189290.546861:0:63468:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3527 00000100:00080000:2.0:1784189290.546867:0:63468:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 15s 00000100:00080000:2.0:1784189290.546882:0:63468:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9dbf42271800 using connection 192.168.203.112@tcp/0@lo 00000100:00100000:2.0:1784189290.546904:0:63468:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9dc07b7e2680 x1870854458213248/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1784189290.546926:0:63468:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1784189290.546929:0:63468:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1784189290.546931:0:63468:0:(import.c:65:import_set_state_nolock()) ffff9dbf425f4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1784189290.546945:0:63468:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3527 00000100:00080000:2.0:1784189290.546948:0:63468:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 15s 00000100:00080000:2.0:1784189290.546952:0:63468:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9dbf425f4800 using connection 192.168.203.112@tcp/0@lo 00000100:00100000:2.0:1784189290.546961:0:63468:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9dc07b7e3b80 x1870854458213504/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1784189290.546987:0:63468:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1784189290.546990:0:63468:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1784189290.546992:0:63468:0:(import.c:65:import_set_state_nolock()) ffff9dbf436c4000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1784189290.546995:0:63468:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3527 00000100:00080000:2.0:1784189290.546998:0:63468:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 15s 00000100:00080000:2.0:1784189290.547001:0:63468:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9dbf436c4000 using connection 192.168.203.112@tcp/0@lo 00000100:00100000:2.0:1784189290.547012:0:63468:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9dc07b7e1880 x1870854458213760/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1784189290.547031:0:63468:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1784189290.547034:0:63468:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1784189290.547035:0:63468:0:(import.c:65:import_set_state_nolock()) ffff9dbf43690800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1784189290.547038:0:63468:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3527 00000100:00080000:2.0:1784189290.547040:0:63468:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 15s 00000100:00080000:2.0:1784189290.547049:0:63468:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff9dbf43690800 using connection 192.168.203.112@tcp/0@lo 00000100:00100000:2.0:1784189290.547060:0:63468:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9dc07016c700 x1870854458214144/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1784189290.547087:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc07b7e2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3639:1870854458213248:0@lo:38:kworker.0 00000100:00100000:2.0:1784189290.547149:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784189290.547179:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc07b7e3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3639:1870854458213504:0@lo:38:kworker.0 00000100:00100000:2.0:1784189290.547201:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784189290.547216:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc07b7e1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3639:1870854458213760:0@lo:38:kworker.0 00000100:00100000:2.0:1784189290.547288:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784189290.547307:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc07016c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3639:1870854458214144:0@lo:38:kworker.0 00000100:00100000:2.0:1784189290.547351:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784189290.547387:0:68287:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458213248 00000100:00100000:2.0:1784189290.547394:0:68287:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458213248 00000100:00100000:3.0:1784189290.547690:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc07b7e2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bd553d0d-03e2-4233-b06b-b55bbfa2b954:3642:1870854458213120:0@lo:400:kworker.0 00000400:00000100:3.0:1784189290.547715:0:3642:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1870854458213120 offset 0 length 224: 4 00000100:00100000:3.0:1784189290.547735:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc07016ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1870854458214016:0@lo:400:kworker.0 00000100:00100000:3.0:1784189290.547756:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784189290.547774:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1784189290.547779:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc07b7e1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3642:1870854458213376:0@lo:400:kworker.0 00000100:00100000:3.0:1784189290.547798:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784189290.547825:0:66171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458213504 00000100:00100000:3.0:1784189290.547836:0:66171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458213504 00000100:00100000:3.0:1784189290.547851:0:66171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458214144 00000100:00100000:3.0:1784189290.547853:0:66171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458214144 00000100:00100000:3.0:1784189290.547861:0:66171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458213376 00000100:00100000:3.0:1784189290.547863:0:66171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458213376 00000100:00100000:3.0:1784189290.547896:0:66171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1291 00000100:00100000:3.0:1784189290.547906:0:66171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc07fb34e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1870854458213376:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784189290.547967:0:66171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc07fb34e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1870854458213376:12345-0@lo:400:kworker.0 Request processed in 63us (167us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189290.547975:0:66171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1291 00000100:00100000:3.0:1784189290.547993:0:66171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1407 00000100:00100000:3.0:1784189290.547997:0:66171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc07016ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3639:x1870854458213248:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1784189290.548015:0:66171:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1784189290.548044:0:66171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc07016ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3639:x1870854458213248:12345-0@lo:38:kworker.0 Request processed in 46us (895us total) trans 0 rc -19/-19 00000100:00100000:3.0:1784189290.548050:0:66171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1407 00000100:00100000:3.0:1784189290.548065:0:66171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1408 00000100:00100000:3.0:1784189290.548069:0:66171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc07016d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3639:x1870854458213504:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1784189290.548077:0:66171:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1784189290.548100:0:66171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc07016d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3639:x1870854458213504:12345-0@lo:38:kworker.0 Request processed in 29us (898us total) trans 0 rc -19/-19 00000100:00100000:3.0:1784189290.548105:0:66171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1408 00000100:00100000:3.0:1784189290.548117:0:66171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1409 00000100:00100000:3.0:1784189290.548121:0:66171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc080e7c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3639:x1870854458214144:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1784189290.548129:0:66171:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1784189290.548150:0:66171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc080e7c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3639:x1870854458214144:12345-0@lo:38:kworker.0 Request processed in 28us (799us total) trans 0 rc -19/-19 00000100:00100000:3.0:1784189290.548162:0:66171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1409 00000100:00100000:3.0:1784189290.548181:0:26170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458214016 00000100:00100000:3.0:1784189290.548185:0:26170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458214016 00000100:00100000:3.0:1784189290.548207:0:26170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2549 00000100:00100000:3.0:1784189290.548212:0:26170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc07fb34a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0001-mdtlov_UUID+5:3642:x1870854458214016:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784189290.548253:0:26170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc07fb34a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0001-mdtlov_UUID+5:3642:x1870854458214016:12345-0@lo:400:kworker.0 Request processed in 40us (496us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189290.548261:0:26170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2549 00000100:00080000:3.0:1784189290.548279:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1784189290.548305:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc07b7e1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3642:1870854458213376:0@lo:400:kworker.0 00000100:00100000:3.0:1784189290.548315:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc07016ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1870854458214016:0@lo:400:kworker.0 00000100:00080000:3.0:1784189290.548383:0:3639:0:(import.c:65:import_set_state_nolock()) ffff9dbf42271800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1784189290.548388:0:3639:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1784189290.548391:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc07b7e2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3639:1870854458213248:0@lo:38:kworker.0 00000100:00080000:3.0:1784189290.548398:0:3639:0:(import.c:65:import_set_state_nolock()) ffff9dbf425f4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1784189290.548401:0:3639:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1784189290.548403:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc07b7e3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3639:1870854458213504:0@lo:38:kworker.0 00000100:00080000:3.0:1784189290.548409:0:3639:0:(import.c:65:import_set_state_nolock()) ffff9dbf43690800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1784189290.548412:0:3639:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1784189290.548415:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc07016c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3639:1870854458214144:0@lo:38:kworker.0 00000100:00100000:2.0:1784189290.548671:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458213760 00000100:00100000:2.0:1784189290.548676:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458213760 00000100:00100000:2.0:1784189290.548700:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3915 00000100:00100000:2.0:1784189290.548705:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc07016df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3639:x1870854458213760:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1784189290.548715:0:8438:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1784189290.548747:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc07016df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3639:x1870854458213760:12345-0@lo:38:kworker.0 Request processed in 41us (1458us total) trans 0 rc -19/-19 00000100:00100000:2.0:1784189290.548753:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3915 00000100:00100000:2.0:1784189290.548778:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc07b7e3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3640:1870854458213632:0@lo:400:kworker.0 00000100:00100000:2.0:1784189290.548803:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784189290.548823:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1784189290.548828:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc07016ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1870854458213888:0@lo:400:kworker.0 00000100:00100000:2.0:1784189290.548862:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784189290.549452:0:66171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458213632 00000100:00100000:3.0:1784189290.549458:0:66171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458213632 00000100:00100000:3.0:1784189290.549512:0:66171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1292 00000100:00100000:3.0:1784189290.549520:0:66171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc080e7f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1870854458213632:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784189290.549569:0:66171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc080e7f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1870854458213632:12345-0@lo:400:kworker.0 Request processed in 51us (765us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189290.549576:0:66171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1292 00000100:00100000:3.0:1784189290.549619:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc07b7e3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3640:1870854458213632:0@lo:400:kworker.0 00000100:00080000:3.0:1784189290.549653:0:3639:0:(import.c:65:import_set_state_nolock()) ffff9dbf436c4000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1784189290.549657:0:3639:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1784189290.549661:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc07b7e1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3639:1870854458213760:0@lo:38:kworker.0 00000100:00100000:0.0:1784189290.550037:0:26163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458213888 00000100:00100000:0.0:1784189290.550043:0:26163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458213888 00000100:00080000:2.0:1784189290.550072:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1784189290.550080:0:26163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2550 00000100:00100000:0.0:1784189290.550089:0:26163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc080e7c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:3640:x1870854458213888:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784189290.550470:0:26163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc080e7c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:3640:x1870854458213888:12345-0@lo:400:kworker.0 Request processed in 381us (1606us total) trans 0 rc 0/0 00000100:00100000:0.0:1784189290.550478:0:26163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2550 00000100:00100000:2.0:1784189290.558582:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc07016ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1870854458213888:0@lo:400:kworker.0 00010000:00010000:3.0:1784189291.249309:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00000400:3.0:1784189291.571871:0:3640:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1784189275/real 1784189275] req@ffff9dbf4262ea00 x1870854458208384/t0(0) o400->MGC192.168.203.112@tcp@0@lo:26/25 lens 224/224 e 0 to 1 dl 1784189291 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784189291.571899:0:3640:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ TIMEOUT-NORESEND: req@ffff9dbf4262ea00 x1870854458208384/t0(0) o400->MGC192.168.203.112@tcp@0@lo:26/25 lens 224/224 e 0 to 1 dl 1784189291 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1784189291.571908:0:3640:0:(import.c:65:import_set_state_nolock()) ffff9dc07110c800 MGS: changing import state from FULL to DISCONN 00000100:02020000:3.0:1784189291.571912:0:3640:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.203.112@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00000100:00080000:3.0:1784189291.571915:0:3640:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.203.112@tcp not replayable, auto-deactivating 00000100:00080000:3.0:1784189291.571918:0:3640:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:3.0:1784189291.571922:0:3640:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9dbf4262ea00 x1870854458208384/t0(0) o400->MGC192.168.203.112@tcp@0@lo:26/25 lens 224/224 e 0 to 1 dl 1784189291 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784189291.571930:0:3640:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9dc07b5b3b80 x1870854458210304/t0(0) o400->MGC192.168.203.112@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1784189296 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784189291.571939:0:3640:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9dbf4693df80 x1870854458211712/t0(0) o400->MGC192.168.203.112@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1784189301 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784189291.571953:0:3640:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9dc07b7e2300 x1870854458213120/t0(0) o400->MGC192.168.203.112@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1784189306 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 10000000:01000000:3.0:1784189291.571962:0:3640:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:3.0:1784189291.571971:0:3640:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:3.0:1784189291.571973:0:3640:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:3.0:1784189291.571975:0:3640:0:(import.c:418:ptlrpc_pinger_force()) MGS: waking up pinger s:DISCONN 00000100:00100000:3.0:1784189291.572004:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc07b5b3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bd553d0d-03e2-4233-b06b-b55bbfa2b954:3640:1870854458210304:0@lo:400:kworker.0 00000100:00100000:3.0:1784189291.572011:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf4262ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bd553d0d-03e2-4233-b06b-b55bbfa2b954:3640:1870854458208384:0@lo:400:kworker.0 00000100:00100000:3.0:1784189291.572053:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc07b7e2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bd553d0d-03e2-4233-b06b-b55bbfa2b954:3642:1870854458213120:0@lo:400:kworker.0 00000100:00100000:3.0:1784189291.572086:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf4693df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:bd553d0d-03e2-4233-b06b-b55bbfa2b954:3643:1870854458211712:0@lo:400:kworker.0 00000100:00080000:3.0:1784189291.572105:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) bd553d0d-03e2-4233-b06b-b55bbfa2b954->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1784189291.572109:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1784189291.572112:0:36:0:(import.c:65:import_set_state_nolock()) ffff9dc07110c800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1784189291.572116:0:36:0:(import.c:510:import_select_connection()) MGC192.168.203.112@tcp: connect to NID 0@lo last attempt 3486 00000100:00080000:3.0:1784189291.572124:0:36:0:(import.c:624:import_select_connection()) MGC192.168.203.112@tcp: import ffff9dc07110c800 using connection 192.168.203.112@tcp/0@lo 00000100:00100000:3.0:1784189291.572149:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9dc07fb37800 x1870854458214272/t0(0) o250->MGC192.168.203.112@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1784189291.572167:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1784189291.572171:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1784189291.572173:0:36:0:(import.c:65:import_set_state_nolock()) ffff9dbf42271800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1784189291.572176:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3532 00000100:00080000:3.0:1784189291.572179:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1784189291.572183:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9dbf42271800 using connection 192.168.203.112@tcp/0@lo 00000100:00100000:3.0:1784189291.572197:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9dc07fb37b80 x1870854458214400/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1784189291.572217:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1784189291.572221:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1784189291.572252:0:36:0:(import.c:65:import_set_state_nolock()) ffff9dbf425f4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1784189291.572257:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3532 00000100:00080000:3.0:1784189291.572259:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1784189291.572264:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9dbf425f4800 using connection 192.168.203.112@tcp/0@lo 00000100:00100000:3.0:1784189291.572277:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9dc07fb36680 x1870854458214656/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1784189291.572303:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1784189291.572306:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1784189291.572308:0:36:0:(import.c:65:import_set_state_nolock()) ffff9dbf436c4000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1784189291.572311:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3532 00000100:00080000:3.0:1784189291.572314:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1784189291.572346:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9dbf436c4000 using connection 192.168.203.112@tcp/0@lo 00000100:00100000:3.0:1784189291.572359:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9dc07fb34700 x1870854458214912/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1784189291.572378:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1784189291.572381:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1784189291.572382:0:36:0:(import.c:65:import_set_state_nolock()) ffff9dbf43690800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1784189291.572385:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3532 00000100:00080000:3.0:1784189291.572387:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1784189291.572390:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff9dbf43690800 using connection 192.168.203.112@tcp/0@lo 00000100:00100000:3.0:1784189291.572400:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9dc07fb36a00 x1870854458215296/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1784189291.572424:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc07fb37800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:bd553d0d-03e2-4233-b06b-b55bbfa2b954:3639:1870854458214272:0@lo:250:kworker.0 00000400:00000100:3.0:1784189291.572464:0:3639:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1870854458214272 offset 0 length 520: 4 00000100:00100000:3.0:1784189291.572501:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc07fb37b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3639:1870854458214400:0@lo:38:kworker.0 00000100:00100000:3.0:1784189291.572534:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784189291.572554:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc07fb36680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3639:1870854458214656:0@lo:38:kworker.0 00000100:00100000:3.0:1784189291.572575:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784189291.572589:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc07fb34700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3639:1870854458214912:0@lo:38:kworker.0 00000100:00100000:3.0:1784189291.572611:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784189291.572627:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc07fb36a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3639:1870854458215296:0@lo:38:kworker.0 00000100:00100000:3.0:1784189291.572661:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784189291.572691:0:68287:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458214400 00000100:00100000:3.0:1784189291.572698:0:68287:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458214400 00000100:00100000:3.0:1784189291.572724:0:68287:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458214656 00000100:00100000:3.0:1784189291.572728:0:68287:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458214656 00000100:00100000:3.0:1784189291.572740:0:68287:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458215296 00000100:00100000:3.0:1784189291.572742:0:68287:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458215296 00000100:00100000:3.0:1784189291.572755:0:68287:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1410 00000100:00100000:3.0:1784189291.572762:0:68287:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc07016ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3639:x1870854458214400:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1784189291.572780:0:68287:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1784189291.572815:0:68287:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc07016ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3639:x1870854458214400:12345-0@lo:38:kworker.0 Request processed in 52us (280us total) trans 0 rc -19/-19 00000100:00100000:3.0:1784189291.572823:0:68287:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1410 00000100:00100000:3.0:1784189291.572838:0:68287:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1411 00000100:00100000:3.0:1784189291.572842:0:68287:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc07016c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3639:x1870854458214656:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1784189291.572852:0:68287:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1784189291.572873:0:68287:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc07016c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3639:x1870854458214656:12345-0@lo:38:kworker.0 Request processed in 30us (298us total) trans 0 rc -19/-19 00000100:00100000:3.0:1784189291.572879:0:68287:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1411 00000100:00100000:3.0:1784189291.572899:0:68287:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1412 00000100:00100000:3.0:1784189291.572903:0:68287:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc07b7e2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3639:x1870854458215296:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1784189291.572913:0:68287:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1784189291.572935:0:68287:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc07b7e2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3639:x1870854458215296:12345-0@lo:38:kworker.0 Request processed in 30us (273us total) trans 0 rc -19/-19 00000100:00100000:3.0:1784189291.572941:0:68287:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1412 00000100:00100000:3.0:1784189291.572970:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc07fb34000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3643:1870854458214528:0@lo:400:kworker.0 00000100:00100000:3.0:1784189291.572994:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784189291.573009:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1784189291.573015:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc07fb34380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1870854458215168:0@lo:400:kworker.0 00000100:00100000:3.0:1784189291.573035:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784189291.573060:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc07fb36300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3640:1870854458214784:0@lo:400:kworker.0 00000100:00100000:3.0:1784189291.573082:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784189291.573098:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1784189291.573103:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc07fb35f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1870854458215040:0@lo:400:kworker.0 00000100:00100000:3.0:1784189291.573122:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784189291.573146:0:26164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458215168 00000100:00100000:3.0:1784189291.573150:0:26164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458215168 00000100:00100000:3.0:1784189291.573185:0:26164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458215040 00000100:00100000:3.0:1784189291.573188:0:26164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458215040 00000100:00100000:3.0:1784189291.573215:0:26164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2551 00000100:00100000:3.0:1784189291.573222:0:26164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc07b7e3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0001-mdtlov_UUID+5:3643:x1870854458215168:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784189291.573446:0:26164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc07b7e3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0001-mdtlov_UUID+5:3643:x1870854458215168:12345-0@lo:400:kworker.0 Request processed in 224us (409us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189291.573453:0:26164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2551 00000100:00100000:3.0:1784189291.573466:0:26164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2552 00000100:00100000:3.0:1784189291.573480:0:26164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc07b7e2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0001-mdtlov_UUID+5:3640:x1870854458215040:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784189291.573514:0:26164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc07b7e2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0001-mdtlov_UUID+5:3640:x1870854458215040:12345-0@lo:400:kworker.0 Request processed in 35us (391us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189291.573520:0:26164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2552 00000100:00080000:3.0:1784189291.573535:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1784189291.573539:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1784189291.573552:0:66170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458214528 00000100:00100000:3.0:1784189291.573555:0:66170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458214528 00000100:00100000:3.0:1784189291.573578:0:66170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458214784 00000100:00100000:3.0:1784189291.573581:0:66170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458214784 00000100:00100000:3.0:1784189291.573596:0:66170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1293 00000100:00100000:3.0:1784189291.573602:0:66170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc07b7e1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1870854458214528:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784189291.573697:0:66170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc07b7e1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1870854458214528:12345-0@lo:400:kworker.0 Request processed in 94us (701us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189291.573703:0:66170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1293 00000100:00100000:3.0:1784189291.573715:0:66170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1294 00000100:00100000:3.0:1784189291.573722:0:66170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc07b7e3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1870854458214784:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784189291.573748:0:66170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc07b7e3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1870854458214784:12345-0@lo:400:kworker.0 Request processed in 27us (666us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189291.573754:0:66170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1294 00000100:00100000:3.0:1784189291.573789:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc07fb34380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1870854458215168:0@lo:400:kworker.0 00000100:00100000:3.0:1784189291.573800:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc07fb34000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3643:1870854458214528:0@lo:400:kworker.0 00000100:00100000:3.0:1784189291.573824:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc07fb35f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1870854458215040:0@lo:400:kworker.0 00000100:00100000:3.0:1784189291.573832:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc07fb36300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3640:1870854458214784:0@lo:400:kworker.0 00000100:00080000:3.0:1784189291.573854:0:3639:0:(import.c:65:import_set_state_nolock()) ffff9dbf42271800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1784189291.573865:0:3639:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1784189291.573869:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc07fb37b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3639:1870854458214400:0@lo:38:kworker.0 00000100:00080000:3.0:1784189291.573880:0:3639:0:(import.c:65:import_set_state_nolock()) ffff9dbf425f4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1784189291.573883:0:3639:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1784189291.573886:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc07fb36680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3639:1870854458214656:0@lo:38:kworker.0 00000100:00080000:3.0:1784189291.573893:0:3639:0:(import.c:65:import_set_state_nolock()) ffff9dbf43690800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1784189291.573896:0:3639:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1784189291.573899:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc07fb36a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3639:1870854458215296:0@lo:38:kworker.0 00000100:00100000:0.0:1784189291.573959:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458214912 00000100:00100000:0.0:1784189291.573965:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458214912 00000100:00100000:0.0:1784189291.574002:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3916 00000100:00100000:0.0:1784189291.574009:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc07016ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3639:x1870854458214912:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1784189291.574021:0:8439:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1784189291.574059:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc07016ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3639:x1870854458214912:12345-0@lo:38:kworker.0 Request processed in 50us (1446us total) trans 0 rc -19/-19 00000100:00100000:0.0:1784189291.574066:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3916 00000100:00080000:0.0:1784189291.574099:0:3639:0:(import.c:65:import_set_state_nolock()) ffff9dbf436c4000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1784189291.574104:0:3639:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1784189291.574108:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc07fb34700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3639:1870854458214912:0@lo:38:kworker.0 00010000:00010000:1.0:1784189292.272353:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000400:00000100:3.0:1784189292.845668:0:3635:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-192.168.203.12@tcp portal 26 match 1870854436322176 offset 0 length 224: 4 00000100:00100000:3.0:1784189292.845704:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1784189292.845774:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1784189292.845828:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1784189292.848793:0:26160:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436322560 00000100:00100000:1.0:1784189292.848817:0:26160:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436322560 00000100:00100000:1.0:1784189292.848902:0:26160:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 4989 00000100:00100000:1.0:1784189292.848912:0:26160:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc07fb34700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:debedd94-805c-42a0-a5e5-41758b2012e9+5:2395:x1870854436322560:12345-192.168.203.12@tcp:9:kworker.0 00000020:00000080:1.0:1784189292.848938:0:26160:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xcc1762b626f8c438 00000100:00080000:1.0:1784189292.848946:0:26160:0:(import.c:65:import_set_state_nolock()) ffff9dc07118c800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1784189292.848980:0:26160:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294968959 00000100:00080000:2.0:1784189292.849151:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1784189292.849185:0:26160:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc07fb34700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:debedd94-805c-42a0-a5e5-41758b2012e9+2:2395:x1870854436322560:12345-192.168.203.12@tcp:9:kworker.0 Request processed in 274us (3410us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189292.849192:0:26160:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 4989 00010000:00010000:1.0:1784189292.849214:0:7454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784189292.850454:0:66945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436322304 00000100:00100000:0.0:1784189292.850475:0:66945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436322304 00000100:00100000:0.0:1784189292.850933:0:66945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436322432 00000100:00100000:0.0:1784189292.850939:0:66945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436322432 00000100:00080000:1.0:1784189292.852721:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1784189292.854042:0:66170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1295 00000100:00100000:2.0:1784189292.854066:0:66170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc07fb36a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:debedd94-805c-42a0-a5e5-41758b2012e9+9:2396:x1870854436322432:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:2.0:1784189292.854195:0:66170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc07fb36a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:debedd94-805c-42a0-a5e5-41758b2012e9+9:2396:x1870854436322432:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 141us (8365us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189292.854203:0:66170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1295 00000100:00100000:2.0:1784189292.854240:0:66170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1413 00000100:00100000:2.0:1784189292.854245:0:66170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc07b7e1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2395:x1870854436322304:12345-192.168.203.12@tcp:38:kworker.0 00010000:00020000:2.0:1784189292.854539:0:66170:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.203.12@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1784189292.854568:0:66170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc07b7e1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2395:x1870854436322304:12345-192.168.203.12@tcp:38:kworker.0 Request processed in 321us (8863us total) trans 0 rc -19/-19 00000100:00100000:2.0:1784189292.854575:0:66170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1413 00000400:00000100:0.0:1784189292.891008:0:3633:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-192.168.203.12@tcp portal 26 match 1870854436322688 offset 0 length 520: 4 00010000:00010000:1.0:1784189293.297751:0:26173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1784189293.618595:0:8423:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of debedd94-805c-42a0-a5e5-41758b2012e9 00000020:00000080:3.0:1784189293.618604:0:8423:0:(genops.c:906:class_export_put()) final put ffff9dbf45128000/debedd94-805c-42a0-a5e5-41758b2012e9 00000020:00000080:2.0:1784189293.618705:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9dbf45128000/debedd94-805c-42a0-a5e5-41758b2012e9 for lustre-OST0000 00000020:00000080:2.0:1784189293.618754:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9dbf45128800 for lustre-OST0000 00010000:00010000:3.0:1784189294.322475:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784189294.641567:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc056eadf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1870854458215424:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1784189294.641634:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784189294.641683:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458215424 00000100:00100000:2.0:1784189294.641690:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458215424 00000100:00100000:2.0:1784189294.641740:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2040 00000100:00100000:2.0:1784189294.641748:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc056eaf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1870854458215424:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1784189294.641774:0:8432:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 210112 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1784189294.641830:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc056eaf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1870854458215424:12345-0@lo:13:osp-pre-1-1.0 Request processed in 82us (195us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189294.641838:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2040 00000100:00100000:2.0:1784189294.641881:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc056eadf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1870854458215424:0@lo:13:osp-pre-1-1.0 00000100:00080000:1.0:1784189294.643653:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1784189294.643664:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1784189294.643681:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc06b98f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1870854458215552:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1784189294.643739:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784189294.643779:0:9466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458215552 00000100:00100000:1.0:1784189294.643785:0:9466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458215552 00000100:00100000:1.0:1784189294.643832:0:9466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2041 00000100:00100000:1.0:1784189294.643840:0:9466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc06b98ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1870854458215552:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1784189294.643864:0:9466:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 210112 pending 0 free 3922481152 avail 3690958848 00000100:00100000:1.0:1784189294.643899:0:9466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc06b98ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1870854458215552:12345-0@lo:13:osp-pre-0-1.0 Request processed in 60us (159us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189294.643906:0:9466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2041 00000100:00080000:1.0:1784189294.643926:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1784189294.643961:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc06b98f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1870854458215552:0@lo:13:osp-pre-0-1.0 00010000:00010000:1.0:1784189295.350307:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1784189296.132112:0:94303:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1784189296.132119:0:94303:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds1_flakey 00000020:01000004:2.0:1784189296.132121:0:94303:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:2.0:1784189296.133552:0:94303:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff9dc07a8f1800 00000020:01000004:2.0:1784189296.133574:0:94303:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0000, type=osd-ldiskfs, lsifl=200005, mountfl=0 00000020:01000004:2.0:1784189296.133590:0:94303:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-ldiskfs) 00000020:00000080:2.0:1784189296.133604:0:94303:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff9dc07547b380) 00000020:00000080:2.0:1784189296.133624:0:94303:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-ldiskfs with refcount 2 00100000:10000000:2.0:1784189296.289028:0:94303:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:2.0:1784189296.289485:0:94303:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:2.0:1784189296.291871:0:94303:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:2.0:1784189296.292198:0:94303:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/32) registered 00100000:10000000:2.0:1784189296.292573:0:94303:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:2.0:1784189296.292839:0:94303:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/32) registered 00100000:10000000:2.0:1784189296.293018:0:94303:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:2.0:1784189296.293239:0:94303:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/32) registered 00100000:10000000:2.0:1784189296.293614:0:94303:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/32) registered 00100000:10000000:2.0:1784189296.293836:0:94303:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:2.0:1784189296.294058:0:94303:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:2.0:1784189296.294266:0:94303:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/32) registered 00100000:10000000:3.0:1784189296.294765:0:94303:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:3.0:1784189296.294950:0:94303:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x9:0x0] (8/32) registered 00100000:10000000:3.0:1784189296.296993:0:94303:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2f:0x0] (24/16) registered 00100000:10000000:3.0:1784189296.297229:0:94303:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:3.0:1784189296.297510:0:94303:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:3.0:1784189296.297728:0:94303:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1e:0x0] (16/1) registered 00100000:10000000:3.0:1784189296.297991:0:94303:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:3.0:1784189296.298449:0:94303:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:3.0:1784189296.298785:0:94303:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:3.0:1784189296.299475:0:94303:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x32:0x0] (24/16) registered 00100000:10000000:3.0:1784189296.300419:0:94303:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x34:0x0] (24/16) registered 00100000:10000000:3.0:1784189296.300641:0:94303:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:3.0:1784189296.301100:0:94303:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:3.0:1784189296.301590:0:94303:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:3.0:1784189296.301838:0:94303:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:3.0:1784189296.302065:0:94303:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:3.0:1784189296.302437:0:94303:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x20:0x0] (16/1) registered 00100000:10000000:3.0:1784189296.302674:0:94303:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x22:0x0] (16/1) registered 00100000:10000000:3.0:1784189296.302901:0:94303:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:3.0:1784189296.303223:0:94303:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:3.0:1784189296.303614:0:94303:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:3.0:1784189296.303815:0:94303:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:3.0:1784189296.304526:0:94303:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:3.0:1784189296.308868:0:94303:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:3.0:1784189296.309253:0:94303:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1f:0x0] (16/1) registered 00100000:10000000:3.0:1784189296.309697:0:94303:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x21:0x0] (16/1) registered 00100000:10000000:3.0:1784189296.309919:0:94303:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x23:0x0] (16/1) registered 00100000:10000000:3.0:1784189296.310111:0:94303:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x33:0x0] (24/16) registered 00100000:10000000:3.0:1784189296.310451:0:94303:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:3.0:1784189296.310645:0:94303:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x31:0x0] (24/16) registered 00100000:10000000:3.0:1784189296.310839:0:94303:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:3.0:1784189296.311025:0:94303:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x30:0x0] (24/16) registered 00100000:10000000:3.0:1784189296.311217:0:94303:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:3.0:1784189296.311559:0:94303:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:3.0:1784189296.314439:0:94303:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2:0x0] (8/32) registered 00100000:10000000:3.0:1784189296.315508:0:94303:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x52:0x0] (8/32) registered 00100000:10000000:3.0:1784189296.315550:0:94303:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x50:0x0] (8/32) registered 00100000:10000000:3.0:1784189296.315578:0:94303:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x51:0x0] (8/32) registered 00100000:10000000:3.0:1784189296.316109:0:94303:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/32) registered 00100000:10000000:3.0:1784189296.316765:0:94303:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/32) registered 00100000:10000000:3.0:1784189296.316955:0:94303:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/32) registered 00100000:10000000:3.0:1784189296.317532:0:94303:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/32) registered 00100000:10000000:3.0:1784189296.318815:0:94303:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/32) registered 00100000:10000000:3.0:1784189296.319037:0:94303:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/32) registered 00080000:01000000:1.0:1784189296.320637:0:94303:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0000: register osd-ldiskfs tunable parameters 00000020:00000080:1.0:1784189296.320865:0:94303:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:1.0:1784189296.320874:0:94303:0:(osd_handler.c:8929:osd_obd_connect()) connect #0 00000020:00000080:1.0:1784189296.320885:0:94303:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xcc1762b626f8c55e 00000020:01000004:1.0:1784189296.320893:0:94303:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0000 on device /dev/mapper/mds1_flakey 00000020:01000000:1.0:1784189296.320904:0:94303:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:1.0:1784189296.320910:0:94303:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9dc07a8f1800 from MGS 00000020:01000004:1.0:1784189296.320914:0:94303:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:1.0:1784189296.320924:0:94303:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff9dbf42000000) 00000020:00000080:1.0:1784189296.320936:0:94303:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mgs with refcount 2 00000020:01000004:1.0:1784189296.321000:0:94303:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9dc07a8f1800 from MGS, refs=2 00080000:01000000:1.0:1784189296.321005:0:94303:0:(osd_handler.c:8929:osd_obd_connect()) connect #1 00000020:00000080:1.0:1784189296.321010:0:94303:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xcc1762b626f8c56c 00010000:00010000:1.0:1784189296.321148:0:94303:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-MGS-3 is initialized 00000040:01000000:1.0:1784189296.336714:0:94303:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 10000000:01000000:2.0:1784189296.337633:0:94307:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:1.0:1784189296.337946:0:94303:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:1.0:1784189296.337985:0:94303:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1784189296.339063:0:94303:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:1.0:1784189296.340390:0:94303:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1784189296.340559:0:94303:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:1.0:1784189296.340566:0:94303:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:3.0:1784189296.342481:0:94303:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:3.0:1784189296.342493:0:94303:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:2.0:1784189296.342865:0:94303:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:2.0:1784189296.342872:0:94303:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:3.0:1784189296.343362:0:94303:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:3.0:1784189296.343385:0:94303:0:(obd_mount.c:392:lustre_start_mgc()) New MGS with live MGC 00000020:01000004:3.0:1784189296.343387:0:94303:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.112@tcp:Set MGC reconnect 2 10000000:01000000:3.0:1784189296.343390:0:94303:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.112@tcp 2/d0:i1:r0:or0:CONNECTING 00000100:00080000:3.0:1784189296.343395:0:94303:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffff9dc07110c800 already not connected (conn 66, was 0): CONNECTING 00000100:00100000:3.0:1784189296.343401:0:94303:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 6s for inflight to error out 00010000:00010000:1.0:1784189296.368749:0:7454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1784189296.687913:0:63468:0:(pinger.c:229:ptlrpc_pinger_process_import()) bd553d0d-03e2-4233-b06b-b55bbfa2b954->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1784189296.687923:0:63468:0:(pinger.c:247:ptlrpc_pinger_process_import()) bd553d0d-03e2-4233-b06b-b55bbfa2b954->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1784189296.687926:0:63468:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1784189296.687929:0:63468:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1784189296.687933:0:63468:0:(import.c:65:import_set_state_nolock()) ffff9dbf42271800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1784189296.687940:0:63468:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3533 00000100:00080000:0.0:1784189296.687945:0:63468:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1784189296.687952:0:63468:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9dbf42271800 using connection 192.168.203.112@tcp/0@lo 00000100:00100000:0.0:1784189296.687990:0:63468:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9dbf43f58000 x1870854458215680/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1784189296.688035:0:63468:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1784189296.688039:0:63468:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1784189296.688041:0:63468:0:(import.c:65:import_set_state_nolock()) ffff9dbf425f4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1784189296.688044:0:63468:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3533 00000100:00080000:0.0:1784189296.688046:0:63468:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1784189296.688049:0:63468:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9dbf425f4800 using connection 192.168.203.112@tcp/0@lo 00000100:00100000:0.0:1784189296.688060:0:63468:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9dbf43f5ad80 x1870854458215936/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1784189296.688081:0:63468:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1784189296.688084:0:63468:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1784189296.688086:0:63468:0:(import.c:65:import_set_state_nolock()) ffff9dbf436c4000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1784189296.688103:0:63468:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3533 00000100:00080000:0.0:1784189296.688105:0:63468:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1784189296.688109:0:63468:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9dbf436c4000 using connection 192.168.203.112@tcp/0@lo 00000100:00100000:0.0:1784189296.688123:0:63468:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9dc07b5b3b80 x1870854458216192/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1784189296.688145:0:63468:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1784189296.688147:0:63468:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1784189296.688149:0:63468:0:(import.c:65:import_set_state_nolock()) ffff9dbf43690800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1784189296.688152:0:63468:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3533 00000100:00080000:0.0:1784189296.688154:0:63468:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1784189296.688157:0:63468:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff9dbf43690800 using connection 192.168.203.112@tcp/0@lo 00000100:00100000:0.0:1784189296.688166:0:63468:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9dc07b5b0e00 x1870854458216576/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1784189296.688201:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc07b5b2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1870854458216448:0@lo:400:kworker.0 00000100:00100000:0.0:1784189296.688262:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784189296.688298:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1784189296.688304:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf43f58e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3640:1870854458215808:0@lo:400:kworker.0 00000100:00100000:0.0:1784189296.688352:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784189296.688385:0:26161:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458216448 00000100:00100000:0.0:1784189296.688392:0:26161:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458216448 00000100:00100000:3.0:1784189296.688549:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf43f58000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3639:1870854458215680:0@lo:38:kworker.0 00000100:00100000:3.0:1784189296.688579:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784189296.688598:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf43f5ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3639:1870854458215936:0@lo:38:kworker.0 00000100:00100000:3.0:1784189296.688620:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784189296.688636:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc07b5b3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3639:1870854458216192:0@lo:38:kworker.0 00000100:00100000:3.0:1784189296.688657:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784189296.688675:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc07b5b0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3639:1870854458216576:0@lo:38:kworker.0 00000100:00100000:3.0:1784189296.688695:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784189296.688721:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf43f58380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3642:1870854458216064:0@lo:400:kworker.0 00000100:00100000:3.0:1784189296.688742:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784189296.688767:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1784189296.688773:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc07b5b1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1870854458216320:0@lo:400:kworker.0 00000100:00100000:3.0:1784189296.688795:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784189296.688821:0:68287:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458215808 00000100:00100000:3.0:1784189296.688824:0:68287:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458215808 00000100:00100000:3.0:1784189296.688849:0:68287:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458215680 00000100:00100000:3.0:1784189296.688852:0:68287:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458215680 00000100:00100000:3.0:1784189296.688861:0:68287:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458215936 00000100:00100000:3.0:1784189296.688864:0:68287:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458215936 00000100:00100000:3.0:1784189296.688872:0:68287:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458216576 00000100:00100000:3.0:1784189296.688874:0:68287:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458216576 00000100:00100000:3.0:1784189296.688882:0:68287:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458216064 00000100:00100000:3.0:1784189296.688884:0:68287:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458216064 00000100:00100000:3.0:1784189296.688899:0:68287:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1296 00000100:00100000:3.0:1784189296.688907:0:68287:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc07b5b0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1870854458215808:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784189296.688958:0:68287:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc07b5b0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1870854458215808:12345-0@lo:400:kworker.0 Request processed in 51us (604us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189296.688965:0:68287:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1296 00000100:00100000:3.0:1784189296.688981:0:68287:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1297 00000100:00100000:3.0:1784189296.688988:0:68287:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc07fb34000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1870854458216064:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784189296.689017:0:68287:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc07fb34000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1870854458216064:12345-0@lo:400:kworker.0 Request processed in 30us (274us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189296.689023:0:68287:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1297 00000100:00100000:3.0:1784189296.689034:0:68287:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1414 00000100:00100000:3.0:1784189296.689037:0:68287:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc07fb36680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3639:x1870854458215680:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1784189296.689054:0:68287:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1784189296.689084:0:68287:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc07fb36680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3639:x1870854458215680:12345-0@lo:38:kworker.0 Request processed in 45us (503us total) trans 0 rc -19/-19 00000100:00100000:3.0:1784189296.689100:0:68287:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1414 00000100:00100000:3.0:1784189296.689112:0:68287:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1415 00000100:00100000:3.0:1784189296.689117:0:68287:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc07fb37b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3639:x1870854458215936:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1784189296.689127:0:68287:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1784189296.689152:0:68287:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc07fb37b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3639:x1870854458215936:12345-0@lo:38:kworker.0 Request processed in 34us (531us total) trans 0 rc -19/-19 00000100:00100000:3.0:1784189296.689158:0:68287:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1415 00000100:00100000:3.0:1784189296.689169:0:68287:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1416 00000100:00100000:3.0:1784189296.689172:0:68287:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc07fb35f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3639:x1870854458216576:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1784189296.689180:0:68287:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1784189296.689218:0:68287:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc07fb35f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3639:x1870854458216576:12345-0@lo:38:kworker.0 Request processed in 44us (522us total) trans 0 rc -19/-19 00000100:00100000:3.0:1784189296.689223:0:68287:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1416 00000100:00100000:3.0:1784189296.689246:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458216192 00000100:00100000:3.0:1784189296.689249:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458216192 00000100:00100000:3.0:1784189296.689267:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3917 00000100:00100000:3.0:1784189296.689271:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc07fb36300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3639:x1870854458216192:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1784189296.689280:0:8438:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1784189296.689305:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc07fb36300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3639:x1870854458216192:12345-0@lo:38:kworker.0 Request processed in 31us (646us total) trans 0 rc -19/-19 00000100:00100000:3.0:1784189296.689310:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3917 00000100:00100000:3.0:1784189296.689348:0:26166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458216320 00000100:00100000:3.0:1784189296.689352:0:26166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458216320 00000100:00100000:2.0:1784189296.689552:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf43f58380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3642:1870854458216064:0@lo:400:kworker.0 00000100:00100000:2.0:1784189296.689596:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf43f58e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3640:1870854458215808:0@lo:400:kworker.0 00000100:00080000:2.0:1784189296.689626:0:3639:0:(import.c:65:import_set_state_nolock()) ffff9dbf42271800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1784189296.689630:0:3639:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1784189296.689633:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf43f58000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3639:1870854458215680:0@lo:38:kworker.0 00000100:00080000:2.0:1784189296.689642:0:3639:0:(import.c:65:import_set_state_nolock()) ffff9dbf425f4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1784189296.689645:0:3639:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1784189296.689648:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf43f5ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3639:1870854458215936:0@lo:38:kworker.0 00000100:00080000:2.0:1784189296.689655:0:3639:0:(import.c:65:import_set_state_nolock()) ffff9dbf436c4000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1784189296.689658:0:3639:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1784189296.689660:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc07b5b3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3639:1870854458216192:0@lo:38:kworker.0 00000100:00080000:2.0:1784189296.689667:0:3639:0:(import.c:65:import_set_state_nolock()) ffff9dbf43690800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1784189296.689670:0:3639:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1784189296.689672:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc07b5b0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3639:1870854458216576:0@lo:38:kworker.0 00000100:00080000:2.0:1784189296.689711:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1784189296.689715:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1784189296.689717:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1784189296.690230:0:26161:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2553 00000100:00100000:0.0:1784189296.690242:0:26161:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc07b5b1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:3640:x1870854458216448:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784189296.690291:0:26161:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc07b5b1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:3640:x1870854458216448:12345-0@lo:400:kworker.0 Request processed in 52us (2028us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189296.690354:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc07b5b2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1870854458216448:0@lo:400:kworker.0 00000100:00100000:3.0:1784189296.693691:0:26166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2554 00000100:00100000:3.0:1784189296.693715:0:26166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc07fb34380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+5:3642:x1870854458216320:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784189296.693826:0:26166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc07fb34380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+5:3642:x1870854458216320:12345-0@lo:400:kworker.0 Request processed in 123us (5029us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189296.693835:0:26166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2554 00000100:00100000:3.0:1784189296.693893:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc07b5b1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1870854458216320:0@lo:400:kworker.0 00000100:00100000:0.0:1784189296.694065:0:26161:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2553 00010000:00010000:1.0:1784189297.392516:0:26173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784189297.959233:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1784189297.959279:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1784189297.959442:0:66171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436322944 00000100:00100000:1.0:1784189297.959451:0:66171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436322944 00000100:00100000:1.0:1784189297.959522:0:66171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436322816 00000100:00100000:1.0:1784189297.959526:0:66171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436322816 00000100:00100000:1.0:1784189297.959546:0:66171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1298 00000100:00100000:1.0:1784189297.959561:0:66171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf469b7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:debedd94-805c-42a0-a5e5-41758b2012e9+9:2397:x1870854436322944:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:1.0:1784189297.959648:0:66171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf469b7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:debedd94-805c-42a0-a5e5-41758b2012e9+9:2397:x1870854436322944:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 79us (411us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189297.959662:0:66171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1298 00000100:00100000:1.0:1784189297.959695:0:66171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1417 00000100:00100000:1.0:1784189297.959705:0:66171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf469b7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2395:x1870854436322816:12345-192.168.203.12@tcp:38:kworker.0 00010000:00020000:1.0:1784189297.959728:0:66171:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.203.12@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1784189297.959759:0:66171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf469b7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2395:x1870854436322816:12345-192.168.203.12@tcp:38:kworker.0 Request processed in 57us (479us total) trans 0 rc -19/-19 00000100:00100000:1.0:1784189297.959765:0:66171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1417 00000100:00080000:2.0:1784189297.959911:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:3.0:1784189298.416669:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1784189298.737429:0:9506:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of debedd94-805c-42a0-a5e5-41758b2012e9 00000020:00000080:0.0:1784189298.737438:0:9506:0:(genops.c:906:class_export_put()) final put ffff9dc07118d800/debedd94-805c-42a0-a5e5-41758b2012e9 00000020:00000080:2.0:1784189298.737510:0:63468:0:(genops.c:865:class_export_destroy()) destroying export ffff9dc07118d800/debedd94-805c-42a0-a5e5-41758b2012e9 for lustre-OST0001 00000020:00000080:2.0:1784189298.737571:0:63468:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9dc07118c800 for lustre-OST0001 00010000:00010000:1.0:1784189299.441543:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784189299.759845:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc06b98f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1870854458216704:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1784189299.759928:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784189299.760026:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458216704 00000100:00100000:1.0:1784189299.760039:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458216704 00000100:00100000:1.0:1784189299.760098:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2042 00000100:00100000:1.0:1784189299.760107:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc056eadf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1870854458216704:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1784189299.760135:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 210112 pending 0 free 3922481152 avail 3690958848 00000100:00100000:1.0:1784189299.760185:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc056eadf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1870854458216704:12345-0@lo:13:osp-pre-0-1.0 Request processed in 80us (256us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189299.760192:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2042 00000100:00100000:1.0:1784189299.760533:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1784189299.760543:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc07b5b0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1870854458216832:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1784189299.760571:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784189299.760643:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458216832 00000100:00100000:0.0:1784189299.760647:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458216832 00000100:00100000:0.0:1784189299.760679:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2043 00000100:00100000:0.0:1784189299.760686:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc06b98fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1870854458216832:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1784189299.760702:0:8432:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 210112 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1784189299.760739:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc06b98fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1870854458216832:12345-0@lo:13:osp-pre-1-1.0 Request processed in 54us (167us total) trans 0 rc 0/0 00000100:00100000:0.0:1784189299.760745:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2043 00000100:00100000:0.0:1784189299.760785:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc07b5b0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1870854458216832:0@lo:13:osp-pre-1-1.0 00000100:00080000:2.0:1784189299.760881:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1784189299.760885:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1784189299.760922:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc06b98f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1870854458216704:0@lo:13:osp-pre-0-1.0 00010000:00010000:1.0:1784189300.464213:0:7454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784189301.488478:0:26173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1784189301.807438:0:93049:0:(pinger.c:229:ptlrpc_pinger_process_import()) bd553d0d-03e2-4233-b06b-b55bbfa2b954->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1784189301.807450:0:93049:0:(pinger.c:247:ptlrpc_pinger_process_import()) bd553d0d-03e2-4233-b06b-b55bbfa2b954->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1784189301.807453:0:93049:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1784189301.807457:0:93049:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1784189301.807462:0:93049:0:(import.c:65:import_set_state_nolock()) ffff9dbf42271800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1784189301.807470:0:93049:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3538 00000100:00080000:3.0:1784189301.807476:0:93049:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1784189301.807485:0:93049:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9dbf42271800 using connection 192.168.203.112@tcp/0@lo 00000100:00100000:3.0:1784189301.807526:0:93049:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9dbf469b7480 x1870854458216960/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1784189301.807578:0:93049:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1784189301.807582:0:93049:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1784189301.807584:0:93049:0:(import.c:65:import_set_state_nolock()) ffff9dbf425f4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1784189301.807588:0:93049:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3538 00000100:00080000:3.0:1784189301.807591:0:93049:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s 00000100:00100000:2.0:1784189301.807597:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf469b4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3643:1870854458217088:0@lo:400:kworker.0 00000100:00080000:3.0:1784189301.807611:0:93049:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9dbf425f4800 using connection 192.168.203.112@tcp/0@lo 00000100:00100000:3.0:1784189301.807626:0:93049:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9dbf469b4700 x1870854458217216/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1784189301.807669:0:93049:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00100000:2.0:1784189301.807675:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1784189301.807676:0:93049:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1784189301.807681:0:93049:0:(import.c:65:import_set_state_nolock()) ffff9dbf436c4000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1784189301.807686:0:93049:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3538 00000100:00080000:3.0:1784189301.807689:0:93049:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1784189301.807693:0:93049:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9dbf436c4000 using connection 192.168.203.112@tcp/0@lo 00000100:00100000:3.0:1784189301.807707:0:93049:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9dbf469b4000 x1870854458217472/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1784189301.807723:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1784189301.807735:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf469b6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1870854458217600:0@lo:400:kworker.0 00000100:00080000:3.0:1784189301.807742:0:93049:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1784189301.807747:0:93049:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1784189301.807749:0:93049:0:(import.c:65:import_set_state_nolock()) ffff9dbf43690800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1784189301.807753:0:93049:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3538 00000100:00080000:3.0:1784189301.807756:0:93049:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1784189301.807760:0:93049:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff9dbf43690800 using connection 192.168.203.112@tcp/0@lo 00000100:00100000:2.0:1784189301.807767:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784189301.807775:0:93049:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9dbf469b5c00 x1870854458217856/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1784189301.807790:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf469b6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3641:1870854458217344:0@lo:400:kworker.0 00000100:00100000:3.0:1784189301.807805:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf469b7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1870854458217728:0@lo:400:kworker.0 00000100:00100000:2.0:1784189301.807817:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784189301.807873:0:3639:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1784189291/real 1784189291] req@ffff9dc07fb37800 x1870854458214272/t0(0) o250->MGC192.168.203.112@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1784189301 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784189301.807893:0:3639:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9dc07fb37800 x1870854458214272/t0(0) o250->MGC192.168.203.112@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1784189301 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784189301.807905:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf469b7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3639:1870854458216960:0@lo:38:kworker.0 00000100:00100000:1.0:1784189301.807998:0:66171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458217088 00000100:00100000:1.0:1784189301.808005:0:66171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458217088 00000100:00100000:3.0:1784189301.808011:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784189301.808053:0:26171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458217600 00000100:00100000:3.0:1784189301.808058:0:26171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458217600 00000100:00100000:1.0:1784189301.808061:0:66171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458217344 00000100:00100000:1.0:1784189301.808066:0:66171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458217344 00000100:00100000:3.0:1784189301.808092:0:26171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458217728 00000100:00100000:3.0:1784189301.808097:0:26171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458217728 00000100:00100000:1.0:1784189301.808117:0:66171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1299 00000100:00100000:3.0:1784189301.808132:0:26171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2555 00000100:00100000:1.0:1784189301.808133:0:66171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc056eae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1870854458217088:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784189301.808154:0:26171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc056eace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0001-mdtlov_UUID+5:3641:x1870854458217600:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784189301.808209:0:66171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc056eae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1870854458217088:12345-0@lo:400:kworker.0 Request processed in 82us (537us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189301.808215:0:26171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc056eace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0001-mdtlov_UUID+5:3641:x1870854458217600:12345-0@lo:400:kworker.0 Request processed in 74us (446us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189301.808234:0:26171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2555 00000100:00100000:1.0:1784189301.808234:0:66171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1299 00000100:00100000:3.0:1784189301.808258:0:26171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2556 00000100:00100000:1.0:1784189301.808262:0:66171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1300 00000100:00100000:3.0:1784189301.808270:0:26171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf469b6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0001-mdtlov_UUID+5:3642:x1870854458217728:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784189301.808274:0:66171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc056eaca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1870854458217344:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784189301.808316:0:26171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf469b6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0001-mdtlov_UUID+5:3642:x1870854458217728:12345-0@lo:400:kworker.0 Request processed in 48us (304us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189301.808344:0:66171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc056eaca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1870854458217344:12345-0@lo:400:kworker.0 Request processed in 74us (526us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189301.808348:0:26171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2556 00000100:00100000:1.0:1784189301.808356:0:66171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1300 00000100:00100000:3.0:1784189301.808411:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf469b7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1870854458217728:0@lo:400:kworker.0 00000100:00100000:3.0:1784189301.808465:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf469b4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3643:1870854458217088:0@lo:400:kworker.0 00000100:00080000:3.0:1784189301.808499:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1784189301.808503:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1784189301.808505:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1784189301.809434:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784189301.809460:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf469b4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3639:1870854458217216:0@lo:38:kworker.0 00000100:00100000:0.0:1784189301.809487:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784189301.809508:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf469b4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3639:1870854458217472:0@lo:38:kworker.0 00000100:00100000:3.0:1784189301.809509:0:68287:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458216960 00000100:00100000:3.0:1784189301.809517:0:68287:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458216960 00000100:00100000:0.0:1784189301.809533:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784189301.809548:0:68287:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458217216 00000100:00100000:0.0:1784189301.809551:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf469b5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3639:1870854458217856:0@lo:38:kworker.0 00000100:00100000:3.0:1784189301.809553:0:68287:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458217216 00000100:00100000:0.0:1784189301.809572:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784189301.809578:0:68287:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1418 00000100:00100000:3.0:1784189301.809585:0:68287:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc07b5b0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3639:x1870854458216960:12345-0@lo:38:kworker.0 00000100:00080000:0.0:1784189301.809591:0:3639:0:(import.c:65:import_set_state_nolock()) ffff9dc07110c800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1784189301.809603:0:3639:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:0.0:1784189301.809621:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc07fb37800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:bd553d0d-03e2-4233-b06b-b55bbfa2b954:3639:1870854458214272:0@lo:250:kworker.0 00000100:00100000:0.0:1784189301.809650:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458217472 00000100:00100000:0.0:1784189301.809653:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458217472 00000100:00100000:0.0:1784189301.809672:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3918 00000100:00100000:0.0:1784189301.809676:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc07b5b2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3639:x1870854458217472:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1784189301.809692:0:8439:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1784189301.809721:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc07b5b2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3639:x1870854458217472:12345-0@lo:38:kworker.0 Request processed in 43us (188us total) trans 0 rc -19/-19 00000100:00100000:0.0:1784189301.809727:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3918 00000100:00100000:0.0:1784189301.809746:0:66945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458217856 00000100:00100000:0.0:1784189301.809748:0:66945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458217856 00000100:00100000:0.0:1784189301.809758:0:66945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1419 00000100:00100000:0.0:1784189301.809762:0:66945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc07b5b1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3639:x1870854458217216:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1784189301.809770:0:66945:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1784189301.809789:0:66945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc07b5b1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3639:x1870854458217216:12345-0@lo:38:kworker.0 Request processed in 25us (302us total) trans 0 rc -19/-19 00000100:00100000:0.0:1784189301.809794:0:66945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1419 00000100:00100000:0.0:1784189301.809810:0:66945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1420 00000100:00100000:0.0:1784189301.809814:0:66945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc07b5b0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3639:x1870854458217856:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1784189301.809822:0:66945:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1784189301.809850:0:66945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc07b5b0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3639:x1870854458217856:12345-0@lo:38:kworker.0 Request processed in 35us (278us total) trans 0 rc -19/-19 00000100:00100000:0.0:1784189301.809855:0:66945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1420 00000100:00080000:0.0:1784189301.809869:0:93049:0:(pinger.c:229:ptlrpc_pinger_process_import()) bd553d0d-03e2-4233-b06b-b55bbfa2b954->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1784189301.809873:0:93049:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1784189301.809880:0:93049:0:(import.c:65:import_set_state_nolock()) ffff9dc07110c800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1784189301.809885:0:93049:0:(import.c:510:import_select_connection()) MGC192.168.203.112@tcp: connect to NID 0@lo last attempt 3533 00000100:00080000:0.0:1784189301.809889:0:93049:0:(import.c:589:import_select_connection()) MGC192.168.203.112@tcp: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1784189301.809894:0:93049:0:(import.c:624:import_select_connection()) MGC192.168.203.112@tcp: import ffff9dc07110c800 using connection 192.168.203.112@tcp/0@lo 00000100:00100000:0.0:1784189301.809915:0:93049:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9dc07b5b3b80 x1870854458217984/t0(0) o250->MGC192.168.203.112@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1784189301.809940:0:3639:0:(import.c:65:import_set_state_nolock()) ffff9dbf425f4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00010000:00020000:3.0:1784189301.809943:0:68287:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00080000:1.0:1784189301.809947:0:3639:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1784189301.809953:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf469b4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3639:1870854458217216:0@lo:38:kworker.0 10000000:01000000:0.0:1784189301.809956:0:94303:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000100:00080000:1.0:1784189301.809964:0:3639:0:(import.c:65:import_set_state_nolock()) ffff9dbf436c4000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1784189301.809969:0:3639:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00010000:00010000:0.0:1784189301.809971:0:94303:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.112@tcp lock: ffff9dc0565e7600/0xcc1762b626f8be6c lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0xcc1762b626f8be73 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784189301.809974:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf469b4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3639:1870854458217472:0@lo:38:kworker.0 00000100:00100000:3.0:1784189301.809987:0:68287:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc07b5b0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3639:x1870854458216960:12345-0@lo:38:kworker.0 Request processed in 398us (552us total) trans 0 rc -19/-19 10000000:00010000:0.0:1784189301.809989:0:94303:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.112@tcp lock: ffff9dc0565e7600/0xcc1762b626f8be6c lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0xcc1762b626f8be73 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1784189301.809990:0:3639:0:(import.c:65:import_set_state_nolock()) ffff9dbf43690800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1784189301.809998:0:3639:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1784189301.810003:0:68287:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1418 00000100:00100000:1.0:1784189301.810006:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf469b5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3639:1870854458217856:0@lo:38:kworker.0 10000000:01000000:0.0:1784189301.810006:0:94303:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:0.0:1784189301.810022:0:94303:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1784189301.810032:0:94303:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.112@tcp lock: ffff9dc0565e7600/0xcc1762b626f8be6c lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0xcc1762b626f8be73 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00020000:1.0:1784189301.810034:0:3639:0:(client.c:1391:ptlrpc_import_delay_req()) @@@ invalidate in flight req@ffff9dc07b5b3b80 x1870854458217984/t0(0) o250->MGC192.168.203.112@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl Rpc:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00010000:00010000:0.0:1784189301.810056:0:94303:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.112@tcp lock: ffff9dc04152da00/0xcc1762b626f8c271 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x110e400000000 nid: local remote: 0xcc1762b626f8c278 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1784189301.810066:0:94303:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.112@tcp lock: ffff9dc04152da00/0xcc1762b626f8c271 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x110f400000000 nid: local remote: 0xcc1762b626f8c278 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784189301.810071:0:94303:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1784189301.810094:0:94303:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1784189301.810098:0:94303:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.112@tcp lock: ffff9dc04152da00/0xcc1762b626f8c271 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x590f400000000 nid: local remote: 0xcc1762b626f8c278 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189301.810107:0:94303:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.112@tcp lock: ffff9dbf4710fc00/0xcc1762b626f8c27f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x110e400000000 nid: local remote: 0xcc1762b626f8c286 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1784189301.810120:0:94303:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.112@tcp lock: ffff9dbf4710fc00/0xcc1762b626f8c27f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x110f400000000 nid: local remote: 0xcc1762b626f8c286 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784189301.810125:0:94303:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1784189301.810128:0:94303:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1784189301.810131:0:94303:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.112@tcp lock: ffff9dbf4710fc00/0xcc1762b626f8c27f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x590f400000000 nid: local remote: 0xcc1762b626f8c286 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189301.810158:0:94303:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.112@tcp lock: ffff9dbf4710e800/0xcc1762b626f8c28d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x110e400000000 nid: local remote: 0xcc1762b626f8c294 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1784189301.810164:0:94303:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.112@tcp lock: ffff9dbf4710e800/0xcc1762b626f8c28d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x110f400000000 nid: local remote: 0xcc1762b626f8c294 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784189301.810168:0:94303:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1784189301.810172:0:94303:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1784189301.810175:0:94303:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.112@tcp lock: ffff9dbf4710e800/0xcc1762b626f8c28d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x590f400000000 nid: local remote: 0xcc1762b626f8c294 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189301.810307:0:94303:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.112@tcp lock: ffff9dbf4710f200/0xcc1762b626f8c29b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x110e400000000 nid: local remote: 0xcc1762b626f8c2a2 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1784189301.810314:0:94303:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.112@tcp lock: ffff9dbf4710f200/0xcc1762b626f8c29b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x110f400000000 nid: local remote: 0xcc1762b626f8c2a2 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784189301.810346:0:94303:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1784189301.810350:0:94303:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1784189301.810354:0:94303:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.112@tcp lock: ffff9dbf4710f200/0xcc1762b626f8c29b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x590f400000000 nid: local remote: 0xcc1762b626f8c2a2 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189301.810374:0:94303:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.112@tcp lock: ffff9dbf4710f000/0xcc1762b626f8c2a9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x110e400000000 nid: local remote: 0xcc1762b626f8c2b0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1784189301.810381:0:94303:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.112@tcp lock: ffff9dbf4710f000/0xcc1762b626f8c2a9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x110f400000000 nid: local remote: 0xcc1762b626f8c2b0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784189301.810386:0:94303:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1784189301.810389:0:94303:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1784189301.810392:0:94303:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.112@tcp lock: ffff9dbf4710f000/0xcc1762b626f8c2a9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x590f400000000 nid: local remote: 0xcc1762b626f8c2b0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189301.810400:0:94303:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.112@tcp lock: ffff9dbf4369d600/0xcc1762b626f8c2b7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x110e400000000 nid: local remote: 0xcc1762b626f8c2be expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1784189301.810406:0:94303:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.112@tcp lock: ffff9dbf4369d600/0xcc1762b626f8c2b7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x110f400000000 nid: local remote: 0xcc1762b626f8c2be expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784189301.810410:0:94303:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1784189301.810413:0:94303:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1784189301.810416:0:94303:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.112@tcp lock: ffff9dbf4369d600/0xcc1762b626f8c2b7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x590f400000000 nid: local remote: 0xcc1762b626f8c2be expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189301.810423:0:94303:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.112@tcp lock: ffff9dbf4369da00/0xcc1762b626f8c2c5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0xcc1762b626f8c2cc expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1784189301.810429:0:94303:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.112@tcp lock: ffff9dbf4369da00/0xcc1762b626f8c2c5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0xcc1762b626f8c2cc expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784189301.810434:0:94303:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1784189301.810440:0:94303:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1784189301.810444:0:94303:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.112@tcp lock: ffff9dbf4369da00/0xcc1762b626f8c2c5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0xcc1762b626f8c2cc expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189301.810455:0:94303:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.112@tcp lock: ffff9dc0755a5200/0xcc1762b626f8bde0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0xcc1762b626f8bde7 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1784189301.810461:0:94303:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.112@tcp lock: ffff9dc0755a5200/0xcc1762b626f8bde0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0xcc1762b626f8bde7 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784189301.810467:0:94303:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1784189301.810469:0:94303:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1784189301.810472:0:94303:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.112@tcp lock: ffff9dc0755a5200/0xcc1762b626f8bde0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0xcc1762b626f8bde7 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189301.810483:0:94303:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.112@tcp lock: ffff9dc0565e6600/0xcc1762b626f8bdfc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0xcc1762b626f8be03 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1784189301.810489:0:94303:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.112@tcp lock: ffff9dc0565e6600/0xcc1762b626f8bdfc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0xcc1762b626f8be03 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784189301.810493:0:94303:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 00010000:00010000:0.0:1784189301.810496:0:94303:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1784189301.810499:0:94303:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.112@tcp lock: ffff9dc0565e6600/0xcc1762b626f8bdfc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0xcc1762b626f8be03 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189301.810509:0:94303:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.112@tcp lock: ffff9dc0565e7e00/0xcc1762b626f8be0a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x110e400000000 nid: local remote: 0xcc1762b626f8be11 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1784189301.810515:0:94303:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.112@tcp lock: ffff9dc0565e7e00/0xcc1762b626f8be0a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x110f400000000 nid: local remote: 0xcc1762b626f8be11 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784189301.810527:0:94303:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1784189301.810530:0:94303:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1784189301.810534:0:94303:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.112@tcp lock: ffff9dc0565e7e00/0xcc1762b626f8be0a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x590f400000000 nid: local remote: 0xcc1762b626f8be11 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189301.810542:0:94303:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.112@tcp lock: ffff9dc04152c600/0xcc1762b626f8be34 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x110e400000000 nid: local remote: 0xcc1762b626f8be3b expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1784189301.810547:0:94303:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.112@tcp lock: ffff9dc04152c600/0xcc1762b626f8be34 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x110f400000000 nid: local remote: 0xcc1762b626f8be3b expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784189301.810552:0:94303:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1784189301.810554:0:94303:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1784189301.810557:0:94303:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.112@tcp lock: ffff9dc04152c600/0xcc1762b626f8be34 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x590f400000000 nid: local remote: 0xcc1762b626f8be3b expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189301.810565:0:94303:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.112@tcp lock: ffff9dc0565e7800/0xcc1762b626f8be5e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0xcc1762b626f8be65 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1784189301.810571:0:94303:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.112@tcp lock: ffff9dc0565e7800/0xcc1762b626f8be5e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0xcc1762b626f8be65 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784189301.810576:0:94303:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1784189301.810579:0:94303:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1784189301.810581:0:94303:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.112@tcp lock: ffff9dc0565e7800/0xcc1762b626f8be5e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0xcc1762b626f8be65 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784189301.810805:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf469b6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3641:1870854458217344:0@lo:400:kworker.0 00000100:00100000:2.0:1784189301.810901:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf469b6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1870854458217600:0@lo:400:kworker.0 00000100:00080000:0.0:1784189301.825084:0:94303:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffff9dc07110c800 already not connected (conn 67, was 0): CONNECTING 00000100:00080000:1.0:1784189301.825086:0:3639:0:(import.c:65:import_set_state_nolock()) ffff9dc07110c800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1784189301.825098:0:94303:0:(import.c:65:import_set_state_nolock()) ffff9dc07110c800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1784189301.825120:0:94303:0:(import.c:510:import_select_connection()) MGC192.168.203.112@tcp: connect to NID 0@lo last attempt 3544 00000100:00080000:0.0:1784189301.825126:0:94303:0:(import.c:589:import_select_connection()) MGC192.168.203.112@tcp: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1784189301.825133:0:94303:0:(import.c:624:import_select_connection()) MGC192.168.203.112@tcp: import ffff9dc07110c800 using connection 192.168.203.112@tcp/0@lo 00000100:00080000:1.0:1784189301.825196:0:3639:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-5) 00000100:00100000:1.0:1784189301.825203:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc07b5b3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:bd553d0d-03e2-4233-b06b-b55bbfa2b954:0:1870854458217984:0@lo:250:kworker.0 00000100:00080000:1.0:1784189301.825248:0:3639:0:(import.c:65:import_set_state_nolock()) ffff9dbf42271800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1784189301.825252:0:3639:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1784189301.825255:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf469b7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3639:1870854458216960:0@lo:38:kworker.0 00000100:00100000:2.0:1784189301.825266:0:94303:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9dc056ead500 x1870854458218112/t0(0) o250->MGC192.168.203.112@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1784189301.825283:0:94303:0:(recover.c:337:ptlrpc_recover_import()) MGS: recovery started, waiting 20 seconds 00000100:00100000:1.0:1784189301.825303:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc056ead500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:bd553d0d-03e2-4233-b06b-b55bbfa2b954:3639:1870854458218112:0@lo:250:mount.lustre.0 00000100:00100000:1.0:1784189301.825397:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784189301.825698:0:94308:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458218112 00000100:00100000:0.0:1784189301.825705:0:94308:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458218112 00000100:00100000:0.0:1784189301.825781:0:94308:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1784189301.825788:0:94308:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc044984c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3639:x1870854458218112:12345-0@lo:250:mount.lustre.0 00010000:00080000:0.0:1784189301.825816:0:94308:0:(ldlm_lib.c:1445:target_handle_connect()) MGS: connection from bd553d0d-03e2-4233-b06b-b55bbfa2b954@0@lo t0 exp 0000000000000000 cur 3544 last 0 00000020:00000080:0.0:1784189301.825842:0:94308:0:(genops.c:1406:class_connect()) connect: client bd553d0d-03e2-4233-b06b-b55bbfa2b954, cookie 0xcc1762b626f8c573 00000100:00080000:0.0:1784189301.825966:0:94308:0:(import.c:65:import_set_state_nolock()) ffff9dc050ae6800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1784189301.826015:0:94308:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc044984c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd553d0d-03e2-4233-b06b-b55bbfa2b954+5:3639:x1870854458218112:12345-0@lo:250:mount.lustre.0 Request processed in 225us (618us total) trans 0 rc 0/0 00000100:00100000:0.0:1784189301.826022:0:94308:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1784189301.826097:0:3639:0:(client.c:3112:ptlrpc_free_committed()) MGC192.168.203.112@tcp: committing for last_committed 0 gen 28 00000100:00080000:1.0:1784189301.826104:0:3639:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.203.112@tcp: connect to target with instance 0 00000100:00080000:1.0:1784189301.826111:0:3639:0:(import.c:956:ptlrpc_connect_set_flags()) MGC192.168.203.112@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:1.0:1784189301.826115:0:3639:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:1.0:1784189301.826118:0:3639:0:(import.c:65:import_set_state_nolock()) ffff9dc07110c800 MGS: changing import state from CONNECTING to FULL 10000000:01000000:1.0:1784189301.826120:0:3639:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:1.0:1784189301.830021:0:3639:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:1.0:1784189301.830044:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc056ead500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:bd553d0d-03e2-4233-b06b-b55bbfa2b954:3639:1870854458218112:0@lo:250:mount.lustre.0 00000020:01000000:2.0:1784189301.830201:0:36:0:(tgt_mount.c:1626:tgt_import_update()) NID #0: 192.168.203.112@tcp 00000100:00080000:0.0:1784189301.830202:0:94303:0:(recover.c:348:ptlrpc_recover_import()) MGS: recovery finished FULL, rc = 0 00000020:01000004:0.0:1784189301.830215:0:94303:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0000 10000000:01000000:2.0:1784189301.830225:0:36:0:(mgc_request_server.c:464:mgc_set_info_async_server()) NID notify for lustre-OST0000 about 1 new NIDs 00000020:01000004:2.0:1784189301.830241:0:36:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: req 00000020:01000004:2.0:1784189301.830243:0:36:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1784189301.830245:0:36:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1784189301.830246:0:36:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1784189301.830247:0:36:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1784189301.830249:0:36:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1784189301.830250:0:36:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1784189301.830252:0:36:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1784189301.830253:0:36:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:01000000:2.0:1784189301.830303:0:36:0:(tgt_mount.c:1637:tgt_import_update()) lustre-OST0000: notify about 1 NIDs, rc = 0 00000100:00100000:1.0:1784189301.830394:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc056eac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:bd553d0d-03e2-4233-b06b-b55bbfa2b954:3643:1870854458218240:0@lo:253:kworker.0 00000100:00100000:1.0:1784189301.830461:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784189301.830545:0:94310:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458218240 00000100:00100000:1.0:1784189301.830552:0:94310:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458218240 00000100:00100000:1.0:1784189301.830596:0:94310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1784189301.830605:0:94310:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc044986450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd553d0d-03e2-4233-b06b-b55bbfa2b954+5:3643:x1870854458218240:12345-0@lo:253:kworker.0 20000000:01000000:1.0:1784189301.830632:0:94310:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 10000000:01000000:1.0:1784189301.830885:0:94312:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:1.0:1784189301.830984:0:94310:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 120 00000020:01000004:0.0:1784189301.831214:0:94303:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds1_flakey 10000000:01000000:0.0:1784189301.831219:0:94303:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.112@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:0.0:1784189301.831435:0:94303:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.112@tcp ctxt 0 is initialized 00000020:01000004:0.0:1784189301.831461:0:94303:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.203.112@tcp, index=0000, flags=0x20005 00000020:01000004:0.0:1784189301.831465:0:94303:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1784189301.831466:0:94303:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1784189301.831468:0:94303:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1784189301.831468:0:94303:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1784189301.831469:0:94303:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1784189301.831470:0:94303:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1784189301.831472:0:94303:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1784189301.831473:0:94303:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1784189301.831475:0:94303:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1784189301.831476:0:94303:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1784189301.831479:0:94303:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:0.0:1784189301.831481:0:94303:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1784189301.831486:0:94303:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1784189301.831487:0:94303:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1784189301.831488:0:94303:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1784189301.831489:0:94303:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1784189301.831490:0:94303:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1784189301.831491:0:94303:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1784189301.831492:0:94303:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1784189301.831493:0:94303:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1784189301.831494:0:94303:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1784189301.831510:0:94303:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:0.0:1784189301.831530:0:94303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc07b5b3b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd553d0d-03e2-4233-b06b-b55bbfa2b954:94303:1870854458218368:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1784189301.831586:0:94303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784189301.831630:0:94303:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dbf422f4240 going to sleep for 11 seconds 10000000:01000000:2.0:1784189301.832000:0:36:0:(mgc_request_server.c:464:mgc_set_info_async_server()) NID notify for lustre-OST0001 about 1 new NIDs 00000020:01000004:2.0:1784189301.832004:0:36:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: req 00000020:01000004:2.0:1784189301.832006:0:36:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1784189301.832007:0:36:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1784189301.832008:0:36:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1784189301.832016:0:36:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1784189301.832017:0:36:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1784189301.832018:0:36:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1784189301.832020:0:36:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1784189301.832021:0:36:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:01000000:2.0:1784189301.832062:0:36:0:(tgt_mount.c:1637:tgt_import_update()) lustre-OST0001: notify about 1 NIDs, rc = 0 10000000:01000000:2.0:1784189301.832068:0:36:0:(mgc_request_server.c:464:mgc_set_info_async_server()) NID notify for lustre-MDT0001 about 1 new NIDs 00000020:01000004:2.0:1784189301.832070:0:36:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: req 00000020:01000004:2.0:1784189301.832071:0:36:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1784189301.832072:0:36:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1784189301.832073:0:36:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1784189301.832073:0:36:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1784189301.832074:0:36:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1784189301.832075:0:36:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1784189301.832076:0:36:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1784189301.832077:0:36:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:01000000:2.0:1784189301.832090:0:36:0:(tgt_mount.c:1637:tgt_import_update()) lustre-MDT0001: notify about 1 NIDs, rc = 0 00000100:00100000:3.0:1784189301.832159:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc056eac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:bd553d0d-03e2-4233-b06b-b55bbfa2b954:3641:1870854458218624:0@lo:253:kworker.0 00000100:00100000:3.0:1784189301.832195:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784189301.832227:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1784189301.832232:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc056eaea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:bd553d0d-03e2-4233-b06b-b55bbfa2b954:3641:1870854458218496:0@lo:253:kworker.0 00000100:00100000:3.0:1784189301.832264:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784189301.832362:0:94309:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458218368 00000100:00100000:2.0:1784189301.832368:0:94309:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458218368 00000100:00100000:2.0:1784189301.832397:0:94309:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458218624 00000100:00100000:2.0:1784189301.832400:0:94309:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458218624 00000100:00100000:2.0:1784189301.832408:0:94309:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458218496 00000100:00100000:2.0:1784189301.832410:0:94309:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458218496 00000100:00100000:2.0:1784189301.832423:0:94309:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1784189301.832430:0:94309:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc044985c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd553d0d-03e2-4233-b06b-b55bbfa2b954+8:94303:x1870854458218368:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1784189301.832843:0:94313:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:3.0:1784189301.832847:0:94313:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 1 20000000:01000000:3.0:1784189301.832850:0:94313:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:3.0:1784189301.832852:0:94313:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:3.0:1784189301.832867:0:94313:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 58 count 57 20000000:01000000:1.0:1784189301.833122:0:94310:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1784189301.833154:0:94310:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1784189301.833312:0:94309:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1784189301.833315:0:94309:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:2.0:1784189301.833350:0:94309:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 20000000:01000000:2.0:1784189301.833356:0:94309:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:1.0:1784189301.837799:0:94310:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1784189301.837819:0:94310:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:1.0:1784189301.838123:0:94310:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc044986450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd553d0d-03e2-4233-b06b-b55bbfa2b954+8:3643:x1870854458218240:12345-0@lo:253:kworker.0 Request processed in 7514us (7656us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189301.838136:0:94310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1784189301.838187:0:94310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1784189301.838198:0:94310:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc044985050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd553d0d-03e2-4233-b06b-b55bbfa2b954+7:3641:x1870854458218624:12345-0@lo:253:kworker.0 20000000:01000000:1.0:1784189301.838250:0:94310:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:1.0:1784189301.838262:0:94310:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:2.0:1784189301.838508:0:94309:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc044985c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd553d0d-03e2-4233-b06b-b55bbfa2b954+7:94303:x1870854458218368:12345-0@lo:253:mount.lustre.0 Request processed in 6077us (6920us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189301.838516:0:94309:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1784189301.838547:0:94309:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1784189301.838556:0:94309:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc044985850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd553d0d-03e2-4233-b06b-b55bbfa2b954+6:3641:x1870854458218496:12345-0@lo:253:kworker.0 20000000:01000000:2.0:1784189301.838582:0:94309:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 00000100:00100000:1.0:1784189301.838737:0:94303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc07b5b3b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd553d0d-03e2-4233-b06b-b55bbfa2b954:94303:1870854458218368:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1784189301.838750:0:94303:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:1.0:1784189301.838753:0:94303:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1784189301.838755:0:94303:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1784189301.838756:0:94303:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1784189301.838757:0:94303:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1784189301.838759:0:94303:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1784189301.838760:0:94303:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1784189301.838761:0:94303:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1784189301.838762:0:94303:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1784189301.838764:0:94303:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1784189301.838766:0:94303:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1784189301.838791:0:94303:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9dc07a8f1800 from lustre-MDT0000 10000000:01000000:1.0:1784189301.838821:0:94303:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:1.0:1784189301.838823:0:94303:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:1.0:1784189301.838833:0:94303:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9dc07a8f1800 10000000:01000000:1.0:1784189301.838837:0:94303:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1784189301.838842:0:94303:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff9dc07a8f1800 10000000:01000000:1.0:1784189301.838844:0:94303:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:1.0:1784189301.838848:0:94303:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-barrier-ffff9dc07a8f1800 from 1 10000000:01000000:1.0:1784189301.838851:0:94303:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:1.0:1784189301.838882:0:94303:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff9dbf4710fe00/0xcc1762b626f8c57a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 94303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189301.838892:0:94303:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: ffff9dbf4710fe00/0xcc1762b626f8c57a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 94303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189301.838900:0:94303:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: ffff9dbf4710fe00/0xcc1762b626f8c57a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 94303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784189301.838920:0:94303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc06b98e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd553d0d-03e2-4233-b06b-b55bbfa2b954:94303:1870854458218752:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1784189301.838961:0:94303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784189301.838997:0:94303:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dbf425bb6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1784189301.839112:0:94308:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 3 min 3 max 32 00000100:00100000:2.0:1784189301.839121:0:94308:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0003' 20000000:01000000:3.0:1784189301.839202:0:94312:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1784189301.839206:0:94312:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1784189301.839223:0:94312:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9dc058f66200/0xcc1762b626f8c581 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 94312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189301.839246:0:94312:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dc058f66200/0xcc1762b626f8c581 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 94312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1784189301.839256:0:94312:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.000049853s 00010000:00010000:3.0:1784189301.839261:0:94312:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9dc058f66200/0xcc1762b626f8c581 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 94312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189301.839268:0:94312:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9dc058f66200/0xcc1762b626f8c581 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 94312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189301.839275:0:94312:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9dc058f66200/0xcc1762b626f8c581 lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 94312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189301.839281:0:94312:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9dc058f66200/0xcc1762b626f8c581 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 94312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189301.839287:0:94312:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc058f66200 already unused, calling callback (ffffffffc0b2e230) 00010000:00010000:3.0:1784189301.839290:0:94312:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9dc058f66200/0xcc1762b626f8c581 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 94312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189301.839308:0:94312:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9dc058f66200/0xcc1762b626f8c581 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 94312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189301.839336:0:94312:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9dc058f66200/0xcc1762b626f8c581 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 94312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189301.839346:0:94312:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9dc058f66200/0xcc1762b626f8c581 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 94312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189301.839352:0:94312:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dc058f66200/0xcc1762b626f8c581 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 94312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1784189301.839523:0:3643:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: rep 00000020:01000004:0.0:1784189301.839535:0:3643:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1784189301.839536:0:3643:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1784189301.839537:0:3643:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1784189301.839538:0:3643:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1784189301.839540:0:3643:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1784189301.839541:0:3643:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1784189301.839542:0:3643:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1784189301.839543:0:3643:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000100:00100000:0.0:1784189301.839546:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc056eac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:bd553d0d-03e2-4233-b06b-b55bbfa2b954:3643:1870854458218240:0@lo:253:kworker.0 00000100:00100000:2.0:1784189301.840252:0:94308:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458218752 00000100:00100000:2.0:1784189301.840260:0:94308:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458218752 00000100:00100000:0.0:1784189301.840445:0:94314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1784189301.840456:0:94314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc044987450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:bd553d0d-03e2-4233-b06b-b55bbfa2b954+7:94303:x1870854458218752:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1784189301.840470:0:94314:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784189301.840485:0:94314:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dc05ec0ec00/0xcc1762b626f8c588 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xcc1762b626f8c57a expref: -99 pid: 94314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189301.840505:0:94314:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dc05ec0ec00/0xcc1762b626f8c588 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcc1762b626f8c57a expref: 8 pid: 94314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189301.840515:0:94314:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dc05ec0ec00/0xcc1762b626f8c588 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcc1762b626f8c57a expref: 8 pid: 94314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189301.840544:0:94314:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc05ec0ec00, rc 0) 00000100:00100000:0.0:1784189301.840605:0:94314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc044987450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:bd553d0d-03e2-4233-b06b-b55bbfa2b954+8:94303:x1870854458218752:12345-0@lo:101:mount.lustre.0 Request processed in 151us (1642us total) trans 0 rc 0/0 00000100:00100000:0.0:1784189301.840612:0:94314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1784189301.840806:0:94303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc06b98e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd553d0d-03e2-4233-b06b-b55bbfa2b954:94303:1870854458218752:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1784189301.840823:0:94303:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: ffff9dbf4710fe00/0xcc1762b626f8c57a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc1762b626f8c588 expref: -99 pid: 94303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189301.840832:0:94303:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: ffff9dbf4710fe00/0xcc1762b626f8c57a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcc1762b626f8c588 expref: -99 pid: 94303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784189301.840848:0:94303:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:2.0:1784189301.840864:0:94303:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff9dbf4710fe00/0xcc1762b626f8c57a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc1762b626f8c588 expref: -99 pid: 94303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189301.840870:0:94303:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: ffff9dbf4710fe00/0xcc1762b626f8c57a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc1762b626f8c588 expref: -99 pid: 94303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784189301.840877:0:94303:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:2.0:1784189301.840882:0:94303:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1784189301.840886:0:94303:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff9dc07a8f1800 10000000:01000000:2.0:1784189301.840889:0:94303:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:2.0:1784189301.840892:0:94303:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:2.0:1784189301.840895:0:94303:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1784189301.840917:0:94303:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff9dc04a20b400/0xcc1762b626f8c58f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 94303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189301.840924:0:94303:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: ffff9dc04a20b400/0xcc1762b626f8c58f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 94303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189301.840938:0:94303:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: ffff9dc04a20b400/0xcc1762b626f8c58f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 94303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784189301.840956:0:94303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc056eac380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd553d0d-03e2-4233-b06b-b55bbfa2b954:94303:1870854458218880:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1784189301.840988:0:94303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784189301.841013:0:94308:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458218880 00000100:00100000:2.0:1784189301.841017:0:94308:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458218880 00000100:00100000:2.0:1784189301.841038:0:94308:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1784189301.841044:0:94308:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc044987c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd553d0d-03e2-4233-b06b-b55bbfa2b954+8:94303:x1870854458218880:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1784189301.841051:0:94308:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784189301.841060:0:94308:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dc04a20b000/0xcc1762b626f8c596 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xcc1762b626f8c58f expref: -99 pid: 94308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189301.841074:0:94308:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dc04a20b000/0xcc1762b626f8c596 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcc1762b626f8c58f expref: 9 pid: 94308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189301.841082:0:94308:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dc04a20b000/0xcc1762b626f8c596 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcc1762b626f8c58f expref: 9 pid: 94308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189301.841088:0:94308:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc04a20b000, rc 0) 00000100:00100000:2.0:1784189301.841111:0:94308:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc044987c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd553d0d-03e2-4233-b06b-b55bbfa2b954+9:94303:x1870854458218880:12345-0@lo:101:mount.lustre.0 Request processed in 68us (122us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189301.841118:0:94308:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1784189301.841163:0:94303:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dc06231a840 going to sleep for 11 seconds 00000100:00100000:2.0:1784189301.841178:0:94303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc056eac380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd553d0d-03e2-4233-b06b-b55bbfa2b954:94303:1870854458218880:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1784189301.841189:0:94303:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: ffff9dc04a20b400/0xcc1762b626f8c58f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc1762b626f8c596 expref: -99 pid: 94303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189301.841203:0:94303:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: ffff9dc04a20b400/0xcc1762b626f8c58f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcc1762b626f8c596 expref: -99 pid: 94303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784189301.841262:0:94303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc056eac380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd553d0d-03e2-4233-b06b-b55bbfa2b954:94303:1870854458219008:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1784189301.841287:0:94303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784189301.841306:0:94308:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458219008 00000100:00100000:2.0:1784189301.841310:0:94308:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458219008 00000100:00100000:2.0:1784189301.841357:0:94308:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1784189301.841363:0:94308:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc044984050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd553d0d-03e2-4233-b06b-b55bbfa2b954+9:94303:x1870854458219008:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1784189301.841468:0:94308:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc044984050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd553d0d-03e2-4233-b06b-b55bbfa2b954+10:94303:x1870854458219008:12345-0@lo:501:mount.lustre.0 Request processed in 104us (179us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189301.841475:0:94308:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1784189301.841497:0:94303:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dc06231a840 going to sleep for 11 seconds 00000100:00100000:2.0:1784189301.841509:0:94303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc056eac380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd553d0d-03e2-4233-b06b-b55bbfa2b954:94303:1870854458219008:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1784189301.841545:0:94303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc056eac380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd553d0d-03e2-4233-b06b-b55bbfa2b954:94303:1870854458219136:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1784189301.841581:0:94303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784189301.841599:0:94308:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458219136 00000100:00100000:2.0:1784189301.841603:0:94308:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458219136 00000100:00100000:2.0:1784189301.841620:0:94308:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1784189301.841626:0:94308:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc044986c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd553d0d-03e2-4233-b06b-b55bbfa2b954+10:94303:x1870854458219136:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1784189301.841914:0:94303:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dc058ce3f00 going to sleep for 11 seconds 00000100:00100000:2.0:1784189301.842183:0:94308:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc044986c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd553d0d-03e2-4233-b06b-b55bbfa2b954+10:94303:x1870854458219136:12345-0@lo:503:mount.lustre.0 Request processed in 556us (601us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189301.842191:0:94308:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 20000000:01000000:1.0:1784189301.842793:0:94310:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1784189301.842801:0:94310:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 00000100:00100000:1.0:1784189301.842957:0:94310:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc044985050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd553d0d-03e2-4233-b06b-b55bbfa2b954+9:3641:x1870854458218624:12345-0@lo:253:kworker.0 Request processed in 4762us (10760us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189301.842965:0:94310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000020:01000004:1.0:1784189301.843006:0:3641:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: rep 00000020:01000004:1.0:1784189301.843008:0:3641:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1784189301.843009:0:3641:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1784189301.843010:0:3641:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1784189301.843012:0:3641:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1784189301.843013:0:3641:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1784189301.843015:0:3641:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1784189301.843016:0:3641:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1784189301.843017:0:3641:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000100:00100000:1.0:1784189301.843020:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc056eac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:bd553d0d-03e2-4233-b06b-b55bbfa2b954:3641:1870854458218624:0@lo:253:kworker.0 20000000:01000000:3.0:1784189301.843101:0:94312:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1784189301.843105:0:94312:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1784189301.843123:0:94312:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9dc058f67000/0xcc1762b626f8c59d lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 94312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189301.843137:0:94312:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dc058f67000/0xcc1762b626f8c59d lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 94312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1784189301.843155:0:94312:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.000050258s 00010000:00010000:3.0:1784189301.843160:0:94312:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9dc058f67000/0xcc1762b626f8c59d lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 94312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189301.843167:0:94312:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9dc058f67000/0xcc1762b626f8c59d lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 94312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189301.843174:0:94312:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9dc058f67000/0xcc1762b626f8c59d lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 94312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189301.843195:0:94312:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9dc058f67000/0xcc1762b626f8c59d lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 94312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189301.843202:0:94312:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc058f67000 already unused, calling callback (ffffffffc0b2e230) 00010000:00010000:3.0:1784189301.843206:0:94312:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9dc058f67000/0xcc1762b626f8c59d lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 94312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189301.843214:0:94312:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9dc058f67000/0xcc1762b626f8c59d lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 94312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189301.843225:0:94312:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9dc058f67000/0xcc1762b626f8c59d lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 94312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189301.843241:0:94312:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9dc058f67000/0xcc1762b626f8c59d lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 94312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189301.843247:0:94312:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dc058f67000/0xcc1762b626f8c59d lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 94312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784189301.843278:0:94303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc056eac380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd553d0d-03e2-4233-b06b-b55bbfa2b954:94303:1870854458219136:0@lo:503:mount.lustre.0 20000000:01000000:2.0:1784189301.843447:0:94309:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:2.0:1784189301.850991:0:94315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc056ead880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bd553d0d-03e2-4233-b06b-b55bbfa2b954:94315:1870854458219264:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1784189301.851086:0:94315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784189301.851133:0:94315:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dc047e1da80 going to sleep for 11 seconds 00000100:00100000:3.0:1784189301.853621:0:94308:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458219264 00000100:00100000:3.0:1784189301.853634:0:94308:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458219264 00000100:00100000:3.0:1784189301.853740:0:94308:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1784189301.853753:0:94308:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc044985450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd553d0d-03e2-4233-b06b-b55bbfa2b954+9:94315:x1870854458219264:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1784189301.854611:0:94308:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc044985450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd553d0d-03e2-4233-b06b-b55bbfa2b954+9:94315:x1870854458219264:12345-0@lo:502:llog_process_th.0 Request processed in 858us (3521us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189301.854620:0:94308:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 20000000:01000000:0.0:1784189301.856296:0:94309:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 00000100:00100000:2.0:1784189301.856439:0:94315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc056ead880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bd553d0d-03e2-4233-b06b-b55bbfa2b954:94315:1870854458219264:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1784189301.856481:0:94315:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1784189301.856492:0:94315:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784189301.856494:0:94315:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:2.0:1784189301.856500:0:94315:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:2.0:1784189301.856503:0:94315:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 20000000:01000000:0.0:1784189301.856510:0:94309:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000020:00000080:2.0:1784189301.856518:0:94315:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff9dc07547cd40) 00000020:00000080:2.0:1784189301.856541:0:94315:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type lod with refcount 2 00000020:00000080:2.0:1784189301.856547:0:94315:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00080000:01000000:2.0:1784189301.856650:0:94315:0:(osd_handler.c:8929:osd_obd_connect()) connect #2 00000020:00000080:2.0:1784189301.856657:0:94315:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xcc1762b626f8c5ab 00000020:00000080:2.0:1784189301.856884:0:94315:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:2.0:1784189301.856889:0:94315:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1784189301.856894:0:94315:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784189301.856896:0:94315:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:2.0:1784189301.856899:0:94315:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1784189301.856903:0:94315:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784189301.856905:0:94315:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:2.0:1784189301.856909:0:94315:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1784189301.856916:0:94315:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff9dc075478000) 00000020:00000080:2.0:1784189301.856930:0:94315:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type mdt with refcount 2 00000020:00000080:2.0:1784189301.856935:0:94315:0:(obd_config.c:1470:class_process_config()) processing cmd: cf007 00000020:00000080:2.0:1784189301.856938:0:94315:0:(obd_config.c:1514:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000100:00100000:0.0:1784189301.856938:0:94309:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc044985850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd553d0d-03e2-4233-b06b-b55bbfa2b954+8:3641:x1870854458218496:12345-0@lo:253:kworker.0 Request processed in 18381us (24669us total) trans 0 rc 0/0 00000020:01000000:2.0:1784189301.856943:0:94315:0:(obd_config.c:1148:class_add_profile()) Add profile lustre-MDT0000 00000100:00100000:0.0:1784189301.856953:0:94309:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000020:00000080:2.0:1784189301.856954:0:94315:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1784189301.857005:0:94315:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9dc07a8f1800 from lustre-MDT0000, refs=3 00000020:00000080:2.0:1784189301.857018:0:94315:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff9dc07a7a19c0) 00000020:01000004:1.0:1784189301.857023:0:3641:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: rep 00000020:01000004:1.0:1784189301.857026:0:3641:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1784189301.857027:0:3641:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1784189301.857029:0:3641:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:00000080:2.0:1784189301.857030:0:94315:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type mdd with refcount 2 00000020:01000004:1.0:1784189301.857031:0:3641:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1784189301.857033:0:3641:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1784189301.857034:0:3641:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1784189301.857036:0:3641:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1784189301.857037:0:3641:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000100:00100000:1.0:1784189301.857042:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc056eaea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:bd553d0d-03e2-4233-b06b-b55bbfa2b954:3641:1870854458218496:0@lo:253:kworker.0 00000004:01000000:2.0:1784189301.857101:0:94315:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:2.0:1784189301.857107:0:94315:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xcc1762b626f8c5c0 00000020:00000080:2.0:1784189301.857247:0:94315:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:2.0:1784189301.857255:0:94315:0:(mdd_device.c:1596:mdd_obd_connect()) connect #0 00000020:00000080:2.0:1784189301.857259:0:94315:0:(genops.c:1406:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0xcc1762b626f8c5c7 00080000:01000000:2.0:1784189301.857265:0:94315:0:(osd_handler.c:8929:osd_obd_connect()) connect #3 00000020:00000080:2.0:1784189301.857269:0:94315:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xcc1762b626f8c5ce 20000000:01000000:3.0:1784189301.858895:0:94312:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1784189301.858909:0:94312:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1784189301.858927:0:94312:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9dc058f67000/0xcc1762b626f8c5d5 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 94312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189301.858943:0:94312:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dc058f67000/0xcc1762b626f8c5d5 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 94312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1784189301.858953:0:94312:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.000050258s 00010000:00010000:3.0:1784189301.858958:0:94312:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9dc058f67000/0xcc1762b626f8c5d5 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 94312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189301.858964:0:94312:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9dc058f67000/0xcc1762b626f8c5d5 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 94312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189301.858971:0:94312:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9dc058f67000/0xcc1762b626f8c5d5 lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 94312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189301.858979:0:94312:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9dc058f67000/0xcc1762b626f8c5d5 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 94312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189301.858985:0:94312:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc058f67000 already unused, calling callback (ffffffffc0b2e230) 00010000:00010000:3.0:1784189301.858989:0:94312:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9dc058f67000/0xcc1762b626f8c5d5 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 94312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189301.858997:0:94312:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9dc058f67000/0xcc1762b626f8c5d5 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 94312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189301.859009:0:94312:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9dc058f67000/0xcc1762b626f8c5d5 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 94312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189301.859016:0:94312:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9dc058f67000/0xcc1762b626f8c5d5 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 94312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189301.859032:0:94312:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dc058f67000/0xcc1762b626f8c5d5 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 94312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189301.944592:0:94315:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-4 is initialized 00000001:00080000:3.0:1784189301.944723:0:94315:0:(tgt_lastrcvd.c:1748:tgt_clients_data_init()) RCVRNG CLIENT uuid: lustre-MDT0001-mdtlov_UUID idx: 1 lr: 111669149699 srv lr: 115964116992 lx: 0 gen 21 00000001:00080000:3.0:1784189301.944763:0:94315:0:(tgt_lastrcvd.c:1748:tgt_clients_data_init()) RCVRNG CLIENT uuid: debedd94-805c-42a0-a5e5-41758b2012e9 idx: 2 lr: 0 srv lr: 115964116992 lx: 0 gen 23 00000001:00000004:3.0:1784189301.944784:0:94315:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 28, last_transno is 115964116992 00000001:00080000:3.0:1784189301.944881:0:94315:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000001:00080000:3.0:1784189301.944934:0:94315:0:(tgt_lastrcvd.c:2283:tgt_reply_data_init()) lustre-MDT0000: restore reply ffff9dc045d3c600: xid 1870854436311424, transno 115964116997, client gen 23, slot idx 0 00000001:00080000:3.0:1784189301.944945:0:94315:0:(tgt_lastrcvd.c:2283:tgt_reply_data_init()) lustre-MDT0000: restore reply ffff9dc045d3c3c0: xid 1870854458201728, transno 115964116999, client gen 21, slot idx 1 00000001:00080000:3.0:1784189301.944949:0:94315:0:(tgt_lastrcvd.c:2283:tgt_reply_data_init()) lustre-MDT0000: restore reply ffff9dc045d3c900: xid 1870854458203520, transno 115964117000, client gen 21, slot idx 2 00000001:00080000:3.0:1784189301.945024:0:94315:0:(tgt_lastrcvd.c:2283:tgt_reply_data_init()) lustre-MDT0000: restore reply ffff9dc045d3c180: xid 1870854458201216, transno 115964116998, client gen 21, slot idx 3 00000020:00000080:3.0:1784189301.948731:0:94315:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff9dc07a904d40) 00000020:00000080:3.0:1784189301.948759:0:94315:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type qmt with refcount 2 00080000:01000000:3.0:1784189301.948844:0:94315:0:(osd_handler.c:8929:osd_obd_connect()) connect #4 00000020:00000080:3.0:1784189301.948856:0:94315:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xcc1762b626f8c5f1 00000020:00000080:1.0:1784189301.950041:0:94315:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:3.0:1784189301.964265:0:94315:0:(genops.c:1406:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0xcc1762b626f8c5f8 00000020:00000080:3.0:1784189301.965062:0:94315:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:3.0:1784189301.965074:0:94315:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1784189301.965080:0:94315:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784189301.965083:0:94315:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:3.0:1784189301.965086:0:94315:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1784189301.965088:0:94315:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #8 00000020:01000000:3.0:1784189301.965090:0:94315:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1784189301.965091:0:94315:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1784189301.965092:0:94315:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1784189301.965095:0:94315:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784189301.965103:0:94315:0:(obd_config.c:1561:class_process_config()) marker 8 (0x6) lustre sys.timeout 00000020:01000000:3.0:1784189301.965106:0:94315:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1784189301.965110:0:94315:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784189301.965112:0:94315:0:(obd_config.c:1561:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:3.0:1784189301.965116:0:94315:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000004:01000000:3.0:1784189301.965170:0:94315:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:3.0:1784189301.965186:0:94315:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1784189301.965190:0:94315:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784189301.965191:0:94315:0:(obd_config.c:1561:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:3.0:1784189301.965193:0:94315:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1784189301.965197:0:94315:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784189301.965199:0:94315:0:(obd_config.c:1561:class_process_config()) marker 17 (0x1) lustre-MDT0001 add osp 00000020:00000080:3.0:1784189301.965201:0:94315:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1784189301.965206:0:94315:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.203.112@tcp to nid 0x20000c0a8cb70 (192.168.203.112@tcp) 00000020:00000080:3.0:1784189301.965230:0:94315:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1784189301.965243:0:94315:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osp-MDT0000 (ffff9dc07a903380) 00000020:00000080:3.0:1784189301.965259:0:94315:0:(obd_config.c:720:class_attach_name()) OBD: dev 21 attached type osp with refcount 2 00000020:00000080:3.0:1784189301.965263:0:94315:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1784189301.965314:0:94315:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0001-osp-MDT0000: connect to lustre-MDT0000-osd (lustre-MDT0001-osp-MDT0000) 00080000:01000000:3.0:1784189301.966784:0:94315:0:(osd_handler.c:8929:osd_obd_connect()) connect #5 00000020:00000080:3.0:1784189301.966798:0:94315:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xcc1762b626f8c606 00010000:00080000:3.0:1784189301.966837:0:94315:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9dbf436c1800@lustre-MDT0001-osp-MDT0000: add connection 192.168.203.112@tcp at head 00010000:00010000:3.0:1784189301.969106:0:94315:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-osp-MDT0000-9 is initialized 00000020:00000080:1.0:1784189301.971977:0:94315:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1784189301.971990:0:94315:0:(obd_config.c:1470:class_process_config()) processing cmd: cf014 00000004:01000000:1.0:1784189301.972024:0:94315:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0001_UUID idx:1 gen:1 00000020:00000080:1.0:1784189301.972046:0:94315:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xcc1762b626f8c60d 00000100:00080000:1.0:1784189301.972056:0:94315:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1784189301.972066:0:94315:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff9dbf436c1800 using connection 192.168.203.112@tcp/0@lo 00000100:00100000:1.0:1784189301.972098:0:94315:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9dc06b98f100 x1870854458219392/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1784189301.972126:0:94315:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000020:01000000:1.0:1784189301.972188:0:94315:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1784189301.972192:0:94315:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784189301.972194:0:94315:0:(obd_config.c:1561:class_process_config()) marker 17 (0x2) lustre-MDT0001 add osp 00000020:01000000:1.0:1784189301.972197:0:94315:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1784189301.972199:0:94315:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #19 00000020:01000000:1.0:1784189301.972201:0:94315:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1784189301.972202:0:94315:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1784189301.972204:0:94315:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1784189301.972206:0:94315:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784189301.972207:0:94315:0:(obd_config.c:1561:class_process_config()) marker 19 (0x6) lustre sys.timeout 00000020:01000000:1.0:1784189301.972210:0:94315:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1784189301.972214:0:94315:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:1.0:1784189301.972217:0:94315:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784189301.972218:0:94315:0:(obd_config.c:1561:class_process_config()) marker 22 (0x1) lustre-OST0000 add osc 00000020:00000080:1.0:1784189301.972221:0:94315:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1784189301.972224:0:94315:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.203.112@tcp to nid 0x20000c0a8cb70 (192.168.203.112@tcp) 00000020:01000000:1.0:1784189301.972245:0:94315:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:1.0:1784189301.972247:0:94315:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1784189301.972257:0:94315:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff9dbf420019c0) 00000020:00000080:1.0:1784189301.972271:0:94315:0:(obd_config.c:720:class_attach_name()) OBD: dev 22 attached type osp with refcount 2 00000020:00000080:1.0:1784189301.972274:0:94315:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1784189301.972353:0:94315:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:1.0:1784189301.972359:0:94315:0:(osd_handler.c:8929:osd_obd_connect()) connect #6 00000020:00000080:1.0:1784189301.972365:0:94315:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xcc1762b626f8c61b 00010000:00080000:1.0:1784189301.972389:0:94315:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9dc075655000@lustre-OST0000-osc-MDT0000: add connection 192.168.203.112@tcp at head 00010000:00010000:1.0:1784189301.972567:0:94315:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-10 is initialized 00000100:00100000:2.0:1784189301.972839:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc06b98f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3639:1870854458219392:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1784189301.972906:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784189301.973015:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458219392 00000100:00100000:3.0:1784189301.973023:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458219392 00000100:00100000:3.0:1784189301.973059:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3919 00000100:00100000:3.0:1784189301.973066:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc056ead880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3639:x1870854458219392:12345-0@lo:38:llog_process_th.0 00010000:00080000:3.0:1784189301.973091:0:8438:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 3544 last 0 00000020:00000080:3.0:1784189301.973121:0:8438:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xcc1762b626f8c622 00000004:00100000:3.0:1784189301.973135:0:8438:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1784189301.973244:0:8438:0:(import.c:65:import_set_state_nolock()) ffff9dc047a85000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1784189301.973424:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc056ead880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3639:x1870854458219392:12345-0@lo:38:llog_process_th.0 Request processed in 356us (517us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189301.973433:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3919 00000100:00100000:1.0:1784189301.974046:0:3639:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1784189301.974064:0:3639:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-osp-MDT0000: connect to target with instance 19 00000100:00080000:1.0:1784189301.974072:0:3639:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-osp-MDT0000: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:1.0:1784189301.974078:0:3639:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:1.0:1784189301.974080:0:3639:0:(import.c:65:import_set_state_nolock()) ffff9dbf436c1800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1784189301.974092:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc06b98f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3639:1870854458219392:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1784189301.974967:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1784189301.974980:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc056eaed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1870854458219520:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1784189301.975026:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784189301.975064:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458219520 00000100:00100000:3.0:1784189301.975069:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458219520 00000100:00100000:3.0:1784189301.975104:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3920 00000100:00100000:3.0:1784189301.975112:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf469b4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3643:x1870854458219520:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1784189301.975136:0:8439:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445568512 avail 1299329024 00000100:00100000:3.0:1784189301.975185:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf469b4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3643:x1870854458219520:12345-0@lo:41:osp-pre-1-0.0 Request processed in 74us (158us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189301.975192:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3920 00000100:00100000:3.0:1784189301.975225:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc056eaed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1870854458219520:0@lo:41:osp-pre-1-0.0 00000040:01000000:2.0:1784189301.975349:0:94315:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1784189301.975373:0:94315:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:2.0:1784189301.975805:0:94315:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0x1:0x2:0x0] first idx 26, last_idx 27 00000040:00080000:2.0:1784189301.976492:0:94315:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1784189301.976517:0:94315:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].28, 64 off9984 00000040:00080000:2.0:1784189301.976651:0:94315:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x70:0x0].1, 64 off8256 00000040:00080000:3.0:1784189301.980423:0:94321:0:(llog.c:805:llog_process_thread()) index: 27, lh_last_idx: 28 synced_idx: 0 lgh_last_idx: 28 00000040:00080000:3.0:1784189301.980431:0:94321:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x6c:0x0] at index 27 of catalog [0x1:0x2:0x0] 00000040:00080000:3.0:1784189301.980618:0:94321:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0x1:0x2:0x0] first idx 27, last_idx 28 00000040:00080000:3.0:1784189301.980638:0:94321:0:(llog_cat_server.c:902:llog_cat_cleanup()) cancel plain log [0x1:0x6c:0x0] at index 27 of catalog [0x1:0x2:0x0] 00000040:00080000:3.0:1784189301.980772:0:94321:0:(llog.c:805:llog_process_thread()) index: 28, lh_last_idx: 28 synced_idx: 28 lgh_last_idx: 28 00000040:00080000:3.0:1784189301.980776:0:94321:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x70:0x0] at index 28 of catalog [0x1:0x2:0x0] 00000020:00000080:3.0:1784189301.982070:0:94315:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1784189301.982081:0:94315:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1784189301.982119:0:94315:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:3.0:1784189301.982139:0:94315:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xcc1762b626f8c629 00000100:00080000:3.0:1784189301.982158:0:94315:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1784189301.982163:0:94315:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9dc075655000 using connection 192.168.203.112@tcp/0@lo 00000100:00100000:3.0:1784189301.982198:0:94315:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9dbf469b7800 x1870854458219648/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1784189301.982223:0:94315:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:3.0:1784189301.982285:0:94315:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1784189301.982289:0:94315:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784189301.982290:0:94315:0:(obd_config.c:1561:class_process_config()) marker 22 (0x2) lustre-OST0000 add osc 00000020:01000000:3.0:1784189301.982293:0:94315:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1784189301.982295:0:94315:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #26 00000020:01000000:3.0:1784189301.982297:0:94315:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1784189301.982298:0:94315:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1784189301.982299:0:94315:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1784189301.982301:0:94315:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784189301.982302:0:94315:0:(obd_config.c:1561:class_process_config()) marker 26 (0x6) lustre sys.timeout 00000020:01000000:3.0:1784189301.982304:0:94315:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1784189301.982308:0:94315:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:3.0:1784189301.982310:0:94315:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784189301.982311:0:94315:0:(obd_config.c:1561:class_process_config()) marker 30 (0x1) lustre-OST0001 add osc 00000020:00000080:3.0:1784189301.982314:0:94315:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1784189301.982334:0:94315:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.203.112@tcp to nid 0x20000c0a8cb70 (192.168.203.112@tcp) 00000020:01000000:3.0:1784189301.982358:0:94315:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1784189301.982360:0:94315:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1784189301.982371:0:94315:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff9dbf431299c0) 00000020:00000080:3.0:1784189301.982386:0:94315:0:(obd_config.c:720:class_attach_name()) OBD: dev 27 attached type osp with refcount 2 00000020:00000080:3.0:1784189301.982391:0:94315:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1784189301.982458:0:94315:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:3.0:1784189301.982464:0:94315:0:(osd_handler.c:8929:osd_obd_connect()) connect #7 00000020:00000080:3.0:1784189301.982469:0:94315:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xcc1762b626f8c637 00010000:00080000:3.0:1784189301.982497:0:94315:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9dbf4845c000@lustre-OST0001-osc-MDT0000: add connection 192.168.203.112@tcp at head 00000100:00100000:1.0:1784189301.982583:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf469b7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3639:1870854458219648:0@lo:8:llog_process_th.0 00000100:00100000:1.0:1784189301.982701:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784189301.982788:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458219648 00000100:00100000:2.0:1784189301.982796:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458219648 00010000:00010000:3.0:1784189301.982812:0:94315:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-11 is initialized 00000100:00100000:2.0:1784189301.982860:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4990 00000100:00100000:2.0:1784189301.982869:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc06b98f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3639:x1870854458219648:12345-0@lo:8:llog_process_th.0 00000040:01000000:3.0:1784189301.982878:0:94315:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:3.0:1784189301.982890:0:94315:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00010000:00080000:2.0:1784189301.982893:0:8428:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 3544 last 0 00000020:00000080:2.0:1784189301.982914:0:8428:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xcc1762b626f8c63e 00002000:00100000:2.0:1784189301.982926:0:8428:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff9dbf43e98000 ocd_connect_flags: 0xa044401443000026 ocd_version: 21136a2 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:2.0:1784189301.982930:0:8428:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:2.0:1784189301.982932:0:8428:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1784189301.982993:0:8428:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1784189301.983013:0:8428:0:(import.c:65:import_set_state_nolock()) ffff9dbf43e99000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1784189301.983079:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc06b98f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3639:x1870854458219648:12345-0@lo:8:llog_process_th.0 Request processed in 210us (377us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189301.983087:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4990 00000100:00100000:1.0:1784189301.983165:0:3639:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1784189301.983173:0:3639:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 1 00000100:00080000:1.0:1784189301.983180:0:3639:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1784189301.983185:0:3639:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:1.0:1784189301.983187:0:3639:0:(import.c:65:import_set_state_nolock()) ffff9dc075655000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1784189301.983200:0:3639:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1784189301.983205:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf469b7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3639:1870854458219648:0@lo:8:llog_process_th.0 00000004:00080000:1.0:1784189301.983226:0:94321:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1784189301.983270:0:94321:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 3544206950220ns, next at 0ns, rc = 0 00080000:00080000:1.0:1784189301.983276:0:94321:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0000: async commit OSD 00000040:00080000:3.0:1784189301.984381:0:94315:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0x1:0x5:0x0] first idx 26, last_idx 27 00000100:00100000:1.0:1784189301.985177:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1784189301.985194:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc06b98e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1870854458219776:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1784189301.985245:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784189301.985314:0:9466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458219776 00000100:00100000:0.0:1784189301.985343:0:9466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458219776 00000100:00100000:0.0:1784189301.985395:0:9466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2044 00000100:00100000:0.0:1784189301.985403:0:9466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc06b98f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3642:x1870854458219776:12345-0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1784189301.985425:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00000024:0.0:1784189301.985427:0:9466:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 210112 pending 0 free 3922481152 avail 3690958848 00000100:00100000:0.0:1784189301.985486:0:9466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc06b98f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3642:x1870854458219776:12345-0@lo:13:osp-pre-0-0.0 Request processed in 84us (240us total) trans 0 rc 0/0 00000100:00100000:0.0:1784189301.985493:0:9466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2044 00000100:00100000:1.0:1784189301.985614:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc06b98e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1870854458219776:0@lo:13:osp-pre-0-0.0 00000040:00080000:3.0:1784189301.987300:0:94315:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1784189301.988099:0:94315:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].28, 64 off9984 00000040:00080000:3.0:1784189301.988284:0:94315:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x72:0x0].1, 64 off8256 00000040:00080000:3.0:1784189301.989028:0:94323:0:(llog.c:805:llog_process_thread()) index: 27, lh_last_idx: 28 synced_idx: 0 lgh_last_idx: 28 00000040:00080000:3.0:1784189301.989034:0:94323:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x6e:0x0] at index 27 of catalog [0x1:0x5:0x0] 00000040:00080000:3.0:1784189301.989181:0:94323:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0x1:0x5:0x0] first idx 27, last_idx 28 00000040:00080000:3.0:1784189301.989198:0:94323:0:(llog_cat_server.c:902:llog_cat_cleanup()) cancel plain log [0x1:0x6e:0x0] at index 27 of catalog [0x1:0x5:0x0] 00000040:00080000:3.0:1784189301.989355:0:94323:0:(llog.c:805:llog_process_thread()) index: 28, lh_last_idx: 28 synced_idx: 28 lgh_last_idx: 28 00000040:00080000:3.0:1784189301.989358:0:94323:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x72:0x0] at index 28 of catalog [0x1:0x5:0x0] 00000020:00000080:3.0:1784189301.990606:0:94315:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1784189301.990622:0:94315:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1784189301.990669:0:94315:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:3.0:1784189301.990693:0:94315:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xcc1762b626f8c645 00000100:00080000:3.0:1784189301.990703:0:94315:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1784189301.990710:0:94315:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9dbf4845c000 using connection 192.168.203.112@tcp/0@lo 00000100:00100000:3.0:1784189301.990749:0:94315:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9dbf469b5880 x1870854458219904/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1784189301.990777:0:94315:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:3.0:1784189301.990823:0:94315:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1784189301.990826:0:94315:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784189301.990828:0:94315:0:(obd_config.c:1561:class_process_config()) marker 30 (0x2) lustre-OST0001 add osc 00000020:01000000:3.0:1784189301.990835:0:94315:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1784189301.990839:0:94315:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784189301.990840:0:94315:0:(obd_config.c:1561:class_process_config()) marker 35 (0x1) lustre sys.timeout 00000020:00000080:3.0:1784189301.990843:0:94315:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1784189301.990845:0:94315:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1784189301.990848:0:94315:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1784189301.990850:0:94315:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784189301.990851:0:94315:0:(obd_config.c:1561:class_process_config()) marker 35 (0x2) lustre sys.timeout 00000020:01000000:3.0:1784189301.990853:0:94315:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1784189301.990862:0:94315:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784189301.990863:0:94315:0:(obd_config.c:1561:class_process_config()) marker 40 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1784189301.990867:0:94315:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000020:01000000:3.0:1784189301.990873:0:94315:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1784189301.990875:0:94315:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784189301.990877:0:94315:0:(obd_config.c:1561:class_process_config()) marker 40 (0x2) lustre sys.jobid_var 00000020:01000000:3.0:1784189301.990879:0:94315:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1784189301.990882:0:94315:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784189301.990884:0:94315:0:(obd_config.c:1561:class_process_config()) marker 43 (0x1) lustre-MDT0000-m new lustre.pool_134 00000020:00000080:3.0:1784189301.990886:0:94315:0:(obd_config.c:1470:class_process_config()) processing cmd: ce020 00020000:01000000:3.0:1784189301.990928:0:94315:0:(lod_pool.c:475:lod_pool_new()) pool_134 is pool #1 00000100:00100000:2.0:1784189301.991356:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf469b5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3639:1870854458219904:0@lo:8:llog_process_th.0 00000100:00100000:2.0:1784189301.991423:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784189301.991460:0:26159:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458219904 00000100:00100000:0.0:1784189301.991468:0:26159:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458219904 00000100:00100000:0.0:1784189301.991500:0:26159:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4991 00000100:00100000:0.0:1784189301.991508:0:26159:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc056eaf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0+-99:3639:x1870854458219904:12345-0@lo:8:llog_process_th.0 00010000:00080000:0.0:1784189301.991533:0:26159:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 3544 last 0 00000020:00000080:0.0:1784189301.991555:0:26159:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xcc1762b626f8c64c 00002000:00100000:0.0:1784189301.991567:0:26159:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff9dbf47452800 ocd_connect_flags: 0xa044401443000026 ocd_version: 21136a2 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:0.0:1784189301.991571:0:26159:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:0.0:1784189301.991580:0:26159:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1784189301.991637:0:26159:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1784189301.991670:0:26159:0:(import.c:65:import_set_state_nolock()) ffff9dc05f22b000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1784189301.991697:0:94315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf469b4e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bd553d0d-03e2-4233-b06b-b55bbfa2b954:94315:1870854458220032:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1784189301.991719:0:26159:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc056eaf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+6:3639:x1870854458219904:12345-0@lo:8:llog_process_th.0 Request processed in 211us (296us total) trans 0 rc 0/0 00000100:00100000:0.0:1784189301.991726:0:26159:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4991 00000100:00100000:3.0:1784189301.991736:0:94315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784189301.991762:0:3639:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1784189301.991770:0:3639:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 1 00000100:00080000:0.0:1784189301.991777:0:3639:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1784189301.991781:0:3639:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:0.0:1784189301.991784:0:3639:0:(import.c:65:import_set_state_nolock()) ffff9dbf4845c000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1784189301.991796:0:3639:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1784189301.991802:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf469b5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3639:1870854458219904:0@lo:8:llog_process_th.0 00000100:00100000:0.0:1784189301.991846:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc056eafb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1870854458220160:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1784189301.991865:0:94315:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dbf464c26c0 going to sleep for 11 seconds 00000100:00100000:0.0:1784189301.991876:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:3.0:1784189301.991879:0:94323:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000100:00100000:0.0:1784189301.991910:0:94314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458220032 00000100:00100000:0.0:1784189301.991914:0:94314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458220032 00000004:00080000:3.0:1784189301.991919:0:94323:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 3544215599677ns, next at 0ns, rc = 0 00080000:00080000:3.0:1784189301.991924:0:94323:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00100000:0.0:1784189301.991943:0:94308:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1784189301.991950:0:94308:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc044984450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd553d0d-03e2-4233-b06b-b55bbfa2b954+8:94315:x1870854458220032:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1784189301.992048:0:94308:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc044984450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd553d0d-03e2-4233-b06b-b55bbfa2b954+8:94315:x1870854458220032:12345-0@lo:502:llog_process_th.0 Request processed in 97us (310us total) trans 0 rc 0/0 00000100:00100000:0.0:1784189301.992055:0:94308:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000004:00080000:1.0:1784189301.992118:0:94304:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00000100:00100000:3.0:1784189301.992448:0:94315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf469b4e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bd553d0d-03e2-4233-b06b-b55bbfa2b954:94315:1870854458220032:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1784189301.992468:0:94315:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1784189301.992473:0:94315:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784189301.992475:0:94315:0:(obd_config.c:1561:class_process_config()) marker 43 (0x2) lustre-MDT0000-m new lustre.pool_134 00000020:01000000:3.0:1784189301.992478:0:94315:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1784189301.992481:0:94315:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784189301.992482:0:94315:0:(obd_config.c:1561:class_process_config()) marker 46 (0x1) lustre-MDT0000-m add lustre.pool_134.lustre-OST0001_UUID 00000020:00000080:3.0:1784189301.992485:0:94315:0:(obd_config.c:1470:class_process_config()) processing cmd: ce021 00020000:01000000:3.0:1784189301.992496:0:94315:0:(lod_pool.c:594:lod_pool_add()) Added lustre-OST0001_UUID to pool_134 as member 1 00000100:00100000:2.0:1784189301.992990:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458220160 00000100:00100000:2.0:1784189301.992996:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458220160 00000100:00100000:2.0:1784189301.993047:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2045 00000100:00100000:2.0:1784189301.993054:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc07b5b3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3640:x1870854458220160:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1784189301.993074:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 210112 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1784189301.993118:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc07b5b3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3640:x1870854458220160:12345-0@lo:13:osp-pre-1-0.0 Request processed in 64us (1241us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189301.993125:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2045 00000100:00100000:0.0:1784189301.993217:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc056eafb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1870854458220160:0@lo:13:osp-pre-1-0.0 00000100:00080000:3.0:1784189301.993954:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:2.0:1784189301.994483:0:94304:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000100:00100000:3.0:1784189301.995231:0:94315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf469b4e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bd553d0d-03e2-4233-b06b-b55bbfa2b954:94315:1870854458220288:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1784189301.995305:0:94315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784189301.995371:0:94315:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dbf464c26c0 going to sleep for 11 seconds 00000100:00100000:1.0:1784189301.995429:0:94310:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458220288 00000100:00100000:1.0:1784189301.995436:0:94310:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458220288 00000100:00100000:1.0:1784189301.995471:0:94310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1784189301.995487:0:94310:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc044984850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd553d0d-03e2-4233-b06b-b55bbfa2b954+8:94315:x1870854458220288:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1784189301.995679:0:94310:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc044984850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd553d0d-03e2-4233-b06b-b55bbfa2b954+8:94315:x1870854458220288:12345-0@lo:502:llog_process_th.0 Request processed in 193us (372us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189301.995687:0:94310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1784189301.995809:0:94315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf469b4e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bd553d0d-03e2-4233-b06b-b55bbfa2b954:94315:1870854458220288:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1784189301.995841:0:94315:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1784189301.995847:0:94315:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784189301.995849:0:94315:0:(obd_config.c:1561:class_process_config()) marker 46 (0x2) lustre-MDT0000-m add lustre.pool_134.lustre-OST0001_UUID 00000040:00080000:3.0:1784189301.995853:0:94315:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 53 count 52 00000020:01000000:1.0:1784189301.996080:0:94303:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-52 (rc=0) 10000000:01000000:1.0:1784189301.996102:0:94303:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1784189301.996122:0:94303:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff9dc04a20b400/0xcc1762b626f8c58f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc1762b626f8c596 expref: -99 pid: 94303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189301.996133:0:94303:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: ffff9dc04a20b400/0xcc1762b626f8c58f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc1762b626f8c596 expref: -99 pid: 94303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784189301.996141:0:94303:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff9dc07a8f1800 from 1 10000000:01000000:1.0:1784189301.996153:0:94303:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1784189301.996179:0:94303:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff9dbf4710e000/0xcc1762b626f8c653 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 94303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189301.996186:0:94303:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: ffff9dbf4710e000/0xcc1762b626f8c653 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 94303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189301.996195:0:94303:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: ffff9dbf4710e000/0xcc1762b626f8c653 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 94303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784189301.996207:0:94303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc06b98e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd553d0d-03e2-4233-b06b-b55bbfa2b954:94303:1870854458220416:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1784189301.996236:0:94303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784189301.996259:0:94303:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dbf4376f480 going to sleep for 11 seconds 00000100:00100000:2.0:1784189301.996376:0:94309:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458220416 00000100:00100000:2.0:1784189301.996381:0:94309:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458220416 00000100:00100000:2.0:1784189301.996414:0:94309:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1784189301.996421:0:94309:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc044986850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd553d0d-03e2-4233-b06b-b55bbfa2b954+8:94303:x1870854458220416:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1784189301.996429:0:94309:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784189301.996442:0:94309:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dc04a20a200/0xcc1762b626f8c65a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xcc1762b626f8c653 expref: -99 pid: 94309 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189301.996464:0:94309:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dc04a20a200/0xcc1762b626f8c65a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcc1762b626f8c653 expref: 9 pid: 94309 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189301.996473:0:94309:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dc04a20a200/0xcc1762b626f8c65a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcc1762b626f8c653 expref: 9 pid: 94309 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189301.996482:0:94309:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc04a20a200, rc 0) 00000100:00100000:2.0:1784189301.996770:0:94309:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc044986850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd553d0d-03e2-4233-b06b-b55bbfa2b954+9:94303:x1870854458220416:12345-0@lo:101:mount.lustre.0 Request processed in 349us (532us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189301.996787:0:94309:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1784189301.996894:0:94303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc06b98e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd553d0d-03e2-4233-b06b-b55bbfa2b954:94303:1870854458220416:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1784189301.996908:0:94303:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: ffff9dbf4710e000/0xcc1762b626f8c653 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc1762b626f8c65a expref: -99 pid: 94303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189301.996917:0:94303:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: ffff9dbf4710e000/0xcc1762b626f8c653 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcc1762b626f8c65a expref: -99 pid: 94303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784189301.997582:0:94303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf469b4e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd553d0d-03e2-4233-b06b-b55bbfa2b954:94303:1870854458220544:0@lo:256:mount.lustre.0 00000100:00100000:3.0:1784189301.997725:0:94303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784189301.997753:0:94303:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dbf464c26c0 going to sleep for 11 seconds 00000100:00100000:1.0:1784189301.997817:0:94310:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458220544 00000100:00100000:1.0:1784189301.997823:0:94310:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458220544 00000100:00100000:1.0:1784189301.997864:0:94310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1784189301.997879:0:94310:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc044987050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd553d0d-03e2-4233-b06b-b55bbfa2b954+9:94303:x1870854458220544:12345-0@lo:256:mount.lustre.0 20000000:01000000:1.0:1784189301.997895:0:94310:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:1.0:1784189301.997910:0:94310:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1784189301.997914:0:94310:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:1.0:1784189301.997917:0:94310:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:1.0:1784189301.997920:0:94310:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 123 00000100:00100000:1.0:1784189301.998006:0:94310:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc044987050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd553d0d-03e2-4233-b06b-b55bbfa2b954+9:94303:x1870854458220544:12345-0@lo:256:mount.lustre.0 Request processed in 128us (281us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189301.998014:0:94310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1784189301.998201:0:94303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf469b4e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd553d0d-03e2-4233-b06b-b55bbfa2b954:94303:1870854458220544:0@lo:256:mount.lustre.0 10000000:01000000:3.0:1784189302.001647:0:94303:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1784189302.001777:0:94303:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff9dbf4710e000/0xcc1762b626f8c653 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc1762b626f8c65a expref: -99 pid: 94303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189302.001792:0:94303:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: ffff9dbf4710e000/0xcc1762b626f8c653 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc1762b626f8c65a expref: -99 pid: 94303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784189302.001800:0:94303:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9dc07a8f1800 from 1 10000000:01000000:3.0:1784189302.001803:0:94303:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1784189302.001848:0:94303:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff9dc058f67000/0xcc1762b626f8c661 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 94303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189302.001856:0:94303:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: ffff9dc058f67000/0xcc1762b626f8c661 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 94303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189302.001880:0:94303:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: ffff9dc058f67000/0xcc1762b626f8c661 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 94303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784189302.001905:0:94303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf469b4e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd553d0d-03e2-4233-b06b-b55bbfa2b954:94303:1870854458220672:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1784189302.001975:0:94303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784189302.002015:0:94303:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dbf464c26c0 going to sleep for 11 seconds 00000020:01000004:0.0:1784189302.002275:0:94325:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9dc07a8f1800 from lustre-MDT0000, refs=4 00000020:01000004:0.0:1784189302.002280:0:94325:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9dc07a8f1800 4 00000100:00100000:2.0:1784189302.002347:0:94309:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458220672 00000100:00100000:2.0:1784189302.002355:0:94309:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458220672 00000100:00100000:2.0:1784189302.002403:0:94309:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1784189302.002412:0:94309:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc044941450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd553d0d-03e2-4233-b06b-b55bbfa2b954+9:94303:x1870854458220672:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1784189302.002424:0:94309:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784189302.002437:0:94309:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dc04a20b600/0xcc1762b626f8c668 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xcc1762b626f8c661 expref: -99 pid: 94309 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189302.002459:0:94309:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dc04a20b600/0xcc1762b626f8c668 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcc1762b626f8c661 expref: 10 pid: 94309 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189302.002468:0:94309:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dc04a20b600/0xcc1762b626f8c668 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcc1762b626f8c661 expref: 10 pid: 94309 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189302.002476:0:94309:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc04a20b600, rc 0) 00000100:00100000:2.0:1784189302.002711:0:94309:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc044941450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd553d0d-03e2-4233-b06b-b55bbfa2b954+10:94303:x1870854458220672:12345-0@lo:101:mount.lustre.0 Request processed in 300us (735us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189302.002719:0:94309:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1784189302.002813:0:94303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf469b4e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd553d0d-03e2-4233-b06b-b55bbfa2b954:94303:1870854458220672:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1784189302.002839:0:94303:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: ffff9dc058f67000/0xcc1762b626f8c661 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc1762b626f8c668 expref: -99 pid: 94303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189302.002848:0:94303:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: ffff9dc058f67000/0xcc1762b626f8c661 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcc1762b626f8c668 expref: -99 pid: 94303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784189302.002917:0:94303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc07fb37800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd553d0d-03e2-4233-b06b-b55bbfa2b954:94303:1870854458220800:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1784189302.002944:0:94303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784189302.002971:0:94303:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dc06bb82300 going to sleep for 11 seconds 00000100:00100000:2.0:1784189302.003113:0:94314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458220800 00000100:00100000:2.0:1784189302.003118:0:94314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458220800 00000100:00100000:2.0:1784189302.003157:0:94314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1784189302.003164:0:94314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc044943c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:bd553d0d-03e2-4233-b06b-b55bbfa2b954+10:94303:x1870854458220800:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1784189302.003281:0:94314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc044943c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:bd553d0d-03e2-4233-b06b-b55bbfa2b954+10:94303:x1870854458220800:12345-0@lo:501:mount.lustre.0 Request processed in 117us (336us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189302.003289:0:94314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1784189302.003368:0:94303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc07fb37800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd553d0d-03e2-4233-b06b-b55bbfa2b954:94303:1870854458220800:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1784189302.003397:0:94303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc07fb37800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd553d0d-03e2-4233-b06b-b55bbfa2b954:94303:1870854458220928:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1784189302.003434:0:94303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784189302.003460:0:94303:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dc06bb82300 going to sleep for 11 seconds 00000100:00100000:2.0:1784189302.003577:0:94310:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458220928 00000100:00100000:2.0:1784189302.003587:0:94310:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458220928 00000100:00100000:2.0:1784189302.003629:0:94310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1784189302.003636:0:94310:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc044940850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd553d0d-03e2-4233-b06b-b55bbfa2b954+10:94303:x1870854458220928:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1784189302.003713:0:94310:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc044940850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd553d0d-03e2-4233-b06b-b55bbfa2b954+10:94303:x1870854458220928:12345-0@lo:503:mount.lustre.0 Request processed in 78us (278us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189302.003720:0:94310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1784189302.003760:0:94303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc07fb37800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd553d0d-03e2-4233-b06b-b55bbfa2b954:94303:1870854458220928:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1784189302.005899:0:94326:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf469b4380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bd553d0d-03e2-4233-b06b-b55bbfa2b954:94326:1870854458221056:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1784189302.005977:0:94326:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784189302.006018:0:94326:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dbf464c2300 going to sleep for 11 seconds 00000100:00100000:0.0:1784189302.006348:0:94314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458221056 00000100:00100000:0.0:1784189302.006356:0:94314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458221056 00000100:00100000:0.0:1784189302.006394:0:94314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1784189302.006402:0:94314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc044943050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:bd553d0d-03e2-4233-b06b-b55bbfa2b954+10:94326:x1870854458221056:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1784189302.007946:0:94314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc044943050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:bd553d0d-03e2-4233-b06b-b55bbfa2b954+10:94326:x1870854458221056:12345-0@lo:502:llog_process_th.0 Request processed in 1538us (1962us total) trans 0 rc 0/0 00000100:00100000:0.0:1784189302.007957:0:94314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1784189302.008125:0:94326:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf469b4380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bd553d0d-03e2-4233-b06b-b55bbfa2b954:94326:1870854458221056:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1784189302.008167:0:94326:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1784189302.008176:0:94326:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784189302.008177:0:94326:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1784189302.008185:0:94326:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9dc07a8f1800 00000020:00000080:3.0:1784189302.008187:0:94326:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1784189302.008195:0:94326:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1784189302.008197:0:94326:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784189302.008199:0:94326:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:3.0:1784189302.008201:0:94326:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1784189302.008202:0:94326:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784189302.008203:0:94326:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1784189302.008206:0:94326:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9dc07a8f1800 00000020:00000080:3.0:1784189302.008208:0:94326:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1784189302.008288:0:94326:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf469b4380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bd553d0d-03e2-4233-b06b-b55bbfa2b954:94326:1870854458221184:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1784189302.008363:0:94326:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784189302.008392:0:94326:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dbf464c2300 going to sleep for 11 seconds 00000100:00100000:2.0:1784189302.008420:0:94310:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458221184 00000100:00100000:2.0:1784189302.008427:0:94310:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458221184 00000100:00100000:2.0:1784189302.008524:0:94310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1784189302.008534:0:94310:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc044941850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd553d0d-03e2-4233-b06b-b55bbfa2b954+10:94326:x1870854458221184:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1784189302.008624:0:94310:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc044941850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd553d0d-03e2-4233-b06b-b55bbfa2b954+10:94326:x1870854458221184:12345-0@lo:502:llog_process_th.0 Request processed in 92us (260us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189302.008644:0:94310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1784189302.008725:0:94326:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf469b4380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bd553d0d-03e2-4233-b06b-b55bbfa2b954:94326:1870854458221184:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1784189302.008746:0:94326:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1784189302.008751:0:94326:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784189302.008754:0:94326:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:1.0:1784189302.008758:0:94326:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:1.0:1784189302.009380:0:94303:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-6 (rc=0) 10000000:01000000:1.0:1784189302.009403:0:94303:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1784189302.009423:0:94303:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff9dc058f67000/0xcc1762b626f8c661 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc1762b626f8c668 expref: -99 pid: 94303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189302.009435:0:94303:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: ffff9dc058f67000/0xcc1762b626f8c661 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc1762b626f8c668 expref: -99 pid: 94303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784189302.009493:0:94303:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1784189302.009497:0:94303:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9dc07a8f1800 10000000:01000000:1.0:1784189302.009505:0:94303:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9dc07a8f1800 10000000:01000000:1.0:1784189302.009510:0:94303:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1784189302.009515:0:94303:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9dc07a8f1800 from 1 10000000:01000000:1.0:1784189302.009518:0:94303:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1784189302.009543:0:94303:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff9dbf4710e400/0xcc1762b626f8c66f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 94303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189302.009559:0:94303:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: ffff9dbf4710e400/0xcc1762b626f8c66f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 94303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189302.009569:0:94303:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: ffff9dbf4710e400/0xcc1762b626f8c66f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 94303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784189302.009587:0:94303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc06b98e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd553d0d-03e2-4233-b06b-b55bbfa2b954:94303:1870854458221312:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1784189302.009627:0:94303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784189302.009672:0:94303:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dbf4376fb40 going to sleep for 11 seconds 00000100:00100000:2.0:1784189302.009766:0:94308:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458221312 00000100:00100000:2.0:1784189302.009772:0:94308:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458221312 00000100:00100000:2.0:1784189302.009815:0:94308:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1784189302.009824:0:94308:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc044941c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd553d0d-03e2-4233-b06b-b55bbfa2b954+10:94303:x1870854458221312:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1784189302.009834:0:94308:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784189302.009847:0:94308:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dc04a20b200/0xcc1762b626f8c676 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xcc1762b626f8c66f expref: -99 pid: 94308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189302.009869:0:94308:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dc04a20b200/0xcc1762b626f8c676 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcc1762b626f8c66f expref: 11 pid: 94308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189302.009880:0:94308:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dc04a20b200/0xcc1762b626f8c676 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcc1762b626f8c66f expref: 11 pid: 94308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189302.009901:0:94308:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc04a20b200, rc 0) 00000100:00100000:2.0:1784189302.009946:0:94308:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc044941c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd553d0d-03e2-4233-b06b-b55bbfa2b954+11:94303:x1870854458221312:12345-0@lo:101:mount.lustre.0 Request processed in 124us (317us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189302.009952:0:94308:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1784189302.010022:0:94303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc06b98e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd553d0d-03e2-4233-b06b-b55bbfa2b954:94303:1870854458221312:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1784189302.010036:0:94303:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: ffff9dbf4710e400/0xcc1762b626f8c66f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc1762b626f8c676 expref: -99 pid: 94303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189302.010045:0:94303:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: ffff9dbf4710e400/0xcc1762b626f8c66f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xcc1762b626f8c676 expref: -99 pid: 94303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784189302.010099:0:94303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc06b98e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd553d0d-03e2-4233-b06b-b55bbfa2b954:94303:1870854458221440:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1784189302.010129:0:94303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784189302.010161:0:94303:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dbf4376fb40 going to sleep for 11 seconds 00000100:00100000:3.0:1784189302.010196:0:94314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458221440 00000100:00100000:3.0:1784189302.010207:0:94314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458221440 00000100:00100000:3.0:1784189302.010238:0:94314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1784189302.010246:0:94314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc044942850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:bd553d0d-03e2-4233-b06b-b55bbfa2b954+11:94303:x1870854458221440:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1784189302.010364:0:94314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc044942850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:bd553d0d-03e2-4233-b06b-b55bbfa2b954+11:94303:x1870854458221440:12345-0@lo:501:mount.lustre.0 Request processed in 119us (234us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189302.010372:0:94314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1784189302.010474:0:94303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc06b98e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd553d0d-03e2-4233-b06b-b55bbfa2b954:94303:1870854458221440:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1784189302.010505:0:94303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc06b98e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd553d0d-03e2-4233-b06b-b55bbfa2b954:94303:1870854458221568:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1784189302.011047:0:94303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784189302.011077:0:94303:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dbf4376fb40 going to sleep for 11 seconds 00000100:00100000:2.0:1784189302.011128:0:94308:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458221568 00000100:00100000:2.0:1784189302.011133:0:94308:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458221568 00000100:00100000:2.0:1784189302.011201:0:94308:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1784189302.011209:0:94308:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc044942450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd553d0d-03e2-4233-b06b-b55bbfa2b954+11:94303:x1870854458221568:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1784189302.011426:0:94308:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc044942450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd553d0d-03e2-4233-b06b-b55bbfa2b954+11:94303:x1870854458221568:12345-0@lo:503:mount.lustre.0 Request processed in 217us (379us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189302.011434:0:94308:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1784189302.011509:0:94303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc06b98e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd553d0d-03e2-4233-b06b-b55bbfa2b954:94303:1870854458221568:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1784189302.012513:0:94328:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc06b98e300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bd553d0d-03e2-4233-b06b-b55bbfa2b954:94328:1870854458221696:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1784189302.012564:0:94328:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784189302.012709:0:94328:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dbf4376f240 going to sleep for 11 seconds 00000100:00100000:0.0:1784189302.012907:0:94310:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458221696 00000100:00100000:0.0:1784189302.012913:0:94310:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458221696 00000100:00100000:0.0:1784189302.013021:0:94310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1784189302.013033:0:94310:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf44915450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd553d0d-03e2-4233-b06b-b55bbfa2b954+11:94328:x1870854458221696:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1784189302.013501:0:94310:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf44915450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd553d0d-03e2-4233-b06b-b55bbfa2b954+11:94328:x1870854458221696:12345-0@lo:502:llog_process_th.0 Request processed in 470us (935us total) trans 0 rc 0/0 00000100:00100000:0.0:1784189302.013587:0:94310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1784189302.013843:0:94328:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc06b98e300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bd553d0d-03e2-4233-b06b-b55bbfa2b954:94328:1870854458221696:0@lo:502:llog_process_th.0 00000020:01000004:1.0:1784189302.013900:0:94328:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:1.0:1784189302.013913:0:94328:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff9dc0762999c0) 00000020:00000080:1.0:1784189302.013936:0:94328:0:(obd_config.c:720:class_attach_name()) OBD: dev 28 attached type lwp with refcount 2 00000020:01000004:1.0:1784189302.014111:0:94328:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9dc07a8f1800 from lustre-MDT0000, refs=4 00000020:01000004:1.0:1784189302.014115:0:94328:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9dc07a8f1800 from lustre-MDT0000, refs=4 00000020:01000004:1.0:1784189302.014118:0:94328:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9dc07a8f1800 4 00010000:00080000:1.0:1784189302.014155:0:94328:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9dbf43fcb000@lustre-MDT0000-lwp-MDT0000: add connection 192.168.203.112@tcp at head 00010000:00010000:1.0:1784189302.023645:0:94328:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-12 is initialized 00000020:00000080:1.0:1784189302.023748:0:94328:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:1.0:1784189302.023799:0:94328:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1784189302.023814:0:94328:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0xcc1762b626f8c684 00000100:00080000:1.0:1784189302.023825:0:94328:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1784189302.023832:0:94328:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff9dbf43fcb000 using connection 192.168.203.112@tcp/0@lo 00000100:00100000:1.0:1784189302.023871:0:94328:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9dc06b98e300 x1870854458221824/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1784189302.023908:0:94328:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1784189302.024235:0:94328:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc06b98e680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bd553d0d-03e2-4233-b06b-b55bbfa2b954:94328:1870854458221952:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1784189302.024313:0:94328:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784189302.024386:0:94309:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458221952 00000100:00100000:2.0:1784189302.024393:0:94309:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458221952 00000100:00100000:1.0:1784189302.024401:0:94328:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dbf4376f240 going to sleep for 11 seconds 00000100:00100000:2.0:1784189302.024435:0:94309:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1784189302.024443:0:94309:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf44914050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd553d0d-03e2-4233-b06b-b55bbfa2b954+11:94328:x1870854458221952:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1784189302.024662:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc06b98e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3639:1870854458221824:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1784189302.024699:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784189302.024915:0:66945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458221824 00000100:00100000:1.0:1784189302.024920:0:66945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458221824 00000100:00100000:1.0:1784189302.024950:0:66945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1421 00000100:00100000:1.0:1784189302.024955:0:66945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc07fb37800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3639:x1870854458221824:12345-0@lo:38:llog_process_th.0 00000100:00100000:1.0:1784189302.025190:0:66945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc07fb37800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3639:x1870854458221824:12345-0@lo:38:llog_process_th.0 Request processed in 232us (489us total) trans 0 rc -11/-11 00000100:00100000:1.0:1784189302.025207:0:66945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1421 00000100:00100000:0.0:1784189302.025280:0:3639:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1784189302.025288:0:3639:0:(import.c:65:import_set_state_nolock()) ffff9dbf43fcb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1784189302.025291:0:3639:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1784189302.025294:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc06b98e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3639:1870854458221824:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1784189302.027584:0:94309:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf44914050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd553d0d-03e2-4233-b06b-b55bbfa2b954+11:94328:x1870854458221952:12345-0@lo:502:llog_process_th.0 Request processed in 3133us (3262us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189302.027599:0:94309:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1784189302.027697:0:94328:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc06b98e680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bd553d0d-03e2-4233-b06b-b55bbfa2b954:94328:1870854458221952:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1784189302.027775:0:94328:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc06b98e680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bd553d0d-03e2-4233-b06b-b55bbfa2b954:94328:1870854458222080:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1784189302.027848:0:94328:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784189302.027895:0:94328:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dbf4376f240 going to sleep for 11 seconds 00000100:00100000:2.0:1784189302.027896:0:94314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458222080 00000100:00100000:2.0:1784189302.027905:0:94314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458222080 00000100:00100000:2.0:1784189302.027992:0:94314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1784189302.028002:0:94314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf44916850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:bd553d0d-03e2-4233-b06b-b55bbfa2b954+11:94328:x1870854458222080:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1784189302.028116:0:94314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf44916850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:bd553d0d-03e2-4233-b06b-b55bbfa2b954+11:94328:x1870854458222080:12345-0@lo:502:llog_process_th.0 Request processed in 114us (266us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189302.028123:0:94314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1784189302.028203:0:94328:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc06b98e680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bd553d0d-03e2-4233-b06b-b55bbfa2b954:94328:1870854458222080:0@lo:502:llog_process_th.0 00000040:00080000:1.0:1784189302.028226:0:94328:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 58 count 57 00000020:01000000:1.0:1784189302.028298:0:94303:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-57 (rc=0) 10000000:01000000:1.0:1784189302.028338:0:94303:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1784189302.028354:0:94303:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff9dbf4710e400/0xcc1762b626f8c66f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc1762b626f8c676 expref: -99 pid: 94303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189302.028377:0:94303:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: ffff9dbf4710e400/0xcc1762b626f8c66f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc1762b626f8c676 expref: -99 pid: 94303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1784189302.028426:0:94303:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1784189302.028428:0:94303:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1784189302.028429:0:94303:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1784189302.028430:0:94303:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1784189302.028431:0:94303:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1784189302.028433:0:94303:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1784189302.028434:0:94303:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1784189302.028436:0:94303:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1784189302.028437:0:94303:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1784189302.028438:0:94303:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1784189302.028441:0:94303:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:1.0:1784189302.028444:0:94303:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1784189302.028445:0:94303:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1784189302.028446:0:94303:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1784189302.028447:0:94303:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1784189302.028453:0:94303:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1784189302.028454:0:94303:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1784189302.028455:0:94303:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1784189302.028456:0:94303:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1784189302.028457:0:94303:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1784189302.028458:0:94303:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1784189302.028472:0:94303:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:1.0:1784189302.028481:0:94303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc06b98e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd553d0d-03e2-4233-b06b-b55bbfa2b954:94303:1870854458222208:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1784189302.028513:0:94303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784189302.029668:0:94310:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458222208 00000100:00100000:0.0:1784189302.029677:0:94310:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458222208 00000100:00100000:1.0:1784189302.029692:0:94303:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dbf4376f180 going to sleep for 11 seconds 00000100:00100000:0.0:1784189302.029727:0:94310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1784189302.029737:0:94310:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf44917850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd553d0d-03e2-4233-b06b-b55bbfa2b954+11:94303:x1870854458222208:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1784189302.029767:0:94310:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:0.0:1784189302.029781:0:94310:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1784189302.040711:0:94310:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1784189302.040730:0:94310:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:3.0:1784189302.040747:0:94312:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1784189302.040753:0:94312:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1784189302.040782:0:94312:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9dc058f66200/0xcc1762b626f8c68b lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 94312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189302.040800:0:94312:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9dc04a20a200/0xcc1762b626f8c65a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcc1762b626f8c653 expref: 11 pid: 94309 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189302.040808:0:94312:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9dc058f66200/0xcc1762b626f8c68b lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 94312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189302.040849:0:94312:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9dc04a20a200/0xcc1762b626f8c65a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcc1762b626f8c653 expref: 11 pid: 94309 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189302.040862:0:94312:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9dc04a20a200/0xcc1762b626f8c65a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcc1762b626f8c653 expref: 11 pid: 94309 timeout: 3644 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784189302.040876:0:94312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf469b5f80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:94312:1870854458222336:0@lo:104: 00000100:00100000:3.0:1784189302.040937:0:94312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784189302.040975:0:94312:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dbf464c29c0 going to sleep for 11 seconds 00000100:00100000:2.0:1784189302.041034:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458222336 00000100:00100000:2.0:1784189302.041041:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458222336 00000100:00100000:2.0:1784189302.041137:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 336 00000100:00100000:2.0:1784189302.041156:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf469b5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:bd553d0d-03e2-4233-b06b-b55bbfa2b954+3:94312:x1870854458222336:12345-0@lo:104: 00010000:00010000:2.0:1784189302.041169:0:6496:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.112@tcp lock: ffff9dbf4710e000/0xcc1762b626f8c653 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xcc1762b626f8c65a expref: -99 pid: 94303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189302.041231:0:6496:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1784189302.041238:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf469b5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:bd553d0d-03e2-4233-b06b-b55bbfa2b954+3:94312:x1870854458222336:12345-0@lo:104: Request processed in 85us (300us total) trans 0 rc 0/0 00010000:00010000:3.0:1784189302.041239:0:6501:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784189302.041249:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.112@tcp lock: ffff9dbf4710e000/0xcc1762b626f8c653 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xcc1762b626f8c65a expref: -99 pid: 94303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784189302.041249:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 336 00010000:00010000:3.0:1784189302.041273:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dbf4710e000 already unused, calling callback (ffffffffc114ac20) 10000000:00010000:3.0:1784189302.041276:0:6501:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.112@tcp lock: ffff9dbf4710e000/0xcc1762b626f8c653 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xcc1762b626f8c65a expref: -99 pid: 94303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189302.041283:0:6501:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.112@tcp lock: ffff9dbf4710e000/0xcc1762b626f8c653 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xcc1762b626f8c65a expref: -99 pid: 94303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1784189302.041290:0:6501:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.112@tcp lock: ffff9dbf4710e000/0xcc1762b626f8c653 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xcc1762b626f8c65a expref: -99 pid: 94303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784189302.041295:0:6501:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00000100:00100000:0.0:1784189302.041364:0:94310:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf44917850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd553d0d-03e2-4233-b06b-b55bbfa2b954+11:94303:x1870854458222208:12345-0@lo:253:mount.lustre.0 Request processed in 11628us (12849us total) trans 0 rc 0/0 00000100:00100000:0.0:1784189302.041373:0:94310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00010000:3.0:1784189302.041413:0:6501:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.112@tcp lock: ffff9dbf4710e000/0xcc1762b626f8c653 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcc1762b626f8c65a expref: -99 pid: 94303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189302.041421:0:6501:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1784189302.041453:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.112@tcp lock: ffff9dbf4710e000/0xcc1762b626f8c653 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcc1762b626f8c65a expref: -99 pid: 94303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189302.041460:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.112@tcp lock: ffff9dbf4710e000/0xcc1762b626f8c653 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcc1762b626f8c65a expref: -99 pid: 94303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784189302.041465:0:94312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf469b5f80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:94312:1870854458222336:0@lo:104: 00010000:00010000:3.0:1784189302.041478:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784189302.041481:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784189302.041484:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784189302.041488:0:94312:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9dc058f66200/0xcc1762b626f8c68b lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 94312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784189302.041499:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1784189302.041512:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf469b4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bd553d0d-03e2-4233-b06b-b55bbfa2b954:3640:1870854458222464:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1784189302.041520:0:94303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc06b98e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd553d0d-03e2-4233-b06b-b55bbfa2b954:94303:1870854458222208:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1784189302.041529:0:94303:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:1.0:1784189302.041532:0:94303:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1784189302.041534:0:94303:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1784189302.041536:0:94303:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1784189302.041538:0:94303:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1784189302.041539:0:94303:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1784189302.041541:0:94303:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1784189302.041542:0:94303:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1784189302.041545:0:94303:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000100:00100000:3.0:1784189302.041546:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:01000004:1.0:1784189302.041548:0:94303:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1784189302.041551:0:94303:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1784189302.041563:0:94303:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:3.0:1784189302.041589:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458222464 00000100:00100000:3.0:1784189302.041605:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458222464 00010000:00010000:3.0:1784189302.041631:0:6500:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9dc04a20a200/0xcc1762b626f8c65a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcc1762b626f8c653 expref: 11 pid: 94309 timeout: 3644 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784189302.041654:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2579 00000100:00100000:3.0:1784189302.041661:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf469b4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bd553d0d-03e2-4233-b06b-b55bbfa2b954+11:3640:x1870854458222464:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1784189302.041671:0:6500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784189302.041677:0:6500:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9dc04a20a200/0xcc1762b626f8c65a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcc1762b626f8c653 expref: 11 pid: 94309 timeout: 3644 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189302.041688:0:6500:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9dc04a20a200/0xcc1762b626f8c65a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcc1762b626f8c653 expref: 11 pid: 94309 timeout: 3644 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189302.041702:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dc04a20a200/0xcc1762b626f8c65a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcc1762b626f8c653 expref: 11 pid: 94309 timeout: 3644 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189302.041715:0:6500:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9dc058f66200/0xcc1762b626f8c68b lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 94312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189302.041721:0:6500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dc058f66200/0xcc1762b626f8c68b lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 94312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1784189302.041735:0:6500:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.000983115s 00010000:00010000:3.0:1784189302.041740:0:6500:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9dc058f66200/0xcc1762b626f8c68b lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 94312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189302.041748:0:6500:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9dc058f66200/0xcc1762b626f8c68b lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 94312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189302.041754:0:6500:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9dc058f66200/0xcc1762b626f8c68b lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 94312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189302.041774:0:6500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9dc058f66200/0xcc1762b626f8c68b lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 94312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189302.041786:0:6500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc058f66200 already unused, calling callback (ffffffffc0b2e230) 00010000:00010000:3.0:1784189302.041790:0:6500:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9dc058f66200/0xcc1762b626f8c68b lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 94312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189302.041797:0:6500:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9dc058f66200/0xcc1762b626f8c68b lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 94312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189302.041813:0:6500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9dc058f66200/0xcc1762b626f8c68b lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 94312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189302.041822:0:6500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784189302.041856:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf469b4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bd553d0d-03e2-4233-b06b-b55bbfa2b954+10:3640:x1870854458222464:12345-0@lo:103:ldlm_bl.0 Request processed in 195us (311us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189302.041864:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2579 00000100:00100000:3.0:1784189302.041911:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf469b4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bd553d0d-03e2-4233-b06b-b55bbfa2b954:3640:1870854458222464:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1784189302.042073:0:94312:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9dc058f66200/0xcc1762b626f8c68b lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 94312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189302.042152:0:94312:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9dc058f66200/0xcc1762b626f8c68b lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 94312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189302.042161:0:94312:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dc058f66200/0xcc1762b626f8c68b lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 94312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:2.0:1784189302.052054:0:94303:0:(update_trans.c:1495:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 73014444062 00000040:01000000:2.0:1784189302.052419:0:94303:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:0.0:1784189302.052500:0:94334:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 73014444062 00000020:00080000:0.0:1784189302.052505:0:94334:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 73014444062 00000040:01000000:0.0:1784189302.052821:0:94335:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1784189302.052939:0:94303:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osp-MDT0000 ctxt 16 is initialized 00000100:00100000:0.0:1784189302.053312:0:94336:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc05ed38700 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:94336:1870854458222592:0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1784189302.053437:0:94336:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784189302.053475:0:94336:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dbf42629780 going to sleep for 11 seconds 00000100:00100000:1.0:1784189302.053485:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458222592 00000100:00100000:1.0:1784189302.053493:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458222592 00000100:00100000:1.0:1784189302.053544:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3921 00000100:00100000:1.0:1784189302.053554:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc05ed3ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:94336:x1870854458222592:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1784189302.053641:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc05ed3ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:94336:x1870854458222592:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 87us (203us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189302.053650:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3921 00000040:01000000:2.0:1784189302.053864:0:94303:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:2.0:1784189302.053905:0:94303:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1784189302.054464:0:94336:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc05ed38700 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:94336:1870854458222592:0@lo:1000:lod0000_rec0001.0 00000040:01000000:0.0:1784189302.054496:0:94336:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:0.0:1784189302.054527:0:94336:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc05ed38700 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:94336:1870854458222720:0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1784189302.054575:0:94336:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784189302.054591:0:94336:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dbf42629780 going to sleep for 11 seconds 00000004:00000080:2.0:1784189302.054847:0:94303:0:(mdd_device.c:553:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:2.0:1784189302.054856:0:94303:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:2.0:1784189302.054901:0:94303:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1784189302.055848:0:94303:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:3.0:1784189302.055910:0:94335:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1784189302.056539:0:94303:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:2.0:1784189302.056568:0:94303:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:2.0:1784189302.056650:0:94303:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:2.0:1784189302.057126:0:94303:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x53:0x0] (8/32) registered 00000040:00080000:3.0:1784189302.060238:0:94335:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x20000a810:0x1:0x0] index 261376 count 1 00000004:00080000:3.0:1784189302.060347:0:94335:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000100:00100000:3.0:1784189302.060453:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458222720 00000100:00100000:3.0:1784189302.060462:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458222720 00000100:00100000:3.0:1784189302.060508:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3922 00000100:00100000:3.0:1784189302.060515:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc05ed3b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:94336:x1870854458222720:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1784189302.060664:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc05ed3b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:94336:x1870854458222720:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 149us (6088us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189302.060671:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3922 00000100:00100000:3.0:1784189302.060712:0:94336:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc05ed38700 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:94336:1870854458222720:0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1784189302.060800:0:94336:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf469b4380 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:94336:1870854458222848:0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1784189302.060831:0:94336:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784189302.060850:0:94336:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dbf464c23c0 going to sleep for 11 seconds 00010000:00080000:2.0:1784189302.069579:0:94303:0:(ldlm_lib.c:3053:target_recovery_init()) RECOVERY: service lustre-MDT0000, 2 recoverable clients, last_transno 115964117000 00000100:00100000:1.0:1784189302.069816:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458222848 00000100:00100000:1.0:1784189302.069826:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458222848 00000100:00100000:1.0:1784189302.069962:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3923 00000100:00100000:1.0:1784189302.069973:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf469b5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:94336:x1870854458222848:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1784189302.070088:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf469b5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:94336:x1870854458222848:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 117us (9255us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189302.070096:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3923 00000100:00100000:0.0:1784189302.070177:0:94336:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf469b4380 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:94336:1870854458222848:0@lo:1000:lod0000_rec0001.0 00000040:00080000:0.0:1784189302.070249:0:94336:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1784189302.072395:0:94336:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x2400090a4:0x1:0x0] index 261376 count 1 00000004:00080000:0.0:1784189302.072471:0:94336:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osp-MDT0000 retrieved update log, duration 0, retries 0 00000004:00080000:0.0:1784189302.072475:0:94336:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00010000:00080000:2.0:1784189302.073709:0:94337:0:(ldlm_lib.c:2853:target_recovery_thread()) lustre-MDT0000: started recovery thread pid 94337 00010000:02000000:2.0:1784189302.073726:0:94337:0:(ldlm_lib.c:2335:target_recovery_overseer()) lustre-MDT0000: in recovery but waiting for the first client to connect 00010000:00080000:2.0:1784189302.073729:0:94337:0:(ldlm_lib.c:2545:check_for_recovery_ready()) connected 0 stale 0 max_recoverable_clients 2 abort 0 expired 0 00010000:00080000:2.0:1784189302.073740:0:94337:0:(ldlm_lib.c:2545:check_for_recovery_ready()) connected 0 stale 0 max_recoverable_clients 2 abort 0 expired 0 00000020:01000004:0.0:1784189302.074439:0:94303:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1784189302.074456:0:94303:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.112@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1784189302.074481:0:94303:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=46 00000080:00000004:0.0:1784189302.074510:0:94303:0:(super25.c:181:lustre_fill_super()) /dev/mapper/mds1_flakey: Mount complete 00000020:00000004:0.0:1784189302.076001:0:94303:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1784189302.076445:0:94303:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1784189302.512888:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1784189302.896410:0:6510:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1784189302.896417:0:6510:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff9dc07a8f1800 from 124 10000000:01000000:2.0:1784189302.896423:0:6510:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1784189302.896467:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff9dc04a20ae00/0xcc1762b626f8c692 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189302.896479:0:6510:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: ffff9dc04a20ae00/0xcc1762b626f8c692 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189302.896490:0:6510:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: ffff9dc04a20ae00/0xcc1762b626f8c692 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784189302.896515:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc056ead180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458222976:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1784189302.896578:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784189302.896618:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dbf44b58e40 going to sleep for 11 seconds 00000100:00100000:0.0:1784189302.896669:0:94308:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458222976 00000100:00100000:0.0:1784189302.896678:0:94308:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458222976 00000100:00100000:0.0:1784189302.896742:0:94308:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1784189302.896753:0:94308:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf44916050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd553d0d-03e2-4233-b06b-b55bbfa2b954+10:6510:x1870854458222976:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784189302.896765:0:94308:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784189302.896778:0:94308:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dc05ec0e600/0xcc1762b626f8c699 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xcc1762b626f8c692 expref: -99 pid: 94308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189302.896802:0:94308:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dc05ec0e600/0xcc1762b626f8c699 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcc1762b626f8c692 expref: 11 pid: 94308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189302.896812:0:94308:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dc05ec0e600/0xcc1762b626f8c699 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcc1762b626f8c692 expref: 11 pid: 94308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189302.896820:0:94308:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc05ec0e600, rc 0) 00000100:00100000:0.0:1784189302.896865:0:94308:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf44916050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd553d0d-03e2-4233-b06b-b55bbfa2b954+11:6510:x1870854458222976:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 114us (287us total) trans 0 rc 0/0 00000100:00100000:0.0:1784189302.896881:0:94308:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1784189302.897020:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc056ead180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458222976:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784189302.897035:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: ffff9dc04a20ae00/0xcc1762b626f8c692 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc1762b626f8c699 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189302.897044:0:6510:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: ffff9dc04a20ae00/0xcc1762b626f8c692 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcc1762b626f8c699 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784189302.897097:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc06b98e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458223104:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1784189302.897131:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784189302.897163:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dc04a63be40 going to sleep for 11 seconds 00000100:00100000:2.0:1784189302.897217:0:94309:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458223104 00000100:00100000:2.0:1784189302.897222:0:94309:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458223104 00000100:00100000:2.0:1784189302.897264:0:94309:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1784189302.897271:0:94309:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf44917450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd553d0d-03e2-4233-b06b-b55bbfa2b954+11:6510:x1870854458223104:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1784189302.897284:0:94309:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1784189302.897301:0:94309:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1784189302.897303:0:94309:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 124 00000100:00100000:2.0:1784189302.897401:0:94309:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf44917450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd553d0d-03e2-4233-b06b-b55bbfa2b954+11:6510:x1870854458223104:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 130us (269us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189302.897409:0:94309:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1784189302.897706:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc06b98e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458223104:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1784189302.897767:0:6510:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1784189302.897773:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff9dc04a20ae00/0xcc1762b626f8c692 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc1762b626f8c699 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189302.897779:0:6510:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: ffff9dc04a20ae00/0xcc1762b626f8c692 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc1762b626f8c699 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784189302.897784:0:6510:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1784189302.897786:0:6510:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9dbf44675800 from 58 10000000:01000000:1.0:1784189302.897787:0:6510:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1784189302.897801:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff9dbf4710f600/0xcc1762b626f8c6a0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189302.897806:0:6510:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: ffff9dbf4710f600/0xcc1762b626f8c6a0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189302.897811:0:6510:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: ffff9dbf4710f600/0xcc1762b626f8c6a0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784189302.897819:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc06b98e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458223232:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1784189302.897838:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784189302.897847:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dc04a63be40 going to sleep for 11 seconds 00000100:00100000:0.0:1784189302.897948:0:94314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458223232 00000100:00100000:0.0:1784189302.897952:0:94314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458223232 00000100:00100000:0.0:1784189302.897976:0:94314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1784189302.897980:0:94314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf44914450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:bd553d0d-03e2-4233-b06b-b55bbfa2b954+11:6510:x1870854458223232:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784189302.897986:0:94314:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784189302.897993:0:94314:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dc05ec0e400/0xcc1762b626f8c6a7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xcc1762b626f8c6a0 expref: -99 pid: 94314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189302.898004:0:94314:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dc05ec0e400/0xcc1762b626f8c6a7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcc1762b626f8c6a0 expref: 12 pid: 94314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189302.898009:0:94314:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dc05ec0e400/0xcc1762b626f8c6a7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcc1762b626f8c6a0 expref: 12 pid: 94314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189302.898014:0:94314:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc05ec0e400, rc 0) 00000100:00100000:0.0:1784189302.898040:0:94314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf44914450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:bd553d0d-03e2-4233-b06b-b55bbfa2b954+12:6510:x1870854458223232:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 60us (201us total) trans 0 rc 0/0 00000100:00100000:0.0:1784189302.898043:0:94314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1784189302.898198:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc06b98e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458223232:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784189302.898208:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: ffff9dbf4710f600/0xcc1762b626f8c6a0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc1762b626f8c6a7 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189302.898216:0:6510:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: ffff9dbf4710f600/0xcc1762b626f8c6a0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xcc1762b626f8c6a7 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784189302.898279:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc06b98e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458223360:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1784189302.898305:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784189302.898356:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dc04a63be40 going to sleep for 11 seconds 00000100:00100000:0.0:1784189302.898544:0:94310:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458223360 00000100:00100000:0.0:1784189302.898549:0:94310:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458223360 00000100:00100000:0.0:1784189302.898579:0:94310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1784189302.898586:0:94310:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf44917050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd553d0d-03e2-4233-b06b-b55bbfa2b954+12:6510:x1870854458223360:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1784189302.898707:0:94310:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf44917050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd553d0d-03e2-4233-b06b-b55bbfa2b954+12:6510:x1870854458223360:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 121us (401us total) trans 0 rc 0/0 00000100:00100000:0.0:1784189302.898713:0:94310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1784189302.898795:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc06b98e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458223360:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1784189302.898823:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc06b98e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458223488:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1784189302.898862:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784189302.898887:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dc04a63be40 going to sleep for 11 seconds 00000100:00100000:0.0:1784189302.898934:0:94308:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458223488 00000100:00100000:0.0:1784189302.898943:0:94308:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458223488 00000100:00100000:0.0:1784189302.898972:0:94308:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1784189302.898979:0:94308:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf44915050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd553d0d-03e2-4233-b06b-b55bbfa2b954+12:6510:x1870854458223488:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1784189302.899092:0:94308:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf44915050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd553d0d-03e2-4233-b06b-b55bbfa2b954+12:6510:x1870854458223488:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 113us (228us total) trans 0 rc 0/0 00000100:00100000:0.0:1784189302.899099:0:94308:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1784189302.899236:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc06b98e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458223488:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1784189302.900673:0:94394:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 57 00000020:01000000:2.0:1784189302.900899:0:6510:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 58-57 (rc=0) 10000000:01000000:2.0:1784189302.900924:0:6510:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1784189302.900934:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff9dbf4710f600/0xcc1762b626f8c6a0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc1762b626f8c6a7 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189302.900953:0:6510:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: ffff9dbf4710f600/0xcc1762b626f8c6a0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc1762b626f8c6a7 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784189302.900962:0:6510:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1784189302.900965:0:6510:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff9dbf44675800 from 121 10000000:01000000:2.0:1784189302.900967:0:6510:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1784189302.900994:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff9dc04a20a600/0xcc1762b626f8c6ae lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189302.901002:0:6510:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: ffff9dc04a20a600/0xcc1762b626f8c6ae lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189302.901011:0:6510:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: ffff9dc04a20a600/0xcc1762b626f8c6ae lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784189302.901032:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc056eadc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458223616:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1784189302.901084:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784189302.901159:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dbf44b58480 going to sleep for 11 seconds 00000100:00100000:0.0:1784189302.901206:0:94314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458223616 00000100:00100000:0.0:1784189302.901211:0:94314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458223616 00000100:00100000:0.0:1784189302.901294:0:94314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1784189302.901303:0:94314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf44914c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:bd553d0d-03e2-4233-b06b-b55bbfa2b954+12:6510:x1870854458223616:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784189302.901313:0:94314:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784189302.901359:0:94314:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dc05ec0e800/0xcc1762b626f8c6b5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xcc1762b626f8c6ae expref: -99 pid: 94314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189302.901380:0:94314:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dc05ec0e800/0xcc1762b626f8c6b5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcc1762b626f8c6ae expref: 13 pid: 94314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189302.901389:0:94314:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dc05ec0e800/0xcc1762b626f8c6b5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcc1762b626f8c6ae expref: 13 pid: 94314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189302.901397:0:94314:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc05ec0e800, rc 0) 00000100:00100000:0.0:1784189302.901601:0:94314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf44914c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:bd553d0d-03e2-4233-b06b-b55bbfa2b954+13:6510:x1870854458223616:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 128us (344us total) trans 0 rc 0/0 00000100:00100000:0.0:1784189302.901609:0:94314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1784189302.901762:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc056eadc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458223616:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1784189302.901775:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: ffff9dc04a20a600/0xcc1762b626f8c6ae lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc1762b626f8c6b5 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189302.901784:0:6510:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: ffff9dc04a20a600/0xcc1762b626f8c6ae lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xcc1762b626f8c6b5 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784189302.901831:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc056eadc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458223744:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1784189302.901862:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784189302.901888:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dbf44b58480 going to sleep for 11 seconds 00000100:00100000:0.0:1784189302.901975:0:94314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458223744 00000100:00100000:0.0:1784189302.901980:0:94314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458223744 00000100:00100000:0.0:1784189302.902042:0:94314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1784189302.902049:0:94314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf44916c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:bd553d0d-03e2-4233-b06b-b55bbfa2b954+13:6510:x1870854458223744:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1784189302.902070:0:94314:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1784189302.902084:0:94314:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1784189302.902088:0:94314:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/4/3. 20000000:01000000:0.0:1784189302.902091:0:94314:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/4/3. 20000000:01000000:0.0:1784189302.902093:0:94314:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/4/3. 20000000:01000000:0.0:1784189302.902095:0:94314:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 124 00000100:00100000:0.0:1784189302.902189:0:94314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf44916c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:bd553d0d-03e2-4233-b06b-b55bbfa2b954+13:6510:x1870854458223744:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 140us (325us total) trans 0 rc 0/0 00000100:00100000:0.0:1784189302.902196:0:94314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1784189302.902410:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc056eadc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458223744:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1784189302.902665:0:6510:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1784189302.902672:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff9dc04a20a600/0xcc1762b626f8c6ae lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc1762b626f8c6b5 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189302.902680:0:6510:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: ffff9dc04a20a600/0xcc1762b626f8c6ae lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc1762b626f8c6b5 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784189302.902687:0:6510:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:2.0:1784189302.902689:0:6510:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 53 10000000:01000000:2.0:1784189302.902691:0:6510:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:2.0:1784189302.902710:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff9dc04a20ac00/0xcc1762b626f8c6bc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189302.902718:0:6510:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: ffff9dc04a20ac00/0xcc1762b626f8c6bc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189302.902726:0:6510:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: ffff9dc04a20ac00/0xcc1762b626f8c6bc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784189302.902802:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc056eadc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458223872:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1784189302.902831:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784189302.902892:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dbf44b58480 going to sleep for 11 seconds 00000100:00100000:0.0:1784189302.902926:0:94310:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458223872 00000100:00100000:0.0:1784189302.902931:0:94310:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458223872 00000100:00100000:0.0:1784189302.902987:0:94310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1784189302.902994:0:94310:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf44914850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd553d0d-03e2-4233-b06b-b55bbfa2b954+13:6510:x1870854458223872:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784189302.903002:0:94310:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784189302.903011:0:94310:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dc05ec0f600/0xcc1762b626f8c6c3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xcc1762b626f8c6bc expref: -99 pid: 94310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189302.903026:0:94310:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dc05ec0f600/0xcc1762b626f8c6c3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcc1762b626f8c6bc expref: 14 pid: 94310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189302.903035:0:94310:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dc05ec0f600/0xcc1762b626f8c6c3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcc1762b626f8c6bc expref: 14 pid: 94310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189302.903042:0:94310:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc05ec0f600, rc 0) 00000100:00100000:0.0:1784189302.903110:0:94310:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf44914850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd553d0d-03e2-4233-b06b-b55bbfa2b954+14:6510:x1870854458223872:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 116us (278us total) trans 0 rc 0/0 00000100:00100000:0.0:1784189302.903117:0:94310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1784189302.903217:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc056eadc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458223872:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784189302.903228:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: ffff9dc04a20ac00/0xcc1762b626f8c6bc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc1762b626f8c6c3 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189302.903237:0:6510:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: ffff9dc04a20ac00/0xcc1762b626f8c6bc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xcc1762b626f8c6c3 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784189302.903418:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf469b7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458224000:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784189302.903564:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784189302.903625:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dc0487a5cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1784189302.903655:0:94314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458224000 00000100:00100000:0.0:1784189302.903659:0:94314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458224000 00000100:00100000:0.0:1784189302.903743:0:94314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1784189302.903750:0:94314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf44915850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:bd553d0d-03e2-4233-b06b-b55bbfa2b954+14:6510:x1870854458224000:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1784189302.903911:0:94314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf44915850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:bd553d0d-03e2-4233-b06b-b55bbfa2b954+14:6510:x1870854458224000:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 161us (346us total) trans 0 rc 0/0 00000100:00100000:0.0:1784189302.903918:0:94314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1784189302.904009:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf469b7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458224000:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784189302.904037:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf469b7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458224128:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1784189302.904070:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784189302.904133:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dc0487a5cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1784189302.904169:0:94308:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458224128 00000100:00100000:2.0:1784189302.904174:0:94308:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458224128 00000100:00100000:2.0:1784189302.904236:0:94308:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1784189302.904243:0:94308:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc074ad7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd553d0d-03e2-4233-b06b-b55bbfa2b954+14:6510:x1870854458224128:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1784189302.904365:0:94308:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc074ad7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd553d0d-03e2-4233-b06b-b55bbfa2b954+14:6510:x1870854458224128:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 122us (293us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189302.904377:0:94308:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1784189302.904666:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf469b7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458224128:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1784189302.911380:0:94396:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 64768 count 52 00000020:01000000:2.0:1784189302.911935:0:6510:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 53-52 (rc=0) 10000000:01000000:2.0:1784189302.911962:0:6510:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:2.0:1784189302.911974:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff9dc04a20ac00/0xcc1762b626f8c6bc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc1762b626f8c6c3 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189302.911985:0:6510:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: ffff9dc04a20ac00/0xcc1762b626f8c6bc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc1762b626f8c6c3 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784189302.911995:0:6510:0:(mgc_request.c:611:do_requeue()) updating log lustre-barrier 10000000:01000000:2.0:1784189302.911997:0:6510:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-barrier-ffff9dbf44675800 from 1 10000000:01000000:2.0:1784189302.912000:0:6510:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:2.0:1784189302.912040:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff9dc04a20a000/0xcc1762b626f8c6ca lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189302.912047:0:6510:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: ffff9dc04a20a000/0xcc1762b626f8c6ca lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189302.912058:0:6510:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: ffff9dc04a20a000/0xcc1762b626f8c6ca lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784189302.912083:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc056eadc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458224256:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1784189302.912159:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784189302.912200:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dbf44b58f00 going to sleep for 11 seconds 00000100:00100000:3.0:1784189302.912476:0:94310:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458224256 00000100:00100000:3.0:1784189302.912483:0:94310:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458224256 00000100:00100000:3.0:1784189302.912525:0:94310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1784189302.912534:0:94310:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf44d0e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd553d0d-03e2-4233-b06b-b55bbfa2b954+14:6510:x1870854458224256:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784189302.912547:0:94310:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784189302.912573:0:94310:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dc058f67400/0xcc1762b626f8c6d1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xcc1762b626f8c6ca expref: -99 pid: 94310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189302.912596:0:94310:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dc058f67400/0xcc1762b626f8c6d1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcc1762b626f8c6ca expref: 15 pid: 94310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189302.912605:0:94310:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dc058f67400/0xcc1762b626f8c6d1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcc1762b626f8c6ca expref: 15 pid: 94310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189302.912613:0:94310:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc058f67400, rc 0) 00000100:00100000:3.0:1784189302.912655:0:94310:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf44d0e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd553d0d-03e2-4233-b06b-b55bbfa2b954+15:6510:x1870854458224256:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 123us (497us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189302.912662:0:94310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1784189302.912703:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc056eadc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458224256:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784189302.912716:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: ffff9dc04a20a000/0xcc1762b626f8c6ca lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc1762b626f8c6d1 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189302.912724:0:6510:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: ffff9dc04a20a000/0xcc1762b626f8c6ca lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xcc1762b626f8c6d1 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784189302.912750:0:6510:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:3.0:1784189302.912755:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff9dc04a20a000/0xcc1762b626f8c6ca lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc1762b626f8c6d1 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189302.912762:0:6510:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: ffff9dc04a20a000/0xcc1762b626f8c6ca lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc1762b626f8c6d1 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784189302.912768:0:6510:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1784189302.912770:0:6510:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9dbf44675800 from 7 10000000:01000000:3.0:1784189302.912772:0:6510:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1784189302.912792:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff9dc058f67800/0xcc1762b626f8c6d8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189302.912799:0:6510:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: ffff9dc058f67800/0xcc1762b626f8c6d8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189302.912806:0:6510:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: ffff9dc058f67800/0xcc1762b626f8c6d8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784189302.912819:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf469b7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458224384:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1784189302.912844:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784189302.912859:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dc05876dcc0 going to sleep for 11 seconds 00000100:00100000:2.0:1784189302.912999:0:94309:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458224384 00000100:00100000:2.0:1784189302.913004:0:94309:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458224384 00000100:00100000:2.0:1784189302.913038:0:94309:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1784189302.913045:0:94309:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf44d0e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd553d0d-03e2-4233-b06b-b55bbfa2b954+15:6510:x1870854458224384:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1784189302.913052:0:94309:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784189302.913067:0:94309:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dc04a20be00/0xcc1762b626f8c6df lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xcc1762b626f8c6d8 expref: -99 pid: 94309 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189302.913081:0:94309:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dc04a20be00/0xcc1762b626f8c6df lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcc1762b626f8c6d8 expref: 16 pid: 94309 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189302.913089:0:94309:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dc04a20be00/0xcc1762b626f8c6df lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcc1762b626f8c6d8 expref: 16 pid: 94309 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189302.913096:0:94309:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc04a20be00, rc 0) 00000100:00100000:2.0:1784189302.913122:0:94309:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf44d0e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd553d0d-03e2-4233-b06b-b55bbfa2b954+16:6510:x1870854458224384:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 78us (277us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189302.913128:0:94309:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1784189302.917905:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf469b7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458224384:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784189302.917932:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: ffff9dc058f67800/0xcc1762b626f8c6d8 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc1762b626f8c6df expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189302.917944:0:6510:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: ffff9dc058f67800/0xcc1762b626f8c6d8 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xcc1762b626f8c6df expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784189302.918020:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf469b7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458224512:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784189302.918072:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784189302.918102:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dc05876dcc0 going to sleep for 11 seconds 00000100:00100000:2.0:1784189302.918161:0:94310:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458224512 00000100:00100000:2.0:1784189302.918167:0:94310:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458224512 00000100:00100000:2.0:1784189302.918211:0:94310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1784189302.918218:0:94310:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf44d0cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd553d0d-03e2-4233-b06b-b55bbfa2b954+16:6510:x1870854458224512:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1784189302.918367:0:94310:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf44d0cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd553d0d-03e2-4233-b06b-b55bbfa2b954+16:6510:x1870854458224512:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 147us (292us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189302.918374:0:94310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1784189302.918626:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf469b7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458224512:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784189302.918654:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf469b7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458224640:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1784189302.918690:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784189302.918716:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dc05876dcc0 going to sleep for 11 seconds 00000100:00100000:2.0:1784189302.918808:0:94308:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458224640 00000100:00100000:2.0:1784189302.918813:0:94308:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458224640 00000100:00100000:2.0:1784189302.918842:0:94308:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1784189302.918848:0:94308:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf44d0d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd553d0d-03e2-4233-b06b-b55bbfa2b954+16:6510:x1870854458224640:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1784189302.918917:0:94308:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf44d0d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd553d0d-03e2-4233-b06b-b55bbfa2b954+16:6510:x1870854458224640:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 69us (226us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189302.918924:0:94308:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1784189302.919365:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf469b7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458224640:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1784189302.920561:0:94397:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:2.0:1784189302.922231:0:6510:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:2.0:1784189302.922572:0:6510:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1784189302.922584:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff9dc058f67800/0xcc1762b626f8c6d8 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc1762b626f8c6df expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189302.922595:0:6510:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: ffff9dc058f67800/0xcc1762b626f8c6d8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc1762b626f8c6df expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784189302.922604:0:6510:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1784189302.922607:0:6510:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9dbf425f7000 from 58 10000000:01000000:2.0:1784189302.922610:0:6510:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1784189302.922644:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff9dc04a20a400/0xcc1762b626f8c6e6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189302.922653:0:6510:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: ffff9dc04a20a400/0xcc1762b626f8c6e6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189302.922663:0:6510:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: ffff9dc04a20a400/0xcc1762b626f8c6e6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784189302.922683:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc056ead180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458224768:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1784189302.922812:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784189302.922886:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dbf44b58e40 going to sleep for 11 seconds 00000100:00100000:3.0:1784189302.922922:0:94310:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458224768 00000100:00100000:3.0:1784189302.922929:0:94310:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458224768 00000100:00100000:3.0:1784189302.923005:0:94310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1784189302.923015:0:94310:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf44d0c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd553d0d-03e2-4233-b06b-b55bbfa2b954+16:6510:x1870854458224768:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784189302.923028:0:94310:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784189302.923041:0:94310:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dc058f66800/0xcc1762b626f8c6ed lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xcc1762b626f8c6e6 expref: -99 pid: 94310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189302.923064:0:94310:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dc058f66800/0xcc1762b626f8c6ed lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcc1762b626f8c6e6 expref: 17 pid: 94310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189302.923076:0:94310:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dc058f66800/0xcc1762b626f8c6ed lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcc1762b626f8c6e6 expref: 17 pid: 94310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189302.923083:0:94310:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc058f66800, rc 0) 00000100:00100000:3.0:1784189302.923195:0:94310:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf44d0c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd553d0d-03e2-4233-b06b-b55bbfa2b954+17:6510:x1870854458224768:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 181us (381us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189302.923202:0:94310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1784189302.925360:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc056ead180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458224768:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784189302.925385:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: ffff9dc04a20a400/0xcc1762b626f8c6e6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc1762b626f8c6ed expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189302.925396:0:6510:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: ffff9dc04a20a400/0xcc1762b626f8c6e6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xcc1762b626f8c6ed expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784189302.925606:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc05ed38e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458224896:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1784189302.925656:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784189302.925688:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dbf42629c00 going to sleep for 11 seconds 00000100:00100000:1.0:1784189302.925949:0:94308:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458224896 00000100:00100000:1.0:1784189302.925955:0:94308:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458224896 00000100:00100000:1.0:1784189302.925998:0:94308:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1784189302.926007:0:94308:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf44d0ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd553d0d-03e2-4233-b06b-b55bbfa2b954+17:6510:x1870854458224896:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1784189302.926123:0:94308:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf44d0ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd553d0d-03e2-4233-b06b-b55bbfa2b954+17:6510:x1870854458224896:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 116us (466us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189302.926130:0:94308:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1784189302.926220:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc05ed38e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458224896:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1784189302.926343:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc05ed38e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458225024:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1784189302.926382:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784189302.926407:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dbf42629c00 going to sleep for 11 seconds 00000100:00100000:1.0:1784189302.926554:0:94309:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458225024 00000100:00100000:1.0:1784189302.926558:0:94309:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458225024 00000100:00100000:1.0:1784189302.926589:0:94309:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1784189302.926595:0:94309:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf44d0d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd553d0d-03e2-4233-b06b-b55bbfa2b954+17:6510:x1870854458225024:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1784189302.926670:0:94309:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf44d0d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd553d0d-03e2-4233-b06b-b55bbfa2b954+17:6510:x1870854458225024:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 74us (287us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189302.926676:0:94309:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1784189302.926834:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc05ed38e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458225024:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1784189302.928123:0:94399:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 57 00000020:01000000:1.0:1784189302.928592:0:6510:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 58-57 (rc=0) 10000000:01000000:1.0:1784189302.928619:0:6510:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1784189302.928628:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff9dc04a20a400/0xcc1762b626f8c6e6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc1762b626f8c6ed expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189302.928640:0:6510:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: ffff9dc04a20a400/0xcc1762b626f8c6e6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc1762b626f8c6ed expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784189302.928649:0:6510:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:1.0:1784189302.928652:0:6510:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 11 10000000:01000000:1.0:1784189302.928654:0:6510:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:1.0:1784189302.928684:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff9dbf4710ee00/0xcc1762b626f8c6f4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189302.928692:0:6510:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: ffff9dbf4710ee00/0xcc1762b626f8c6f4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189302.928701:0:6510:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: ffff9dbf4710ee00/0xcc1762b626f8c6f4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784189302.928721:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc06b98e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458225152:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1784189302.928839:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784189302.928877:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dc04a63b9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1784189302.928924:0:94314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458225152 00000100:00100000:3.0:1784189302.928930:0:94314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458225152 00000100:00100000:3.0:1784189302.928976:0:94314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1784189302.928985:0:94314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf44d0c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:bd553d0d-03e2-4233-b06b-b55bbfa2b954+17:6510:x1870854458225152:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784189302.928997:0:94314:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784189302.929010:0:94314:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dc058f66a00/0xcc1762b626f8c6fb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xcc1762b626f8c6f4 expref: -99 pid: 94314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189302.929032:0:94314:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dc058f66a00/0xcc1762b626f8c6fb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcc1762b626f8c6f4 expref: 18 pid: 94314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189302.929048:0:94314:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dc058f66a00/0xcc1762b626f8c6fb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcc1762b626f8c6f4 expref: 18 pid: 94314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189302.929057:0:94314:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc058f66a00, rc 0) 00000100:00100000:3.0:1784189302.929093:0:94314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf44d0c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:bd553d0d-03e2-4233-b06b-b55bbfa2b954+18:6510:x1870854458225152:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 108us (253us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189302.929099:0:94314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1784189302.929185:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc06b98e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458225152:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784189302.929200:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: ffff9dbf4710ee00/0xcc1762b626f8c6f4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc1762b626f8c6fb expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189302.929208:0:6510:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: ffff9dbf4710ee00/0xcc1762b626f8c6f4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xcc1762b626f8c6fb expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784189302.929353:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc06b98e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458225280:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1784189302.929384:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784189302.929403:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dc04a63b9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1784189302.929465:0:94308:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458225280 00000100:00100000:3.0:1784189302.929470:0:94308:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458225280 00000100:00100000:3.0:1784189302.929500:0:94308:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1784189302.929507:0:94308:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf44d0d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd553d0d-03e2-4233-b06b-b55bbfa2b954+18:6510:x1870854458225280:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784189302.929619:0:94308:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf44d0d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd553d0d-03e2-4233-b06b-b55bbfa2b954+18:6510:x1870854458225280:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 112us (233us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189302.929626:0:94308:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1784189302.929825:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc06b98e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458225280:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1784189302.929855:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc06b98e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458225408:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1784189302.929892:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784189302.929920:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dc04a63b9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1784189302.929959:0:94314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458225408 00000100:00100000:3.0:1784189302.929964:0:94314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458225408 00000100:00100000:3.0:1784189302.929993:0:94314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1784189302.929999:0:94314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf44d0f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:bd553d0d-03e2-4233-b06b-b55bbfa2b954+18:6510:x1870854458225408:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1784189302.937196:0:94314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf44d0f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:bd553d0d-03e2-4233-b06b-b55bbfa2b954+18:6510:x1870854458225408:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 7189us (7295us total) trans 0 rc 0/0 00000100:00100000:0.0:1784189302.937210:0:94314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1784189302.937560:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc06b98e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458225408:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1784189302.939817:0:94401:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 64768 count 11 00000020:01000000:1.0:1784189302.940712:0:6510:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 11-10 (rc=0) 10000000:01000000:1.0:1784189302.940737:0:6510:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:1.0:1784189302.940748:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff9dbf4710ee00/0xcc1762b626f8c6f4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc1762b626f8c6fb expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189302.940760:0:6510:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: ffff9dbf4710ee00/0xcc1762b626f8c6f4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc1762b626f8c6fb expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784189302.940769:0:6510:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1784189302.940771:0:6510:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9dbf425f7000 from 7 10000000:01000000:1.0:1784189302.940774:0:6510:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1784189302.940810:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff9dbf4710fa00/0xcc1762b626f8c702 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189302.940818:0:6510:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: ffff9dbf4710fa00/0xcc1762b626f8c702 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189302.940828:0:6510:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: ffff9dbf4710fa00/0xcc1762b626f8c702 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784189302.940851:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc06b98e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458225536:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1784189302.940923:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784189302.940964:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dc04a63b9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1784189302.941174:0:94308:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458225536 00000100:00100000:3.0:1784189302.941182:0:94308:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458225536 00000100:00100000:3.0:1784189302.941229:0:94308:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1784189302.941238:0:94308:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf44d0e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd553d0d-03e2-4233-b06b-b55bbfa2b954+18:6510:x1870854458225536:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784189302.941337:0:94308:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784189302.941351:0:94308:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dc058f66e00/0xcc1762b626f8c709 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xcc1762b626f8c702 expref: -99 pid: 94308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189302.941387:0:94308:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dc058f66e00/0xcc1762b626f8c709 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcc1762b626f8c702 expref: 19 pid: 94308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189302.941397:0:94308:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dc058f66e00/0xcc1762b626f8c709 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcc1762b626f8c702 expref: 19 pid: 94308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189302.941406:0:94308:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc058f66e00, rc 0) 00000100:00100000:3.0:1784189302.941448:0:94308:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf44d0e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd553d0d-03e2-4233-b06b-b55bbfa2b954+19:6510:x1870854458225536:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 211us (524us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189302.941454:0:94308:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1784189302.941574:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc06b98e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458225536:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784189302.941588:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: ffff9dbf4710fa00/0xcc1762b626f8c702 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc1762b626f8c709 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189302.941596:0:6510:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: ffff9dbf4710fa00/0xcc1762b626f8c702 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xcc1762b626f8c709 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784189302.941651:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc05ed38e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458225664:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1784189302.941677:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784189302.941703:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dbf426296c0 going to sleep for 11 seconds 00000100:00100000:1.0:1784189302.941815:0:94309:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458225664 00000100:00100000:1.0:1784189302.941821:0:94309:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458225664 00000100:00100000:1.0:1784189302.941852:0:94309:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1784189302.941859:0:94309:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc080e3b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd553d0d-03e2-4233-b06b-b55bbfa2b954+19:6510:x1870854458225664:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1784189302.942000:0:94309:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc080e3b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd553d0d-03e2-4233-b06b-b55bbfa2b954+19:6510:x1870854458225664:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 141us (321us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189302.942008:0:94309:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1784189302.942361:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc05ed38e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458225664:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784189302.942397:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf469b7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458225792:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1784189302.942437:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784189302.942460:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dbf44c4fa80 going to sleep for 11 seconds 00000100:00100000:1.0:1784189302.942510:0:94308:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458225792 00000100:00100000:1.0:1784189302.942515:0:94308:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458225792 00000100:00100000:1.0:1784189302.942543:0:94308:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1784189302.942550:0:94308:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc080e38850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd553d0d-03e2-4233-b06b-b55bbfa2b954+19:6510:x1870854458225792:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1784189302.942625:0:94308:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc080e38850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd553d0d-03e2-4233-b06b-b55bbfa2b954+19:6510:x1870854458225792:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 75us (187us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189302.942632:0:94308:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1784189302.942823:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf469b7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458225792:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1784189302.948660:0:94402:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:0.0:1784189302.951061:0:6510:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:0.0:1784189302.951097:0:6510:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1784189302.951108:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff9dbf4710fa00/0xcc1762b626f8c702 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc1762b626f8c709 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189302.951122:0:6510:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: ffff9dbf4710fa00/0xcc1762b626f8c702 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc1762b626f8c709 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784189302.951132:0:6510:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1784189302.951146:0:6510:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9dc07b5d6800 from 58 10000000:01000000:0.0:1784189302.951150:0:6510:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1784189302.951185:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff9dc05ec0ea00/0xcc1762b626f8c710 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189302.951193:0:6510:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: ffff9dc05ec0ea00/0xcc1762b626f8c710 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189302.951203:0:6510:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: ffff9dc05ec0ea00/0xcc1762b626f8c710 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784189302.952678:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc05ed38000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458225920:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1784189302.953480:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784189302.953520:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dbf42629c00 going to sleep for 11 seconds 00000100:00100000:1.0:1784189302.954587:0:94309:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458225920 00000100:00100000:1.0:1784189302.954597:0:94309:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458225920 00000100:00100000:1.0:1784189302.954651:0:94309:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1784189302.954661:0:94309:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc080e3a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd553d0d-03e2-4233-b06b-b55bbfa2b954+19:6510:x1870854458225920:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784189302.954677:0:94309:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784189302.954694:0:94309:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dbf4710f400/0xcc1762b626f8c717 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xcc1762b626f8c710 expref: -99 pid: 94309 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189302.954719:0:94309:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dbf4710f400/0xcc1762b626f8c717 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcc1762b626f8c710 expref: 20 pid: 94309 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189302.954815:0:94309:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dbf4710f400/0xcc1762b626f8c717 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcc1762b626f8c710 expref: 20 pid: 94309 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189302.954825:0:94309:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dbf4710f400, rc 0) 00000100:00100000:1.0:1784189302.954879:0:94309:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc080e3a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd553d0d-03e2-4233-b06b-b55bbfa2b954+20:6510:x1870854458225920:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 220us (1402us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189302.954887:0:94309:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1784189302.954995:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc05ed38000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458225920:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784189302.955011:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: ffff9dc05ec0ea00/0xcc1762b626f8c710 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc1762b626f8c717 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189302.955020:0:6510:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: ffff9dc05ec0ea00/0xcc1762b626f8c710 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xcc1762b626f8c717 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784189302.955089:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc05ed38000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458226048:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1784189302.955118:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784189302.955151:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dbf42629c00 going to sleep for 11 seconds 00000100:00100000:1.0:1784189302.956364:0:94310:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458226048 00000100:00100000:1.0:1784189302.956373:0:94310:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458226048 00000100:00100000:1.0:1784189302.956408:0:94310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1784189302.956416:0:94310:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc080e3a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd553d0d-03e2-4233-b06b-b55bbfa2b954+20:6510:x1870854458226048:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1784189302.956555:0:94310:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc080e3a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd553d0d-03e2-4233-b06b-b55bbfa2b954+20:6510:x1870854458226048:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 139us (1435us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189302.956563:0:94310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1784189302.957010:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc05ed38000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458226048:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1784189302.957051:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc05ed38000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458226176:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1784189302.957100:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784189302.957124:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dbf42629c00 going to sleep for 11 seconds 00000100:00100000:1.0:1784189302.957499:0:94309:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458226176 00000100:00100000:1.0:1784189302.957504:0:94309:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458226176 00000100:00100000:1.0:1784189302.957535:0:94309:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1784189302.957542:0:94309:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc080e3ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd553d0d-03e2-4233-b06b-b55bbfa2b954+20:6510:x1870854458226176:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1784189302.957622:0:94309:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc080e3ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd553d0d-03e2-4233-b06b-b55bbfa2b954+20:6510:x1870854458226176:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 80us (521us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189302.957629:0:94309:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1784189302.958371:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc05ed38000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458226176:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1784189302.962111:0:94404:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 57 00000020:01000000:0.0:1784189302.962637:0:6510:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 58-57 (rc=0) 10000000:01000000:0.0:1784189302.962664:0:6510:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1784189302.962676:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff9dc05ec0ea00/0xcc1762b626f8c710 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc1762b626f8c717 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189302.962689:0:6510:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: ffff9dc05ec0ea00/0xcc1762b626f8c710 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc1762b626f8c717 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784189302.962709:0:6510:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:0.0:1784189302.962712:0:6510:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 14 10000000:01000000:0.0:1784189302.962715:0:6510:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:0.0:1784189302.963065:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff9dc05ec0fa00/0xcc1762b626f8c71e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189302.963075:0:6510:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: ffff9dc05ec0fa00/0xcc1762b626f8c71e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189302.963085:0:6510:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: ffff9dc05ec0fa00/0xcc1762b626f8c71e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784189302.963110:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc05ed38000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458226304:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1784189302.963184:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784189302.963233:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dc0749d59c0 going to sleep for 11 seconds 00000100:00100000:1.0:1784189302.963930:0:94310:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458226304 00000100:00100000:1.0:1784189302.963939:0:94310:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458226304 00000100:00100000:1.0:1784189302.963989:0:94310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1784189302.963999:0:94310:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc080e39850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd553d0d-03e2-4233-b06b-b55bbfa2b954+20:6510:x1870854458226304:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784189302.964021:0:94310:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784189302.964035:0:94310:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dbf4710e600/0xcc1762b626f8c725 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xcc1762b626f8c71e expref: -99 pid: 94310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189302.964058:0:94310:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dbf4710e600/0xcc1762b626f8c725 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcc1762b626f8c71e expref: 21 pid: 94310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189302.964068:0:94310:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dbf4710e600/0xcc1762b626f8c725 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcc1762b626f8c71e expref: 21 pid: 94310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189302.964076:0:94310:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dbf4710e600, rc 0) 00000100:00100000:1.0:1784189302.964120:0:94310:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc080e39850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd553d0d-03e2-4233-b06b-b55bbfa2b954+21:6510:x1870854458226304:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 123us (937us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189302.964127:0:94310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1784189302.964376:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc05ed38000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458226304:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784189302.964391:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: ffff9dc05ec0fa00/0xcc1762b626f8c71e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc1762b626f8c725 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189302.964401:0:6510:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: ffff9dc05ec0fa00/0xcc1762b626f8c71e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0xcc1762b626f8c725 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784189302.964629:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc05ed38000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458226432:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1784189302.964660:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784189302.964682:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dc0749d59c0 going to sleep for 11 seconds 00000100:00100000:1.0:1784189302.964720:0:94309:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458226432 00000100:00100000:1.0:1784189302.964725:0:94309:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458226432 00000100:00100000:1.0:1784189302.964821:0:94309:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1784189302.964828:0:94309:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc080e39050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd553d0d-03e2-4233-b06b-b55bbfa2b954+21:6510:x1870854458226432:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1784189302.964950:0:94309:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc080e39050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd553d0d-03e2-4233-b06b-b55bbfa2b954+21:6510:x1870854458226432:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 122us (289us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189302.964958:0:94309:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1784189302.965021:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc05ed38000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458226432:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1784189302.965048:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc05ed38000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458226560:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1784189302.965090:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784189302.965111:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dc0749d59c0 going to sleep for 11 seconds 00000100:00100000:1.0:1784189302.965158:0:94310:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458226560 00000100:00100000:1.0:1784189302.965162:0:94310:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458226560 00000100:00100000:1.0:1784189302.965190:0:94310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1784189302.965196:0:94310:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc080e3a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd553d0d-03e2-4233-b06b-b55bbfa2b954+21:6510:x1870854458226560:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1784189302.972249:0:94310:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc080e3a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd553d0d-03e2-4233-b06b-b55bbfa2b954+21:6510:x1870854458226560:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 7044us (7149us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189302.972275:0:94310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1784189302.977557:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc05ed38000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458226560:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1784189302.981622:0:94405:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 64768 count 14 00000020:01000000:3.0:1784189302.988432:0:6510:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 14-13 (rc=0) 10000000:01000000:3.0:1784189302.988474:0:6510:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:3.0:1784189302.988486:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff9dc05ec0fa00/0xcc1762b626f8c71e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc1762b626f8c725 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189302.988497:0:6510:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: ffff9dc05ec0fa00/0xcc1762b626f8c71e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc1762b626f8c725 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784189302.988506:0:6510:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1784189302.988522:0:6510:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9dc07b5d6800 from 7 10000000:01000000:3.0:1784189302.988524:0:6510:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1784189302.988561:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff9dc058f67a00/0xcc1762b626f8c72c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189302.988569:0:6510:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: ffff9dc058f67a00/0xcc1762b626f8c72c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189302.988578:0:6510:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: ffff9dc058f67a00/0xcc1762b626f8c72c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784189302.988601:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf469b7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458226688:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1784189302.988658:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784189302.989035:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dbf44c4fa80 going to sleep for 11 seconds 00000100:00100000:2.0:1784189302.989542:0:94309:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458226688 00000100:00100000:2.0:1784189302.989550:0:94309:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458226688 00000100:00100000:2.0:1784189302.989598:0:94309:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1784189302.989607:0:94309:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc080e39450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd553d0d-03e2-4233-b06b-b55bbfa2b954+21:6510:x1870854458226688:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1784189302.989620:0:94309:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784189302.989632:0:94309:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dc04a20ba00/0xcc1762b626f8c733 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xcc1762b626f8c72c expref: -99 pid: 94309 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189302.989668:0:94309:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dc04a20ba00/0xcc1762b626f8c733 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcc1762b626f8c72c expref: 22 pid: 94309 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189302.989678:0:94309:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dc04a20ba00/0xcc1762b626f8c733 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcc1762b626f8c72c expref: 22 pid: 94309 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189302.989686:0:94309:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc04a20ba00, rc 0) 00000100:00100000:2.0:1784189302.990400:0:94309:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc080e39450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd553d0d-03e2-4233-b06b-b55bbfa2b954+22:6510:x1870854458226688:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 790us (1738us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189302.990407:0:94309:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1784189302.997250:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf469b7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458226688:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784189302.997281:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: ffff9dc058f67a00/0xcc1762b626f8c72c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc1762b626f8c733 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189302.997294:0:6510:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: ffff9dc058f67a00/0xcc1762b626f8c72c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xcc1762b626f8c733 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784189302.997606:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc056eafb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458226816:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1784189302.997661:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784189302.997696:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dc04529b3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1784189302.997715:0:94314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458226816 00000100:00100000:0.0:1784189302.997722:0:94314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458226816 00000100:00100000:0.0:1784189302.997771:0:94314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1784189302.997780:0:94314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc080e3b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:bd553d0d-03e2-4233-b06b-b55bbfa2b954+22:6510:x1870854458226816:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1784189302.997906:0:94314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc080e3b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:bd553d0d-03e2-4233-b06b-b55bbfa2b954+22:6510:x1870854458226816:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 126us (244us total) trans 0 rc 0/0 00000100:00100000:0.0:1784189302.997915:0:94314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1784189302.997981:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc056eafb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458226816:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1784189302.998006:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc056eafb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458226944:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1784189302.998048:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784189302.998071:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dc04529b3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1784189302.998174:0:94308:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458226944 00000100:00100000:0.0:1784189302.998179:0:94308:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458226944 00000100:00100000:0.0:1784189302.998209:0:94308:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1784189302.998215:0:94308:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc080e38450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd553d0d-03e2-4233-b06b-b55bbfa2b954+22:6510:x1870854458226944:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1784189302.998542:0:94308:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc080e38450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd553d0d-03e2-4233-b06b-b55bbfa2b954+22:6510:x1870854458226944:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 326us (493us total) trans 0 rc 0/0 00000100:00100000:0.0:1784189302.998549:0:94308:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1784189303.008187:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc056eafb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458226944:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1784189303.010107:0:94406:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:3.0:1784189303.010362:0:6510:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:3.0:1784189303.010384:0:6510:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1784189303.010394:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff9dc058f67a00/0xcc1762b626f8c72c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc1762b626f8c733 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189303.010405:0:6510:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: ffff9dc058f67a00/0xcc1762b626f8c72c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc1762b626f8c733 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784189303.010414:0:6510:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:0.0:1784189303.011401:0:6510:0:(mgc_request.c:1801:mgc_process_log()) Process log nodemap-ffff9dc06bb30000 from 1 10000000:01000000:0.0:1784189303.011407:0:6510:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:0.0:1784189303.011449:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff9dc05ec0f800/0xcc1762b626f8c73a lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189303.011458:0:6510:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: ffff9dc05ec0f800/0xcc1762b626f8c73a lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189303.011468:0:6510:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: ffff9dc05ec0f800/0xcc1762b626f8c73a lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784189303.011504:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc05ed3a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458227072:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1784189303.011570:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784189303.011612:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dc0749d5c00 going to sleep for 11 seconds 00000100:00100000:1.0:1784189303.011640:0:94310:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458227072 00000100:00100000:1.0:1784189303.011647:0:94310:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458227072 00000100:00100000:1.0:1784189303.011699:0:94310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1784189303.011709:0:94310:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc080e3bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd553d0d-03e2-4233-b06b-b55bbfa2b954+22:6510:x1870854458227072:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784189303.011721:0:94310:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784189303.011734:0:94310:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dbf4710f800/0xcc1762b626f8c741 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xcc1762b626f8c73a expref: -99 pid: 94310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189303.011754:0:94310:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dbf4710f800/0xcc1762b626f8c741 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcc1762b626f8c73a expref: 23 pid: 94310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189303.011765:0:94310:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dbf4710f800/0xcc1762b626f8c741 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcc1762b626f8c73a expref: 23 pid: 94310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189303.011773:0:94310:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dbf4710f800, rc 0) 00000100:00100000:1.0:1784189303.011822:0:94310:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc080e3bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd553d0d-03e2-4233-b06b-b55bbfa2b954+23:6510:x1870854458227072:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 114us (251us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189303.011828:0:94310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1784189303.012009:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc05ed3a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458227072:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1784189303.012024:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: ffff9dc05ec0f800/0xcc1762b626f8c73a lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc1762b626f8c741 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189303.012033:0:6510:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: ffff9dc05ec0f800/0xcc1762b626f8c73a lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcc1762b626f8c741 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784189303.012059:0:6510:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:2.0:1784189303.012064:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff9dc05ec0f800/0xcc1762b626f8c73a lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc1762b626f8c741 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189303.012072:0:6510:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: ffff9dc05ec0f800/0xcc1762b626f8c73a lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc1762b626f8c741 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784189303.012080:0:6510:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:2.0:1784189303.012082:0:6510:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-sptlrpc-ffff9dc06bb30000 from 1 10000000:01000000:2.0:1784189303.012084:0:6510:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1784189303.012099:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff9dc04a20aa00/0xcc1762b626f8c748 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189303.012106:0:6510:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: ffff9dc04a20aa00/0xcc1762b626f8c748 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189303.012114:0:6510:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: ffff9dc04a20aa00/0xcc1762b626f8c748 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784189303.012129:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc056eafb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458227200:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1784189303.012171:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784189303.012195:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dc04529b3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1784189303.012258:0:94309:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458227200 00000100:00100000:1.0:1784189303.012263:0:94309:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458227200 00000100:00100000:1.0:1784189303.012294:0:94309:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1784189303.012301:0:94309:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc080e38c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd553d0d-03e2-4233-b06b-b55bbfa2b954+23:6510:x1870854458227200:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784189303.012308:0:94309:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784189303.012349:0:94309:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dbf4710fc00/0xcc1762b626f8c74f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xcc1762b626f8c748 expref: -99 pid: 94309 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189303.012365:0:94309:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dbf4710fc00/0xcc1762b626f8c74f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcc1762b626f8c748 expref: 24 pid: 94309 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189303.012382:0:94309:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dbf4710fc00/0xcc1762b626f8c74f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcc1762b626f8c748 expref: 24 pid: 94309 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189303.012389:0:94309:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dbf4710fc00, rc 0) 00000100:00100000:1.0:1784189303.012427:0:94309:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc080e38c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd553d0d-03e2-4233-b06b-b55bbfa2b954+24:6510:x1870854458227200:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 126us (255us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189303.012433:0:94309:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1784189303.012474:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc056eafb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458227200:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784189303.012485:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: ffff9dc04a20aa00/0xcc1762b626f8c748 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc1762b626f8c74f expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189303.012492:0:6510:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: ffff9dc04a20aa00/0xcc1762b626f8c748 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0xcc1762b626f8c74f expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784189303.012544:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc05ed38a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458227328:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1784189303.012568:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784189303.012583:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dc0749d5b40 going to sleep for 11 seconds 00000100:00100000:1.0:1784189303.012614:0:94310:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458227328 00000100:00100000:1.0:1784189303.012618:0:94310:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458227328 00000100:00100000:1.0:1784189303.012648:0:94310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1784189303.012655:0:94310:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc080e3b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd553d0d-03e2-4233-b06b-b55bbfa2b954+24:6510:x1870854458227328:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1784189303.012728:0:94310:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc080e3b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd553d0d-03e2-4233-b06b-b55bbfa2b954+24:6510:x1870854458227328:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 74us (158us total) trans 0 rc -2/-2 00000100:00100000:1.0:1784189303.012735:0:94310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1784189303.012795:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc05ed38a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458227328:0@lo:501:ll_cfg_requeue.0 10000000:01000000:2.0:1784189303.012822:0:6510:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1784189303.012827:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff9dc04a20aa00/0xcc1762b626f8c748 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc1762b626f8c74f expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189303.012835:0:6510:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: ffff9dc04a20aa00/0xcc1762b626f8c748 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc1762b626f8c74f expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784189303.087057:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1784189303.087109:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1784189303.087189:0:94308:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436323072 00000100:00100000:1.0:1784189303.087194:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1784189303.087198:0:94308:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436323072 00000100:00100000:3.0:1784189303.087272:0:66171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436323328 00000100:00100000:3.0:1784189303.087276:0:66171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436323328 00000100:00100000:2.0:1784189303.087278:0:66169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436323200 00000100:00100000:2.0:1784189303.087281:0:66169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436323200 00000100:00100000:2.0:1784189303.087309:0:66169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1422 00000100:00100000:2.0:1784189303.087341:0:66169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc06b98e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2395:x1870854436323200:12345-192.168.203.12@tcp:38:kworker.0 00000100:00100000:0.0:1784189303.087349:0:94308:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 61 00000100:00100000:0.0:1784189303.087353:0:94308:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc07fa60050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:2395:x1870854436323072:12345-192.168.203.12@tcp:250:kworker.0 00010000:00080000:2.0:1784189303.087371:0:66169:0:(ldlm_lib.c:938:target_handle_reconnect()) connect export for UUID 'debedd94-805c-42a0-a5e5-41758b2012e9' at ffff9dbf47a3b800, cookie 0xcc1762b626f8c5e3 00010000:00080000:0.0:1784189303.087371:0:94308:0:(ldlm_lib.c:1445:target_handle_connect()) MGS: connection from 60f345e3-c70e-4f53-b5e7-c9671463c9a5@192.168.203.12@tcp t0 exp 0000000000000000 cur 3545 last 0 00010000:00080000:2.0:1784189303.087375:0:66169:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from debedd94-805c-42a0-a5e5-41758b2012e9@192.168.203.12@tcp recovering/t115964117001 exp ffff9dbf47a3b800 cur 3545 last 1784189301 00010000:02000400:2.0:1784189303.087382:0:66169:0:(ldlm_lib.c:2036:target_start_recovery_timer()) lustre-MDT0000: Will be in recovery for at least 1:00, or until 2 clients reconnect 00010000:00080000:2.0:1784189303.087387:0:66169:0:(ldlm_lib.c:2100:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 70 seconds 00000020:00000080:0.0:1784189303.087396:0:94308:0:(genops.c:1406:class_connect()) connect: client 60f345e3-c70e-4f53-b5e7-c9671463c9a5, cookie 0xcc1762b626f8c756 00000004:00100000:2.0:1784189303.087403:0:66169:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:2.0:1784189303.087525:0:66169:0:(import.c:65:import_set_state_nolock()) ffff9dbf4512e800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1784189303.087588:0:66169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc06b98e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:debedd94-805c-42a0-a5e5-41758b2012e9+6:2395:x1870854436323200:12345-192.168.203.12@tcp:38:kworker.0 Request processed in 270us (393us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189303.087620:0:66171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1301 00000100:00100000:3.0:1784189303.087628:0:66171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc06b98e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:debedd94-805c-42a0-a5e5-41758b2012e9+9:2396:x1870854436323328:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:3.0:1784189303.087662:0:66171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc06b98e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:debedd94-805c-42a0-a5e5-41758b2012e9+9:2396:x1870854436323328:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 36us (615us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189303.087669:0:66171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1301 00000100:00080000:3.0:1784189303.087690:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1784189303.088069:0:94308:0:(import.c:65:import_set_state_nolock()) ffff9dbf42275000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1784189303.088104:0:94308:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc07fa60050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:60f345e3-c70e-4f53-b5e7-c9671463c9a5+5:2395:x1870854436323072:12345-192.168.203.12@tcp:250:kworker.0 Request processed in 750us (994us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189303.088111:0:94308:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 61 00000100:00100000:2.0:1784189303.093996:0:66169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1422 00000100:00100000:1.0:1784189303.098806:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1784189303.098914:0:66945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436315648 00000100:00100000:0.0:1784189303.098923:0:66945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436315648 00000100:00100000:0.0:1784189303.098985:0:66945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1423 00000100:00100000:0.0:1784189303.098995:0:66945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc071534700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:debedd94-805c-42a0-a5e5-41758b2012e9+6:2395:x1870854436315648:12345-192.168.203.12@tcp:36:mcreate.0 00010000:00080000:0.0:1784189303.099012:0:66945:0:(ldlm_lib.c:3228:target_queue_recovery_request()) Next recovery transno: 115964117001, current: 115964117001, replaying 00000100:00100000:0.0:1784189303.099043:0:66945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc071534700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:debedd94-805c-42a0-a5e5-41758b2012e9+6:2395:x1870854436315648:12345-192.168.203.12@tcp:36:mcreate.0 Request processed in 50us (247us total) trans 0 rc 0/-999 00000100:00100000:0.0:1784189303.099050:0:66945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1423 00010000:00080000:2.0:1784189303.099275:0:94337:0:(ldlm_lib.c:2545:check_for_recovery_ready()) connected 1 stale 0 max_recoverable_clients 2 abort 0 expired 0 00010000:00010000:1.0:1784189303.538747:0:7454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784189304.487037:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1784189304.487134:0:94310:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436323456 00000100:00100000:3.0:1784189304.487143:0:94310:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436323456 00000100:00100000:3.0:1784189304.487304:0:94310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 62 00000100:00100000:3.0:1784189304.487315:0:94310:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc07fa61050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:60f345e3-c70e-4f53-b5e7-c9671463c9a5+5:70943:x1870854436323456:12345-192.168.203.12@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784189304.487349:0:94310:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784189304.487367:0:94310:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dc058f67c00/0xcc1762b626f8c75d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xcbfc5de7fe6c409b expref: -99 pid: 94310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189304.487394:0:94310:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dc058f67c00/0xcc1762b626f8c75d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c409b expref: 6 pid: 94310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189304.487407:0:94310:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dc058f67c00/0xcc1762b626f8c75d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c409b expref: 6 pid: 94310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189304.487416:0:94310:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc058f67c00, rc 0) 00000100:00100000:3.0:1784189304.487469:0:94310:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc07fa61050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:60f345e3-c70e-4f53-b5e7-c9671463c9a5+6:70943:x1870854436323456:12345-192.168.203.12@tcp:101:ll_cfg_requeue.0 Request processed in 156us (441us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189304.487484:0:94310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 62 00000100:00100000:2.0:1784189304.494874:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1784189304.495002:0:94309:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436323584 00000100:00100000:3.0:1784189304.495011:0:94309:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436323584 00000100:00100000:3.0:1784189304.495061:0:94309:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 63 00000100:00100000:3.0:1784189304.495071:0:94309:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc07fa63c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:60f345e3-c70e-4f53-b5e7-c9671463c9a5+6:70943:x1870854436323584:12345-192.168.203.12@tcp:256:ll_cfg_requeue.0 20000000:01000000:3.0:1784189304.495097:0:94309:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 16384. 20000000:01000000:3.0:1784189304.495114:0:94309:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1784189304.495118:0:94309:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/4/3. 20000000:01000000:3.0:1784189304.495121:0:94309:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/4/3. 20000000:01000000:3.0:1784189304.495136:0:94309:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/4/3. 20000000:01000000:3.0:1784189304.495138:0:94309:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 124 00000100:00100000:3.0:1784189304.500052:0:94309:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc07fa63c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:60f345e3-c70e-4f53-b5e7-c9671463c9a5+6:70943:x1870854436323584:12345-192.168.203.12@tcp:256:ll_cfg_requeue.0 Request processed in 4972us (5177us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189304.500066:0:94309:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 63 00000100:00100000:2.0:1784189304.506340:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1784189304.506418:0:94314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436323712 00000100:00100000:3.0:1784189304.506428:0:94314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436323712 00000100:00100000:3.0:1784189304.506474:0:94314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 64 00000100:00100000:3.0:1784189304.506484:0:94314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc044984c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:60f345e3-c70e-4f53-b5e7-c9671463c9a5+6:70943:x1870854436323712:12345-192.168.203.12@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784189304.506502:0:94314:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784189304.506519:0:94314:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dc058f67600/0xcc1762b626f8c764 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xcbfc5de7fe6c40a2 expref: -99 pid: 94314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189304.506546:0:94314:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dc058f67600/0xcc1762b626f8c764 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c40a2 expref: 7 pid: 94314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189304.506557:0:94314:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dc058f67600/0xcc1762b626f8c764 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c40a2 expref: 7 pid: 94314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189304.506578:0:94314:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc058f67600, rc 0) 00000100:00100000:3.0:1784189304.506637:0:94314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc044984c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:60f345e3-c70e-4f53-b5e7-c9671463c9a5+7:70943:x1870854436323712:12345-192.168.203.12@tcp:101:ll_cfg_requeue.0 Request processed in 154us (321us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189304.506645:0:94314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 64 00000100:00100000:2.0:1784189304.510197:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1784189304.510272:0:94308:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436323840 00000100:00100000:3.0:1784189304.510282:0:94308:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436323840 00000100:00100000:3.0:1784189304.510343:0:94308:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 65 00000100:00100000:3.0:1784189304.510352:0:94308:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc044986450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:60f345e3-c70e-4f53-b5e7-c9671463c9a5+7:70943:x1870854436323840:12345-192.168.203.12@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784189304.510497:0:94308:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc044986450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:60f345e3-c70e-4f53-b5e7-c9671463c9a5+8:70943:x1870854436323840:12345-192.168.203.12@tcp:501:ll_cfg_requeue.0 Request processed in 144us (308us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189304.510506:0:94308:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 65 00000100:00100000:2.0:1784189304.511929:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1784189304.511995:0:94314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436323968 00000100:00100000:3.0:1784189304.512001:0:94314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436323968 00000100:00100000:3.0:1784189304.512036:0:94314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 66 00000100:00100000:3.0:1784189304.512044:0:94314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc044985c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:60f345e3-c70e-4f53-b5e7-c9671463c9a5+8:70943:x1870854436323968:12345-192.168.203.12@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1784189304.512168:0:94314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc044985c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:60f345e3-c70e-4f53-b5e7-c9671463c9a5+8:70943:x1870854436323968:12345-192.168.203.12@tcp:503:ll_cfg_requeue.0 Request processed in 124us (243us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189304.512176:0:94314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 66 00000100:00100000:2.0:1784189304.520939:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1784189304.521079:0:94308:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436324096 00000100:00100000:3.0:1784189304.521088:0:94308:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436324096 00000100:00100000:3.0:1784189304.521152:0:94308:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 67 00000100:00100000:3.0:1784189304.521162:0:94308:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc044987450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:60f345e3-c70e-4f53-b5e7-c9671463c9a5+8:70943:x1870854436324096:12345-192.168.203.12@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784189304.521178:0:94308:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784189304.521207:0:94308:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dc058f66400/0xcc1762b626f8c76b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xcbfc5de7fe6c40a9 expref: -99 pid: 94308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189304.521248:0:94308:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dc058f66400/0xcc1762b626f8c76b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c40a9 expref: 9 pid: 94308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189304.521259:0:94308:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dc058f66400/0xcc1762b626f8c76b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c40a9 expref: 9 pid: 94308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189304.521269:0:94308:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc058f66400, rc 0) 00000100:00100000:3.0:1784189304.521339:0:94308:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc044987450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:60f345e3-c70e-4f53-b5e7-c9671463c9a5+9:70943:x1870854436324096:12345-192.168.203.12@tcp:101:ll_cfg_requeue.0 Request processed in 158us (388us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189304.521347:0:94308:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 67 00000100:00100000:1.0:1784189304.530728:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1784189304.530797:0:94314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436324224 00000100:00100000:3.0:1784189304.530807:0:94314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436324224 00000100:00100000:3.0:1784189304.530935:0:94314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 68 00000100:00100000:3.0:1784189304.530946:0:94314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc044987c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:60f345e3-c70e-4f53-b5e7-c9671463c9a5+9:70943:x1870854436324224:12345-192.168.203.12@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784189304.531172:0:94314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc044987c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:60f345e3-c70e-4f53-b5e7-c9671463c9a5+9:70943:x1870854436324224:12345-192.168.203.12@tcp:501:ll_cfg_requeue.0 Request processed in 226us (451us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189304.531180:0:94314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 68 00000100:00100000:2.0:1784189304.537039:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1784189304.537289:0:94308:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436324352 00000100:00100000:3.0:1784189304.537300:0:94308:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436324352 00000100:00100000:3.0:1784189304.537942:0:94308:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 69 00000100:00100000:3.0:1784189304.537954:0:94308:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc044984050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:60f345e3-c70e-4f53-b5e7-c9671463c9a5+9:70943:x1870854436324352:12345-192.168.203.12@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1784189304.540923:0:94308:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc044984050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:60f345e3-c70e-4f53-b5e7-c9671463c9a5+9:70943:x1870854436324352:12345-192.168.203.12@tcp:503:ll_cfg_requeue.0 Request processed in 2960us (3881us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189304.540938:0:94308:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 69 00000100:00100000:1.0:1784189304.562271:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1784189304.562314:0:94310:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436324480 00000100:00100000:1.0:1784189304.562344:0:94310:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436324480 00000100:00100000:1.0:1784189304.562389:0:94310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 70 00000100:00100000:1.0:1784189304.562396:0:94310:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc044986c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:60f345e3-c70e-4f53-b5e7-c9671463c9a5+9:70943:x1870854436324480:12345-192.168.203.12@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784189304.562411:0:94310:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784189304.562435:0:94310:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dbf4710f200/0xcc1762b626f8c772 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0xcbfc5de7fe6c40b0 expref: -99 pid: 94310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189304.562462:0:94310:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dbf4710f200/0xcc1762b626f8c772 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c40b0 expref: 10 pid: 94310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189304.562473:0:94310:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dbf4710f200/0xcc1762b626f8c772 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c40b0 expref: 10 pid: 94310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189304.562482:0:94310:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dbf4710f200, rc 0) 00000100:00100000:1.0:1784189304.562536:0:94310:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc044986c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:60f345e3-c70e-4f53-b5e7-c9671463c9a5+10:70943:x1870854436324480:12345-192.168.203.12@tcp:101:ll_cfg_requeue.0 Request processed in 139us (274us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189304.562544:0:94310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 70 00010000:00010000:0.0:1784189304.566366:0:26173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784189304.570160:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1784189304.570408:0:94309:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436324608 00000100:00100000:3.0:1784189304.570426:0:94309:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436324608 00000100:00100000:3.0:1784189304.570480:0:94309:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 71 00000100:00100000:3.0:1784189304.570490:0:94309:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc044985050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:60f345e3-c70e-4f53-b5e7-c9671463c9a5+10:70943:x1870854436324608:12345-192.168.203.12@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784189304.570905:0:94309:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc044985050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:60f345e3-c70e-4f53-b5e7-c9671463c9a5+10:70943:x1870854436324608:12345-192.168.203.12@tcp:501:ll_cfg_requeue.0 Request processed in 414us (754us total) trans 0 rc -2/-2 00000100:00100000:3.0:1784189304.570915:0:94309:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 71 00000100:00100000:2.0:1784189304.879510:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1784189304.879530:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc056eaed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1870854458227456:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1784189304.879607:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784189304.879653:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458227456 00000100:00100000:2.0:1784189304.879659:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458227456 00000100:00100000:2.0:1784189304.879703:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2046 00000100:00100000:2.0:1784189304.879713:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc056eaea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1870854458227456:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1784189304.879738:0:8432:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 210112 pending 0 free 3922481152 avail 3690958848 00000100:00100000:2.0:1784189304.879778:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc056eaea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1870854458227456:12345-0@lo:13:osp-pre-0-1.0 Request processed in 67us (170us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189304.879785:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2046 00000100:00100000:2.0:1784189304.879829:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc056eaed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1870854458227456:0@lo:13:osp-pre-0-1.0 00000100:00080000:3.0:1784189304.882420:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1784189304.885525:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc071534e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1870854458227584:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1784189304.885595:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784189304.885654:0:9466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458227584 00000100:00100000:2.0:1784189304.885661:0:9466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458227584 00000100:00100000:2.0:1784189304.885713:0:9466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2047 00000100:00100000:2.0:1784189304.885723:0:9466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc056eaed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1870854458227584:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1784189304.885752:0:9466:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 210112 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1784189304.885796:0:9466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc056eaed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1870854458227584:12345-0@lo:13:osp-pre-1-1.0 Request processed in 74us (200us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189304.885803:0:9466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2047 00000100:00100000:2.0:1784189304.885849:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc071534e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1870854458227584:0@lo:13:osp-pre-1-1.0 00000100:00080000:2.0:1784189304.886068:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1784189305.584351:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1784189305.955877:0:94588:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg312-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1784189306.610207:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1784189306.986968:0:94640:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1784189306.987665:0:94640:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:0.0:1784189307.440128:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1784189307.440151:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc05ed39c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1870854458227712:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1784189307.440216:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784189307.440263:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458227712 00000100:00100000:0.0:1784189307.440269:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458227712 00000100:00100000:0.0:1784189307.440315:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3924 00000100:00100000:0.0:1784189307.440350:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc05ed3b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3641:x1870854458227712:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1784189307.440382:0:8439:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445568512 avail 1299329024 00000100:00100000:0.0:1784189307.440425:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc05ed3b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3641:x1870854458227712:12345-0@lo:41:osp-pre-1-0.0 Request processed in 77us (209us total) trans 0 rc 0/0 00000100:00100000:0.0:1784189307.440432:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3924 00000100:00100000:0.0:1784189307.440476:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc05ed39c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1870854458227712:0@lo:41:osp-pre-1-0.0 00000100:00080000:0.0:1784189307.440766:0:93049:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1784189307.440770:0:93049:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1784189307.440773:0:93049:0:(import.c:65:import_set_state_nolock()) ffff9dbf42271800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1784189307.440778:0:93049:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3544 00000100:00080000:0.0:1784189307.440781:0:93049:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1784189307.440786:0:93049:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9dbf42271800 using connection 192.168.203.112@tcp/0@lo 00000100:00100000:0.0:1784189307.440807:0:93049:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9dc05ed38a80 x1870854458227968/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1784189307.440835:0:93049:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1784189307.440847:0:93049:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1784189307.440849:0:93049:0:(import.c:65:import_set_state_nolock()) ffff9dbf425f4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1784189307.440853:0:93049:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3544 00000100:00080000:0.0:1784189307.440855:0:93049:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1784189307.440859:0:93049:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9dbf425f4800 using connection 192.168.203.112@tcp/0@lo 00000100:00100000:0.0:1784189307.440873:0:93049:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9dc05ed38000 x1870854458228224/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1784189307.440889:0:93049:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1784189307.440892:0:93049:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1784189307.440894:0:93049:0:(import.c:65:import_set_state_nolock()) ffff9dbf436c4000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1784189307.440898:0:93049:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3544 00000100:00080000:0.0:1784189307.440900:0:93049:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1784189307.440904:0:93049:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9dbf436c4000 using connection 192.168.203.112@tcp/0@lo 00000100:00100000:0.0:1784189307.440915:0:93049:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9dc05ed38700 x1870854458228480/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1784189307.440937:0:93049:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1784189307.440940:0:93049:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1784189307.440942:0:93049:0:(import.c:65:import_set_state_nolock()) ffff9dbf43690800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1784189307.440945:0:93049:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3544 00000100:00080000:0.0:1784189307.440947:0:93049:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1784189307.440950:0:93049:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff9dbf43690800 using connection 192.168.203.112@tcp/0@lo 00000100:00100000:0.0:1784189307.440960:0:93049:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9dbf43e12300 x1870854458228864/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1784189307.441053:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc05ed39c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:bd553d0d-03e2-4233-b06b-b55bbfa2b954:3641:1870854458227840:0@lo:400:kworker.0 00000100:00100000:1.0:1784189307.441089:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784189307.441126:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf43e13480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1870854458228736:0@lo:400:kworker.0 00000100:00100000:1.0:1784189307.441150:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784189307.441171:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1784189307.441176:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf43e10380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1870854458228608:0@lo:400:kworker.0 00000100:00100000:1.0:1784189307.441199:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784189307.441225:0:94310:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458227840 00000100:00100000:1.0:1784189307.441230:0:94310:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458227840 00000100:00100000:1.0:1784189307.441259:0:94310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1784189307.441266:0:94310:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc044985450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd553d0d-03e2-4233-b06b-b55bbfa2b954+24:3641:x1870854458227840:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784189307.441314:0:94310:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc044985450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd553d0d-03e2-4233-b06b-b55bbfa2b954+24:3641:x1870854458227840:12345-0@lo:400:kworker.0 Request processed in 48us (224us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189307.441337:0:94310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1784189307.441370:0:26164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458228736 00000100:00100000:1.0:1784189307.441373:0:26164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458228736 00000100:00100000:1.0:1784189307.441405:0:26164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458228608 00000100:00100000:1.0:1784189307.441409:0:26164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458228608 00000100:00100000:1.0:1784189307.441432:0:26164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2557 00000100:00100000:1.0:1784189307.441437:0:26164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc071534e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0001-mdtlov_UUID+5:3641:x1870854458228736:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784189307.441469:0:26164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc071534e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0001-mdtlov_UUID+5:3641:x1870854458228736:12345-0@lo:400:kworker.0 Request processed in 31us (317us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189307.441475:0:26164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2557 00000100:00100000:1.0:1784189307.441487:0:26164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2558 00000100:00100000:1.0:1784189307.441493:0:26164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf46434380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0001-mdtlov_UUID+5:3641:x1870854458228608:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784189307.441519:0:26164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf46434380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0001-mdtlov_UUID+5:3641:x1870854458228608:12345-0@lo:400:kworker.0 Request processed in 27us (319us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189307.441525:0:26164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2558 00000100:00100000:1.0:1784189307.441563:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf43e10380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1870854458228608:0@lo:400:kworker.0 00000100:00100000:1.0:1784189307.441573:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc05ed39c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:bd553d0d-03e2-4233-b06b-b55bbfa2b954:3641:1870854458227840:0@lo:400:kworker.0 00000100:00100000:1.0:1784189307.441580:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf43e13480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1870854458228736:0@lo:400:kworker.0 00000100:00080000:0.0:1784189307.441752:0:93049:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1784189307.441761:0:93049:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1784189307.441764:0:93049:0:(import.c:65:import_set_state_nolock()) ffff9dbf43fcb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1784189307.441769:0:93049:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff9dbf43fcb000 using connection 192.168.203.112@tcp/0@lo 00000100:00100000:0.0:1784189307.441783:0:93049:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9dbf43e13800 x1870854458229248/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1784189307.441809:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc05ed38a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3639:1870854458227968:0@lo:38:kworker.0 00000100:00100000:0.0:1784189307.441840:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784189307.441861:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc05ed38000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3639:1870854458228224:0@lo:38:kworker.0 00000100:00100000:0.0:1784189307.441884:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784189307.441901:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc05ed38700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3639:1870854458228480:0@lo:38:kworker.0 00000100:00100000:0.0:1784189307.441922:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784189307.441938:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf43e12300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3639:1870854458228864:0@lo:38:kworker.0 00000100:00100000:0.0:1784189307.441959:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784189307.444694:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc05ed3a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3642:1870854458228096:0@lo:400:kworker.0 00000100:00100000:2.0:1784189307.444763:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc05ed38e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3643:1870854458228352:0@lo:400:kworker.0 00000100:00080000:2.0:1784189307.444804:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1784189307.444809:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1784189307.444938:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf43e13800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3639:1870854458229248:0@lo:38:kworker.0 00000100:00100000:2.0:1784189307.445273:0:66169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458227968 00000100:00100000:2.0:1784189307.445281:0:66169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458227968 00000100:00100000:2.0:1784189307.445342:0:66169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458228224 00000100:00100000:2.0:1784189307.445346:0:66169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458228224 00000100:00100000:2.0:1784189307.445364:0:66169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458228864 00000100:00100000:2.0:1784189307.445367:0:66169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458228864 00000100:00100000:2.0:1784189307.445379:0:66169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1424 00000100:00100000:2.0:1784189307.445386:0:66169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf43e12680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3639:x1870854458227968:12345-0@lo:38:kworker.0 00010000:00080000:2.0:1784189307.445417:0:66169:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo recovering/t0 exp 0000000000000000 cur 3549 last 0 00000020:00000080:2.0:1784189307.445455:0:66169:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0xcc1762b626f8c779 00000004:00100000:2.0:1784189307.445468:0:66169:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1784189307.445606:0:66169:0:(import.c:65:import_set_state_nolock()) ffff9dbf46b09800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1784189307.445658:0:66169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf43e12680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1870854458227968:12345-0@lo:38:kworker.0 Request processed in 271us (3817us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189307.445666:0:66169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1424 00000100:00100000:2.0:1784189307.445686:0:66169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1425 00000100:00100000:2.0:1784189307.445691:0:66169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf43e13b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3639:x1870854458228224:12345-0@lo:38:kworker.0 00010000:00080000:2.0:1784189307.445706:0:66169:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo recovering/t0 exp 0000000000000000 cur 3549 last 0 00000020:00000080:2.0:1784189307.445728:0:66169:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0xcc1762b626f8c780 00000004:00100000:2.0:1784189307.445734:0:66169:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1784189307.445752:0:66169:0:(import.c:65:import_set_state_nolock()) ffff9dbf46b08800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1784189307.445783:0:66169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf43e13b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3639:x1870854458228224:12345-0@lo:38:kworker.0 Request processed in 90us (3898us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189307.445789:0:66169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1425 00000100:00100000:2.0:1784189307.445802:0:66169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1426 00000100:00100000:2.0:1784189307.445816:0:66169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf43e11880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3639:x1870854458228864:12345-0@lo:38:kworker.0 00010000:00080000:2.0:1784189307.445829:0:66169:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0001_UUID@0@lo recovering/t0 exp 0000000000000000 cur 3549 last 0 00000020:00000080:2.0:1784189307.445852:0:66169:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001_UUID, cookie 0xcc1762b626f8c787 00000004:00100000:2.0:1784189307.445865:0:66169:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1784189307.445880:0:66169:0:(import.c:65:import_set_state_nolock()) ffff9dbf46b0b800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1784189307.445911:0:66169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf43e11880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1870854458228864:12345-0@lo:38:kworker.0 Request processed in 94us (3951us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189307.445917:0:66169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1426 00000100:00100000:0.0:1784189307.446358:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:0.0:1784189307.446408:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dc05ed38a80 x1870854458227968/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1784189332 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1784189307.446424:0:3639:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 28 00000100:00080000:0.0:1784189307.447205:0:3639:0:(import.c:1328:ptlrpc_connect_interpret()) @@@ lustre-MDT0000-lwp-OST0000: lwp recover req@ffff9dc05ed38a80 x1870854458227968/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1784189332 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1784189307.447215:0:3639:0:(import.c:65:import_set_state_nolock()) ffff9dbf42271800 lustre-MDT0000_UUID: changing import state from CONNECTING to RECOVER 00000100:00080000:0.0:1784189307.447219:0:3639:0:(import.c:65:import_set_state_nolock()) ffff9dbf42271800 lustre-MDT0000_UUID: changing import state from RECOVER to FULL 00000100:02000000:0.0:1784189307.447222:0:3639:0:(import.c:1743:ptlrpc_import_recovery_state_machine()) lustre-MDT0000-lwp-OST0000: Connection restored to 0@lo (at 0@lo) 00000100:00100000:0.0:1784189307.447227:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc05ed38a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3639:1870854458227968:0@lo:38:kworker.0 00010000:00080000:0.0:1784189307.447256:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dc05ed38000 x1870854458228224/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1784189332 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1784189307.447266:0:3639:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 28 00000100:00080000:0.0:1784189307.448034:0:3639:0:(import.c:1328:ptlrpc_connect_interpret()) @@@ lustre-MDT0000-lwp-OST0001: lwp recover req@ffff9dc05ed38000 x1870854458228224/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1784189332 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1784189307.448043:0:3639:0:(import.c:65:import_set_state_nolock()) ffff9dbf425f4800 lustre-MDT0000_UUID: changing import state from CONNECTING to RECOVER 00000100:00080000:0.0:1784189307.448046:0:3639:0:(import.c:65:import_set_state_nolock()) ffff9dbf425f4800 lustre-MDT0000_UUID: changing import state from RECOVER to FULL 00000100:02000000:0.0:1784189307.448049:0:3639:0:(import.c:1743:ptlrpc_import_recovery_state_machine()) lustre-MDT0000-lwp-OST0001: Connection restored to 0@lo (at 0@lo) 00000100:00100000:0.0:1784189307.448054:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc05ed38000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3639:1870854458228224:0@lo:38:kworker.0 00010000:00080000:0.0:1784189307.448074:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dbf43e12300 x1870854458228864/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1784189332 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1784189307.448085:0:3639:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0001: connect to target with instance 28 00000100:00080000:0.0:1784189307.448868:0:3639:0:(import.c:1328:ptlrpc_connect_interpret()) @@@ lustre-MDT0000-lwp-MDT0001: lwp recover req@ffff9dbf43e12300 x1870854458228864/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1784189332 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1784189307.448878:0:3639:0:(import.c:65:import_set_state_nolock()) ffff9dbf43690800 lustre-MDT0000_UUID: changing import state from CONNECTING to RECOVER 00000100:00080000:0.0:1784189307.448881:0:3639:0:(import.c:65:import_set_state_nolock()) ffff9dbf43690800 lustre-MDT0000_UUID: changing import state from RECOVER to FULL 00000100:02000000:0.0:1784189307.448885:0:3639:0:(import.c:1743:ptlrpc_import_recovery_state_machine()) lustre-MDT0000-lwp-MDT0001: Connection restored to 0@lo (at 0@lo) 00000100:00100000:0.0:1784189307.448889:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf43e12300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3639:1870854458228864:0@lo:38:kworker.0 00000100:00100000:0.0:1784189307.448951:0:68287:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458229248 00000100:00100000:0.0:1784189307.448958:0:68287:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458229248 00000100:00100000:0.0:1784189307.448993:0:68287:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1427 00000100:00100000:0.0:1784189307.449000:0:68287:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf43e11c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3639:x1870854458229248:12345-0@lo:38:kworker.0 00010000:00080000:0.0:1784189307.449023:0:68287:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo recovering/t0 exp 0000000000000000 cur 3549 last 0 00000020:00000080:0.0:1784189307.449055:0:68287:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0xcc1762b626f8c78e 00000004:00100000:0.0:1784189307.449074:0:68287:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1784189307.450677:0:68287:0:(import.c:65:import_set_state_nolock()) ffff9dc06b8e3000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1784189307.450769:0:68287:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf43e11c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1870854458229248:12345-0@lo:38:kworker.0 Request processed in 1765us (4408us total) trans 0 rc 0/0 00000100:00100000:0.0:1784189307.450780:0:68287:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1427 00000100:00100000:0.0:1784189307.450828:0:26492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458228480 00000100:00100000:0.0:1784189307.450833:0:26492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458228480 00000100:00100000:0.0:1784189307.450854:0:26492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3925 00000100:00100000:0.0:1784189307.450860:0:26492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf43e11500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3639:x1870854458228480:12345-0@lo:38:kworker.0 00010000:00080000:0.0:1784189307.450881:0:26492:0:(ldlm_lib.c:938:target_handle_reconnect()) connect export for UUID 'lustre-MDT0001-mdtlov_UUID' at ffff9dbf47a3f000, cookie 0xcc1762b626f8c5dc 00010000:00080000:0.0:1784189307.450886:0:26492:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo recovering/t115964116998 exp ffff9dbf47a3f000 cur 3549 last 1784189301 00000004:00100000:0.0:1784189307.451168:0:26492:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1784189307.451199:0:26492:0:(import.c:65:import_set_state_nolock()) ffff9dc06b8e4000 : changing import state from RECOVER to FULL 00010000:00080000:1.0:1784189307.451221:0:94337:0:(ldlm_lib.c:2545:check_for_recovery_ready()) connected 2 stale 0 max_recoverable_clients 2 abort 0 expired 0 00010000:00080000:1.0:1784189307.451227:0:94337:0:(ldlm_lib.c:2683:replay_request_or_update()) Waiting for transno 115964117001 00000020:00080000:1.0:1784189307.451233:0:94337:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1784189307.451237:0:94337:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 2, connected: 2, completed: 0, queue_len: 1, req_transno: 115964117001, next_transno: 115964117001 00010000:00080000:1.0:1784189307.451242:0:94337:0:(ldlm_lib.c:2246:check_for_next_transno()) waking for next (115964117001) 00000100:00100000:0.0:1784189307.451244:0:26492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf43e11500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3639:x1870854458228480:12345-0@lo:38:kworker.0 Request processed in 382us (9319us total) trans 0 rc 0/0 00000100:00100000:0.0:1784189307.451252:0:26492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3925 00000020:00080000:1.0:1784189307.451254:0:94337:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1784189307.451267:0:94337:0:(ldlm_lib.c:2747:replay_request_or_update()) @@@ processing x1870854436315648 t115964117001 from 192.168.203.12@tcp req@ffff9dc071534700 x1870854436315648/t0(115964117001) o36->debedd94-805c-42a0-a5e5-41758b2012e9@192.168.203.12@tcp:494/0 lens 528/0 e 0 to 0 dl 1784189314 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'mcreate.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784189307.451294:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784189307.451372:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf43e11180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1870854458229120:0@lo:400:kworker.0 00000100:00100000:0.0:1784189307.451407:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784189307.451446:0:26169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458229120 00000100:00100000:0.0:1784189307.451450:0:26169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458229120 00000100:00100000:1.0:1784189307.451452:0:66945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458228352 00000100:00100000:1.0:1784189307.451458:0:66945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458228352 00000100:00100000:1.0:1784189307.451509:0:66945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1302 00000100:00100000:0.0:1784189307.451509:0:26169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2559 00000100:00100000:0.0:1784189307.451519:0:26169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf43e12d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+6:3643:x1870854458229120:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784189307.451525:0:66945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf43e12300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1870854458228352:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784189307.451560:0:26169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf43e12d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+6:3643:x1870854458229120:12345-0@lo:400:kworker.0 Request processed in 41us (153us total) trans 0 rc 0/0 00000100:00100000:0.0:1784189307.451567:0:26169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2559 00000100:00100000:1.0:1784189307.451578:0:66945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf43e12300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1870854458228352:12345-0@lo:400:kworker.0 Request processed in 58us (284us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189307.451586:0:66945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1302 00000100:00100000:0.0:1784189307.451606:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784189307.451623:0:66945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458228096 00000100:00100000:1.0:1784189307.451628:0:66945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458228096 00000100:00100000:0.0:1784189307.451631:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf43e13100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1870854458228992:0@lo:400:kworker.0 00000100:00100000:1.0:1784189307.451664:0:66945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1303 00000100:00100000:1.0:1784189307.451677:0:66945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf43e11f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1870854458228096:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784189307.451677:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784189307.451724:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc05ed38e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3643:1870854458228352:0@lo:400:kworker.0 00000100:00100000:1.0:1784189307.451730:0:66945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf43e11f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1870854458228096:12345-0@lo:400:kworker.0 Request processed in 57us (122us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189307.451738:0:66945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1303 00000100:00100000:0.0:1784189307.451740:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf43e11180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1870854458229120:0@lo:400:kworker.0 00000100:00100000:1.0:1784189307.451765:0:26160:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458228992 00000100:00100000:1.0:1784189307.451771:0:26160:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458228992 00000100:00100000:0.0:1784189307.452041:0:26166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2560 00000100:00100000:0.0:1784189307.452049:0:26166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf43e12a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+6:3642:x1870854458228992:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784189307.452081:0:26166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf43e12a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+6:3642:x1870854458228992:12345-0@lo:400:kworker.0 Request processed in 33us (409us total) trans 0 rc 0/0 00000100:00100000:0.0:1784189307.452087:0:26166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2560 00000100:00080000:3.0:1784189307.453092:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1784189307.453109:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1784189307.453113:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1784189307.453151:0:3639:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 115964117000 gen 3 00000004:00080000:3.0:1784189307.453158:0:3639:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 115964116998 committed transno 115964117000 00000020:00080000:3.0:1784189307.453164:0:3639:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0001-osd tmt ffff9dc04673fc00 refcount 2 committed 0 result 0 batchid 77309411388 00000020:00080000:3.0:1784189307.453169:0:3639:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9dbf44dc8c00 obd lustre-MDT0000-osp-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff9dc04673f540 00000020:00080000:3.0:1784189307.453172:0:3639:0:(update_trans.c:71:top_multiple_thandle_dump()) cookie [0x2000088d1:0x2:0x0].4 00000020:00080000:3.0:1784189307.453176:0:3639:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9dbf44dc8500 obd lustre-MDT0001-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9dc056591400 00000020:00080000:3.0:1784189307.453179:0:3639:0:(update_trans.c:71:top_multiple_thandle_dump()) cookie [0x2400090a0:0x2:0x0].4 00000004:00080000:3.0:1784189307.453207:0:3639:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 115964116999 committed transno 115964117000 00000004:00080000:3.0:1784189307.453218:0:3639:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 115964117000 committed transno 115964117000 00000020:00080000:3.0:1784189307.453222:0:3639:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0001-osd tmt ffff9dbf43e3a000 refcount 2 committed 0 result 0 batchid 77309411389 00000020:00080000:3.0:1784189307.453225:0:3639:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9dbf44dc8100 obd lustre-MDT0000-osp-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff9dbf43e3a780 00000020:00080000:3.0:1784189307.453227:0:3639:0:(update_trans.c:71:top_multiple_thandle_dump()) cookie [0x2000088d1:0x2:0x0].5 00000020:00080000:3.0:1784189307.453229:0:3639:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9dbf44dc8400 obd lustre-MDT0001-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9dbf4226ea00 00000020:00080000:3.0:1784189307.453232:0:3639:0:(update_trans.c:71:top_multiple_thandle_dump()) cookie [0x2400090a0:0x2:0x0].5 00000100:00080000:3.0:1784189307.453248:0:3639:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-osp-MDT0001: connect to target with instance 28 00000100:00080000:3.0:1784189307.453267:0:3639:0:(import.c:65:import_set_state_nolock()) ffff9dbf436c4000 lustre-MDT0000_UUID: changing import state from CONNECTING to REPLAY 00000100:00080000:3.0:1784189307.453271:0:3639:0:(import.c:1700:ptlrpc_import_recovery_state_machine()) replay requested by lustre-MDT0000_UUID 00000100:00100000:3.0:1784189307.453274:0:3639:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 115964117000 gen 3 00000100:00080000:3.0:1784189307.453277:0:3639:0:(recover.c:53:ptlrpc_replay_next()) import ffff9dbf436c4000 from lustre-MDT0000_UUID committed 115964117000 last 0 00000100:00080000:3.0:1784189307.453280:0:3639:0:(import.c:65:import_set_state_nolock()) ffff9dbf436c4000 lustre-MDT0000_UUID: changing import state from REPLAY to REPLAY_LOCKS 00000020:00080000:3.0:1784189307.453306:0:75608:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 77309411389 committed batchid 77309411387 00000020:00080000:3.0:1784189307.453391:0:75608:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 77309411387 00000100:00100000:3.0:1784189307.453637:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc05ed38700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3639:1870854458228480:0@lo:38:kworker.0 00010000:00080000:3.0:1784189307.453666:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dbf43e13800 x1870854458229248/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1784189317 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1784189307.453679:0:3639:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 28 00000100:00080000:3.0:1784189307.453685:0:3639:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:3.0:1784189307.453690:0:3639:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1784189307.453692:0:3639:0:(import.c:65:import_set_state_nolock()) ffff9dbf43fcb000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1784189307.453698:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf43e13800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3639:1870854458229248:0@lo:38:kworker.0 00010000:00080000:3.0:1784189307.453724:0:94666:0:(ldlm_request.c:2972:ldlm_lock_replay_thread()) lock replay thread lustre-MDT0000-osp-MDT0001 to lustre-MDT0000_UUID@0@lo 00010000:00010000:3.0:1784189307.453728:0:94666:0:(ldlm_request.c:2888:ldlm_cancel_unused_locks_for_replay()) Dropping as many unused locks as possible before replay for namespace lustre-MDT0000-osp-MDT0001 (0) 00010000:00010000:3.0:1784189307.453733:0:94666:0:(ldlm_request.c:2901:ldlm_cancel_unused_locks_for_replay()) Canceled 0 unused locks from namespace lustre-MDT0000-osp-MDT0001 00010000:00010000:3.0:1784189307.454189:0:94666:0:(ldlm_request.c:2860:replay_one_lock()) ### replaying lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff9dc07116e200/0xcc1762b626f8beb2 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xcc1762b626f8beb9 expref: -99 pid: 66171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00080000:3.0:1784189307.454218:0:94666:0:(ldlm_request.c:2910:lock_can_replay()) check lock replay limit, inflights = 1(512) 00000100:00100000:2.0:1784189307.454353:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf469b7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3639:1870854458229376:0@lo:101:ldlm_lock_repla.0 00000100:00100000:2.0:1784189307.454408:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784189307.454438:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458229376 00000100:00100000:0.0:1784189307.454445:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458229376 00000100:00100000:0.0:1784189307.454492:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3926 00000100:00100000:0.0:1784189307.454500:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc056eac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3639:x1870854458229376:12345-0@lo:101:ldlm_lock_repla.0 00010000:00080000:0.0:1784189307.454521:0:8439:0:(ldlm_lib.c:3187:target_queue_recovery_request()) @@@ queue lock replay req req@ffff9dc056eac380 x1870854458229376/t0(0) o101->lustre-MDT0001-mdtlov_UUID@0@lo:498/0 lens 328/0 e 0 to 0 dl 1784189318 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784189307.454531:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc056eac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3639:x1870854458229376:12345-0@lo:101:ldlm_lock_repla.0 Request processed in 33us (124us total) trans 0 rc 0/-999 00000100:00100000:0.0:1784189307.454537:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3926 00000020:00080000:2.0:1784189307.456033:0:75588:0:(update_trans.c:1348:distribute_txn_batchid_cb()) lustre-MDT0001: 77309411389 batchid updated 00000001:00100000:2.0:1784189307.456057:0:75588:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00080000:3.0:1784189307.456822:0:75608:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 77309411389 00000004:00080000:3.0:1784189307.456879:0:75608:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff9dc080ea9e40 with version 15 00000020:00080000:3.0:1784189307.456897:0:75608:0:(update_trans.c:1311:distribute_txn_cancel_records()) lustre-MDT0000-osp-MDT0001: batchid 77309411388 cancel update log [0x2000088d1:0x2:0x0].4: rc = 0 00000004:00080000:2.0:1784189307.456931:0:75594:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9dc05020c840 version 15 rpc_version 15 00000020:00100000:2.0:1784189307.456972:0:75594:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:2.0:1784189307.456984:0:75594:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9dc056eac700 x1870854458229632/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000020:00080000:3.0:1784189307.456992:0:75608:0:(update_trans.c:1311:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 77309411388 cancel update log [0x2400090a0:0x2:0x0].4: rc = 0 00000100:00080000:2.0:1784189307.457007:0:75594:0:(client.c:1832:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != REPLAY_LOCKS) req@ffff9dc056eac700 x1870854458229632/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'osp_up0-1.0' uid:0 gid:0 projid:4294967295 00000004:00080000:3.0:1784189307.457017:0:75608:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff9dc080ea99c0 with version 16 00000100:00100000:2.0:1784189307.457019:0:75594:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dc0583003c0 going to sleep for 0 seconds 00000020:00080000:3.0:1784189307.457023:0:75608:0:(update_trans.c:1311:distribute_txn_cancel_records()) lustre-MDT0000-osp-MDT0001: batchid 77309411389 cancel update log [0x2000088d1:0x2:0x0].5: rc = 0 00000020:00080000:3.0:1784189307.457045:0:75608:0:(update_trans.c:1311:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 77309411389 cancel update log [0x2400090a0:0x2:0x0].5: rc = 0 00000020:00080000:3.0:1784189307.457051:0:75608:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 77309411389 00000004:00080000:1.0:1784189307.457540:0:94337:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 6114us 00000100:00100000:1.0:1784189307.457586:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc05ed3a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3642:1870854458228096:0@lo:400:kworker.0 00000100:00100000:1.0:1784189307.458302:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf43e13100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1870854458228992:0@lo:400:kworker.0 00010000:00010000:2.0:1784189307.468239:0:94337:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04a20a200/0xcc1762b626f8c795 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 94337 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189307.468261:0:94337:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04a20a200/0xcc1762b626f8c795 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 94337 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189307.468276:0:94337:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04a20a200/0xcc1762b626f8c795 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 94337 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189307.468305:0:94337:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04a20bc00/0xcc1762b626f8c79c lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x21e7de2f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 94337 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189307.468313:0:94337:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04a20bc00/0xcc1762b626f8c79c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x21e7de2f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 94337 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189307.468342:0:94337:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04a20bc00/0xcc1762b626f8c79c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x21e7de2f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 94337 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189307.468761:0:94337:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04a20a200/0xcc1762b626f8c795 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 94337 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189307.468770:0:94337:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04a20a200/0xcc1762b626f8c795 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 94337 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189307.468777:0:94337:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04a20a200/0xcc1762b626f8c795 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 94337 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189307.468783:0:94337:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc04a20a200 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:2.0:1784189307.468787:0:94337:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04a20a200/0xcc1762b626f8c795 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 94337 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189307.468794:0:94337:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04a20a200/0xcc1762b626f8c795 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 94337 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189307.468807:0:94337:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9dc07b032400) 00010000:00010000:2.0:1784189307.468810:0:94337:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784189307.468814:0:94337:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04a20a200/0xcc1762b626f8c795 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 94337 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189307.468821:0:94337:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04a20a200/0xcc1762b626f8c795 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 94337 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1784189307.468844:0:94337:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000075623f2c reply state 00000000f472c630 transno 115964117001 ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04a20bc00/0xcc1762b626f8c79c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x21e7de2f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 94337 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189307.468855:0:94337:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04a20bc00/0xcc1762b626f8c79c lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x21e7de2f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 94337 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189307.468861:0:94337:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x21e7de2f (ffff9dc07b032600) 00010000:00010000:2.0:1784189307.468863:0:94337:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1784189307.468866:0:94337:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:2.0:1784189307.468967:0:94337:0:(ldlm_lib.c:2100:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 101 seconds 00000020:00080000:2.0:1784189307.468989:0:94337:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1784189307.468992:0:94337:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 115964117002 00000020:00080000:2.0:1784189307.468997:0:94337:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1784189307.468999:0:94337:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 115964117002 00000100:00100000:1.0:1784189307.472354:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1784189307.472607:0:66170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436316160 00000100:00100000:3.0:1784189307.472617:0:66170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436316160 00000001:00080000:1.0:1784189307.473359:0:94304:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 115964117001 is committed 00010000:00010000:1.0:1784189307.473394:0:3627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04a20bc00/0xcc1762b626f8c79c lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x21e7de2f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 94337 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189307.473417:0:3627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04a20bc00/0xcc1762b626f8c79c lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x21e7de2f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 94337 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189307.473425:0:3627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04a20bc00/0xcc1762b626f8c79c lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x21e7de2f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 94337 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189307.473431:0:3627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc04a20bc00 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:1.0:1784189307.473436:0:3627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04a20bc00/0xcc1762b626f8c79c lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x21e7de2f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 94337 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189307.473443:0:3627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04a20bc00/0xcc1762b626f8c79c lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x21e7de2f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 94337 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189307.473461:0:3627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x21e7de2f (ffff9dc07b032600) 00010000:00010000:1.0:1784189307.473465:0:3627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784189307.473469:0:3627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04a20bc00/0xcc1762b626f8c79c lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x21e7de2f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 94337 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189307.473476:0:3627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04a20bc00/0xcc1762b626f8c79c lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x21e7de2f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 94337 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784189307.473575:0:66170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1428 00000100:00100000:3.0:1784189307.473587:0:66170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf46435180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:debedd94-805c-42a0-a5e5-41758b2012e9+6:2395:x1870854436316160:12345-192.168.203.12@tcp:36:rm.0 00010000:00080000:3.0:1784189307.473604:0:66170:0:(ldlm_lib.c:3228:target_queue_recovery_request()) Next recovery transno: 115964117002, current: 115964117002, replaying 00000100:00100000:3.0:1784189307.473617:0:66170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf46435180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:debedd94-805c-42a0-a5e5-41758b2012e9+6:2395:x1870854436316160:12345-192.168.203.12@tcp:36:rm.0 Request processed in 35us (1273us total) trans 0 rc 0/-999 00000100:00100000:3.0:1784189307.473625:0:66170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1428 00000020:00080000:3.0:1784189307.473639:0:94337:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1784189307.473643:0:94337:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 115964117002, next_transno: 115964117002 00010000:00080000:3.0:1784189307.473714:0:94337:0:(ldlm_lib.c:2246:check_for_next_transno()) waking for next (115964117002) 00000020:00080000:3.0:1784189307.473717:0:94337:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1784189307.473727:0:94337:0:(ldlm_lib.c:2747:replay_request_or_update()) @@@ processing x1870854436316160 t115964117002 from 192.168.203.12@tcp req@ffff9dbf46435180 x1870854436316160/t0(115964117002) o36->debedd94-805c-42a0-a5e5-41758b2012e9@192.168.203.12@tcp:498/0 lens 512/0 e 0 to 0 dl 1784189318 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'rm.0' uid:0 gid:0 projid:4294967295 00010000:00010000:3.0:1784189307.473801:0:94337:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc058f66200/0xcc1762b626f8c7a3 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 94337 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189307.473814:0:94337:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc058f66200/0xcc1762b626f8c7a3 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 94337 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189307.473826:0:94337:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc058f66200/0xcc1762b626f8c7a3 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 94337 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189307.473845:0:94337:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc058f66000/0xcc1762b626f8c7aa lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x21e7de2f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 94337 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189307.473853:0:94337:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc058f66000/0xcc1762b626f8c7aa lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x21e7de2f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 94337 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189307.473860:0:94337:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc058f66000/0xcc1762b626f8c7aa lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x21e7de2f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 94337 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189307.473943:0:94337:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc058f67200/0xcc1762b626f8c7b1 lrc: 3/0,1 mode: --/EX res: [0x20000cf21:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 94337 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189307.473951:0:94337:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc058f67200/0xcc1762b626f8c7b1 lrc: 3/0,1 mode: EX/EX res: [0x20000cf21:0x3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 94337 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189307.473957:0:94337:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc058f67200/0xcc1762b626f8c7b1 lrc: 3/0,1 mode: EX/EX res: [0x20000cf21:0x3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 94337 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189307.474172:0:94337:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc058f67200/0xcc1762b626f8c7b1 lrc: 3/0,1 mode: EX/EX res: [0x20000cf21:0x3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 94337 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189307.474179:0:94337:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc058f67200/0xcc1762b626f8c7b1 lrc: 2/0,0 mode: EX/EX res: [0x20000cf21:0x3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 94337 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189307.474186:0:94337:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dc058f67200/0xcc1762b626f8c7b1 lrc: 3/0,0 mode: EX/EX res: [0x20000cf21:0x3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 94337 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189307.474848:0:94337:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc058f67200 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:3.0:1784189307.474852:0:94337:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc058f67200/0xcc1762b626f8c7b1 lrc: 3/0,0 mode: EX/EX res: [0x20000cf21:0x3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 94337 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189307.474860:0:94337:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc058f67200/0xcc1762b626f8c7b1 lrc: 4/0,0 mode: EX/EX res: [0x20000cf21:0x3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 94337 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189307.474878:0:94337:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x3:0x0].0x0 (ffff9dc041408f00) 00010000:00010000:3.0:1784189307.474880:0:94337:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1784189307.474884:0:94337:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dc058f67200/0xcc1762b626f8c7b1 lrc: 2/0,0 mode: --/EX res: [0x20000cf21:0x3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 94337 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189307.474890:0:94337:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc058f67200/0xcc1762b626f8c7b1 lrc: 0/0,0 mode: --/EX res: [0x20000cf21:0x3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 94337 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189307.474907:0:94337:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc058f66200/0xcc1762b626f8c7a3 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 94337 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189307.474914:0:94337:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc058f66200/0xcc1762b626f8c7a3 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 94337 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189307.474920:0:94337:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dc058f66200/0xcc1762b626f8c7a3 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 94337 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189307.474925:0:94337:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc058f66200 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:3.0:1784189307.474928:0:94337:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc058f66200/0xcc1762b626f8c7a3 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 94337 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189307.474934:0:94337:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc058f66200/0xcc1762b626f8c7a3 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 94337 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189307.474941:0:94337:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9dc041408e00) 00010000:00010000:3.0:1784189307.474943:0:94337:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784189307.474946:0:94337:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dc058f66200/0xcc1762b626f8c7a3 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 94337 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189307.474951:0:94337:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc058f66200/0xcc1762b626f8c7a3 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 94337 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1784189307.474975:0:94337:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000b7a22dff reply state 000000004ae0d216 transno 115964117002 ns: mdt-lustre-MDT0000_UUID lock: ffff9dc058f66000/0xcc1762b626f8c7aa lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x21e7de2f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 94337 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189307.474986:0:94337:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc058f66000/0xcc1762b626f8c7aa lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x21e7de2f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 94337 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189307.474992:0:94337:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x21e7de2f (ffff9dc041408500) 00010000:00010000:3.0:1784189307.474994:0:94337:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1784189307.474997:0:94337:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:3.0:1784189307.475118:0:94337:0:(ldlm_lib.c:2100:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:3.0:1784189307.475134:0:94337:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1784189307.475137:0:94337:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 115964117003 00000020:00080000:3.0:1784189307.475140:0:94337:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1784189307.475142:0:94337:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 115964117003 00000100:00100000:2.0:1784189307.487511:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1784189307.487565:0:68287:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436324736 00000100:00100000:3.0:1784189307.487575:0:68287:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436324736 00000100:00100000:3.0:1784189307.487633:0:68287:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1304 00000100:00100000:3.0:1784189307.487643:0:68287:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc056eac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:debedd94-805c-42a0-a5e5-41758b2012e9+8:2395:x1870854436324736:12345-192.168.203.12@tcp:400:ldlm_lock_repla.0 00010000:00080000:3.0:1784189307.487667:0:68287:0:(ldlm_lib.c:3137:target_queue_recovery_request()) @@@ queue final req req@ffff9dc056eac000 x1870854436324736/t0(0) o400->debedd94-805c-42a0-a5e5-41758b2012e9@192.168.203.12@tcp:498/0 lens 224/0 e 0 to 0 dl 1784189318 ref 2 fl Interpret:H/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784189307.487690:0:68287:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc056eac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:debedd94-805c-42a0-a5e5-41758b2012e9+8:2395:x1870854436324736:12345-192.168.203.12@tcp:400:ldlm_lock_repla.0 Request processed in 51us (189us total) trans 0 rc 0/-999 00000100:00100000:3.0:1784189307.487698:0:68287:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1304 00000020:00080000:1.0:1784189307.487730:0:94337:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1784189307.487735:0:94337:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 2, connected: 2, completed: 2, queue_len: 0, req_transno: 0, next_transno: 115964117003 00010000:00080000:1.0:1784189307.487739:0:94337:0:(ldlm_lib.c:2262:check_for_next_transno()) waking for completed recovery 00000020:00080000:1.0:1784189307.487741:0:94337:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1784189307.487747:0:94337:0:(ldlm_lib.c:2452:target_next_replay_lock()) Waiting for lock 00010000:00080000:1.0:1784189307.487749:0:94337:0:(ldlm_lib.c:2282:check_for_next_lock()) waking for next lock 00010000:00080000:1.0:1784189307.487757:0:94337:0:(ldlm_lib.c:2888:target_recovery_thread()) @@@ processing lock from 0@lo: req@ffff9dc056eac380 x1870854458229376/t0(0) o101->lustre-MDT0001-mdtlov_UUID@0@lo:498/0 lens 328/0 e 0 to 0 dl 1784189318 ref 1 fl Complete:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00010000:1.0:1784189307.487775:0:94337:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784189307.487812:0:94337:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4710e800/0xcc1762b626f8c7b8 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcc1762b626f8beb2 expref: -99 pid: 94337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189307.487836:0:94337:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4710e800/0xcc1762b626f8c7b8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xcc1762b626f8beb2 expref: 7 pid: 94337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189307.487850:0:94337:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4710e800/0xcc1762b626f8c7b8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xcc1762b626f8beb2 expref: 7 pid: 94337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189307.487858:0:94337:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dbf4710e800, rc 0) 00010000:00080000:1.0:1784189307.487916:0:94337:0:(ldlm_lib.c:2100:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00010000:00080000:1.0:1784189307.487926:0:94337:0:(ldlm_lib.c:2452:target_next_replay_lock()) Waiting for lock 00010000:00010000:3.0:1784189307.488093:0:3639:0:(ldlm_request.c:2777:replay_lock_interpret()) ### replayed lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff9dc07116e200/0xcc1762b626f8beb2 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xcc1762b626f8c7b8 expref: -99 pid: 66171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1784189307.488895:0:3639:0:(import.c:65:import_set_state_nolock()) ffff9dbf436c4000 lustre-MDT0000_UUID: changing import state from REPLAY_LOCKS to REPLAY_WAIT 00000100:00100000:3.0:1784189307.488931:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf469b7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3639:1870854458229376:0@lo:101:ldlm_lock_repla.0 00000100:00100000:3.0:1784189307.488956:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf469b7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3639:1870854458229760:0@lo:400:ptlrpcd_rcv.0 00000100:00100000:3.0:1784189307.489001:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784189307.489064:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458229760 00000100:00100000:2.0:1784189307.489070:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458229760 00000100:00100000:2.0:1784189307.489121:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3927 00000100:00100000:2.0:1784189307.489130:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf469b7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3639:x1870854458229760:12345-0@lo:400:ptlrpcd_rcv.0 00010000:00080000:2.0:1784189307.489145:0:8438:0:(ldlm_lib.c:3137:target_queue_recovery_request()) @@@ queue final req req@ffff9dbf469b7800 x1870854458229760/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:498/0 lens 224/0 e 0 to 0 dl 1784189318 ref 2 fl Interpret:/2c0/ffffffff rc 0/-1 job:'ptlrpcd_rcv.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784189307.489169:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf469b7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3639:x1870854458229760:12345-0@lo:400:ptlrpcd_rcv.0 Request processed in 41us (168us total) trans 0 rc 0/-999 00000100:00100000:2.0:1784189307.489175:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3927 00010000:00080000:1.0:1784189307.489217:0:94337:0:(ldlm_lib.c:2285:check_for_next_lock()) waking for completed lock replay 00000001:00000004:1.0:1784189307.489349:0:94337:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 28, last_transno is 120259084288 00000001:00100000:2.0:1784189307.492437:0:94304:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000001:00100000:2.0:1784189307.492448:0:94304:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of debedd94-805c-42a0-a5e5-41758b2012e9 00000001:00080000:2.0:1784189307.492472:0:94304:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 115964117002 is committed 00010000:00010000:3.0:1784189307.492555:0:3626:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc058f66000/0xcc1762b626f8c7aa lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x21e7de2f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 94337 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189307.492568:0:3626:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc058f66000/0xcc1762b626f8c7aa lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x21e7de2f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 94337 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189307.492575:0:3626:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dc058f66000/0xcc1762b626f8c7aa lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x21e7de2f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 94337 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189307.492582:0:3626:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc058f66000 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:3.0:1784189307.492587:0:3626:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc058f66000/0xcc1762b626f8c7aa lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x21e7de2f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 94337 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189307.492595:0:3626:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc058f66000/0xcc1762b626f8c7aa lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x21e7de2f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 94337 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189307.492612:0:3626:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dc058f66000/0xcc1762b626f8c7aa lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x21e7de2f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 94337 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189307.492619:0:3626:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc058f66000/0xcc1762b626f8c7aa lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x21e7de2f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 94337 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1784189307.493156:0:94337:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00010000:00080000:1.0:1784189307.493267:0:94337:0:(ldlm_lib.c:1996:target_cancel_recovery_timer()) lustre-MDT0000: cancel recovery timer 00010000:00080000:1.0:1784189307.493282:0:94337:0:(ldlm_lib.c:2940:target_recovery_thread()) @@@ processing final ping from 192.168.203.12@tcp: req@ffff9dc056eac000 x1870854436324736/t0(0) o400->debedd94-805c-42a0-a5e5-41758b2012e9@192.168.203.12@tcp:498/0 lens 224/0 e 0 to 0 dl 1784189318 ref 1 fl Complete:H/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00080000:1.0:1784189307.493723:0:94337:0:(ldlm_lib.c:2940:target_recovery_thread()) @@@ processing final ping from 0@lo: req@ffff9dbf469b7800 x1870854458229760/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:498/0 lens 224/0 e 0 to 0 dl 1784189318 ref 1 fl Complete:/2c0/ffffffff rc 0/-1 job:'ptlrpcd_rcv.0' uid:0 gid:0 projid:4294967295 00010000:02000000:1.0:1784189307.493799:0:94337:0:(ldlm_lib.c:1868:target_finish_recovery()) lustre-MDT0000: Recovery over after 0:04, of 2 clients 2 recovered and 0 were evicted. 00000100:00080000:0.0:1784189307.496521:0:3639:0:(import.c:65:import_set_state_nolock()) ffff9dbf436c4000 lustre-MDT0000_UUID: changing import state from REPLAY_WAIT to RECOVER 00000100:00080000:0.0:1784189307.496537:0:3639:0:(client.c:3234:ptlrpc_resend_req()) @@@ going to resend req@ffff9dbf469b7480 x1870854458229760/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1784189323 ref 1 fl Interpret:RQU/2c0/0 rc 0/0 job:'ptlrpcd_rcv.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1784189307.496550:0:3639:0:(client.c:3243:ptlrpc_resend_req()) @@@ it has reply, so skip it req@ffff9dbf469b7480 x1870854458229760/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1784189323 ref 1 fl Interpret:RQU/2c0/0 rc 0/0 job:'ptlrpcd_rcv.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1784189307.496558:0:3639:0:(import.c:65:import_set_state_nolock()) ffff9dbf436c4000 lustre-MDT0000_UUID: changing import state from RECOVER to FULL 00000100:02000000:0.0:1784189307.496595:0:3639:0:(import.c:1743:ptlrpc_import_recovery_state_machine()) lustre-MDT0000-osp-MDT0001: Connection restored to 0@lo (at 0@lo) 00000100:00080000:0.0:1784189307.496602:0:3639:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 00000000a722b4a5): req@ffff9dbf4262d880 x1870854458208256/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1784189291 ref 1 fl Rpc:RSQU/200/0 rc -107/-107 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1784189307.496619:0:3639:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 000000007614c5cc): req@ffff9dc056eac700 x1870854458229632/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'osp_up0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784189307.496639:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf469b7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3639:1870854458229760:0@lo:400:ptlrpcd_rcv.0 00000100:00100000:0.0:1784189307.496729:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784189307.496769:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458208256 00000100:00100000:0.0:1784189307.496776:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458208256 00000100:00100000:0.0:1784189307.496816:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3928 00000100:00100000:0.0:1784189307.496825:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf43e11180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3640:x1870854458208256:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1784189307.496858:0:8439:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445228544 avail 1298989056 00000100:00100000:0.0:1784189307.496902:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf43e11180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3640:x1870854458208256:12345-0@lo:41:osp-pre-0-1.0 Request processed in 78us (172us total) trans 0 rc 0/0 00000100:00100000:0.0:1784189307.496909:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3928 00000100:00100000:0.0:1784189307.496943:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf4262d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1870854458208256:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1784189307.497086:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1784189307.497111:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf469b6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1870854458229888:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1784189307.497142:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784189307.497170:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458229888 00000100:00100000:3.0:1784189307.497175:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458229888 00000100:00100000:3.0:1784189307.497208:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3929 00000100:00100000:3.0:1784189307.497214:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf469b6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3641:x1870854458229888:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1784189307.497226:0:8438:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445228544 avail 1298989056 00000100:00100000:3.0:1784189307.497258:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf469b6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3641:x1870854458229888:12345-0@lo:41:osp-pre-0-1.0 Request processed in 43us (115us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189307.497264:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3929 00000100:00100000:3.0:1784189307.497294:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf469b6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1870854458229888:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1784189307.497389:0:75594:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784189307.497405:0:75594:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dc0583003c0 going to sleep for 11 seconds 00000100:00100000:3.0:1784189307.497416:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458229632 00000100:00100000:3.0:1784189307.497419:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458229632 00000100:00100000:3.0:1784189307.497442:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3930 00000100:00100000:3.0:1784189307.497448:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf469b6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:75594:x1870854458229632:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:3.0:1784189307.497606:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf469b6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:75594:x1870854458229632:12345-0@lo:1000:osp_up0-1.0 Request processed in 157us (216us total) trans 120259084289 rc 0/0 00000100:00100000:3.0:1784189307.497613:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3930 00000100:00100000:3.0:1784189307.497655:0:75594:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc056eac700 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:75594:1870854458229632:0@lo:1000:osp_up0-1.0 00000004:00080000:3.0:1784189307.497667:0:75594:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9dc05020c840 version 16 rpc_version 16 00000020:00100000:3.0:1784189307.497683:0:75594:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:3.0:1784189307.497689:0:75594:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9dbf469b5c00 x1870854458230144/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1784189307.497704:0:75594:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf469b5c00 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:75594:1870854458230144:0@lo:1000:osp_up0-1.0 00000100:00100000:3.0:1784189307.497727:0:75594:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784189307.497741:0:75594:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dc0583003c0 going to sleep for 11 seconds 00000100:00100000:3.0:1784189307.497753:0:26492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458230144 00000100:00100000:3.0:1784189307.497756:0:26492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458230144 00000100:00100000:3.0:1784189307.497789:0:26492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3931 00000100:00100000:3.0:1784189307.497795:0:26492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf469b4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:75594:x1870854458230144:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:3.0:1784189307.497865:0:26492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf469b4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:75594:x1870854458230144:12345-0@lo:1000:osp_up0-1.0 Request processed in 71us (137us total) trans 120259084290 rc 0/0 00000100:00100000:3.0:1784189307.497872:0:26492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3931 00000100:00100000:3.0:1784189307.497901:0:75594:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf469b5c00 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:75594:1870854458230144:0@lo:1000:osp_up0-1.0 00000004:00000080:0.0:1784189307.525833:0:94337:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffae0987dabe10 00100000:10000000:0.0:1784189307.525848:0:94337:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000004:00080000:0.0:1784189307.527537:0:94324:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x2c0000401:0x703:0x0] 00000100:00100000:0.0:1784189307.527583:0:94324:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf43e10700 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:94324:1870854458230272:0@lo:5:osp-pre-1-0.0 00000100:00100000:0.0:1784189307.527643:0:94324:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784189307.527683:0:94324:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dbf425bb540 going to sleep for 11 seconds 00000100:00100000:0.0:1784189307.527707:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458230272 00000100:00100000:0.0:1784189307.527714:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458230272 00000100:00100000:0.0:1784189307.527758:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4992 00000100:00100000:0.0:1784189307.527767:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf43e10a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:94324:x1870854458230272:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:0.0:1784189307.527801:0:8427:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 1889 -> diff = -94 00002000:02000040:0.0:1784189307.527806:0:8427:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000401:1796 to 0x2c0000401:1889) 00000004:00080000:2.0:1784189307.532139:0:94322:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x280000401:0x702:0x0] 00000100:00100000:2.0:1784189307.532188:0:94322:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc056ead500 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:94322:1870854458230400:0@lo:5:osp-pre-0-0.0 00000100:00100000:2.0:1784189307.532258:0:94322:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784189307.532340:0:94322:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dc050825e40 going to sleep for 11 seconds 00000100:00100000:1.0:1784189307.539791:0:26161:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458230400 00000100:00100000:1.0:1784189307.539804:0:26161:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458230400 00000100:00100000:1.0:1784189307.539862:0:26171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4993 00000100:00100000:1.0:1784189307.539872:0:26171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc056eafb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+6:94322:x1870854458230400:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:1.0:1784189307.539907:0:26171:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 1889 -> diff = -95 00002000:02000040:1.0:1784189307.539913:0:26171:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:1795 to 0x280000401:1889) 00002000:00010000:0.0:1784189307.540793:0:8427:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x761:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784189307.540803:0:8427:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001bd2303a/0xcc1762b626f8c7bf lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x761:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189307.540821:0:8427:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x761:0x0].0x0 since=3549s v=(0 0) 00010000:00010000:0.0:1784189307.540826:0:8427:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x761:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784189307.540832:0:8427:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001bd2303a/0xcc1762b626f8c7bf lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x761:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189307.540848:0:8427:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001bd2303a/0xcc1762b626f8c7bf lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x761:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189307.540856:0:8427:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001bd2303a/0xcc1762b626f8c7bf lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x761:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189307.540862:0:8427:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001bd2303a/0xcc1762b626f8c7bf lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x761:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189307.540890:0:8427:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1784189307.540992:0:8427:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x760:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784189307.540998:0:8427:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b6a56637/0xcc1762b626f8c7c6 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x760:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189307.541006:0:8427:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x760:0x0].0x0 since=3549s v=(0 0) 00010000:00010000:0.0:1784189307.541018:0:8427:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x760:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784189307.541022:0:8427:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b6a56637/0xcc1762b626f8c7c6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x760:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189307.541032:0:8427:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b6a56637/0xcc1762b626f8c7c6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x760:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189307.541040:0:8427:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b6a56637/0xcc1762b626f8c7c6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x760:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189307.541046:0:8427:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b6a56637/0xcc1762b626f8c7c6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x760:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189307.541063:0:8427:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1784189307.541073:0:26173:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1784189307.541079:0:26173:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001bd2303a/0xcc1762b626f8c7bf lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x761:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189307.541086:0:26173:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc05ec0f400 already unused, calling callback (ffffffffc0b2e230) 00010000:00010000:0.0:1784189307.541091:0:26173:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001bd2303a/0xcc1762b626f8c7bf lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x761:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189307.541109:0:26173:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001bd2303a/0xcc1762b626f8c7bf lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x761:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189307.541125:0:26173:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001bd2303a/0xcc1762b626f8c7bf lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x761:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189307.541144:0:26173:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001bd2303a/0xcc1762b626f8c7bf lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x761:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189307.541161:0:26173:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784189307.541164:0:26173:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b6a56637/0xcc1762b626f8c7c6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x760:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189307.541170:0:26173:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc05ec0ee00 already unused, calling callback (ffffffffc0b2e230) 00010000:00010000:0.0:1784189307.541173:0:26173:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b6a56637/0xcc1762b626f8c7c6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x760:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189307.541180:0:26173:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b6a56637/0xcc1762b626f8c7c6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x760:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189307.541266:0:7454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784189307.541294:0:26173:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b6a56637/0xcc1762b626f8c7c6 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x760:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189307.541302:0:26173:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b6a56637/0xcc1762b626f8c7c6 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x760:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189307.541315:0:26173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784189307.541437:0:26173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784189307.541440:0:26173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1784189307.541508:0:8427:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x75f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784189307.541514:0:8427:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c88020a6/0xcc1762b626f8c7cd lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x75f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189307.541530:0:8427:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x75f:0x0].0x0 since=3549s v=(0 0) 00010000:00010000:0.0:1784189307.541533:0:8427:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x75f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784189307.541537:0:8427:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c88020a6/0xcc1762b626f8c7cd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x75f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189307.541547:0:8427:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c88020a6/0xcc1762b626f8c7cd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x75f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189307.541554:0:8427:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c88020a6/0xcc1762b626f8c7cd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x75f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189307.541562:0:8427:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c88020a6/0xcc1762b626f8c7cd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x75f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189307.541577:0:8427:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1784189307.541622:0:8427:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x75e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784189307.541628:0:8427:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005d016393/0xcc1762b626f8c7d4 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x75e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189307.541636:0:8427:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x75e:0x0].0x0 since=3549s v=(0 0) 00010000:00010000:0.0:1784189307.541638:0:8427:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x75e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784189307.541642:0:8427:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005d016393/0xcc1762b626f8c7d4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x75e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189307.541649:0:8427:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005d016393/0xcc1762b626f8c7d4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x75e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189307.541668:0:8427:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005d016393/0xcc1762b626f8c7d4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x75e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189307.541675:0:8427:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005d016393/0xcc1762b626f8c7d4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x75e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189307.541688:0:8427:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:0.0:1784189307.541728:0:8427:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x75d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784189307.541733:0:8427:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008cdafd97/0xcc1762b626f8c7db lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x75d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189307.541741:0:8427:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x75d:0x0].0x0 since=3549s v=(0 0) 00010000:00010000:0.0:1784189307.541744:0:8427:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x75d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784189307.541748:0:8427:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008cdafd97/0xcc1762b626f8c7db lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x75d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189307.541758:0:8427:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008cdafd97/0xcc1762b626f8c7db lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x75d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189307.541766:0:8427:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008cdafd97/0xcc1762b626f8c7db lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x75d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189307.541773:0:8427:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008cdafd97/0xcc1762b626f8c7db lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x75d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189307.541799:0:8427:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:0.0:1784189307.541807:0:7454:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1784189307.541812:0:7454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c88020a6/0xcc1762b626f8c7cd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x75f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189307.541819:0:7454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc05ec0f000 already unused, calling callback (ffffffffc0b2e230) 00010000:00010000:0.0:1784189307.541822:0:7454:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c88020a6/0xcc1762b626f8c7cd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x75f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189307.541831:0:7454:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c88020a6/0xcc1762b626f8c7cd lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x75f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189307.541842:0:7454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c88020a6/0xcc1762b626f8c7cd lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x75f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189307.541849:0:7454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c88020a6/0xcc1762b626f8c7cd lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x75f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189307.541863:0:7454:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1784189307.541866:0:7454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005d016393/0xcc1762b626f8c7d4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x75e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189307.541872:0:7454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc05ec0f200 already unused, calling callback (ffffffffc0b2e230) 00010000:00010000:0.0:1784189307.541875:0:7454:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005d016393/0xcc1762b626f8c7d4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x75e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189307.541892:0:7454:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005d016393/0xcc1762b626f8c7d4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x75e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189307.541902:0:7454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005d016393/0xcc1762b626f8c7d4 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x75e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189307.541908:0:7454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005d016393/0xcc1762b626f8c7d4 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x75e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189307.541921:0:7454:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784189307.541924:0:7454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008cdafd97/0xcc1762b626f8c7db lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x75d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189307.541930:0:7454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc05ec0e000 already unused, calling callback (ffffffffc0b2e230) 00010000:00010000:0.0:1784189307.541933:0:7454:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008cdafd97/0xcc1762b626f8c7db lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x75d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189307.541941:0:7454:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008cdafd97/0xcc1762b626f8c7db lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x75d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189307.541950:0:7454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008cdafd97/0xcc1762b626f8c7db lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x75d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189307.541957:0:7454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008cdafd97/0xcc1762b626f8c7db lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x75d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189307.541981:0:7454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784189307.541983:0:7454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784189307.541985:0:7454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1784189307.542030:0:8427:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x75c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784189307.542035:0:8427:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e9a3ca49/0xcc1762b626f8c7e2 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x75c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189307.542044:0:8427:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x75c:0x0].0x0 since=3549s v=(0 0) 00010000:00010000:0.0:1784189307.542047:0:8427:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x75c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784189307.542051:0:8427:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e9a3ca49/0xcc1762b626f8c7e2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x75c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189307.542060:0:8427:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e9a3ca49/0xcc1762b626f8c7e2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x75c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189307.542069:0:8427:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e9a3ca49/0xcc1762b626f8c7e2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x75c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189307.542075:0:8427:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e9a3ca49/0xcc1762b626f8c7e2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x75c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189307.542088:0:8427:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1784189307.542094:0:26173:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784189307.542108:0:26173:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e9a3ca49/0xcc1762b626f8c7e2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x75c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189307.542127:0:26173:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc05ec0fc00 already unused, calling callback (ffffffffc0b2e230) 00010000:00010000:0.0:1784189307.542130:0:26173:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e9a3ca49/0xcc1762b626f8c7e2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x75c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189307.542138:0:26173:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e9a3ca49/0xcc1762b626f8c7e2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x75c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189307.542149:0:26173:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e9a3ca49/0xcc1762b626f8c7e2 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x75c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189307.542156:0:26173:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e9a3ca49/0xcc1762b626f8c7e2 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x75c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189307.542170:0:26173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784189307.542172:0:26173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784189307.542173:0:26173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1784189307.542585:0:8427:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x75b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784189307.542591:0:8427:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dc1a395e/0xcc1762b626f8c7e9 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x75b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189307.542599:0:8427:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x75b:0x0].0x0 since=3549s v=(0 0) 00010000:00010000:0.0:1784189307.542602:0:8427:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x75b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784189307.542607:0:8427:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dc1a395e/0xcc1762b626f8c7e9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x75b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189307.542616:0:8427:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000dc1a395e/0xcc1762b626f8c7e9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x75b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189307.542630:0:8427:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dc1a395e/0xcc1762b626f8c7e9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x75b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189307.542638:0:8427:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000dc1a395e/0xcc1762b626f8c7e9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x75b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189307.542651:0:8427:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1784189307.542657:0:7454:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784189307.542661:0:7454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000dc1a395e/0xcc1762b626f8c7e9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x75b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189307.542668:0:7454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc05ec0e200 already unused, calling callback (ffffffffc0b2e230) 00010000:00010000:0.0:1784189307.542672:0:7454:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000dc1a395e/0xcc1762b626f8c7e9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x75b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189307.542679:0:7454:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000dc1a395e/0xcc1762b626f8c7e9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x75b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189307.542690:0:7454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000dc1a395e/0xcc1762b626f8c7e9 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x75b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189307.542697:0:7454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000dc1a395e/0xcc1762b626f8c7e9 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x75b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189307.542709:0:7454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784189307.542715:0:7454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784189307.542717:0:7454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1784189307.549529:0:26171:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x761:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784189307.549543:0:26171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000029d98140/0xcc1762b626f8c7f0 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x761:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189307.549561:0:26171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x761:0x0].0x0 since=3549s v=(0 0) 00010000:00010000:1.0:1784189307.549566:0:26171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x761:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784189307.549572:0:26171:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000029d98140/0xcc1762b626f8c7f0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x761:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189307.549589:0:26171:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000029d98140/0xcc1762b626f8c7f0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x761:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189307.549600:0:26171:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000029d98140/0xcc1762b626f8c7f0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x761:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189307.549607:0:26171:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000029d98140/0xcc1762b626f8c7f0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x761:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189307.549630:0:26171:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1784189307.549734:0:26171:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x760:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784189307.549740:0:26171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f0234c64/0xcc1762b626f8c7f7 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x760:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189307.549749:0:26171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x760:0x0].0x0 since=3549s v=(0 0) 00010000:00010000:1.0:1784189307.549752:0:26171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x760:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784189307.549756:0:26171:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f0234c64/0xcc1762b626f8c7f7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x760:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189307.549781:0:26171:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f0234c64/0xcc1762b626f8c7f7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x760:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189307.549789:0:26171:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f0234c64/0xcc1762b626f8c7f7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x760:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189307.549796:0:26171:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f0234c64/0xcc1762b626f8c7f7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x760:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189307.549809:0:26171:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:1.0:1784189307.549855:0:26171:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x75f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784189307.549861:0:26171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000316b11d0/0xcc1762b626f8c7fe lrc: 3/0,1 mode: --/PW res: [0x280000401:0x75f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189307.549869:0:26171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x75f:0x0].0x0 since=3549s v=(0 0) 00010000:00010000:1.0:1784189307.549872:0:26171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x75f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784189307.549876:0:26171:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000316b11d0/0xcc1762b626f8c7fe lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x75f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189307.549884:0:26171:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000316b11d0/0xcc1762b626f8c7fe lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x75f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189307.549892:0:26171:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000316b11d0/0xcc1762b626f8c7fe lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x75f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189307.549910:0:26171:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000316b11d0/0xcc1762b626f8c7fe lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x75f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189307.549919:0:26171:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:1.0:1784189307.549958:0:26171:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x75e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784189307.549963:0:26171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e101baf9/0xcc1762b626f8c805 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x75e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189307.549971:0:26171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x75e:0x0].0x0 since=3549s v=(0 0) 00010000:00010000:1.0:1784189307.549974:0:26171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x75e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784189307.549977:0:26171:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e101baf9/0xcc1762b626f8c805 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x75e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189307.549986:0:26171:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e101baf9/0xcc1762b626f8c805 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x75e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189307.549994:0:26171:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e101baf9/0xcc1762b626f8c805 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x75e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189307.550001:0:26171:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e101baf9/0xcc1762b626f8c805 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x75e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189307.550009:0:26171:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00002000:00010000:1.0:1784189307.550047:0:26171:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x75d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784189307.550052:0:26171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000006c4aa/0xcc1762b626f8c80c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x75d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189307.550064:0:26171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x75d:0x0].0x0 since=3549s v=(0 0) 00010000:00010000:1.0:1784189307.550067:0:26171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x75d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784189307.550071:0:26171:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000006c4aa/0xcc1762b626f8c80c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x75d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189307.550079:0:26171:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000006c4aa/0xcc1762b626f8c80c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x75d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189307.550086:0:26171:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000006c4aa/0xcc1762b626f8c80c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x75d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189307.550094:0:26171:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000006c4aa/0xcc1762b626f8c80c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x75d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189307.550111:0:26171:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00002000:00010000:1.0:1784189307.550151:0:26171:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x75c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784189307.550155:0:26171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007ca946a3/0xcc1762b626f8c813 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x75c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189307.550163:0:26171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x75c:0x0].0x0 since=3549s v=(0 0) 00010000:00010000:1.0:1784189307.550166:0:26171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x75c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784189307.550170:0:26171:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007ca946a3/0xcc1762b626f8c813 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x75c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189307.550178:0:26171:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007ca946a3/0xcc1762b626f8c813 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x75c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189307.550824:0:26173:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:2.0:1784189307.550833:0:26173:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000029d98140/0xcc1762b626f8c7f0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x761:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189307.550843:0:26173:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dbf4710f000 already unused, calling callback (ffffffffc0b2e230) 00010000:00010000:2.0:1784189307.550848:0:26173:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000029d98140/0xcc1762b626f8c7f0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x761:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189307.550857:0:26173:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000029d98140/0xcc1762b626f8c7f0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x761:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189307.550874:0:26173:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000029d98140/0xcc1762b626f8c7f0 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x761:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189307.550881:0:26173:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000029d98140/0xcc1762b626f8c7f0 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x761:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189307.550911:0:26173:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1784189307.550915:0:26173:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f0234c64/0xcc1762b626f8c7f7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x760:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189307.550922:0:26173:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dbf4710e000 already unused, calling callback (ffffffffc0b2e230) 00010000:00010000:2.0:1784189307.550934:0:26173:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f0234c64/0xcc1762b626f8c7f7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x760:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189307.550941:0:26173:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f0234c64/0xcc1762b626f8c7f7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x760:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189307.550951:0:26173:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f0234c64/0xcc1762b626f8c7f7 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x760:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189307.550958:0:26173:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f0234c64/0xcc1762b626f8c7f7 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x760:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189307.550970:0:26173:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1784189307.550974:0:26173:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000316b11d0/0xcc1762b626f8c7fe lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x75f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189307.550981:0:26173:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc07116fc00 already unused, calling callback (ffffffffc0b2e230) 00010000:00010000:2.0:1784189307.550984:0:26173:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000316b11d0/0xcc1762b626f8c7fe lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x75f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189307.550991:0:26173:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000316b11d0/0xcc1762b626f8c7fe lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x75f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189307.550999:0:26173:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000316b11d0/0xcc1762b626f8c7fe lrc: 1/0,0 mode: --/PW res: [0x280000401:0x75f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189307.551006:0:26173:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000316b11d0/0xcc1762b626f8c7fe lrc: 0/0,0 mode: --/PW res: [0x280000401:0x75f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189307.551024:0:26173:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1784189307.551027:0:26173:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e101baf9/0xcc1762b626f8c805 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x75e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189307.551034:0:26173:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc07116e600 already unused, calling callback (ffffffffc0b2e230) 00010000:00010000:2.0:1784189307.551037:0:26173:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e101baf9/0xcc1762b626f8c805 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x75e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189307.551045:0:26173:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e101baf9/0xcc1762b626f8c805 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x75e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189307.551057:0:26173:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e101baf9/0xcc1762b626f8c805 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x75e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189307.551064:0:26173:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e101baf9/0xcc1762b626f8c805 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x75e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189307.551075:0:26173:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784189307.551078:0:26173:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000006c4aa/0xcc1762b626f8c80c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x75d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189307.551085:0:26173:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc07116e400 already unused, calling callback (ffffffffc0b2e230) 00010000:00010000:2.0:1784189307.551088:0:26173:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000006c4aa/0xcc1762b626f8c80c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x75d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189307.551116:0:26173:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000006c4aa/0xcc1762b626f8c80c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x75d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189307.551126:0:26173:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000006c4aa/0xcc1762b626f8c80c lrc: 1/0,0 mode: --/PW res: [0x280000401:0x75d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189307.551132:0:26173:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000006c4aa/0xcc1762b626f8c80c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x75d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189307.551145:0:26173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784189307.551147:0:26173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784189307.551149:0:26173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784189307.551876:0:26171:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007ca946a3/0xcc1762b626f8c813 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x75c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189307.551884:0:26171:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007ca946a3/0xcc1762b626f8c813 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x75c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189307.551904:0:26171:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1784189307.551988:0:26171:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x75b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784189307.551994:0:26171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d358cced/0xcc1762b626f8c81a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x75b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189307.552005:0:26171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x75b:0x0].0x0 since=3549s v=(0 0) 00010000:00010000:1.0:1784189307.552010:0:26171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x75b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784189307.552016:0:26171:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d358cced/0xcc1762b626f8c81a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x75b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189307.552027:0:26171:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d358cced/0xcc1762b626f8c81a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x75b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189307.552035:0:26171:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d358cced/0xcc1762b626f8c81a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x75b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189307.552042:0:26171:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d358cced/0xcc1762b626f8c81a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x75b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189307.552061:0:26171:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000001:00100000:3.0:1784189307.552193:0:9506:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:3.0:1784189307.552210:0:26173:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1784189307.552215:0:26173:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007ca946a3/0xcc1762b626f8c813 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x75c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189307.552222:0:26173:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc07116fa00 already unused, calling callback (ffffffffc0b2e230) 00010000:00010000:3.0:1784189307.552226:0:26173:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007ca946a3/0xcc1762b626f8c813 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x75c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189307.552233:0:26173:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007ca946a3/0xcc1762b626f8c813 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x75c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189307.552245:0:26173:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007ca946a3/0xcc1762b626f8c813 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x75c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189307.552252:0:26173:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007ca946a3/0xcc1762b626f8c813 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x75c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189307.552267:0:26173:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784189307.552270:0:26173:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d358cced/0xcc1762b626f8c81a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x75b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189307.552283:0:26173:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc07116e000 already unused, calling callback (ffffffffc0b2e230) 00010000:00010000:3.0:1784189307.552286:0:26173:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d358cced/0xcc1762b626f8c81a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x75b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189307.552294:0:26173:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d358cced/0xcc1762b626f8c81a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x75b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189307.552305:0:26173:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d358cced/0xcc1762b626f8c81a lrc: 1/0,0 mode: --/PW res: [0x280000401:0x75b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189307.552311:0:26173:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d358cced/0xcc1762b626f8c81a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x75b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189307.552346:0:26173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784189307.552348:0:26173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784189307.552350:0:26173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1784189307.552445:0:26171:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x75a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784189307.552451:0:26171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000022fa77b/0xcc1762b626f8c821 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x75a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189307.552460:0:26171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x75a:0x0].0x0 since=3549s v=(0 0) 00010000:00010000:1.0:1784189307.552463:0:26171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x75a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784189307.552468:0:26171:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000022fa77b/0xcc1762b626f8c821 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x75a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189307.552478:0:26171:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000022fa77b/0xcc1762b626f8c821 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x75a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189307.552486:0:26171:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000022fa77b/0xcc1762b626f8c821 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x75a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189307.552493:0:26171:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000022fa77b/0xcc1762b626f8c821 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x75a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189307.552513:0:26171:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1784189307.552555:0:26171:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x759:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784189307.552560:0:26171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006c76bcb1/0xcc1762b626f8c828 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x759:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189307.552567:0:26171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x759:0x0].0x0 since=3549s v=(0 0) 00010000:00010000:1.0:1784189307.552576:0:26171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x759:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784189307.552581:0:26171:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006c76bcb1/0xcc1762b626f8c828 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x759:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189307.552590:0:26171:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006c76bcb1/0xcc1762b626f8c828 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x759:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189307.552597:0:26171:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006c76bcb1/0xcc1762b626f8c828 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x759:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189307.552605:0:26171:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006c76bcb1/0xcc1762b626f8c828 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x759:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189307.552613:0:26171:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:1.0:1784189307.552655:0:26171:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x758:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784189307.552660:0:26171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d7af1b89/0xcc1762b626f8c82f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x758:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189307.552668:0:26171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x758:0x0].0x0 since=3549s v=(0 0) 00010000:00010000:1.0:1784189307.552671:0:26171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x758:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784189307.552676:0:26171:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d7af1b89/0xcc1762b626f8c82f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x758:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189307.552684:0:26171:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d7af1b89/0xcc1762b626f8c82f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x758:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189307.552692:0:26171:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d7af1b89/0xcc1762b626f8c82f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x758:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189307.552707:0:26171:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d7af1b89/0xcc1762b626f8c82f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x758:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189307.552715:0:26171:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:1.0:1784189307.552755:0:26171:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x757:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784189307.552760:0:26171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000004c81696/0xcc1762b626f8c836 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x757:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189307.552768:0:26171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x757:0x0].0x0 since=3549s v=(0 0) 00010000:00010000:1.0:1784189307.552771:0:26171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x757:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784189307.552775:0:26171:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000004c81696/0xcc1762b626f8c836 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x757:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189307.552784:0:26171:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000004c81696/0xcc1762b626f8c836 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x757:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189307.552793:0:26171:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000004c81696/0xcc1762b626f8c836 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x757:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189307.552800:0:26171:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000004c81696/0xcc1762b626f8c836 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x757:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189307.552809:0:26171:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00002000:00010000:1.0:1784189307.552842:0:26171:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x756:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784189307.552846:0:26171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d638fecc/0xcc1762b626f8c83d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x756:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189307.552860:0:26171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x756:0x0].0x0 since=3549s v=(0 0) 00010000:00010000:1.0:1784189307.552863:0:26171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x756:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784189307.552867:0:26171:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d638fecc/0xcc1762b626f8c83d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x756:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189307.552876:0:26171:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d638fecc/0xcc1762b626f8c83d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x756:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189307.552884:0:26171:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d638fecc/0xcc1762b626f8c83d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x756:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189307.552891:0:26171:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d638fecc/0xcc1762b626f8c83d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x756:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189307.552899:0:26171:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00002000:00010000:1.0:1784189307.552936:0:26171:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x755:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784189307.552940:0:26171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006a15f861/0xcc1762b626f8c844 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x755:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189307.552947:0:26171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x755:0x0].0x0 since=3549s v=(0 0) 00010000:00010000:1.0:1784189307.552950:0:26171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x755:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784189307.552953:0:26171:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006a15f861/0xcc1762b626f8c844 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x755:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189307.552962:0:26171:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006a15f861/0xcc1762b626f8c844 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x755:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189307.552982:0:26171:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006a15f861/0xcc1762b626f8c844 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x755:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189307.552988:0:26171:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006a15f861/0xcc1762b626f8c844 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x755:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189307.552996:0:26171:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to regular blp list, 6 blwis in pool 00002000:00010000:1.0:1784189307.553034:0:26171:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x754:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784189307.553038:0:26171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000005567574/0xcc1762b626f8c84b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x754:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189307.553046:0:26171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x754:0x0].0x0 since=3549s v=(0 0) 00010000:00010000:1.0:1784189307.553049:0:26171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x754:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784189307.553053:0:26171:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000005567574/0xcc1762b626f8c84b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x754:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189307.553061:0:26171:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000005567574/0xcc1762b626f8c84b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x754:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189307.553068:0:26171:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000005567574/0xcc1762b626f8c84b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x754:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189307.553074:0:26171:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000005567574/0xcc1762b626f8c84b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x754:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189307.553093:0:26171:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to regular blp list, 7 blwis in pool 00002000:00010000:1.0:1784189307.553138:0:26171:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x753:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784189307.553142:0:26171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000067956617/0xcc1762b626f8c852 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x753:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189307.553150:0:26171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x753:0x0].0x0 since=3549s v=(0 0) 00010000:00010000:1.0:1784189307.553153:0:26171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x753:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784189307.553156:0:26171:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000067956617/0xcc1762b626f8c852 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x753:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189307.553165:0:26171:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000067956617/0xcc1762b626f8c852 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x753:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189307.553172:0:26171:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000067956617/0xcc1762b626f8c852 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x753:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189307.553180:0:26171:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000067956617/0xcc1762b626f8c852 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x753:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189307.553267:0:26173:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:3.0:1784189307.553273:0:26173:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000022fa77b/0xcc1762b626f8c821 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x75a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189307.553280:0:26173:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc07116f000 already unused, calling callback (ffffffffc0b2e230) 00010000:00010000:3.0:1784189307.553284:0:26173:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000022fa77b/0xcc1762b626f8c821 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x75a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189307.553292:0:26173:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000022fa77b/0xcc1762b626f8c821 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x75a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189307.553311:0:26173:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000022fa77b/0xcc1762b626f8c821 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x75a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189307.553339:0:26173:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000022fa77b/0xcc1762b626f8c821 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x75a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189307.553357:0:26173:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:3.0:1784189307.553360:0:26173:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006c76bcb1/0xcc1762b626f8c828 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x759:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189307.553367:0:26173:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc07116fe00 already unused, calling callback (ffffffffc0b2e230) 00010000:00010000:3.0:1784189307.553370:0:26173:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006c76bcb1/0xcc1762b626f8c828 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x759:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189307.553377:0:26173:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006c76bcb1/0xcc1762b626f8c828 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x759:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189307.553387:0:26173:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006c76bcb1/0xcc1762b626f8c828 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x759:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189307.553394:0:26173:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006c76bcb1/0xcc1762b626f8c828 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x759:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189307.553406:0:26173:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:3.0:1784189307.553409:0:26173:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d7af1b89/0xcc1762b626f8c82f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x758:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189307.553424:0:26173:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc07116f800 already unused, calling callback (ffffffffc0b2e230) 00010000:00010000:3.0:1784189307.553427:0:26173:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d7af1b89/0xcc1762b626f8c82f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x758:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189307.553434:0:26173:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d7af1b89/0xcc1762b626f8c82f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x758:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189307.553444:0:26173:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d7af1b89/0xcc1762b626f8c82f lrc: 1/0,0 mode: --/PW res: [0x280000401:0x758:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189307.553451:0:26173:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d7af1b89/0xcc1762b626f8c82f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x758:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189307.553463:0:26173:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:3.0:1784189307.553467:0:26173:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000004c81696/0xcc1762b626f8c836 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x757:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189307.553473:0:26173:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc07116ea00 already unused, calling callback (ffffffffc0b2e230) 00010000:00010000:3.0:1784189307.553476:0:26173:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000004c81696/0xcc1762b626f8c836 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x757:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189307.553484:0:26173:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000004c81696/0xcc1762b626f8c836 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x757:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189307.553492:0:26173:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000004c81696/0xcc1762b626f8c836 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x757:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189307.553505:0:26173:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000004c81696/0xcc1762b626f8c836 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x757:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189307.553518:0:26173:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1784189307.553521:0:26173:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d638fecc/0xcc1762b626f8c83d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x756:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189307.553526:0:26173:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc07116f600 already unused, calling callback (ffffffffc0b2e230) 00010000:00010000:3.0:1784189307.553529:0:26173:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d638fecc/0xcc1762b626f8c83d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x756:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189307.553536:0:26173:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d638fecc/0xcc1762b626f8c83d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x756:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189307.553546:0:26173:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d638fecc/0xcc1762b626f8c83d lrc: 1/0,0 mode: --/PW res: [0x280000401:0x756:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189307.553554:0:26173:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d638fecc/0xcc1762b626f8c83d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x756:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189307.553565:0:26173:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1784189307.553568:0:26173:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006a15f861/0xcc1762b626f8c844 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x755:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189307.553574:0:26173:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc07116f400 already unused, calling callback (ffffffffc0b2e230) 00010000:00010000:3.0:1784189307.553582:0:26173:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006a15f861/0xcc1762b626f8c844 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x755:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189307.553589:0:26173:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006a15f861/0xcc1762b626f8c844 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x755:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189307.553599:0:26173:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006a15f861/0xcc1762b626f8c844 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x755:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189307.553606:0:26173:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006a15f861/0xcc1762b626f8c844 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x755:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189307.553617:0:26173:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784189307.553620:0:26173:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000005567574/0xcc1762b626f8c84b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x754:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189307.553626:0:26173:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc07116ee00 already unused, calling callback (ffffffffc0b2e230) 00010000:00010000:3.0:1784189307.553628:0:26173:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000005567574/0xcc1762b626f8c84b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x754:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189307.553636:0:26173:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000005567574/0xcc1762b626f8c84b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x754:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189307.553645:0:26173:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000005567574/0xcc1762b626f8c84b lrc: 1/0,0 mode: --/PW res: [0x280000401:0x754:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189307.553651:0:26173:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000005567574/0xcc1762b626f8c84b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x754:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189307.553671:0:26173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784189307.553673:0:26173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784189307.553675:0:26173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784189307.553769:0:26171:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1784189307.553812:0:26171:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x752:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784189307.553817:0:26171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000091d4841/0xcc1762b626f8c859 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x752:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189307.553826:0:26171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x752:0x0].0x0 since=3549s v=(0 0) 00010000:00010000:1.0:1784189307.553834:0:26171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x752:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784189307.553839:0:26171:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000091d4841/0xcc1762b626f8c859 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x752:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189307.553848:0:26171:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000091d4841/0xcc1762b626f8c859 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x752:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189307.553856:0:26171:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000091d4841/0xcc1762b626f8c859 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x752:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189307.553863:0:26171:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000091d4841/0xcc1762b626f8c859 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x752:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1784189307.554052:0:8427:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x75a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784189307.554059:0:8427:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000061338346/0xcc1762b626f8c860 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x75a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189307.554067:0:8427:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x75a:0x0].0x0 since=3549s v=(0 0) 00010000:00010000:0.0:1784189307.554070:0:8427:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x75a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784189307.554074:0:8427:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000061338346/0xcc1762b626f8c860 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x75a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189307.554084:0:8427:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000061338346/0xcc1762b626f8c860 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x75a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189307.554092:0:8427:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000061338346/0xcc1762b626f8c860 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x75a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189307.554108:0:8427:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000061338346/0xcc1762b626f8c860 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x75a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189307.554198:0:26173:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1784189307.554204:0:26173:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000067956617/0xcc1762b626f8c852 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x753:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189307.554210:0:26173:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc07116e800 already unused, calling callback (ffffffffc0b2e230) 00010000:00010000:3.0:1784189307.554213:0:26173:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000067956617/0xcc1762b626f8c852 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x753:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189307.554220:0:26173:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000067956617/0xcc1762b626f8c852 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x753:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189307.554231:0:26173:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000067956617/0xcc1762b626f8c852 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x753:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189307.554238:0:26173:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000067956617/0xcc1762b626f8c852 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x753:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189307.554251:0:26173:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1784189307.554254:0:26173:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000091d4841/0xcc1762b626f8c859 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x752:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189307.554259:0:26173:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc07116f200 already unused, calling callback (ffffffffc0b2e230) 00010000:00010000:3.0:1784189307.554268:0:26173:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000091d4841/0xcc1762b626f8c859 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x752:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189307.554275:0:26173:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000091d4841/0xcc1762b626f8c859 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x752:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189307.554286:0:26173:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000091d4841/0xcc1762b626f8c859 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x752:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189307.554294:0:26173:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784189307.554297:0:26173:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000061338346/0xcc1762b626f8c860 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x75a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189307.554303:0:26173:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc05ec0fe00 already unused, calling callback (ffffffffc0b2e230) 00010000:00010000:3.0:1784189307.554306:0:26173:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000061338346/0xcc1762b626f8c860 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x75a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189307.554313:0:26173:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000061338346/0xcc1762b626f8c860 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x75a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189307.554347:0:26173:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000061338346/0xcc1762b626f8c860 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x75a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189307.554355:0:26173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784189307.554356:0:26173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784189307.554358:0:26173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784189307.554577:0:26171:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1784189307.554583:0:26171:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000091d4841/0xcc1762b626f8c859 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x752:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1784189307.554643:0:26171:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x751:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784189307.554648:0:26171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a47d5412/0xcc1762b626f8c867 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x751:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189307.554656:0:26171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x751:0x0].0x0 since=3549s v=(0 0) 00010000:00010000:1.0:1784189307.554659:0:26171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x751:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784189307.554664:0:26171:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a47d5412/0xcc1762b626f8c867 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x751:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189307.554672:0:26171:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a47d5412/0xcc1762b626f8c867 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x751:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189307.554687:0:26171:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a47d5412/0xcc1762b626f8c867 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x751:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189307.554694:0:26171:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a47d5412/0xcc1762b626f8c867 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x751:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189307.554702:0:26171:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1784189307.554740:0:26171:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x750:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784189307.554745:0:26171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005a83b75c/0xcc1762b626f8c86e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x750:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189307.554753:0:26171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x750:0x0].0x0 since=3549s v=(0 0) 00010000:00010000:1.0:1784189307.554756:0:26171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x750:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784189307.554760:0:26171:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005a83b75c/0xcc1762b626f8c86e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x750:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189307.554769:0:26171:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005a83b75c/0xcc1762b626f8c86e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x750:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189307.554777:0:26171:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005a83b75c/0xcc1762b626f8c86e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x750:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189307.554784:0:26171:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005a83b75c/0xcc1762b626f8c86e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x750:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189307.554807:0:26171:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:1.0:1784189307.554845:0:26171:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x74f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784189307.554850:0:26171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000cc621f7/0xcc1762b626f8c875 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x74f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189307.554857:0:26171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x74f:0x0].0x0 since=3549s v=(0 0) 00010000:00010000:1.0:1784189307.554860:0:26171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x74f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784189307.554864:0:26171:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000cc621f7/0xcc1762b626f8c875 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x74f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189307.554873:0:26171:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000cc621f7/0xcc1762b626f8c875 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x74f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189307.554880:0:26171:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000cc621f7/0xcc1762b626f8c875 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x74f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189307.554886:0:26171:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000cc621f7/0xcc1762b626f8c875 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x74f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189307.554894:0:26171:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:1.0:1784189307.554927:0:26171:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x74e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784189307.554932:0:26171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c9d589c0/0xcc1762b626f8c87c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x74e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189307.554939:0:26171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x74e:0x0].0x0 since=3549s v=(0 0) 00010000:00010000:1.0:1784189307.554948:0:26171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x74e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784189307.554952:0:26171:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c9d589c0/0xcc1762b626f8c87c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x74e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189307.554961:0:26171:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c9d589c0/0xcc1762b626f8c87c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x74e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189307.554969:0:26171:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c9d589c0/0xcc1762b626f8c87c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x74e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189307.554976:0:26171:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c9d589c0/0xcc1762b626f8c87c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x74e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189307.554984:0:26171:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00002000:00010000:1.0:1784189307.555021:0:26171:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x74d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784189307.555026:0:26171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000b6eacba/0xcc1762b626f8c883 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x74d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189307.555033:0:26171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x74d:0x0].0x0 since=3549s v=(0 0) 00010000:00010000:1.0:1784189307.555036:0:26171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x74d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784189307.555040:0:26171:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000b6eacba/0xcc1762b626f8c883 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x74d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189307.555048:0:26171:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000b6eacba/0xcc1762b626f8c883 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x74d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189307.555055:0:26171:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000b6eacba/0xcc1762b626f8c883 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x74d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189307.555068:0:26171:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000b6eacba/0xcc1762b626f8c883 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x74d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189307.555077:0:26171:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00002000:00010000:1.0:1784189307.555126:0:26171:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x74c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784189307.555131:0:26171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000067521a5b/0xcc1762b626f8c88a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x74c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189307.555139:0:26171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x74c:0x0].0x0 since=3549s v=(0 0) 00010000:00010000:1.0:1784189307.555142:0:26171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x74c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784189307.555146:0:26171:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000067521a5b/0xcc1762b626f8c88a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x74c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189307.555154:0:26171:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000067521a5b/0xcc1762b626f8c88a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x74c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189307.555162:0:26171:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000067521a5b/0xcc1762b626f8c88a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x74c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189307.555169:0:26171:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000067521a5b/0xcc1762b626f8c88a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x74c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189307.555177:0:26171:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to regular blp list, 6 blwis in pool 00010000:00010000:3.0:1784189307.555275:0:26173:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:3.0:1784189307.555284:0:26173:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a47d5412/0xcc1762b626f8c867 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x751:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189307.555292:0:26173:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc07116ec00 already unused, calling callback (ffffffffc0b2e230) 00010000:00010000:3.0:1784189307.555295:0:26173:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a47d5412/0xcc1762b626f8c867 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x751:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189307.555302:0:26173:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a47d5412/0xcc1762b626f8c867 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x751:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189307.555314:0:26173:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a47d5412/0xcc1762b626f8c867 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x751:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189307.555397:0:26173:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a47d5412/0xcc1762b626f8c867 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x751:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189307.555412:0:26173:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:3.0:1784189307.555415:0:26173:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005a83b75c/0xcc1762b626f8c86e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x750:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189307.555422:0:26173:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc0755a5200 already unused, calling callback (ffffffffc0b2e230) 00010000:00010000:3.0:1784189307.555425:0:26173:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005a83b75c/0xcc1762b626f8c86e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x750:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189307.555431:0:26173:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005a83b75c/0xcc1762b626f8c86e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x750:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189307.555451:0:26173:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005a83b75c/0xcc1762b626f8c86e lrc: 1/0,0 mode: --/PW res: [0x280000401:0x750:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189307.555457:0:26173:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005a83b75c/0xcc1762b626f8c86e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x750:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189307.555466:0:26173:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:3.0:1784189307.555469:0:26173:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000cc621f7/0xcc1762b626f8c875 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x74f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189307.555475:0:26173:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc0755a4a00 already unused, calling callback (ffffffffc0b2e230) 00010000:00010000:3.0:1784189307.555477:0:26173:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000cc621f7/0xcc1762b626f8c875 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x74f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189307.555483:0:26173:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000cc621f7/0xcc1762b626f8c875 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x74f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189307.555490:0:26173:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000cc621f7/0xcc1762b626f8c875 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x74f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189307.555496:0:26173:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000cc621f7/0xcc1762b626f8c875 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x74f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189307.555506:0:26173:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1784189307.555509:0:26173:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c9d589c0/0xcc1762b626f8c87c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x74e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189307.555522:0:26173:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc0755a4c00 already unused, calling callback (ffffffffc0b2e230) 00010000:00010000:3.0:1784189307.555525:0:26173:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c9d589c0/0xcc1762b626f8c87c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x74e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189307.555532:0:26173:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c9d589c0/0xcc1762b626f8c87c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x74e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189307.555540:0:26173:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c9d589c0/0xcc1762b626f8c87c lrc: 1/0,0 mode: --/PW res: [0x280000401:0x74e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189307.555547:0:26173:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c9d589c0/0xcc1762b626f8c87c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x74e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189307.555557:0:26173:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1784189307.555560:0:26173:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000b6eacba/0xcc1762b626f8c883 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x74d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189307.555565:0:26173:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc0755a4e00 already unused, calling callback (ffffffffc0b2e230) 00010000:00010000:3.0:1784189307.555568:0:26173:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000b6eacba/0xcc1762b626f8c883 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x74d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189307.555574:0:26173:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000b6eacba/0xcc1762b626f8c883 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x74d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189307.555581:0:26173:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000b6eacba/0xcc1762b626f8c883 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x74d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189307.555591:0:26173:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000b6eacba/0xcc1762b626f8c883 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x74d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189307.555601:0:26173:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784189307.555603:0:26173:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000067521a5b/0xcc1762b626f8c88a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x74c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189307.555608:0:26173:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc0755a5a00 already unused, calling callback (ffffffffc0b2e230) 00010000:00010000:3.0:1784189307.555611:0:26173:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000067521a5b/0xcc1762b626f8c88a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x74c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189307.555619:0:26173:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000067521a5b/0xcc1762b626f8c88a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x74c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189307.555627:0:26173:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000067521a5b/0xcc1762b626f8c88a lrc: 1/0,0 mode: --/PW res: [0x280000401:0x74c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189307.555633:0:26173:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000067521a5b/0xcc1762b626f8c88a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x74c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189307.555642:0:26173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784189307.555644:0:26173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784189307.555646:0:26173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1784189307.555711:0:26171:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x74b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784189307.555716:0:26171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004e27f8fd/0xcc1762b626f8c891 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x74b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189307.555728:0:26171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x74b:0x0].0x0 since=3549s v=(0 0) 00010000:00010000:1.0:1784189307.555731:0:26171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x74b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784189307.555735:0:26171:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004e27f8fd/0xcc1762b626f8c891 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x74b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189307.555743:0:26171:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004e27f8fd/0xcc1762b626f8c891 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x74b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189307.555750:0:26171:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004e27f8fd/0xcc1762b626f8c891 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x74b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189307.555757:0:26171:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004e27f8fd/0xcc1762b626f8c891 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x74b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189307.555774:0:26171:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1784189307.555809:0:26171:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x74a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784189307.555813:0:26171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000283735d0/0xcc1762b626f8c898 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x74a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189307.555820:0:26171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x74a:0x0].0x0 since=3549s v=(0 0) 00010000:00010000:1.0:1784189307.555823:0:26171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x74a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784189307.555827:0:26171:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000283735d0/0xcc1762b626f8c898 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x74a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189307.555834:0:26171:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000283735d0/0xcc1762b626f8c898 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x74a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189307.555851:0:26171:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000283735d0/0xcc1762b626f8c898 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x74a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189307.555857:0:26171:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000283735d0/0xcc1762b626f8c898 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x74a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189307.555864:0:26171:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:1.0:1784189307.555895:0:26171:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x749:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784189307.555899:0:26171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007391f9a3/0xcc1762b626f8c89f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x749:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189307.555906:0:26171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x749:0x0].0x0 since=3549s v=(0 0) 00010000:00010000:1.0:1784189307.555908:0:26171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x749:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784189307.555912:0:26171:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007391f9a3/0xcc1762b626f8c89f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x749:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189307.555920:0:26171:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007391f9a3/0xcc1762b626f8c89f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x749:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189307.555927:0:26171:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007391f9a3/0xcc1762b626f8c89f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x749:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189307.555933:0:26171:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007391f9a3/0xcc1762b626f8c89f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x749:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189307.555949:0:26171:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:1.0:1784189307.555985:0:26171:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x748:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784189307.555989:0:26171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000090923e4f/0xcc1762b626f8c8a6 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x748:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189307.555997:0:26171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x748:0x0].0x0 since=3549s v=(0 0) 00010000:00010000:1.0:1784189307.556000:0:26171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x748:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784189307.556004:0:26171:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000090923e4f/0xcc1762b626f8c8a6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x748:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189307.556012:0:26171:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000090923e4f/0xcc1762b626f8c8a6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x748:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189307.556018:0:26171:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000090923e4f/0xcc1762b626f8c8a6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x748:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189307.556024:0:26171:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000090923e4f/0xcc1762b626f8c8a6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x748:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189307.556031:0:26171:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00002000:00010000:1.0:1784189307.556064:0:26171:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x747:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784189307.556069:0:26171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b12f7059/0xcc1762b626f8c8ad lrc: 3/0,1 mode: --/PW res: [0x280000401:0x747:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189307.556076:0:26171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x747:0x0].0x0 since=3549s v=(0 0) 00010000:00010000:1.0:1784189307.556084:0:26171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x747:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784189307.556089:0:26171:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b12f7059/0xcc1762b626f8c8ad lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x747:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189307.556107:0:26171:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b12f7059/0xcc1762b626f8c8ad lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x747:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189307.556116:0:26171:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b12f7059/0xcc1762b626f8c8ad lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x747:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189307.556122:0:26171:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b12f7059/0xcc1762b626f8c8ad lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x747:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189307.556131:0:26171:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00002000:00010000:1.0:1784189307.556168:0:26171:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x746:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784189307.556173:0:26171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000062d13dad/0xcc1762b626f8c8b4 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x746:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189307.556180:0:26171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x746:0x0].0x0 since=3549s v=(0 0) 00010000:00010000:1.0:1784189307.556183:0:26171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x746:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784189307.556267:0:26173:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:3.0:1784189307.556272:0:26173:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004e27f8fd/0xcc1762b626f8c891 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x74b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189307.556285:0:26173:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc0755a5e00 already unused, calling callback (ffffffffc0b2e230) 00010000:00010000:3.0:1784189307.556288:0:26173:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004e27f8fd/0xcc1762b626f8c891 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x74b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189307.556295:0:26173:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004e27f8fd/0xcc1762b626f8c891 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x74b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189307.556307:0:26173:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004e27f8fd/0xcc1762b626f8c891 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x74b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189307.556313:0:26173:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004e27f8fd/0xcc1762b626f8c891 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x74b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189307.556395:0:26173:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:3.0:1784189307.556399:0:26173:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000283735d0/0xcc1762b626f8c898 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x74a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189307.556405:0:26173:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc0755a4200 already unused, calling callback (ffffffffc0b2e230) 00010000:00010000:3.0:1784189307.556408:0:26173:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000283735d0/0xcc1762b626f8c898 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x74a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189307.556415:0:26173:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000283735d0/0xcc1762b626f8c898 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x74a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189307.556425:0:26173:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000283735d0/0xcc1762b626f8c898 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x74a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189307.556437:0:26173:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000283735d0/0xcc1762b626f8c898 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x74a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189307.556450:0:26173:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1784189307.556453:0:26173:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007391f9a3/0xcc1762b626f8c89f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x749:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189307.556459:0:26173:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc0755a4800 already unused, calling callback (ffffffffc0b2e230) 00010000:00010000:3.0:1784189307.556462:0:26173:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007391f9a3/0xcc1762b626f8c89f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x749:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189307.556469:0:26173:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007391f9a3/0xcc1762b626f8c89f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x749:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189307.556479:0:26173:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007391f9a3/0xcc1762b626f8c89f lrc: 1/0,0 mode: --/PW res: [0x280000401:0x749:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189307.556486:0:26173:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007391f9a3/0xcc1762b626f8c89f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x749:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189307.556497:0:26173:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1784189307.556500:0:26173:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000090923e4f/0xcc1762b626f8c8a6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x748:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189307.556507:0:26173:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc0755a5c00 already unused, calling callback (ffffffffc0b2e230) 00010000:00010000:3.0:1784189307.556516:0:26173:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000090923e4f/0xcc1762b626f8c8a6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x748:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189307.556524:0:26173:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000090923e4f/0xcc1762b626f8c8a6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x748:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189307.556534:0:26173:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000090923e4f/0xcc1762b626f8c8a6 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x748:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189307.556542:0:26173:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000090923e4f/0xcc1762b626f8c8a6 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x748:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189307.556555:0:26173:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784189307.556558:0:26173:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b12f7059/0xcc1762b626f8c8ad lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x747:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189307.556565:0:26173:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc0755a4600 already unused, calling callback (ffffffffc0b2e230) 00010000:00010000:3.0:1784189307.556568:0:26173:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b12f7059/0xcc1762b626f8c8ad lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x747:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189307.556575:0:26173:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b12f7059/0xcc1762b626f8c8ad lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x747:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189307.556583:0:26173:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b12f7059/0xcc1762b626f8c8ad lrc: 1/0,0 mode: --/PW res: [0x280000401:0x747:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189307.556590:0:26173:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b12f7059/0xcc1762b626f8c8ad lrc: 0/0,0 mode: --/PW res: [0x280000401:0x747:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189307.556607:0:26173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784189307.556609:0:26173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784189307.556611:0:26173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784189307.556665:0:8427:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1784189307.556672:0:8427:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000061338346/0xcc1762b626f8c860 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x75a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1784189307.556745:0:8427:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x759:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784189307.556750:0:8427:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000091ba7b99/0xcc1762b626f8c8bb lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x759:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189307.556767:0:8427:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x759:0x0].0x0 since=3549s v=(0 0) 00010000:00010000:0.0:1784189307.556770:0:8427:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x759:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784189307.556774:0:8427:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000091ba7b99/0xcc1762b626f8c8bb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x759:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189307.556783:0:8427:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000091ba7b99/0xcc1762b626f8c8bb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x759:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189307.556790:0:8427:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000091ba7b99/0xcc1762b626f8c8bb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x759:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189307.556796:0:8427:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000091ba7b99/0xcc1762b626f8c8bb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x759:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189307.556803:0:8427:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1784189307.556837:0:8427:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x758:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784189307.556842:0:8427:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ba1d3010/0xcc1762b626f8c8c2 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x758:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189307.556848:0:8427:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x758:0x0].0x0 since=3549s v=(0 0) 00010000:00010000:0.0:1784189307.556850:0:8427:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x758:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784189307.556854:0:8427:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ba1d3010/0xcc1762b626f8c8c2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x758:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189307.556861:0:8427:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ba1d3010/0xcc1762b626f8c8c2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x758:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189307.556878:0:8427:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ba1d3010/0xcc1762b626f8c8c2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x758:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189307.556884:0:8427:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ba1d3010/0xcc1762b626f8c8c2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x758:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189307.556891:0:8427:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:0.0:1784189307.556928:0:8427:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x757:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784189307.556933:0:8427:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c441b122/0xcc1762b626f8c8c9 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x757:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189307.556940:0:8427:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x757:0x0].0x0 since=3549s v=(0 0) 00010000:00010000:0.0:1784189307.556943:0:8427:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x757:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784189307.556947:0:8427:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c441b122/0xcc1762b626f8c8c9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x757:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189307.556955:0:8427:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c441b122/0xcc1762b626f8c8c9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x757:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189307.556963:0:8427:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c441b122/0xcc1762b626f8c8c9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x757:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189307.556970:0:8427:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c441b122/0xcc1762b626f8c8c9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x757:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189307.556988:0:8427:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:0.0:1784189307.557026:0:8427:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x756:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784189307.557031:0:8427:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007dc48d1b/0xcc1762b626f8c8d0 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x756:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189307.557039:0:8427:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x756:0x0].0x0 since=3549s v=(0 0) 00010000:00010000:0.0:1784189307.557041:0:8427:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x756:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784189307.557044:0:8427:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007dc48d1b/0xcc1762b626f8c8d0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x756:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189307.557053:0:8427:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007dc48d1b/0xcc1762b626f8c8d0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x756:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189307.557060:0:8427:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007dc48d1b/0xcc1762b626f8c8d0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x756:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189307.557067:0:8427:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007dc48d1b/0xcc1762b626f8c8d0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x756:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189307.557074:0:8427:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00002000:00010000:0.0:1784189307.557118:0:8427:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x755:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784189307.557123:0:8427:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002a22be6d/0xcc1762b626f8c8d7 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x755:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189307.557131:0:8427:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x755:0x0].0x0 since=3549s v=(0 0) 00010000:00010000:0.0:1784189307.557139:0:8427:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x755:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784189307.557143:0:8427:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002a22be6d/0xcc1762b626f8c8d7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x755:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189307.557151:0:8427:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002a22be6d/0xcc1762b626f8c8d7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x755:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189307.557159:0:8427:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002a22be6d/0xcc1762b626f8c8d7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x755:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189307.557165:0:8427:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002a22be6d/0xcc1762b626f8c8d7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x755:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189307.557174:0:8427:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00010000:00010000:3.0:1784189307.557269:0:26173:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:3.0:1784189307.557273:0:26173:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000091ba7b99/0xcc1762b626f8c8bb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x759:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189307.557280:0:26173:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc04152c600 already unused, calling callback (ffffffffc0b2e230) 00010000:00010000:3.0:1784189307.557284:0:26173:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000091ba7b99/0xcc1762b626f8c8bb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x759:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189307.557292:0:26173:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000091ba7b99/0xcc1762b626f8c8bb lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x759:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189307.557304:0:26173:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000091ba7b99/0xcc1762b626f8c8bb lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x759:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189307.557310:0:26173:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000091ba7b99/0xcc1762b626f8c8bb lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x759:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189307.557394:0:26171:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000062d13dad/0xcc1762b626f8c8b4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x746:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189307.557408:0:26171:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000062d13dad/0xcc1762b626f8c8b4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x746:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189307.557416:0:26171:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000062d13dad/0xcc1762b626f8c8b4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x746:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189307.557432:0:26171:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000062d13dad/0xcc1762b626f8c8b4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x746:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189307.557440:0:26171:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00002000:00010000:1.0:1784189307.557488:0:26171:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x745:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784189307.557493:0:26171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e88c95bf/0xcc1762b626f8c8de lrc: 3/0,1 mode: --/PW res: [0x280000401:0x745:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189307.557500:0:26171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x745:0x0].0x0 since=3549s v=(0 0) 00010000:00010000:1.0:1784189307.557503:0:26171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x745:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784189307.557507:0:26171:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e88c95bf/0xcc1762b626f8c8de lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x745:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189307.557516:0:26171:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e88c95bf/0xcc1762b626f8c8de lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x745:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189307.557524:0:26171:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e88c95bf/0xcc1762b626f8c8de lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x745:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189307.557531:0:26171:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e88c95bf/0xcc1762b626f8c8de lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x745:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189307.557539:0:26171:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to regular blp list, 6 blwis in pool 00002000:00010000:1.0:1784189307.557571:0:26171:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x744:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784189307.557576:0:26171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004cf1f60e/0xcc1762b626f8c8e5 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x744:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189307.557588:0:26171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x744:0x0].0x0 since=3549s v=(0 0) 00010000:00010000:1.0:1784189307.557591:0:26171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x744:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784189307.557595:0:26171:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004cf1f60e/0xcc1762b626f8c8e5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x744:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189307.557604:0:26171:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004cf1f60e/0xcc1762b626f8c8e5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x744:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189307.557611:0:26171:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004cf1f60e/0xcc1762b626f8c8e5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x744:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189307.557618:0:26171:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004cf1f60e/0xcc1762b626f8c8e5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x744:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189307.557627:0:26171:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to regular blp list, 7 blwis in pool 00002000:00010000:1.0:1784189307.557661:0:26171:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x743:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784189307.557666:0:26171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000090219bd6/0xcc1762b626f8c8ec lrc: 3/0,1 mode: --/PW res: [0x280000401:0x743:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189307.557673:0:26171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x743:0x0].0x0 since=3549s v=(0 0) 00010000:00010000:1.0:1784189307.557676:0:26171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x743:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784189307.557679:0:26171:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000090219bd6/0xcc1762b626f8c8ec lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x743:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189307.557688:0:26171:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000090219bd6/0xcc1762b626f8c8ec lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x743:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189307.557707:0:26171:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000090219bd6/0xcc1762b626f8c8ec lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x743:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189307.557715:0:26171:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000090219bd6/0xcc1762b626f8c8ec lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x743:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189307.557724:0:26171:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/8 locks to regular blp list, 8 blwis in pool 00002000:00010000:1.0:1784189307.557763:0:26171:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x742:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784189307.557767:0:26171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000043a4eaa4/0xcc1762b626f8c8f3 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x742:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189307.557775:0:26171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x742:0x0].0x0 since=3549s v=(0 0) 00010000:00010000:1.0:1784189307.557778:0:26171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x742:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784189307.557781:0:26171:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000043a4eaa4/0xcc1762b626f8c8f3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x742:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189307.557790:0:26171:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000043a4eaa4/0xcc1762b626f8c8f3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x742:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189307.557797:0:26171:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000043a4eaa4/0xcc1762b626f8c8f3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x742:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189307.557803:0:26171:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000043a4eaa4/0xcc1762b626f8c8f3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x742:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189307.557821:0:26171:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/9 locks to regular blp list, 9 blwis in pool 00010000:00010000:3.0:1784189307.558302:0:26173:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 8 total in blp. (8 blwis in pool) 00010000:00010000:3.0:1784189307.558307:0:26173:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ba1d3010/0xcc1762b626f8c8c2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x758:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189307.558315:0:26173:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc04152da00 already unused, calling callback (ffffffffc0b2e230) 00010000:00010000:3.0:1784189307.558419:0:26173:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ba1d3010/0xcc1762b626f8c8c2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x758:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189307.558427:0:26173:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ba1d3010/0xcc1762b626f8c8c2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x758:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189307.558440:0:26173:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ba1d3010/0xcc1762b626f8c8c2 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x758:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189307.558446:0:26173:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ba1d3010/0xcc1762b626f8c8c2 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x758:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189307.558460:0:26173:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 7 total in blp. (7 blwis in pool) 00010000:00010000:3.0:1784189307.558463:0:26173:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c441b122/0xcc1762b626f8c8c9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x757:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189307.558468:0:26173:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc04152ca00 already unused, calling callback (ffffffffc0b2e230) 00010000:00010000:3.0:1784189307.558471:0:26173:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c441b122/0xcc1762b626f8c8c9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x757:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189307.558477:0:26173:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c441b122/0xcc1762b626f8c8c9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x757:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189307.558484:0:26173:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c441b122/0xcc1762b626f8c8c9 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x757:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189307.558489:0:26173:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c441b122/0xcc1762b626f8c8c9 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x757:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189307.558507:0:26173:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:3.0:1784189307.558511:0:26173:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007dc48d1b/0xcc1762b626f8c8d0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x756:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189307.558517:0:26173:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc04152d000 already unused, calling callback (ffffffffc0b2e230) 00010000:00010000:3.0:1784189307.558520:0:26173:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007dc48d1b/0xcc1762b626f8c8d0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x756:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189307.558527:0:26173:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007dc48d1b/0xcc1762b626f8c8d0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x756:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189307.558535:0:26173:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007dc48d1b/0xcc1762b626f8c8d0 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x756:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189307.558542:0:26173:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007dc48d1b/0xcc1762b626f8c8d0 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x756:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189307.558553:0:26173:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:3.0:1784189307.558555:0:26173:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002a22be6d/0xcc1762b626f8c8d7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x755:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189307.558560:0:26173:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc04152d600 already unused, calling callback (ffffffffc0b2e230) 00010000:00010000:3.0:1784189307.558562:0:26173:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002a22be6d/0xcc1762b626f8c8d7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x755:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189307.558578:0:26173:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002a22be6d/0xcc1762b626f8c8d7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x755:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189307.558587:0:26173:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002a22be6d/0xcc1762b626f8c8d7 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x755:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189307.558593:0:26173:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002a22be6d/0xcc1762b626f8c8d7 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x755:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189307.558606:0:26173:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:3.0:1784189307.558609:0:26173:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000062d13dad/0xcc1762b626f8c8b4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x746:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189307.558613:0:26173:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc0755a5000 already unused, calling callback (ffffffffc0b2e230) 00010000:00010000:3.0:1784189307.558616:0:26173:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000062d13dad/0xcc1762b626f8c8b4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x746:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189307.558622:0:26173:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000062d13dad/0xcc1762b626f8c8b4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x746:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189307.558629:0:26173:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000062d13dad/0xcc1762b626f8c8b4 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x746:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189307.558635:0:26173:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000062d13dad/0xcc1762b626f8c8b4 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x746:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189307.558658:0:26173:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:3.0:1784189307.558662:0:26173:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e88c95bf/0xcc1762b626f8c8de lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x745:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189307.558668:0:26173:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc0755a5600 already unused, calling callback (ffffffffc0b2e230) 00010000:00010000:3.0:1784189307.558670:0:26173:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e88c95bf/0xcc1762b626f8c8de lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x745:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189307.558677:0:26173:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e88c95bf/0xcc1762b626f8c8de lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x745:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189307.558685:0:26173:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e88c95bf/0xcc1762b626f8c8de lrc: 1/0,0 mode: --/PW res: [0x280000401:0x745:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189307.558692:0:26173:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e88c95bf/0xcc1762b626f8c8de lrc: 0/0,0 mode: --/PW res: [0x280000401:0x745:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189307.558701:0:26173:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1784189307.558703:0:26173:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004cf1f60e/0xcc1762b626f8c8e5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x744:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189307.558709:0:26173:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc0755a4400 already unused, calling callback (ffffffffc0b2e230) 00010000:00010000:3.0:1784189307.558712:0:26173:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004cf1f60e/0xcc1762b626f8c8e5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x744:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189307.558729:0:26173:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004cf1f60e/0xcc1762b626f8c8e5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x744:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189307.558739:0:26173:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004cf1f60e/0xcc1762b626f8c8e5 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x744:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189307.558746:0:26173:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004cf1f60e/0xcc1762b626f8c8e5 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x744:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189307.558760:0:26173:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1784189307.558763:0:26173:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000090219bd6/0xcc1762b626f8c8ec lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x743:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189307.558769:0:26173:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc0755a5800 already unused, calling callback (ffffffffc0b2e230) 00010000:00010000:3.0:1784189307.558772:0:26173:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000090219bd6/0xcc1762b626f8c8ec lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x743:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189307.558778:0:26173:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000090219bd6/0xcc1762b626f8c8ec lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x743:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189307.558788:0:26173:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000090219bd6/0xcc1762b626f8c8ec lrc: 1/0,0 mode: --/PW res: [0x280000401:0x743:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189307.558795:0:26173:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000090219bd6/0xcc1762b626f8c8ec lrc: 0/0,0 mode: --/PW res: [0x280000401:0x743:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189307.558820:0:26173:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784189307.558824:0:26173:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000043a4eaa4/0xcc1762b626f8c8f3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x742:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189307.558830:0:26173:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc0755a4000 already unused, calling callback (ffffffffc0b2e230) 00010000:00010000:3.0:1784189307.558833:0:26173:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000043a4eaa4/0xcc1762b626f8c8f3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x742:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189307.558841:0:26173:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000043a4eaa4/0xcc1762b626f8c8f3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x742:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189307.558851:0:26173:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000043a4eaa4/0xcc1762b626f8c8f3 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x742:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189307.558857:0:26173:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000043a4eaa4/0xcc1762b626f8c8f3 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x742:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189307.558868:0:26173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784189307.558870:0:26173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784189307.558872:0:26173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1784189307.558978:0:8427:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x754:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784189307.558985:0:8427:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009985685d/0xcc1762b626f8c8fa lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x754:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189307.558996:0:8427:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x754:0x0].0x0 since=3549s v=(0 0) 00010000:00010000:0.0:1784189307.559000:0:8427:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x754:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784189307.559005:0:8427:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009985685d/0xcc1762b626f8c8fa lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x754:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189307.559015:0:8427:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009985685d/0xcc1762b626f8c8fa lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x754:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189307.559023:0:8427:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009985685d/0xcc1762b626f8c8fa lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x754:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189307.559038:0:8427:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009985685d/0xcc1762b626f8c8fa lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x754:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189307.559059:0:8427:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1784189307.559113:0:8427:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x753:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784189307.559118:0:8427:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b87c84b6/0xcc1762b626f8c901 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x753:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189307.559126:0:8427:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x753:0x0].0x0 since=3549s v=(0 0) 00010000:00010000:0.0:1784189307.559129:0:8427:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x753:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784189307.559133:0:8427:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b87c84b6/0xcc1762b626f8c901 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x753:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189307.559142:0:8427:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b87c84b6/0xcc1762b626f8c901 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x753:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189307.559149:0:8427:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b87c84b6/0xcc1762b626f8c901 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x753:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189307.559155:0:8427:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b87c84b6/0xcc1762b626f8c901 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x753:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189307.559163:0:8427:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1784189307.559272:0:26173:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1784189307.559276:0:26173:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009985685d/0xcc1762b626f8c8fa lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x754:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189307.559283:0:26173:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc04152d200 already unused, calling callback (ffffffffc0b2e230) 00010000:00010000:3.0:1784189307.559292:0:26173:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009985685d/0xcc1762b626f8c8fa lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x754:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189307.559299:0:26173:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009985685d/0xcc1762b626f8c8fa lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x754:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189307.559310:0:26173:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009985685d/0xcc1762b626f8c8fa lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x754:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1784189307.559396:0:8427:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x752:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784189307.559403:0:8427:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002a207b70/0xcc1762b626f8c908 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x752:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189307.559418:0:8427:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x752:0x0].0x0 since=3549s v=(0 0) 00010000:00010000:0.0:1784189307.559420:0:8427:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x752:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784189307.559424:0:8427:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002a207b70/0xcc1762b626f8c908 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x752:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189307.559433:0:8427:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002a207b70/0xcc1762b626f8c908 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x752:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189307.559440:0:8427:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002a207b70/0xcc1762b626f8c908 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x752:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189307.559447:0:8427:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002a207b70/0xcc1762b626f8c908 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x752:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189307.559456:0:8427:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:0.0:1784189307.559500:0:8427:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x751:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784189307.559505:0:8427:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000490fcfab/0xcc1762b626f8c90f lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x751:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189307.559512:0:8427:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x751:0x0].0x0 since=3549s v=(0 0) 00010000:00010000:0.0:1784189307.559515:0:8427:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x751:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784189307.559519:0:8427:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000490fcfab/0xcc1762b626f8c90f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x751:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189307.559527:0:8427:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000490fcfab/0xcc1762b626f8c90f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x751:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189307.559545:0:8427:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000490fcfab/0xcc1762b626f8c90f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x751:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189307.559553:0:8427:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000490fcfab/0xcc1762b626f8c90f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x751:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189307.559561:0:8427:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:0.0:1784189307.559596:0:8427:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x750:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784189307.559601:0:8427:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008d9a0db1/0xcc1762b626f8c916 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x750:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189307.559609:0:8427:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x750:0x0].0x0 since=3549s v=(0 0) 00010000:00010000:0.0:1784189307.559612:0:8427:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x750:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784189307.559616:0:8427:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008d9a0db1/0xcc1762b626f8c916 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x750:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189307.559625:0:8427:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008d9a0db1/0xcc1762b626f8c916 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x750:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189307.559634:0:8427:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008d9a0db1/0xcc1762b626f8c916 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x750:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189307.559641:0:8427:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008d9a0db1/0xcc1762b626f8c916 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x750:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00080000:1.0:1784189307.559647:0:26171:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x280000401:1794 00010000:00010000:0.0:1784189307.559658:0:8427:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00002000:00010000:0.0:1784189307.559697:0:8427:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x74f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784189307.559702:0:8427:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d288a1db/0xcc1762b626f8c91d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x74f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189307.559709:0:8427:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x74f:0x0].0x0 since=3549s v=(0 0) 00010000:00010000:0.0:1784189307.559712:0:8427:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x74f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784189307.559715:0:8427:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d288a1db/0xcc1762b626f8c91d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x74f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189307.559724:0:8427:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d288a1db/0xcc1762b626f8c91d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x74f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189307.559731:0:8427:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d288a1db/0xcc1762b626f8c91d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x74f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189307.559737:0:8427:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d288a1db/0xcc1762b626f8c91d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x74f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784189307.559743:0:26171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc056eafb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+6:94322:x1870854458230400:12345-0@lo:5:osp-pre-0-0.0 Request processed in 19870us (27482us total) trans 0 rc 0/0 00010000:00010000:0.0:1784189307.559745:0:8427:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00000100:00100000:1.0:1784189307.559753:0:26171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4993 00002000:00010000:0.0:1784189307.559775:0:8427:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x74e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784189307.559780:0:8427:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000068daad26/0xcc1762b626f8c924 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x74e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189307.559787:0:8427:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x74e:0x0].0x0 since=3549s v=(0 0) 00010000:00010000:0.0:1784189307.559798:0:8427:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x74e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784189307.559803:0:8427:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000068daad26/0xcc1762b626f8c924 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x74e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189307.559811:0:8427:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000068daad26/0xcc1762b626f8c924 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x74e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189307.559819:0:8427:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000068daad26/0xcc1762b626f8c924 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x74e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189307.559825:0:8427:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000068daad26/0xcc1762b626f8c924 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x74e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189307.559832:0:8427:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to regular blp list, 6 blwis in pool 00002000:00010000:0.0:1784189307.559866:0:8427:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x74d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784189307.559870:0:8427:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e61abee3/0xcc1762b626f8c92b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x74d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189307.559871:0:6501:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:1.0:1784189307.559876:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b87c84b6/0xcc1762b626f8c901 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x753:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189307.559878:0:8427:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x74d:0x0].0x0 since=3549s v=(0 0) 00010000:00010000:0.0:1784189307.559881:0:8427:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x74d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784189307.559883:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc04152d800 already unused, calling callback (ffffffffc0b2e230) 00010000:00010000:0.0:1784189307.559885:0:8427:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e61abee3/0xcc1762b626f8c92b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x74d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189307.559887:0:6501:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b87c84b6/0xcc1762b626f8c901 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x753:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189307.559894:0:8427:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e61abee3/0xcc1762b626f8c92b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x74d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189307.559895:0:6501:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b87c84b6/0xcc1762b626f8c901 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x753:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189307.559903:0:8427:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e61abee3/0xcc1762b626f8c92b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x74d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189307.559907:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b87c84b6/0xcc1762b626f8c901 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x753:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189307.559915:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b87c84b6/0xcc1762b626f8c901 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x753:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189307.559916:0:8427:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e61abee3/0xcc1762b626f8c92b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x74d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189307.559925:0:8427:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to regular blp list, 6 blwis in pool 00010000:00010000:1.0:1784189307.559932:0:6501:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:1.0:1784189307.559935:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002a207b70/0xcc1762b626f8c908 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x752:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189307.559951:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc04152ce00 already unused, calling callback (ffffffffc0b2e230) 00002000:00010000:0.0:1784189307.559958:0:8427:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x74c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784189307.559964:0:8427:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a898aafb/0xcc1762b626f8c932 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x74c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189307.559971:0:8427:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x74c:0x0].0x0 since=3549s v=(0 0) 00010000:00010000:0.0:1784189307.559974:0:8427:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x74c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784189307.559978:0:8427:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a898aafb/0xcc1762b626f8c932 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x74c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189307.559986:0:8427:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a898aafb/0xcc1762b626f8c932 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x74c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189307.559994:0:8427:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a898aafb/0xcc1762b626f8c932 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x74c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189307.560000:0:8427:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a898aafb/0xcc1762b626f8c932 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x74c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189307.560009:0:8427:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to regular blp list, 6 blwis in pool 00002000:00010000:0.0:1784189307.560043:0:8427:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x74b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784189307.560047:0:8427:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000eb2a31c/0xcc1762b626f8c939 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x74b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189307.560061:0:8427:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x74b:0x0].0x0 since=3549s v=(0 0) 00010000:00010000:0.0:1784189307.560064:0:8427:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x74b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784189307.560068:0:8427:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000eb2a31c/0xcc1762b626f8c939 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x74b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189307.560077:0:8427:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000eb2a31c/0xcc1762b626f8c939 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x74b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189307.560084:0:8427:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000eb2a31c/0xcc1762b626f8c939 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x74b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189307.560091:0:8427:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000eb2a31c/0xcc1762b626f8c939 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x74b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784189307.560237:0:94322:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc056ead500 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:94322:1870854458230400:0@lo:5:osp-pre-0-0.0 00000004:00080000:2.0:1784189307.560252:0:94322:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x280000401:0x761:0x0] from OST, last_created [0x280000401:0x761:0x0]last_used is [0x280000401:0x702:0x0] 00000100:00100000:2.0:1784189307.560344:0:94322:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc056ead180 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:94322:1870854458230656:0@lo:5:osp-pre-0-0.0 00000100:00100000:2.0:1784189307.560382:0:94322:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784189307.560406:0:94322:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dc050825e40 going to sleep for 11 seconds 00010000:00010000:3.0:1784189307.560614:0:26173:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009985685d/0xcc1762b626f8c8fa lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x754:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784189307.560646:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc056ead500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1870854458230528:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1784189307.560684:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784189307.560729:0:26167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458230656 00000100:00100000:3.0:1784189307.560735:0:26167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458230656 00000100:00100000:2.0:1784189307.560824:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458230528 00000100:00100000:2.0:1784189307.560827:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458230528 00000100:00100000:2.0:1784189307.560860:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2048 00000100:00100000:2.0:1784189307.560868:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf469b4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3641:x1870854458230528:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1784189307.560893:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 210112 pending 0 free 3922481152 avail 3690958848 00000100:00100000:2.0:1784189307.560931:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf469b4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3641:x1870854458230528:12345-0@lo:13:osp-pre-0-0.0 Request processed in 64us (246us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189307.560948:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2048 00000100:00100000:2.0:1784189307.560986:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc056ead500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1870854458230528:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1784189307.561027:0:26167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4994 00000100:00100000:3.0:1784189307.561035:0:26167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc056eadc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+6:94322:x1870854458230656:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:3.0:1784189307.561060:0:26167:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000401 at 1890 00010000:00010000:2.0:1784189307.561382:0:26173:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:2.0:1784189307.561387:0:26173:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000490fcfab/0xcc1762b626f8c90f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x751:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189307.561396:0:26173:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc04152d400 already unused, calling callback (ffffffffc0b2e230) 00010000:00010000:2.0:1784189307.561399:0:26173:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000490fcfab/0xcc1762b626f8c90f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x751:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189307.561408:0:26173:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000490fcfab/0xcc1762b626f8c90f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x751:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189307.561422:0:26173:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000490fcfab/0xcc1762b626f8c90f lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x751:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189307.561429:0:26173:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000490fcfab/0xcc1762b626f8c90f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x751:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189307.561444:0:26173:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:2.0:1784189307.561448:0:26173:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008d9a0db1/0xcc1762b626f8c916 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x750:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189307.561455:0:26173:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc04152c200 already unused, calling callback (ffffffffc0b2e230) 00010000:00010000:2.0:1784189307.561458:0:26173:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008d9a0db1/0xcc1762b626f8c916 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x750:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189307.561472:0:26173:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008d9a0db1/0xcc1762b626f8c916 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x750:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189307.561482:0:26173:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008d9a0db1/0xcc1762b626f8c916 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x750:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189307.561488:0:26173:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008d9a0db1/0xcc1762b626f8c916 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x750:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189307.561503:0:26173:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1784189307.561506:0:26173:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d288a1db/0xcc1762b626f8c91d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x74f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189307.561513:0:26173:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc081b17a00 already unused, calling callback (ffffffffc0b2e230) 00010000:00010000:2.0:1784189307.561515:0:26173:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d288a1db/0xcc1762b626f8c91d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x74f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189307.561522:0:26173:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d288a1db/0xcc1762b626f8c91d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x74f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189307.561531:0:26173:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d288a1db/0xcc1762b626f8c91d lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x74f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189307.561537:0:26173:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d288a1db/0xcc1762b626f8c91d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x74f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189307.561559:0:26173:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1784189307.561563:0:26173:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000068daad26/0xcc1762b626f8c924 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x74e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189307.561568:0:26173:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc081b16200 already unused, calling callback (ffffffffc0b2e230) 00010000:00010000:2.0:1784189307.561571:0:26173:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000068daad26/0xcc1762b626f8c924 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x74e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189307.561578:0:26173:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000068daad26/0xcc1762b626f8c924 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x74e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189307.561588:0:26173:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000068daad26/0xcc1762b626f8c924 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x74e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189307.561594:0:26173:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000068daad26/0xcc1762b626f8c924 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x74e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189307.561603:0:26173:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1784189307.561606:0:26173:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e61abee3/0xcc1762b626f8c92b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x74d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189307.561613:0:26173:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc081b16600 already unused, calling callback (ffffffffc0b2e230) 00010000:00010000:2.0:1784189307.561616:0:26173:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e61abee3/0xcc1762b626f8c92b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x74d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189307.561633:0:26173:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e61abee3/0xcc1762b626f8c92b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x74d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189307.561642:0:26173:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e61abee3/0xcc1762b626f8c92b lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x74d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189307.561648:0:26173:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e61abee3/0xcc1762b626f8c92b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x74d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189307.561659:0:26173:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784189307.561662:0:26173:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a898aafb/0xcc1762b626f8c932 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x74c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189307.561668:0:26173:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc081b16000 already unused, calling callback (ffffffffc0b2e230) 00010000:00010000:2.0:1784189307.561671:0:26173:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a898aafb/0xcc1762b626f8c932 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x74c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189307.561678:0:26173:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a898aafb/0xcc1762b626f8c932 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x74c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189307.561686:0:26173:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a898aafb/0xcc1762b626f8c932 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x74c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189307.561693:0:26173:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a898aafb/0xcc1762b626f8c932 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x74c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189307.561713:0:26173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784189307.561715:0:26173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784189307.561717:0:26173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784189307.562181:0:8427:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1784189307.562675:0:6501:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002a207b70/0xcc1762b626f8c908 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x752:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189307.562687:0:6501:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002a207b70/0xcc1762b626f8c908 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x752:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189307.562702:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002a207b70/0xcc1762b626f8c908 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x752:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189307.562709:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002a207b70/0xcc1762b626f8c908 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x752:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189307.562729:0:6501:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784189307.562734:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000eb2a31c/0xcc1762b626f8c939 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x74b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189307.562741:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc081b16a00 already unused, calling callback (ffffffffc0b2e230) 00010000:00010000:1.0:1784189307.562744:0:6501:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000eb2a31c/0xcc1762b626f8c939 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x74b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189307.562749:0:6501:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000eb2a31c/0xcc1762b626f8c939 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x74b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189307.562755:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000eb2a31c/0xcc1762b626f8c939 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x74b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189307.562766:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000eb2a31c/0xcc1762b626f8c939 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x74b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189307.562775:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784189307.562777:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784189307.562778:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784189307.562786:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784189307.562819:0:7454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1784189307.563566:0:8427:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x74a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784189307.563574:0:8427:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000097385c8a/0xcc1762b626f8c940 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x74a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189307.563587:0:8427:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x74a:0x0].0x0 since=3549s v=(0 0) 00010000:00010000:1.0:1784189307.563591:0:8427:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x74a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784189307.563599:0:8427:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000097385c8a/0xcc1762b626f8c940 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x74a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189307.563616:0:8427:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000097385c8a/0xcc1762b626f8c940 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x74a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189307.563625:0:8427:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000097385c8a/0xcc1762b626f8c940 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x74a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189307.563635:0:8427:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000097385c8a/0xcc1762b626f8c940 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x74a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189307.563666:0:8427:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1784189307.563675:0:6501:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784189307.563680:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000097385c8a/0xcc1762b626f8c940 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x74a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189307.563687:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc0755a5400 already unused, calling callback (ffffffffc0b2e230) 00010000:00010000:1.0:1784189307.563691:0:6501:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000097385c8a/0xcc1762b626f8c940 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x74a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189307.563700:0:6501:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000097385c8a/0xcc1762b626f8c940 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x74a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189307.563714:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000097385c8a/0xcc1762b626f8c940 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x74a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189307.563722:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000097385c8a/0xcc1762b626f8c940 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x74a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189307.563742:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784189307.563745:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784189307.563749:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1784189307.563804:0:8427:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x749:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784189307.563810:0:8427:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c6d40e55/0xcc1762b626f8c947 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x749:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189307.563818:0:8427:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x749:0x0].0x0 since=3549s v=(0 0) 00010000:00010000:1.0:1784189307.563828:0:8427:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x749:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784189307.563834:0:8427:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c6d40e55/0xcc1762b626f8c947 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x749:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189307.563843:0:8427:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c6d40e55/0xcc1762b626f8c947 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x749:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189307.563852:0:8427:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c6d40e55/0xcc1762b626f8c947 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x749:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189307.563859:0:8427:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c6d40e55/0xcc1762b626f8c947 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x749:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189307.563881:0:8427:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1784189307.563890:0:6502:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784189307.563894:0:6502:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c6d40e55/0xcc1762b626f8c947 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x749:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189307.563903:0:6502:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc042d67400 already unused, calling callback (ffffffffc0b2e230) 00010000:00010000:1.0:1784189307.563906:0:6502:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c6d40e55/0xcc1762b626f8c947 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x749:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189307.563914:0:6502:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c6d40e55/0xcc1762b626f8c947 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x749:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189307.563926:0:6502:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c6d40e55/0xcc1762b626f8c947 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x749:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189307.563950:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c6d40e55/0xcc1762b626f8c947 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x749:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189307.563967:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784189307.563970:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784189307.563973:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1784189307.564042:0:8427:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x748:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784189307.564048:0:8427:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000778f0c98/0xcc1762b626f8c94e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x748:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189307.564056:0:8427:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x748:0x0].0x0 since=3549s v=(0 0) 00010000:00010000:1.0:1784189307.564060:0:8427:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x748:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784189307.564065:0:8427:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000778f0c98/0xcc1762b626f8c94e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x748:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189307.564076:0:8427:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000778f0c98/0xcc1762b626f8c94e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x748:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189307.564085:0:8427:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000778f0c98/0xcc1762b626f8c94e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x748:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189307.564092:0:8427:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000778f0c98/0xcc1762b626f8c94e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x748:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189307.564114:0:8427:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1784189307.564122:0:7454:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784189307.564131:0:7454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000778f0c98/0xcc1762b626f8c94e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x748:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189307.564138:0:7454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc042d66e00 already unused, calling callback (ffffffffc0b2e230) 00010000:00010000:1.0:1784189307.564141:0:7454:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000778f0c98/0xcc1762b626f8c94e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x748:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189307.564149:0:7454:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000778f0c98/0xcc1762b626f8c94e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x748:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189307.564161:0:7454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000778f0c98/0xcc1762b626f8c94e lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x748:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189307.564169:0:7454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000778f0c98/0xcc1762b626f8c94e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x748:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189307.564183:0:26173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784189307.564185:0:7454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784189307.564189:0:7454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784189307.564190:0:7454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1784189307.564238:0:8427:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x747:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784189307.564243:0:8427:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004bf593ac/0xcc1762b626f8c955 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x747:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189307.564251:0:8427:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x747:0x0].0x0 since=3549s v=(0 0) 00010000:00010000:1.0:1784189307.564254:0:8427:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x747:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784189307.564257:0:8427:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004bf593ac/0xcc1762b626f8c955 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x747:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189307.564279:0:8427:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004bf593ac/0xcc1762b626f8c955 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x747:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189307.564288:0:8427:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004bf593ac/0xcc1762b626f8c955 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x747:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189307.564295:0:8427:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004bf593ac/0xcc1762b626f8c955 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x747:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189307.564690:0:8427:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1784189307.564745:0:8427:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x746:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784189307.564750:0:8427:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000092974359/0xcc1762b626f8c95c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x746:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189307.564760:0:8427:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x746:0x0].0x0 since=3549s v=(0 0) 00010000:00010000:1.0:1784189307.564763:0:8427:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x746:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784189307.564767:0:8427:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000092974359/0xcc1762b626f8c95c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x746:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189307.564777:0:8427:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000092974359/0xcc1762b626f8c95c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x746:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189307.564786:0:8427:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000092974359/0xcc1762b626f8c95c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x746:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189307.564803:0:8427:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000092974359/0xcc1762b626f8c95c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x746:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189307.564817:0:8427:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1784189307.564825:0:6502:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1784189307.564829:0:6502:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004bf593ac/0xcc1762b626f8c955 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x747:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189307.564835:0:6502:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc042d67600 already unused, calling callback (ffffffffc0b2e230) 00010000:00010000:1.0:1784189307.564839:0:6502:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004bf593ac/0xcc1762b626f8c955 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x747:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189307.564847:0:6502:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004bf593ac/0xcc1762b626f8c955 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x747:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189307.564859:0:6502:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004bf593ac/0xcc1762b626f8c955 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x747:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189307.564942:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004bf593ac/0xcc1762b626f8c955 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x747:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189307.564967:0:6502:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784189307.564970:0:6502:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000092974359/0xcc1762b626f8c95c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x746:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189307.564988:0:6502:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc042d67a00 already unused, calling callback (ffffffffc0b2e230) 00010000:00010000:1.0:1784189307.564991:0:6502:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000092974359/0xcc1762b626f8c95c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x746:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189307.565107:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784189307.565206:0:6502:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000092974359/0xcc1762b626f8c95c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x746:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189307.565217:0:6502:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000092974359/0xcc1762b626f8c95c lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x746:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189307.565223:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000092974359/0xcc1762b626f8c95c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x746:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189307.565237:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784189307.565239:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784189307.565241:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1784189307.565295:0:8427:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x745:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784189307.565301:0:8427:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d9badbf5/0xcc1762b626f8c963 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x745:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189307.565423:0:8427:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x745:0x0].0x0 since=3549s v=(0 0) 00010000:00010000:1.0:1784189307.565427:0:8427:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x745:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784189307.565432:0:8427:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d9badbf5/0xcc1762b626f8c963 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x745:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189307.565442:0:8427:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d9badbf5/0xcc1762b626f8c963 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x745:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189307.565457:0:8427:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d9badbf5/0xcc1762b626f8c963 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x745:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189307.565465:0:8427:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d9badbf5/0xcc1762b626f8c963 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x745:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189307.565477:0:8427:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1784189307.565650:0:8427:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x744:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784189307.565657:0:8427:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000041bf25cb/0xcc1762b626f8c96a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x744:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189307.565665:0:8427:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x744:0x0].0x0 since=3549s v=(0 0) 00010000:00010000:1.0:1784189307.565668:0:8427:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x744:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784189307.565672:0:8427:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000041bf25cb/0xcc1762b626f8c96a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x744:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189307.565681:0:8427:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000041bf25cb/0xcc1762b626f8c96a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x744:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189307.565688:0:8427:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000041bf25cb/0xcc1762b626f8c96a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x744:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189307.565694:0:8427:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000041bf25cb/0xcc1762b626f8c96a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x744:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189307.565732:0:26173:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784189307.565739:0:26173:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d9badbf5/0xcc1762b626f8c963 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x745:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189307.565748:0:26173:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc042d66200 already unused, calling callback (ffffffffc0b2e230) 00010000:00010000:2.0:1784189307.565752:0:26173:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d9badbf5/0xcc1762b626f8c963 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x745:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189307.565761:0:26173:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d9badbf5/0xcc1762b626f8c963 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x745:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189307.565774:0:26173:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d9badbf5/0xcc1762b626f8c963 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x745:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189307.565781:0:26173:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d9badbf5/0xcc1762b626f8c963 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x745:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189307.565800:0:26173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784189307.565802:0:26173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784189307.565805:0:26173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784189307.566474:0:8427:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1784189307.566660:0:8427:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x743:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784189307.566667:0:8427:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009e262e78/0xcc1762b626f8c971 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x743:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189307.566678:0:8427:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x743:0x0].0x0 since=3549s v=(0 0) 00010000:00010000:1.0:1784189307.566682:0:8427:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x743:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784189307.566688:0:8427:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009e262e78/0xcc1762b626f8c971 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x743:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189307.566698:0:8427:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009e262e78/0xcc1762b626f8c971 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x743:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189307.566705:0:8427:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009e262e78/0xcc1762b626f8c971 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x743:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189307.566712:0:8427:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009e262e78/0xcc1762b626f8c971 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x743:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189307.566726:0:8427:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:1.0:1784189307.566761:0:8427:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x742:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784189307.566765:0:8427:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008f2946f7/0xcc1762b626f8c978 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x742:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189307.566773:0:8427:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x742:0x0].0x0 since=3549s v=(0 0) 00010000:00010000:1.0:1784189307.566781:0:8427:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x742:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784189307.566786:0:8427:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008f2946f7/0xcc1762b626f8c978 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x742:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189307.566795:0:8427:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008f2946f7/0xcc1762b626f8c978 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x742:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189307.566803:0:8427:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008f2946f7/0xcc1762b626f8c978 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x742:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189307.566810:0:8427:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008f2946f7/0xcc1762b626f8c978 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x742:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189307.566823:0:8427:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:1.0:1784189307.566832:0:6502:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1784189307.566836:0:6502:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000041bf25cb/0xcc1762b626f8c96a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x744:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189307.566844:0:6502:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc042d67200 already unused, calling callback (ffffffffc0b2e230) 00010000:00010000:1.0:1784189307.566847:0:6502:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000041bf25cb/0xcc1762b626f8c96a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x744:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189307.566855:0:6502:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000041bf25cb/0xcc1762b626f8c96a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x744:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189307.566867:0:6502:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000041bf25cb/0xcc1762b626f8c96a lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x744:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189307.566885:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000041bf25cb/0xcc1762b626f8c96a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x744:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189307.566903:0:6502:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1784189307.566906:0:6502:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009e262e78/0xcc1762b626f8c971 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x743:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189307.566913:0:6502:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc042d66600 already unused, calling callback (ffffffffc0b2e230) 00010000:00010000:1.0:1784189307.566916:0:6502:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009e262e78/0xcc1762b626f8c971 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x743:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189307.566923:0:6502:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009e262e78/0xcc1762b626f8c971 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x743:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189307.566935:0:6502:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009e262e78/0xcc1762b626f8c971 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x743:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189307.566942:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009e262e78/0xcc1762b626f8c971 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x743:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189307.566954:0:6502:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784189307.566957:0:6502:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008f2946f7/0xcc1762b626f8c978 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x742:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189307.566964:0:6502:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc042d66400 already unused, calling callback (ffffffffc0b2e230) 00010000:00010000:1.0:1784189307.566972:0:6502:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008f2946f7/0xcc1762b626f8c978 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x742:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189307.566980:0:6502:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008f2946f7/0xcc1762b626f8c978 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x742:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189307.566991:0:6502:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008f2946f7/0xcc1762b626f8c978 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x742:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189307.567592:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008f2946f7/0xcc1762b626f8c978 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x742:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189307.567611:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784189307.567615:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784189307.567617:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784189307.569221:0:7454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784189307.569295:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1784189307.570627:0:8423:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294968956 is committed 00000001:00100000:3.0:1784189307.570665:0:8423:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00002000:00080000:0.0:1784189307.570967:0:8427:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x2c0000401:1795 00000100:00100000:0.0:1784189307.571056:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf43e10a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:94324:x1870854458230272:12345-0@lo:5:osp-pre-1-0.0 Request processed in 43286us (43408us total) trans 0 rc 0/0 00000100:00100000:0.0:1784189307.571067:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4992 00000100:00100000:0.0:1784189307.571139:0:94324:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf43e10700 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:94324:1870854458230272:0@lo:5:osp-pre-1-0.0 00000004:00080000:0.0:1784189307.571155:0:94324:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x2c0000401:0x761:0x0] from OST, last_created [0x2c0000401:0x761:0x0]last_used is [0x2c0000401:0x703:0x0] 00000100:00100000:0.0:1784189307.571232:0:94324:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf43e13100 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:94324:1870854458230912:0@lo:5:osp-pre-1-0.0 00000100:00100000:0.0:1784189307.571264:0:94324:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784189307.571283:0:94324:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dbf422f4a80 going to sleep for 11 seconds 00000100:00100000:0.0:1784189307.571304:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1784189307.571315:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf43e10700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1870854458230784:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1784189307.571366:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784189307.571395:0:26223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458230912 00000100:00100000:0.0:1784189307.571401:0:26223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458230912 00000100:00100000:0.0:1784189307.571435:0:26223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4995 00000100:00100000:0.0:1784189307.571444:0:26223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf43e13800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0000-mdtlov_UUID+5:94324:x1870854458230912:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:0.0:1784189307.571477:0:26223:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000401 at 1890 00000100:00100000:1.0:1784189307.572425:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458230784 00000100:00100000:1.0:1784189307.572432:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458230784 00000100:00100000:1.0:1784189307.572471:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2049 00000100:00100000:1.0:1784189307.572490:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf43e13480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3643:x1870854458230784:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1784189307.572513:0:8432:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 210112 pending 896 free 3923529728 avail 3692007424 00000100:00100000:1.0:1784189307.572568:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf43e13480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3643:x1870854458230784:12345-0@lo:13:osp-pre-1-0.0 Request processed in 90us (1201us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189307.572576:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2049 00000100:00100000:0.0:1784189307.572918:0:26223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf43e13800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0000-mdtlov_UUID+6:94324:x1870854458230912:12345-0@lo:5:osp-pre-1-0.0 Request processed in 1475us (1653us total) trans 4294968960 rc 0/0 00000100:00100000:0.0:1784189307.572926:0:26223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4995 00000100:00100000:0.0:1784189307.572971:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf43e10700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1870854458230784:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1784189307.573078:0:94324:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf43e13100 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:94324:1870854458230912:0@lo:5:osp-pre-1-0.0 00000004:00080000:1.0:1784189307.573089:0:94324:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x2c0000401:0x761:0x0]-[0x2c0000401:0x781:0x0] 00000100:00100000:3.0:1784189307.577636:0:26167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc056eadc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+5:94322:x1870854458230656:12345-0@lo:5:osp-pre-0-0.0 Request processed in 16593us (17245us total) trans 4294968956 rc 0/0 00000100:00100000:3.0:1784189307.577648:0:26167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4994 00000100:00100000:2.0:1784189307.579309:0:94322:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294968956 gen 2 00000100:00100000:2.0:1784189307.579407:0:94322:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc056ead180 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:94322:1870854458230656:0@lo:5:osp-pre-0-0.0 00000004:00080000:2.0:1784189307.579424:0:94322:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x280000401:0x761:0x0]-[0x280000401:0x781:0x0] 00010000:00010000:2.0:1784189307.631730:0:26173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1784189307.767009:0:94693:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1784189307.767519:0:94693:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:1.0:1784189308.202046:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1784189308.202293:0:94308:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436324864 00000100:00100000:2.0:1784189308.202304:0:94308:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436324864 00000100:00100000:2.0:1784189308.202390:0:94308:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 73 00000100:00100000:2.0:1784189308.202402:0:94308:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc044985850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:60f345e3-c70e-4f53-b5e7-c9671463c9a5+10:2397:x1870854436324864:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:2.0:1784189308.202480:0:94308:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc044985850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:60f345e3-c70e-4f53-b5e7-c9671463c9a5+10:2397:x1870854436324864:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 80us (443us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189308.202488:0:94308:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 73 00000100:00100000:1.0:1784189308.203620:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1784189308.203684:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1784189308.204813:0:66170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436325120 00000100:00100000:3.0:1784189308.204823:0:66170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436325120 00000100:00100000:3.0:1784189308.205466:0:66170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1305 00000100:00100000:3.0:1784189308.205478:0:66170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf46434000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:debedd94-805c-42a0-a5e5-41758b2012e9+9:2397:x1870854436325120:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:3.0:1784189308.205551:0:66170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf46434000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:debedd94-805c-42a0-a5e5-41758b2012e9+9:2397:x1870854436325120:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 76us (1934us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189308.205559:0:66170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1305 00000100:00100000:3.0:1784189308.205575:0:66170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436324992 00000100:00100000:3.0:1784189308.205579:0:66170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436324992 00000100:00100000:3.0:1784189308.205602:0:66170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1306 00000100:00100000:3.0:1784189308.205609:0:66170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc05ed3a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:debedd94-805c-42a0-a5e5-41758b2012e9+6:2397:x1870854436324992:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:3.0:1784189308.205635:0:66170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc05ed3a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:debedd94-805c-42a0-a5e5-41758b2012e9+6:2397:x1870854436324992:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 27us (1951us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189308.205642:0:66170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1306 00000100:00080000:0.0:1784189308.206206:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:1.0:1784189308.657698:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784189309.651302:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1784189309.651568:0:66171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436325248 00000100:00100000:2.0:1784189309.651577:0:66171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436325248 00000100:00100000:2.0:1784189309.651656:0:66171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1429 00000100:00100000:2.0:1784189309.651666:0:66171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf469b7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:debedd94-805c-42a0-a5e5-41758b2012e9+6:72366:x1870854436325248:12345-192.168.203.12@tcp:101:lfs.0 00010000:00010000:2.0:1784189309.651684:0:66171:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784189309.651704:0:66171:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04a20a200/0xcc1762b626f8c97f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbfc5de7fe6c40b7 expref: -99 pid: 66171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189309.651770:0:66171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04a20bc00/0xcc1762b626f8c986 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189309.651785:0:66171:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04a20bc00/0xcc1762b626f8c986 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189309.651798:0:66171:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04a20bc00/0xcc1762b626f8c986 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784189309.651863:0:66171:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1784189309.651868:0:66171:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1784189309.651901:0:66171:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04a20bc00/0xcc1762b626f8c986 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189309.651927:0:66171:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04a20a200/0xcc1762b626f8c97f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c40b7 expref: 8 pid: 66171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189309.651945:0:66171:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04a20bc00/0xcc1762b626f8c986 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c40b7 expref: 7 pid: 66171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189309.651955:0:66171:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9dbf47406300) 00010000:00010000:2.0:1784189309.651958:0:66171:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1784189309.651961:0:66171:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc04a20bc00, rc 0) 00000100:00100000:2.0:1784189309.652022:0:66171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf469b7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:debedd94-805c-42a0-a5e5-41758b2012e9+7:72366:x1870854436325248:12345-192.168.203.12@tcp:101:lfs.0 Request processed in 357us (727us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189309.652029:0:66171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1429 00000100:00080000:0.0:1784189309.652122:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1784189309.656692:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1784189309.656839:0:66945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436325376 00000100:00100000:1.0:1784189309.656849:0:66945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436325376 00000100:00100000:1.0:1784189309.656908:0:66945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1430 00000100:00100000:1.0:1784189309.656917:0:66945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf469b4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:debedd94-805c-42a0-a5e5-41758b2012e9+7:72366:x1870854436325376:12345-192.168.203.12@tcp:41:lfs.0 00000004:00000024:1.0:1784189309.657017:0:66945:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445228544 avail 1298989056 00000100:00100000:1.0:1784189309.657150:0:66945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf469b4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:debedd94-805c-42a0-a5e5-41758b2012e9+7:72366:x1870854436325376:12345-192.168.203.12@tcp:41:lfs.0 Request processed in 234us (465us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189309.657158:0:66945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1430 00000100:00100000:1.0:1784189309.659415:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1784189309.659737:0:66169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436325504 00000100:00100000:2.0:1784189309.659746:0:66169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436325504 00000100:00100000:2.0:1784189309.659844:0:66169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1431 00000100:00100000:2.0:1784189309.659854:0:66169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc05ed38700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:debedd94-805c-42a0-a5e5-41758b2012e9+9:72366:x1870854436325504:12345-192.168.203.12@tcp:41:lfs.0 00000004:00000024:2.0:1784189309.659888:0:66169:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445568512 avail 1299329024 00000100:00100000:2.0:1784189309.659966:0:66169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc05ed38700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:debedd94-805c-42a0-a5e5-41758b2012e9+9:72366:x1870854436325504:12345-192.168.203.12@tcp:41:lfs.0 Request processed in 113us (557us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189309.659973:0:66169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1431 00000100:00100000:3.0:1784189309.666777:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1784189309.666901:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436325632 00000100:00100000:1.0:1784189309.666911:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436325632 00000100:00100000:1.0:1784189309.666974:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 4996 00000100:00100000:1.0:1784189309.666983:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf469b5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2395:x1870854436325632:12345-192.168.203.12@tcp:8:lfs.0 00010000:00080000:1.0:1784189309.667021:0:8428:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0000: connection from debedd94-805c-42a0-a5e5-41758b2012e9@192.168.203.12@tcp t0 exp 0000000000000000 cur 3551 last 0 00000020:00000080:1.0:1784189309.667063:0:8428:0:(genops.c:1406:class_connect()) connect: client debedd94-805c-42a0-a5e5-41758b2012e9, cookie 0xcc1762b626f8c98d 00002000:00100000:1.0:1784189309.667075:0:8428:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli debedd94-805c-42a0-a5e5-41758b2012e9/ffff9dc07110f800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 21136a2 ocd_grant: 8409088 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1784189309.667099:0:8428:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:1.0:1784189309.667193:0:8428:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1784189309.667229:0:8428:0:(import.c:65:import_set_state_nolock()) ffff9dc06b8e0000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1784189309.667311:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf469b5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:debedd94-805c-42a0-a5e5-41758b2012e9+6:2395:x1870854436325632:12345-192.168.203.12@tcp:8:lfs.0 Request processed in 326us (541us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189309.667352:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 4996 00000100:00100000:0.0:1784189309.677186:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1784189309.677350:0:9466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436325760 00000100:00100000:2.0:1784189309.677372:0:9466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436325760 00000100:00100000:2.0:1784189309.677447:0:9466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 2050 00000100:00100000:2.0:1784189309.677458:0:9466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf43e10700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:debedd94-805c-42a0-a5e5-41758b2012e9+6:72366:x1870854436325760:12345-192.168.203.12@tcp:13:lfs.0 00002000:00000024:2.0:1784189309.677481:0:9466:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8618304 pending 0 free 3922481152 avail 3690958848 00000100:00100000:2.0:1784189309.677545:0:9466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf43e10700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:debedd94-805c-42a0-a5e5-41758b2012e9+6:72366:x1870854436325760:12345-192.168.203.12@tcp:13:lfs.0 Request processed in 88us (366us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189309.677552:0:9466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 2050 00000100:00080000:0.0:1784189309.677616:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1784189309.679845:0:7454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784189309.679948:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1784189309.680015:0:26159:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436325888 00000100:00100000:0.0:1784189309.680024:0:26159:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436325888 00000100:00100000:0.0:1784189309.680065:0:26159:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 4997 00000100:00100000:0.0:1784189309.680072:0:26159:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc056ead180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0+-99:2395:x1870854436325888:12345-192.168.203.12@tcp:8:lfs.0 00010000:00080000:0.0:1784189309.680112:0:26159:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0001: connection from debedd94-805c-42a0-a5e5-41758b2012e9@192.168.203.12@tcp t0 exp 0000000000000000 cur 3551 last 0 00000020:00000080:0.0:1784189309.680141:0:26159:0:(genops.c:1406:class_connect()) connect: client debedd94-805c-42a0-a5e5-41758b2012e9, cookie 0xcc1762b626f8c994 00002000:00100000:0.0:1784189309.680151:0:26159:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli debedd94-805c-42a0-a5e5-41758b2012e9/ffff9dc047a82800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 21136a2 ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1784189309.680168:0:26159:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1784189309.680231:0:26159:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1784189309.680271:0:26159:0:(import.c:65:import_set_state_nolock()) ffff9dc047a87800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1784189309.680353:0:26159:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc056ead180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:debedd94-805c-42a0-a5e5-41758b2012e9+6:2395:x1870854436325888:12345-192.168.203.12@tcp:8:lfs.0 Request processed in 280us (409us total) trans 0 rc 0/0 00000100:00100000:0.0:1784189309.680361:0:26159:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 4997 00000100:00100000:3.0:1784189309.684671:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1784189309.684777:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436326016 00000100:00100000:1.0:1784189309.684786:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436326016 00000100:00100000:1.0:1784189309.684878:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 2051 00000100:00100000:1.0:1784189309.684889:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc07016fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:debedd94-805c-42a0-a5e5-41758b2012e9+6:72366:x1870854436326016:12345-192.168.203.12@tcp:13:lfs.0 00002000:00000024:1.0:1784189309.684915:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8646976 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1784189309.684995:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc07016fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:debedd94-805c-42a0-a5e5-41758b2012e9+6:72366:x1870854436326016:12345-192.168.203.12@tcp:13:lfs.0 Request processed in 108us (331us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189309.685003:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 2051 00000100:00080000:0.0:1784189309.686395:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1784189309.999586:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1784189309.999610:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc056ead500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1870854458231040:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1784189309.999680:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784189309.999788:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458231040 00000100:00100000:2.0:1784189309.999796:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458231040 00000100:00100000:2.0:1784189309.999861:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2052 00000100:00100000:2.0:1784189309.999870:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc07b7e0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1870854458231040:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1784189309.999893:0:8432:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8618304 pending 0 free 3922481152 avail 3690958848 00000100:00100000:2.0:1784189309.999943:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc07b7e0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1870854458231040:12345-0@lo:13:osp-pre-0-1.0 Request processed in 73us (261us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189309.999964:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2052 00000100:00100000:2.0:1784189310.000010:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc056ead500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1870854458231040:0@lo:13:osp-pre-0-1.0 00000100:00080000:3.0:1784189310.000072:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1784189310.000289:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1784189310.000300:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc05ed38e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1870854458231168:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1784189310.000355:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784189310.000659:0:9466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458231168 00000100:00100000:1.0:1784189310.000665:0:9466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458231168 00000100:00100000:1.0:1784189310.000707:0:9466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2053 00000100:00100000:1.0:1784189310.000714:0:9466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf464ac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1870854458231168:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1784189310.000728:0:9466:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8646976 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1784189310.000782:0:9466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf464ac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1870854458231168:12345-0@lo:13:osp-pre-1-1.0 Request processed in 68us (427us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189310.000788:0:9466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2053 00000100:00100000:1.0:1784189310.000819:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc05ed38e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1870854458231168:0@lo:13:osp-pre-1-1.0 00000100:00080000:3.0:1784189310.000912:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1784189310.703589:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784189311.733707:0:26173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784189312.560537:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1784189312.560558:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf43e10380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1870854458231296:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1784189312.560625:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784189312.560826:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc05ed38e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1870854458231424:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1784189312.560855:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784189312.560891:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458231296 00000100:00100000:1.0:1784189312.560898:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458231296 00000100:00100000:1.0:1784189312.560940:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458231424 00000100:00100000:1.0:1784189312.560944:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458231424 00000100:00100000:1.0:1784189312.560963:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3932 00000100:00100000:1.0:1784189312.560971:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc05ed7ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3640:x1870854458231296:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1784189312.561002:0:8438:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445568512 avail 1299329024 00000100:00100000:1.0:1784189312.561046:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc05ed7ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3640:x1870854458231296:12345-0@lo:41:osp-pre-1-0.0 Request processed in 76us (421us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189312.561072:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3932 00000100:00100000:1.0:1784189312.561090:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3933 00000100:00100000:1.0:1784189312.561096:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc05ed38000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:3642:x1870854458231424:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1784189312.561116:0:8438:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445228544 avail 1298989056 00000100:00100000:1.0:1784189312.561147:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc05ed38000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:3642:x1870854458231424:12345-0@lo:41:osp-pre-0-1.0 Request processed in 51us (291us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189312.561153:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3933 00000100:00100000:1.0:1784189312.561196:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc05ed38e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1870854458231424:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1784189312.561228:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf43e10380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1870854458231296:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1784189312.568300:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf464ad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3641:1870854458231808:0@lo:400:kworker.0 00000100:00100000:1.0:1784189312.568387:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784189312.568418:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf47546300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1870854458232320:0@lo:400:kworker.0 00000100:00100000:1.0:1784189312.568441:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784189312.568460:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf47547480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3641:1870854458232832:0@lo:400:kworker.0 00000100:00100000:1.0:1784189312.568484:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784189312.568505:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:1.0:1784189312.568512:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf464ac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3641:1870854458231680:0@lo:400:kworker.0 00000100:00100000:1.0:1784189312.568531:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784189312.568547:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf47545880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1870854458232192:0@lo:400:kworker.0 00000100:00100000:1.0:1784189312.568566:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784189312.568579:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf47545500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1870854458232704:0@lo:400:kworker.0 00000100:00100000:1.0:1784189312.568597:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784189312.568650:0:14684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458232320 00000100:00100000:2.0:1784189312.568748:0:66171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458231808 00000100:00100000:2.0:1784189312.568755:0:66171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458231808 00000100:00100000:2.0:1784189312.568805:0:66171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458232832 00000100:00100000:2.0:1784189312.568810:0:66171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458232832 00000100:00100000:2.0:1784189312.568826:0:66171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458231680 00000100:00100000:2.0:1784189312.568828:0:66171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458231680 00000100:00100000:2.0:1784189312.568843:0:66171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1307 00000100:00100000:2.0:1784189312.568852:0:66171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc05ed38e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1870854458231808:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784189312.568904:0:66171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc05ed38e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1870854458231808:12345-0@lo:400:kworker.0 Request processed in 53us (516us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189312.568924:0:66171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1307 00000100:00100000:2.0:1784189312.568942:0:66171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1308 00000100:00100000:2.0:1784189312.568948:0:66171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc05ed39c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1870854458232832:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784189312.568976:0:66171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc05ed39c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1870854458232832:12345-0@lo:400:kworker.0 Request processed in 28us (490us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189312.568982:0:66171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1308 00000100:00100000:2.0:1784189312.568994:0:66171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1309 00000100:00100000:2.0:1784189312.569000:0:66171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf43e10380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1870854458231680:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784189312.569024:0:66171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf43e10380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1870854458231680:12345-0@lo:400:kworker.0 Request processed in 25us (492us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189312.569030:0:66171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1309 00000100:00080000:2.0:1784189312.569045:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1784189312.569049:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1784189312.569094:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf464ac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3641:1870854458231680:0@lo:400:kworker.0 00000100:00100000:2.0:1784189312.569107:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf464ad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3641:1870854458231808:0@lo:400:kworker.0 00000100:00100000:2.0:1784189312.569121:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf47547480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3641:1870854458232832:0@lo:400:kworker.0 00000100:00100000:1.0:1784189312.569230:0:14684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458232320 00000100:00100000:1.0:1784189312.569270:0:14684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458232192 00000100:00100000:1.0:1784189312.569274:0:14684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458232192 00000100:00100000:1.0:1784189312.569291:0:14684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458232704 00000100:00100000:1.0:1784189312.569293:0:14684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458232704 00000100:00100000:1.0:1784189312.569312:0:14684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2561 00000100:00100000:1.0:1784189312.569344:0:14684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc05ed38a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3641:x1870854458232320:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784189312.569378:0:14684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc05ed38a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3641:x1870854458232320:12345-0@lo:400:kworker.0 Request processed in 60us (935us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189312.569384:0:14684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2561 00000100:00100000:1.0:1784189312.569396:0:14684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2562 00000100:00100000:1.0:1784189312.569401:0:14684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc080df1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3641:x1870854458232192:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784189312.569426:0:14684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc080df1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3641:x1870854458232192:12345-0@lo:400:kworker.0 Request processed in 24us (859us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189312.569432:0:14684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2562 00000100:00100000:1.0:1784189312.569441:0:14684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2563 00000100:00100000:1.0:1784189312.569447:0:14684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc05eda9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3641:x1870854458232704:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784189312.569471:0:14684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc05eda9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3641:x1870854458232704:12345-0@lo:400:kworker.0 Request processed in 24us (873us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189312.569477:0:14684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2563 00000100:00080000:2.0:1784189312.569984:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1784189312.569988:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1784189312.570012:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf47545880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1870854458232192:0@lo:400:kworker.0 00000100:00100000:2.0:1784189312.570023:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf47545500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1870854458232704:0@lo:400:kworker.0 00000100:00100000:2.0:1784189312.570033:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf47546300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1870854458232320:0@lo:400:kworker.0 00000100:00100000:3.0:1784189312.570269:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf464ad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:bd553d0d-03e2-4233-b06b-b55bbfa2b954:3643:1870854458231552:0@lo:400:kworker.0 00000100:00100000:3.0:1784189312.570356:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784189312.570388:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf47546d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3643:1870854458232064:0@lo:400:kworker.0 00000100:00100000:3.0:1784189312.570409:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784189312.570425:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf47545c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1870854458232576:0@lo:400:kworker.0 00000100:00100000:3.0:1784189312.570443:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784189312.570463:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1784189312.570470:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf47544e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3643:1870854458231936:0@lo:400:kworker.0 00000100:00100000:3.0:1784189312.570490:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784189312.570503:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf47547100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3643:1870854458232448:0@lo:400:kworker.0 00000100:00100000:3.0:1784189312.570521:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784189312.570541:0:26160:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458232576 00000100:00100000:3.0:1784189312.570546:0:26160:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458232576 00000100:00100000:3.0:1784189312.570580:0:26160:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2564 00000100:00100000:3.0:1784189312.570587:0:26160:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf47544a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+5:3643:x1870854458232576:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784189312.570622:0:26160:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf47544a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+5:3643:x1870854458232576:12345-0@lo:400:kworker.0 Request processed in 36us (178us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189312.570628:0:26160:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2564 00000100:00100000:2.0:1784189312.570752:0:66169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458232064 00000100:00100000:2.0:1784189312.570756:0:66169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458232064 00000100:00100000:2.0:1784189312.570791:0:66169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458231936 00000100:00100000:2.0:1784189312.570795:0:66169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458231936 00000100:00100000:2.0:1784189312.570811:0:66169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458232448 00000100:00100000:2.0:1784189312.570815:0:66169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458232448 00000100:00100000:2.0:1784189312.570827:0:66169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1310 00000100:00100000:2.0:1784189312.570832:0:66169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf47546a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1870854458232064:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784189312.570863:0:66169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf47546a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1870854458232064:12345-0@lo:400:kworker.0 Request processed in 30us (452us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189312.570869:0:66169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1310 00000100:00100000:2.0:1784189312.570880:0:66169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1311 00000100:00100000:2.0:1784189312.570886:0:66169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf47547800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1870854458231936:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784189312.570910:0:66169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf47547800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1870854458231936:12345-0@lo:400:kworker.0 Request processed in 24us (419us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189312.570915:0:66169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1311 00000100:00100000:2.0:1784189312.570924:0:66169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1312 00000100:00100000:2.0:1784189312.570929:0:66169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf47547b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1870854458232448:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784189312.570951:0:66169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf47547b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1870854458232448:12345-0@lo:400:kworker.0 Request processed in 22us (430us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189312.570957:0:66169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1312 00000100:00080000:2.0:1784189312.570974:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1784189312.570976:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1784189312.570978:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1784189312.571007:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf47545c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1870854458232576:0@lo:400:kworker.0 00000100:00100000:3.0:1784189312.571042:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf47544e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3643:1870854458231936:0@lo:400:kworker.0 00000100:00100000:3.0:1784189312.571050:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf47547100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3643:1870854458232448:0@lo:400:kworker.0 00000100:00100000:3.0:1784189312.571068:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf47546d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3643:1870854458232064:0@lo:400:kworker.0 00000100:00100000:1.0:1784189312.571549:0:94310:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458231552 00000100:00100000:1.0:1784189312.571555:0:94310:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458231552 00000100:00100000:1.0:1784189312.571600:0:94310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1784189312.571606:0:94310:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc044984450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd553d0d-03e2-4233-b06b-b55bbfa2b954+24:3643:x1870854458231552:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784189312.571795:0:94310:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc044984450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd553d0d-03e2-4233-b06b-b55bbfa2b954+24:3643:x1870854458231552:12345-0@lo:400:kworker.0 Request processed in 188us (1476us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189312.571803:0:94310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1784189312.571874:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf464ad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:bd553d0d-03e2-4233-b06b-b55bbfa2b954:3643:1870854458231552:0@lo:400:kworker.0 00010000:00010000:1.0:1784189312.751651:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784189313.071544:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1784189313.071567:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc056ead500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1870854458232960:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1784189313.071630:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784189313.071670:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc05eda8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1870854458233088:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1784189313.071694:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784189313.071695:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458232960 00000100:00100000:1.0:1784189313.071702:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458232960 00000100:00100000:1.0:1784189313.071757:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458233088 00000100:00100000:1.0:1784189313.071761:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458233088 00000100:00100000:1.0:1784189313.071778:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2054 00000100:00100000:1.0:1784189313.071786:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc05ed7c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1870854458232960:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1784189313.071813:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8618304 pending 0 free 3922481152 avail 3690958848 00000100:00100000:1.0:1784189313.071860:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc05ed7c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1870854458232960:12345-0@lo:13:osp-pre-0-0.0 Request processed in 75us (229us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189313.071867:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2054 00000100:00100000:1.0:1784189313.071882:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2055 00000100:00100000:1.0:1784189313.071888:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc05ed7f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3643:x1870854458233088:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1784189313.071903:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8646976 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1784189313.071928:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc05ed7f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3643:x1870854458233088:12345-0@lo:13:osp-pre-1-0.0 Request processed in 41us (233us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189313.071934:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2055 00000100:00100000:1.0:1784189313.071972:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc05eda8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1870854458233088:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1784189313.071985:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc056ead500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1870854458232960:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1784189313.319981:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1784189313.320096:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1784189313.320125:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1784189313.320179:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1784189313.320200:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1784189313.320233:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436326656 00000100:00100000:3.0:1784189313.320241:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436326656 00000100:00100000:3.0:1784189313.320287:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436326528 00000100:00100000:3.0:1784189313.320289:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436326528 00000100:00100000:3.0:1784189313.320310:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 2565 00000100:00100000:3.0:1784189313.320349:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf47547100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:debedd94-805c-42a0-a5e5-41758b2012e9+6:2396:x1870854436326656:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:3.0:1784189313.320410:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf47547100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:debedd94-805c-42a0-a5e5-41758b2012e9+6:2396:x1870854436326656:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 94us (284us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189313.320417:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 2565 00000100:00100000:2.0:1784189313.321113:0:66169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436326400 00000100:00100000:2.0:1784189313.321119:0:66169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436326400 00000100:00100000:2.0:1784189313.321157:0:66169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436326272 00000100:00100000:2.0:1784189313.321160:0:66169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436326272 00000100:00100000:2.0:1784189313.321180:0:66169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1313 00000100:00100000:2.0:1784189313.321196:0:66169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf47546d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:debedd94-805c-42a0-a5e5-41758b2012e9+9:2396:x1870854436326400:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:2.0:1784189313.321233:0:66169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf47546d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:debedd94-805c-42a0-a5e5-41758b2012e9+9:2396:x1870854436326400:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 40us (1150us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189313.321239:0:66169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1313 00000100:00100000:2.0:1784189313.321251:0:66169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1314 00000100:00100000:2.0:1784189313.321256:0:66169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf47544e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:debedd94-805c-42a0-a5e5-41758b2012e9+7:2396:x1870854436326272:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:2.0:1784189313.321277:0:66169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf47544e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:debedd94-805c-42a0-a5e5-41758b2012e9+7:2396:x1870854436326272:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 20us (1105us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189313.321281:0:66169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1314 00000100:00080000:2.0:1784189313.321299:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1784189313.321302:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1784189313.321304:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1784189313.321306:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1784189313.321517:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 2566 00000100:00100000:3.0:1784189313.321531:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf47545c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:debedd94-805c-42a0-a5e5-41758b2012e9+6:2396:x1870854436326528:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:3.0:1784189313.321558:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf47545c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:debedd94-805c-42a0-a5e5-41758b2012e9+6:2396:x1870854436326528:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 32us (1356us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189313.321756:0:94309:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436326144 00000100:00100000:1.0:1784189313.321762:0:94309:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436326144 00000100:00100000:1.0:1784189313.321799:0:94309:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 75 00000100:00100000:1.0:1784189313.321806:0:94309:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc044984850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:60f345e3-c70e-4f53-b5e7-c9671463c9a5+10:2396:x1870854436326144:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:1.0:1784189313.321844:0:94309:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc044984850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:60f345e3-c70e-4f53-b5e7-c9671463c9a5+10:2396:x1870854436326144:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 38us (1872us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189313.321852:0:94309:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 75 00000100:00100000:3.0:1784189313.327349:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 2566 00000001:00080000:2.0:1784189313.587917:0:94304:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 120259084290 is committed 00000001:00100000:3.0:1784189313.590286:0:9506:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of debedd94-805c-42a0-a5e5-41758b2012e9 00000001:00080000:3.0:1784189313.590301:0:9506:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294968960 is committed 00000001:00100000:0.0:1784189313.591385:0:8423:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of debedd94-805c-42a0-a5e5-41758b2012e9 00010000:00010000:3.0:1784189313.775718:0:7454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784189314.800827:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1784189314.932128:0:94886:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg312-client.virtnet: executing wait_import_state_mount (FULL|IDLE) mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 00000100:00100000:2.0:1784189315.119461:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1784189315.119484:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc056ead500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1870854458233216:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1784189315.119557:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784189315.119598:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc05eda8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1870854458233344:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1784189315.119624:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784189315.119672:0:9466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458233216 00000100:00100000:2.0:1784189315.119679:0:9466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458233216 00000100:00100000:2.0:1784189315.119735:0:9466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458233344 00000100:00100000:2.0:1784189315.119738:0:9466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458233344 00000100:00100000:2.0:1784189315.119763:0:9466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2056 00000100:00100000:2.0:1784189315.119774:0:9466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf464ad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1870854458233216:12345-0@lo:13:osp-pre-0-1.0 00000100:00080000:3.0:1784189315.119797:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1784189315.119802:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2057 00002000:00000024:2.0:1784189315.119804:0:9466:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8618304 pending 0 free 3922481152 avail 3690958848 00000100:00080000:3.0:1784189315.119805:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1784189315.119816:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf464ad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1870854458233344:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1784189315.119837:0:8432:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8646976 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1784189315.119892:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf464ad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1870854458233344:12345-0@lo:13:osp-pre-1-1.0 Request processed in 80us (266us total) trans 0 rc 0/0 00000100:00100000:0.0:1784189315.119910:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2057 00000100:00100000:3.0:1784189315.119938:0:9466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf464ad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1870854458233216:12345-0@lo:13:osp-pre-0-1.0 Request processed in 165us (378us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189315.119947:0:9466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2056 00000100:00100000:2.0:1784189315.120946:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc05eda8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1870854458233344:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1784189315.120961:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc056ead500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1870854458233216:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1784189315.823536:0:26173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1784189316.470650:0:94934:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: mdc.lustre-MDT0000-mdc-*.mds_server_uuid in FULL state after 0 sec 00010000:00010000:1.0:1784189316.848087:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784189317.679846:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc05ed7f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bd553d0d-03e2-4233-b06b-b55bbfa2b954:3642:1870854458233472:0@lo:400:kworker.0 00000100:00100000:3.0:1784189317.679915:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784189317.679968:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc05ed7df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3642:1870854458233984:0@lo:400:kworker.0 00000100:00100000:3.0:1784189317.679991:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784189317.680007:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf444e1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3642:1870854458234496:0@lo:400:kworker.0 00000100:00100000:3.0:1784189317.680034:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784189317.680047:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc05ed9aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3642:1870854458235008:0@lo:400:kworker.0 00000100:00100000:3.0:1784189317.680062:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784189317.680081:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1784189317.680085:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc05ed7ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3642:1870854458233600:0@lo:400:kworker.0 00000100:00100000:3.0:1784189317.680100:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784189317.680110:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf444e1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1870854458234112:0@lo:400:kworker.0 00000100:00100000:3.0:1784189317.680128:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784189317.680139:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc05ed9a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1870854458234624:0@lo:400:kworker.0 00000100:00100000:3.0:1784189317.680157:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784189317.680182:0:68287:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458233984 00000100:00100000:3.0:1784189317.680189:0:68287:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458233984 00000100:00100000:3.0:1784189317.680232:0:68287:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458234496 00000100:00100000:3.0:1784189317.680235:0:68287:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458234496 00000100:00100000:3.0:1784189317.680245:0:68287:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458235008 00000100:00100000:3.0:1784189317.680246:0:68287:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458235008 00000100:00100000:3.0:1784189317.680255:0:68287:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458233600 00000100:00100000:3.0:1784189317.680257:0:68287:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458233600 00000100:00100000:3.0:1784189317.680270:0:68287:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1315 00000100:00100000:3.0:1784189317.680276:0:68287:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf47545f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1870854458233984:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784189317.680337:0:68287:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf47545f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1870854458233984:12345-0@lo:400:kworker.0 Request processed in 41us (325us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189317.680344:0:68287:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1315 00000100:00100000:3.0:1784189317.680358:0:68287:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1316 00000100:00100000:3.0:1784189317.680369:0:68287:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf47546680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1870854458234496:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784189317.680395:0:68287:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf47546680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1870854458234496:12345-0@lo:400:kworker.0 Request processed in 27us (360us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189317.680400:0:68287:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1316 00000100:00100000:3.0:1784189317.680410:0:68287:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1317 00000100:00100000:3.0:1784189317.680414:0:68287:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf47544000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1870854458235008:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784189317.680433:0:68287:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf47544000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1870854458235008:12345-0@lo:400:kworker.0 Request processed in 19us (369us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189317.680437:0:68287:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1317 00000100:00100000:3.0:1784189317.680445:0:68287:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1318 00000100:00100000:3.0:1784189317.680450:0:68287:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf47544380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3642:x1870854458233600:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784189317.680469:0:68287:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf47544380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3642:x1870854458233600:12345-0@lo:400:kworker.0 Request processed in 19us (368us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189317.680473:0:68287:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1318 00000100:00080000:3.0:1784189317.680486:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1784189317.680490:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1784189317.680512:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc05ed7ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3642:1870854458233600:0@lo:400:kworker.0 00000100:00100000:3.0:1784189317.680520:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc05ed7df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3642:1870854458233984:0@lo:400:kworker.0 00000100:00100000:3.0:1784189317.680527:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf444e1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3642:1870854458234496:0@lo:400:kworker.0 00000100:00100000:3.0:1784189317.680534:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc05ed9aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3642:1870854458235008:0@lo:400:kworker.0 00000100:00100000:2.0:1784189317.680775:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc05ed7f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3640:1870854458233728:0@lo:400:kworker.0 00000100:00100000:2.0:1784189317.680810:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784189317.680835:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf444e0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1870854458234240:0@lo:400:kworker.0 00000100:00100000:2.0:1784189317.680858:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784189317.680889:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc05ed9b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1870854458234752:0@lo:400:kworker.0 00000100:00100000:2.0:1784189317.680921:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784189317.680938:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1784189317.680944:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc05ed7ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3640:1870854458233856:0@lo:400:kworker.0 00000100:00100000:2.0:1784189317.680965:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784189317.680976:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf444e1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1870854458234368:0@lo:400:kworker.0 00000100:00100000:2.0:1784189317.680998:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784189317.681010:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc05ed98700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1870854458234880:0@lo:400:kworker.0 00000100:00100000:2.0:1784189317.681042:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784189317.681077:0:66169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458233728 00000100:00100000:2.0:1784189317.681081:0:66169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458233728 00000100:00100000:3.0:1784189317.681086:0:26167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458234240 00000100:00100000:3.0:1784189317.681091:0:26167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458234240 00000100:00100000:2.0:1784189317.681122:0:66169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458233856 00000100:00100000:3.0:1784189317.681127:0:26167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458234752 00000100:00100000:2.0:1784189317.681128:0:66169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458233856 00000100:00100000:3.0:1784189317.681132:0:26167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458234752 00000100:00100000:2.0:1784189317.681160:0:66169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1319 00000100:00100000:3.0:1784189317.681161:0:26167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458234368 00000100:00100000:3.0:1784189317.681173:0:26167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458234368 00000100:00100000:2.0:1784189317.681173:0:66169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf464ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1870854458233728:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784189317.681209:0:26167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458234880 00000100:00100000:3.0:1784189317.681212:0:26167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458234880 00000100:00100000:2.0:1784189317.681224:0:66169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf464ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1870854458233728:12345-0@lo:400:kworker.0 Request processed in 55us (412us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189317.681232:0:26167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2567 00000100:00100000:2.0:1784189317.681236:0:66169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1319 00000100:00100000:3.0:1784189317.681241:0:26167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc056ead500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0001-mdtlov_UUID+5:3640:x1870854458234240:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784189317.681270:0:66169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1320 00000100:00100000:2.0:1784189317.681280:0:66169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf43f58000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3640:x1870854458233856:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784189317.681284:0:26167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc056ead500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0001-mdtlov_UUID+5:3640:x1870854458234240:12345-0@lo:400:kworker.0 Request processed in 42us (423us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189317.681292:0:26167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2567 00000100:00100000:3.0:1784189317.681305:0:26167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2568 00000100:00100000:3.0:1784189317.681311:0:26167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf43f5ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+5:3640:x1870854458234752:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784189317.681441:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458234112 00000100:00100000:1.0:1784189317.681445:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458234112 00000100:00100000:1.0:1784189317.681468:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458234624 00000100:00100000:1.0:1784189317.681471:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458234624 00000100:00100000:1.0:1784189317.681485:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3934 00000100:00100000:1.0:1784189317.681491:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf47546300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3642:x1870854458234112:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784189317.681557:0:94314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458233472 00000100:00100000:0.0:1784189317.681560:0:94314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458233472 00000100:00100000:0.0:1784189317.681594:0:94314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1784189317.681600:0:94314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc044986850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:bd553d0d-03e2-4233-b06b-b55bbfa2b954+24:3642:x1870854458233472:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784189317.681653:0:26167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf43f5ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+5:3640:x1870854458234752:12345-0@lo:400:kworker.0 Request processed in 342us (732us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189317.681660:0:26167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2568 00000100:00100000:3.0:1784189317.681670:0:26167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2569 00000100:00100000:3.0:1784189317.681675:0:26167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc081cd1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0001-mdtlov_UUID+5:3640:x1870854458234368:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784189317.681695:0:26167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc081cd1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0001-mdtlov_UUID+5:3640:x1870854458234368:12345-0@lo:400:kworker.0 Request processed in 21us (697us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189317.681701:0:26167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2569 00000100:00100000:2.0:1784189317.681736:0:66169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf43f58000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3640:x1870854458233856:12345-0@lo:400:kworker.0 Request processed in 457us (768us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189317.681745:0:66169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1320 00000100:00100000:2.0:1784189317.681789:0:26163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2570 00000100:00100000:2.0:1784189317.681799:0:26163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf43f58e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+5:3640:x1870854458234880:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784189317.681844:0:26163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf43f58e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+5:3640:x1870854458234880:12345-0@lo:400:kworker.0 Request processed in 47us (801us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189317.681852:0:26163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2570 00000100:00080000:3.0:1784189317.681870:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1784189317.681874:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1784189317.681876:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1784189317.681879:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1784189317.681906:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc05ed7ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3640:1870854458233856:0@lo:400:kworker.0 00000100:00100000:3.0:1784189317.681961:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3935 00000100:00100000:3.0:1784189317.681968:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf47545500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3642:x1870854458234624:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784189317.681994:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf47545500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3642:x1870854458234624:12345-0@lo:400:kworker.0 Request processed in 27us (1837us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189317.682000:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3935 00000100:00100000:2.0:1784189317.682159:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf444e1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1870854458234368:0@lo:400:kworker.0 00000100:00100000:3.0:1784189317.682169:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc05ed9a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1870854458234624:0@lo:400:kworker.0 00000100:00100000:2.0:1784189317.682172:0:3640:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294968960 gen 2 00000100:00100000:3.0:1784189317.682186:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1784189317.682196:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc05ed98700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1870854458234880:0@lo:400:kworker.0 00000100:00100000:3.0:1784189317.682198:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf47544a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1870854458235136:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1784189317.682218:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc05ed7f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3640:1870854458233728:0@lo:400:kworker.0 00000100:00100000:2.0:1784189317.682231:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf444e0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1870854458234240:0@lo:400:kworker.0 00000100:00100000:3.0:1784189317.682236:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784189317.682247:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc05ed9b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1870854458234752:0@lo:400:kworker.0 00000100:00100000:3.0:1784189317.682269:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458235136 00000100:00100000:3.0:1784189317.682274:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458235136 00000100:00100000:2.0:1784189317.682284:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf47547100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1870854458235264:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1784189317.682292:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3936 00000100:00100000:3.0:1784189317.682300:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf47545c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:3642:x1870854458235136:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1784189317.682386:0:8439:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445228544 avail 1298989056 00000100:00100000:3.0:1784189317.682422:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf47545c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:3642:x1870854458235136:12345-0@lo:41:osp-pre-0-1.0 Request processed in 122us (190us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189317.682428:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3936 00000100:00100000:3.0:1784189317.682450:0:3642:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 120259084290 gen 3 00000004:00080000:3.0:1784189317.682454:0:3642:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 120259084289 committed transno 120259084290 00000004:00080000:3.0:1784189317.682466:0:3642:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 120259084290 committed transno 120259084290 00000100:00100000:3.0:1784189317.682478:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf47544a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1870854458235136:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1784189317.682765:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784189317.684009:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458235264 00000100:00100000:3.0:1784189317.684028:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458235264 00000100:00100000:3.0:1784189317.684081:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3937 00000100:00100000:3.0:1784189317.684101:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf43f58380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3640:x1870854458235264:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1784189317.684128:0:8439:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445568512 avail 1299329024 00000100:00100000:3.0:1784189317.684363:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf43f58380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3640:x1870854458235264:12345-0@lo:41:osp-pre-1-0.0 Request processed in 273us (1597us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189317.684371:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3937 00000100:00100000:2.0:1784189317.684786:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf47547100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1870854458235264:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1784189317.688464:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf47546300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3642:x1870854458234112:12345-0@lo:400:kworker.0 Request processed in 6964us (8326us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189317.688479:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3934 00000100:00100000:3.0:1784189317.690875:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf444e1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1870854458234112:0@lo:400:kworker.0 00000100:00100000:0.0:1784189317.691987:0:94314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc044986850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:bd553d0d-03e2-4233-b06b-b55bbfa2b954+24:3642:x1870854458233472:12345-0@lo:400:kworker.0 Request processed in 10382us (12067us total) trans 0 rc 0/0 00000100:00100000:0.0:1784189317.692013:0:94314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1784189317.696047:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc05ed7f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bd553d0d-03e2-4233-b06b-b55bbfa2b954:3642:1870854458233472:0@lo:400:kworker.0 00010000:00010000:3.0:1784189317.871631:0:7454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784189318.193261:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc05edaaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1870854458235392:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1784189318.193358:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784189318.194076:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf43f5ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1870854458235520:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1784189318.194114:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784189318.194669:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458235392 00000100:00100000:1.0:1784189318.194678:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458235392 00000100:00100000:1.0:1784189318.194731:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458235520 00000100:00100000:1.0:1784189318.194735:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458235520 00000100:00100000:1.0:1784189318.194753:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2058 00000100:00100000:1.0:1784189318.194762:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf47544a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1870854458235392:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1784189318.194791:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8646976 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1784189318.194855:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf47544a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1870854458235392:12345-0@lo:13:osp-pre-1-0.0 Request processed in 94us (1496us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189318.194862:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2058 00000100:00100000:0.0:1784189318.195025:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc05edaaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1870854458235392:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1784189318.195134:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2059 00000100:00100000:1.0:1784189318.195152:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf47545880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1870854458235520:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1784189318.195170:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8618304 pending 0 free 3922481152 avail 3690958848 00000100:00100000:1.0:1784189318.195216:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf47545880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1870854458235520:12345-0@lo:13:osp-pre-0-0.0 Request processed in 67us (1102us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189318.195223:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2059 00000100:00100000:0.0:1784189318.196209:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf43f5ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1870854458235520:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1784189318.209500:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1784189318.209669:0:66169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436326784 00000100:00100000:2.0:1784189318.209679:0:66169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436326784 00000100:00100000:2.0:1784189318.209770:0:66169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1432 00000100:00100000:2.0:1784189318.209781:0:66169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf47547480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:debedd94-805c-42a0-a5e5-41758b2012e9+7:72833:x1870854436326784:12345-192.168.203.12@tcp:41:lfs.0 00000004:00000024:2.0:1784189318.209819:0:66169:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445228544 avail 1298989056 00000100:00100000:2.0:1784189318.210081:0:66169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf47547480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:debedd94-805c-42a0-a5e5-41758b2012e9+7:72833:x1870854436326784:12345-192.168.203.12@tcp:41:lfs.0 Request processed in 301us (588us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189318.210089:0:66169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1432 00000100:00080000:3.0:1784189318.210472:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1784189318.217502:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1784189318.217923:0:66170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436326912 00000100:00100000:0.0:1784189318.217933:0:66170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436326912 00000100:00100000:0.0:1784189318.218023:0:66170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1433 00000100:00100000:0.0:1784189318.218034:0:66170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf43f5ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:debedd94-805c-42a0-a5e5-41758b2012e9+9:72833:x1870854436326912:12345-192.168.203.12@tcp:41:lfs.0 00000004:00000024:0.0:1784189318.218071:0:66170:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445568512 avail 1299329024 00000100:00100000:0.0:1784189318.218159:0:66170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf43f5ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:debedd94-805c-42a0-a5e5-41758b2012e9+9:72833:x1870854436326912:12345-192.168.203.12@tcp:41:lfs.0 Request processed in 127us (666us total) trans 0 rc 0/0 00000100:00100000:0.0:1784189318.218167:0:66170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1433 00000100:00080000:3.0:1784189318.218446:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1784189318.223560:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1784189318.224351:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436327040 00000100:00100000:1.0:1784189318.224360:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436327040 00000100:00100000:1.0:1784189318.224494:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 2060 00000100:00100000:1.0:1784189318.224504:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc05ed9b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:debedd94-805c-42a0-a5e5-41758b2012e9+5:72833:x1870854436327040:12345-192.168.203.12@tcp:13:lfs.0 00002000:00000024:1.0:1784189318.224529:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8618304 pending 0 free 3922481152 avail 3690958848 00000100:00100000:1.0:1784189318.224615:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc05ed9b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:debedd94-805c-42a0-a5e5-41758b2012e9+5:72833:x1870854436327040:12345-192.168.203.12@tcp:13:lfs.0 Request processed in 106us (1057us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189318.224629:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 2060 00000100:00080000:3.0:1784189318.224935:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1784189318.230861:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1784189318.231021:0:9466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436327168 00000100:00100000:3.0:1784189318.231031:0:9466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436327168 00000100:00100000:3.0:1784189318.231119:0:9466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 2061 00000100:00100000:3.0:1784189318.231147:0:9466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc05edaad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:debedd94-805c-42a0-a5e5-41758b2012e9+5:72833:x1870854436327168:12345-192.168.203.12@tcp:13:lfs.0 00002000:00000024:3.0:1784189318.231174:0:9466:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8646976 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1784189318.231246:0:9466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc05edaad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:debedd94-805c-42a0-a5e5-41758b2012e9+5:72833:x1870854436327168:12345-192.168.203.12@tcp:13:lfs.0 Request processed in 117us (392us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189318.231254:0:9466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 2061 00000100:00080000:0.0:1784189318.232351:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1784189318.256378:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1784189318.256479:0:68287:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436327296 00000100:00100000:1.0:1784189318.256489:0:68287:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436327296 00000100:00100000:1.0:1784189318.256546:0:68287:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1434 00000100:00100000:1.0:1784189318.256555:0:68287:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc05ed98000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:debedd94-805c-42a0-a5e5-41758b2012e9+7:71731:x1870854436327296:12345-192.168.203.12@tcp:101:bash.0 00010000:00010000:1.0:1784189318.256583:0:68287:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784189318.256602:0:68287:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc042d67000/0xcc1762b626f8c99b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbfc5de7fe6c40be expref: -99 pid: 68287 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189318.256659:0:68287:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc042d66000/0xcc1762b626f8c9a2 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189318.256672:0:68287:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc042d66000/0xcc1762b626f8c9a2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189318.256683:0:68287:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc042d66000/0xcc1762b626f8c9a2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189318.256697:0:68287:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc042d66800/0xcc1762b626f8c9a9 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189318.256720:0:68287:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc042d66800/0xcc1762b626f8c9a9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189318.256727:0:68287:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc042d66800/0xcc1762b626f8c9a9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189318.256883:0:68287:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc042d67c00/0xcc1762b626f8c9b0 lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189318.256892:0:68287:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc042d67c00/0xcc1762b626f8c9b0 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189318.256899:0:68287:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc042d67c00/0xcc1762b626f8c9b0 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784189318.256928:0:68287:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000cf21:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1784189318.256932:0:68287:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1784189318.256966:0:68287:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9dc042d67c00/0xcc1762b626f8c9b0 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189318.256980:0:68287:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc042d66000/0xcc1762b626f8c9a2 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189318.256986:0:68287:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc042d66000/0xcc1762b626f8c9a2 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189318.256993:0:68287:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc042d66000/0xcc1762b626f8c9a2 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189318.256999:0:68287:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dc042d66000/0xcc1762b626f8c9a2 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189318.257027:0:68287:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc042d66000 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:1.0:1784189318.257032:0:68287:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc042d66000/0xcc1762b626f8c9a2 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189318.257040:0:68287:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc042d66000/0xcc1762b626f8c9a2 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189318.257053:0:68287:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9dbf47406300) 00010000:00010000:1.0:1784189318.257056:0:68287:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784189318.257060:0:68287:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dc042d66000/0xcc1762b626f8c9a2 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189318.257067:0:68287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc042d66000/0xcc1762b626f8c9a2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189318.257079:0:68287:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc042d66800/0xcc1762b626f8c9a9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189318.257085:0:68287:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc042d66800/0xcc1762b626f8c9a9 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189318.257090:0:68287:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dc042d66800/0xcc1762b626f8c9a9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189318.257095:0:68287:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc042d66800 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:1.0:1784189318.257098:0:68287:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc042d66800/0xcc1762b626f8c9a9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189318.257104:0:68287:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc042d66800/0xcc1762b626f8c9a9 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189318.257123:0:68287:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x91905c78 (ffff9dc049188400) 00010000:00010000:1.0:1784189318.257125:0:68287:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784189318.257128:0:68287:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dc042d66800/0xcc1762b626f8c9a9 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189318.257134:0:68287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc042d66800/0xcc1762b626f8c9a9 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189318.257174:0:68287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc042d67000/0xcc1762b626f8c99b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c40be expref: 9 pid: 68287 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189318.257187:0:68287:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc042d67c00/0xcc1762b626f8c9b0 lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c40be expref: 8 pid: 68287 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189318.257194:0:68287:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x1:0x0].0x0 (ffff9dc049188200) 00010000:00010000:1.0:1784189318.257197:0:68287:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1784189318.257199:0:68287:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc042d67c00, rc 0) 00000100:00100000:1.0:1784189318.257265:0:68287:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc05ed98000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:debedd94-805c-42a0-a5e5-41758b2012e9+8:71731:x1870854436327296:12345-192.168.203.12@tcp:101:bash.0 Request processed in 710us (897us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189318.257272:0:68287:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1434 00000100:00100000:1.0:1784189318.276647:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1784189318.279266:0:66169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436327424 00000100:00100000:2.0:1784189318.279279:0:66169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436327424 00000100:00100000:2.0:1784189318.279459:0:66169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1435 00000100:00100000:2.0:1784189318.279471:0:66169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc05edaaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:debedd94-805c-42a0-a5e5-41758b2012e9+8:71731:x1870854436327424:12345-192.168.203.12@tcp:101:bash.0 00010000:00010000:2.0:1784189318.279489:0:66169:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784189318.279509:0:66169:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04a20b800/0xcc1762b626f8c9b7 lrc: 2/0,0 mode: --/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbfc5de7fe6c40c5 expref: -99 pid: 66169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189318.279566:0:66169:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04a20a200/0xcc1762b626f8c9be lrc: 3/1,0 mode: --/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189318.279580:0:66169:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04a20a200/0xcc1762b626f8c9be lrc: 3/1,0 mode: CR/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189318.279591:0:66169:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04a20a200/0xcc1762b626f8c9be lrc: 3/1,0 mode: CR/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189318.279604:0:66169:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4710e000/0xcc1762b626f8c9c5 lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0x1:0x0].0xb04f75d6 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189318.279611:0:66169:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4710e000/0xcc1762b626f8c9c5 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189318.279633:0:66169:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4710e000/0xcc1762b626f8c9c5 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784189318.279754:0:66169:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc080f6a680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:66169:1870854458235648:0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1784189318.279807:0:66169:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784189318.279842:0:66169:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dc071b6a9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1784189318.279920:0:23826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458235648 00000100:00100000:3.0:1784189318.279925:0:23826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458235648 00000100:00100000:3.0:1784189318.279964:0:23826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3938 00000100:00100000:3.0:1784189318.279971:0:23826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc080f68000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:66169:x1870854458235648:12345-0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1784189318.280048:0:23826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc080f68000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:66169:x1870854458235648:12345-0@lo:1000:mdt00_000.0 Request processed in 77us (240us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189318.280055:0:23826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3938 00000100:00100000:2.0:1784189318.281108:0:66169:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc080f6a680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:66169:1870854458235648:0@lo:1000:mdt00_000.0 00010000:00010000:2.0:1784189318.281169:0:66169:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4710f000/0xcc1762b626f8c9cc lrc: 3/1,0 mode: --/PR res: [0x2400090a5:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189318.281182:0:66169:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4710f000/0xcc1762b626f8c9cc lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x2:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189318.281192:0:66169:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4710f000/0xcc1762b626f8c9cc lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x2:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1784189318.281212:0:66169:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4710f000/0xcc1762b626f8c9cc lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x2:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189318.281224:0:66169:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04a20a200/0xcc1762b626f8c9be lrc: 4/1,0 mode: CR/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189318.281231:0:66169:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04a20a200/0xcc1762b626f8c9be lrc: 4/1,0 mode: CR/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189318.281237:0:66169:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04a20a200/0xcc1762b626f8c9be lrc: 3/0,0 mode: CR/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189318.281244:0:66169:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04a20a200/0xcc1762b626f8c9be lrc: 4/0,0 mode: CR/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189318.281263:0:66169:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc04a20a200 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:2.0:1784189318.281267:0:66169:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04a20a200/0xcc1762b626f8c9be lrc: 4/0,0 mode: CR/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189318.281274:0:66169:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04a20a200/0xcc1762b626f8c9be lrc: 5/0,0 mode: CR/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189318.281285:0:66169:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x1:0x0].0x0 (ffff9dc049188200) 00010000:00010000:2.0:1784189318.281287:0:66169:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784189318.281291:0:66169:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04a20a200/0xcc1762b626f8c9be lrc: 3/0,0 mode: --/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189318.281297:0:66169:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04a20a200/0xcc1762b626f8c9be lrc: 0/0,0 mode: --/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189318.281310:0:66169:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4710e000/0xcc1762b626f8c9c5 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189318.281315:0:66169:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4710e000/0xcc1762b626f8c9c5 lrc: 2/0,0 mode: PR/PR res: [0x20000cf21:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189318.281359:0:66169:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4710e000/0xcc1762b626f8c9c5 lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189318.281364:0:66169:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dbf4710e000 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:2.0:1784189318.281367:0:66169:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4710e000/0xcc1762b626f8c9c5 lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189318.281373:0:66169:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4710e000/0xcc1762b626f8c9c5 lrc: 4/0,0 mode: PR/PR res: [0x20000cf21:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189318.281390:0:66169:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x1:0x0].0xb04f75d6 (ffff9dc051574700) 00010000:00010000:2.0:1784189318.281393:0:66169:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784189318.281396:0:66169:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4710e000/0xcc1762b626f8c9c5 lrc: 2/0,0 mode: --/PR res: [0x20000cf21:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189318.281402:0:66169:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4710e000/0xcc1762b626f8c9c5 lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189318.281435:0:66169:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04a20b800/0xcc1762b626f8c9b7 lrc: 0/0,0 mode: --/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c40c5 expref: 10 pid: 66169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189318.281448:0:66169:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4710f000/0xcc1762b626f8c9cc lrc: 3/0,0 mode: PR/PR res: [0x2400090a5:0x2:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c40c5 expref: 9 pid: 66169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189318.281456:0:66169:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x2:0x0].0x0 (ffff9dc051574000) 00010000:00010000:2.0:1784189318.281458:0:66169:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1784189318.281460:0:66169:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dbf4710f000, rc 0) 00000100:00100000:2.0:1784189318.281519:0:66169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc05edaaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:debedd94-805c-42a0-a5e5-41758b2012e9+9:71731:x1870854436327424:12345-192.168.203.12@tcp:101:bash.0 Request processed in 2051us (4880us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189318.281526:0:66169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1435 00000100:00100000:2.0:1784189318.284424:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1784189318.284513:0:66171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436327552 00000100:00100000:0.0:1784189318.284524:0:66171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436327552 00000100:00100000:0.0:1784189318.284584:0:66171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1436 00000100:00100000:0.0:1784189318.284594:0:66171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc080f6a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:debedd94-805c-42a0-a5e5-41758b2012e9+9:71731:x1870854436327552:12345-192.168.203.12@tcp:101:bash.0 00010000:00010000:0.0:1784189318.284614:0:66171:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784189318.284635:0:66171:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9dc081b17a00/0xcc1762b626f8c9d3 lrc: 2/0,0 mode: --/CR res: [0x2400090a5:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbfc5de7fe6c40cc expref: -99 pid: 66171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189318.284694:0:66171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9dc081b16200/0xcc1762b626f8c9da lrc: 3/1,0 mode: --/PR res: [0x2400090a5:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189318.284708:0:66171:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9dc081b16200/0xcc1762b626f8c9da lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x2:0x0].0x0 bits 0x10/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66171 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189318.284732:0:66171:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9dc081b16200/0xcc1762b626f8c9da lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x2:0x0].0x0 bits 0x10/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66171 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784189318.284778:0:66171:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2400090a5:0x2:0x0]: returning size 4096 00000004:00200000:0.0:1784189318.284783:0:66171:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00010000:00010000:0.0:1784189318.284835:0:66171:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9dc081b17a00/0xcc1762b626f8c9d3 lrc: 0/0,0 mode: --/CR res: [0x2400090a5:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c40cc expref: 11 pid: 66171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189318.284852:0:66171:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9dc081b16200/0xcc1762b626f8c9da lrc: 3/0,0 mode: PR/PR res: [0x2400090a5:0x2:0x0].0x0 bits 0x10/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c40cc expref: 10 pid: 66171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189318.284861:0:66171:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x2:0x0].0x0 (ffff9dc06adaa000) 00010000:00010000:0.0:1784189318.284864:0:66171:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 10 00010000:00010000:0.0:1784189318.284868:0:66171:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc081b16200, rc 0) 00000100:00100000:0.0:1784189318.284927:0:66171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc080f6a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:debedd94-805c-42a0-a5e5-41758b2012e9+10:71731:x1870854436327552:12345-192.168.203.12@tcp:101:bash.0 Request processed in 334us (511us total) trans 0 rc 0/0 00000100:00100000:0.0:1784189318.284935:0:66171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1436 00000100:00100000:3.0:1784189318.287776:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1784189318.287823:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1784189318.287912:0:66945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436327808 00000100:00100000:0.0:1784189318.287922:0:66945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436327808 00000100:00100000:0.0:1784189318.287980:0:66945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1437 00000100:00100000:0.0:1784189318.287989:0:66945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf47547100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:debedd94-805c-42a0-a5e5-41758b2012e9+10:71731:x1870854436327808:12345-192.168.203.12@tcp:101:bash.0 00010000:00010000:0.0:1784189318.288008:0:66945:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784189318.288035:0:66945:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9dc081b16600/0xcc1762b626f8c9e1 lrc: 2/0,0 mode: --/CR res: [0x2400090a5:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbfc5de7fe6c40d3 expref: -99 pid: 66945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189318.288096:0:66945:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9dc081b16000/0xcc1762b626f8c9e8 lrc: 3/1,0 mode: --/CR res: [0x2400090a5:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189318.288135:0:66945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9dc081b16000/0xcc1762b626f8c9e8 lrc: 3/1,0 mode: CR/CR res: [0x2400090a5:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 66945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189318.288148:0:66945:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9dc081b16000/0xcc1762b626f8c9e8 lrc: 3/1,0 mode: CR/CR res: [0x2400090a5:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 66945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189318.288165:0:66945:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9dc081b16800/0xcc1762b626f8c9ef lrc: 3/1,0 mode: --/PR res: [0x2400090a5:0x2:0x0].0x9add8152 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189318.288172:0:66945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9dc081b16800/0xcc1762b626f8c9ef lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x2:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189318.288178:0:66945:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9dc081b16800/0xcc1762b626f8c9ef lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x2:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189318.288255:0:66945:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9dc081b17200/0xcc1762b626f8c9f6 lrc: 3/1,0 mode: --/PR res: [0x2400090a5:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189318.288265:0:66945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9dc081b17200/0xcc1762b626f8c9f6 lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189318.288272:0:66945:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9dc081b17200/0xcc1762b626f8c9f6 lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66945 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784189318.288310:0:66945:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2400090a5:0x4:0x0]: returning size 0 00000004:00200000:0.0:1784189318.288315:0:66945:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1784189318.288383:0:66945:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff9dc081b17200/0xcc1762b626f8c9f6 lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189318.288396:0:66945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9dc081b17200/0xcc1762b626f8c9f6 lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189318.288415:0:66945:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9dc081b16000/0xcc1762b626f8c9e8 lrc: 4/1,0 mode: CR/CR res: [0x2400090a5:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 66945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189318.288421:0:66945:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9dc081b16000/0xcc1762b626f8c9e8 lrc: 4/1,0 mode: CR/CR res: [0x2400090a5:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 66945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189318.288428:0:66945:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9dc081b16000/0xcc1762b626f8c9e8 lrc: 3/0,0 mode: CR/CR res: [0x2400090a5:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 66945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189318.288434:0:66945:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9dc081b16000/0xcc1762b626f8c9e8 lrc: 4/0,0 mode: CR/CR res: [0x2400090a5:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 66945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189318.288440:0:66945:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc081b16000 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:0.0:1784189318.288444:0:66945:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9dc081b16000/0xcc1762b626f8c9e8 lrc: 4/0,0 mode: CR/CR res: [0x2400090a5:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 66945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189318.288451:0:66945:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9dc081b16000/0xcc1762b626f8c9e8 lrc: 5/0,0 mode: CR/CR res: [0x2400090a5:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 66945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189318.288464:0:66945:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x2:0x0].0x0 (ffff9dc06adaa000) 00010000:00010000:0.0:1784189318.288466:0:66945:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784189318.288470:0:66945:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9dc081b16000/0xcc1762b626f8c9e8 lrc: 3/0,0 mode: --/CR res: [0x2400090a5:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 66945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189318.288477:0:66945:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9dc081b16000/0xcc1762b626f8c9e8 lrc: 0/0,0 mode: --/CR res: [0x2400090a5:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 66945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189318.288489:0:66945:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9dc081b16800/0xcc1762b626f8c9ef lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x2:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189318.288495:0:66945:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9dc081b16800/0xcc1762b626f8c9ef lrc: 2/0,0 mode: PR/PR res: [0x2400090a5:0x2:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189318.288507:0:66945:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9dc081b16800/0xcc1762b626f8c9ef lrc: 3/0,0 mode: PR/PR res: [0x2400090a5:0x2:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189318.288512:0:66945:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc081b16800 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:0.0:1784189318.288515:0:66945:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9dc081b16800/0xcc1762b626f8c9ef lrc: 3/0,0 mode: PR/PR res: [0x2400090a5:0x2:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189318.288521:0:66945:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9dc081b16800/0xcc1762b626f8c9ef lrc: 4/0,0 mode: PR/PR res: [0x2400090a5:0x2:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189318.288529:0:66945:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x2:0x0].0x9add8152 (ffff9dbf47362100) 00010000:00010000:0.0:1784189318.288531:0:66945:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784189318.288534:0:66945:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9dc081b16800/0xcc1762b626f8c9ef lrc: 2/0,0 mode: --/PR res: [0x2400090a5:0x2:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189318.288539:0:66945:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9dc081b16800/0xcc1762b626f8c9ef lrc: 0/0,0 mode: --/PR res: [0x2400090a5:0x2:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66945 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189318.288568:0:66945:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9dc081b16600/0xcc1762b626f8c9e1 lrc: 0/0,0 mode: --/CR res: [0x2400090a5:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c40d3 expref: 12 pid: 66945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189318.288582:0:66945:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9dc081b17200/0xcc1762b626f8c9f6 lrc: 3/0,0 mode: PR/PR res: [0x2400090a5:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c40d3 expref: 11 pid: 66945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189318.288589:0:66945:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x4:0x0].0x0 (ffff9dc0455f8300) 00010000:00010000:0.0:1784189318.288591:0:66945:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1784189318.288594:0:66945:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc081b17200, rc 0) 00000100:00100000:0.0:1784189318.288647:0:66945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf47547100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:debedd94-805c-42a0-a5e5-41758b2012e9+11:71731:x1870854436327808:12345-192.168.203.12@tcp:101:bash.0 Request processed in 658us (822us total) trans 0 rc 0/0 00000100:00100000:0.0:1784189318.288665:0:66945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1437 00000100:00100000:1.0:1784189318.288977:0:7455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436327680 00000100:00100000:1.0:1784189318.288983:0:7455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436327680 00000100:00100000:1.0:1784189318.289032:0:7455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 722 00000100:00100000:1.0:1784189318.289040:0:7455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc07113b450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:debedd94-805c-42a0-a5e5-41758b2012e9+11:2398:x1870854436327680:12345-192.168.203.12@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1784189318.289051:0:7455:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784189318.289065:0:7455:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9dc081b16200/0xcc1762b626f8c9da lrc: 0/0,0 mode: --/PR res: [0x2400090a5:0x2:0x0].0x0 bits 0x10/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c40cc expref: 11 pid: 66171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189318.289084:0:7455:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x2:0x0].0x0 (ffff9dc06adaa000) 00010000:00010000:1.0:1784189318.289087:0:7455:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784189318.289129:0:7455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc07113b450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:debedd94-805c-42a0-a5e5-41758b2012e9+10:2398:x1870854436327680:12345-192.168.203.12@tcp:103:ldlm_bl.0 Request processed in 82us (1353us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189318.289137:0:7455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 722 00000100:00100000:3.0:1784189318.299591:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1784189318.301200:0:26168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436327936 00000100:00100000:1.0:1784189318.301214:0:26168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436327936 00000100:00100000:1.0:1784189318.301273:0:26168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 4998 00000100:00100000:1.0:1784189318.301284:0:26168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc056475180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:debedd94-805c-42a0-a5e5-41758b2012e9+5:2397:x1870854436327936:12345-192.168.203.12@tcp:101:bash.0 00010000:00010000:1.0:1784189318.301302:0:26168:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784189318.301336:0:26168:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001f62eb6a/0xcc1762b626f8c9fd lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0x242:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xcbfc5de7fe6c40da expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1784189318.301364:0:26168:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x242:0x0] initial LVB size: 0, mtime: 0x6a589157, atime: 0x6a589157, ctime: 0x6a589157, blocks: 0x0 00010000:00010000:1.0:1784189318.301385:0:26168:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x242:0x0].0x0 since=3560s v=(0 0) 00010000:00010000:1.0:1784189318.301389:0:26168:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x242:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784189318.301399:0:26168:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001f62eb6a/0xcc1762b626f8c9fd lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x242:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c40da expref: 6 pid: 26168 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189318.301419:0:26168:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000001f62eb6a/0xcc1762b626f8c9fd lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x242:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c40da expref: 6 pid: 26168 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189318.301444:0:26168:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc042d67000, rc 0) 00000100:00100000:1.0:1784189318.301513:0:26168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc056475180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:debedd94-805c-42a0-a5e5-41758b2012e9+6:2397:x1870854436327936:12345-192.168.203.12@tcp:101:bash.0 Request processed in 230us (1931us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189318.301532:0:26168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 4998 00000100:00100000:2.0:1784189318.304954:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1784189318.305038:0:66169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436328064 00000100:00100000:0.0:1784189318.305048:0:66169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436328064 00000100:00100000:0.0:1784189318.305105:0:66169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1438 00000100:00100000:0.0:1784189318.305115:0:66169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc080f6ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:debedd94-805c-42a0-a5e5-41758b2012e9+9:71731:x1870854436328064:12345-192.168.203.12@tcp:101:bash.0 00010000:00010000:0.0:1784189318.305144:0:66169:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784189318.305166:0:66169:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc081b17a00/0xcc1762b626f8ca04 lrc: 2/0,0 mode: --/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbfc5de7fe6c40e1 expref: -99 pid: 66169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189318.305229:0:66169:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc081b17e00/0xcc1762b626f8ca0b lrc: 3/1,0 mode: --/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189318.305242:0:66169:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc081b17e00/0xcc1762b626f8ca0b lrc: 3/1,0 mode: CR/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189318.305253:0:66169:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc081b17e00/0xcc1762b626f8ca0b lrc: 3/1,0 mode: CR/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189318.305267:0:66169:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc081b16e00/0xcc1762b626f8ca12 lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0x1:0x0].0x8f93a2f9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189318.305274:0:66169:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc081b16e00/0xcc1762b626f8ca12 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189318.305280:0:66169:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc081b16e00/0xcc1762b626f8ca12 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784189318.305415:0:66169:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc05ed9b100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:66169:1870854458235776:0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1784189318.305478:0:66169:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784189318.305526:0:66169:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dbf425bb540 going to sleep for 11 seconds 00000100:00100000:3.0:1784189318.305707:0:26492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458235776 00000100:00100000:3.0:1784189318.305712:0:26492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458235776 00000100:00100000:3.0:1784189318.305751:0:26492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3939 00000100:00100000:3.0:1784189318.305759:0:26492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc05ed98700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:66169:x1870854458235776:12345-0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1784189318.305834:0:26492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc05ed98700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:66169:x1870854458235776:12345-0@lo:1000:mdt00_000.0 Request processed in 75us (355us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189318.305841:0:26492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3939 00000100:00100000:0.0:1784189318.305946:0:66169:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc05ed9b100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:66169:1870854458235776:0@lo:1000:mdt00_000.0 00010000:00010000:0.0:1784189318.305988:0:66169:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc081b17c00/0xcc1762b626f8ca19 lrc: 3/1,0 mode: --/PR res: [0x2400090a5:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189318.305997:0:66169:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc081b17c00/0xcc1762b626f8ca19 lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x3:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189318.306005:0:66169:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc081b17c00/0xcc1762b626f8ca19 lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x3:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1784189318.306036:0:66169:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9dc081b17c00/0xcc1762b626f8ca19 lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x3:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189318.306049:0:66169:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc081b17e00/0xcc1762b626f8ca0b lrc: 4/1,0 mode: CR/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189318.306056:0:66169:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc081b17e00/0xcc1762b626f8ca0b lrc: 4/1,0 mode: CR/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189318.306062:0:66169:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc081b17e00/0xcc1762b626f8ca0b lrc: 3/0,0 mode: CR/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189318.306068:0:66169:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dc081b17e00/0xcc1762b626f8ca0b lrc: 4/0,0 mode: CR/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189318.306074:0:66169:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc081b17e00 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:0.0:1784189318.306078:0:66169:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc081b17e00/0xcc1762b626f8ca0b lrc: 4/0,0 mode: CR/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189318.306085:0:66169:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc081b17e00/0xcc1762b626f8ca0b lrc: 5/0,0 mode: CR/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189318.306106:0:66169:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x1:0x0].0x0 (ffff9dc049188200) 00010000:00010000:0.0:1784189318.306109:0:66169:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784189318.306113:0:66169:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dc081b17e00/0xcc1762b626f8ca0b lrc: 3/0,0 mode: --/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189318.306120:0:66169:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc081b17e00/0xcc1762b626f8ca0b lrc: 0/0,0 mode: --/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189318.306131:0:66169:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc081b16e00/0xcc1762b626f8ca12 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189318.306136:0:66169:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc081b16e00/0xcc1762b626f8ca12 lrc: 2/0,0 mode: PR/PR res: [0x20000cf21:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189318.306142:0:66169:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dc081b16e00/0xcc1762b626f8ca12 lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189318.306147:0:66169:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc081b16e00 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:0.0:1784189318.306150:0:66169:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc081b16e00/0xcc1762b626f8ca12 lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189318.306156:0:66169:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc081b16e00/0xcc1762b626f8ca12 lrc: 4/0,0 mode: PR/PR res: [0x20000cf21:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189318.306163:0:66169:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x1:0x0].0x8f93a2f9 (ffff9dbf47362900) 00010000:00010000:0.0:1784189318.306165:0:66169:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784189318.306167:0:66169:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dc081b16e00/0xcc1762b626f8ca12 lrc: 2/0,0 mode: --/PR res: [0x20000cf21:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189318.306172:0:66169:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc081b16e00/0xcc1762b626f8ca12 lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189318.306219:0:66169:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc081b17a00/0xcc1762b626f8ca04 lrc: 0/0,0 mode: --/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c40e1 expref: 11 pid: 66169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189318.306232:0:66169:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc081b17c00/0xcc1762b626f8ca19 lrc: 3/0,0 mode: PR/PR res: [0x2400090a5:0x3:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c40e1 expref: 10 pid: 66169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189318.306240:0:66169:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x3:0x0].0x0 (ffff9dbf47362600) 00010000:00010000:0.0:1784189318.306242:0:66169:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1784189318.306245:0:66169:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc081b17c00, rc 0) 00000100:00100000:0.0:1784189318.306290:0:66169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc080f6ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:debedd94-805c-42a0-a5e5-41758b2012e9+10:71731:x1870854436328064:12345-192.168.203.12@tcp:101:bash.0 Request processed in 1177us (1344us total) trans 0 rc 0/0 00000100:00100000:0.0:1784189318.306297:0:66169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1438 00000100:00100000:3.0:1784189318.318679:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1784189318.318765:0:68287:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436328192 00000100:00100000:1.0:1784189318.318775:0:68287:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436328192 00000100:00100000:1.0:1784189318.318829:0:68287:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1439 00000100:00100000:1.0:1784189318.318839:0:68287:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf44c8aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:debedd94-805c-42a0-a5e5-41758b2012e9+10:71731:x1870854436328192:12345-192.168.203.12@tcp:101:bash.0 00010000:00010000:1.0:1784189318.318860:0:68287:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784189318.318881:0:68287:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9dc042d66800/0xcc1762b626f8ca20 lrc: 2/0,0 mode: --/CR res: [0x2400090a5:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbfc5de7fe6c40e8 expref: -99 pid: 68287 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189318.318941:0:68287:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9dc042d66000/0xcc1762b626f8ca27 lrc: 3/1,0 mode: --/PR res: [0x2400090a5:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189318.318954:0:68287:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9dc042d66000/0xcc1762b626f8ca27 lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x3:0x0].0x0 bits 0x10/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 68287 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189318.318966:0:68287:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9dc042d66000/0xcc1762b626f8ca27 lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x3:0x0].0x0 bits 0x10/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 68287 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784189318.319020:0:68287:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2400090a5:0x3:0x0]: returning size 4096 00000004:00200000:1.0:1784189318.319024:0:68287:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00010000:00010000:1.0:1784189318.319060:0:68287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9dc042d66800/0xcc1762b626f8ca20 lrc: 0/0,0 mode: --/CR res: [0x2400090a5:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c40e8 expref: 12 pid: 68287 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189318.319076:0:68287:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9dc042d66000/0xcc1762b626f8ca27 lrc: 3/0,0 mode: PR/PR res: [0x2400090a5:0x3:0x0].0x0 bits 0x10/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c40e8 expref: 11 pid: 68287 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189318.319084:0:68287:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x3:0x0].0x0 (ffff9dc0455f8800) 00010000:00010000:1.0:1784189318.319087:0:68287:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 10 00010000:00010000:1.0:1784189318.319103:0:68287:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc042d66000, rc 0) 00000100:00100000:1.0:1784189318.319288:0:68287:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf44c8aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:debedd94-805c-42a0-a5e5-41758b2012e9+11:71731:x1870854436328192:12345-192.168.203.12@tcp:101:bash.0 Request processed in 449us (615us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189318.319296:0:68287:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1439 00000100:00100000:3.0:1784189318.324001:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1784189318.324072:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1784189318.324170:0:66170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436328320 00000100:00100000:2.0:1784189318.324179:0:66170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436328320 00000100:00100000:2.0:1784189318.324236:0:66170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1440 00000100:00100000:2.0:1784189318.324244:0:66170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc04a64fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:debedd94-805c-42a0-a5e5-41758b2012e9+11:71731:x1870854436328320:12345-192.168.203.12@tcp:101:bash.0 00010000:00010000:2.0:1784189318.324262:0:66170:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784189318.324290:0:66170:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9dc0565e7600/0xcc1762b626f8ca2e lrc: 2/0,0 mode: --/CR res: [0x2400090a5:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbfc5de7fe6c40ef expref: -99 pid: 66170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189318.324378:0:66170:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9dc0565e7200/0xcc1762b626f8ca35 lrc: 3/1,0 mode: --/CR res: [0x2400090a5:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189318.324392:0:66170:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9dc0565e7200/0xcc1762b626f8ca35 lrc: 3/1,0 mode: CR/CR res: [0x2400090a5:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 66170 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189318.324403:0:66170:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9dc0565e7200/0xcc1762b626f8ca35 lrc: 3/1,0 mode: CR/CR res: [0x2400090a5:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 66170 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189318.324417:0:66170:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9dc0565e7400/0xcc1762b626f8ca3c lrc: 3/1,0 mode: --/PR res: [0x2400090a5:0x3:0x0].0x9add8152 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189318.324423:0:66170:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9dc0565e7400/0xcc1762b626f8ca3c lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x3:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66170 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189318.324435:0:66170:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9dc0565e7400/0xcc1762b626f8ca3c lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x3:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66170 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189318.324509:0:66170:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9dc0565e6200/0xcc1762b626f8ca43 lrc: 3/1,0 mode: --/PR res: [0x2400090a5:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189318.324517:0:66170:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9dc0565e6200/0xcc1762b626f8ca43 lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x5:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66170 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189318.324523:0:66170:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9dc0565e6200/0xcc1762b626f8ca43 lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x5:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66170 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784189318.324559:0:66170:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2400090a5:0x5:0x0]: returning size 0 00000004:00200000:2.0:1784189318.324562:0:66170:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1784189318.324582:0:66170:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff9dc0565e6200/0xcc1762b626f8ca43 lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x5:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66170 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189318.324599:0:66170:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9dc0565e6200/0xcc1762b626f8ca43 lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66170 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189318.324608:0:66170:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9dc0565e7200/0xcc1762b626f8ca35 lrc: 4/1,0 mode: CR/CR res: [0x2400090a5:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 66170 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189318.324614:0:66170:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9dc0565e7200/0xcc1762b626f8ca35 lrc: 4/1,0 mode: CR/CR res: [0x2400090a5:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 66170 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189318.324620:0:66170:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9dc0565e7200/0xcc1762b626f8ca35 lrc: 3/0,0 mode: CR/CR res: [0x2400090a5:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 66170 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189318.324627:0:66170:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9dc0565e7200/0xcc1762b626f8ca35 lrc: 4/0,0 mode: CR/CR res: [0x2400090a5:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 66170 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189318.324633:0:66170:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc0565e7200 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:2.0:1784189318.324636:0:66170:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9dc0565e7200/0xcc1762b626f8ca35 lrc: 4/0,0 mode: CR/CR res: [0x2400090a5:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 66170 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189318.324643:0:66170:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9dc0565e7200/0xcc1762b626f8ca35 lrc: 5/0,0 mode: CR/CR res: [0x2400090a5:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 66170 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189318.324654:0:66170:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x3:0x0].0x0 (ffff9dc0455f8800) 00010000:00010000:2.0:1784189318.324657:0:66170:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784189318.324660:0:66170:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9dc0565e7200/0xcc1762b626f8ca35 lrc: 3/0,0 mode: --/CR res: [0x2400090a5:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 66170 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189318.324667:0:66170:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9dc0565e7200/0xcc1762b626f8ca35 lrc: 0/0,0 mode: --/CR res: [0x2400090a5:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 66170 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189318.324679:0:66170:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9dc0565e7400/0xcc1762b626f8ca3c lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x3:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66170 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189318.324688:0:66170:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9dc0565e7400/0xcc1762b626f8ca3c lrc: 2/0,0 mode: PR/PR res: [0x2400090a5:0x3:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66170 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189318.324694:0:66170:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9dc0565e7400/0xcc1762b626f8ca3c lrc: 3/0,0 mode: PR/PR res: [0x2400090a5:0x3:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66170 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189318.324699:0:66170:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc0565e7400 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:2.0:1784189318.324702:0:66170:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9dc0565e7400/0xcc1762b626f8ca3c lrc: 3/0,0 mode: PR/PR res: [0x2400090a5:0x3:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66170 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189318.324708:0:66170:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9dc0565e7400/0xcc1762b626f8ca3c lrc: 4/0,0 mode: PR/PR res: [0x2400090a5:0x3:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66170 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189318.324714:0:66170:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x3:0x0].0x9add8152 (ffff9dc051574700) 00010000:00010000:2.0:1784189318.324716:0:66170:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784189318.324719:0:66170:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9dc0565e7400/0xcc1762b626f8ca3c lrc: 2/0,0 mode: --/PR res: [0x2400090a5:0x3:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66170 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189318.324725:0:66170:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9dc0565e7400/0xcc1762b626f8ca3c lrc: 0/0,0 mode: --/PR res: [0x2400090a5:0x3:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66170 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189318.324749:0:66170:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9dc0565e7600/0xcc1762b626f8ca2e lrc: 0/0,0 mode: --/CR res: [0x2400090a5:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c40ef expref: 13 pid: 66170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189318.324760:0:66170:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9dc0565e6200/0xcc1762b626f8ca43 lrc: 3/0,0 mode: PR/PR res: [0x2400090a5:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c40ef expref: 12 pid: 66170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189318.324767:0:66170:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x5:0x0].0x0 (ffff9dbf45662c00) 00010000:00010000:2.0:1784189318.324769:0:66170:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784189318.324775:0:66170:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc0565e6200, rc 0) 00000100:00100000:2.0:1784189318.324825:0:66170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc04a64fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:debedd94-805c-42a0-a5e5-41758b2012e9+12:71731:x1870854436328320:12345-192.168.203.12@tcp:101:bash.0 Request processed in 581us (831us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189318.324832:0:66170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1440 00000100:00100000:0.0:1784189318.331559:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436328448 00000100:00100000:0.0:1784189318.331574:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436328448 00000100:00100000:0.0:1784189318.331645:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 723 00000100:00100000:0.0:1784189318.331656:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc04a64d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:debedd94-805c-42a0-a5e5-41758b2012e9+12:2399:x1870854436328448:12345-192.168.203.12@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1784189318.331674:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784189318.331699:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9dc042d66000/0xcc1762b626f8ca27 lrc: 0/0,0 mode: --/PR res: [0x2400090a5:0x3:0x0].0x0 bits 0x10/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c40e8 expref: 12 pid: 68287 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189318.331718:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x3:0x0].0x0 (ffff9dc0455f8800) 00010000:00010000:0.0:1784189318.331724:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784189318.333405:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc04a64d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:debedd94-805c-42a0-a5e5-41758b2012e9+11:2399:x1870854436328448:12345-192.168.203.12@tcp:103:ldlm_bl.0 Request processed in 1742us (9323us total) trans 0 rc 0/0 00000100:00100000:0.0:1784189318.333418:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 723 00000100:00100000:2.0:1784189318.352050:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1784189318.352153:0:26169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436328576 00000100:00100000:1.0:1784189318.352163:0:26169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436328576 00000100:00100000:1.0:1784189318.352226:0:26169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 4999 00000100:00100000:1.0:1784189318.352235:0:26169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc080f68a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:debedd94-805c-42a0-a5e5-41758b2012e9+6:2396:x1870854436328576:12345-192.168.203.12@tcp:101:bash.0 00010000:00010000:1.0:1784189318.352251:0:26169:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784189318.352270:0:26169:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000030c99bec/0xcc1762b626f8ca4a lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0x243:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xcbfc5de7fe6c40f6 expref: -99 pid: 26169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1784189318.352295:0:26169:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x243:0x0] initial LVB size: 0, mtime: 0x6a589157, atime: 0x6a589157, ctime: 0x6a589157, blocks: 0x0 00010000:00010000:1.0:1784189318.352314:0:26169:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x243:0x0].0x0 since=3560s v=(0 0) 00010000:00010000:1.0:1784189318.352354:0:26169:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x243:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784189318.352365:0:26169:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000030c99bec/0xcc1762b626f8ca4a lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x243:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c40f6 expref: 7 pid: 26169 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189318.352384:0:26169:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000030c99bec/0xcc1762b626f8ca4a lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x243:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c40f6 expref: 7 pid: 26169 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189318.352398:0:26169:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc042d66800, rc 0) 00000100:00100000:1.0:1784189318.352457:0:26169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc080f68a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:debedd94-805c-42a0-a5e5-41758b2012e9+7:2396:x1870854436328576:12345-192.168.203.12@tcp:101:bash.0 Request processed in 222us (416us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189318.352465:0:26169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 4999 00000100:00100000:3.0:1784189318.455439:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1784189318.455552:0:94309:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436328704 00000100:00100000:1.0:1784189318.455574:0:94309:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436328704 00000100:00100000:1.0:1784189318.455634:0:94309:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 77 00000100:00100000:1.0:1784189318.455644:0:94309:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc044987050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:60f345e3-c70e-4f53-b5e7-c9671463c9a5+10:2398:x1870854436328704:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:1.0:1784189318.455727:0:94309:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc044987050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:60f345e3-c70e-4f53-b5e7-c9671463c9a5+10:2398:x1870854436328704:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 84us (296us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189318.455735:0:94309:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 77 00010000:00010000:1.0:1784189318.895623:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784189319.919590:0:26173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784189320.240622:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1784189320.240645:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc080f68380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1870854458235904:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1784189320.240713:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784189320.241025:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458235904 00000100:00100000:1.0:1784189320.241034:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458235904 00000100:00100000:1.0:1784189320.241101:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2062 00000100:00100000:1.0:1784189320.241111:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc04a64e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1870854458235904:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1784189320.241140:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8618304 pending 0 free 3922481152 avail 3690958848 00000100:00100000:1.0:1784189320.241188:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc04a64e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1870854458235904:12345-0@lo:13:osp-pre-0-1.0 Request processed in 79us (474us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189320.241196:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2062 00000100:00100000:0.0:1784189320.241484:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1784189320.241498:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc05eda9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1870854458236032:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1784189320.241534:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784189320.242166:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458236032 00000100:00100000:1.0:1784189320.242172:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458236032 00000100:00100000:1.0:1784189320.242216:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2063 00000100:00100000:1.0:1784189320.242224:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc05ed9b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1870854458236032:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1784189320.242243:0:8432:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8646976 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1784189320.242294:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc05ed9b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1870854458236032:12345-0@lo:13:osp-pre-1-1.0 Request processed in 71us (758us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189320.242301:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2063 00000100:00080000:3.0:1784189320.242540:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1784189320.242545:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1784189320.242612:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc080f68380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1870854458235904:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1784189320.242784:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc05eda9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1870854458236032:0@lo:13:osp-pre-1-1.0 00010000:00010000:1.0:1784189320.943610:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784189321.968090:0:7454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784189322.801180:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc05edd0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3640:1870854458236544:0@lo:400:kworker.0 00000100:00100000:0.0:1784189322.801252:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784189322.801287:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc05edd2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1870854458237056:0@lo:400:kworker.0 00000100:00100000:0.0:1784189322.801314:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784189322.801357:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc0505be300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1870854458237568:0@lo:400:kworker.0 00000100:00100000:0.0:1784189322.801382:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784189322.801409:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [1->0] 00000100:00100000:0.0:1784189322.801414:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc05ed9a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bd553d0d-03e2-4233-b06b-b55bbfa2b954:3640:1870854458236160:0@lo:400:kworker.0 00000100:00100000:0.0:1784189322.801441:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784189322.801478:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc05edd2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3640:1870854458236672:0@lo:400:kworker.0 00000100:00100000:3.0:1784189322.801638:0:66169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458236544 00000100:00100000:3.0:1784189322.801645:0:66169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458236544 00000100:00100000:3.0:1784189322.801819:0:66169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1321 00000100:00100000:3.0:1784189322.801828:0:66169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc0505bce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3640:x1870854458236544:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784189322.801986:0:26165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458237056 00000100:00100000:1.0:1784189322.801990:0:26165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458237056 00000100:00100000:1.0:1784189322.802017:0:26165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458237568 00000100:00100000:1.0:1784189322.802032:0:26165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458237568 00000100:00100000:1.0:1784189322.802051:0:26165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2571 00000100:00100000:1.0:1784189322.802057:0:26165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf48598700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0001-mdtlov_UUID+5:3640:x1870854458237056:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784189322.805715:0:66169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc0505bce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3640:x1870854458236544:12345-0@lo:400:kworker.0 Request processed in 3879us (4454us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189322.805730:0:66169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1321 00000100:00100000:3.0:1784189322.805781:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc05edd3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3643:1870854458236416:0@lo:400:kworker.0 00000100:00100000:3.0:1784189322.805830:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784189322.805865:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc05edd0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1870854458236928:0@lo:400:kworker.0 00000100:00100000:3.0:1784189322.805890:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784189322.805917:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc0505be680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1870854458237440:0@lo:400:kworker.0 00000100:00100000:2.0:1784189322.805923:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458236928 00000100:00100000:2.0:1784189322.805932:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458236928 00000100:00100000:3.0:1784189322.805941:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784189322.805966:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [2->3] 00000100:00100000:3.0:1784189322.805973:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc05ed9aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3643:1870854458236288:0@lo:400:kworker.0 00000100:00100000:3.0:1784189322.806240:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784189322.806261:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc05edd1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1870854458236800:0@lo:400:kworker.0 00000100:00100000:3.0:1784189322.806285:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784189322.806302:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc0505bdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1870854458237312:0@lo:400:kworker.0 00000100:00100000:3.0:1784189322.806340:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784189322.806358:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc04a64f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1870854458237824:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1784189322.806378:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1784189322.806406:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1784189322.806411:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1784189322.806421:0:66945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458236416 00000100:00100000:3.0:1784189322.806425:0:66945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458236416 00000100:00100000:3.0:1784189322.806466:0:66945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458236288 00000100:00100000:3.0:1784189322.806469:0:66945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458236288 00000100:00100000:3.0:1784189322.806504:0:66945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1322 00000100:00100000:3.0:1784189322.806513:0:66945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc04a64ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1870854458236416:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784189322.806562:0:66945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc04a64ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1870854458236416:12345-0@lo:400:kworker.0 Request processed in 50us (732us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189322.806569:0:66945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1322 00000100:00100000:3.0:1784189322.806582:0:66945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1323 00000100:00100000:3.0:1784189322.806597:0:66945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc05eddea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1870854458236288:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784189322.806628:0:66945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc05eddea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1870854458236288:12345-0@lo:400:kworker.0 Request processed in 33us (388us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189322.806634:0:66945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1323 00000100:00100000:3.0:1784189322.806858:0:26171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458237440 00000100:00100000:3.0:1784189322.806862:0:26171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458237440 00000100:00100000:2.0:1784189322.807069:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2572 00000100:00100000:2.0:1784189322.807080:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf4859b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1870854458237568:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784189322.807122:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf4859b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1870854458237568:12345-0@lo:400:kworker.0 Request processed in 45us (5740us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189322.807129:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2572 00000100:00100000:2.0:1784189322.807144:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2573 00000100:00100000:3.0:1784189322.808406:0:26171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2574 00000100:00100000:3.0:1784189322.808416:0:26171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc04a64f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+5:3643:x1870854458237440:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784189322.808493:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc04a64ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1870854458236928:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784189322.808807:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784189322.808840:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc05edd2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3640:1870854458237184:0@lo:400:kworker.0 00000100:00100000:0.0:1784189322.808865:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784189322.808882:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc0505bfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3640:1870854458237696:0@lo:400:kworker.0 00000100:00100000:0.0:1784189322.808901:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784189322.808931:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc05edd0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3640:1870854458236544:0@lo:400:kworker.0 00000100:00100000:0.0:1784189322.808944:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc0505be300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1870854458237568:0@lo:400:kworker.0 00000100:00100000:0.0:1784189322.809129:0:94310:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458236160 00000100:00100000:0.0:1784189322.809136:0:94310:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458236160 00000100:00100000:0.0:1784189322.809170:0:94310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1784189322.809177:0:94310:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc044941450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd553d0d-03e2-4233-b06b-b55bbfa2b954+24:3640:x1870854458236160:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784189322.809233:0:94310:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc044941450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd553d0d-03e2-4233-b06b-b55bbfa2b954+24:3640:x1870854458236160:12345-0@lo:400:kworker.0 Request processed in 56us (7790us total) trans 0 rc 0/0 00000100:00100000:0.0:1784189322.809240:0:94310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1784189322.809284:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc05ed9a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bd553d0d-03e2-4233-b06b-b55bbfa2b954:3640:1870854458236160:0@lo:400:kworker.0 00000100:00100000:3.0:1784189322.809394:0:26171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc04a64f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+5:3643:x1870854458237440:12345-0@lo:400:kworker.0 Request processed in 979us (3451us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189322.809401:0:26171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2574 00000100:00100000:3.0:1784189322.809423:0:66170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458236672 00000100:00100000:3.0:1784189322.809427:0:66170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458236672 00000100:00100000:3.0:1784189322.809451:0:66170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458237184 00000100:00100000:3.0:1784189322.809453:0:66170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458237184 00000100:00100000:3.0:1784189322.809462:0:66170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458237696 00000100:00100000:3.0:1784189322.809464:0:66170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458237696 00000100:00100000:3.0:1784189322.809476:0:66170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1324 00000100:00100000:3.0:1784189322.809482:0:66170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf4859a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1870854458236672:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784189322.809587:0:66170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf4859a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1870854458236672:12345-0@lo:400:kworker.0 Request processed in 104us (780us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189322.809593:0:66170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1324 00000100:00100000:3.0:1784189322.809605:0:66170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1325 00000100:00100000:3.0:1784189322.809611:0:66170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf48598a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1870854458237184:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784189322.809635:0:66170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf48598a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1870854458237184:12345-0@lo:400:kworker.0 Request processed in 25us (769us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189322.809640:0:66170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1325 00000100:00100000:0.0:1784189322.810628:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc05edd2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3640:1870854458236672:0@lo:400:kworker.0 00000100:00100000:0.0:1784189322.810643:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc05edd2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3640:1870854458237184:0@lo:400:kworker.0 00000100:00100000:3.0:1784189322.811137:0:66170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1326 00000100:00100000:3.0:1784189322.811152:0:66170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf4859b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1870854458237696:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784189322.811215:0:66170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf4859b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1870854458237696:12345-0@lo:400:kworker.0 Request processed in 70us (2313us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189322.811222:0:66170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1326 00000100:00100000:3.0:1784189322.811259:0:23826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458236800 00000100:00100000:3.0:1784189322.811266:0:23826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458236800 00000100:00100000:3.0:1784189322.811304:0:23826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458237312 00000100:00100000:3.0:1784189322.811307:0:23826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458237312 00000100:00100000:3.0:1784189322.811335:0:23826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458237824 00000100:00100000:3.0:1784189322.811339:0:23826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458237824 00000100:00100000:3.0:1784189322.811354:0:23826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3940 00000100:00100000:3.0:1784189322.811360:0:23826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc05eddc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:3643:x1870854458236800:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784189322.811446:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc0505bfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3640:1870854458237696:0@lo:400:kworker.0 00000100:00100000:1.0:1784189322.811850:0:26165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf48598700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0001-mdtlov_UUID+5:3640:x1870854458237056:12345-0@lo:400:kworker.0 Request processed in 9791us (10533us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189322.811860:0:26165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2571 00000100:00100000:0.0:1784189322.812184:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc05edd2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1870854458237056:0@lo:400:kworker.0 00000100:00100000:2.0:1784189322.814223:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc04a64ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1870854458236928:12345-0@lo:400:kworker.0 Request processed in 7064us (8322us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189322.814237:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2573 00000100:00100000:3.0:1784189322.815766:0:23826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc05eddc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:3643:x1870854458236800:12345-0@lo:400:kworker.0 Request processed in 4290us (9364us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189322.815780:0:23826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3940 00000100:00100000:3.0:1784189322.815813:0:23826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3941 00000100:00100000:3.0:1784189322.815825:0:23826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc05eddf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3643:x1870854458237312:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784189322.815888:0:23826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc05eddf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3643:x1870854458237312:12345-0@lo:400:kworker.0 Request processed in 69us (9548us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189322.815894:0:23826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3941 00000100:00100000:3.0:1784189322.815903:0:23826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3942 00000100:00100000:3.0:1784189322.815909:0:23826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc05eddd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3643:x1870854458237824:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1784189322.815933:0:23826:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445228544 avail 1298989056 00000100:00100000:3.0:1784189322.815959:0:23826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc05eddd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3643:x1870854458237824:12345-0@lo:41:osp-pre-0-1.0 Request processed in 51us (9580us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189322.815964:0:23826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3942 00000100:00080000:3.0:1784189322.817441:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1784189322.817450:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1784189322.817452:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1784189322.817481:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc05eddc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1870854458237952:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1784189322.818182:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784189322.818285:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc05ed9aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3643:1870854458236288:0@lo:400:kworker.0 00000100:00100000:3.0:1784189322.818299:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc05edd1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1870854458236800:0@lo:400:kworker.0 00000100:00100000:3.0:1784189322.818309:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc0505bdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1870854458237312:0@lo:400:kworker.0 00000100:00100000:3.0:1784189322.818359:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc04a64f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1870854458237824:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1784189322.818374:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc05edd3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3643:1870854458236416:0@lo:400:kworker.0 00000100:00100000:3.0:1784189322.818384:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc05edd0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1870854458236928:0@lo:400:kworker.0 00000100:00100000:3.0:1784189322.818395:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc0505be680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1870854458237440:0@lo:400:kworker.0 00000100:00100000:1.0:1784189322.819920:0:23826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458237952 00000100:00100000:1.0:1784189322.819931:0:23826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458237952 00000100:00100000:1.0:1784189322.820010:0:23826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3943 00000100:00100000:1.0:1784189322.820020:0:23826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc05eddce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3643:x1870854458237952:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1784189322.820056:0:23826:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445568512 avail 1299329024 00000100:00100000:1.0:1784189322.820267:0:23826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc05eddce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3643:x1870854458237952:12345-0@lo:41:osp-pre-1-0.0 Request processed in 249us (2085us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189322.820276:0:23826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3943 00000100:00100000:3.0:1784189322.821287:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc05eddc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1870854458237952:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1784189322.991921:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784189323.311784:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf48598380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1870854458238080:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1784189323.311868:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784189323.313357:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458238080 00000100:00100000:0.0:1784189323.313368:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458238080 00000100:00100000:0.0:1784189323.313420:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2064 00000100:00100000:0.0:1784189323.313428:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc05eddc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1870854458238080:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1784189323.313457:0:8432:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8646976 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1784189323.313518:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc05eddc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1870854458238080:12345-0@lo:13:osp-pre-1-0.0 Request processed in 91us (1650us total) trans 0 rc 0/0 00000100:00100000:0.0:1784189323.313525:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2064 00000100:00100000:0.0:1784189323.314122:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc05eda8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1870854458238208:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1784189323.314169:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784189323.314293:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458238208 00000100:00100000:1.0:1784189323.314298:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458238208 00000100:00100000:1.0:1784189323.314343:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2065 00000100:00100000:1.0:1784189323.314350:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf48599880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1870854458238208:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1784189323.314368:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8618304 pending 0 free 3922481152 avail 3690958848 00000100:00100000:1.0:1784189323.314400:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf48599880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1870854458238208:12345-0@lo:13:osp-pre-0-0.0 Request processed in 51us (231us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189323.314406:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2065 00000100:00100000:0.0:1784189323.314515:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc05eda8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1870854458238208:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1784189323.316086:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf48598380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1870854458238080:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1784189323.559375:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1784189323.560401:0:94309:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436328832 00000100:00100000:1.0:1784189323.560414:0:94309:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436328832 00000100:00100000:1.0:1784189323.560471:0:94309:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 79 00000100:00100000:1.0:1784189323.560482:0:94309:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc044943c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:60f345e3-c70e-4f53-b5e7-c9671463c9a5+10:2397:x1870854436328832:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:1.0:1784189323.560566:0:94309:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc044943c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:60f345e3-c70e-4f53-b5e7-c9671463c9a5+10:2397:x1870854436328832:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 86us (1200us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189323.560575:0:94309:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 79 00000100:00100000:2.0:1784189323.573014:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1784189323.575260:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1784189323.575290:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1784189323.578689:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1784189323.578746:0:26163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436329216 00000100:00100000:2.0:1784189323.578755:0:26163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436329216 00000100:00100000:1.0:1784189323.578826:0:66170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436328960 00000100:00100000:1.0:1784189323.578832:0:66170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436328960 00000100:00100000:1.0:1784189323.578875:0:66170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436329088 00000100:00100000:1.0:1784189323.578878:0:66170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436329088 00000100:00100000:1.0:1784189323.578903:0:66170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1327 00000100:00100000:1.0:1784189323.578912:0:66170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc080f69880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:debedd94-805c-42a0-a5e5-41758b2012e9+10:2396:x1870854436328960:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:1.0:1784189323.578996:0:66170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc080f69880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:debedd94-805c-42a0-a5e5-41758b2012e9+10:2396:x1870854436328960:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 84us (5991us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189323.579015:0:66170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1327 00000100:00100000:1.0:1784189323.579034:0:66170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1328 00000100:00100000:1.0:1784189323.579040:0:66170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc080f69f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:debedd94-805c-42a0-a5e5-41758b2012e9+11:2396:x1870854436329088:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:1.0:1784189323.579067:0:66170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc080f69f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:debedd94-805c-42a0-a5e5-41758b2012e9+11:2396:x1870854436329088:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 27us (3776us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189323.579073:0:66170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1328 00000100:00080000:3.0:1784189323.580720:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1784189323.580728:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1784189323.580731:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1784189323.580749:0:14684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436329344 00000100:00100000:3.0:1784189323.580757:0:14684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436329344 00000100:00100000:2.0:1784189323.580899:0:26163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 2575 00000100:00100000:2.0:1784189323.580913:0:26163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc080f6b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:debedd94-805c-42a0-a5e5-41758b2012e9+5:2396:x1870854436329216:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:2.0:1784189323.581002:0:26163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc080f6b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:debedd94-805c-42a0-a5e5-41758b2012e9+5:2396:x1870854436329216:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 92us (5750us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189323.581011:0:26163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 2575 00000100:00100000:2.0:1784189323.581027:0:26163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 2576 00000100:00100000:2.0:1784189323.581034:0:26163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc080f6b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:debedd94-805c-42a0-a5e5-41758b2012e9+7:2396:x1870854436329344:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:2.0:1784189323.581070:0:26163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc080f6b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:debedd94-805c-42a0-a5e5-41758b2012e9+7:2396:x1870854436329344:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 36us (2390us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189323.581077:0:26163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 2576 00000100:00080000:3.0:1784189323.581459:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1784189324.017015:0:26173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784189325.039688:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784189325.364701:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc080f69c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1870854458238336:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1784189325.364814:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784189325.364899:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1784189325.364906:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc05eda8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1870854458238464:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1784189325.364930:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784189325.367171:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458238336 00000100:00100000:1.0:1784189325.367192:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458238336 00000100:00100000:1.0:1784189325.367299:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458238464 00000100:00100000:1.0:1784189325.368106:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458238464 00000100:00100000:1.0:1784189325.368161:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2066 00000100:00100000:1.0:1784189325.368176:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc05edddc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1870854458238336:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1784189325.368222:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8618304 pending 0 free 3922481152 avail 3690958848 00000100:00100000:1.0:1784189325.368404:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc05edddc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1870854458238336:12345-0@lo:13:osp-pre-0-1.0 Request processed in 233us (3589us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189325.368426:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2066 00000100:00100000:1.0:1784189325.368448:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2067 00000100:00100000:1.0:1784189325.368455:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc05edded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1870854458238464:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1784189325.368472:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8646976 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1784189325.368505:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc05edded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1870854458238464:12345-0@lo:13:osp-pre-1-1.0 Request processed in 51us (3574us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189325.368511:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2067 00000100:00080000:3.0:1784189325.368638:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1784189325.368644:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1784189325.377013:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc05eda8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1870854458238464:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1784189325.377041:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc080f69c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1870854458238336:0@lo:13:osp-pre-0-1.0 00000020:00000080:0.0:1784189325.769187:0:95226:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866bc len=0 uarg=00007ffddcb82840 20000000:00000080:0.0:1784189325.769209:0:95226:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866bc len=576 karg=ffff9dc047a9c000 uarg=0000000000000000 00000040:00100000:0.0:1784189325.769825:0:95226:0:(llog.c:1072:llog_reverse_process()) index 57 : idx 49 20000000:01000000:0.0:1784189325.769834:0:95226:0:(mgs_llog.c:963:mgs_search_pool_cb()) Matched pool rec 56 cmd:0xce021 lustre.pool_134 lustre-OST0001_UUID 20000000:01000000:0.0:1784189325.769867:0:95226:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre-clilov/add lustre.pool_134.lustre-OST0001_UUID fl=4 20000000:01000000:0.0:1784189325.771065:0:95227:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 55 marker 45 1->4: lustre-clilov add lustre.pool_134.lustre-OST0001_UUID 20000000:01000000:0.0:1784189325.771303:0:95227:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 57 marker 45 2->4: lustre-clilov add lustre.pool_134.lustre-OST0001_UUID 00000040:00080000:0.0:1784189325.771442:0:95227:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 58 count 57 00000040:00080000:1.0:1784189325.771898:0:95226:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].58, 224 off18320 20000000:01000000:1.0:1784189325.771916:0:95226:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xce022 lustre pool_134 lustre-OST0001_UUID (null) 00000040:00080000:1.0:1784189325.771934:0:95226:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].59, 136 off18456 00000040:00080000:1.0:1784189325.771962:0:95226:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].60, 224 off18680 20000000:01000000:1.0:1784189325.771984:0:95226:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre-MDT0000-mdtlov/add lustre.pool_134.lustre-OST0001_UUID fl=4 20000000:01000000:3.0:1784189325.773504:0:95228:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 50 marker 46 1->4: lustre-MDT0000-mdtlov add lustre.pool_134.lustre-OST0001_UUID 20000000:01000000:3.0:1784189325.773591:0:95228:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 52 marker 46 2->4: lustre-MDT0000-mdtlov add lustre.pool_134.lustre-OST0001_UUID 00000040:00080000:3.0:1784189325.773606:0:95228:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 53 count 52 00000040:00080000:1.0:1784189325.774063:0:95226:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].53, 224 off17424 20000000:01000000:1.0:1784189325.774078:0:95226:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xce022 lustre pool_134 lustre-OST0001_UUID (null) 00000040:00080000:1.0:1784189325.774094:0:95226:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].54, 144 off17568 00000040:00080000:1.0:1784189325.774107:0:95226:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].55, 224 off17792 20000000:01000000:1.0:1784189325.774120:0:95226:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0001/lustre-MDT0001-mdtlov/add lustre.pool_134.lustre-OST0001_UUID fl=4 20000000:01000000:1.0:1784189325.780439:0:95229:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 50 marker 47 1->4: lustre-MDT0001-mdtlov add lustre.pool_134.lustre-OST0001_UUID 20000000:01000000:1.0:1784189325.780548:0:95229:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 52 marker 47 2->4: lustre-MDT0001-mdtlov add lustre.pool_134.lustre-OST0001_UUID 00000040:00080000:1.0:1784189325.780563:0:95229:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 53 count 52 00000040:00080000:0.0:1784189325.780988:0:95226:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].53, 224 off17424 20000000:01000000:0.0:1784189325.781009:0:95226:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xce022 lustre pool_134 lustre-OST0001_UUID (null) 00000040:00080000:0.0:1784189325.781027:0:95226:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].54, 144 off17568 00000040:00080000:0.0:1784189325.781052:0:95226:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].55, 224 off17792 10000000:01000000:0.0:1784189325.781095:0:95226:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:0.0:1784189325.781135:0:95226:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9dc081b16400/0xcc1762b626f8ca51 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 95226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189325.781164:0:95226:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9dc04a20b000/0xcc1762b626f8c596 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcc1762b626f8c58f expref: 23 pid: 94308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189325.781174:0:95226:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9dc04a20b200/0xcc1762b626f8c676 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcc1762b626f8c66f expref: 23 pid: 94308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189325.781183:0:95226:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9dc05ec0e400/0xcc1762b626f8c6a7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcc1762b626f8c6a0 expref: 23 pid: 94314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189325.781190:0:95226:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9dc05ec0f600/0xcc1762b626f8c6c3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcc1762b626f8c6bc expref: 23 pid: 94310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189325.781199:0:95226:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9dc058f66800/0xcc1762b626f8c6ed lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcc1762b626f8c6e6 expref: 23 pid: 94310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189325.781488:0:95226:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9dc058f66a00/0xcc1762b626f8c6fb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcc1762b626f8c6f4 expref: 23 pid: 94314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189325.781498:0:95226:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9dbf4710f400/0xcc1762b626f8c717 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcc1762b626f8c710 expref: 23 pid: 94309 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189325.781524:0:95226:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9dbf4710e600/0xcc1762b626f8c725 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcc1762b626f8c71e expref: 23 pid: 94310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189325.781532:0:95226:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9dbf4710fc00/0xcc1762b626f8c74f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcc1762b626f8c748 expref: 23 pid: 94309 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189325.781543:0:95226:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9dc058f67600/0xcc1762b626f8c764 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c40a2 expref: 9 pid: 94314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189325.781552:0:95226:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9dbf4710f200/0xcc1762b626f8c772 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c40b0 expref: 9 pid: 94310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189325.781561:0:95226:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9dc081b16400/0xcc1762b626f8ca51 lrc: 14/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 95226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189325.781616:0:95226:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9dbf4710f200/0xcc1762b626f8c772 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c40b0 expref: 9 pid: 94310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189325.781698:0:95226:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9dbf4710f200/0xcc1762b626f8c772 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c40b0 expref: 9 pid: 94310 timeout: 3668 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784189325.781723:0:95226:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf48598e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:95226:1870854458238592:192.168.203.12@tcp:104: 00010000:00010000:0.0:1784189325.781924:0:95226:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9dc058f67600/0xcc1762b626f8c764 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c40a2 expref: 9 pid: 94314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189325.781944:0:95226:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9dc058f67600/0xcc1762b626f8c764 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c40a2 expref: 9 pid: 94314 timeout: 3668 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784189325.781963:0:95226:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf48598000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:95226:1870854458238720:192.168.203.12@tcp:104: 00010000:00010000:0.0:1784189325.782010:0:95226:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9dbf4710fc00/0xcc1762b626f8c74f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcc1762b626f8c748 expref: 23 pid: 94309 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189325.782019:0:95226:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9dbf4710fc00/0xcc1762b626f8c74f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcc1762b626f8c748 expref: 23 pid: 94309 timeout: 3668 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784189325.782030:0:95226:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf48599500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:95226:1870854458238848:0@lo:104: 00000100:00100000:0.0:1784189325.782082:0:95226:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1784189325.782169:0:95226:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9dbf4710e600/0xcc1762b626f8c725 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcc1762b626f8c71e expref: 23 pid: 94310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189325.782178:0:95226:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9dbf4710e600/0xcc1762b626f8c725 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcc1762b626f8c71e expref: 23 pid: 94310 timeout: 3668 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784189325.782186:0:95226:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf4859b480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:95226:1870854458238976:0@lo:104: 00000100:00100000:0.0:1784189325.782276:0:95226:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1784189325.789217:0:95226:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9dbf4710f400/0xcc1762b626f8c717 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcc1762b626f8c710 expref: 23 pid: 94309 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189325.789243:0:95226:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9dbf4710f400/0xcc1762b626f8c717 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcc1762b626f8c710 expref: 23 pid: 94309 timeout: 3668 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784189325.789261:0:95226:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf4859bb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:95226:1870854458239104:0@lo:104: 00000100:00100000:0.0:1784189325.789368:0:95226:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784189325.790861:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1784189325.790890:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1784189325.790919:0:7455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436329472 00000100:00100000:1.0:1784189325.790929:0:7455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436329472 00010000:00010000:1.0:1784189325.790992:0:7455:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9dbf4710f200/0xcc1762b626f8c772 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c40b0 expref: 10 pid: 94310 timeout: 3668 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784189325.791068:0:7455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436329600 00000100:00100000:1.0:1784189325.791072:0:7455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436329600 00010000:00010000:1.0:1784189325.791087:0:7455:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9dc058f67600/0xcc1762b626f8c764 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c40a2 expref: 11 pid: 94314 timeout: 3668 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784189325.791114:0:7455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 2580 00000100:00100000:1.0:1784189325.791133:0:7455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc05eda9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:60f345e3-c70e-4f53-b5e7-c9671463c9a5+11:2396:x1870854436329472:12345-192.168.203.12@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1784189325.791153:0:7455:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784189325.791160:0:7455:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9dbf4710f200/0xcc1762b626f8c772 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c40b0 expref: 11 pid: 94310 timeout: 3668 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189325.791175:0:7455:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9dbf4710f200/0xcc1762b626f8c772 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c40b0 expref: 11 pid: 94310 timeout: 3668 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189325.791201:0:7455:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784189325.791276:0:7455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc05eda9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:60f345e3-c70e-4f53-b5e7-c9671463c9a5+11:2396:x1870854436329472:12345-192.168.203.12@tcp:103:ldlm_bl.0 Request processed in 153us (425us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189325.791285:0:7455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 2580 00000100:00100000:1.0:1784189325.791307:0:7455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 2581 00000100:00100000:1.0:1784189325.791314:0:7455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc05eda8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:60f345e3-c70e-4f53-b5e7-c9671463c9a5+10:2396:x1870854436329600:12345-192.168.203.12@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1784189325.791358:0:7455:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784189325.791364:0:7455:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9dc058f67600/0xcc1762b626f8c764 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c40a2 expref: 10 pid: 94314 timeout: 3668 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189325.791373:0:7455:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9dc058f67600/0xcc1762b626f8c764 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c40a2 expref: 10 pid: 94314 timeout: 3668 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189325.791394:0:7455:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784189325.791416:0:7455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc05eda8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:60f345e3-c70e-4f53-b5e7-c9671463c9a5+10:2396:x1870854436329600:12345-192.168.203.12@tcp:103:ldlm_bl.0 Request processed in 102us (525us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189325.791422:0:7455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 2581 00000100:00100000:3.0:1784189325.791897:0:49501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458238848 00000100:00100000:3.0:1784189325.791904:0:49501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458238848 00000100:00100000:3.0:1784189325.791965:0:49501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458238976 00000100:00100000:3.0:1784189325.791969:0:49501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458238976 00000100:00100000:3.0:1784189325.791987:0:49501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 337 00000100:00100000:3.0:1784189325.791995:0:49501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf4859a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:bd553d0d-03e2-4233-b06b-b55bbfa2b954+4:95226:x1870854458238848:12345-0@lo:104: 00010000:00010000:3.0:1784189325.792009:0:49501:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.112@tcp lock: ffff9dc04a20aa00/0xcc1762b626f8c748 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xcc1762b626f8c74f expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189325.792183:0:49501:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1784189325.792190:0:49501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf4859a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:bd553d0d-03e2-4233-b06b-b55bbfa2b954+4:95226:x1870854458238848:12345-0@lo:104: Request processed in 196us (10109us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189325.792197:0:49501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 337 00000100:00100000:3.0:1784189325.792225:0:49501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 338 00000100:00100000:3.0:1784189325.792232:0:49501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf4859ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:bd553d0d-03e2-4233-b06b-b55bbfa2b954+3:95226:x1870854458238976:12345-0@lo:104: 00010000:00010000:3.0:1784189325.792241:0:49501:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.112@tcp lock: ffff9dc05ec0fa00/0xcc1762b626f8c71e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xcc1762b626f8c725 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189325.792280:0:49501:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1784189325.792296:0:49501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf4859ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:bd553d0d-03e2-4233-b06b-b55bbfa2b954+3:95226:x1870854458238976:12345-0@lo:104: Request processed in 65us (10020us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189325.792302:0:49501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 338 00010000:00010000:3.0:1784189325.792375:0:7454:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1784189325.792383:0:7454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.112@tcp lock: ffff9dc04a20aa00/0xcc1762b626f8c748 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xcc1762b626f8c74f expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189325.792392:0:7454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc04a20aa00 already unused, calling callback (ffffffffc114ac20) 10000000:00010000:3.0:1784189325.792397:0:7454:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.112@tcp lock: ffff9dc04a20aa00/0xcc1762b626f8c748 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400400000000 nid: local remote: 0xcc1762b626f8c74f expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189325.792406:0:7454:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.112@tcp lock: ffff9dc04a20aa00/0xcc1762b626f8c748 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1408400000000 nid: local remote: 0xcc1762b626f8c74f expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1784189325.792414:0:7454:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.112@tcp lock: ffff9dc04a20aa00/0xcc1762b626f8c748 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1409400000000 nid: local remote: 0xcc1762b626f8c74f expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784189325.792421:0:7454:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1784189325.792466:0:7454:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.112@tcp lock: ffff9dc04a20aa00/0xcc1762b626f8c748 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcc1762b626f8c74f expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189325.792473:0:7454:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1784189325.792501:0:7454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.112@tcp lock: ffff9dc04a20aa00/0xcc1762b626f8c748 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcc1762b626f8c74f expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189325.792509:0:7454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.112@tcp lock: ffff9dc04a20aa00/0xcc1762b626f8c748 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcc1762b626f8c74f expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189325.792525:0:7454:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784189325.792528:0:7454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.112@tcp lock: ffff9dc05ec0fa00/0xcc1762b626f8c71e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400000000000 nid: local remote: 0xcc1762b626f8c725 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189325.792547:0:7454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc05ec0fa00 already unused, calling callback (ffffffffc114ac20) 10000000:00010000:3.0:1784189325.792551:0:7454:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.112@tcp lock: ffff9dc05ec0fa00/0xcc1762b626f8c71e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400400000000 nid: local remote: 0xcc1762b626f8c725 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189325.792558:0:7454:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.112@tcp lock: ffff9dc05ec0fa00/0xcc1762b626f8c71e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1408400000000 nid: local remote: 0xcc1762b626f8c725 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1784189325.792566:0:7454:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.112@tcp lock: ffff9dc05ec0fa00/0xcc1762b626f8c71e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1409400000000 nid: local remote: 0xcc1762b626f8c725 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784189325.792571:0:7454:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1784189325.792591:0:7454:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.112@tcp lock: ffff9dc05ec0fa00/0xcc1762b626f8c71e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcc1762b626f8c725 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189325.792597:0:7454:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1784189325.792605:0:7454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.112@tcp lock: ffff9dc05ec0fa00/0xcc1762b626f8c71e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcc1762b626f8c725 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189325.792611:0:7454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.112@tcp lock: ffff9dc05ec0fa00/0xcc1762b626f8c71e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcc1762b626f8c725 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189325.792620:0:7454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784189325.792622:0:7454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784189325.792624:0:7454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784189325.792631:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784189325.792783:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc04a64f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bd553d0d-03e2-4233-b06b-b55bbfa2b954:3640:1870854458239232:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1784189325.792830:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1784189325.792985:0:95226:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9dc058f66a00/0xcc1762b626f8c6fb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcc1762b626f8c6f4 expref: 23 pid: 94314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189325.793000:0:95226:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9dc058f66a00/0xcc1762b626f8c6fb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcc1762b626f8c6f4 expref: 23 pid: 94314 timeout: 3668 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784189325.793029:0:95226:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf48599c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:95226:1870854458239488:0@lo:104: 00000100:00100000:0.0:1784189325.793069:0:95226:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1784189325.793089:0:95226:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9dc058f66800/0xcc1762b626f8c6ed lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcc1762b626f8c6e6 expref: 23 pid: 94310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189325.793097:0:95226:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9dc058f66800/0xcc1762b626f8c6ed lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcc1762b626f8c6e6 expref: 23 pid: 94310 timeout: 3668 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784189325.793106:0:95226:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf48598380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:95226:1870854458239616:0@lo:104: 00000100:00100000:3.0:1784189325.793348:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1784189325.793356:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf46902300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bd553d0d-03e2-4233-b06b-b55bbfa2b954:3640:1870854458239360:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1784189325.793388:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784189325.793431:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458239232 00000100:00100000:3.0:1784189325.793437:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458239232 00010000:00010000:3.0:1784189325.793465:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9dbf4710fc00/0xcc1762b626f8c74f lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcc1762b626f8c748 expref: 24 pid: 94309 timeout: 3668 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784189325.793488:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458239360 00000100:00100000:3.0:1784189325.793490:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458239360 00010000:00010000:3.0:1784189325.793501:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9dbf4710e600/0xcc1762b626f8c725 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcc1762b626f8c71e expref: 25 pid: 94310 timeout: 3668 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784189325.793516:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2582 00000100:00100000:3.0:1784189325.793524:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf46902680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bd553d0d-03e2-4233-b06b-b55bbfa2b954+25:3640:x1870854458239232:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1784189325.793536:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784189325.793541:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9dbf4710fc00/0xcc1762b626f8c74f lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcc1762b626f8c748 expref: 25 pid: 94309 timeout: 3668 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189325.793552:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9dbf4710fc00/0xcc1762b626f8c74f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcc1762b626f8c748 expref: 25 pid: 94309 timeout: 3668 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189325.793570:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784189325.793601:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf46902680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bd553d0d-03e2-4233-b06b-b55bbfa2b954+25:3640:x1870854458239232:12345-0@lo:103:ldlm_bl.0 Request processed in 77us (770us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189325.793608:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2582 00000100:00100000:3.0:1784189325.793622:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2583 00000100:00100000:3.0:1784189325.793628:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf46903480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bd553d0d-03e2-4233-b06b-b55bbfa2b954+24:3640:x1870854458239360:12345-0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1784189325.793731:0:95226:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1784189325.793761:0:95226:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9dc05ec0f600/0xcc1762b626f8c6c3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcc1762b626f8c6bc expref: 24 pid: 94310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189325.793771:0:95226:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9dc05ec0f600/0xcc1762b626f8c6c3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcc1762b626f8c6bc expref: 24 pid: 94310 timeout: 3668 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784189325.793780:0:95226:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc05ed9a680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:95226:1870854458239744:0@lo:104: 00000100:00100000:0.0:1784189325.793811:0:95226:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1784189325.793828:0:95226:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9dc05ec0e400/0xcc1762b626f8c6a7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcc1762b626f8c6a0 expref: 24 pid: 94314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189325.793836:0:95226:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9dc05ec0e400/0xcc1762b626f8c6a7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcc1762b626f8c6a0 expref: 24 pid: 94314 timeout: 3668 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784189325.793843:0:95226:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc0505be680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:95226:1870854458239872:0@lo:104: 00010000:00010000:0.0:1784189325.793868:0:95226:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9dc04a20b200/0xcc1762b626f8c676 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcc1762b626f8c66f expref: 24 pid: 94308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189325.793888:0:95226:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9dc04a20b200/0xcc1762b626f8c676 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcc1762b626f8c66f expref: 24 pid: 94308 timeout: 3668 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784189325.793897:0:95226:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc0505bdf80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:95226:1870854458240000:0@lo:104: 00010000:00010000:0.0:1784189325.793925:0:95226:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9dc04a20b000/0xcc1762b626f8c596 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcc1762b626f8c58f expref: 24 pid: 94308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189325.793933:0:95226:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9dc04a20b000/0xcc1762b626f8c596 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcc1762b626f8c58f expref: 24 pid: 94308 timeout: 3668 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784189325.793942:0:95226:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc0505bfb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:95226:1870854458240128:0@lo:104: 00000100:00100000:0.0:1784189325.793971:0:95226:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dc074a760c0 going to sleep for 11 seconds 00010000:00010000:0.0:1784189325.794002:0:95226:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dbf4710f200/0xcc1762b626f8c772 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801400000020 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c40b0 expref: 9 pid: 94310 timeout: 3668 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784189325.794031:0:95226:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf48598e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:95226:1870854458238592:192.168.203.12@tcp:104: 00010000:00010000:0.0:1784189325.794055:0:95226:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dc058f67600/0xcc1762b626f8c764 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801400000020 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c40a2 expref: 8 pid: 94314 timeout: 3668 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784189325.794065:0:95226:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf48598000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:95226:1870854458238720:192.168.203.12@tcp:104: 00010000:00010000:0.0:1784189325.794076:0:95226:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dbf4710fc00/0xcc1762b626f8c74f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcc1762b626f8c748 expref: 24 pid: 94309 timeout: 3668 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784189325.794084:0:95226:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf48599500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:95226:1870854458238848:0@lo:104: 00000100:00100000:0.0:1784189325.794094:0:95226:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf4859b480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:95226:1870854458238976:0@lo:104: 00000100:00100000:1.0:1784189325.794378:0:6497:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1784189325.794400:0:6497:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784189325.794415:0:6497:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784189325.794426:0:6497:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784189325.794434:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458239104 00000100:00100000:1.0:1784189325.794439:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458239104 00000100:00100000:1.0:1784189325.794467:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458239488 00000100:00100000:1.0:1784189325.794470:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458239488 00000100:00100000:1.0:1784189325.794481:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458239616 00000100:00100000:1.0:1784189325.794483:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458239616 00000100:00100000:1.0:1784189325.794493:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458239744 00000100:00100000:1.0:1784189325.794495:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458239744 00000100:00100000:1.0:1784189325.794505:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458239872 00000100:00100000:1.0:1784189325.794507:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458239872 00000100:00100000:1.0:1784189325.794517:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458240000 00000100:00100000:1.0:1784189325.794520:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458240000 00000100:00100000:1.0:1784189325.794529:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458240128 00000100:00100000:1.0:1784189325.794532:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458240128 00000100:00100000:1.0:1784189325.794543:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 339 00000100:00100000:1.0:1784189325.794551:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf48599f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:bd553d0d-03e2-4233-b06b-b55bbfa2b954+9:95226:x1870854458239104:12345-0@lo:104: 00010000:00010000:1.0:1784189325.794565:0:6497:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.112@tcp lock: ffff9dc05ec0ea00/0xcc1762b626f8c710 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xcc1762b626f8c717 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189325.794703:0:6497:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1784189325.794710:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf48599f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:bd553d0d-03e2-4233-b06b-b55bbfa2b954+9:95226:x1870854458239104:12345-0@lo:104: Request processed in 161us (5343us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189325.794732:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 339 00000100:00100000:1.0:1784189325.794750:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 340 00000100:00100000:1.0:1784189325.794756:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf4859aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:bd553d0d-03e2-4233-b06b-b55bbfa2b954+8:95226:x1870854458239488:12345-0@lo:104: 00010000:00010000:1.0:1784189325.794764:0:6497:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.112@tcp lock: ffff9dbf4710ee00/0xcc1762b626f8c6f4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xcc1762b626f8c6fb expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189325.794802:0:6497:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1784189325.794807:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf4859aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:bd553d0d-03e2-4233-b06b-b55bbfa2b954+8:95226:x1870854458239488:12345-0@lo:104: Request processed in 52us (1738us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189325.794813:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 340 00000100:00100000:1.0:1784189325.794825:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 341 00000100:00100000:1.0:1784189325.794831:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc05ed9aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:bd553d0d-03e2-4233-b06b-b55bbfa2b954+7:95226:x1870854458239616:12345-0@lo:104: 00010000:00010000:1.0:1784189325.794839:0:6497:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.112@tcp lock: ffff9dc04a20a400/0xcc1762b626f8c6e6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xcc1762b626f8c6ed expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189325.794876:0:6497:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1784189325.794880:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc05ed9aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:bd553d0d-03e2-4233-b06b-b55bbfa2b954+7:95226:x1870854458239616:12345-0@lo:104: Request processed in 50us (1754us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189325.794885:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 341 00000100:00100000:1.0:1784189325.794896:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 342 00000100:00100000:1.0:1784189325.794901:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc0477da850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:bd553d0d-03e2-4233-b06b-b55bbfa2b954+6:95226:x1870854458239744:12345-0@lo:104: 00010000:00010000:1.0:1784189325.794908:0:6497:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.112@tcp lock: ffff9dc04a20ac00/0xcc1762b626f8c6bc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xcc1762b626f8c6c3 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189325.794936:0:6497:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:1.0:1784189325.794941:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc0477da850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:bd553d0d-03e2-4233-b06b-b55bbfa2b954+6:95226:x1870854458239744:12345-0@lo:104: Request processed in 41us (1131us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189325.794964:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 342 00000100:00100000:1.0:1784189325.795014:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 343 00000100:00100000:1.0:1784189325.795020:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc05ed90000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:bd553d0d-03e2-4233-b06b-b55bbfa2b954+5:95226:x1870854458239872:12345-0@lo:104: 00010000:00010000:1.0:1784189325.795028:0:6497:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.112@tcp lock: ffff9dbf4710f600/0xcc1762b626f8c6a0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xcc1762b626f8c6a7 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784189325.795310:0:95226:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf4859bb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:95226:1870854458239104:0@lo:104: 00000100:00100000:0.0:1784189325.795347:0:95226:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf48599c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:95226:1870854458239488:0@lo:104: 00000100:00100000:0.0:1784189325.795355:0:95226:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf48598380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:95226:1870854458239616:0@lo:104: 00000100:00100000:0.0:1784189325.795361:0:95226:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc05ed9a680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:95226:1870854458239744:0@lo:104: 00010000:00010000:3.0:1784189325.795520:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784189325.795531:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9dbf4710e600/0xcc1762b626f8c725 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcc1762b626f8c71e expref: 23 pid: 94310 timeout: 3668 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189325.795555:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9dbf4710e600/0xcc1762b626f8c725 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcc1762b626f8c71e expref: 23 pid: 94310 timeout: 3668 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189325.795572:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dbf4710e600/0xcc1762b626f8c725 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcc1762b626f8c71e expref: 23 pid: 94310 timeout: 3668 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189325.795589:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784189325.795623:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf46903480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bd553d0d-03e2-4233-b06b-b55bbfa2b954+22:3640:x1870854458239360:12345-0@lo:103:ldlm_bl.0 Request processed in 1996us (2235us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189325.795632:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2583 00010000:00010000:3.0:1784189325.795678:0:7454:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:3.0:1784189325.795685:0:7454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.112@tcp lock: ffff9dc05ec0ea00/0xcc1762b626f8c710 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xcc1762b626f8c717 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189325.795693:0:7454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc05ec0ea00 already unused, calling callback (ffffffffc114ac20) 10000000:00010000:3.0:1784189325.795698:0:7454:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.112@tcp lock: ffff9dc05ec0ea00/0xcc1762b626f8c710 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0xcc1762b626f8c717 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189325.795708:0:7454:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.112@tcp lock: ffff9dc05ec0ea00/0xcc1762b626f8c710 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0xcc1762b626f8c717 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1784189325.795716:0:7454:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.112@tcp lock: ffff9dc05ec0ea00/0xcc1762b626f8c710 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0xcc1762b626f8c717 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784189325.795722:0:7454:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1784189325.795752:0:7454:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.112@tcp lock: ffff9dc05ec0ea00/0xcc1762b626f8c710 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcc1762b626f8c717 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189325.795759:0:7454:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1784189325.795803:0:7454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.112@tcp lock: ffff9dc05ec0ea00/0xcc1762b626f8c710 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcc1762b626f8c717 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189325.795811:0:7454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.112@tcp lock: ffff9dc05ec0ea00/0xcc1762b626f8c710 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcc1762b626f8c717 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189325.795825:0:7454:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1784189325.795829:0:7454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.112@tcp lock: ffff9dbf4710ee00/0xcc1762b626f8c6f4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0xcc1762b626f8c6fb expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189325.795836:0:7454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dbf4710ee00 already unused, calling callback (ffffffffc114ac20) 10000000:00010000:3.0:1784189325.795839:0:7454:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.112@tcp lock: ffff9dbf4710ee00/0xcc1762b626f8c6f4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0xcc1762b626f8c6fb expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189325.795846:0:7454:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.112@tcp lock: ffff9dbf4710ee00/0xcc1762b626f8c6f4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0xcc1762b626f8c6fb expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1784189325.795851:0:7454:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.112@tcp lock: ffff9dbf4710ee00/0xcc1762b626f8c6f4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0xcc1762b626f8c6fb expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784189325.795857:0:7454:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1784189325.795870:0:7454:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.112@tcp lock: ffff9dbf4710ee00/0xcc1762b626f8c6f4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcc1762b626f8c6fb expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189325.795876:0:7454:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1784189325.795881:0:7454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.112@tcp lock: ffff9dbf4710ee00/0xcc1762b626f8c6f4 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcc1762b626f8c6fb expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189325.795887:0:7454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.112@tcp lock: ffff9dbf4710ee00/0xcc1762b626f8c6f4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcc1762b626f8c6fb expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189325.795897:0:7454:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1784189325.795907:0:7454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.112@tcp lock: ffff9dc04a20a400/0xcc1762b626f8c6e6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xcc1762b626f8c6ed expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189325.795912:0:7454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc04a20a400 already unused, calling callback (ffffffffc114ac20) 10000000:00010000:3.0:1784189325.795914:0:7454:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.112@tcp lock: ffff9dc04a20a400/0xcc1762b626f8c6e6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0xcc1762b626f8c6ed expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189325.795921:0:7454:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.112@tcp lock: ffff9dc04a20a400/0xcc1762b626f8c6e6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0xcc1762b626f8c6ed expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1784189325.795926:0:7454:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.112@tcp lock: ffff9dc04a20a400/0xcc1762b626f8c6e6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0xcc1762b626f8c6ed expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784189325.795931:0:7454:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1784189325.795945:0:7454:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.112@tcp lock: ffff9dc04a20a400/0xcc1762b626f8c6e6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcc1762b626f8c6ed expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189325.795960:0:7454:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1784189325.795973:0:7454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.112@tcp lock: ffff9dc04a20a400/0xcc1762b626f8c6e6 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcc1762b626f8c6ed expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189325.795979:0:7454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.112@tcp lock: ffff9dc04a20a400/0xcc1762b626f8c6e6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcc1762b626f8c6ed expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189325.795991:0:7454:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784189325.795994:0:7454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.112@tcp lock: ffff9dc04a20ac00/0xcc1762b626f8c6bc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xcc1762b626f8c6c3 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189325.796000:0:7454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc04a20ac00 already unused, calling callback (ffffffffc114ac20) 10000000:00010000:3.0:1784189325.796003:0:7454:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.112@tcp lock: ffff9dc04a20ac00/0xcc1762b626f8c6bc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xcc1762b626f8c6c3 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189325.796020:0:7454:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.112@tcp lock: ffff9dc04a20ac00/0xcc1762b626f8c6bc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xcc1762b626f8c6c3 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1784189325.796026:0:7454:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.112@tcp lock: ffff9dc04a20ac00/0xcc1762b626f8c6bc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xcc1762b626f8c6c3 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784189325.796030:0:7454:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1784189325.796058:0:7454:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.112@tcp lock: ffff9dc04a20ac00/0xcc1762b626f8c6bc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcc1762b626f8c6c3 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189325.796064:0:7454:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1784189325.796069:0:7454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.112@tcp lock: ffff9dc04a20ac00/0xcc1762b626f8c6bc lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcc1762b626f8c6c3 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189325.796076:0:7454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.112@tcp lock: ffff9dc04a20ac00/0xcc1762b626f8c6bc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcc1762b626f8c6c3 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189325.796085:0:7454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784189325.796086:0:7454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784189325.796088:0:7454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784189325.796095:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784189325.796111:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf46903800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:bd553d0d-03e2-4233-b06b-b55bbfa2b954:3643:1870854458240384:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1784189325.796297:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784189325.796372:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1784189325.796378:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf46901500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:bd553d0d-03e2-4233-b06b-b55bbfa2b954:3643:1870854458240256:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1784189325.796410:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784189325.796442:0:26172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458240384 00000100:00100000:3.0:1784189325.796449:0:26172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458240384 00010000:00010000:3.0:1784189325.796477:0:26172:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9dc058f66a00/0xcc1762b626f8c6fb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcc1762b626f8c6f4 expref: 22 pid: 94314 timeout: 3668 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784189325.796507:0:26172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458240256 00000100:00100000:3.0:1784189325.796510:0:26172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458240256 00010000:00010000:3.0:1784189325.796522:0:26172:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9dbf4710f400/0xcc1762b626f8c717 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcc1762b626f8c710 expref: 23 pid: 94309 timeout: 3668 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784189325.796538:0:26172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2584 00000100:00100000:3.0:1784189325.796545:0:26172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf46900a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:bd553d0d-03e2-4233-b06b-b55bbfa2b954+23:3643:x1870854458240384:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1784189325.796554:0:26172:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784189325.796557:0:26172:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9dc058f66a00/0xcc1762b626f8c6fb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcc1762b626f8c6f4 expref: 23 pid: 94314 timeout: 3668 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189325.796565:0:26172:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9dc058f66a00/0xcc1762b626f8c6fb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcc1762b626f8c6f4 expref: 23 pid: 94314 timeout: 3668 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189325.796576:0:26172:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dc058f66a00/0xcc1762b626f8c6fb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcc1762b626f8c6f4 expref: 23 pid: 94314 timeout: 3668 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189325.796588:0:26172:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784189325.796613:0:26172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf46900a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:bd553d0d-03e2-4233-b06b-b55bbfa2b954+22:3643:x1870854458240384:12345-0@lo:103:ldlm_bl.0 Request processed in 69us (317us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189325.796619:0:26172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2584 00000100:00100000:3.0:1784189325.796631:0:26172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2585 00000100:00100000:3.0:1784189325.796636:0:26172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc071139450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:bd553d0d-03e2-4233-b06b-b55bbfa2b954+21:3643:x1870854458240256:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1784189325.796643:0:26172:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784189325.796646:0:26172:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9dbf4710f400/0xcc1762b626f8c717 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcc1762b626f8c710 expref: 21 pid: 94309 timeout: 3668 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189325.796654:0:26172:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9dbf4710f400/0xcc1762b626f8c717 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcc1762b626f8c710 expref: 21 pid: 94309 timeout: 3668 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189325.796669:0:26172:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dbf4710f400/0xcc1762b626f8c717 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcc1762b626f8c710 expref: 21 pid: 94309 timeout: 3668 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189325.796689:0:26172:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784189325.796709:0:26172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc071139450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:bd553d0d-03e2-4233-b06b-b55bbfa2b954+20:3643:x1870854458240256:12345-0@lo:103:ldlm_bl.0 Request processed in 72us (299us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189325.796715:0:26172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2585 00000100:00100000:3.0:1784189325.796781:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf46901500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:bd553d0d-03e2-4233-b06b-b55bbfa2b954:3643:1870854458240256:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1784189325.796791:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf46903800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:bd553d0d-03e2-4233-b06b-b55bbfa2b954:3643:1870854458240384:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1784189325.796815:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf46903b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:bd553d0d-03e2-4233-b06b-b55bbfa2b954:3641:1870854458240640:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1784189325.796838:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784189325.796856:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1784189325.796861:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf46900e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:bd553d0d-03e2-4233-b06b-b55bbfa2b954:3641:1870854458240512:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1784189325.796879:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784189325.796899:0:25703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458240640 00000100:00100000:3.0:1784189325.796903:0:25703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458240640 00010000:00010000:3.0:1784189325.796918:0:25703:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9dc05ec0f600/0xcc1762b626f8c6c3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcc1762b626f8c6bc expref: 20 pid: 94310 timeout: 3668 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784189325.796935:0:25703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458240512 00000100:00100000:3.0:1784189325.796938:0:25703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458240512 00010000:00010000:3.0:1784189325.796947:0:25703:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9dc058f66800/0xcc1762b626f8c6ed lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcc1762b626f8c6e6 expref: 21 pid: 94310 timeout: 3668 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189325.797107:0:6497:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1784189325.797114:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc05ed90000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:bd553d0d-03e2-4233-b06b-b55bbfa2b954+5:95226:x1870854458239872:12345-0@lo:104: Request processed in 2094us (2713us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189325.797122:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 343 00000100:00100000:1.0:1784189325.797156:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 344 00000100:00100000:1.0:1784189325.797164:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc05ed92a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:bd553d0d-03e2-4233-b06b-b55bbfa2b954+4:95226:x1870854458240000:12345-0@lo:104: 00010000:00010000:1.0:1784189325.797174:0:6497:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.112@tcp lock: ffff9dbf4710e400/0xcc1762b626f8c66f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xcc1762b626f8c676 expref: -99 pid: 94303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189325.797219:0:6497:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1784189325.797224:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc05ed92a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:bd553d0d-03e2-4233-b06b-b55bbfa2b954+4:95226:x1870854458240000:12345-0@lo:104: Request processed in 62us (2808us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189325.797230:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 344 00000100:00100000:1.0:1784189325.797244:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 345 00000100:00100000:1.0:1784189325.797257:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf4a343b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:bd553d0d-03e2-4233-b06b-b55bbfa2b954+3:95226:x1870854458240128:12345-0@lo:104: 00010000:00010000:1.0:1784189325.797265:0:6497:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.112@tcp lock: ffff9dc04a20b400/0xcc1762b626f8c58f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xcc1762b626f8c596 expref: -99 pid: 94303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189325.797298:0:6497:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1784189325.797302:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf4a343b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:bd553d0d-03e2-4233-b06b-b55bbfa2b954+3:95226:x1870854458240128:12345-0@lo:104: Request processed in 53us (2875us total) trans 0 rc 0/0 00010000:00010000:2.0:1784189325.797307:0:26173:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1784189325.797329:0:26173:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.112@tcp lock: ffff9dbf4710f600/0xcc1762b626f8c6a0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xcc1762b626f8c6a7 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784189325.797340:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 345 00010000:00010000:2.0:1784189325.797341:0:26173:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dbf4710f600 already unused, calling callback (ffffffffc114ac20) 10000000:00010000:2.0:1784189325.797346:0:26173:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.112@tcp lock: ffff9dbf4710f600/0xcc1762b626f8c6a0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xcc1762b626f8c6a7 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189325.797356:0:26173:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.112@tcp lock: ffff9dbf4710f600/0xcc1762b626f8c6a0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xcc1762b626f8c6a7 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1784189325.797365:0:26173:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.112@tcp lock: ffff9dbf4710f600/0xcc1762b626f8c6a0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xcc1762b626f8c6a7 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784189325.797382:0:26173:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1784189325.797406:0:26173:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.112@tcp lock: ffff9dbf4710f600/0xcc1762b626f8c6a0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcc1762b626f8c6a7 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189325.797412:0:26173:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1784189325.797602:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1784189325.797704:0:95226:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc0505be680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:95226:1870854458239872:0@lo:104: 00000100:00100000:0.0:1784189325.797717:0:95226:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc0505bdf80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:95226:1870854458240000:0@lo:104: 00000100:00100000:0.0:1784189325.797724:0:95226:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc0505bfb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:95226:1870854458240128:0@lo:104: 00010000:00010000:0.0:1784189325.797783:0:95226:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9dc081b16400/0xcc1762b626f8ca51 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 95226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189325.797851:0:26173:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.112@tcp lock: ffff9dbf4710f600/0xcc1762b626f8c6a0 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcc1762b626f8c6a7 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189325.797860:0:26173:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.112@tcp lock: ffff9dbf4710f600/0xcc1762b626f8c6a0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcc1762b626f8c6a7 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189325.797880:0:26173:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1784189325.797884:0:26173:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.112@tcp lock: ffff9dbf4710e400/0xcc1762b626f8c66f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xcc1762b626f8c676 expref: -99 pid: 94303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784189325.797926:0:25703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2586 00010000:00010000:2.0:1784189325.797933:0:26173:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dbf4710e400 already unused, calling callback (ffffffffc114ac20) 00000100:00100000:3.0:1784189325.797937:0:25703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf46903800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:bd553d0d-03e2-4233-b06b-b55bbfa2b954+21:3641:x1870854458240640:12345-0@lo:103:ldlm_bl.0 10000000:00010000:2.0:1784189325.797938:0:26173:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.112@tcp lock: ffff9dbf4710e400/0xcc1762b626f8c66f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xcc1762b626f8c676 expref: -99 pid: 94303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189325.797971:0:25703:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784189325.797978:0:25703:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9dc05ec0f600/0xcc1762b626f8c6c3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcc1762b626f8c6bc expref: 21 pid: 94310 timeout: 3668 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189325.797988:0:25703:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9dc05ec0f600/0xcc1762b626f8c6c3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcc1762b626f8c6bc expref: 21 pid: 94310 timeout: 3668 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189325.798000:0:25703:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dc05ec0f600/0xcc1762b626f8c6c3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcc1762b626f8c6bc expref: 21 pid: 94310 timeout: 3668 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189325.798012:0:25703:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784189325.798061:0:25703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf46903800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:bd553d0d-03e2-4233-b06b-b55bbfa2b954+20:3641:x1870854458240640:12345-0@lo:103:ldlm_bl.0 Request processed in 128us (1221us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189325.798068:0:25703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2586 00000100:00100000:3.0:1784189325.798083:0:25703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2587 00000100:00100000:3.0:1784189325.798089:0:25703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf46901500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:bd553d0d-03e2-4233-b06b-b55bbfa2b954+19:3641:x1870854458240512:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1784189325.798096:0:25703:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784189325.798100:0:25703:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9dc058f66800/0xcc1762b626f8c6ed lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcc1762b626f8c6e6 expref: 19 pid: 94310 timeout: 3668 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189325.798109:0:25703:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9dc058f66800/0xcc1762b626f8c6ed lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcc1762b626f8c6e6 expref: 19 pid: 94310 timeout: 3668 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189325.798118:0:25703:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dc058f66800/0xcc1762b626f8c6ed lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcc1762b626f8c6e6 expref: 19 pid: 94310 timeout: 3668 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189325.798137:0:25703:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1784189325.798144:0:26173:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.112@tcp lock: ffff9dbf4710e400/0xcc1762b626f8c66f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xcc1762b626f8c676 expref: -99 pid: 94303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784189325.798161:0:25703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf46901500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:bd553d0d-03e2-4233-b06b-b55bbfa2b954+18:3641:x1870854458240512:12345-0@lo:103:ldlm_bl.0 Request processed in 70us (1279us total) trans 0 rc 0/0 10000000:00010000:2.0:1784189325.798164:0:26173:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.112@tcp lock: ffff9dbf4710e400/0xcc1762b626f8c66f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xcc1762b626f8c676 expref: -99 pid: 94303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784189325.798171:0:26173:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:3.0:1784189325.798184:0:25703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2587 00010000:00010000:2.0:1784189325.798198:0:26173:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.112@tcp lock: ffff9dbf4710e400/0xcc1762b626f8c66f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcc1762b626f8c676 expref: -99 pid: 94303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189325.798206:0:26173:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1784189325.798341:0:7454:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784189325.798347:0:7454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.112@tcp lock: ffff9dc04a20b400/0xcc1762b626f8c58f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xcc1762b626f8c596 expref: -99 pid: 94303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189325.798354:0:7454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc04a20b400 already unused, calling callback (ffffffffc114ac20) 10000000:00010000:3.0:1784189325.798356:0:7454:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.112@tcp lock: ffff9dc04a20b400/0xcc1762b626f8c58f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xcc1762b626f8c596 expref: -99 pid: 94303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189325.798363:0:7454:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.112@tcp lock: ffff9dc04a20b400/0xcc1762b626f8c58f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xcc1762b626f8c596 expref: -99 pid: 94303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1784189325.798369:0:7454:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.112@tcp lock: ffff9dc04a20b400/0xcc1762b626f8c58f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xcc1762b626f8c596 expref: -99 pid: 94303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784189325.798375:0:7454:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1784189325.798389:0:7454:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.112@tcp lock: ffff9dc04a20b400/0xcc1762b626f8c58f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcc1762b626f8c596 expref: -99 pid: 94303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189325.798399:0:7454:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1784189325.798407:0:7454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.112@tcp lock: ffff9dc04a20b400/0xcc1762b626f8c58f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcc1762b626f8c596 expref: -99 pid: 94303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189325.798413:0:7454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.112@tcp lock: ffff9dc04a20b400/0xcc1762b626f8c58f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcc1762b626f8c596 expref: -99 pid: 94303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189325.798423:0:7454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784189325.798424:0:7454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784189325.798426:0:7454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784189325.798432:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784189325.798463:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf46900e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:bd553d0d-03e2-4233-b06b-b55bbfa2b954:3641:1870854458240512:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1784189325.798473:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf46903b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:bd553d0d-03e2-4233-b06b-b55bbfa2b954:3641:1870854458240640:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1784189325.798491:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1784189325.798563:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf46902680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:bd553d0d-03e2-4233-b06b-b55bbfa2b954:3641:1870854458241024:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1784189325.798599:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784189325.798696:0:25703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458241024 00000100:00100000:0.0:1784189325.798702:0:25703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458241024 00010000:00010000:0.0:1784189325.798726:0:25703:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9dc04a20b000/0xcc1762b626f8c596 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcc1762b626f8c58f expref: 18 pid: 94308 timeout: 3668 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189325.798973:0:26173:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.112@tcp lock: ffff9dbf4710e400/0xcc1762b626f8c66f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcc1762b626f8c676 expref: -99 pid: 94303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189325.798982:0:26173:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.112@tcp lock: ffff9dbf4710e400/0xcc1762b626f8c66f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcc1762b626f8c676 expref: -99 pid: 94303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189325.798999:0:26173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784189325.799000:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc080f6b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:bd553d0d-03e2-4233-b06b-b55bbfa2b954:3643:1870854458240896:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1784189325.799002:0:26173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784189325.799006:0:26173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784189325.799024:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784189325.801486:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784189325.802577:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc080f69c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:bd553d0d-03e2-4233-b06b-b55bbfa2b954:3643:1870854458240768:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1784189325.802667:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784189325.802761:0:25703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458240896 00000100:00100000:0.0:1784189325.802771:0:25703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458240896 00010000:00010000:0.0:1784189325.802819:0:25703:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9dc04a20b200/0xcc1762b626f8c676 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcc1762b626f8c66f expref: 19 pid: 94308 timeout: 3668 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784189325.802825:0:7455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2588 00000100:00100000:0.0:1784189325.802860:0:25703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2589 00000100:00100000:0.0:1784189325.802869:0:25703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf4a341180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:bd553d0d-03e2-4233-b06b-b55bbfa2b954+19:3643:x1870854458240896:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1784189325.802888:0:25703:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784189325.802894:0:25703:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9dc04a20b200/0xcc1762b626f8c676 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcc1762b626f8c66f expref: 19 pid: 94308 timeout: 3668 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189325.802906:0:25703:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9dc04a20b200/0xcc1762b626f8c676 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcc1762b626f8c66f expref: 19 pid: 94308 timeout: 3668 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189325.802944:0:25703:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dc04a20b200/0xcc1762b626f8c676 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcc1762b626f8c66f expref: 19 pid: 94308 timeout: 3668 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189325.802974:0:25703:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784189325.803001:0:7455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf46903b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bd553d0d-03e2-4233-b06b-b55bbfa2b954+18:3641:x1870854458241024:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1784189325.803015:0:7455:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1784189325.803018:0:25703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf4a341180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:bd553d0d-03e2-4233-b06b-b55bbfa2b954+18:3643:x1870854458240896:12345-0@lo:103:ldlm_bl.0 Request processed in 150us (1543us total) trans 0 rc 0/0 00010000:00010000:2.0:1784189325.803025:0:7455:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9dc04a20b000/0xcc1762b626f8c596 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcc1762b626f8c58f expref: 18 pid: 94308 timeout: 3668 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784189325.803034:0:25703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2589 00010000:00010000:2.0:1784189325.803043:0:7455:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9dc04a20b000/0xcc1762b626f8c596 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcc1762b626f8c58f expref: 18 pid: 94308 timeout: 3668 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189325.803055:0:7455:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dc04a20b000/0xcc1762b626f8c596 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcc1762b626f8c58f expref: 18 pid: 94308 timeout: 3668 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189325.803065:0:7455:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784189325.803250:0:7455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf46903b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bd553d0d-03e2-4233-b06b-b55bbfa2b954+17:3641:x1870854458241024:12345-0@lo:103:ldlm_bl.0 Request processed in 412us (4654us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189325.803287:0:7455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2588 00000100:00100000:3.0:1784189325.803583:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf46902680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:bd553d0d-03e2-4233-b06b-b55bbfa2b954:3641:1870854458241024:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1784189325.803623:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf46902300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bd553d0d-03e2-4233-b06b-b55bbfa2b954:3640:1870854458239360:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1784189325.803635:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc04a64f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bd553d0d-03e2-4233-b06b-b55bbfa2b954:3640:1870854458239232:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1784189325.803810:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc080f6b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:bd553d0d-03e2-4233-b06b-b55bbfa2b954:3643:1870854458240896:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1784189325.803874:0:25703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458240768 00000100:00100000:0.0:1784189325.803880:0:25703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458240768 00010000:00010000:0.0:1784189325.803904:0:25703:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9dc05ec0e400/0xcc1762b626f8c6a7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcc1762b626f8c6a0 expref: 16 pid: 94314 timeout: 3668 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784189325.803936:0:25703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2590 00000100:00100000:0.0:1784189325.803943:0:25703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf4a340700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:bd553d0d-03e2-4233-b06b-b55bbfa2b954+16:3643:x1870854458240768:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1784189325.803963:0:25703:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784189325.803968:0:25703:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9dc05ec0e400/0xcc1762b626f8c6a7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcc1762b626f8c6a0 expref: 16 pid: 94314 timeout: 3668 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189325.803978:0:25703:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9dc05ec0e400/0xcc1762b626f8c6a7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcc1762b626f8c6a0 expref: 16 pid: 94314 timeout: 3668 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189325.803991:0:25703:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dc05ec0e400/0xcc1762b626f8c6a7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcc1762b626f8c6a0 expref: 16 pid: 94314 timeout: 3668 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189325.804005:0:25703:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9dc081b16400/0xcc1762b626f8ca51 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 95226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189325.804014:0:25703:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dc081b16400/0xcc1762b626f8ca51 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 95226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189325.804275:0:25703:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9dc081b16400/0xcc1762b626f8ca51 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 95226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189325.804284:0:25703:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9dc081b16400/0xcc1762b626f8ca51 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 95226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189325.804291:0:25703:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9dc081b16400/0xcc1762b626f8ca51 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 95226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189325.804299:0:25703:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9dc081b16400/0xcc1762b626f8ca51 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 95226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189325.804306:0:25703:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc081b16400 already unused, calling callback (ffffffffc0b2e230) 00010000:00010000:0.0:1784189325.804310:0:25703:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9dc081b16400/0xcc1762b626f8ca51 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 95226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189325.804566:0:25703:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9dc081b16400/0xcc1762b626f8ca51 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 95226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189325.804672:0:95226:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9dc081b16400/0xcc1762b626f8ca51 lrc: 5/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 95226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189325.804682:0:95226:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9dc081b16400/0xcc1762b626f8ca51 lrc: 5/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 95226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189325.805112:0:25703:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9dc081b16400/0xcc1762b626f8ca51 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 95226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189325.805123:0:25703:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dc081b16400/0xcc1762b626f8ca51 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 95226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189325.805272:0:25703:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784189325.806304:0:25703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf4a340700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:bd553d0d-03e2-4233-b06b-b55bbfa2b954+15:3643:x1870854458240768:12345-0@lo:103:ldlm_bl.0 Request processed in 2352us (3627us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189325.806344:0:25703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2590 00000100:00100000:3.0:1784189325.806525:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc080f69c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:bd553d0d-03e2-4233-b06b-b55bbfa2b954:3643:1870854458240768:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1784189326.064062:0:7454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1784189326.896373:0:6510:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1784189326.896384:0:6510:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9dc07a8f1800 from 58 10000000:01000000:2.0:1784189326.896392:0:6510:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1784189326.896477:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff9dc0565e7600/0xcc1762b626f8ca58 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189326.896492:0:6510:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: ffff9dc0565e7600/0xcc1762b626f8ca58 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189326.896505:0:6510:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: ffff9dc0565e7600/0xcc1762b626f8ca58 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784189326.896547:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc080f6a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458241152:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1784189326.896771:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784189326.896840:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dc071b6a9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1784189326.898847:0:94310:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458241152 00000100:00100000:0.0:1784189326.898869:0:94310:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458241152 00000100:00100000:0.0:1784189326.898981:0:94310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1784189326.898994:0:94310:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc044940850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd553d0d-03e2-4233-b06b-b55bbfa2b954+15:6510:x1870854458241152:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784189326.899051:0:94310:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784189326.899078:0:94310:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dc081b16400/0xcc1762b626f8ca5f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xcc1762b626f8ca58 expref: -99 pid: 94310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189326.899113:0:94310:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dc081b16400/0xcc1762b626f8ca5f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcc1762b626f8ca58 expref: 16 pid: 94310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189326.899127:0:94310:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dc081b16400/0xcc1762b626f8ca5f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcc1762b626f8ca58 expref: 16 pid: 94310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189326.899138:0:94310:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc081b16400, rc 0) 00000100:00100000:0.0:1784189326.899788:0:94310:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc044940850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd553d0d-03e2-4233-b06b-b55bbfa2b954+16:6510:x1870854458241152:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 794us (3015us total) trans 0 rc 0/0 00000100:00100000:0.0:1784189326.899797:0:94310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1784189326.900001:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc080f6a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458241152:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1784189326.900028:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: ffff9dc0565e7600/0xcc1762b626f8ca58 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc1762b626f8ca5f expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189326.900041:0:6510:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: ffff9dc0565e7600/0xcc1762b626f8ca58 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcc1762b626f8ca5f expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784189326.900147:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc080f6a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458241280:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1784189326.900209:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784189326.900265:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dc071b6a9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1784189326.900378:0:94309:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458241280 00000100:00100000:1.0:1784189326.900384:0:94309:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458241280 00000100:00100000:1.0:1784189326.900426:0:94309:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1784189326.900436:0:94309:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc044943050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd553d0d-03e2-4233-b06b-b55bbfa2b954+16:6510:x1870854458241280:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1784189326.900599:0:94309:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc044943050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd553d0d-03e2-4233-b06b-b55bbfa2b954+16:6510:x1870854458241280:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 164us (402us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189326.900606:0:94309:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1784189326.900701:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc080f6a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458241280:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784189326.900737:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf46902300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458241408:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1784189326.900783:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784189326.900812:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dc058076780 going to sleep for 11 seconds 00000100:00100000:2.0:1784189326.900934:0:94308:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458241408 00000100:00100000:2.0:1784189326.900939:0:94308:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458241408 00000100:00100000:2.0:1784189326.900986:0:94308:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1784189326.900994:0:94308:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc044941850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd553d0d-03e2-4233-b06b-b55bbfa2b954+16:6510:x1870854458241408:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1784189326.901138:0:94308:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc044941850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd553d0d-03e2-4233-b06b-b55bbfa2b954+16:6510:x1870854458241408:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 145us (353us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189326.901146:0:94308:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1784189326.905156:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf46902300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458241408:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1784189326.906151:0:95230:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf4a342a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bd553d0d-03e2-4233-b06b-b55bbfa2b954:95230:1870854458241536:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1784189326.906277:0:95230:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784189326.906370:0:95230:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dc07545b900 going to sleep for 11 seconds 00000100:00100000:3.0:1784189326.906434:0:94309:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458241536 00000100:00100000:3.0:1784189326.906443:0:94309:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458241536 00000100:00100000:3.0:1784189326.906509:0:94309:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1784189326.906520:0:94309:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc044941c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd553d0d-03e2-4233-b06b-b55bbfa2b954+16:95230:x1870854458241536:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1784189326.906703:0:94309:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc044941c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd553d0d-03e2-4233-b06b-b55bbfa2b954+16:95230:x1870854458241536:12345-0@lo:502:llog_process_th.0 Request processed in 183us (425us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189326.906712:0:94309:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1784189326.907060:0:95230:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf4a342a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bd553d0d-03e2-4233-b06b-b55bbfa2b954:95230:1870854458241536:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1784189326.907121:0:95230:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf4a342a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bd553d0d-03e2-4233-b06b-b55bbfa2b954:95230:1870854458241664:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1784189326.907161:0:95230:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784189326.907200:0:95230:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dc07545b900 going to sleep for 11 seconds 00000100:00100000:3.0:1784189326.907500:0:94310:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458241664 00000100:00100000:3.0:1784189326.907507:0:94310:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458241664 00000100:00100000:3.0:1784189326.907558:0:94310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1784189326.907565:0:94310:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc044942850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd553d0d-03e2-4233-b06b-b55bbfa2b954+16:95230:x1870854458241664:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1784189326.907671:0:94310:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc044942850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd553d0d-03e2-4233-b06b-b55bbfa2b954+16:95230:x1870854458241664:12345-0@lo:502:llog_process_th.0 Request processed in 106us (509us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189326.907678:0:94310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1784189326.907880:0:95230:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf4a342a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bd553d0d-03e2-4233-b06b-b55bbfa2b954:95230:1870854458241664:0@lo:502:llog_process_th.0 00000040:00080000:1.0:1784189326.907913:0:95230:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 61 count 60 00000020:01000000:3.0:1784189326.908209:0:6510:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 58-60 (rc=0) 10000000:01000000:3.0:1784189326.908249:0:6510:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1784189326.908262:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff9dc0565e7600/0xcc1762b626f8ca58 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc1762b626f8ca5f expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189326.908275:0:6510:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: ffff9dc0565e7600/0xcc1762b626f8ca58 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc1762b626f8ca5f expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784189326.908287:0:6510:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:3.0:1784189326.908291:0:6510:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 53 10000000:01000000:3.0:1784189326.908294:0:6510:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1784189326.908380:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff9dc058f66800/0xcc1762b626f8ca66 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189326.908390:0:6510:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: ffff9dc058f66800/0xcc1762b626f8ca66 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189326.908400:0:6510:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: ffff9dc058f66800/0xcc1762b626f8ca66 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784189326.908420:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf46902680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458241792:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1784189326.908463:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784189326.908494:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dbf41086600 going to sleep for 11 seconds 00000100:00100000:1.0:1784189326.912427:0:94309:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458241792 00000100:00100000:1.0:1784189326.912450:0:94309:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458241792 00000100:00100000:1.0:1784189326.912540:0:94309:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1784189326.912552:0:94309:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc044942450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd553d0d-03e2-4233-b06b-b55bbfa2b954+16:6510:x1870854458241792:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784189326.912573:0:94309:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784189326.912596:0:94309:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dc042d67600/0xcc1762b626f8ca6d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xcc1762b626f8ca66 expref: -99 pid: 94309 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189326.912631:0:94309:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dc042d67600/0xcc1762b626f8ca6d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcc1762b626f8ca66 expref: 17 pid: 94309 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189326.912642:0:94309:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dc042d67600/0xcc1762b626f8ca6d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcc1762b626f8ca66 expref: 17 pid: 94309 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189326.912652:0:94309:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc042d67600, rc 0) 00000100:00100000:1.0:1784189326.912749:0:94309:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc044942450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd553d0d-03e2-4233-b06b-b55bbfa2b954+17:6510:x1870854458241792:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 199us (4285us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189326.912756:0:94309:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1784189326.912900:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf46902680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458241792:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784189326.912924:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: ffff9dc058f66800/0xcc1762b626f8ca66 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc1762b626f8ca6d expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189326.912935:0:6510:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: ffff9dc058f66800/0xcc1762b626f8ca66 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xcc1762b626f8ca6d expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784189326.913052:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc0505bfb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458241920:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1784189326.913092:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784189326.913134:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dc074a76780 going to sleep for 11 seconds 00000100:00100000:1.0:1784189326.913372:0:94310:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458241920 00000100:00100000:1.0:1784189326.913378:0:94310:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458241920 00000100:00100000:1.0:1784189326.913405:0:94310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1784189326.913411:0:94310:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf44915450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd553d0d-03e2-4233-b06b-b55bbfa2b954+17:6510:x1870854458241920:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1784189326.913577:0:94310:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf44915450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd553d0d-03e2-4233-b06b-b55bbfa2b954+17:6510:x1870854458241920:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 165us (484us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189326.913584:0:94310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1784189326.913657:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc0505bfb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458241920:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1784189326.913700:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc080f6bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458242048:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1784189326.913764:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784189326.913794:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dc071b6a540 going to sleep for 11 seconds 00000100:00100000:3.0:1784189326.913867:0:94308:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458242048 00000100:00100000:3.0:1784189326.913878:0:94308:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458242048 00000100:00100000:3.0:1784189326.913915:0:94308:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1784189326.913923:0:94308:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf44914050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd553d0d-03e2-4233-b06b-b55bbfa2b954+17:6510:x1870854458242048:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1784189326.914025:0:94308:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf44914050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd553d0d-03e2-4233-b06b-b55bbfa2b954+17:6510:x1870854458242048:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 103us (260us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189326.914033:0:94308:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1784189326.914166:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc080f6bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458242048:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1784189326.914879:0:95231:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf4a342a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bd553d0d-03e2-4233-b06b-b55bbfa2b954:95231:1870854458242176:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1784189326.914955:0:95231:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784189326.914986:0:95231:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dc07545b9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1784189326.915091:0:94308:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458242176 00000100:00100000:3.0:1784189326.915098:0:94308:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458242176 00000100:00100000:3.0:1784189326.915137:0:94308:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1784189326.915146:0:94308:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf44916850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd553d0d-03e2-4233-b06b-b55bbfa2b954+17:95231:x1870854458242176:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1784189326.915286:0:94308:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf44916850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd553d0d-03e2-4233-b06b-b55bbfa2b954+17:95231:x1870854458242176:12345-0@lo:502:llog_process_th.0 Request processed in 141us (342us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189326.915295:0:94308:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1784189326.915650:0:95231:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf4a342a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bd553d0d-03e2-4233-b06b-b55bbfa2b954:95231:1870854458242176:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1784189326.915682:0:95231:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1784189326.915695:0:95231:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784189326.915698:0:95231:0:(obd_config.c:1561:class_process_config()) marker 47 (0x1) lustre-MDT0000-m rem lustre.pool_134.lustre-OST0001_UUID 00000020:00000080:1.0:1784189326.915705:0:95231:0:(obd_config.c:1470:class_process_config()) processing cmd: ce022 00020000:01000000:1.0:1784189326.915728:0:95231:0:(lod_pool.c:649:lod_pool_remove()) lustre-OST0001_UUID removed from pool_134 00000100:00100000:3.0:1784189326.916613:0:95231:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf46900e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bd553d0d-03e2-4233-b06b-b55bbfa2b954:95231:1870854458242304:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1784189326.916692:0:95231:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784189326.916791:0:95231:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dbf41086600 going to sleep for 11 seconds 00000020:01000004:1.0:1784189326.916881:0:95232:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9dc07a8f1800 from lustre-MDT0000, refs=4 00000020:01000004:1.0:1784189326.916886:0:95232:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9dc07a8f1800 4 00000100:00100000:0.0:1784189326.918657:0:94314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458242304 00000100:00100000:0.0:1784189326.918675:0:94314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458242304 00000100:00100000:0.0:1784189326.918952:0:94314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1784189326.918966:0:94314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf44917850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:bd553d0d-03e2-4233-b06b-b55bbfa2b954+17:95231:x1870854458242304:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1784189326.921644:0:94314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf44917850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:bd553d0d-03e2-4233-b06b-b55bbfa2b954+17:95231:x1870854458242304:12345-0@lo:502:llog_process_th.0 Request processed in 2665us (4934us total) trans 0 rc 0/0 00000100:00100000:0.0:1784189326.921664:0:94314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1784189326.921906:0:95231:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf46900e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bd553d0d-03e2-4233-b06b-b55bbfa2b954:95231:1870854458242304:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1784189326.921965:0:95231:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1784189326.921975:0:95231:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784189326.921978:0:95231:0:(obd_config.c:1561:class_process_config()) marker 47 (0x2) lustre-MDT0000-m rem lustre.pool_134.lustre-OST0001_UUID 00000040:00080000:3.0:1784189326.921984:0:95231:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 56 count 55 00000020:01000000:2.0:1784189326.922600:0:6510:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 53-55 (rc=0) 10000000:01000000:2.0:1784189326.922638:0:6510:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1784189326.922653:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff9dc058f66800/0xcc1762b626f8ca66 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc1762b626f8ca6d expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189326.922667:0:6510:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: ffff9dc058f66800/0xcc1762b626f8ca66 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc1762b626f8ca6d expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784189326.922680:0:6510:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1784189326.922684:0:6510:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9dbf44675800 from 58 10000000:01000000:2.0:1784189326.922687:0:6510:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1784189326.922736:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff9dc0565e7c00/0xcc1762b626f8ca74 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189326.922745:0:6510:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: ffff9dc0565e7c00/0xcc1762b626f8ca74 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189326.922774:0:6510:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: ffff9dc0565e7c00/0xcc1762b626f8ca74 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784189326.922805:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc080f6bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458242432:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1784189326.922969:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784189326.923055:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dc071b6a540 going to sleep for 11 seconds 00000100:00100000:3.0:1784189326.923105:0:94308:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458242432 00000100:00100000:3.0:1784189326.923114:0:94308:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458242432 00000100:00100000:3.0:1784189326.923215:0:94308:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1784189326.923226:0:94308:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf44916050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd553d0d-03e2-4233-b06b-b55bbfa2b954+17:6510:x1870854458242432:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784189326.923604:0:94308:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784189326.923633:0:94308:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dc058f66a00/0xcc1762b626f8ca7b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xcc1762b626f8ca74 expref: -99 pid: 94308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189326.923666:0:94308:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dc058f66a00/0xcc1762b626f8ca7b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcc1762b626f8ca74 expref: 18 pid: 94308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189326.923679:0:94308:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dc058f66a00/0xcc1762b626f8ca7b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcc1762b626f8ca74 expref: 18 pid: 94308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189326.923689:0:94308:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc058f66a00, rc 0) 00000100:00100000:3.0:1784189326.923747:0:94308:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf44916050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd553d0d-03e2-4233-b06b-b55bbfa2b954+18:6510:x1870854458242432:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 523us (778us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189326.923754:0:94308:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1784189326.923865:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc080f6bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458242432:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784189326.923882:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: ffff9dc0565e7c00/0xcc1762b626f8ca74 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc1762b626f8ca7b expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189326.923892:0:6510:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: ffff9dc0565e7c00/0xcc1762b626f8ca74 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xcc1762b626f8ca7b expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784189326.923985:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc0505bdf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458242560:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1784189326.924018:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784189326.924254:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dc074a76600 going to sleep for 11 seconds 00000100:00100000:2.0:1784189326.924609:0:94310:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458242560 00000100:00100000:2.0:1784189326.924616:0:94310:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458242560 00000100:00100000:2.0:1784189326.924664:0:94310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1784189326.924674:0:94310:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf44917450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd553d0d-03e2-4233-b06b-b55bbfa2b954+18:6510:x1870854458242560:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1784189326.924852:0:94310:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf44917450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd553d0d-03e2-4233-b06b-b55bbfa2b954+18:6510:x1870854458242560:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 179us (832us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189326.924859:0:94310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1784189326.925029:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc0505bdf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458242560:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1784189326.925070:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc0505bdf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458242688:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1784189326.925131:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784189326.925158:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dc074a76600 going to sleep for 11 seconds 00000100:00100000:2.0:1784189326.925219:0:94310:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458242688 00000100:00100000:2.0:1784189326.925224:0:94310:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458242688 00000100:00100000:2.0:1784189326.925295:0:94310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1784189326.925303:0:94310:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf44914450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd553d0d-03e2-4233-b06b-b55bbfa2b954+18:6510:x1870854458242688:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1784189326.925417:0:94310:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf44914450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd553d0d-03e2-4233-b06b-b55bbfa2b954+18:6510:x1870854458242688:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 114us (296us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189326.925690:0:94310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1784189326.926181:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc0505bdf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458242688:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1784189326.927022:0:95233:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc0505bdf80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bd553d0d-03e2-4233-b06b-b55bbfa2b954:95233:1870854458242816:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1784189326.927106:0:95233:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784189326.927152:0:95233:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dc074a76780 going to sleep for 11 seconds 00000100:00100000:2.0:1784189326.927340:0:94314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458242816 00000100:00100000:2.0:1784189326.927349:0:94314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458242816 00000100:00100000:2.0:1784189326.927402:0:94314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1784189326.927412:0:94314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf44917050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:bd553d0d-03e2-4233-b06b-b55bbfa2b954+18:95233:x1870854458242816:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1784189326.927561:0:94314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf44917050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:bd553d0d-03e2-4233-b06b-b55bbfa2b954+18:95233:x1870854458242816:12345-0@lo:502:llog_process_th.0 Request processed in 150us (455us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189326.927576:0:94314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1784189326.927689:0:95233:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc0505bdf80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bd553d0d-03e2-4233-b06b-b55bbfa2b954:95233:1870854458242816:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1784189326.927740:0:95233:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc0505bdf80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bd553d0d-03e2-4233-b06b-b55bbfa2b954:95233:1870854458242944:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1784189326.927784:0:95233:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784189326.927810:0:95233:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dbf44b58840 going to sleep for 11 seconds 00000100:00100000:2.0:1784189326.927924:0:94314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458242944 00000100:00100000:2.0:1784189326.927929:0:94314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458242944 00000100:00100000:2.0:1784189326.927963:0:94314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1784189326.927970:0:94314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf44915050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:bd553d0d-03e2-4233-b06b-b55bbfa2b954+18:95233:x1870854458242944:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1784189326.928035:0:94314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf44915050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:bd553d0d-03e2-4233-b06b-b55bbfa2b954+18:95233:x1870854458242944:12345-0@lo:502:llog_process_th.0 Request processed in 66us (252us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189326.928042:0:94314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1784189326.928118:0:95233:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc0505bdf80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bd553d0d-03e2-4233-b06b-b55bbfa2b954:95233:1870854458242944:0@lo:502:llog_process_th.0 00000040:00080000:0.0:1784189326.928140:0:95233:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 61 count 60 00000020:01000000:2.0:1784189326.928666:0:6510:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 58-60 (rc=0) 10000000:01000000:2.0:1784189326.928693:0:6510:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1784189326.928705:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff9dc0565e7c00/0xcc1762b626f8ca74 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc1762b626f8ca7b expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189326.928717:0:6510:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: ffff9dc0565e7c00/0xcc1762b626f8ca74 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc1762b626f8ca7b expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784189326.928729:0:6510:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:2.0:1784189326.928733:0:6510:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 53 10000000:01000000:2.0:1784189326.928736:0:6510:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:2.0:1784189326.928770:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff9dc0565e6600/0xcc1762b626f8ca82 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189326.928779:0:6510:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: ffff9dc0565e6600/0xcc1762b626f8ca82 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189326.928790:0:6510:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: ffff9dc0565e6600/0xcc1762b626f8ca82 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784189326.928809:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc080f68e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458243072:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1784189326.928950:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784189326.928986:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dbf42629d80 going to sleep for 11 seconds 00000100:00100000:3.0:1784189326.929059:0:94308:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458243072 00000100:00100000:3.0:1784189326.929065:0:94308:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458243072 00000100:00100000:3.0:1784189326.929110:0:94308:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1784189326.929118:0:94308:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf44914c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd553d0d-03e2-4233-b06b-b55bbfa2b954+18:6510:x1870854458243072:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784189326.929130:0:94308:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784189326.929146:0:94308:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dc058f66000/0xcc1762b626f8ca89 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xcc1762b626f8ca82 expref: -99 pid: 94308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189326.929170:0:94308:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dc058f66000/0xcc1762b626f8ca89 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcc1762b626f8ca82 expref: 19 pid: 94308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189326.929180:0:94308:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dc058f66000/0xcc1762b626f8ca89 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcc1762b626f8ca82 expref: 19 pid: 94308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189326.929189:0:94308:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc058f66000, rc 0) 00000100:00100000:3.0:1784189326.929240:0:94308:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf44914c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd553d0d-03e2-4233-b06b-b55bbfa2b954+19:6510:x1870854458243072:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 115us (290us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189326.929256:0:94308:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1784189326.929538:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc080f68e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458243072:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1784189326.929555:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: ffff9dc0565e6600/0xcc1762b626f8ca82 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc1762b626f8ca89 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189326.929565:0:6510:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: ffff9dc0565e6600/0xcc1762b626f8ca82 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xcc1762b626f8ca89 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784189326.929633:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc080f68e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458243200:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1784189326.929664:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784189326.929692:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dbf42629d80 going to sleep for 11 seconds 00000100:00100000:3.0:1784189326.929738:0:94309:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458243200 00000100:00100000:3.0:1784189326.929744:0:94309:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458243200 00000100:00100000:3.0:1784189326.929776:0:94309:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1784189326.929784:0:94309:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf44916c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd553d0d-03e2-4233-b06b-b55bbfa2b954+19:6510:x1870854458243200:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784189326.930007:0:94309:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf44916c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd553d0d-03e2-4233-b06b-b55bbfa2b954+19:6510:x1870854458243200:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 223us (341us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189326.930014:0:94309:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1784189326.930084:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc080f68e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458243200:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1784189326.930116:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc0505bdf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458243328:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1784189326.930162:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784189326.930186:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dc074a76780 going to sleep for 11 seconds 00000100:00100000:2.0:1784189326.930430:0:94308:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458243328 00000100:00100000:2.0:1784189326.930436:0:94308:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458243328 00000100:00100000:2.0:1784189326.930473:0:94308:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1784189326.930480:0:94308:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf44914850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd553d0d-03e2-4233-b06b-b55bbfa2b954+19:6510:x1870854458243328:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1784189326.930578:0:94308:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf44914850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd553d0d-03e2-4233-b06b-b55bbfa2b954+19:6510:x1870854458243328:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 97us (414us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189326.930585:0:94308:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1784189326.930671:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc0505bdf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458243328:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1784189326.931188:0:95234:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf46900e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bd553d0d-03e2-4233-b06b-b55bbfa2b954:95234:1870854458243456:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1784189326.931248:0:95234:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784189326.931285:0:95234:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dc048b2d840 going to sleep for 11 seconds 00000100:00100000:0.0:1784189326.931350:0:94309:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458243456 00000100:00100000:0.0:1784189326.931355:0:94309:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458243456 00000100:00100000:0.0:1784189326.931391:0:94309:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1784189326.931398:0:94309:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf44915850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd553d0d-03e2-4233-b06b-b55bbfa2b954+19:95234:x1870854458243456:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1784189326.931501:0:94309:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf44915850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd553d0d-03e2-4233-b06b-b55bbfa2b954+19:95234:x1870854458243456:12345-0@lo:502:llog_process_th.0 Request processed in 103us (252us total) trans 0 rc 0/0 00000100:00100000:0.0:1784189326.931508:0:94309:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1784189326.931627:0:95234:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf46900e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bd553d0d-03e2-4233-b06b-b55bbfa2b954:95234:1870854458243456:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1784189326.931657:0:95234:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1784189326.931670:0:95234:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784189326.931672:0:95234:0:(obd_config.c:1561:class_process_config()) marker 48 (0x1) lustre-MDT0001-m rem lustre.pool_134.lustre-OST0001_UUID 00000020:00000080:3.0:1784189326.931679:0:95234:0:(obd_config.c:1470:class_process_config()) processing cmd: ce022 00020000:01000000:3.0:1784189326.931700:0:95234:0:(lod_pool.c:649:lod_pool_remove()) lustre-OST0001_UUID removed from pool_134 00000100:00100000:3.0:1784189326.931721:0:95234:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf46900e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bd553d0d-03e2-4233-b06b-b55bbfa2b954:95234:1870854458243584:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1784189326.931753:0:95234:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784189326.931777:0:95234:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dc082158240 going to sleep for 11 seconds 00000100:00100000:0.0:1784189326.931905:0:94310:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458243584 00000100:00100000:0.0:1784189326.931910:0:94310:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458243584 00000100:00100000:0.0:1784189326.931950:0:94310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1784189326.931957:0:94310:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc074ad7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd553d0d-03e2-4233-b06b-b55bbfa2b954+19:95234:x1870854458243584:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1784189326.932033:0:94310:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc074ad7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd553d0d-03e2-4233-b06b-b55bbfa2b954+19:95234:x1870854458243584:12345-0@lo:502:llog_process_th.0 Request processed in 76us (279us total) trans 0 rc 0/0 00000100:00100000:0.0:1784189326.932039:0:94310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1784189326.932109:0:95234:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf46900e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bd553d0d-03e2-4233-b06b-b55bbfa2b954:95234:1870854458243584:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1784189326.932129:0:95234:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1784189326.932134:0:95234:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784189326.932136:0:95234:0:(obd_config.c:1561:class_process_config()) marker 48 (0x2) lustre-MDT0001-m rem lustre.pool_134.lustre-OST0001_UUID 00000040:00080000:2.0:1784189326.932140:0:95234:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 56 count 55 00000020:01000000:0.0:1784189326.932309:0:6510:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 53-55 (rc=0) 10000000:01000000:0.0:1784189326.932373:0:6510:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:0.0:1784189326.932382:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff9dc0565e6600/0xcc1762b626f8ca82 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc1762b626f8ca89 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189326.932393:0:6510:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: ffff9dc0565e6600/0xcc1762b626f8ca82 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc1762b626f8ca89 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784189326.932404:0:6510:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1784189326.932407:0:6510:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9dbf425f7000 from 58 10000000:01000000:0.0:1784189326.932410:0:6510:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1784189326.932440:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff9dc081b16000/0xcc1762b626f8ca90 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189326.932449:0:6510:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: ffff9dc081b16000/0xcc1762b626f8ca90 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189326.932459:0:6510:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: ffff9dc081b16000/0xcc1762b626f8ca90 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784189326.932474:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc0505bdf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458243712:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1784189326.932505:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784189326.932525:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dc074a76780 going to sleep for 11 seconds 00000100:00100000:2.0:1784189326.932577:0:94309:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458243712 00000100:00100000:2.0:1784189326.932582:0:94309:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458243712 00000100:00100000:2.0:1784189326.932615:0:94309:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1784189326.932630:0:94309:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf44d0e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd553d0d-03e2-4233-b06b-b55bbfa2b954+19:6510:x1870854458243712:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1784189326.932640:0:94309:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784189326.932654:0:94309:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dc0565e7e00/0xcc1762b626f8ca97 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xcc1762b626f8ca90 expref: -99 pid: 94309 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189326.932678:0:94309:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dc0565e7e00/0xcc1762b626f8ca97 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcc1762b626f8ca90 expref: 20 pid: 94309 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189326.932689:0:94309:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dc0565e7e00/0xcc1762b626f8ca97 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcc1762b626f8ca90 expref: 20 pid: 94309 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189326.932698:0:94309:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc0565e7e00, rc 0) 00000100:00100000:2.0:1784189326.932727:0:94309:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf44d0e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd553d0d-03e2-4233-b06b-b55bbfa2b954+20:6510:x1870854458243712:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 98us (220us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189326.932733:0:94309:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1784189326.932978:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc0505bdf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458243712:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784189326.932994:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: ffff9dc081b16000/0xcc1762b626f8ca90 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc1762b626f8ca97 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189326.933004:0:6510:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: ffff9dc081b16000/0xcc1762b626f8ca90 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xcc1762b626f8ca97 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784189326.933058:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc0505bdf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458243840:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1784189326.933094:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784189326.933116:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dc074a76780 going to sleep for 11 seconds 00000100:00100000:2.0:1784189326.933157:0:94310:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458243840 00000100:00100000:2.0:1784189326.933162:0:94310:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458243840 00000100:00100000:2.0:1784189326.933199:0:94310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1784189326.933205:0:94310:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf44d0e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd553d0d-03e2-4233-b06b-b55bbfa2b954+20:6510:x1870854458243840:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1784189326.933344:0:94310:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf44d0e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd553d0d-03e2-4233-b06b-b55bbfa2b954+20:6510:x1870854458243840:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 138us (249us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189326.933351:0:94310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1784189326.933418:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc0505bdf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458243840:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784189326.933446:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf46903480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458243968:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1784189326.933483:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784189326.933505:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dc048b2d840 going to sleep for 11 seconds 00000100:00100000:0.0:1784189326.933604:0:94309:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458243968 00000100:00100000:0.0:1784189326.933609:0:94309:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458243968 00000100:00100000:0.0:1784189326.933641:0:94309:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1784189326.933649:0:94309:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf44d0cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd553d0d-03e2-4233-b06b-b55bbfa2b954+20:6510:x1870854458243968:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1784189326.933727:0:94309:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf44d0cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd553d0d-03e2-4233-b06b-b55bbfa2b954+20:6510:x1870854458243968:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 78us (243us total) trans 0 rc 0/0 00000100:00100000:0.0:1784189326.933734:0:94309:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1784189326.934005:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf46903480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458243968:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1784189326.941262:0:95235:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc080f68700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bd553d0d-03e2-4233-b06b-b55bbfa2b954:95235:1870854458244096:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1784189326.941493:0:95235:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784189326.941546:0:95235:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dbf42629000 going to sleep for 11 seconds 00000100:00100000:0.0:1784189326.941598:0:94310:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458244096 00000100:00100000:0.0:1784189326.941607:0:94310:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458244096 00000100:00100000:0.0:1784189326.941664:0:94310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1784189326.941675:0:94310:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf44d0d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd553d0d-03e2-4233-b06b-b55bbfa2b954+20:95235:x1870854458244096:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1784189326.941823:0:94310:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf44d0d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd553d0d-03e2-4233-b06b-b55bbfa2b954+20:95235:x1870854458244096:12345-0@lo:502:llog_process_th.0 Request processed in 149us (330us total) trans 0 rc 0/0 00000100:00100000:0.0:1784189326.941838:0:94310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1784189326.941984:0:95235:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc080f68700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bd553d0d-03e2-4233-b06b-b55bbfa2b954:95235:1870854458244096:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1784189326.942036:0:95235:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf46903480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bd553d0d-03e2-4233-b06b-b55bbfa2b954:95235:1870854458244224:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1784189326.942069:0:95235:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784189326.942089:0:95235:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dbf46a20840 going to sleep for 11 seconds 00000100:00100000:2.0:1784189326.942126:0:94309:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458244224 00000100:00100000:2.0:1784189326.942130:0:94309:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458244224 00000100:00100000:2.0:1784189326.942161:0:94309:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1784189326.942174:0:94309:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf44d0c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd553d0d-03e2-4233-b06b-b55bbfa2b954+20:95235:x1870854458244224:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1784189326.942353:0:94309:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf44d0c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd553d0d-03e2-4233-b06b-b55bbfa2b954+20:95235:x1870854458244224:12345-0@lo:502:llog_process_th.0 Request processed in 177us (281us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189326.942360:0:94309:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1784189326.942466:0:95235:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf46903480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bd553d0d-03e2-4233-b06b-b55bbfa2b954:95235:1870854458244224:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1784189326.942488:0:95235:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 61 count 60 00000020:01000000:2.0:1784189326.942654:0:6510:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 58-60 (rc=0) 10000000:01000000:2.0:1784189326.942682:0:6510:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1784189326.942694:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff9dc081b16000/0xcc1762b626f8ca90 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc1762b626f8ca97 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189326.942706:0:6510:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: ffff9dc081b16000/0xcc1762b626f8ca90 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc1762b626f8ca97 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784189326.942716:0:6510:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:2.0:1784189326.942719:0:6510:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 11 10000000:01000000:2.0:1784189326.942721:0:6510:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:2.0:1784189326.942749:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff9dc0565e7800/0xcc1762b626f8ca9e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189326.942758:0:6510:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: ffff9dc0565e7800/0xcc1762b626f8ca9e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189326.942768:0:6510:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: ffff9dc0565e7800/0xcc1762b626f8ca9e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784189326.942782:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc080f69500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458244352:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1784189326.942810:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784189326.942898:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dbf42629d80 going to sleep for 11 seconds 00000100:00100000:0.0:1784189326.942959:0:94308:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458244352 00000100:00100000:0.0:1784189326.942964:0:94308:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458244352 00000100:00100000:0.0:1784189326.942994:0:94308:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1784189326.943001:0:94308:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf44d0ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd553d0d-03e2-4233-b06b-b55bbfa2b954+20:6510:x1870854458244352:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784189326.943010:0:94308:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784189326.943024:0:94308:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dc081b16800/0xcc1762b626f8caa5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xcc1762b626f8ca9e expref: -99 pid: 94308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189326.943048:0:94308:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dc081b16800/0xcc1762b626f8caa5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcc1762b626f8ca9e expref: 21 pid: 94308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189326.943072:0:94308:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dc081b16800/0xcc1762b626f8caa5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcc1762b626f8ca9e expref: 21 pid: 94308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189326.943082:0:94308:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc081b16800, rc 0) 00000100:00100000:0.0:1784189326.943117:0:94308:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf44d0ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd553d0d-03e2-4233-b06b-b55bbfa2b954+21:6510:x1870854458244352:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 117us (306us total) trans 0 rc 0/0 00000100:00100000:0.0:1784189326.943124:0:94308:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1784189326.943196:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc080f69500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458244352:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1784189326.943217:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: ffff9dc0565e7800/0xcc1762b626f8ca9e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc1762b626f8caa5 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189326.943228:0:6510:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: ffff9dc0565e7800/0xcc1762b626f8ca9e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xcc1762b626f8caa5 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784189326.943350:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc080f69500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458244480:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1784189326.943373:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784189326.943386:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dbf42629d80 going to sleep for 11 seconds 00000100:00100000:0.0:1784189326.943456:0:94309:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458244480 00000100:00100000:0.0:1784189326.943460:0:94309:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458244480 00000100:00100000:0.0:1784189326.943510:0:94309:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1784189326.943516:0:94309:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf44d0d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd553d0d-03e2-4233-b06b-b55bbfa2b954+21:6510:x1870854458244480:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1784189326.943654:0:94309:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf44d0d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd553d0d-03e2-4233-b06b-b55bbfa2b954+21:6510:x1870854458244480:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 139us (280us total) trans 0 rc 0/0 00000100:00100000:0.0:1784189326.943661:0:94309:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1784189326.943758:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc080f69500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458244480:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1784189326.943781:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc080f69500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458244608:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1784189326.943814:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784189326.944357:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dbf42629d80 going to sleep for 11 seconds 00000100:00100000:3.0:1784189326.944580:0:94308:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458244608 00000100:00100000:3.0:1784189326.944586:0:94308:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458244608 00000100:00100000:3.0:1784189326.944617:0:94308:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1784189326.944623:0:94308:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf44d0c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd553d0d-03e2-4233-b06b-b55bbfa2b954+21:6510:x1870854458244608:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1784189326.944740:0:94308:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf44d0c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd553d0d-03e2-4233-b06b-b55bbfa2b954+21:6510:x1870854458244608:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 116us (924us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189326.944747:0:94308:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1784189326.944827:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc080f69500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458244608:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1784189326.946441:0:95236:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 64768 count 11 00000020:01000000:3.0:1784189326.946916:0:6510:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 11-10 (rc=0) 10000000:01000000:3.0:1784189326.946954:0:6510:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:3.0:1784189326.946967:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff9dc0565e7800/0xcc1762b626f8ca9e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc1762b626f8caa5 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189326.946980:0:6510:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: ffff9dc0565e7800/0xcc1762b626f8ca9e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc1762b626f8caa5 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784189326.946991:0:6510:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1784189326.946993:0:6510:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9dc07b5d6800 from 58 10000000:01000000:3.0:1784189326.946996:0:6510:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1784189326.947042:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff9dc058f66200/0xcc1762b626f8caac lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189326.947069:0:6510:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: ffff9dc058f66200/0xcc1762b626f8caac lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189326.947082:0:6510:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: ffff9dc058f66200/0xcc1762b626f8caac lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784189326.947203:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf46903480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458244736:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1784189326.947819:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784189326.947954:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dbf46a206c0 going to sleep for 11 seconds 00000100:00100000:0.0:1784189326.948029:0:94308:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458244736 00000100:00100000:0.0:1784189326.948037:0:94308:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458244736 00000100:00100000:0.0:1784189326.948127:0:94308:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1784189326.948139:0:94308:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf44d0d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd553d0d-03e2-4233-b06b-b55bbfa2b954+21:6510:x1870854458244736:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784189326.948156:0:94308:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784189326.948174:0:94308:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dc081b16600/0xcc1762b626f8cab3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xcc1762b626f8caac expref: -99 pid: 94308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189326.948203:0:94308:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dc081b16600/0xcc1762b626f8cab3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcc1762b626f8caac expref: 22 pid: 94308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189326.948216:0:94308:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dc081b16600/0xcc1762b626f8cab3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcc1762b626f8caac expref: 22 pid: 94308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189326.948252:0:94308:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc081b16600, rc 0) 00000100:00100000:0.0:1784189326.948307:0:94308:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf44d0d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd553d0d-03e2-4233-b06b-b55bbfa2b954+22:6510:x1870854458244736:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 169us (489us total) trans 0 rc 0/0 00000100:00100000:0.0:1784189326.948314:0:94308:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1784189326.948411:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf46903480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458244736:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1784189326.948428:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: ffff9dc058f66200/0xcc1762b626f8caac lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc1762b626f8cab3 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189326.948437:0:6510:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: ffff9dc058f66200/0xcc1762b626f8caac lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xcc1762b626f8cab3 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784189326.948523:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc080f69500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458244864:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1784189326.948555:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784189326.948807:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dbf42629000 going to sleep for 11 seconds 00000100:00100000:0.0:1784189326.948968:0:94308:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458244864 00000100:00100000:0.0:1784189326.948973:0:94308:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458244864 00000100:00100000:0.0:1784189326.949005:0:94308:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1784189326.949012:0:94308:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf44d0f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd553d0d-03e2-4233-b06b-b55bbfa2b954+22:6510:x1870854458244864:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1784189326.949174:0:94308:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf44d0f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd553d0d-03e2-4233-b06b-b55bbfa2b954+22:6510:x1870854458244864:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 162us (617us total) trans 0 rc 0/0 00000100:00100000:0.0:1784189326.949182:0:94308:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1784189326.949276:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc080f69500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458244864:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1784189326.949312:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc080f69500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458244992:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1784189326.949383:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784189326.949398:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dbf42629000 going to sleep for 11 seconds 00000100:00100000:0.0:1784189326.949492:0:94308:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458244992 00000100:00100000:0.0:1784189326.949497:0:94308:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458244992 00000100:00100000:0.0:1784189326.949534:0:94308:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1784189326.949540:0:94308:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf44d0e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd553d0d-03e2-4233-b06b-b55bbfa2b954+22:6510:x1870854458244992:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1784189326.949622:0:94308:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf44d0e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd553d0d-03e2-4233-b06b-b55bbfa2b954+22:6510:x1870854458244992:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 82us (240us total) trans 0 rc 0/0 00000100:00100000:0.0:1784189326.949630:0:94308:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1784189326.950004:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc080f69500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458244992:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1784189326.954912:0:95237:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc080f69500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bd553d0d-03e2-4233-b06b-b55bbfa2b954:95237:1870854458245120:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1784189326.955051:0:95237:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784189326.955108:0:95237:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dbf42629780 going to sleep for 11 seconds 00000100:00100000:0.0:1784189326.955213:0:94308:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458245120 00000100:00100000:0.0:1784189326.955222:0:94308:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458245120 00000100:00100000:0.0:1784189326.955288:0:94308:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1784189326.955300:0:94308:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc080e3b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd553d0d-03e2-4233-b06b-b55bbfa2b954+22:95237:x1870854458245120:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1784189326.955500:0:94308:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc080e3b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd553d0d-03e2-4233-b06b-b55bbfa2b954+22:95237:x1870854458245120:12345-0@lo:502:llog_process_th.0 Request processed in 202us (449us total) trans 0 rc 0/0 00000100:00100000:0.0:1784189326.955510:0:94308:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1784189326.955739:0:95237:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc080f69500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bd553d0d-03e2-4233-b06b-b55bbfa2b954:95237:1870854458245120:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1784189326.955920:0:95237:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf46900a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bd553d0d-03e2-4233-b06b-b55bbfa2b954:95237:1870854458245248:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1784189326.955974:0:95237:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784189326.956008:0:95237:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dbf46a20c00 going to sleep for 11 seconds 00000100:00100000:0.0:1784189326.956054:0:94314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458245248 00000100:00100000:0.0:1784189326.956059:0:94314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458245248 00000100:00100000:0.0:1784189326.956093:0:94314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1784189326.956100:0:94314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc080e38850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:bd553d0d-03e2-4233-b06b-b55bbfa2b954+22:95237:x1870854458245248:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1784189326.956246:0:94314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc080e38850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:bd553d0d-03e2-4233-b06b-b55bbfa2b954+22:95237:x1870854458245248:12345-0@lo:502:llog_process_th.0 Request processed in 147us (272us total) trans 0 rc 0/0 00000100:00100000:0.0:1784189326.956254:0:94314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1784189326.957795:0:95237:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf46900a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bd553d0d-03e2-4233-b06b-b55bbfa2b954:95237:1870854458245248:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1784189326.957912:0:95237:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 61 count 60 00000020:01000000:0.0:1784189326.958168:0:6510:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 58-60 (rc=0) 10000000:01000000:0.0:1784189326.958197:0:6510:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1784189326.958212:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff9dc058f66200/0xcc1762b626f8caac lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc1762b626f8cab3 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189326.958224:0:6510:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: ffff9dc058f66200/0xcc1762b626f8caac lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc1762b626f8cab3 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784189326.958455:0:6510:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:0.0:1784189326.958458:0:6510:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 14 10000000:01000000:0.0:1784189326.958462:0:6510:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:0.0:1784189326.958516:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff9dc081b17e00/0xcc1762b626f8caba lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189326.958525:0:6510:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: ffff9dc081b17e00/0xcc1762b626f8caba lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189326.958538:0:6510:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: ffff9dc081b17e00/0xcc1762b626f8caba lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784189326.958566:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc0505be680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458245376:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1784189326.958640:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784189326.958739:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dc06231a840 going to sleep for 11 seconds 00000100:00100000:3.0:1784189326.958783:0:94308:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458245376 00000100:00100000:3.0:1784189326.958792:0:94308:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458245376 00000100:00100000:3.0:1784189326.959004:0:94308:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1784189326.959017:0:94308:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc080e3a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd553d0d-03e2-4233-b06b-b55bbfa2b954+22:6510:x1870854458245376:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784189326.959032:0:94308:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784189326.959049:0:94308:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dc058f67200/0xcc1762b626f8cac1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xcc1762b626f8caba expref: -99 pid: 94308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189326.959081:0:94308:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dc058f67200/0xcc1762b626f8cac1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcc1762b626f8caba expref: 23 pid: 94308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189326.959110:0:94308:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dc058f67200/0xcc1762b626f8cac1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcc1762b626f8caba expref: 23 pid: 94308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189326.959120:0:94308:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc058f67200, rc 0) 00000100:00100000:3.0:1784189326.959370:0:94308:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc080e3a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd553d0d-03e2-4233-b06b-b55bbfa2b954+23:6510:x1870854458245376:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 355us (728us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189326.959378:0:94308:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1784189326.959716:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc0505be680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458245376:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784189326.959738:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: ffff9dc081b17e00/0xcc1762b626f8caba lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc1762b626f8cac1 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189326.959749:0:6510:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: ffff9dc081b17e00/0xcc1762b626f8caba lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0xcc1762b626f8cac1 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784189326.959826:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc0505be680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458245504:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1784189326.959935:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784189326.960011:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dc06231a840 going to sleep for 11 seconds 00000100:00100000:1.0:1784189326.960045:0:94309:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458245504 00000100:00100000:1.0:1784189326.960052:0:94309:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458245504 00000100:00100000:1.0:1784189326.960121:0:94309:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:1.0:1784189326.960130:0:94309:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc080e3a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd553d0d-03e2-4233-b06b-b55bbfa2b954+23:6510:x1870854458245504:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1784189326.960306:0:94309:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc080e3a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd553d0d-03e2-4233-b06b-b55bbfa2b954+23:6510:x1870854458245504:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 176us (369us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189326.960313:0:94309:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:2.0:1784189326.960674:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc0505be680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458245504:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1784189326.960719:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc080f6aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458245632:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1784189326.960773:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784189326.960796:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dbf42629d80 going to sleep for 11 seconds 00000100:00100000:1.0:1784189326.962224:0:94310:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458245632 00000100:00100000:1.0:1784189326.962252:0:94310:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458245632 00000100:00100000:1.0:1784189326.962359:0:94310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:1.0:1784189326.962371:0:94310:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc080e3ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd553d0d-03e2-4233-b06b-b55bbfa2b954+23:6510:x1870854458245632:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1784189326.962575:0:94310:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc080e3ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd553d0d-03e2-4233-b06b-b55bbfa2b954+23:6510:x1870854458245632:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 207us (1800us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189326.962584:0:94310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:2.0:1784189326.962749:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc080f6aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458245632:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1784189326.967010:0:95238:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 64768 count 14 00000020:01000000:0.0:1784189326.974256:0:6510:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 14-13 (rc=0) 10000000:01000000:0.0:1784189326.974590:0:6510:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:0.0:1784189326.974605:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff9dc081b17e00/0xcc1762b626f8caba lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc1762b626f8cac1 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189326.974621:0:6510:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: ffff9dc081b17e00/0xcc1762b626f8caba lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc1762b626f8cac1 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784189326.974651:0:6510:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:0.0:1784189326.974655:0:6510:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-sptlrpc-ffff9dc06bb30000 from 1 10000000:01000000:0.0:1784189326.974658:0:6510:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1784189326.974714:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff9dc081b16e00/0xcc1762b626f8cac8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189326.974724:0:6510:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: ffff9dc081b16e00/0xcc1762b626f8cac8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189326.974737:0:6510:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: ffff9dc081b16e00/0xcc1762b626f8cac8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784189326.974795:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc0505be300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458245760:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1784189326.976122:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784189326.976176:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dc06231a600 going to sleep for 11 seconds 00000100:00100000:1.0:1784189326.977010:0:94310:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458245760 00000100:00100000:1.0:1784189326.977023:0:94310:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458245760 00000100:00100000:1.0:1784189326.977117:0:94310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:1.0:1784189326.977128:0:94310:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc080e39850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd553d0d-03e2-4233-b06b-b55bbfa2b954+23:6510:x1870854458245760:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784189326.977166:0:94310:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784189326.977187:0:94310:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dc042d66e00/0xcc1762b626f8cacf lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xcc1762b626f8cac8 expref: -99 pid: 94310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189326.977223:0:94310:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dc042d66e00/0xcc1762b626f8cacf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcc1762b626f8cac8 expref: 24 pid: 94310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189326.977236:0:94310:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dc042d66e00/0xcc1762b626f8cacf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcc1762b626f8cac8 expref: 24 pid: 94310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189326.977247:0:94310:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc042d66e00, rc 0) 00000100:00100000:1.0:1784189326.977356:0:94310:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc080e39850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd553d0d-03e2-4233-b06b-b55bbfa2b954+24:6510:x1870854458245760:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 229us (1240us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189326.977364:0:94310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:0.0:1784189326.978390:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc0505be300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458245760:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784189326.978421:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: ffff9dc081b16e00/0xcc1762b626f8cac8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc1762b626f8cacf expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189326.978435:0:6510:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: ffff9dc081b16e00/0xcc1762b626f8cac8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0xcc1762b626f8cacf expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784189326.978542:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc0505be300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458245888:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1784189326.978598:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784189326.978638:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dc06231a600 going to sleep for 11 seconds 00000100:00100000:3.0:1784189326.978727:0:94308:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458245888 00000100:00100000:3.0:1784189326.978734:0:94308:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458245888 00000100:00100000:3.0:1784189326.978773:0:94308:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:3.0:1784189326.978781:0:94308:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc080e39050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd553d0d-03e2-4233-b06b-b55bbfa2b954+24:6510:x1870854458245888:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784189326.978893:0:94308:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc080e39050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd553d0d-03e2-4233-b06b-b55bbfa2b954+24:6510:x1870854458245888:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 112us (295us total) trans 0 rc -2/-2 00000100:00100000:3.0:1784189326.978901:0:94308:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:0.0:1784189326.979174:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc0505be300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458245888:0@lo:501:ll_cfg_requeue.0 10000000:01000000:0.0:1784189326.979207:0:6510:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1784189326.979215:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff9dc081b16e00/0xcc1762b626f8cac8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc1762b626f8cacf expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189326.979225:0:6510:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: ffff9dc081b16e00/0xcc1762b626f8cac8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc1762b626f8cacf expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784189327.080793:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1784189327.080891:0:94310:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436329728 00000100:00100000:1.0:1784189327.080904:0:94310:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436329728 00000100:00100000:1.0:1784189327.080986:0:94310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 118 00000100:00100000:1.0:1784189327.080999:0:94310:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc080e3a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:60f345e3-c70e-4f53-b5e7-c9671463c9a5+8:70943:x1870854436329728:12345-192.168.203.12@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784189327.081020:0:94310:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784189327.081045:0:94310:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dc042d67400/0xcc1762b626f8cad6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xcbfc5de7fe6c40fd expref: -99 pid: 94310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189327.081084:0:94310:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dc042d67400/0xcc1762b626f8cad6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c40fd expref: 9 pid: 94310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189327.081097:0:94310:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dc042d67400/0xcc1762b626f8cad6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c40fd expref: 9 pid: 94310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189327.081108:0:94310:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc042d67400, rc 0) 00000100:00100000:1.0:1784189327.081217:0:94310:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc080e3a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:60f345e3-c70e-4f53-b5e7-c9671463c9a5+9:70943:x1870854436329728:12345-192.168.203.12@tcp:101:ll_cfg_requeue.0 Request processed in 220us (437us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189327.081226:0:94310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 118 00010000:00010000:3.0:1784189327.087709:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784189327.087955:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1784189327.088044:0:94308:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436329856 00000100:00100000:3.0:1784189327.088064:0:94308:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436329856 00000100:00100000:3.0:1784189327.088137:0:94308:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 119 00000100:00100000:3.0:1784189327.088149:0:94308:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc080e39450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:60f345e3-c70e-4f53-b5e7-c9671463c9a5+9:70943:x1870854436329856:12345-192.168.203.12@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784189327.088561:0:94308:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc080e39450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:60f345e3-c70e-4f53-b5e7-c9671463c9a5+9:70943:x1870854436329856:12345-192.168.203.12@tcp:501:ll_cfg_requeue.0 Request processed in 411us (622us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189327.088571:0:94308:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 119 00000100:00100000:2.0:1784189327.090827:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1784189327.090913:0:94310:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436329984 00000100:00100000:1.0:1784189327.090926:0:94310:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436329984 00000100:00100000:1.0:1784189327.091004:0:94310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 120 00000100:00100000:1.0:1784189327.091016:0:94310:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc080e3b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:60f345e3-c70e-4f53-b5e7-c9671463c9a5+9:70943:x1870854436329984:12345-192.168.203.12@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1784189327.091236:0:94310:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc080e3b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:60f345e3-c70e-4f53-b5e7-c9671463c9a5+9:70943:x1870854436329984:12345-192.168.203.12@tcp:503:ll_cfg_requeue.0 Request processed in 221us (423us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189327.091245:0:94310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 120 00000100:00100000:2.0:1784189327.099838:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1784189327.100269:0:94314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436330112 00000100:00100000:0.0:1784189327.100294:0:94314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436330112 00000100:00100000:0.0:1784189327.100407:0:94314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 121 00000100:00100000:0.0:1784189327.100419:0:94314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc080e38450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:60f345e3-c70e-4f53-b5e7-c9671463c9a5+9:73317:x1870854436330112:12345-192.168.203.12@tcp:502:llog_process_th.0 00000100:00100000:0.0:1784189327.100639:0:94314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc080e38450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:60f345e3-c70e-4f53-b5e7-c9671463c9a5+9:73317:x1870854436330112:12345-192.168.203.12@tcp:502:llog_process_th.0 Request processed in 222us (815us total) trans 0 rc 0/0 00000100:00100000:0.0:1784189327.100648:0:94314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 121 00000100:00100000:2.0:1784189327.105709:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1784189327.105811:0:94310:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436330240 00000100:00100000:1.0:1784189327.105857:0:94310:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436330240 00000100:00100000:1.0:1784189327.105936:0:94310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 122 00000100:00100000:1.0:1784189327.105956:0:94310:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc080e3bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:60f345e3-c70e-4f53-b5e7-c9671463c9a5+9:73317:x1870854436330240:12345-192.168.203.12@tcp:502:llog_process_th.0 00000100:00100000:1.0:1784189327.106419:0:94310:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc080e3bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:60f345e3-c70e-4f53-b5e7-c9671463c9a5+9:73317:x1870854436330240:12345-192.168.203.12@tcp:502:llog_process_th.0 Request processed in 464us (721us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189327.106428:0:94310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 122 00000100:00100000:2.0:1784189327.117637:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1784189327.120894:0:94314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436330368 00000100:00100000:0.0:1784189327.120918:0:94314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436330368 00000100:00100000:0.0:1784189327.121040:0:94314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 123 00000100:00100000:0.0:1784189327.121061:0:94314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc080e38c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:60f345e3-c70e-4f53-b5e7-c9671463c9a5+9:70943:x1870854436330368:12345-192.168.203.12@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784189327.121087:0:94314:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784189327.121115:0:94314:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dc081b17a00/0xcc1762b626f8cadd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0xcbfc5de7fe6c4104 expref: -99 pid: 94314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189327.121157:0:94314:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dc081b17a00/0xcc1762b626f8cadd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c4104 expref: 10 pid: 94314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189327.121172:0:94314:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dc081b17a00/0xcc1762b626f8cadd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c4104 expref: 10 pid: 94314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189327.121183:0:94314:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc081b17a00, rc 0) 00000100:00100000:0.0:1784189327.121281:0:94314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc080e38c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:60f345e3-c70e-4f53-b5e7-c9671463c9a5+10:70943:x1870854436330368:12345-192.168.203.12@tcp:101:ll_cfg_requeue.0 Request processed in 231us (3659us total) trans 0 rc 0/0 00000100:00100000:0.0:1784189327.121289:0:94314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 123 00000100:00100000:2.0:1784189327.127638:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1784189327.127740:0:94309:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436330496 00000100:00100000:3.0:1784189327.127753:0:94309:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436330496 00000100:00100000:3.0:1784189327.127830:0:94309:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 124 00000100:00100000:3.0:1784189327.127842:0:94309:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc080e3b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:60f345e3-c70e-4f53-b5e7-c9671463c9a5+10:70943:x1870854436330496:12345-192.168.203.12@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784189327.128144:0:94309:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc080e3b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:60f345e3-c70e-4f53-b5e7-c9671463c9a5+10:70943:x1870854436330496:12345-192.168.203.12@tcp:501:ll_cfg_requeue.0 Request processed in 301us (520us total) trans 0 rc -2/-2 00000100:00100000:3.0:1784189327.128153:0:94309:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 124 00000100:00100000:1.0:1784189327.919630:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc0505bfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3640:1870854458246400:0@lo:400:kworker.0 00000100:00100000:1.0:1784189327.919701:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784189327.919822:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc05edd2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1870854458246912:0@lo:400:kworker.0 00000100:00100000:1.0:1784189327.919849:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784189327.919865:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc0477c2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1870854458247424:0@lo:400:kworker.0 00000100:00100000:1.0:1784189327.919886:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784189327.919907:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [1->0] 00000100:00100000:1.0:1784189327.919920:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc0505be300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bd553d0d-03e2-4233-b06b-b55bbfa2b954:3640:1870854458246016:0@lo:400:kworker.0 00000100:00100000:1.0:1784189327.919958:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784189327.919986:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc05edd0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3640:1870854458246528:0@lo:400:kworker.0 00000100:00100000:1.0:1784189327.920007:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784189327.920023:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc05edd2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3640:1870854458247040:0@lo:400:kworker.0 00000100:00100000:1.0:1784189327.920043:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784189327.920057:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc0477c0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3640:1870854458247552:0@lo:400:kworker.0 00000100:00100000:1.0:1784189327.920078:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784189327.920816:0:68287:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458246400 00000100:00100000:1.0:1784189327.920824:0:68287:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458246400 00000100:00100000:1.0:1784189327.920879:0:68287:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458246528 00000100:00100000:1.0:1784189327.920883:0:68287:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458246528 00000100:00100000:1.0:1784189327.920898:0:68287:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458247040 00000100:00100000:1.0:1784189327.920901:0:68287:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458247040 00000100:00100000:1.0:1784189327.920910:0:68287:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458247552 00000100:00100000:1.0:1784189327.920912:0:68287:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458247552 00000100:00100000:1.0:1784189327.920926:0:68287:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1329 00000100:00100000:2.0:1784189327.920943:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc0505be680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3642:1870854458246144:0@lo:400:kworker.0 00000100:00100000:1.0:1784189327.920943:0:68287:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf4a342a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3640:x1870854458246400:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784189327.920979:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784189327.920990:0:68287:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf4a342a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3640:x1870854458246400:12345-0@lo:400:kworker.0 Request processed in 57us (1289us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189327.920992:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc05edd3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1870854458246656:0@lo:400:kworker.0 00000100:00100000:1.0:1784189327.921009:0:68287:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1329 00000100:00100000:2.0:1784189327.921026:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784189327.921026:0:68287:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458246144 00000100:00100000:1.0:1784189327.921028:0:68287:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458246144 00000100:00100000:2.0:1784189327.921043:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc05edd2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1870854458247168:0@lo:400:kworker.0 00000100:00100000:1.0:1784189327.921045:0:68287:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1330 00000100:00100000:1.0:1784189327.921050:0:68287:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf4a343480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1870854458246528:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784189327.921062:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784189327.921074:0:68287:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf4a343480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1870854458246528:12345-0@lo:400:kworker.0 Request processed in 24us (1066us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189327.921082:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:2.0:1784189327.921088:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc0505bdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3642:1870854458246272:0@lo:400:kworker.0 00000100:00100000:1.0:1784189327.921103:0:68287:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1330 00000100:00100000:2.0:1784189327.921108:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784189327.921114:0:68287:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458246272 00000100:00100000:1.0:1784189327.921117:0:68287:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458246272 00000100:00100000:2.0:1784189327.921118:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc05edd1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1870854458246784:0@lo:400:kworker.0 00000100:00100000:1.0:1784189327.921133:0:68287:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1331 00000100:00100000:2.0:1784189327.921136:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784189327.921137:0:68287:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf4a340a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1870854458247040:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784189327.921150:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc05edd0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1870854458247296:0@lo:400:kworker.0 00000100:00100000:2.0:1784189327.921168:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784189327.921178:0:68287:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf4a340a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1870854458247040:12345-0@lo:400:kworker.0 Request processed in 40us (1134us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189327.921184:0:68287:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1331 00000100:00100000:2.0:1784189327.921194:0:66945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1332 00000100:00100000:1.0:1784189327.921198:0:68287:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1333 00000100:00100000:2.0:1784189327.921202:0:66945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf4a342300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1870854458247552:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784189327.921203:0:68287:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc080f6aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3642:x1870854458246144:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784189327.921229:0:66945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf4a342300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1870854458247552:12345-0@lo:400:kworker.0 Request processed in 29us (1150us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189327.921232:0:68287:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc080f6aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3642:x1870854458246144:12345-0@lo:400:kworker.0 Request processed in 29us (253us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189327.921236:0:66945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1332 00000100:00100000:1.0:1784189327.921238:0:68287:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1333 00000100:00100000:2.0:1784189327.921248:0:66945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1334 00000100:00100000:2.0:1784189327.921260:0:66945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc080f68700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1870854458246272:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784189327.921289:0:66945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc080f68700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1870854458246272:12345-0@lo:400:kworker.0 Request processed in 36us (180us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189327.921370:0:26159:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458246912 00000100:00100000:3.0:1784189327.921375:0:26159:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458246912 00000100:00100000:3.0:1784189327.921406:0:26159:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458247424 00000100:00100000:3.0:1784189327.921409:0:26159:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458247424 00000100:00100000:3.0:1784189327.921427:0:26159:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458246784 00000100:00100000:3.0:1784189327.921430:0:26159:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458246784 00000100:00100000:3.0:1784189327.921448:0:26159:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458247296 00000100:00100000:3.0:1784189327.921451:0:26159:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458247296 00000100:00100000:3.0:1784189327.921470:0:26159:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2577 00000100:00100000:3.0:1784189327.921476:0:26159:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf4a343100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3640:x1870854458246912:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784189327.921508:0:26159:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf4a343100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3640:x1870854458246912:12345-0@lo:400:kworker.0 Request processed in 33us (1658us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189327.921515:0:26159:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2577 00000100:00100000:3.0:1784189327.921527:0:26159:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2578 00000100:00100000:3.0:1784189327.921534:0:26159:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf4a341f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3640:x1870854458247424:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784189327.921543:0:94314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458246016 00000100:00100000:1.0:1784189327.921547:0:94314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458246016 00000100:00100000:3.0:1784189327.921561:0:26159:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf4a341f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3640:x1870854458247424:12345-0@lo:400:kworker.0 Request processed in 28us (1674us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189327.921566:0:26159:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2578 00000100:00100000:1.0:1784189327.921572:0:94314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:3.0:1784189327.921578:0:26159:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2579 00000100:00100000:1.0:1784189327.921578:0:94314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc07fa60050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:bd553d0d-03e2-4233-b06b-b55bbfa2b954+24:3640:x1870854458246016:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784189327.921582:0:26159:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc080f68e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3642:x1870854458246784:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784189327.921604:0:26159:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc080f68e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3642:x1870854458246784:12345-0@lo:400:kworker.0 Request processed in 21us (466us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189327.921605:0:94314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc07fa60050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:bd553d0d-03e2-4233-b06b-b55bbfa2b954+24:3640:x1870854458246016:12345-0@lo:400:kworker.0 Request processed in 28us (1647us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189327.921609:0:26159:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2579 00000100:00100000:1.0:1784189327.921611:0:94314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:3.0:1784189327.921626:0:26159:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2580 00000100:00100000:3.0:1784189327.921631:0:26159:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc080f6bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3642:x1870854458247296:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1784189327.921641:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1784189327.921645:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1784189327.921647:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1784189327.921649:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1784189327.921656:0:26159:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc080f6bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3642:x1870854458247296:12345-0@lo:400:kworker.0 Request processed in 25us (488us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189327.921658:0:23826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458246656 00000100:00100000:1.0:1784189327.921661:0:23826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458246656 00000100:00100000:3.0:1784189327.921662:0:26159:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2580 00000100:00100000:1.0:1784189327.921682:0:23826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458247168 00000100:00100000:3.0:1784189327.921684:0:26492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3944 00000100:00100000:3.0:1784189327.921689:0:26492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc080f69180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3642:x1870854458246656:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784189327.921689:0:23826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458247168 00000100:00100000:1.0:1784189327.921709:0:23826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3945 00000100:00100000:1.0:1784189327.921715:0:23826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc080f69500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3642:x1870854458247168:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784189327.921716:0:26492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc080f69180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3642:x1870854458246656:12345-0@lo:400:kworker.0 Request processed in 27us (690us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189327.921721:0:26492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3944 00000100:00100000:3.0:1784189327.921817:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf46902d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1870854458247808:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1784189327.921843:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784189327.921861:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1784189327.921867:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf46900a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1870854458247680:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1784189327.921878:0:23826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc080f69500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3642:x1870854458247168:12345-0@lo:400:kworker.0 Request processed in 163us (815us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189327.921885:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784189327.921885:0:23826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3945 00000100:00100000:1.0:1784189327.921896:0:23826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458247808 00000100:00100000:1.0:1784189327.921899:0:23826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458247808 00000100:00100000:3.0:1784189327.921903:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458247680 00000100:00100000:3.0:1784189327.921906:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458247680 00000100:00100000:1.0:1784189327.921912:0:23826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3946 00000100:00100000:1.0:1784189327.921917:0:23826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf46900700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3643:x1870854458247808:12345-0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1784189327.921919:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3947 00000100:00100000:3.0:1784189327.921924:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf46900380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3643:x1870854458247680:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1784189327.921949:0:23826:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445228544 avail 1298989056 00000004:00000024:3.0:1784189327.921951:0:8438:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445568512 avail 1299329024 00000100:00100000:3.0:1784189327.932378:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf46900380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3643:x1870854458247680:12345-0@lo:41:osp-pre-1-0.0 Request processed in 10441us (10480us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189327.932393:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3947 00000100:00100000:3.0:1784189327.932483:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf46900a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1870854458247680:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1784189327.932499:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf46902d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1870854458247808:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1784189327.934835:0:66945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1334 00000100:00100000:0.0:1784189327.935917:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc0505be300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bd553d0d-03e2-4233-b06b-b55bbfa2b954:3640:1870854458246016:0@lo:400:kworker.0 00000100:00100000:0.0:1784189327.935949:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc05edd0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3640:1870854458246528:0@lo:400:kworker.0 00000100:00100000:0.0:1784189327.935963:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc05edd2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3640:1870854458247040:0@lo:400:kworker.0 00000100:00100000:0.0:1784189327.935973:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc0477c0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3640:1870854458247552:0@lo:400:kworker.0 00000100:00100000:0.0:1784189327.935994:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc0505bfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3640:1870854458246400:0@lo:400:kworker.0 00000100:00100000:0.0:1784189327.936005:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc05edd2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1870854458246912:0@lo:400:kworker.0 00000100:00100000:0.0:1784189327.936016:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc0477c2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1870854458247424:0@lo:400:kworker.0 00000100:00100000:0.0:1784189327.936071:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc0505bdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3642:1870854458246272:0@lo:400:kworker.0 00000100:00100000:0.0:1784189327.936082:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc05edd1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1870854458246784:0@lo:400:kworker.0 00000100:00100000:0.0:1784189327.936093:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc05edd0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1870854458247296:0@lo:400:kworker.0 00000100:00100000:0.0:1784189327.936104:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc0505be680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3642:1870854458246144:0@lo:400:kworker.0 00000100:00100000:0.0:1784189327.936113:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc05edd3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1870854458246656:0@lo:400:kworker.0 00000100:00100000:0.0:1784189327.936122:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc05edd2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1870854458247168:0@lo:400:kworker.0 00000100:00100000:1.0:1784189327.939678:0:23826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf46900700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3643:x1870854458247808:12345-0@lo:41:osp-pre-0-1.0 Request processed in 17749us (17823us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189327.939693:0:23826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3946 00010000:00010000:3.0:1784189328.111523:0:26173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784189328.432362:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc0477c2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1870854458247936:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1784189328.433258:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784189328.433316:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458247936 00000100:00100000:0.0:1784189328.433343:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458247936 00000100:00100000:0.0:1784189328.433390:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2068 00000100:00100000:0.0:1784189328.433398:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc0477c0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1870854458247936:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1784189328.433587:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf46902d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1870854458248064:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1784189328.433628:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784189328.433659:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458248064 00000100:00100000:3.0:1784189328.433662:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458248064 00000100:00100000:3.0:1784189328.433684:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2069 00000100:00100000:3.0:1784189328.433689:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc07b872c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1870854458248064:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1784189328.433714:0:8432:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8618304 pending 0 free 3922481152 avail 3690958848 00000100:00100000:3.0:1784189328.433756:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc07b872c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1870854458248064:12345-0@lo:13:osp-pre-0-0.0 Request processed in 66us (127us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189328.433763:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2069 00000100:00100000:3.0:1784189328.434646:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf46902d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1870854458248064:0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1784189328.436165:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8646976 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1784189328.436240:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc0477c0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1870854458247936:12345-0@lo:13:osp-pre-1-0.0 Request processed in 2840us (2980us total) trans 0 rc 0/0 00000100:00100000:0.0:1784189328.436249:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2068 00000100:00100000:2.0:1784189328.437012:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc0477c2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1870854458247936:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1784189328.680056:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1784189328.680102:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1784189328.680129:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1784189328.680197:0:94309:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436330624 00000100:00100000:1.0:1784189328.680205:0:94309:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436330624 00000100:00100000:1.0:1784189328.680262:0:94309:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 126 00000100:00100000:1.0:1784189328.680272:0:94309:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc07fa61050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:60f345e3-c70e-4f53-b5e7-c9671463c9a5+10:2397:x1870854436330624:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:1.0:1784189328.680363:0:94309:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc07fa61050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:60f345e3-c70e-4f53-b5e7-c9671463c9a5+10:2397:x1870854436330624:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 91us (316us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189328.680371:0:94309:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 126 00000100:00100000:1.0:1784189328.680407:0:68287:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436330752 00000100:00100000:1.0:1784189328.680410:0:68287:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436330752 00000100:00100000:1.0:1784189328.680446:0:68287:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436330880 00000100:00100000:1.0:1784189328.680449:0:68287:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436330880 00000100:00100000:1.0:1784189328.680471:0:68287:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1335 00000100:00100000:1.0:1784189328.680478:0:68287:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf46902d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:debedd94-805c-42a0-a5e5-41758b2012e9+10:2397:x1870854436330752:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:1.0:1784189328.680522:0:68287:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf46902d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:debedd94-805c-42a0-a5e5-41758b2012e9+10:2397:x1870854436330752:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 45us (420us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189328.680529:0:68287:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1335 00000100:00100000:1.0:1784189328.680542:0:68287:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1336 00000100:00100000:1.0:1784189328.680548:0:68287:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf46900a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:debedd94-805c-42a0-a5e5-41758b2012e9+11:2396:x1870854436330880:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:1.0:1784189328.680569:0:68287:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf46900a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:debedd94-805c-42a0-a5e5-41758b2012e9+11:2396:x1870854436330880:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 21us (440us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189328.680575:0:68287:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1336 00000100:00080000:1.0:1784189328.680683:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1784189328.680687:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1784189328.701550:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1784189328.701590:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1784189328.701651:0:26171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436331008 00000100:00100000:3.0:1784189328.701660:0:26171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436331008 00000100:00100000:3.0:1784189328.701726:0:26171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436331136 00000100:00100000:3.0:1784189328.701730:0:26171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436331136 00000100:00100000:3.0:1784189328.701754:0:26171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 2581 00000100:00100000:3.0:1784189328.701763:0:26171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc080f6a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:debedd94-805c-42a0-a5e5-41758b2012e9+5:2397:x1870854436331008:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:3.0:1784189328.701832:0:26171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc080f6a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:debedd94-805c-42a0-a5e5-41758b2012e9+5:2397:x1870854436331008:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 70us (289us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189328.701841:0:26171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 2581 00000100:00100000:3.0:1784189328.701858:0:26171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 2582 00000100:00100000:3.0:1784189328.701865:0:26171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc080f69c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:debedd94-805c-42a0-a5e5-41758b2012e9+7:2396:x1870854436331136:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:3.0:1784189328.701910:0:26171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc080f69c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:debedd94-805c-42a0-a5e5-41758b2012e9+7:2396:x1870854436331136:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 44us (318us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189328.701917:0:26171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 2582 00000100:00080000:2.0:1784189328.702084:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1784189328.702088:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1784189329.138003:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1784189329.583026:0:95336:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866bc len=0 uarg=00007ffd9e78c920 20000000:00000080:1.0:1784189329.583043:0:95336:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866bc len=576 karg=ffff9dbf43750400 uarg=0000000000000000 00000040:00100000:1.0:1784189329.583803:0:95336:0:(llog.c:1072:llog_reverse_process()) index 60 : idx 49 20000000:01000000:1.0:1784189329.583812:0:95336:0:(mgs_llog.c:963:mgs_search_pool_cb()) Matched pool rec 59 cmd:0xce022 lustre.pool_134 lustre-OST0001_UUID 20000000:01000000:1.0:1784189329.583829:0:95336:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre-clilov/new lustre.pool_134 fl=4 20000000:01000000:2.0:1784189329.586588:0:95337:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 52 marker 42 1->4: lustre-clilov new lustre.pool_134 20000000:01000000:2.0:1784189329.586642:0:95337:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 54 marker 42 2->4: lustre-clilov new lustre.pool_134 00000040:00080000:2.0:1784189329.586672:0:95337:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 61 count 60 00000040:00080000:1.0:1784189329.587376:0:95336:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].61, 224 off18904 20000000:01000000:1.0:1784189329.587390:0:95336:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xce023 lustre pool_134 (null) (null) 00000040:00080000:1.0:1784189329.587404:0:95336:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].62, 112 off19016 00000040:00080000:1.0:1784189329.587423:0:95336:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].63, 224 off19240 20000000:01000000:1.0:1784189329.587436:0:95336:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre-MDT0000-mdtlov/new lustre.pool_134 fl=4 20000000:01000000:2.0:1784189329.588373:0:95338:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 46 marker 43 1->4: lustre-MDT0000-mdtlov new lustre.pool_134 20000000:01000000:2.0:1784189329.588419:0:95338:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 49 marker 43 2->4: lustre-MDT0000-mdtlov new lustre.pool_134 00000040:00080000:2.0:1784189329.588435:0:95338:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 56 count 55 00000040:00080000:1.0:1784189329.588739:0:95336:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].56, 224 off18016 20000000:01000000:1.0:1784189329.588752:0:95336:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xce023 lustre pool_134 (null) (null) 00000040:00080000:1.0:1784189329.588766:0:95336:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].57, 120 off18136 00000040:00080000:1.0:1784189329.588781:0:95336:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].58, 224 off18360 20000000:01000000:1.0:1784189329.588795:0:95336:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0001/lustre-MDT0001-mdtlov/new lustre.pool_134 fl=4 20000000:01000000:3.0:1784189329.596982:0:95339:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 46 marker 44 1->4: lustre-MDT0001-mdtlov new lustre.pool_134 20000000:01000000:3.0:1784189329.597045:0:95339:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 49 marker 44 2->4: lustre-MDT0001-mdtlov new lustre.pool_134 00000040:00080000:3.0:1784189329.597061:0:95339:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 56 count 55 00000040:00080000:1.0:1784189329.598545:0:95336:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].56, 224 off18016 20000000:01000000:1.0:1784189329.598565:0:95336:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xce023 lustre pool_134 (null) (null) 00000040:00080000:1.0:1784189329.598580:0:95336:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].57, 120 off18136 00000040:00080000:1.0:1784189329.598612:0:95336:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].58, 224 off18360 10000000:01000000:1.0:1784189329.598625:0:95336:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:1.0:1784189329.598643:0:95336:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9dc042d67800/0xcc1762b626f8cae4 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 95336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189329.598674:0:95336:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9dc081b16400/0xcc1762b626f8ca5f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcc1762b626f8ca58 expref: 23 pid: 94310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189329.598682:0:95336:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9dc042d67600/0xcc1762b626f8ca6d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcc1762b626f8ca66 expref: 23 pid: 94309 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189329.598691:0:95336:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9dc058f66a00/0xcc1762b626f8ca7b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcc1762b626f8ca74 expref: 23 pid: 94308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189329.598698:0:95336:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9dc058f66000/0xcc1762b626f8ca89 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcc1762b626f8ca82 expref: 23 pid: 94308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189329.598705:0:95336:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9dc0565e7e00/0xcc1762b626f8ca97 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcc1762b626f8ca90 expref: 23 pid: 94309 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189329.598711:0:95336:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9dc081b16800/0xcc1762b626f8caa5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcc1762b626f8ca9e expref: 23 pid: 94308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189329.598718:0:95336:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9dc081b16600/0xcc1762b626f8cab3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcc1762b626f8caac expref: 23 pid: 94308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189329.598726:0:95336:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9dc058f67200/0xcc1762b626f8cac1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcc1762b626f8caba expref: 23 pid: 94308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189329.598733:0:95336:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9dc042d66e00/0xcc1762b626f8cacf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcc1762b626f8cac8 expref: 23 pid: 94310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189329.598753:0:95336:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9dc042d67400/0xcc1762b626f8cad6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c40fd expref: 9 pid: 94310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189329.598762:0:95336:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9dc081b17a00/0xcc1762b626f8cadd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c4104 expref: 9 pid: 94314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189329.598769:0:95336:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9dc042d67800/0xcc1762b626f8cae4 lrc: 14/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 95336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189329.598805:0:95336:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9dc081b17a00/0xcc1762b626f8cadd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c4104 expref: 9 pid: 94314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189329.598821:0:95336:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9dc081b17a00/0xcc1762b626f8cadd lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c4104 expref: 9 pid: 94314 timeout: 3671 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784189329.598836:0:95336:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf4a342d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:95336:1870854458248192:192.168.203.12@tcp:104: 00010000:00010000:1.0:1784189329.598945:0:95336:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9dc042d67400/0xcc1762b626f8cad6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c40fd expref: 9 pid: 94310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189329.598954:0:95336:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9dc042d67400/0xcc1762b626f8cad6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c40fd expref: 9 pid: 94310 timeout: 3671 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784189329.598963:0:95336:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf4a342680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:95336:1870854458248320:192.168.203.12@tcp:104: 00010000:00010000:1.0:1784189329.598993:0:95336:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9dc042d66e00/0xcc1762b626f8cacf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcc1762b626f8cac8 expref: 23 pid: 94310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189329.599002:0:95336:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9dc042d66e00/0xcc1762b626f8cacf lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcc1762b626f8cac8 expref: 23 pid: 94310 timeout: 3671 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784189329.599022:0:95336:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf4a340e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:95336:1870854458248448:0@lo:104: 00000100:00100000:1.0:1784189329.599060:0:95336:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1784189329.599101:0:95336:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9dc058f67200/0xcc1762b626f8cac1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcc1762b626f8caba expref: 23 pid: 94308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189329.599109:0:95336:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9dc058f67200/0xcc1762b626f8cac1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcc1762b626f8caba expref: 23 pid: 94308 timeout: 3671 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784189329.599118:0:95336:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf4a341500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:95336:1870854458248576:0@lo:104: 00000100:00100000:1.0:1784189329.599255:0:95336:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1784189329.599283:0:95336:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9dc081b16600/0xcc1762b626f8cab3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcc1762b626f8caac expref: 23 pid: 94308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189329.599292:0:95336:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9dc081b16600/0xcc1762b626f8cab3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcc1762b626f8caac expref: 23 pid: 94308 timeout: 3671 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784189329.599301:0:95336:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf4a341880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:95336:1870854458248704:0@lo:104: 00000100:00100000:1.0:1784189329.599343:0:95336:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1784189329.599364:0:95336:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9dc081b16800/0xcc1762b626f8caa5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcc1762b626f8ca9e expref: 23 pid: 94308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189329.599372:0:95336:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9dc081b16800/0xcc1762b626f8caa5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcc1762b626f8ca9e expref: 23 pid: 94308 timeout: 3671 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784189329.599380:0:95336:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf4a343800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:95336:1870854458248832:0@lo:104: 00000100:00100000:1.0:1784189329.599402:0:95336:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1784189329.599417:0:95336:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9dc0565e7e00/0xcc1762b626f8ca97 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcc1762b626f8ca90 expref: 23 pid: 94309 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189329.599437:0:95336:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9dc0565e7e00/0xcc1762b626f8ca97 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcc1762b626f8ca90 expref: 23 pid: 94309 timeout: 3671 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784189329.599446:0:95336:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf48599880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:95336:1870854458248960:0@lo:104: 00010000:00010000:1.0:1784189329.599472:0:95336:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9dc058f66000/0xcc1762b626f8ca89 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcc1762b626f8ca82 expref: 23 pid: 94308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189329.599480:0:95336:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9dc058f66000/0xcc1762b626f8ca89 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcc1762b626f8ca82 expref: 23 pid: 94308 timeout: 3671 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784189329.599488:0:95336:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf48598380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:95336:1870854458249088:0@lo:104: 00010000:00010000:1.0:1784189329.599507:0:95336:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9dc058f66a00/0xcc1762b626f8ca7b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcc1762b626f8ca74 expref: 23 pid: 94308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189329.599515:0:95336:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9dc058f66a00/0xcc1762b626f8ca7b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcc1762b626f8ca74 expref: 23 pid: 94308 timeout: 3671 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784189329.599523:0:95336:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf48599c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:95336:1870854458249216:0@lo:104: 00010000:00010000:1.0:1784189329.599543:0:95336:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9dc042d67600/0xcc1762b626f8ca6d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcc1762b626f8ca66 expref: 23 pid: 94309 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189329.599551:0:95336:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9dc042d67600/0xcc1762b626f8ca6d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcc1762b626f8ca66 expref: 23 pid: 94309 timeout: 3671 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784189329.599559:0:95336:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf4859bb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:95336:1870854458249344:0@lo:104: 00010000:00010000:1.0:1784189329.599577:0:95336:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9dc081b16400/0xcc1762b626f8ca5f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcc1762b626f8ca58 expref: 23 pid: 94310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189329.599595:0:95336:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9dc081b16400/0xcc1762b626f8ca5f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcc1762b626f8ca58 expref: 23 pid: 94310 timeout: 3671 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784189329.599604:0:95336:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf4859b480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:95336:1870854458249472:0@lo:104: 00000100:00100000:1.0:1784189329.599623:0:95336:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dc0760d8180 going to sleep for 11 seconds 00000100:00100000:3.0:1784189329.599959:0:6496:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1784189329.599977:0:6496:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784189329.599987:0:6496:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784189329.599995:0:6496:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784189329.600001:0:6496:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784189329.600008:0:6496:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784189329.600015:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458248448 00000100:00100000:3.0:1784189329.600021:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458248448 00000100:00100000:3.0:1784189329.600057:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458248576 00000100:00100000:3.0:1784189329.600059:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458248576 00000100:00100000:3.0:1784189329.600069:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458248704 00000100:00100000:3.0:1784189329.600071:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458248704 00000100:00100000:3.0:1784189329.600078:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458248832 00000100:00100000:3.0:1784189329.600080:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458248832 00000100:00100000:3.0:1784189329.600088:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458248960 00000100:00100000:3.0:1784189329.600091:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458248960 00000100:00100000:3.0:1784189329.600099:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458249088 00000100:00100000:3.0:1784189329.600101:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458249088 00000100:00100000:3.0:1784189329.600108:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458249216 00000100:00100000:3.0:1784189329.600110:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458249216 00000100:00100000:2.0:1784189329.600169:0:49501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458249344 00000100:00100000:2.0:1784189329.600175:0:49501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458249344 00000100:00100000:2.0:1784189329.600197:0:49501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458249472 00000100:00100000:2.0:1784189329.600200:0:49501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458249472 00000100:00100000:2.0:1784189329.600214:0:49501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 346 00000100:00100000:2.0:1784189329.600222:0:49501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf4a340000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:bd553d0d-03e2-4233-b06b-b55bbfa2b954+11:95336:x1870854458248448:12345-0@lo:104: 00010000:00010000:2.0:1784189329.600239:0:49501:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.112@tcp lock: ffff9dc081b16e00/0xcc1762b626f8cac8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xcc1762b626f8cacf expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189329.600295:0:49501:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1784189329.600865:0:49501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf4a340000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:bd553d0d-03e2-4233-b06b-b55bbfa2b954+11:95336:x1870854458248448:12345-0@lo:104: Request processed in 81us (1242us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189329.600873:0:49501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 346 00000100:00100000:2.0:1784189329.600900:0:49501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 347 00000100:00100000:2.0:1784189329.600908:0:49501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf4a340380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:bd553d0d-03e2-4233-b06b-b55bbfa2b954+10:95336:x1870854458248576:12345-0@lo:104: 00010000:00010000:2.0:1784189329.600917:0:49501:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.112@tcp lock: ffff9dc081b17e00/0xcc1762b626f8caba lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xcc1762b626f8cac1 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189329.600975:0:49501:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1784189329.600981:0:49501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf4a340380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:bd553d0d-03e2-4233-b06b-b55bbfa2b954+10:95336:x1870854458248576:12345-0@lo:104: Request processed in 75us (1726us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189329.600988:0:49501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 347 00000100:00100000:2.0:1784189329.601011:0:49501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 348 00000100:00100000:2.0:1784189329.601017:0:49501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf4a341c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:bd553d0d-03e2-4233-b06b-b55bbfa2b954+9:95336:x1870854458248704:12345-0@lo:104: 00010000:00010000:2.0:1784189329.601026:0:49501:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.112@tcp lock: ffff9dc058f66200/0xcc1762b626f8caac lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xcc1762b626f8cab3 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189329.601061:0:49501:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1784189329.601066:0:49501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf4a341c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:bd553d0d-03e2-4233-b06b-b55bbfa2b954+9:95336:x1870854458248704:12345-0@lo:104: Request processed in 51us (1724us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189329.601073:0:49501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 348 00000100:00100000:2.0:1784189329.601084:0:49501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 349 00000100:00100000:2.0:1784189329.601090:0:49501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf43e60c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:bd553d0d-03e2-4233-b06b-b55bbfa2b954+8:95336:x1870854458248832:12345-0@lo:104: 00010000:00010000:2.0:1784189329.601097:0:49501:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.112@tcp lock: ffff9dc0565e7800/0xcc1762b626f8ca9e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xcc1762b626f8caa5 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189329.601126:0:49501:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:2.0:1784189329.601131:0:49501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf43e60c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:bd553d0d-03e2-4233-b06b-b55bbfa2b954+8:95336:x1870854458248832:12345-0@lo:104: Request processed in 42us (1728us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189329.601137:0:49501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 349 00000100:00100000:2.0:1784189329.601165:0:49501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 350 00000100:00100000:2.0:1784189329.601171:0:49501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf46903100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:bd553d0d-03e2-4233-b06b-b55bbfa2b954+7:95336:x1870854458248960:12345-0@lo:104: 00010000:00010000:2.0:1784189329.601178:0:49501:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.112@tcp lock: ffff9dc081b16000/0xcc1762b626f8ca90 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xcc1762b626f8ca97 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189329.601203:0:49501:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:2.0:1784189329.601207:0:49501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf46903100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:bd553d0d-03e2-4233-b06b-b55bbfa2b954+7:95336:x1870854458248960:12345-0@lo:104: Request processed in 37us (1230us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189329.601213:0:49501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 350 00000100:00100000:2.0:1784189329.601232:0:49501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 351 00000100:00100000:2.0:1784189329.601238:0:49501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf46901180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:bd553d0d-03e2-4233-b06b-b55bbfa2b954+6:95336:x1870854458249088:12345-0@lo:104: 00010000:00010000:2.0:1784189329.601245:0:49501:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.112@tcp lock: ffff9dc0565e6600/0xcc1762b626f8ca82 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xcc1762b626f8ca89 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189329.601270:0:49501:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to priority blp list, 6 blwis in pool 00000100:00100000:2.0:1784189329.601274:0:49501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf46901180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:bd553d0d-03e2-4233-b06b-b55bbfa2b954+6:95336:x1870854458249088:12345-0@lo:104: Request processed in 38us (1286us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189329.601279:0:49501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 351 00000100:00100000:2.0:1784189329.601291:0:49501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 352 00000100:00100000:2.0:1784189329.601296:0:49501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf46901f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:bd553d0d-03e2-4233-b06b-b55bbfa2b954+5:95336:x1870854458249216:12345-0@lo:104: 00010000:00010000:2.0:1784189329.601467:0:49501:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.112@tcp lock: ffff9dc0565e7c00/0xcc1762b626f8ca74 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xcc1762b626f8ca7b expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189329.601498:0:49501:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to priority blp list, 7 blwis in pool 00000100:00100000:2.0:1784189329.601503:0:49501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf46901f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:bd553d0d-03e2-4233-b06b-b55bbfa2b954+5:95336:x1870854458249216:12345-0@lo:104: Request processed in 208us (1507us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189329.601510:0:49501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 352 00000100:00100000:2.0:1784189329.601523:0:49501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 353 00000100:00100000:2.0:1784189329.601634:0:49501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf46901880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:bd553d0d-03e2-4233-b06b-b55bbfa2b954+4:95336:x1870854458249344:12345-0@lo:104: 00010000:00010000:2.0:1784189329.601644:0:49501:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.112@tcp lock: ffff9dc058f66800/0xcc1762b626f8ca66 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xcc1762b626f8ca6d expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189329.601671:0:49501:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/8 locks to priority blp list, 8 blwis in pool 00000100:00100000:2.0:1784189329.601955:0:49501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf46901880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:bd553d0d-03e2-4233-b06b-b55bbfa2b954+4:95336:x1870854458249344:12345-0@lo:104: Request processed in 325us (1952us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189329.601962:0:49501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 353 00000100:00100000:2.0:1784189329.601984:0:49501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 354 00000100:00100000:2.0:1784189329.601991:0:49501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf46902a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:bd553d0d-03e2-4233-b06b-b55bbfa2b954+3:95336:x1870854458249472:12345-0@lo:104: 00010000:00010000:2.0:1784189329.601998:0:49501:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.112@tcp lock: ffff9dc0565e7600/0xcc1762b626f8ca58 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xcc1762b626f8ca5f expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189329.602028:0:49501:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/9 locks to priority blp list, 9 blwis in pool 00000100:00100000:2.0:1784189329.602032:0:49501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf46902a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:bd553d0d-03e2-4233-b06b-b55bbfa2b954+3:95336:x1870854458249472:12345-0@lo:104: Request processed in 43us (2023us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189329.602038:0:49501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 354 00010000:00010000:2.0:1784189329.602058:0:7454:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 8 total in blp. (8 blwis in pool) 00010000:00010000:2.0:1784189329.602064:0:7454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.112@tcp lock: ffff9dc081b16e00/0xcc1762b626f8cac8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xcc1762b626f8cacf expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189329.602072:0:7454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc081b16e00 already unused, calling callback (ffffffffc114ac20) 10000000:00010000:2.0:1784189329.602077:0:7454:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.112@tcp lock: ffff9dc081b16e00/0xcc1762b626f8cac8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400400000000 nid: local remote: 0xcc1762b626f8cacf expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189329.602085:0:7454:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.112@tcp lock: ffff9dc081b16e00/0xcc1762b626f8cac8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1408400000000 nid: local remote: 0xcc1762b626f8cacf expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1784189329.602093:0:7454:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.112@tcp lock: ffff9dc081b16e00/0xcc1762b626f8cac8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1409400000000 nid: local remote: 0xcc1762b626f8cacf expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784189329.602099:0:7454:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1784189329.602130:0:7454:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.112@tcp lock: ffff9dc081b16e00/0xcc1762b626f8cac8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcc1762b626f8cacf expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189329.602137:0:7454:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1784189329.602157:0:7454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.112@tcp lock: ffff9dc081b16e00/0xcc1762b626f8cac8 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcc1762b626f8cacf expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189329.602175:0:7454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.112@tcp lock: ffff9dc081b16e00/0xcc1762b626f8cac8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcc1762b626f8cacf expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189329.602187:0:7454:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 7 total in blp. (7 blwis in pool) 00010000:00010000:2.0:1784189329.602191:0:7454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.112@tcp lock: ffff9dc081b17e00/0xcc1762b626f8caba lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400000000000 nid: local remote: 0xcc1762b626f8cac1 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189329.602197:0:7454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc081b17e00 already unused, calling callback (ffffffffc114ac20) 10000000:00010000:2.0:1784189329.602200:0:7454:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.112@tcp lock: ffff9dc081b17e00/0xcc1762b626f8caba lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400400000000 nid: local remote: 0xcc1762b626f8cac1 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189329.602207:0:7454:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.112@tcp lock: ffff9dc081b17e00/0xcc1762b626f8caba lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1408400000000 nid: local remote: 0xcc1762b626f8cac1 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1784189329.602214:0:7454:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.112@tcp lock: ffff9dc081b17e00/0xcc1762b626f8caba lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1409400000000 nid: local remote: 0xcc1762b626f8cac1 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784189329.602219:0:7454:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1784189329.602231:0:7454:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.112@tcp lock: ffff9dc081b17e00/0xcc1762b626f8caba lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcc1762b626f8cac1 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189329.602237:0:7454:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1784189329.602242:0:7454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.112@tcp lock: ffff9dc081b17e00/0xcc1762b626f8caba lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcc1762b626f8cac1 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189329.602249:0:7454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.112@tcp lock: ffff9dc081b17e00/0xcc1762b626f8caba lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcc1762b626f8cac1 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189329.602257:0:7454:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:2.0:1784189329.602264:0:7454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.112@tcp lock: ffff9dc058f66200/0xcc1762b626f8caac lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xcc1762b626f8cab3 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189329.602270:0:7454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc058f66200 already unused, calling callback (ffffffffc114ac20) 10000000:00010000:2.0:1784189329.602273:0:7454:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.112@tcp lock: ffff9dc058f66200/0xcc1762b626f8caac lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0xcc1762b626f8cab3 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189329.602280:0:7454:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.112@tcp lock: ffff9dc058f66200/0xcc1762b626f8caac lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0xcc1762b626f8cab3 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1784189329.602286:0:7454:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.112@tcp lock: ffff9dc058f66200/0xcc1762b626f8caac lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0xcc1762b626f8cab3 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784189329.602290:0:7454:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:1.0:1784189329.603267:0:95336:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf4a340e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:95336:1870854458248448:0@lo:104: 00000100:00100000:1.0:1784189329.603279:0:95336:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf4a341500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:95336:1870854458248576:0@lo:104: 00000100:00100000:1.0:1784189329.603287:0:95336:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf4a341880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:95336:1870854458248704:0@lo:104: 00000100:00100000:1.0:1784189329.603294:0:95336:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf4a343800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:95336:1870854458248832:0@lo:104: 00000100:00100000:1.0:1784189329.603301:0:95336:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf48599880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:95336:1870854458248960:0@lo:104: 00000100:00100000:1.0:1784189329.603309:0:95336:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf48598380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:95336:1870854458249088:0@lo:104: 00000100:00100000:1.0:1784189329.603332:0:95336:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf48599c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:95336:1870854458249216:0@lo:104: 00000100:00100000:1.0:1784189329.603343:0:95336:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf4859bb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:95336:1870854458249344:0@lo:104: 00000100:00100000:1.0:1784189329.603350:0:95336:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf4859b480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:95336:1870854458249472:0@lo:104: 00010000:00010000:3.0:1784189329.603593:0:6502:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:3.0:1784189329.603601:0:6502:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.112@tcp lock: ffff9dc0565e7800/0xcc1762b626f8ca9e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xcc1762b626f8caa5 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189329.603611:0:6502:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc0565e7800 already unused, calling callback (ffffffffc114ac20) 10000000:00010000:3.0:1784189329.603623:0:6502:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.112@tcp lock: ffff9dc0565e7800/0xcc1762b626f8ca9e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0xcc1762b626f8caa5 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189329.603633:0:6502:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.112@tcp lock: ffff9dc0565e7800/0xcc1762b626f8ca9e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0xcc1762b626f8caa5 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1784189329.603640:0:6502:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.112@tcp lock: ffff9dc0565e7800/0xcc1762b626f8ca9e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0xcc1762b626f8caa5 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784189329.603646:0:6502:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1784189329.604842:0:7454:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.112@tcp lock: ffff9dc058f66200/0xcc1762b626f8caac lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcc1762b626f8cab3 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189329.604856:0:7454:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1784189329.604887:0:7454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.112@tcp lock: ffff9dc058f66200/0xcc1762b626f8caac lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcc1762b626f8cab3 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189329.604895:0:7454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.112@tcp lock: ffff9dc058f66200/0xcc1762b626f8caac lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcc1762b626f8cab3 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189329.604910:0:7454:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:2.0:1784189329.604914:0:7454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.112@tcp lock: ffff9dc081b16000/0xcc1762b626f8ca90 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0xcc1762b626f8ca97 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189329.604932:0:7454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc081b16000 already unused, calling callback (ffffffffc114ac20) 10000000:00010000:2.0:1784189329.604935:0:7454:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.112@tcp lock: ffff9dc081b16000/0xcc1762b626f8ca90 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0xcc1762b626f8ca97 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189329.604959:0:7454:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.112@tcp lock: ffff9dc081b16000/0xcc1762b626f8ca90 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0xcc1762b626f8ca97 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1784189329.604967:0:7454:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.112@tcp lock: ffff9dc081b16000/0xcc1762b626f8ca90 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0xcc1762b626f8ca97 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784189329.604973:0:7454:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1784189329.604999:0:7454:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.112@tcp lock: ffff9dc081b16000/0xcc1762b626f8ca90 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcc1762b626f8ca97 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189329.605006:0:7454:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1784189329.605012:0:7454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.112@tcp lock: ffff9dc081b16000/0xcc1762b626f8ca90 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcc1762b626f8ca97 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189329.605019:0:7454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.112@tcp lock: ffff9dc081b16000/0xcc1762b626f8ca90 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcc1762b626f8ca97 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189329.605030:0:7454:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1784189329.605033:0:7454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.112@tcp lock: ffff9dc0565e6600/0xcc1762b626f8ca82 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xcc1762b626f8ca89 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189329.605039:0:7454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc0565e6600 already unused, calling callback (ffffffffc114ac20) 10000000:00010000:2.0:1784189329.605042:0:7454:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.112@tcp lock: ffff9dc0565e6600/0xcc1762b626f8ca82 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0xcc1762b626f8ca89 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189329.605048:0:7454:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.112@tcp lock: ffff9dc0565e6600/0xcc1762b626f8ca82 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0xcc1762b626f8ca89 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1784189329.605053:0:7454:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.112@tcp lock: ffff9dc0565e6600/0xcc1762b626f8ca82 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0xcc1762b626f8ca89 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784189329.605063:0:7454:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1784189329.605080:0:7454:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.112@tcp lock: ffff9dc0565e6600/0xcc1762b626f8ca82 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcc1762b626f8ca89 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189329.605086:0:7454:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1784189329.605091:0:7454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.112@tcp lock: ffff9dc0565e6600/0xcc1762b626f8ca82 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcc1762b626f8ca89 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189329.605097:0:7454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.112@tcp lock: ffff9dc0565e6600/0xcc1762b626f8ca82 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcc1762b626f8ca89 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189329.605106:0:7454:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1784189329.605109:0:7454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.112@tcp lock: ffff9dc0565e7c00/0xcc1762b626f8ca74 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xcc1762b626f8ca7b expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189329.605115:0:7454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc0565e7c00 already unused, calling callback (ffffffffc114ac20) 10000000:00010000:2.0:1784189329.605118:0:7454:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.112@tcp lock: ffff9dc0565e7c00/0xcc1762b626f8ca74 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xcc1762b626f8ca7b expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189329.605124:0:7454:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.112@tcp lock: ffff9dc0565e7c00/0xcc1762b626f8ca74 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xcc1762b626f8ca7b expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1784189329.605129:0:7454:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.112@tcp lock: ffff9dc0565e7c00/0xcc1762b626f8ca74 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xcc1762b626f8ca7b expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784189329.605134:0:7454:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1784189329.605145:0:7454:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.112@tcp lock: ffff9dc0565e7c00/0xcc1762b626f8ca74 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcc1762b626f8ca7b expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189329.605150:0:7454:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1784189329.605162:0:7454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.112@tcp lock: ffff9dc0565e7c00/0xcc1762b626f8ca74 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcc1762b626f8ca7b expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189329.605169:0:7454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.112@tcp lock: ffff9dc0565e7c00/0xcc1762b626f8ca74 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcc1762b626f8ca7b expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189329.605177:0:7454:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1784189329.605180:0:7454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.112@tcp lock: ffff9dc058f66800/0xcc1762b626f8ca66 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xcc1762b626f8ca6d expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189329.605185:0:7454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc058f66800 already unused, calling callback (ffffffffc114ac20) 10000000:00010000:2.0:1784189329.605188:0:7454:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.112@tcp lock: ffff9dc058f66800/0xcc1762b626f8ca66 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xcc1762b626f8ca6d expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189329.605194:0:7454:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.112@tcp lock: ffff9dc058f66800/0xcc1762b626f8ca66 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xcc1762b626f8ca6d expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1784189329.605199:0:7454:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.112@tcp lock: ffff9dc058f66800/0xcc1762b626f8ca66 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xcc1762b626f8ca6d expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784189329.605204:0:7454:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1784189329.605216:0:7454:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.112@tcp lock: ffff9dc058f66800/0xcc1762b626f8ca66 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcc1762b626f8ca6d expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189329.605222:0:7454:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1784189329.605226:0:7454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.112@tcp lock: ffff9dc058f66800/0xcc1762b626f8ca66 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcc1762b626f8ca6d expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189329.605232:0:7454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.112@tcp lock: ffff9dc058f66800/0xcc1762b626f8ca66 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcc1762b626f8ca6d expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189329.605241:0:7454:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784189329.605249:0:7454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.112@tcp lock: ffff9dc0565e7600/0xcc1762b626f8ca58 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xcc1762b626f8ca5f expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189329.605255:0:7454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc0565e7600 already unused, calling callback (ffffffffc114ac20) 10000000:00010000:2.0:1784189329.605257:0:7454:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.112@tcp lock: ffff9dc0565e7600/0xcc1762b626f8ca58 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xcc1762b626f8ca5f expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189329.605263:0:7454:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.112@tcp lock: ffff9dc0565e7600/0xcc1762b626f8ca58 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xcc1762b626f8ca5f expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1784189329.605269:0:7454:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.112@tcp lock: ffff9dc0565e7600/0xcc1762b626f8ca58 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xcc1762b626f8ca5f expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784189329.605273:0:7454:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1784189329.605284:0:7454:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.112@tcp lock: ffff9dc0565e7600/0xcc1762b626f8ca58 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcc1762b626f8ca5f expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189329.605288:0:7454:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1784189329.605292:0:7454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.112@tcp lock: ffff9dc0565e7600/0xcc1762b626f8ca58 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcc1762b626f8ca5f expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189329.605297:0:7454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.112@tcp lock: ffff9dc0565e7600/0xcc1762b626f8ca58 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcc1762b626f8ca5f expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189329.605445:0:7454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784189329.605447:0:7454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784189329.605449:0:7454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784189329.605977:0:6502:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.112@tcp lock: ffff9dc0565e7800/0xcc1762b626f8ca9e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcc1762b626f8caa5 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189329.605986:0:6502:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1784189329.605993:0:6502:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.112@tcp lock: ffff9dc0565e7800/0xcc1762b626f8ca9e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcc1762b626f8caa5 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189329.606000:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.112@tcp lock: ffff9dc0565e7800/0xcc1762b626f8ca9e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcc1762b626f8caa5 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189329.606015:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784189329.606016:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784189329.606018:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784189329.606025:0:26173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784189329.606031:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784189329.606315:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1784189329.606356:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1784189329.606406:0:95336:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf4a342d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:95336:1870854458248192:192.168.203.12@tcp:104: 00000100:00100000:1.0:1784189329.606416:0:95336:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf4a342680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:95336:1870854458248320:192.168.203.12@tcp:104: 00010000:00010000:1.0:1784189329.606463:0:95336:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9dc042d67800/0xcc1762b626f8cae4 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 95336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784189329.606645:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc080f68380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:bd553d0d-03e2-4233-b06b-b55bbfa2b954:3643:1870854458249728:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1784189329.608202:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436331264 00000100:00100000:1.0:1784189329.608214:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436331264 00010000:00010000:1.0:1784189329.608262:0:6499:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9dc081b17a00/0xcc1762b626f8cadd lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c4104 expref: 10 pid: 94314 timeout: 3671 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784189329.608306:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436331392 00000100:00100000:1.0:1784189329.608310:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436331392 00010000:00010000:1.0:1784189329.608337:0:6499:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9dc042d67400/0xcc1762b626f8cad6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c40fd expref: 11 pid: 94310 timeout: 3671 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784189329.608358:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 2591 00000100:00100000:1.0:1784189329.608367:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf48599500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:60f345e3-c70e-4f53-b5e7-c9671463c9a5+11:2397:x1870854436331264:12345-192.168.203.12@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1784189329.608380:0:6499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784189329.608386:0:6499:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9dc081b17a00/0xcc1762b626f8cadd lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c4104 expref: 11 pid: 94314 timeout: 3671 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189329.608397:0:6499:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9dc081b17a00/0xcc1762b626f8cadd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c4104 expref: 11 pid: 94314 timeout: 3671 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189329.608413:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dc081b17a00/0xcc1762b626f8cadd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x44801400000020 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c4104 expref: 11 pid: 94314 timeout: 3671 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189329.608427:0:6499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784189329.608495:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf48599500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:60f345e3-c70e-4f53-b5e7-c9671463c9a5+10:2397:x1870854436331264:12345-192.168.203.12@tcp:103:ldlm_bl.0 Request processed in 129us (2183us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189329.608502:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 2591 00000100:00100000:1.0:1784189329.608520:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 2592 00000100:00100000:1.0:1784189329.608526:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc07113bc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:60f345e3-c70e-4f53-b5e7-c9671463c9a5+9:2397:x1870854436331392:12345-192.168.203.12@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1784189329.608534:0:6499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784189329.608538:0:6499:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9dc042d67400/0xcc1762b626f8cad6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c40fd expref: 9 pid: 94310 timeout: 3671 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189329.608556:0:6499:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9dc042d67400/0xcc1762b626f8cad6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000400000020 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c40fd expref: 9 pid: 94310 timeout: 3671 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189329.608566:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dc042d67400/0xcc1762b626f8cad6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801400000020 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c40fd expref: 9 pid: 94310 timeout: 3671 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189329.608574:0:6499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784189329.608593:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc07113bc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:60f345e3-c70e-4f53-b5e7-c9671463c9a5+8:2397:x1870854436331392:12345-192.168.203.12@tcp:103:ldlm_bl.0 Request processed in 68us (2237us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189329.608600:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 2592 00000100:00100000:0.0:1784189329.609282:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc080f6b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bd553d0d-03e2-4233-b06b-b55bbfa2b954:3642:1870854458249600:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1784189329.609355:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784189329.609405:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf4a343b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bd553d0d-03e2-4233-b06b-b55bbfa2b954:3642:1870854458250112:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1784189329.609425:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784189329.609443:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf46900000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bd553d0d-03e2-4233-b06b-b55bbfa2b954:3642:1870854458250624:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1784189329.609461:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784189329.609492:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458249600 00000100:00100000:0.0:1784189329.609497:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458249600 00010000:00010000:0.0:1784189329.609517:0:6499:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9dc042d66e00/0xcc1762b626f8cacf lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcc1762b626f8cac8 expref: 24 pid: 94310 timeout: 3671 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784189329.609531:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458250112 00000100:00100000:0.0:1784189329.609533:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458250112 00010000:00010000:0.0:1784189329.609544:0:6499:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9dc058f66000/0xcc1762b626f8ca89 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcc1762b626f8ca82 expref: 25 pid: 94308 timeout: 3671 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784189329.609552:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458250624 00000100:00100000:0.0:1784189329.609554:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458250624 00010000:00010000:0.0:1784189329.609563:0:6499:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9dc081b16800/0xcc1762b626f8caa5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcc1762b626f8ca9e expref: 26 pid: 94308 timeout: 3671 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784189329.609573:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2593 00000100:00100000:0.0:1784189329.609579:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc0477c0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bd553d0d-03e2-4233-b06b-b55bbfa2b954+26:3642:x1870854458249600:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1784189329.609588:0:6499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784189329.609593:0:6499:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9dc042d66e00/0xcc1762b626f8cacf lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcc1762b626f8cac8 expref: 26 pid: 94310 timeout: 3671 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189329.609601:0:6499:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9dc042d66e00/0xcc1762b626f8cacf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcc1762b626f8cac8 expref: 26 pid: 94310 timeout: 3671 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189329.609613:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dc042d66e00/0xcc1762b626f8cacf lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcc1762b626f8cac8 expref: 26 pid: 94310 timeout: 3671 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189329.609634:0:6499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784189329.610239:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc05ed90000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bd553d0d-03e2-4233-b06b-b55bbfa2b954:3640:1870854458249856:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1784189329.610339:0:7455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2594 00000100:00100000:1.0:1784189329.610349:0:7455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc0477c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bd553d0d-03e2-4233-b06b-b55bbfa2b954+25:3642:x1870854458250112:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1784189329.610360:0:7455:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784189329.610366:0:7455:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9dc058f66000/0xcc1762b626f8ca89 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcc1762b626f8ca82 expref: 25 pid: 94308 timeout: 3671 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189329.610376:0:7455:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9dc058f66000/0xcc1762b626f8ca89 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcc1762b626f8ca82 expref: 25 pid: 94308 timeout: 3671 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189329.610388:0:7455:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dc058f66000/0xcc1762b626f8ca89 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcc1762b626f8ca82 expref: 25 pid: 94308 timeout: 3671 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189329.610400:0:7455:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784189329.611499:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784189329.611628:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf4a340380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bd553d0d-03e2-4233-b06b-b55bbfa2b954:3640:1870854458250368:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1784189329.611665:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784189329.611770:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1784189329.611777:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc05ed92a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bd553d0d-03e2-4233-b06b-b55bbfa2b954:3640:1870854458249984:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1784189329.611798:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784189329.611807:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf4a341c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bd553d0d-03e2-4233-b06b-b55bbfa2b954:3640:1870854458250496:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1784189329.611824:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784189329.611849:0:25703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458249856 00000100:00100000:2.0:1784189329.611854:0:25703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458249856 00010000:00010000:2.0:1784189329.611879:0:25703:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9dc081b16600/0xcc1762b626f8cab3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcc1762b626f8caac expref: 25 pid: 94308 timeout: 3671 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784189329.611898:0:25703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458250368 00000100:00100000:2.0:1784189329.611901:0:25703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458250368 00010000:00010000:2.0:1784189329.611911:0:25703:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9dc042d67600/0xcc1762b626f8ca6d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcc1762b626f8ca66 expref: 26 pid: 94309 timeout: 3671 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784189329.611929:0:25703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458249984 00000100:00100000:2.0:1784189329.611932:0:25703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458249984 00010000:00010000:2.0:1784189329.611941:0:25703:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9dc0565e7e00/0xcc1762b626f8ca97 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcc1762b626f8ca90 expref: 27 pid: 94309 timeout: 3671 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784189329.611950:0:25703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458250496 00000100:00100000:2.0:1784189329.611952:0:25703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458250496 00010000:00010000:2.0:1784189329.611960:0:25703:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9dc081b16400/0xcc1762b626f8ca5f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcc1762b626f8ca58 expref: 28 pid: 94310 timeout: 3671 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784189329.611971:0:25703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2595 00000100:00100000:2.0:1784189329.611977:0:25703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc0477c1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:bd553d0d-03e2-4233-b06b-b55bbfa2b954+28:3642:x1870854458250624:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1784189329.611988:0:25703:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784189329.611997:0:25703:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9dc081b16800/0xcc1762b626f8caa5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcc1762b626f8ca9e expref: 28 pid: 94308 timeout: 3671 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189329.612006:0:25703:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9dc081b16800/0xcc1762b626f8caa5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcc1762b626f8ca9e expref: 28 pid: 94308 timeout: 3671 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189329.612019:0:25703:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dc081b16800/0xcc1762b626f8caa5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcc1762b626f8ca9e expref: 28 pid: 94308 timeout: 3671 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189329.612031:0:25703:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784189329.612066:0:25703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc0477c1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:bd553d0d-03e2-4233-b06b-b55bbfa2b954+27:3642:x1870854458250624:12345-0@lo:103:ldlm_bl.0 Request processed in 89us (2603us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189329.612073:0:25703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2595 00000100:00100000:2.0:1784189329.612089:0:25703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2596 00000100:00100000:2.0:1784189329.612095:0:25703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf4a341180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:bd553d0d-03e2-4233-b06b-b55bbfa2b954+26:3640:x1870854458249856:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1784189329.612101:0:25703:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784189329.612105:0:25703:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9dc081b16600/0xcc1762b626f8cab3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcc1762b626f8caac expref: 26 pid: 94308 timeout: 3671 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189329.612113:0:25703:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9dc081b16600/0xcc1762b626f8cab3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcc1762b626f8caac expref: 26 pid: 94308 timeout: 3671 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189329.612122:0:25703:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dc081b16600/0xcc1762b626f8cab3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcc1762b626f8caac expref: 26 pid: 94308 timeout: 3671 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189329.612129:0:25703:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784189329.612148:0:25703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf4a341180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:bd553d0d-03e2-4233-b06b-b55bbfa2b954+25:3640:x1870854458249856:12345-0@lo:103:ldlm_bl.0 Request processed in 54us (653us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189329.612154:0:25703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2596 00000100:00100000:2.0:1784189329.612164:0:25703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2597 00000100:00100000:2.0:1784189329.612175:0:25703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf4a340700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:bd553d0d-03e2-4233-b06b-b55bbfa2b954+24:3640:x1870854458250368:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1784189329.612182:0:25703:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784189329.612186:0:25703:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9dc042d67600/0xcc1762b626f8ca6d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcc1762b626f8ca66 expref: 24 pid: 94309 timeout: 3671 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189329.612193:0:25703:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9dc042d67600/0xcc1762b626f8ca6d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcc1762b626f8ca66 expref: 24 pid: 94309 timeout: 3671 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189329.612203:0:25703:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dc042d67600/0xcc1762b626f8ca6d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcc1762b626f8ca66 expref: 24 pid: 94309 timeout: 3671 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189329.612211:0:25703:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784189329.612228:0:25703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf4a340700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:bd553d0d-03e2-4233-b06b-b55bbfa2b954+23:3640:x1870854458250368:12345-0@lo:103:ldlm_bl.0 Request processed in 55us (563us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189329.612234:0:25703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2597 00000100:00100000:2.0:1784189329.612243:0:25703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2598 00000100:00100000:2.0:1784189329.612248:0:25703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf4a342680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:bd553d0d-03e2-4233-b06b-b55bbfa2b954+22:3640:x1870854458249984:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1784189329.612255:0:25703:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784189329.612258:0:25703:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9dc0565e7e00/0xcc1762b626f8ca97 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcc1762b626f8ca90 expref: 22 pid: 94309 timeout: 3671 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189329.612266:0:25703:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9dc0565e7e00/0xcc1762b626f8ca97 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcc1762b626f8ca90 expref: 22 pid: 94309 timeout: 3671 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189329.612275:0:25703:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dc0565e7e00/0xcc1762b626f8ca97 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcc1762b626f8ca90 expref: 22 pid: 94309 timeout: 3671 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189329.612283:0:25703:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784189329.612297:0:25703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf4a342680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:bd553d0d-03e2-4233-b06b-b55bbfa2b954+21:3640:x1870854458249984:12345-0@lo:103:ldlm_bl.0 Request processed in 49us (499us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189329.612388:0:25703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2598 00000100:00100000:2.0:1784189329.612400:0:25703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2599 00000100:00100000:2.0:1784189329.612406:0:25703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc071139c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:bd553d0d-03e2-4233-b06b-b55bbfa2b954+20:3640:x1870854458250496:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1784189329.612412:0:25703:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784189329.612416:0:25703:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9dc081b16400/0xcc1762b626f8ca5f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcc1762b626f8ca58 expref: 20 pid: 94310 timeout: 3671 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189329.612424:0:25703:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9dc081b16400/0xcc1762b626f8ca5f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcc1762b626f8ca58 expref: 20 pid: 94310 timeout: 3671 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189329.612434:0:25703:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dc081b16400/0xcc1762b626f8ca5f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcc1762b626f8ca58 expref: 20 pid: 94310 timeout: 3671 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189329.612443:0:25703:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784189329.612462:0:25703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc071139c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:bd553d0d-03e2-4233-b06b-b55bbfa2b954+19:3640:x1870854458250496:12345-0@lo:103:ldlm_bl.0 Request processed in 57us (638us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189329.612467:0:25703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2599 00000100:00100000:2.0:1784189329.612495:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc05ed92a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bd553d0d-03e2-4233-b06b-b55bbfa2b954:3640:1870854458249984:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1784189329.612502:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf4a341c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bd553d0d-03e2-4233-b06b-b55bbfa2b954:3640:1870854458250496:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1784189329.612509:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc05ed90000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bd553d0d-03e2-4233-b06b-b55bbfa2b954:3640:1870854458249856:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1784189329.612515:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf4a340380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bd553d0d-03e2-4233-b06b-b55bbfa2b954:3640:1870854458250368:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1784189329.612655:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf46900000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bd553d0d-03e2-4233-b06b-b55bbfa2b954:3642:1870854458250624:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1784189329.613217:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc0477c0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bd553d0d-03e2-4233-b06b-b55bbfa2b954+18:3642:x1870854458249600:12345-0@lo:103:ldlm_bl.0 Request processed in 3634us (3858us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189329.613225:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc080f6b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bd553d0d-03e2-4233-b06b-b55bbfa2b954:3642:1870854458249600:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1784189329.613233:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2593 00000100:00100000:3.0:1784189329.613441:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784189329.613449:0:7455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc0477c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bd553d0d-03e2-4233-b06b-b55bbfa2b954+17:3642:x1870854458250112:12345-0@lo:103:ldlm_bl.0 Request processed in 3100us (4020us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189329.613458:0:7455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2594 00000100:00100000:3.0:1784189329.613496:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf4a340000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:bd553d0d-03e2-4233-b06b-b55bbfa2b954:3643:1870854458250240:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1784189329.613505:0:7455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458249728 00000100:00100000:1.0:1784189329.613520:0:7455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458249728 00000100:00100000:3.0:1784189329.613528:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1784189329.613544:0:7455:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9dc058f67200/0xcc1762b626f8cac1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcc1762b626f8caba expref: 17 pid: 94308 timeout: 3671 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784189329.613564:0:7455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458250240 00000100:00100000:1.0:1784189329.613568:0:7455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458250240 00010000:00010000:1.0:1784189329.613581:0:7455:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9dc058f66a00/0xcc1762b626f8ca7b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcc1762b626f8ca74 expref: 18 pid: 94308 timeout: 3671 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784189329.613598:0:7455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2600 00000100:00100000:1.0:1784189329.613607:0:7455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf46900000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bd553d0d-03e2-4233-b06b-b55bbfa2b954+18:3643:x1870854458249728:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1784189329.613617:0:7455:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784189329.613622:0:7455:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9dc058f67200/0xcc1762b626f8cac1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcc1762b626f8caba expref: 18 pid: 94308 timeout: 3671 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189329.613632:0:7455:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9dc058f67200/0xcc1762b626f8cac1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcc1762b626f8caba expref: 18 pid: 94308 timeout: 3671 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189329.613646:0:7455:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dc058f67200/0xcc1762b626f8cac1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcc1762b626f8caba expref: 18 pid: 94308 timeout: 3671 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784189329.613701:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf4a343b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bd553d0d-03e2-4233-b06b-b55bbfa2b954:3642:1870854458250112:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1784189329.613735:0:25703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2601 00000100:00100000:0.0:1784189329.613744:0:25703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf46903800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:bd553d0d-03e2-4233-b06b-b55bbfa2b954+18:3643:x1870854458250240:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1784189329.613752:0:25703:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784189329.613756:0:25703:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9dc058f66a00/0xcc1762b626f8ca7b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcc1762b626f8ca74 expref: 18 pid: 94308 timeout: 3671 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189329.613765:0:25703:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9dc058f66a00/0xcc1762b626f8ca7b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcc1762b626f8ca74 expref: 18 pid: 94308 timeout: 3671 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189329.613776:0:25703:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dc058f66a00/0xcc1762b626f8ca7b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcc1762b626f8ca74 expref: 18 pid: 94308 timeout: 3671 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189329.613789:0:25703:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9dc042d67800/0xcc1762b626f8cae4 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 95336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189329.613798:0:25703:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dc042d67800/0xcc1762b626f8cae4 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 95336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189329.613812:0:25703:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9dc042d67800/0xcc1762b626f8cae4 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 95336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189329.613818:0:25703:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9dc042d67800/0xcc1762b626f8cae4 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 95336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189329.613824:0:25703:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9dc042d67800/0xcc1762b626f8cae4 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 95336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189329.613838:0:25703:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9dc042d67800/0xcc1762b626f8cae4 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 95336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189329.613844:0:25703:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc042d67800 already unused, calling callback (ffffffffc0b2e230) 00010000:00010000:0.0:1784189329.613848:0:25703:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9dc042d67800/0xcc1762b626f8cae4 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 95336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189329.613856:0:25703:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9dc042d67800/0xcc1762b626f8cae4 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 95336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189329.613945:0:25703:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9dc042d67800/0xcc1762b626f8cae4 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 95336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189329.613958:0:25703:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784189329.613994:0:25703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf46903800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:bd553d0d-03e2-4233-b06b-b55bbfa2b954+17:3643:x1870854458250240:12345-0@lo:103:ldlm_bl.0 Request processed in 251us (466us total) trans 0 rc 0/0 00000100:00100000:0.0:1784189329.614002:0:25703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2601 00000100:00100000:0.0:1784189329.614040:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf4a340000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:bd553d0d-03e2-4233-b06b-b55bbfa2b954:3643:1870854458250240:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1784189329.614056:0:95336:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9dc042d67800/0xcc1762b626f8cae4 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 95336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189329.614067:0:95336:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9dc042d67800/0xcc1762b626f8cae4 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 95336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189329.614074:0:95336:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dc042d67800/0xcc1762b626f8cae4 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 95336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189329.614089:0:7455:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784189329.614259:0:7455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf46900000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bd553d0d-03e2-4233-b06b-b55bbfa2b954+15:3643:x1870854458249728:12345-0@lo:103:ldlm_bl.0 Request processed in 653us (820us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189329.614267:0:7455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2600 00000100:00100000:0.0:1784189329.614341:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc080f68380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:bd553d0d-03e2-4233-b06b-b55bbfa2b954:3643:1870854458249728:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1784189330.159700:0:7454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784189330.479778:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf4a340380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1870854458250752:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1784189330.479868:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784189330.480037:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458250752 00000100:00100000:2.0:1784189330.480045:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458250752 00000100:00100000:2.0:1784189330.480102:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2070 00000100:00100000:2.0:1784189330.480113:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc0477c2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1870854458250752:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1784189330.480150:0:8432:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8618304 pending 0 free 3922481152 avail 3690958848 00000100:00100000:2.0:1784189330.480192:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc0477c2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1870854458250752:12345-0@lo:13:osp-pre-0-1.0 Request processed in 81us (324us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189330.480199:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2070 00000100:00080000:0.0:1784189330.480287:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1784189330.480348:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf4a340380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1870854458250752:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1784189330.480492:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf48599500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1870854458250880:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1784189330.480520:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784189330.480620:0:9466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458250880 00000100:00100000:1.0:1784189330.480625:0:9466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458250880 00000100:00100000:1.0:1784189330.480673:0:9466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2071 00000100:00100000:1.0:1784189330.480681:0:9466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf4a341c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1870854458250880:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1784189330.480697:0:9466:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8646976 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1784189330.480743:0:9466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf4a341c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1870854458250880:12345-0@lo:13:osp-pre-1-1.0 Request processed in 64us (222us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189330.480750:0:9466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2071 00000100:00100000:2.0:1784189330.480962:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf48599500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1870854458250880:0@lo:13:osp-pre-1-1.0 00000100:00080000:0.0:1784189330.481024:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 10000000:01000000:0.0:1784189330.671439:0:6510:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1784189330.671448:0:6510:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9dc07a8f1800 from 61 10000000:01000000:0.0:1784189330.671455:0:6510:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1784189330.671529:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff9dc081b16c00/0xcc1762b626f8caeb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189330.671541:0:6510:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: ffff9dc081b16c00/0xcc1762b626f8caeb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189330.671551:0:6510:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: ffff9dc081b16c00/0xcc1762b626f8caeb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784189330.671577:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc0477c1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458251008:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1784189330.671664:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784189330.671706:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dc0710df0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1784189330.671730:0:94314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458251008 00000100:00100000:1.0:1784189330.671738:0:94314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458251008 00000100:00100000:1.0:1784189330.671797:0:94314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:1.0:1784189330.671807:0:94314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc07fa63c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:bd553d0d-03e2-4233-b06b-b55bbfa2b954+15:6510:x1870854458251008:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784189330.671959:0:94314:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784189330.671974:0:94314:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dc042d67400/0xcc1762b626f8caf2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xcc1762b626f8caeb expref: -99 pid: 94314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189330.672000:0:94314:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dc042d67400/0xcc1762b626f8caf2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcc1762b626f8caeb expref: 16 pid: 94314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189330.672010:0:94314:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dc042d67400/0xcc1762b626f8caf2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcc1762b626f8caeb expref: 16 pid: 94314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189330.672018:0:94314:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc042d67400, rc 0) 00000100:00100000:1.0:1784189330.672065:0:94314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc07fa63c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:bd553d0d-03e2-4233-b06b-b55bbfa2b954+16:6510:x1870854458251008:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 259us (400us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189330.672073:0:94314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:0.0:1784189330.672105:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc0477c1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458251008:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784189330.672121:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: ffff9dc081b16c00/0xcc1762b626f8caeb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc1762b626f8caf2 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189330.672130:0:6510:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: ffff9dc081b16c00/0xcc1762b626f8caeb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcc1762b626f8caf2 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784189330.672192:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc0477c1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458251136:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1784189330.672217:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784189330.672242:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dc0710df0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1784189330.672356:0:94309:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458251136 00000100:00100000:1.0:1784189330.672362:0:94309:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458251136 00000100:00100000:1.0:1784189330.672396:0:94309:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:1.0:1784189330.672403:0:94309:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc044984c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd553d0d-03e2-4233-b06b-b55bbfa2b954+16:6510:x1870854458251136:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1784189330.672529:0:94309:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc044984c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd553d0d-03e2-4233-b06b-b55bbfa2b954+16:6510:x1870854458251136:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 126us (309us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189330.672536:0:94309:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:0.0:1784189330.672772:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc0477c1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458251136:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1784189330.672803:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc0477c1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458251264:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1784189330.672842:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784189330.672871:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dc0710df0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1784189330.672940:0:94308:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458251264 00000100:00100000:3.0:1784189330.672945:0:94308:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458251264 00000100:00100000:3.0:1784189330.672975:0:94308:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:3.0:1784189330.672983:0:94308:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc044986450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd553d0d-03e2-4233-b06b-b55bbfa2b954+16:6510:x1870854458251264:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1784189330.673094:0:94308:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc044986450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd553d0d-03e2-4233-b06b-b55bbfa2b954+16:6510:x1870854458251264:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 111us (251us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189330.673102:0:94308:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:0.0:1784189330.673300:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc0477c1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458251264:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1784189330.674310:0:95340:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf4859b480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bd553d0d-03e2-4233-b06b-b55bbfa2b954:95340:1870854458251392:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1784189330.674400:0:95340:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784189330.674490:0:95340:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dc0760d8600 going to sleep for 11 seconds 00000100:00100000:3.0:1784189330.681456:0:94309:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458251392 00000100:00100000:3.0:1784189330.681478:0:94309:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458251392 00000100:00100000:3.0:1784189330.681555:0:94309:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:3.0:1784189330.681567:0:94309:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc044985c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd553d0d-03e2-4233-b06b-b55bbfa2b954+16:95340:x1870854458251392:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1784189330.681839:0:94309:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc044985c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd553d0d-03e2-4233-b06b-b55bbfa2b954+16:95340:x1870854458251392:12345-0@lo:502:llog_process_th.0 Request processed in 275us (7438us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189330.681848:0:94309:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:2.0:1784189330.682362:0:95340:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf4859b480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bd553d0d-03e2-4233-b06b-b55bbfa2b954:95340:1870854458251392:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1784189330.682428:0:95340:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf4a342d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bd553d0d-03e2-4233-b06b-b55bbfa2b954:95340:1870854458251520:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1784189330.682484:0:95340:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784189330.682519:0:95340:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dc07569f900 going to sleep for 11 seconds 00000100:00100000:3.0:1784189330.682650:0:94308:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458251520 00000100:00100000:3.0:1784189330.682656:0:94308:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458251520 00000100:00100000:3.0:1784189330.682688:0:94308:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:3.0:1784189330.682696:0:94308:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc044987450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd553d0d-03e2-4233-b06b-b55bbfa2b954+16:95340:x1870854458251520:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1784189330.682823:0:94308:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc044987450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd553d0d-03e2-4233-b06b-b55bbfa2b954+16:95340:x1870854458251520:12345-0@lo:502:llog_process_th.0 Request processed in 128us (338us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189330.682836:0:94308:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:2.0:1784189330.682971:0:95340:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf4a342d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bd553d0d-03e2-4233-b06b-b55bbfa2b954:95340:1870854458251520:0@lo:502:llog_process_th.0 00000040:00080000:2.0:1784189330.682998:0:95340:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64 count 63 00000020:01000000:0.0:1784189330.688229:0:6510:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 61-63 (rc=0) 10000000:01000000:0.0:1784189330.688272:0:6510:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1784189330.688284:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff9dc081b16c00/0xcc1762b626f8caeb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc1762b626f8caf2 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189330.688296:0:6510:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: ffff9dc081b16c00/0xcc1762b626f8caeb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc1762b626f8caf2 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784189330.688306:0:6510:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:0.0:1784189330.688309:0:6510:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 56 10000000:01000000:0.0:1784189330.688312:0:6510:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1784189330.688436:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff9dc081b17600/0xcc1762b626f8caf9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189330.688445:0:6510:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: ffff9dc081b17600/0xcc1762b626f8caf9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189330.688455:0:6510:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: ffff9dc081b17600/0xcc1762b626f8caf9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784189330.688566:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc0477c1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458251648:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1784189330.688634:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784189330.688862:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dc0710df0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1784189330.688928:0:94309:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458251648 00000100:00100000:3.0:1784189330.688935:0:94309:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458251648 00000100:00100000:3.0:1784189330.688979:0:94309:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:3.0:1784189330.688988:0:94309:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc044987c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd553d0d-03e2-4233-b06b-b55bbfa2b954+16:6510:x1870854458251648:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784189330.689002:0:94309:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784189330.689015:0:94309:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dc058f67e00/0xcc1762b626f8cb00 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xcc1762b626f8caf9 expref: -99 pid: 94309 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189330.689039:0:94309:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dc058f67e00/0xcc1762b626f8cb00 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcc1762b626f8caf9 expref: 17 pid: 94309 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189330.689049:0:94309:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dc058f67e00/0xcc1762b626f8cb00 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcc1762b626f8caf9 expref: 17 pid: 94309 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189330.689057:0:94309:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc058f67e00, rc 0) 00000100:00100000:3.0:1784189330.690379:0:94309:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc044987c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd553d0d-03e2-4233-b06b-b55bbfa2b954+17:6510:x1870854458251648:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 1386us (1740us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189330.690390:0:94309:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:0.0:1784189330.690418:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc0477c1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458251648:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784189330.690438:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: ffff9dc081b17600/0xcc1762b626f8caf9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc1762b626f8cb00 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189330.690450:0:6510:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: ffff9dc081b17600/0xcc1762b626f8caf9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xcc1762b626f8cb00 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784189330.690737:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc0477c1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458251776:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1784189330.690774:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784189330.690850:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dc0710df0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1784189330.690962:0:94314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458251776 00000100:00100000:1.0:1784189330.690969:0:94314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458251776 00000100:00100000:1.0:1784189330.691012:0:94314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:1.0:1784189330.691021:0:94314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc044984050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:bd553d0d-03e2-4233-b06b-b55bbfa2b954+17:6510:x1870854458251776:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1784189330.691351:0:94314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc044984050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:bd553d0d-03e2-4233-b06b-b55bbfa2b954+17:6510:x1870854458251776:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 297us (542us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189330.691360:0:94314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:0.0:1784189330.691538:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc0477c1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458251776:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1784189330.691571:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc0477c1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458251904:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1784189330.691736:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784189330.691795:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dc0710df0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1784189330.691834:0:94310:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458251904 00000100:00100000:1.0:1784189330.691838:0:94310:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458251904 00000100:00100000:1.0:1784189330.691991:0:94310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:1.0:1784189330.691999:0:94310:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc044986c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd553d0d-03e2-4233-b06b-b55bbfa2b954+17:6510:x1870854458251904:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1784189330.692142:0:94310:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc044986c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd553d0d-03e2-4233-b06b-b55bbfa2b954+17:6510:x1870854458251904:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 144us (406us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189330.692149:0:94310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:0.0:1784189330.692292:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc0477c1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458251904:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1784189330.692862:0:95341:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf46901500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bd553d0d-03e2-4233-b06b-b55bbfa2b954:95341:1870854458252032:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1784189330.692931:0:95341:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784189330.692966:0:95341:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dc080ea9000 going to sleep for 11 seconds 00000100:00100000:0.0:1784189330.693135:0:94308:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458252032 00000100:00100000:0.0:1784189330.693141:0:94308:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458252032 00000100:00100000:0.0:1784189330.693182:0:94308:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:0.0:1784189330.693189:0:94308:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc044985050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd553d0d-03e2-4233-b06b-b55bbfa2b954+17:95341:x1870854458252032:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1784189330.693298:0:94308:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc044985050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd553d0d-03e2-4233-b06b-b55bbfa2b954+17:95341:x1870854458252032:12345-0@lo:502:llog_process_th.0 Request processed in 108us (366us total) trans 0 rc 0/0 00000100:00100000:0.0:1784189330.693305:0:94308:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:3.0:1784189330.693456:0:95341:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf46901500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bd553d0d-03e2-4233-b06b-b55bbfa2b954:95341:1870854458252032:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1784189330.693532:0:95341:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1784189330.693544:0:95341:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784189330.693547:0:95341:0:(obd_config.c:1561:class_process_config()) marker 50 (0x1) lustre-MDT0000-m del lustre.pool_134 00000020:00000080:3.0:1784189330.693553:0:95341:0:(obd_config.c:1470:class_process_config()) processing cmd: ce023 00000100:00100000:3.0:1784189330.695864:0:95341:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf46901500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bd553d0d-03e2-4233-b06b-b55bbfa2b954:95341:1870854458252160:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1784189330.696027:0:95341:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784189330.696175:0:95341:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dc080ea9540 going to sleep for 11 seconds 00000100:00100000:1.0:1784189330.696213:0:94309:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458252160 00000100:00100000:1.0:1784189330.696220:0:94309:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458252160 00000100:00100000:1.0:1784189330.696312:0:94309:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:1.0:1784189330.696354:0:94309:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc044985450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd553d0d-03e2-4233-b06b-b55bbfa2b954+17:95341:x1870854458252160:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1784189330.696473:0:94309:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc044985450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd553d0d-03e2-4233-b06b-b55bbfa2b954+17:95341:x1870854458252160:12345-0@lo:502:llog_process_th.0 Request processed in 110us (434us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189330.696481:0:94309:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:3.0:1784189330.696573:0:95341:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf46901500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bd553d0d-03e2-4233-b06b-b55bbfa2b954:95341:1870854458252160:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1784189330.696611:0:95341:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1784189330.696618:0:95341:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784189330.696620:0:95341:0:(obd_config.c:1561:class_process_config()) marker 50 (0x2) lustre-MDT0000-m del lustre.pool_134 00000040:00080000:3.0:1784189330.696625:0:95341:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 59 count 58 00000020:01000000:2.0:1784189330.696827:0:6510:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 56-58 (rc=0) 10000000:01000000:2.0:1784189330.696850:0:6510:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1784189330.696860:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff9dc081b17600/0xcc1762b626f8caf9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc1762b626f8cb00 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189330.696870:0:6510:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: ffff9dc081b17600/0xcc1762b626f8caf9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc1762b626f8cb00 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784189330.696879:0:6510:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1784189330.696888:0:6510:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9dbf44675800 from 61 10000000:01000000:2.0:1784189330.696891:0:6510:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1784189330.696927:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff9dc0565e7e00/0xcc1762b626f8cb07 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189330.696936:0:6510:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: ffff9dc0565e7e00/0xcc1762b626f8cb07 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189330.696945:0:6510:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: ffff9dc0565e7e00/0xcc1762b626f8cb07 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784189330.696960:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf4a342d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458252288:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1784189330.696992:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784189330.697529:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dc07569f900 going to sleep for 11 seconds 00000100:00100000:0.0:1784189330.697663:0:94308:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458252288 00000100:00100000:0.0:1784189330.697670:0:94308:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458252288 00000100:00100000:0.0:1784189330.697716:0:94308:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:0.0:1784189330.697724:0:94308:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc044985850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd553d0d-03e2-4233-b06b-b55bbfa2b954+17:6510:x1870854458252288:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784189330.697736:0:94308:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784189330.697750:0:94308:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dc081b16a00/0xcc1762b626f8cb0e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xcc1762b626f8cb07 expref: -99 pid: 94308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189330.697771:0:94308:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dc081b16a00/0xcc1762b626f8cb0e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcc1762b626f8cb07 expref: 18 pid: 94308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189330.697791:0:94308:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dc081b16a00/0xcc1762b626f8cb0e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcc1762b626f8cb07 expref: 18 pid: 94308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189330.697800:0:94308:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc081b16a00, rc 0) 00000100:00100000:0.0:1784189330.697839:0:94308:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc044985850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd553d0d-03e2-4233-b06b-b55bbfa2b954+18:6510:x1870854458252288:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 116us (845us total) trans 0 rc 0/0 00000100:00100000:0.0:1784189330.697845:0:94308:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:2.0:1784189330.697950:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf4a342d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458252288:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1784189330.697966:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: ffff9dc0565e7e00/0xcc1762b626f8cb07 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc1762b626f8cb0e expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189330.697976:0:6510:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: ffff9dc0565e7e00/0xcc1762b626f8cb07 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xcc1762b626f8cb0e expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784189330.698040:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf4a342d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458252416:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1784189330.698084:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784189330.698106:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dc07569f900 going to sleep for 11 seconds 00000100:00100000:0.0:1784189330.698217:0:94308:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458252416 00000100:00100000:0.0:1784189330.698221:0:94308:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458252416 00000100:00100000:0.0:1784189330.698253:0:94308:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:0.0:1784189330.698260:0:94308:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc044984450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd553d0d-03e2-4233-b06b-b55bbfa2b954+18:6510:x1870854458252416:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1784189330.698397:0:94308:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc044984450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd553d0d-03e2-4233-b06b-b55bbfa2b954+18:6510:x1870854458252416:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 136us (311us total) trans 0 rc 0/0 00000100:00100000:0.0:1784189330.698404:0:94308:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:2.0:1784189330.698693:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf4a342d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458252416:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1784189330.698721:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf4a342d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458252544:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1784189330.698762:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784189330.698791:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dc07569f900 going to sleep for 11 seconds 00000100:00100000:0.0:1784189330.698844:0:94308:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458252544 00000100:00100000:0.0:1784189330.698849:0:94308:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458252544 00000100:00100000:0.0:1784189330.698881:0:94308:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:0.0:1784189330.698887:0:94308:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc044984850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd553d0d-03e2-4233-b06b-b55bbfa2b954+18:6510:x1870854458252544:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1784189330.698983:0:94308:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc044984850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd553d0d-03e2-4233-b06b-b55bbfa2b954+18:6510:x1870854458252544:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 96us (220us total) trans 0 rc 0/0 00000100:00100000:0.0:1784189330.698990:0:94308:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:2.0:1784189330.699129:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf4a342d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458252544:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1784189330.699841:0:95342:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf4a342d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bd553d0d-03e2-4233-b06b-b55bbfa2b954:95342:1870854458252672:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1784189330.699889:0:95342:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784189330.699968:0:95342:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dc07569f3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1784189330.700004:0:94310:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458252672 00000100:00100000:1.0:1784189330.700010:0:94310:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458252672 00000100:00100000:0.0:1784189330.700133:0:94308:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:0.0:1784189330.700142:0:94308:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc044986850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd553d0d-03e2-4233-b06b-b55bbfa2b954+18:95342:x1870854458252672:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1784189330.700277:0:94308:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc044986850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd553d0d-03e2-4233-b06b-b55bbfa2b954+18:95342:x1870854458252672:12345-0@lo:502:llog_process_th.0 Request processed in 136us (387us total) trans 0 rc 0/0 00000100:00100000:0.0:1784189330.700293:0:94308:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:2.0:1784189330.701190:0:95342:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf4a342d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bd553d0d-03e2-4233-b06b-b55bbfa2b954:95342:1870854458252672:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1784189330.701256:0:95342:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf4a342d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bd553d0d-03e2-4233-b06b-b55bbfa2b954:95342:1870854458252800:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1784189330.701305:0:95342:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784189330.701587:0:95342:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dc07569f3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1784189330.701648:0:94309:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458252800 00000100:00100000:1.0:1784189330.701661:0:94309:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458252800 00000100:00100000:1.0:1784189330.701706:0:94309:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:1.0:1784189330.701714:0:94309:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc044987050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd553d0d-03e2-4233-b06b-b55bbfa2b954+18:95342:x1870854458252800:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1784189330.703673:0:94309:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc044987050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd553d0d-03e2-4233-b06b-b55bbfa2b954+18:95342:x1870854458252800:12345-0@lo:502:llog_process_th.0 Request processed in 1953us (2360us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189330.703687:0:94309:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:2.0:1784189330.703959:0:95342:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf4a342d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bd553d0d-03e2-4233-b06b-b55bbfa2b954:95342:1870854458252800:0@lo:502:llog_process_th.0 00000040:00080000:2.0:1784189330.704013:0:95342:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64 count 63 00000020:01000000:0.0:1784189330.704973:0:6510:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 61-63 (rc=0) 10000000:01000000:0.0:1784189330.704999:0:6510:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1784189330.705009:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff9dc0565e7e00/0xcc1762b626f8cb07 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc1762b626f8cb0e expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189330.705020:0:6510:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: ffff9dc0565e7e00/0xcc1762b626f8cb07 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc1762b626f8cb0e expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784189330.705030:0:6510:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:0.0:1784189330.705032:0:6510:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 56 10000000:01000000:0.0:1784189330.705035:0:6510:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:0.0:1784189330.705070:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff9dc081b16200/0xcc1762b626f8cb15 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189330.705077:0:6510:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: ffff9dc081b16200/0xcc1762b626f8cb15 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189330.705086:0:6510:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: ffff9dc081b16200/0xcc1762b626f8cb15 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784189330.705109:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc0477c1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458252928:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1784189330.705164:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784189330.705204:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dc0715a3300 going to sleep for 11 seconds 00000100:00100000:3.0:1784189330.706921:0:94308:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458252928 00000100:00100000:3.0:1784189330.706933:0:94308:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458252928 00000100:00100000:3.0:1784189330.707001:0:94308:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:3.0:1784189330.707011:0:94308:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc044941450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd553d0d-03e2-4233-b06b-b55bbfa2b954+18:6510:x1870854458252928:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784189330.707025:0:94308:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784189330.707041:0:94308:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dc058f66c00/0xcc1762b626f8cb1c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xcc1762b626f8cb15 expref: -99 pid: 94308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189330.707066:0:94308:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dc058f66c00/0xcc1762b626f8cb1c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcc1762b626f8cb15 expref: 19 pid: 94308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189330.707076:0:94308:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dc058f66c00/0xcc1762b626f8cb1c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcc1762b626f8cb15 expref: 19 pid: 94308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189330.707084:0:94308:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc058f66c00, rc 0) 00000100:00100000:3.0:1784189330.707534:0:94308:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc044941450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd553d0d-03e2-4233-b06b-b55bbfa2b954+19:6510:x1870854458252928:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 522us (2368us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189330.707541:0:94308:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:0.0:1784189330.707864:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc0477c1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458252928:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784189330.707881:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: ffff9dc081b16200/0xcc1762b626f8cb15 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc1762b626f8cb1c expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189330.707908:0:6510:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: ffff9dc081b16200/0xcc1762b626f8cb15 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xcc1762b626f8cb1c expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784189330.707993:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc0477c1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458253056:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1784189330.708031:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784189330.708105:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dc0715a3300 going to sleep for 11 seconds 00000100:00100000:1.0:1784189330.708214:0:94309:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458253056 00000100:00100000:1.0:1784189330.708219:0:94309:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458253056 00000100:00100000:1.0:1784189330.708288:0:94309:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:1.0:1784189330.708298:0:94309:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc044943c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd553d0d-03e2-4233-b06b-b55bbfa2b954+19:6510:x1870854458253056:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1784189330.708472:0:94309:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc044943c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd553d0d-03e2-4233-b06b-b55bbfa2b954+19:6510:x1870854458253056:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 176us (440us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189330.708481:0:94309:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:0.0:1784189330.708926:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc0477c1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458253056:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1784189330.708962:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc0477c1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458253184:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1784189330.709007:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784189330.709039:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dc0715a3300 going to sleep for 11 seconds 00000100:00100000:2.0:1784189330.709537:0:94310:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458253184 00000100:00100000:2.0:1784189330.709543:0:94310:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458253184 00000100:00100000:3.0:1784189330.709650:0:94308:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:3.0:1784189330.709661:0:94308:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc044940850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd553d0d-03e2-4233-b06b-b55bbfa2b954+19:6510:x1870854458253184:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1784189330.709767:0:94308:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc044940850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd553d0d-03e2-4233-b06b-b55bbfa2b954+19:6510:x1870854458253184:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 109us (759us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189330.709775:0:94308:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:0.0:1784189330.709874:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc0477c1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458253184:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1784189330.710187:0:95343:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf46901500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bd553d0d-03e2-4233-b06b-b55bbfa2b954:95343:1870854458253312:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1784189330.710228:0:95343:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784189330.710260:0:95343:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dc080ea9300 going to sleep for 11 seconds 00000100:00100000:2.0:1784189330.710302:0:94314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458253312 00000100:00100000:2.0:1784189330.710307:0:94314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458253312 00000100:00100000:2.0:1784189330.710371:0:94314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:2.0:1784189330.710379:0:94314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc044943050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:bd553d0d-03e2-4233-b06b-b55bbfa2b954+19:95343:x1870854458253312:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1784189330.710457:0:94314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc044943050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:bd553d0d-03e2-4233-b06b-b55bbfa2b954+19:95343:x1870854458253312:12345-0@lo:502:llog_process_th.0 Request processed in 80us (229us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189330.710464:0:94314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:0.0:1784189330.710539:0:95343:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf46901500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bd553d0d-03e2-4233-b06b-b55bbfa2b954:95343:1870854458253312:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1784189330.710561:0:95343:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1784189330.710571:0:95343:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784189330.710574:0:95343:0:(obd_config.c:1561:class_process_config()) marker 51 (0x1) lustre-MDT0001-m del lustre.pool_134 00000020:00000080:0.0:1784189330.710578:0:95343:0:(obd_config.c:1470:class_process_config()) processing cmd: ce023 00000100:00100000:0.0:1784189330.712865:0:95343:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc0477c1180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bd553d0d-03e2-4233-b06b-b55bbfa2b954:95343:1870854458253440:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1784189330.712953:0:95343:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784189330.712995:0:95343:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dc0715a3900 going to sleep for 11 seconds 00000100:00100000:3.0:1784189330.713220:0:94308:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458253440 00000100:00100000:3.0:1784189330.713228:0:94308:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458253440 00000100:00100000:3.0:1784189330.713283:0:94308:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:3.0:1784189330.713293:0:94308:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc044941850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd553d0d-03e2-4233-b06b-b55bbfa2b954+19:95343:x1870854458253440:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1784189330.713430:0:94308:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc044941850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd553d0d-03e2-4233-b06b-b55bbfa2b954+19:95343:x1870854458253440:12345-0@lo:502:llog_process_th.0 Request processed in 139us (477us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189330.713438:0:94308:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1784189330.713579:0:95343:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc0477c1180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bd553d0d-03e2-4233-b06b-b55bbfa2b954:95343:1870854458253440:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1784189330.713676:0:95343:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1784189330.713683:0:95343:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784189330.713685:0:95343:0:(obd_config.c:1561:class_process_config()) marker 51 (0x2) lustre-MDT0001-m del lustre.pool_134 00000040:00080000:0.0:1784189330.713688:0:95343:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 59 count 58 00000020:01000000:2.0:1784189330.713846:0:6510:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 56-58 (rc=0) 10000000:01000000:2.0:1784189330.713868:0:6510:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:2.0:1784189330.713878:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff9dc081b16200/0xcc1762b626f8cb15 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc1762b626f8cb1c expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189330.713889:0:6510:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: ffff9dc081b16200/0xcc1762b626f8cb15 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc1762b626f8cb1c expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784189330.713906:0:6510:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1784189330.713908:0:6510:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9dbf425f7000 from 61 10000000:01000000:2.0:1784189330.713923:0:6510:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1784189330.713950:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff9dc0565e7600/0xcc1762b626f8cb23 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189330.713958:0:6510:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: ffff9dc0565e7600/0xcc1762b626f8cb23 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189330.713966:0:6510:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: ffff9dc0565e7600/0xcc1762b626f8cb23 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784189330.713982:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf4a342d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458253568:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1784189330.714012:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784189330.714044:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dc07569ff00 going to sleep for 11 seconds 00000100:00100000:3.0:1784189330.714088:0:94308:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458253568 00000100:00100000:3.0:1784189330.714092:0:94308:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458253568 00000100:00100000:3.0:1784189330.714125:0:94308:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:3.0:1784189330.714132:0:94308:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc044941c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd553d0d-03e2-4233-b06b-b55bbfa2b954+19:6510:x1870854458253568:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784189330.714141:0:94308:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784189330.714152:0:94308:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dc058f66600/0xcc1762b626f8cb2a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xcc1762b626f8cb23 expref: -99 pid: 94308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189330.714174:0:94308:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dc058f66600/0xcc1762b626f8cb2a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcc1762b626f8cb23 expref: 20 pid: 94308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189330.714185:0:94308:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dc058f66600/0xcc1762b626f8cb2a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcc1762b626f8cb23 expref: 20 pid: 94308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189330.714205:0:94308:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc058f66600, rc 0) 00000100:00100000:3.0:1784189330.714243:0:94308:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc044941c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd553d0d-03e2-4233-b06b-b55bbfa2b954+20:6510:x1870854458253568:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 111us (230us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189330.714249:0:94308:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:0.0:1784189330.714347:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf4a342d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458253568:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784189330.714361:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: ffff9dc0565e7600/0xcc1762b626f8cb23 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc1762b626f8cb2a expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189330.714370:0:6510:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: ffff9dc0565e7600/0xcc1762b626f8cb23 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xcc1762b626f8cb2a expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784189330.714424:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc0477c1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458253696:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1784189330.714454:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784189330.714473:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dc0715a3900 going to sleep for 11 seconds 00000100:00100000:2.0:1784189330.714528:0:94310:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458253696 00000100:00100000:2.0:1784189330.714532:0:94310:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458253696 00000100:00100000:2.0:1784189330.714566:0:94310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:2.0:1784189330.714573:0:94310:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc044942850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd553d0d-03e2-4233-b06b-b55bbfa2b954+20:6510:x1870854458253696:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1784189330.714751:0:94310:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc044942850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd553d0d-03e2-4233-b06b-b55bbfa2b954+20:6510:x1870854458253696:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 179us (296us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189330.714758:0:94310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:0.0:1784189330.715100:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc0477c1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458253696:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1784189330.715133:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc0477c1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458253824:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1784189330.715176:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784189330.715235:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dc0715a3900 going to sleep for 11 seconds 00000100:00100000:2.0:1784189330.715926:0:94310:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458253824 00000100:00100000:2.0:1784189330.720214:0:94310:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458253824 00000100:00100000:2.0:1784189330.720335:0:94310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:2.0:1784189330.720347:0:94310:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc044942450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd553d0d-03e2-4233-b06b-b55bbfa2b954+20:6510:x1870854458253824:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1784189330.720517:0:94310:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc044942450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd553d0d-03e2-4233-b06b-b55bbfa2b954+20:6510:x1870854458253824:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 172us (5339us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189330.720532:0:94310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:0.0:1784189330.720660:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc0477c1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458253824:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1784189330.721005:0:95344:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc0477c1180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bd553d0d-03e2-4233-b06b-b55bbfa2b954:95344:1870854458253952:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1784189330.721051:0:95344:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784189330.721088:0:95344:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dc0715a33c0 going to sleep for 11 seconds 00000100:00100000:2.0:1784189330.721127:0:94314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458253952 00000100:00100000:2.0:1784189330.721134:0:94314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458253952 00000100:00100000:2.0:1784189330.721169:0:94314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:2.0:1784189330.721176:0:94314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf44915450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:bd553d0d-03e2-4233-b06b-b55bbfa2b954+20:95344:x1870854458253952:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1784189330.721253:0:94314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf44915450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:bd553d0d-03e2-4233-b06b-b55bbfa2b954+20:95344:x1870854458253952:12345-0@lo:502:llog_process_th.0 Request processed in 77us (201us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189330.721259:0:94314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:2.0:1784189330.721299:0:95344:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc0477c1180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bd553d0d-03e2-4233-b06b-b55bbfa2b954:95344:1870854458253952:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1784189330.721362:0:95344:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf4a343800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bd553d0d-03e2-4233-b06b-b55bbfa2b954:95344:1870854458254080:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1784189330.721394:0:95344:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784189330.721414:0:94310:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458254080 00000100:00100000:2.0:1784189330.721417:0:94310:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458254080 00000100:00100000:2.0:1784189330.721439:0:94310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:2.0:1784189330.721445:0:94310:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf44914050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd553d0d-03e2-4233-b06b-b55bbfa2b954+20:95344:x1870854458254080:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1784189330.721502:0:94310:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf44914050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd553d0d-03e2-4233-b06b-b55bbfa2b954+20:95344:x1870854458254080:12345-0@lo:502:llog_process_th.0 Request processed in 56us (107us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189330.721508:0:94310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:2.0:1784189330.721538:0:95344:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dc058076c00 going to sleep for 11 seconds 00000100:00100000:2.0:1784189330.721550:0:95344:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf4a343800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bd553d0d-03e2-4233-b06b-b55bbfa2b954:95344:1870854458254080:0@lo:502:llog_process_th.0 00000040:00080000:2.0:1784189330.721568:0:95344:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64 count 63 00000020:01000000:2.0:1784189330.721626:0:6510:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 61-63 (rc=0) 10000000:01000000:2.0:1784189330.721649:0:6510:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1784189330.721658:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff9dc0565e7600/0xcc1762b626f8cb23 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc1762b626f8cb2a expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189330.721673:0:6510:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: ffff9dc0565e7600/0xcc1762b626f8cb23 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc1762b626f8cb2a expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784189330.721683:0:6510:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:2.0:1784189330.721685:0:6510:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 11 10000000:01000000:2.0:1784189330.721688:0:6510:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:2.0:1784189330.721709:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff9dc0565e7c00/0xcc1762b626f8cb31 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189330.721717:0:6510:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: ffff9dc0565e7c00/0xcc1762b626f8cb31 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189330.721725:0:6510:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: ffff9dc0565e7c00/0xcc1762b626f8cb31 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784189330.721737:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf4a343800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458254208:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1784189330.721761:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784189330.721773:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dc058076c00 going to sleep for 11 seconds 00000100:00100000:2.0:1784189330.721783:0:94314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458254208 00000100:00100000:2.0:1784189330.721786:0:94314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458254208 00000100:00100000:2.0:1784189330.721803:0:94314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:2.0:1784189330.721808:0:94314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf44916850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:bd553d0d-03e2-4233-b06b-b55bbfa2b954+20:6510:x1870854458254208:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1784189330.721815:0:94314:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784189330.721824:0:94314:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dc0565e6600/0xcc1762b626f8cb38 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xcc1762b626f8cb31 expref: -99 pid: 94314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189330.721843:0:94314:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dc0565e6600/0xcc1762b626f8cb38 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcc1762b626f8cb31 expref: 21 pid: 94314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189330.721862:0:94314:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dc0565e6600/0xcc1762b626f8cb38 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcc1762b626f8cb31 expref: 21 pid: 94314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189330.721870:0:94314:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc0565e6600, rc 0) 00000100:00100000:2.0:1784189330.721895:0:94314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf44916850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:bd553d0d-03e2-4233-b06b-b55bbfa2b954+21:6510:x1870854458254208:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 86us (133us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189330.721901:0:94314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:2.0:1784189330.724201:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf4a343800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458254208:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1784189330.724225:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: ffff9dc0565e7c00/0xcc1762b626f8cb31 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc1762b626f8cb38 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189330.724238:0:6510:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: ffff9dc0565e7c00/0xcc1762b626f8cb31 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xcc1762b626f8cb38 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784189330.724315:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf4a343800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458254336:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1784189330.724442:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784189330.724514:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dc058076c00 going to sleep for 11 seconds 00000100:00100000:0.0:1784189330.724851:0:94309:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458254336 00000100:00100000:0.0:1784189330.724858:0:94309:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458254336 00000100:00100000:0.0:1784189330.724906:0:94309:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1784189330.724926:0:94309:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf44917850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd553d0d-03e2-4233-b06b-b55bbfa2b954+21:6510:x1870854458254336:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1784189330.725067:0:94309:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf44917850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd553d0d-03e2-4233-b06b-b55bbfa2b954+21:6510:x1870854458254336:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 142us (624us total) trans 0 rc 0/0 00000100:00100000:0.0:1784189330.725074:0:94309:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:2.0:1784189330.725190:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf4a343800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458254336:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1784189330.725222:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf4a343800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458254464:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1784189330.725262:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784189330.725285:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dc058076c00 going to sleep for 11 seconds 00000100:00100000:0.0:1784189330.725417:0:94314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458254464 00000100:00100000:0.0:1784189330.725421:0:94314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458254464 00000100:00100000:0.0:1784189330.725453:0:94314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1784189330.725459:0:94314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf44916050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:bd553d0d-03e2-4233-b06b-b55bbfa2b954+21:6510:x1870854458254464:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1784189330.725600:0:94314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf44916050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:bd553d0d-03e2-4233-b06b-b55bbfa2b954+21:6510:x1870854458254464:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 140us (336us total) trans 0 rc 0/0 00000100:00100000:0.0:1784189330.725606:0:94314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:1.0:1784189330.725782:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf4a343800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458254464:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1784189330.726773:0:95345:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 64768 count 11 00000020:01000000:1.0:1784189330.726952:0:6510:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 11-10 (rc=0) 10000000:01000000:1.0:1784189330.726976:0:6510:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:1.0:1784189330.726984:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff9dc0565e7c00/0xcc1762b626f8cb31 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc1762b626f8cb38 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189330.726995:0:6510:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: ffff9dc0565e7c00/0xcc1762b626f8cb31 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc1762b626f8cb38 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784189330.727004:0:6510:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1784189330.727006:0:6510:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9dc07b5d6800 from 61 10000000:01000000:1.0:1784189330.727009:0:6510:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1784189330.727038:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff9dc042d67800/0xcc1762b626f8cb3f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189330.727058:0:6510:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: ffff9dc042d67800/0xcc1762b626f8cb3f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189330.727068:0:6510:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: ffff9dc042d67800/0xcc1762b626f8cb3f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784189330.727086:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf4859bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458254592:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1784189330.727132:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784189330.729241:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dc043ca9300 going to sleep for 11 seconds 00000100:00100000:0.0:1784189330.729576:0:94309:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458254592 00000100:00100000:0.0:1784189330.729637:0:94309:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458254592 00000100:00100000:0.0:1784189330.729728:0:94309:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1784189330.729739:0:94309:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf44917450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd553d0d-03e2-4233-b06b-b55bbfa2b954+21:6510:x1870854458254592:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784189330.729753:0:94309:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784189330.729771:0:94309:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dc081b16400/0xcc1762b626f8cb46 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xcc1762b626f8cb3f expref: -99 pid: 94309 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189330.729797:0:94309:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dc081b16400/0xcc1762b626f8cb46 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcc1762b626f8cb3f expref: 22 pid: 94309 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189330.729808:0:94309:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dc081b16400/0xcc1762b626f8cb46 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcc1762b626f8cb3f expref: 22 pid: 94309 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189330.729817:0:94309:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc081b16400, rc 0) 00000100:00100000:0.0:1784189330.729882:0:94309:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf44917450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd553d0d-03e2-4233-b06b-b55bbfa2b954+22:6510:x1870854458254592:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 145us (2749us total) trans 0 rc 0/0 00000100:00100000:0.0:1784189330.729889:0:94309:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1784189330.729973:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf4859bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458254592:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1784189330.729989:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: ffff9dc042d67800/0xcc1762b626f8cb3f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc1762b626f8cb46 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189330.730017:0:6510:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: ffff9dc042d67800/0xcc1762b626f8cb3f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xcc1762b626f8cb46 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784189330.730092:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf4a341880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458254720:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1784189330.730125:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784189330.730228:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dbf410866c0 going to sleep for 11 seconds 00000100:00100000:1.0:1784189330.730297:0:94308:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458254720 00000100:00100000:1.0:1784189330.730302:0:94308:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458254720 00000100:00100000:1.0:1784189330.730366:0:94308:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1784189330.730374:0:94308:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf44914450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd553d0d-03e2-4233-b06b-b55bbfa2b954+22:6510:x1870854458254720:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1784189330.730477:0:94308:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf44914450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd553d0d-03e2-4233-b06b-b55bbfa2b954+22:6510:x1870854458254720:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 103us (350us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189330.730484:0:94308:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1784189330.730614:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf4a341880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458254720:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1784189330.730643:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf4a341880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458254848:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1784189330.730682:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784189330.730698:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dbf410866c0 going to sleep for 11 seconds 00000100:00100000:1.0:1784189330.730742:0:94308:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458254848 00000100:00100000:1.0:1784189330.730746:0:94308:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458254848 00000100:00100000:1.0:1784189330.730774:0:94308:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1784189330.730780:0:94308:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf44917050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd553d0d-03e2-4233-b06b-b55bbfa2b954+22:6510:x1870854458254848:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1784189330.730849:0:94308:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf44917050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd553d0d-03e2-4233-b06b-b55bbfa2b954+22:6510:x1870854458254848:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 68us (166us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189330.730856:0:94308:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1784189330.730937:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf4a341880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458254848:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1784189330.731254:0:95346:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf4a341880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bd553d0d-03e2-4233-b06b-b55bbfa2b954:95346:1870854458254976:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1784189330.731287:0:95346:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784189330.731307:0:95346:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dbf410866c0 going to sleep for 11 seconds 00000100:00100000:1.0:1784189330.731415:0:94308:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458254976 00000100:00100000:1.0:1784189330.731420:0:94308:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458254976 00000100:00100000:1.0:1784189330.731449:0:94308:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:1.0:1784189330.731463:0:94308:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf44915050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd553d0d-03e2-4233-b06b-b55bbfa2b954+22:95346:x1870854458254976:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1784189330.731535:0:94308:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf44915050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd553d0d-03e2-4233-b06b-b55bbfa2b954+22:95346:x1870854458254976:12345-0@lo:502:llog_process_th.0 Request processed in 72us (246us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189330.731542:0:94308:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1784189330.732128:0:95346:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf4a341880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bd553d0d-03e2-4233-b06b-b55bbfa2b954:95346:1870854458254976:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1784189330.732176:0:95346:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf4a341880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bd553d0d-03e2-4233-b06b-b55bbfa2b954:95346:1870854458255104:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1784189330.732216:0:95346:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784189330.732248:0:95346:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dc050825e40 going to sleep for 11 seconds 00000100:00100000:1.0:1784189330.732298:0:94308:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458255104 00000100:00100000:1.0:1784189330.732303:0:94308:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458255104 00000100:00100000:1.0:1784189330.732354:0:94308:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:1.0:1784189330.732361:0:94308:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf44914c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd553d0d-03e2-4233-b06b-b55bbfa2b954+22:95346:x1870854458255104:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1784189330.732431:0:94308:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf44914c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd553d0d-03e2-4233-b06b-b55bbfa2b954+22:95346:x1870854458255104:12345-0@lo:502:llog_process_th.0 Request processed in 69us (214us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189330.732437:0:94308:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:2.0:1784189330.732529:0:95346:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf4a341880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bd553d0d-03e2-4233-b06b-b55bbfa2b954:95346:1870854458255104:0@lo:502:llog_process_th.0 00000040:00080000:2.0:1784189330.732547:0:95346:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64 count 63 00000020:01000000:1.0:1784189330.732697:0:6510:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 61-63 (rc=0) 10000000:01000000:1.0:1784189330.732715:0:6510:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1784189330.732723:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff9dc042d67800/0xcc1762b626f8cb3f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc1762b626f8cb46 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189330.732734:0:6510:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: ffff9dc042d67800/0xcc1762b626f8cb3f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc1762b626f8cb46 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784189330.732743:0:6510:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:1.0:1784189330.732746:0:6510:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 14 10000000:01000000:1.0:1784189330.732749:0:6510:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:1.0:1784189330.732772:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff9dc042d67600/0xcc1762b626f8cb4d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189330.732780:0:6510:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: ffff9dc042d67600/0xcc1762b626f8cb4d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189330.732788:0:6510:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: ffff9dc042d67600/0xcc1762b626f8cb4d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784189330.732809:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf48599c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458255232:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1784189330.732838:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784189330.732868:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dc043ca9840 going to sleep for 11 seconds 00000100:00100000:2.0:1784189330.736270:0:94308:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458255232 00000100:00100000:2.0:1784189330.736287:0:94308:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458255232 00000100:00100000:2.0:1784189330.736365:0:94308:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:2.0:1784189330.736389:0:94308:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf44916c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd553d0d-03e2-4233-b06b-b55bbfa2b954+22:6510:x1870854458255232:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1784189330.736406:0:94308:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784189330.736425:0:94308:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dc0565e7a00/0xcc1762b626f8cb54 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xcc1762b626f8cb4d expref: -99 pid: 94308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189330.736451:0:94308:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dc0565e7a00/0xcc1762b626f8cb54 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcc1762b626f8cb4d expref: 23 pid: 94308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189330.736462:0:94308:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dc0565e7a00/0xcc1762b626f8cb54 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcc1762b626f8cb4d expref: 23 pid: 94308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189330.736471:0:94308:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc0565e7a00, rc 0) 00000100:00100000:2.0:1784189330.736540:0:94308:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf44916c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd553d0d-03e2-4233-b06b-b55bbfa2b954+23:6510:x1870854458255232:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 153us (3700us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189330.736547:0:94308:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:1.0:1784189330.736688:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf48599c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458255232:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784189330.736708:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: ffff9dc042d67600/0xcc1762b626f8cb4d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc1762b626f8cb54 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189330.736719:0:6510:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: ffff9dc042d67600/0xcc1762b626f8cb4d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0xcc1762b626f8cb54 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784189330.736793:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf48599c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458255360:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1784189330.736829:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784189330.736864:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dc043ca9840 going to sleep for 11 seconds 00000100:00100000:2.0:1784189330.736924:0:94308:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458255360 00000100:00100000:2.0:1784189330.736929:0:94308:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458255360 00000100:00100000:2.0:1784189330.736963:0:94308:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:2.0:1784189330.736970:0:94308:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf44914850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd553d0d-03e2-4233-b06b-b55bbfa2b954+23:6510:x1870854458255360:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1784189330.737082:0:94308:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf44914850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd553d0d-03e2-4233-b06b-b55bbfa2b954+23:6510:x1870854458255360:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 112us (253us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189330.737090:0:94308:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:2.0:1784189330.737119:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf48599c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458255360:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1784189330.737145:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf4a341880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458255488:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1784189330.737186:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784189330.737199:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dc050825e40 going to sleep for 11 seconds 00000100:00100000:2.0:1784189330.737211:0:94308:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458255488 00000100:00100000:2.0:1784189330.737221:0:94308:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458255488 00000100:00100000:2.0:1784189330.737238:0:94308:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:2.0:1784189330.737244:0:94308:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf44915850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd553d0d-03e2-4233-b06b-b55bbfa2b954+23:6510:x1870854458255488:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1784189330.737343:0:94308:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf44915850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd553d0d-03e2-4233-b06b-b55bbfa2b954+23:6510:x1870854458255488:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 74us (131us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189330.737351:0:94308:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:2.0:1784189330.737390:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf4a341880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458255488:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1784189330.738030:0:95347:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 64768 count 14 00000020:01000000:2.0:1784189330.738081:0:6510:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 14-13 (rc=0) 10000000:01000000:2.0:1784189330.738098:0:6510:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:2.0:1784189330.738106:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff9dc042d67600/0xcc1762b626f8cb4d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc1762b626f8cb54 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189330.738115:0:6510:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: ffff9dc042d67600/0xcc1762b626f8cb4d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc1762b626f8cb54 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784189330.738125:0:6510:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:2.0:1784189330.738128:0:6510:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-sptlrpc-ffff9dc06bb30000 from 1 10000000:01000000:2.0:1784189330.738130:0:6510:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1784189330.738154:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff9dc0565e6800/0xcc1762b626f8cb5b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189330.738162:0:6510:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: ffff9dc0565e6800/0xcc1762b626f8cb5b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189330.738171:0:6510:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: ffff9dc0565e6800/0xcc1762b626f8cb5b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784189330.738188:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf4a341880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458255616:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1784189330.738230:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784189330.738255:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dc07569f900 going to sleep for 11 seconds 00000100:00100000:2.0:1784189330.738270:0:94308:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458255616 00000100:00100000:2.0:1784189330.738274:0:94308:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458255616 00000100:00100000:2.0:1784189330.738295:0:94308:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:2.0:1784189330.738301:0:94308:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc074ad7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd553d0d-03e2-4233-b06b-b55bbfa2b954+23:6510:x1870854458255616:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1784189330.738310:0:94308:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784189330.738345:0:94308:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dc0565e7800/0xcc1762b626f8cb62 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xcc1762b626f8cb5b expref: -99 pid: 94308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189330.738363:0:94308:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dc0565e7800/0xcc1762b626f8cb62 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcc1762b626f8cb5b expref: 24 pid: 94308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189330.738371:0:94308:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dc0565e7800/0xcc1762b626f8cb62 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcc1762b626f8cb5b expref: 24 pid: 94308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189330.738378:0:94308:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc0565e7800, rc 0) 00000100:00100000:2.0:1784189330.738407:0:94308:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc074ad7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd553d0d-03e2-4233-b06b-b55bbfa2b954+24:6510:x1870854458255616:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 105us (176us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189330.738413:0:94308:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:2.0:1784189330.738447:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf4a341880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458255616:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1784189330.738459:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: ffff9dc0565e6800/0xcc1762b626f8cb5b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc1762b626f8cb62 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189330.738467:0:6510:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: ffff9dc0565e6800/0xcc1762b626f8cb5b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0xcc1762b626f8cb62 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784189330.738506:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf4a341880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458255744:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1784189330.738539:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784189330.738556:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dc07569f900 going to sleep for 11 seconds 00000100:00100000:2.0:1784189330.738567:0:94308:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458255744 00000100:00100000:2.0:1784189330.738570:0:94308:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458255744 00000100:00100000:2.0:1784189330.739984:0:94308:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:2.0:1784189330.740002:0:94308:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf44d0e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd553d0d-03e2-4233-b06b-b55bbfa2b954+24:6510:x1870854458255744:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1784189330.740108:0:94308:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf44d0e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd553d0d-03e2-4233-b06b-b55bbfa2b954+24:6510:x1870854458255744:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 114us (1568us total) trans 0 rc -2/-2 00000100:00100000:2.0:1784189330.740116:0:94308:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:1.0:1784189330.742185:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf4a341880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458255744:0@lo:501:ll_cfg_requeue.0 10000000:01000000:1.0:1784189330.742234:0:6510:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1784189330.742245:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff9dc0565e6800/0xcc1762b626f8cb5b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc1762b626f8cb62 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189330.742256:0:6510:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: ffff9dc0565e6800/0xcc1762b626f8cb5b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc1762b626f8cb62 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784189330.918667:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1784189330.918745:0:94310:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436331520 00000100:00100000:1.0:1784189330.918759:0:94310:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436331520 00000100:00100000:1.0:1784189330.918826:0:94310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 165 00000100:00100000:1.0:1784189330.918836:0:94310:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf44d0e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:60f345e3-c70e-4f53-b5e7-c9671463c9a5+8:70943:x1870854436331520:12345-192.168.203.12@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784189330.918868:0:94310:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784189330.918886:0:94310:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dc042d66e00/0xcc1762b626f8cb69 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xcbfc5de7fe6c410b expref: -99 pid: 94310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189330.918926:0:94310:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dc042d66e00/0xcc1762b626f8cb69 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c410b expref: 9 pid: 94310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189330.918937:0:94310:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dc042d66e00/0xcc1762b626f8cb69 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c410b expref: 9 pid: 94310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189330.918946:0:94310:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc042d66e00, rc 0) 00000100:00100000:1.0:1784189330.919015:0:94310:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf44d0e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:60f345e3-c70e-4f53-b5e7-c9671463c9a5+9:70943:x1870854436331520:12345-192.168.203.12@tcp:101:ll_cfg_requeue.0 Request processed in 180us (364us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189330.919022:0:94310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 165 00000100:00100000:3.0:1784189330.925481:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1784189330.925607:0:94309:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436331648 00000100:00100000:0.0:1784189330.925623:0:94309:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436331648 00000100:00100000:0.0:1784189330.925706:0:94309:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 166 00000100:00100000:0.0:1784189330.925717:0:94309:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf44d0cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:60f345e3-c70e-4f53-b5e7-c9671463c9a5+9:70943:x1870854436331648:12345-192.168.203.12@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1784189330.925932:0:94309:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf44d0cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:60f345e3-c70e-4f53-b5e7-c9671463c9a5+9:70943:x1870854436331648:12345-192.168.203.12@tcp:501:ll_cfg_requeue.0 Request processed in 215us (475us total) trans 0 rc 0/0 00000100:00100000:0.0:1784189330.925941:0:94309:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 166 00000100:00100000:3.0:1784189330.929590:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1784189330.929783:0:94310:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436331776 00000100:00100000:1.0:1784189330.929793:0:94310:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436331776 00000100:00100000:1.0:1784189330.929849:0:94310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 167 00000100:00100000:1.0:1784189330.929858:0:94310:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf44d0d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:60f345e3-c70e-4f53-b5e7-c9671463c9a5+9:70943:x1870854436331776:12345-192.168.203.12@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1784189330.930014:0:94310:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf44d0d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:60f345e3-c70e-4f53-b5e7-c9671463c9a5+9:70943:x1870854436331776:12345-192.168.203.12@tcp:503:ll_cfg_requeue.0 Request processed in 156us (431us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189330.930022:0:94310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 167 00000100:00100000:1.0:1784189330.937624:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1784189330.937724:0:94309:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436331904 00000100:00100000:0.0:1784189330.937734:0:94309:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436331904 00000100:00100000:0.0:1784189330.937793:0:94309:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 168 00000100:00100000:0.0:1784189330.937803:0:94309:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf44d0c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:60f345e3-c70e-4f53-b5e7-c9671463c9a5+9:73335:x1870854436331904:12345-192.168.203.12@tcp:502:llog_process_th.0 00000100:00100000:0.0:1784189330.937964:0:94309:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf44d0c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:60f345e3-c70e-4f53-b5e7-c9671463c9a5+9:73335:x1870854436331904:12345-192.168.203.12@tcp:502:llog_process_th.0 Request processed in 161us (462us total) trans 0 rc 0/0 00000100:00100000:0.0:1784189330.937973:0:94309:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 168 00000100:00100000:3.0:1784189330.942660:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1784189330.942823:0:94310:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436332032 00000100:00100000:1.0:1784189330.942834:0:94310:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436332032 00000100:00100000:1.0:1784189330.942951:0:94310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 169 00000100:00100000:1.0:1784189330.942961:0:94310:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf44d0ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:60f345e3-c70e-4f53-b5e7-c9671463c9a5+9:73335:x1870854436332032:12345-192.168.203.12@tcp:502:llog_process_th.0 00000100:00100000:1.0:1784189330.943150:0:94310:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf44d0ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:60f345e3-c70e-4f53-b5e7-c9671463c9a5+9:73335:x1870854436332032:12345-192.168.203.12@tcp:502:llog_process_th.0 Request processed in 189us (683us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189330.943158:0:94310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 169 00000100:00100000:1.0:1784189330.954368:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1784189330.955217:0:94309:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436332160 00000100:00100000:0.0:1784189330.955229:0:94309:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436332160 00000100:00100000:0.0:1784189330.955288:0:94309:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 170 00000100:00100000:0.0:1784189330.955298:0:94309:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf44d0d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:60f345e3-c70e-4f53-b5e7-c9671463c9a5+9:70943:x1870854436332160:12345-192.168.203.12@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784189330.955313:0:94309:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784189330.955353:0:94309:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dc081b16600/0xcc1762b626f8cb70 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0xcbfc5de7fe6c4112 expref: -99 pid: 94309 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189330.955382:0:94309:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dc081b16600/0xcc1762b626f8cb70 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c4112 expref: 10 pid: 94309 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189330.955393:0:94309:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dc081b16600/0xcc1762b626f8cb70 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c4112 expref: 10 pid: 94309 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189330.955402:0:94309:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc081b16600, rc 0) 00000100:00100000:0.0:1784189330.955468:0:94309:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf44d0d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:60f345e3-c70e-4f53-b5e7-c9671463c9a5+10:70943:x1870854436332160:12345-192.168.203.12@tcp:101:ll_cfg_requeue.0 Request processed in 171us (1110us total) trans 0 rc 0/0 00000100:00100000:0.0:1784189330.955498:0:94309:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 170 00000100:00100000:3.0:1784189330.973418:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1784189330.973615:0:94308:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436332288 00000100:00100000:2.0:1784189330.973625:0:94308:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436332288 00000100:00100000:2.0:1784189330.973746:0:94308:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 171 00000100:00100000:2.0:1784189330.973757:0:94308:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf44d0c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:60f345e3-c70e-4f53-b5e7-c9671463c9a5+10:70943:x1870854436332288:12345-192.168.203.12@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1784189330.973871:0:94308:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf44d0c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:60f345e3-c70e-4f53-b5e7-c9671463c9a5+10:70943:x1870854436332288:12345-192.168.203.12@tcp:501:ll_cfg_requeue.0 Request processed in 116us (461us total) trans 0 rc -2/-2 00000100:00100000:2.0:1784189330.973880:0:94308:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 171 00010000:00010000:3.0:1784189331.183544:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784189332.217609:0:26173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784189333.039809:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf48598380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:bd553d0d-03e2-4233-b06b-b55bbfa2b954:3641:1870854458255872:0@lo:400:kworker.0 00000100:00100000:0.0:1784189333.039876:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784189333.039929:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf4859a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3641:1870854458256384:0@lo:400:kworker.0 00000100:00100000:0.0:1784189333.039954:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784189333.039970:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf48599c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3641:1870854458256896:0@lo:400:kworker.0 00000100:00100000:0.0:1784189333.040000:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784189333.040016:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc05ed9b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3641:1870854458257408:0@lo:400:kworker.0 00000100:00100000:0.0:1784189333.040034:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784189333.040066:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:0.0:1784189333.040072:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf48598e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3641:1870854458256256:0@lo:400:kworker.0 00000100:00100000:0.0:1784189333.040093:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784189333.040108:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf4859aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1870854458256768:0@lo:400:kworker.0 00000100:00100000:0.0:1784189333.040133:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784189333.040152:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf48599500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1870854458257280:0@lo:400:kworker.0 00000100:00100000:0.0:1784189333.040171:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784189333.040195:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf48598000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3643:1870854458256128:0@lo:400:kworker.0 00000100:00100000:0.0:1784189333.040215:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784189333.040228:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf48599f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1870854458256640:0@lo:400:kworker.0 00000100:00100000:0.0:1784189333.040248:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784189333.040259:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf4859b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1870854458257152:0@lo:400:kworker.0 00000100:00100000:0.0:1784189333.040276:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784189333.040290:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:0.0:1784189333.040310:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf48599880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3643:1870854458256000:0@lo:400:kworker.0 00000100:00100000:0.0:1784189333.040358:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784189333.040369:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf4859ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1870854458256512:0@lo:400:kworker.0 00000100:00100000:0.0:1784189333.040392:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784189333.040406:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf4859bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1870854458257024:0@lo:400:kworker.0 00000100:00100000:0.0:1784189333.040425:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784189333.040451:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458256768 00000100:00100000:0.0:1784189333.040457:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458256768 00000100:00100000:0.0:1784189333.040504:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458257280 00000100:00100000:0.0:1784189333.040508:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458257280 00000100:00100000:0.0:1784189333.040524:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458256640 00000100:00100000:0.0:1784189333.040527:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458256640 00000100:00100000:0.0:1784189333.040542:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458257152 00000100:00100000:0.0:1784189333.040545:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458257152 00000100:00100000:0.0:1784189333.040560:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2583 00000100:00100000:0.0:1784189333.040568:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc0477c2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1870854458256768:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784189333.040615:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc0477c2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1870854458256768:12345-0@lo:400:kworker.0 Request processed in 47us (480us total) trans 0 rc 0/0 00000100:00100000:0.0:1784189333.040622:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2583 00000100:00100000:0.0:1784189333.040636:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2584 00000100:00100000:0.0:1784189333.040641:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc0477c0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1870854458257280:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784189333.040665:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc0477c0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1870854458257280:12345-0@lo:400:kworker.0 Request processed in 24us (493us total) trans 0 rc 0/0 00000100:00100000:0.0:1784189333.040670:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2584 00000100:00100000:0.0:1784189333.040679:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2585 00000100:00100000:0.0:1784189333.040684:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc0477c1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1870854458256640:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784189333.040709:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc0477c1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1870854458256640:12345-0@lo:400:kworker.0 Request processed in 25us (461us total) trans 0 rc 0/0 00000100:00100000:0.0:1784189333.040722:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2585 00000100:00100000:0.0:1784189333.040732:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2586 00000100:00100000:0.0:1784189333.040738:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc0477c1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1870854458257152:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784189333.040763:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc0477c1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1870854458257152:12345-0@lo:400:kworker.0 Request processed in 25us (486us total) trans 0 rc 0/0 00000100:00100000:0.0:1784189333.040768:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2586 00000100:00080000:0.0:1784189333.040782:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1784189333.040786:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1784189333.040812:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf48599f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1870854458256640:0@lo:400:kworker.0 00000100:00100000:0.0:1784189333.040821:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf4859b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1870854458257152:0@lo:400:kworker.0 00000100:00100000:0.0:1784189333.040853:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf4859aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1870854458256768:0@lo:400:kworker.0 00000100:00100000:0.0:1784189333.040861:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf48599500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1870854458257280:0@lo:400:kworker.0 00000100:00100000:1.0:1784189333.041087:0:94309:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458255872 00000100:00100000:1.0:1784189333.041093:0:94309:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458255872 00000100:00100000:1.0:1784189333.041130:0:94309:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:1.0:1784189333.041136:0:94309:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf44d0d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd553d0d-03e2-4233-b06b-b55bbfa2b954+24:3641:x1870854458255872:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784189333.041177:0:94309:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf44d0d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd553d0d-03e2-4233-b06b-b55bbfa2b954+24:3641:x1870854458255872:12345-0@lo:400:kworker.0 Request processed in 41us (1301us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189333.041183:0:94309:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:1.0:1784189333.041211:0:68287:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458256384 00000100:00100000:1.0:1784189333.041215:0:68287:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458256384 00000100:00100000:1.0:1784189333.041240:0:68287:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458256896 00000100:00100000:1.0:1784189333.041243:0:68287:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458256896 00000100:00100000:1.0:1784189333.041254:0:68287:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458257408 00000100:00100000:1.0:1784189333.041257:0:68287:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458257408 00000100:00100000:1.0:1784189333.041266:0:68287:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458256256 00000100:00100000:1.0:1784189333.041269:0:68287:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458256256 00000100:00100000:1.0:1784189333.041280:0:68287:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458256128 00000100:00100000:1.0:1784189333.041282:0:68287:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458256128 00000100:00100000:1.0:1784189333.041292:0:68287:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458256000 00000100:00100000:1.0:1784189333.041294:0:68287:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458256000 00000100:00100000:1.0:1784189333.041306:0:68287:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1337 00000100:00100000:1.0:1784189333.041311:0:68287:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc0477c1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1870854458256384:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784189333.041361:0:68287:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc0477c1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1870854458256384:12345-0@lo:400:kworker.0 Request processed in 50us (1406us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189333.041367:0:68287:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1337 00000100:00100000:1.0:1784189333.041389:0:68287:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1338 00000100:00100000:1.0:1784189333.041395:0:68287:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc0477c0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1870854458256896:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784189333.041423:0:68287:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc0477c0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1870854458256896:12345-0@lo:400:kworker.0 Request processed in 29us (1423us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189333.041428:0:68287:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1338 00000100:00100000:1.0:1784189333.041439:0:68287:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1339 00000100:00100000:1.0:1784189333.041444:0:68287:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc0477c3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1870854458257408:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784189333.041467:0:68287:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc0477c3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1870854458257408:12345-0@lo:400:kworker.0 Request processed in 22us (1432us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189333.041472:0:68287:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1339 00000100:00100000:1.0:1784189333.041481:0:68287:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1340 00000100:00100000:1.0:1784189333.041486:0:68287:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc0477c0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1870854458256256:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784189333.041509:0:68287:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc0477c0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1870854458256256:12345-0@lo:400:kworker.0 Request processed in 23us (1415us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189333.041514:0:68287:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1340 00000100:00100000:1.0:1784189333.041524:0:68287:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1341 00000100:00100000:1.0:1784189333.041530:0:68287:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc0477c3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1870854458256128:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784189333.041571:0:68287:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc0477c3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1870854458256128:12345-0@lo:400:kworker.0 Request processed in 41us (1354us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189333.041577:0:68287:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1341 00000100:00100000:1.0:1784189333.041589:0:68287:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1342 00000100:00100000:1.0:1784189333.041594:0:68287:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc0477c0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1870854458256000:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784189333.041620:0:68287:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc0477c0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1870854458256000:12345-0@lo:400:kworker.0 Request processed in 25us (1261us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189333.041625:0:68287:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1342 00000100:00080000:1.0:1784189333.041656:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1784189333.041659:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1784189333.041682:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf48598e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3641:1870854458256256:0@lo:400:kworker.0 00000100:00100000:1.0:1784189333.041692:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf48598380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:bd553d0d-03e2-4233-b06b-b55bbfa2b954:3641:1870854458255872:0@lo:400:kworker.0 00000100:00100000:1.0:1784189333.041701:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf4859a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3641:1870854458256384:0@lo:400:kworker.0 00000100:00100000:1.0:1784189333.041709:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf48599c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3641:1870854458256896:0@lo:400:kworker.0 00000100:00100000:1.0:1784189333.041718:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc05ed9b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3641:1870854458257408:0@lo:400:kworker.0 00000100:00100000:3.0:1784189333.041997:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458256512 00000100:00100000:3.0:1784189333.042002:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458256512 00000100:00100000:3.0:1784189333.042031:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458257024 00000100:00100000:3.0:1784189333.042034:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458257024 00000100:00100000:3.0:1784189333.042060:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3948 00000100:00100000:3.0:1784189333.042067:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc0477c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3643:x1870854458256512:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784189333.042103:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc0477c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3643:x1870854458256512:12345-0@lo:400:kworker.0 Request processed in 37us (1710us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189333.042110:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3948 00000100:00100000:3.0:1784189333.042127:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3949 00000100:00100000:3.0:1784189333.042134:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc0477c2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3643:x1870854458257024:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784189333.042161:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc0477c2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3643:x1870854458257024:12345-0@lo:400:kworker.0 Request processed in 28us (1735us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189333.042166:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3949 00000100:00100000:0.0:1784189333.044468:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc05ed9b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1870854458257664:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1784189333.044529:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784189333.044622:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf48599880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3643:1870854458256000:0@lo:400:kworker.0 00000100:00100000:0.0:1784189333.044634:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf4859ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1870854458256512:0@lo:400:kworker.0 00000100:00100000:0.0:1784189333.044644:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf4859bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1870854458257024:0@lo:400:kworker.0 00000100:00100000:0.0:1784189333.044654:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf48598000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3643:1870854458256128:0@lo:400:kworker.0 00000100:00100000:0.0:1784189333.044682:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1784189333.044688:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf4a341500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1870854458257536:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1784189333.044709:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784189333.055169:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458257664 00000100:00100000:2.0:1784189333.055184:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458257664 00000100:00100000:2.0:1784189333.055265:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458257536 00000100:00100000:2.0:1784189333.055268:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458257536 00000100:00100000:2.0:1784189333.055302:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3950 00000100:00100000:2.0:1784189333.055310:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf48599c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3643:x1870854458257664:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1784189333.055359:0:8438:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445568512 avail 1299329024 00000100:00100000:2.0:1784189333.055438:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf48599c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3643:x1870854458257664:12345-0@lo:41:osp-pre-1-0.0 Request processed in 129us (10909us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189333.055446:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3950 00000100:00100000:2.0:1784189333.055477:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3951 00000100:00100000:2.0:1784189333.055483:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf48598000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3643:x1870854458257536:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1784189333.055499:0:8438:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445253120 avail 1299013632 00000100:00100000:2.0:1784189333.055527:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf48598000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3643:x1870854458257536:12345-0@lo:41:osp-pre-0-1.0 Request processed in 44us (10817us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189333.055534:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3951 00000100:00100000:2.0:1784189333.055587:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf4a341500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1870854458257536:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1784189333.055601:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc05ed9b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1870854458257664:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1784189333.231625:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784189333.552252:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1784189333.552278:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf4859bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1870854458257792:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1784189333.552376:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784189333.552481:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458257792 00000100:00100000:0.0:1784189333.552489:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458257792 00000100:00100000:0.0:1784189333.552540:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2072 00000100:00100000:0.0:1784189333.552557:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc05ed9b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1870854458257792:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1784189333.552587:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8646976 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1784189333.552638:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc05ed9b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1870854458257792:12345-0@lo:13:osp-pre-1-0.0 Request processed in 90us (261us total) trans 0 rc 0/0 00000100:00100000:0.0:1784189333.552645:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2072 00000100:00100000:3.0:1784189333.553126:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf4859bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1870854458257792:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1784189333.553148:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc05ed9a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1870854458257920:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1784189333.553178:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784189333.553290:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458257920 00000100:00100000:0.0:1784189333.553295:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458257920 00000100:00100000:0.0:1784189333.553341:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2073 00000100:00100000:0.0:1784189333.553349:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf46903b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1870854458257920:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1784189333.553366:0:8432:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8618304 pending 0 free 3922481152 avail 3690958848 00000100:00100000:0.0:1784189333.553405:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf46903b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1870854458257920:12345-0@lo:13:osp-pre-0-0.0 Request processed in 57us (226us total) trans 0 rc 0/0 00000100:00100000:0.0:1784189333.553411:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2073 00000100:00100000:3.0:1784189333.553547:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc05ed9a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1870854458257920:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1784189333.805160:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1784189333.805193:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1784189333.805216:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1784189333.805233:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1784189333.805266:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1784189333.805293:0:68287:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436332672 00000100:00100000:1.0:1784189333.805301:0:68287:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436332672 00000100:00100000:1.0:1784189333.805373:0:68287:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436332544 00000100:00100000:1.0:1784189333.805377:0:68287:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436332544 00000100:00100000:1.0:1784189333.805401:0:68287:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1343 00000100:00100000:1.0:1784189333.805409:0:68287:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc05ed9aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:debedd94-805c-42a0-a5e5-41758b2012e9+11:2397:x1870854436332672:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:1.0:1784189333.805492:0:68287:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc05ed9aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:debedd94-805c-42a0-a5e5-41758b2012e9+11:2397:x1870854436332672:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 83us (297us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189333.805500:0:68287:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1343 00000100:00100000:1.0:1784189333.805516:0:68287:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1344 00000100:00100000:1.0:1784189333.805528:0:68287:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc05ed9b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:debedd94-805c-42a0-a5e5-41758b2012e9+10:2397:x1870854436332544:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:1.0:1784189333.805555:0:68287:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc05ed9b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:debedd94-805c-42a0-a5e5-41758b2012e9+10:2397:x1870854436332544:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 28us (321us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189333.805560:0:68287:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1344 00000100:00100000:1.0:1784189333.805581:0:26170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436332928 00000100:00100000:1.0:1784189333.805585:0:26170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436332928 00000100:00100000:1.0:1784189333.805610:0:26170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436332800 00000100:00100000:1.0:1784189333.805613:0:26170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436332800 00000100:00100000:1.0:1784189333.805634:0:26170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 2587 00000100:00100000:1.0:1784189333.805640:0:26170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc05ed9a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:debedd94-805c-42a0-a5e5-41758b2012e9+7:2397:x1870854436332928:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:1.0:1784189333.805665:0:26170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc05ed9a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:debedd94-805c-42a0-a5e5-41758b2012e9+7:2397:x1870854436332928:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 24us (447us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189333.805671:0:26170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 2587 00000100:00100000:1.0:1784189333.805682:0:26170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 2588 00000100:00100000:1.0:1784189333.805687:0:26170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf43c5d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:debedd94-805c-42a0-a5e5-41758b2012e9+5:2397:x1870854436332800:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:1.0:1784189333.805709:0:26170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf43c5d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:debedd94-805c-42a0-a5e5-41758b2012e9+5:2397:x1870854436332800:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 22us (443us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189333.805714:0:26170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 2588 00000100:00080000:1.0:1784189333.805733:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1784189333.805737:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1784189333.805739:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1784189333.805741:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1784189333.809465:0:94310:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436332416 00000100:00100000:2.0:1784189333.809479:0:94310:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436332416 00000100:00100000:2.0:1784189333.809542:0:94310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 173 00000100:00100000:2.0:1784189333.809552:0:94310:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf44d0f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:60f345e3-c70e-4f53-b5e7-c9671463c9a5+10:2397:x1870854436332416:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:2.0:1784189333.809636:0:94310:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf44d0f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:60f345e3-c70e-4f53-b5e7-c9671463c9a5+10:2397:x1870854436332416:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 84us (4482us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189333.809643:0:94310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 173 00010000:00010000:2.0:1784189334.262748:0:7454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1784189334.323092:0:95445:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == replay-single test 135: Server failure in lock replay phase ========================================================== 04:08:52 (1784189332) 00000100:00100000:1.0:1784189334.414500:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1784189334.414550:0:66945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436333184 00000100:00100000:3.0:1784189334.414560:0:66945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436333184 00000100:00100000:3.0:1784189334.414623:0:66945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1441 00000100:00100000:3.0:1784189334.414632:0:66945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf43c5ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:debedd94-805c-42a0-a5e5-41758b2012e9+10:73506:x1870854436333184:12345-192.168.203.12@tcp:36:mkdir.0 00010000:00010000:3.0:1784189334.414686:0:66945:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784189334.414710:0:66945:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04a20bc00/0xcc1762b626f8c986 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c40b7 expref: 10 pid: 66171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189334.414728:0:66945:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9dbf47406300) 00010000:00010000:3.0:1784189334.414732:0:66945:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1784189334.414791:0:66945:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc058f66a00/0xcc1762b626f8cb77 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189334.414804:0:66945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc058f66a00/0xcc1762b626f8cb77 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189334.414814:0:66945:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc058f66a00/0xcc1762b626f8cb77 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189334.414829:0:66945:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc058f67200/0xcc1762b626f8cb7e lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189334.414836:0:66945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc058f67200/0xcc1762b626f8cb7e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189334.414850:0:66945:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc058f67200/0xcc1762b626f8cb7e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189334.415623:0:66945:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0565e6400/0xcc1762b626f8cb85 lrc: 3/0,1 mode: --/PW res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189334.415634:0:66945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0565e6400/0xcc1762b626f8cb85 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189334.415642:0:66945:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0565e6400/0xcc1762b626f8cb85 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1784189334.415656:0:66945:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000004f45bb31 reply state 00000000b0c051ea transno 120259084291 ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0565e6400/0xcc1762b626f8cb85 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189334.415677:0:66945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0565e6400/0xcc1762b626f8cb85 lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189334.415683:0:66945:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x0 (ffff9dbf45994c00) 00010000:00010000:2.0:1784189334.415686:0:66945:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1784189334.415688:0:66945:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1784189334.415692:0:66945:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000cf21:0x4:0x0]: returning size 4096 00010000:00010000:2.0:1784189334.415701:0:66945:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc058f66a00/0xcc1762b626f8cb77 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189334.415708:0:66945:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc058f66a00/0xcc1762b626f8cb77 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189334.415714:0:66945:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc058f66a00/0xcc1762b626f8cb77 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189334.415720:0:66945:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dc058f66a00/0xcc1762b626f8cb77 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189334.415726:0:66945:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc058f66a00 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:2.0:1784189334.415730:0:66945:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc058f66a00/0xcc1762b626f8cb77 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189334.415737:0:66945:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc058f66a00/0xcc1762b626f8cb77 lrc: 5/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189334.415744:0:66945:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9dbf47406300) 00010000:00010000:2.0:1784189334.415746:0:66945:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784189334.415749:0:66945:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dc058f66a00/0xcc1762b626f8cb77 lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189334.415763:0:66945:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc058f66a00/0xcc1762b626f8cb77 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1784189334.415775:0:66945:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000004f45bb31 reply state 00000000b0c051ea transno 120259084291 ns: mdt-lustre-MDT0000_UUID lock: ffff9dc058f67200/0xcc1762b626f8cb7e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189334.415783:0:66945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc058f67200/0xcc1762b626f8cb7e lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189334.415789:0:66945:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x1134d0c6 (ffff9dbf44851e00) 00010000:00010000:2.0:1784189334.415791:0:66945:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1784189334.415793:0:66945:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:2.0:1784189334.415898:0:66945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf43c5ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:debedd94-805c-42a0-a5e5-41758b2012e9+11:73506:x1870854436333184:12345-192.168.203.12@tcp:36:mkdir.0 Request processed in 1264us (1404us total) trans 120259084291 rc 0/0 00000100:00100000:2.0:1784189334.415905:0:66945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1441 00000100:00100000:1.0:1784189334.432364:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1784189334.432454:0:66170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436333312 00000100:00100000:2.0:1784189334.432463:0:66170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436333312 00000100:00100000:2.0:1784189334.432526:0:66170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1442 00000100:00100000:2.0:1784189334.432537:0:66170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf43c5df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:debedd94-805c-42a0-a5e5-41758b2012e9+11:73508:x1870854436333312:12345-192.168.203.12@tcp:101:lfs.0 00010000:00010000:2.0:1784189334.432561:0:66170:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784189334.432581:0:66170:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0565e7000/0xcc1762b626f8cb8c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbfc5de7fe6c4119 expref: -99 pid: 66170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189334.432640:0:66170:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0565e6c00/0xcc1762b626f8cb93 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189334.432654:0:66170:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0565e6c00/0xcc1762b626f8cb93 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189334.432678:0:66170:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0565e6c00/0xcc1762b626f8cb93 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784189334.432719:0:66170:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1784189334.432723:0:66170:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1784189334.432740:0:66170:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0565e6c00/0xcc1762b626f8cb93 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189334.432763:0:66170:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0565e7000/0xcc1762b626f8cb8c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c4119 expref: 13 pid: 66170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189334.432779:0:66170:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0565e6c00/0xcc1762b626f8cb93 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c4119 expref: 12 pid: 66170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189334.432786:0:66170:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9dbf47406300) 00010000:00010000:2.0:1784189334.432789:0:66170:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1784189334.432792:0:66170:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc0565e6c00, rc 0) 00000100:00100000:2.0:1784189334.432845:0:66170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf43c5df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:debedd94-805c-42a0-a5e5-41758b2012e9+12:73508:x1870854436333312:12345-192.168.203.12@tcp:101:lfs.0 Request processed in 308us (489us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189334.432852:0:66170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1442 00000100:00100000:1.0:1784189334.440705:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1784189334.440779:0:66171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436333568 00000100:00100000:3.0:1784189334.440788:0:66171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436333568 00000100:00100000:3.0:1784189334.440843:0:66171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1443 00000100:00100000:3.0:1784189334.440852:0:66171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf43c5ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:debedd94-805c-42a0-a5e5-41758b2012e9+12:73508:x1870854436333568:12345-192.168.203.12@tcp:101:lfs.0 00010000:00010000:3.0:1784189334.440871:0:66171:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784189334.440874:0:66171:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1784189334.440915:0:66171:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0565e6c00/0xcc1762b626f8cb93 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c4119 expref: 12 pid: 66170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189334.440931:0:66171:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9dbf47406300) 00010000:00010000:3.0:1784189334.440935:0:66171:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1784189334.440947:0:66171:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc058f66000/0xcc1762b626f8cb9a lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbfc5de7fe6c4120 expref: -99 pid: 66171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189334.441056:0:66171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc058f66800/0xcc1762b626f8cba1 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189334.441068:0:66171:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc058f66800/0xcc1762b626f8cba1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189334.441078:0:66171:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc058f66800/0xcc1762b626f8cba1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189334.441087:0:66171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc058f66200/0xcc1762b626f8cba8 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189334.441105:0:66171:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc058f66200/0xcc1762b626f8cba8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189334.441112:0:66171:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc058f66200/0xcc1762b626f8cba8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189334.441168:0:66171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc058f67600/0xcc1762b626f8cbaf lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189334.441176:0:66171:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc058f67600/0xcc1762b626f8cbaf lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189334.441182:0:66171:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc058f67600/0xcc1762b626f8cbaf lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784189334.441190:0:66171:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000cf21:0x4:0x0]: returning size 4096 00010000:00010000:3.0:1784189334.441201:0:66171:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc058f67600/0xcc1762b626f8cbaf lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189334.441207:0:66171:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc058f67600/0xcc1762b626f8cbaf lrc: 2/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189334.441213:0:66171:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dc058f67600/0xcc1762b626f8cbaf lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189334.441218:0:66171:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc058f67600 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:3.0:1784189334.441223:0:66171:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc058f67600/0xcc1762b626f8cbaf lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189334.441229:0:66171:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc058f67600/0xcc1762b626f8cbaf lrc: 4/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189334.441246:0:66171:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x0 (ffff9dbf45994c00) 00010000:00010000:3.0:1784189334.441249:0:66171:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784189334.441252:0:66171:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dc058f67600/0xcc1762b626f8cbaf lrc: 2/0,0 mode: --/PR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189334.441258:0:66171:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc058f67600/0xcc1762b626f8cbaf lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189334.441272:0:66171:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc058f66800/0xcc1762b626f8cba1 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189334.441279:0:66171:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc058f66800/0xcc1762b626f8cba1 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189334.441284:0:66171:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc058f66800/0xcc1762b626f8cba1 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189334.441289:0:66171:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dc058f66800/0xcc1762b626f8cba1 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189334.441293:0:66171:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc058f66800 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:3.0:1784189334.441305:0:66171:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc058f66800/0xcc1762b626f8cba1 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189334.441311:0:66171:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc058f66800/0xcc1762b626f8cba1 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189334.441352:0:66171:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9dbf47406300) 00010000:00010000:3.0:1784189334.441355:0:66171:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784189334.441358:0:66171:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dc058f66800/0xcc1762b626f8cba1 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189334.441373:0:66171:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc058f66800/0xcc1762b626f8cba1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189334.441383:0:66171:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc058f66200/0xcc1762b626f8cba8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189334.441388:0:66171:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc058f66200/0xcc1762b626f8cba8 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189334.441394:0:66171:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dc058f66200/0xcc1762b626f8cba8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189334.441399:0:66171:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc058f66200 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:3.0:1784189334.441403:0:66171:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc058f66200/0xcc1762b626f8cba8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189334.441408:0:66171:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc058f66200/0xcc1762b626f8cba8 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189334.441416:0:66171:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x1134d0c6 (ffff9dbf44851e00) 00010000:00010000:3.0:1784189334.441418:0:66171:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784189334.441420:0:66171:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dc058f66200/0xcc1762b626f8cba8 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189334.441426:0:66171:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc058f66200/0xcc1762b626f8cba8 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189334.441448:0:66171:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc058f66000/0xcc1762b626f8cb9a lrc: 1/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c4120 expref: 12 pid: 66171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189334.441467:0:66171:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9dbf47406300) 00010000:00010000:3.0:1784189334.441469:0:66171:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784189334.441473:0:66171:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc058f66000/0xcc1762b626f8cb9a lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c4120 expref: 12 pid: 66171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189334.441481:0:66171:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc058f66000, rc 0) 00000100:00100000:3.0:1784189334.441530:0:66171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf43c5ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:debedd94-805c-42a0-a5e5-41758b2012e9+11:73508:x1870854436333568:12345-192.168.203.12@tcp:101:lfs.0 Request processed in 679us (833us total) trans 0 rc 301/301 00000100:00100000:3.0:1784189334.441537:0:66171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1443 00000100:00100000:3.0:1784189334.444790:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1784189334.444866:0:66945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436333696 00000100:00100000:0.0:1784189334.444875:0:66945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436333696 00000100:00100000:0.0:1784189334.444945:0:66945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1444 00000100:00100000:0.0:1784189334.444955:0:66945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf46903480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:debedd94-805c-42a0-a5e5-41758b2012e9+11:73508:x1870854436333696:12345-192.168.203.12@tcp:101:lfs.0 00010000:00010000:0.0:1784189334.444975:0:66945:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784189334.444993:0:66945:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc081b17a00/0xcc1762b626f8cbb6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbfc5de7fe6c4127 expref: -99 pid: 66945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189334.445051:0:66945:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc081b17800/0xcc1762b626f8cbbd lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189334.445075:0:66945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc081b17800/0xcc1762b626f8cbbd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189334.445087:0:66945:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc081b17800/0xcc1762b626f8cbbd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784189334.445133:0:66945:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1784189334.445136:0:66945:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1784189334.445156:0:66945:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9dc081b17800/0xcc1762b626f8cbbd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189334.445177:0:66945:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc081b17a00/0xcc1762b626f8cbb6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c4127 expref: 13 pid: 66945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189334.445192:0:66945:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc081b17800/0xcc1762b626f8cbbd lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c4127 expref: 12 pid: 66945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189334.445200:0:66945:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9dbf47406300) 00010000:00010000:0.0:1784189334.445203:0:66945:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1784189334.445206:0:66945:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc081b17800, rc 0) 00000100:00100000:0.0:1784189334.445265:0:66945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf46903480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:debedd94-805c-42a0-a5e5-41758b2012e9+12:73508:x1870854436333696:12345-192.168.203.12@tcp:101:lfs.0 Request processed in 310us (482us total) trans 0 rc 0/0 00000100:00100000:0.0:1784189334.445272:0:66945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1444 00000100:00100000:1.0:1784189334.466766:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1784189334.467397:0:66169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436333952 00000100:00100000:0.0:1784189334.467406:0:66169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436333952 00000100:00100000:0.0:1784189334.467455:0:66169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1445 00000100:00100000:0.0:1784189334.467464:0:66169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf43c5c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:debedd94-805c-42a0-a5e5-41758b2012e9+12:73508:x1870854436333952:12345-192.168.203.12@tcp:101:lfs.0 00010000:00010000:0.0:1784189334.467483:0:66169:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784189334.467507:0:66169:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc081b17000/0xcc1762b626f8cbc4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbfc5de7fe6c412e expref: -99 pid: 66169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189334.467574:0:66169:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc081b17400/0xcc1762b626f8cbcb lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189334.467589:0:66169:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc081b17400/0xcc1762b626f8cbcb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189334.467600:0:66169:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc081b17400/0xcc1762b626f8cbcb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189334.467613:0:66169:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc081b16e00/0xcc1762b626f8cbd2 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189334.467621:0:66169:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc081b16e00/0xcc1762b626f8cbd2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189334.467628:0:66169:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc081b16e00/0xcc1762b626f8cbd2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784189334.467725:0:66169:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000cf21:0x4:0x0]: returning size 4096 00010000:00010000:0.0:1784189334.467789:0:66169:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc081b17400/0xcc1762b626f8cbcb lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189334.467797:0:66169:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc081b17400/0xcc1762b626f8cbcb lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189334.467803:0:66169:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc081b17400/0xcc1762b626f8cbcb lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189334.467810:0:66169:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dc081b17400/0xcc1762b626f8cbcb lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189334.467825:0:66169:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc081b17400 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:0.0:1784189334.467829:0:66169:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc081b17400/0xcc1762b626f8cbcb lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189334.467836:0:66169:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc081b17400/0xcc1762b626f8cbcb lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189334.467846:0:66169:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9dbf47406300) 00010000:00010000:0.0:1784189334.467849:0:66169:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784189334.467854:0:66169:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dc081b17400/0xcc1762b626f8cbcb lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189334.467860:0:66169:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc081b17400/0xcc1762b626f8cbcb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189334.467871:0:66169:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc081b16e00/0xcc1762b626f8cbd2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189334.467876:0:66169:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc081b16e00/0xcc1762b626f8cbd2 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189334.467894:0:66169:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dc081b16e00/0xcc1762b626f8cbd2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189334.467900:0:66169:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc081b16e00 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:0.0:1784189334.467903:0:66169:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc081b16e00/0xcc1762b626f8cbd2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189334.467909:0:66169:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc081b16e00/0xcc1762b626f8cbd2 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189334.467926:0:66169:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x1134d0c6 (ffff9dbf44851e00) 00010000:00010000:0.0:1784189334.467928:0:66169:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784189334.467931:0:66169:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dc081b16e00/0xcc1762b626f8cbd2 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189334.467937:0:66169:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc081b16e00/0xcc1762b626f8cbd2 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189334.467967:0:66169:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc081b17000/0xcc1762b626f8cbc4 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c412e expref: 14 pid: 66169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189334.467976:0:66169:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9dbf47406300) 00010000:00010000:0.0:1784189334.467978:0:66169:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1784189334.467982:0:66169:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc081b17000/0xcc1762b626f8cbc4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c412e expref: 14 pid: 66169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189334.467990:0:66169:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc081b17000, rc 0) 00000100:00100000:0.0:1784189334.468046:0:66169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf43c5c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:debedd94-805c-42a0-a5e5-41758b2012e9+13:73508:x1870854436333952:12345-192.168.203.12@tcp:101:lfs.0 Request processed in 582us (1287us total) trans 120259084292 rc 301/301 00000100:00100000:0.0:1784189334.468053:0:66169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1445 00000100:00100000:1.0:1784189334.482367:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1784189334.482402:0:68287:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436334208 00000100:00100000:1.0:1784189334.482410:0:68287:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436334208 00000100:00100000:1.0:1784189334.482459:0:68287:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1446 00000100:00100000:1.0:1784189334.482469:0:68287:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf43c5e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:debedd94-805c-42a0-a5e5-41758b2012e9+13:73508:x1870854436334208:12345-192.168.203.12@tcp:36:lfs.0 00010000:00010000:1.0:1784189334.482545:0:68287:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc042d67200/0xcc1762b626f8cbe0 lrc: 3/0,1 mode: --/PW res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189334.482562:0:68287:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc042d67200/0xcc1762b626f8cbe0 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x4:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189334.482574:0:68287:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc042d67200/0xcc1762b626f8cbe0 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x4:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1784189334.482712:0:68287:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000a1a0c3ee reply state 0000000051044348 transno 120259084293 ns: mdt-lustre-MDT0000_UUID lock: ffff9dc042d67200/0xcc1762b626f8cbe0 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x4:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189334.482726:0:68287:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc042d67200/0xcc1762b626f8cbe0 lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189334.482733:0:68287:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x0 (ffff9dbf45994c00) 00010000:00010000:1.0:1784189334.482736:0:68287:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00000100:00100000:1.0:1784189334.482739:0:68287:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1784189334.482746:0:68287:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000cf21:0x4:0x0]: returning size 4096 00000100:00100000:1.0:1784189334.482808:0:68287:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf43c5e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:debedd94-805c-42a0-a5e5-41758b2012e9+15:73508:x1870854436334208:12345-192.168.203.12@tcp:36:lfs.0 Request processed in 340us (448us total) trans 120259084293 rc 0/0 00000100:00100000:1.0:1784189334.482815:0:68287:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1446 00000100:00100000:2.0:1784189334.496626:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1784189334.508474:0:66173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436334464 00000100:00100000:0.0:1784189334.508488:0:66173:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436334464 00000100:00100000:0.0:1784189334.508552:0:66173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 244 00000100:00100000:0.0:1784189334.508562:0:66173:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf4a341500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:debedd94-805c-42a0-a5e5-41758b2012e9+15:73508:x1870854436334464:12345-192.168.203.12@tcp:35:lfs.0 00000100:00100000:0.0:1784189334.508787:0:66173:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf4a341500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:debedd94-805c-42a0-a5e5-41758b2012e9+16:73508:x1870854436334464:12345-192.168.203.12@tcp:35:lfs.0 Request processed in 225us (12477us total) trans 120259084294 rc 0/0 00000100:00100000:0.0:1784189334.508795:0:66173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 244 00000100:00100000:1.0:1784189334.526156:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1784189334.526230:0:66170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436334592 00000100:00100000:2.0:1784189334.526239:0:66170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436334592 00000100:00100000:2.0:1784189334.526307:0:66170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1447 00000100:00100000:2.0:1784189334.526366:0:66170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf43c5dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:debedd94-805c-42a0-a5e5-41758b2012e9+16:73517:x1870854436334592:12345-192.168.203.12@tcp:101:touch.0 00010000:00010000:2.0:1784189334.526389:0:66170:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784189334.526410:0:66170:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0565e7000/0xcc1762b626f8cbe7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbfc5de7fe6c4135 expref: -99 pid: 66170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189334.526488:0:66170:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0565e6c00/0xcc1762b626f8cbee lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189334.526513:0:66170:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0565e6c00/0xcc1762b626f8cbee lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189334.526526:0:66170:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0565e6c00/0xcc1762b626f8cbee lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189334.526538:0:66170:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0565e6000/0xcc1762b626f8cbf5 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189334.526547:0:66170:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0565e6000/0xcc1762b626f8cbf5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189334.526554:0:66170:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0565e6000/0xcc1762b626f8cbf5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189334.526635:0:66170:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0565e6e00/0xcc1762b626f8cbfc lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189334.526645:0:66170:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0565e6e00/0xcc1762b626f8cbfc lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189334.526652:0:66170:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0565e6e00/0xcc1762b626f8cbfc lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784189334.526683:0:66170:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000cf21:0x4:0x0]: returning size 4096 00000004:00200000:2.0:1784189334.526687:0:66170:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1784189334.526716:0:66170:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0565e6e00/0xcc1762b626f8cbfc lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189334.526739:0:66170:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0565e6c00/0xcc1762b626f8cbee lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189334.526746:0:66170:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0565e6c00/0xcc1762b626f8cbee lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189334.526752:0:66170:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0565e6c00/0xcc1762b626f8cbee lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189334.526759:0:66170:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0565e6c00/0xcc1762b626f8cbee lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189334.526766:0:66170:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc0565e6c00 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:2.0:1784189334.526770:0:66170:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0565e6c00/0xcc1762b626f8cbee lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189334.526778:0:66170:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0565e6c00/0xcc1762b626f8cbee lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189334.526790:0:66170:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9dbf47406300) 00010000:00010000:2.0:1784189334.526793:0:66170:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784189334.526797:0:66170:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0565e6c00/0xcc1762b626f8cbee lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189334.526804:0:66170:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0565e6c00/0xcc1762b626f8cbee lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189334.526815:0:66170:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0565e6000/0xcc1762b626f8cbf5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189334.526820:0:66170:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0565e6000/0xcc1762b626f8cbf5 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189334.526831:0:66170:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0565e6000/0xcc1762b626f8cbf5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189334.526836:0:66170:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc0565e6000 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:2.0:1784189334.526839:0:66170:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0565e6000/0xcc1762b626f8cbf5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189334.526845:0:66170:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0565e6000/0xcc1762b626f8cbf5 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189334.526852:0:66170:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x1134d0c6 (ffff9dbf44851e00) 00010000:00010000:2.0:1784189334.526854:0:66170:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784189334.526857:0:66170:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0565e6000/0xcc1762b626f8cbf5 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189334.526862:0:66170:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0565e6000/0xcc1762b626f8cbf5 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189334.526896:0:66170:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0565e7000/0xcc1762b626f8cbe7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c4135 expref: 18 pid: 66170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189334.526910:0:66170:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0565e6e00/0xcc1762b626f8cbfc lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c4135 expref: 17 pid: 66170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189334.526917:0:66170:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x0 (ffff9dbf45994c00) 00010000:00010000:2.0:1784189334.526919:0:66170:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1784189334.526921:0:66170:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc0565e6e00, rc 0) 00000100:00100000:2.0:1784189334.526981:0:66170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf43c5dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:debedd94-805c-42a0-a5e5-41758b2012e9+17:73517:x1870854436334592:12345-192.168.203.12@tcp:101:touch.0 Request processed in 665us (834us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189334.526997:0:66170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1447 00000100:00100000:3.0:1784189334.554511:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1784189334.555156:0:66171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436334848 00000100:00100000:0.0:1784189334.555171:0:66171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436334848 00000100:00100000:0.0:1784189334.555253:0:66171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1448 00000100:00100000:0.0:1784189334.555265:0:66171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf46900e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:debedd94-805c-42a0-a5e5-41758b2012e9+17:73517:x1870854436334848:12345-192.168.203.12@tcp:101:touch.0 00010000:00010000:0.0:1784189334.555295:0:66171:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784189334.555373:0:66171:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc081b17000/0xcc1762b626f8cc03 lrc: 2/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbfc5de7fe6c413c expref: -99 pid: 66171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189334.555533:0:66171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc081b16e00/0xcc1762b626f8cc0a lrc: 3/0,1 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189334.555552:0:66171:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc081b16e00/0xcc1762b626f8cc0a lrc: 3/0,1 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189334.555567:0:66171:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc081b16e00/0xcc1762b626f8cc0a lrc: 3/0,1 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189334.555585:0:66171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc081b17400/0xcc1762b626f8cc11 lrc: 3/0,1 mode: --/PW res: [0x20000cf21:0x4:0x0].0x9beb5ca3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189334.555593:0:66171:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc081b17400/0xcc1762b626f8cc11 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x4:0x0].0x9beb5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189334.555600:0:66171:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc081b17400/0xcc1762b626f8cc11 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x4:0x0].0x9beb5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1784189334.558466:0:66171:0:(osp_internal.h:570:osp_update_last_fid()) Gap in objids: start=[0x280000401:0x703:0x0], count =95 00000004:00080000:0.0:1784189334.558490:0:66171:0:(osp_object.c:1645:osp_create()) Writing gap [0x280000401:0x703:0x0]+95 in llog 00000004:00080000:0.0:1784189334.558551:0:66171:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x762:0x0], index 0: 0 00010000:00010000:0.0:1784189334.558841:0:66171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc081b17a00/0xcc1762b626f8cc18 lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189334.558895:0:66171:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc081b17a00/0xcc1762b626f8cc18 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189334.558910:0:66171:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc081b17a00/0xcc1762b626f8cc18 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189334.558962:0:66171:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc081b16e00/0xcc1762b626f8cc0a lrc: 4/0,1 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189334.558969:0:66171:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc081b16e00/0xcc1762b626f8cc0a lrc: 4/0,1 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189334.558976:0:66171:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc081b16e00/0xcc1762b626f8cc0a lrc: 3/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189334.558982:0:66171:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dc081b16e00/0xcc1762b626f8cc0a lrc: 4/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189334.558989:0:66171:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc081b16e00 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:0.0:1784189334.559988:0:66171:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc081b16e00/0xcc1762b626f8cc0a lrc: 4/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189334.560076:0:66171:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc081b16e00/0xcc1762b626f8cc0a lrc: 5/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189334.560096:0:66171:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x0 (ffff9dbf45994c00) 00010000:00010000:0.0:1784189334.560100:0:66171:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784189334.560107:0:66171:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dc081b16e00/0xcc1762b626f8cc0a lrc: 3/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189334.560116:0:66171:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc081b16e00/0xcc1762b626f8cc0a lrc: 0/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1784189334.560157:0:66171:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000022cefc2e reply state 00000000512d84e0 transno 120259084295 ns: mdt-lustre-MDT0000_UUID lock: ffff9dc081b17400/0xcc1762b626f8cc11 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x4:0x0].0x9beb5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189334.560171:0:66171:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc081b17400/0xcc1762b626f8cc11 lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x9beb5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189334.560180:0:66171:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x9beb5ca3 (ffff9dc07fab4d00) 00010000:00010000:0.0:1784189334.560182:0:66171:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1784189334.560186:0:66171:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1784189334.560251:0:66171:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc081b17000/0xcc1762b626f8cc03 lrc: 0/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c413c expref: 20 pid: 66171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189334.560271:0:66171:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc081b17a00/0xcc1762b626f8cc18 lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c413c expref: 19 pid: 66171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189334.560279:0:66171:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x6:0x0].0x0 (ffff9dc07fab4100) 00010000:00010000:0.0:1784189334.560282:0:66171:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1784189334.560284:0:66171:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc081b17a00, rc 0) 00000100:00100000:0.0:1784189334.560440:0:66171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf46900e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:debedd94-805c-42a0-a5e5-41758b2012e9+20:73517:x1870854436334848:12345-192.168.203.12@tcp:101:touch.0 Request processed in 5175us (5942us total) trans 120259084295 rc 0/0 00000100:00100000:0.0:1784189334.560451:0:66171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1448 00000100:00100000:3.0:1784189334.576970:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1784189334.577199:0:66945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436335104 00000100:00100000:1.0:1784189334.577214:0:66945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436335104 00000100:00100000:1.0:1784189334.577383:0:66945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1449 00000100:00100000:1.0:1784189334.577396:0:66945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf46902680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:debedd94-805c-42a0-a5e5-41758b2012e9+20:73517:x1870854436335104:12345-192.168.203.12@tcp:36:touch.0 00010000:00010000:1.0:1784189334.577457:0:66945:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784189334.577487:0:66945:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc081b17a00/0xcc1762b626f8cc18 lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c413c expref: 20 pid: 66171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189334.577505:0:66945:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x6:0x0].0x0 (ffff9dc07fab4100) 00010000:00010000:1.0:1784189334.577516:0:66945:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1784189334.577570:0:66945:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc042d66a00/0xcc1762b626f8cc26 lrc: 3/0,1 mode: --/PW res: [0x20000cf21:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189334.577583:0:66945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc042d66a00/0xcc1762b626f8cc26 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189334.577594:0:66945:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc042d66a00/0xcc1762b626f8cc26 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1784189334.577690:0:66945:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000000804bbc2 reply state 00000000946a6205 transno 120259084296 ns: mdt-lustre-MDT0000_UUID lock: ffff9dc042d66a00/0xcc1762b626f8cc26 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189334.577702:0:66945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc042d66a00/0xcc1762b626f8cc26 lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189334.577708:0:66945:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x6:0x0].0x0 (ffff9dc05a487700) 00010000:00010000:1.0:1784189334.577711:0:66945:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1784189334.577713:0:66945:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1784189334.577805:0:66945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf46902680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:debedd94-805c-42a0-a5e5-41758b2012e9+21:73517:x1870854436335104:12345-192.168.203.12@tcp:36:touch.0 Request processed in 412us (849us total) trans 120259084296 rc 0/0 00000100:00100000:1.0:1784189334.577812:0:66945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1449 00000100:00100000:1.0:1784189334.580365:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1784189334.580561:0:66169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436335232 00000100:00100000:0.0:1784189334.580580:0:66169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436335232 00000100:00100000:0.0:1784189334.580664:0:66169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1450 00000100:00100000:0.0:1784189334.580678:0:66169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf43c5fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:debedd94-805c-42a0-a5e5-41758b2012e9+21:73517:x1870854436335232:12345-192.168.203.12@tcp:101:touch.0 00010000:00010000:0.0:1784189334.580709:0:66169:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784189334.580737:0:66169:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc081b17000/0xcc1762b626f8cc2d lrc: 2/0,0 mode: --/CR res: [0x20000cf21:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbfc5de7fe6c4143 expref: -99 pid: 66169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189334.580828:0:66169:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc081b17000/0xcc1762b626f8cc2d lrc: 3/0,0 mode: CR/CR res: [0x20000cf21:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c4143 expref: 22 pid: 66169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189334.580847:0:66169:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc081b17000/0xcc1762b626f8cc2d lrc: 3/0,0 mode: CR/CR res: [0x20000cf21:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c4143 expref: 22 pid: 66169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189334.580871:0:66169:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x6:0x0].0x0 (ffff9dc05a487700) 00010000:00010000:0.0:1784189334.580875:0:66169:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1784189334.580891:0:66169:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc081b17000, rc 0) 00000100:00100000:0.0:1784189334.580982:0:66169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf43c5fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:debedd94-805c-42a0-a5e5-41758b2012e9+22:73517:x1870854436335232:12345-192.168.203.12@tcp:101:touch.0 Request processed in 307us (666us total) trans 0 rc 0/0 00000100:00100000:0.0:1784189334.580990:0:66169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1450 00000100:00100000:3.0:1784189334.583687:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1784189334.583890:0:26166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436335360 00000100:00100000:0.0:1784189334.583902:0:26166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436335360 00000100:00100000:3.0:1784189334.584106:0:26160:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 5000 00000100:00100000:3.0:1784189334.584121:0:26160:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf46902300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:debedd94-805c-42a0-a5e5-41758b2012e9+5:2397:x1870854436335360:12345-192.168.203.12@tcp:2:touch.0 00000100:00100000:3.0:1784189334.584479:0:26160:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf46902300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:debedd94-805c-42a0-a5e5-41758b2012e9+6:2397:x1870854436335360:12345-192.168.203.12@tcp:2:touch.0 Request processed in 362us (803us total) trans 4294968957 rc 0/0 00000100:00100000:3.0:1784189334.584488:0:26160:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 5000 00000100:00100000:3.0:1784189334.587281:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1784189334.587580:0:66173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436335616 00000100:00100000:0.0:1784189334.587593:0:66173:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436335616 00000100:00100000:0.0:1784189334.587672:0:66173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 245 00000100:00100000:0.0:1784189334.587686:0:66173:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf44d09c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:debedd94-805c-42a0-a5e5-41758b2012e9+22:73517:x1870854436335616:12345-192.168.203.12@tcp:35:touch.0 00000100:00100000:0.0:1784189334.588091:0:66173:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf44d09c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:debedd94-805c-42a0-a5e5-41758b2012e9+23:73517:x1870854436335616:12345-192.168.203.12@tcp:35:touch.0 Request processed in 407us (823us total) trans 120259084297 rc 0/0 00000100:00100000:0.0:1784189334.588099:0:66173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 245 00000100:00100000:1.0:1784189334.592548:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1784189334.592892:0:66171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436335872 00000100:00100000:0.0:1784189334.592903:0:66171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436335872 00000100:00100000:0.0:1784189334.592966:0:66171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1451 00000100:00100000:0.0:1784189334.592975:0:66171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf43c5c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:debedd94-805c-42a0-a5e5-41758b2012e9+23:73517:x1870854436335872:12345-192.168.203.12@tcp:101:touch.0 00010000:00010000:0.0:1784189334.593014:0:66171:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784189334.593037:0:66171:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc081b16e00/0xcc1762b626f8cc34 lrc: 2/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbfc5de7fe6c414a expref: -99 pid: 66171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189334.593147:0:66171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc081b16000/0xcc1762b626f8cc3b lrc: 3/0,1 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189334.593163:0:66171:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc081b16000/0xcc1762b626f8cc3b lrc: 3/0,1 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189334.593175:0:66171:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc081b16000/0xcc1762b626f8cc3b lrc: 3/0,1 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189334.593189:0:66171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc081b16800/0xcc1762b626f8cc42 lrc: 3/0,1 mode: --/PW res: [0x20000cf21:0x4:0x0].0xe44515a3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189334.593196:0:66171:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc081b16800/0xcc1762b626f8cc42 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x4:0x0].0xe44515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189334.593203:0:66171:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc081b16800/0xcc1762b626f8cc42 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x4:0x0].0xe44515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1784189334.594126:0:66171:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x763:0x0], index 0: 0 00010000:00010000:0.0:1784189334.594261:0:66171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc081b17a00/0xcc1762b626f8cc49 lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189334.594273:0:66171:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc081b17a00/0xcc1762b626f8cc49 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189334.594289:0:66171:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc081b17a00/0xcc1762b626f8cc49 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189334.594358:0:66171:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc081b16000/0xcc1762b626f8cc3b lrc: 4/0,1 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189334.594367:0:66171:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc081b16000/0xcc1762b626f8cc3b lrc: 4/0,1 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189334.594374:0:66171:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc081b16000/0xcc1762b626f8cc3b lrc: 3/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189334.594381:0:66171:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dc081b16000/0xcc1762b626f8cc3b lrc: 4/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189334.594387:0:66171:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc081b16000 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:0.0:1784189334.594392:0:66171:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc081b16000/0xcc1762b626f8cc3b lrc: 4/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189334.594399:0:66171:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc081b16000/0xcc1762b626f8cc3b lrc: 5/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189334.594412:0:66171:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x0 (ffff9dbf45994c00) 00010000:00010000:0.0:1784189334.594415:0:66171:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784189334.594419:0:66171:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dc081b16000/0xcc1762b626f8cc3b lrc: 3/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189334.594426:0:66171:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc081b16000/0xcc1762b626f8cc3b lrc: 0/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1784189334.594439:0:66171:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000d0b609d8 reply state 00000000e1bd75ea transno 120259084298 ns: mdt-lustre-MDT0000_UUID lock: ffff9dc081b16800/0xcc1762b626f8cc42 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x4:0x0].0xe44515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189334.594450:0:66171:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc081b16800/0xcc1762b626f8cc42 lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0xe44515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189334.594463:0:66171:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0xe44515a3 (ffff9dc07fab4700) 00010000:00010000:0.0:1784189334.594465:0:66171:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1784189334.594468:0:66171:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1784189334.594499:0:66171:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc081b16e00/0xcc1762b626f8cc34 lrc: 0/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c414a expref: 26 pid: 66171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189334.594514:0:66171:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc081b17a00/0xcc1762b626f8cc49 lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c414a expref: 25 pid: 66171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189334.594522:0:66171:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x7:0x0].0x0 (ffff9dc07fab4f00) 00010000:00010000:0.0:1784189334.594524:0:66171:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1784189334.594526:0:66171:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc081b17a00, rc 0) 00000100:00100000:0.0:1784189334.599026:0:66171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf43c5c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:debedd94-805c-42a0-a5e5-41758b2012e9+26:73517:x1870854436335872:12345-192.168.203.12@tcp:101:touch.0 Request processed in 6039us (6475us total) trans 120259084298 rc 0/0 00000100:00100000:0.0:1784189334.599039:0:66171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1451 00000100:00100000:3.0:1784189334.612817:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1784189334.613131:0:66170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436336128 00000100:00100000:2.0:1784189334.613141:0:66170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436336128 00000100:00100000:2.0:1784189334.613260:0:66170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1452 00000100:00100000:2.0:1784189334.613271:0:66170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf46901500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:debedd94-805c-42a0-a5e5-41758b2012e9+26:73517:x1870854436336128:12345-192.168.203.12@tcp:36:touch.0 00010000:00010000:2.0:1784189334.613369:0:66170:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784189334.613396:0:66170:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc081b17a00/0xcc1762b626f8cc49 lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c414a expref: 26 pid: 66171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189334.613415:0:66170:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x7:0x0].0x0 (ffff9dc07fab4f00) 00010000:00010000:2.0:1784189334.613426:0:66170:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1784189334.613475:0:66170:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0565e7000/0xcc1762b626f8cc57 lrc: 3/0,1 mode: --/PW res: [0x20000cf21:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189334.613488:0:66170:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0565e7000/0xcc1762b626f8cc57 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189334.613497:0:66170:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0565e7000/0xcc1762b626f8cc57 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1784189334.613596:0:66170:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000043a9855 reply state 0000000089a6ead9 transno 120259084299 ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0565e7000/0xcc1762b626f8cc57 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189334.613609:0:66170:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0565e7000/0xcc1762b626f8cc57 lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189334.613615:0:66170:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x7:0x0].0x0 (ffff9dbf45994300) 00010000:00010000:2.0:1784189334.613618:0:66170:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1784189334.613620:0:66170:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1784189334.613711:0:66170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf46901500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:debedd94-805c-42a0-a5e5-41758b2012e9+27:73517:x1870854436336128:12345-192.168.203.12@tcp:36:touch.0 Request processed in 442us (903us total) trans 120259084299 rc 0/0 00000100:00100000:2.0:1784189334.613718:0:66170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1452 00000100:00100000:3.0:1784189334.621951:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1784189334.622082:0:66169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436336256 00000100:00100000:0.0:1784189334.622091:0:66169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436336256 00000100:00100000:0.0:1784189334.622153:0:66169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1453 00000100:00100000:0.0:1784189334.622162:0:66169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc04a64e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:debedd94-805c-42a0-a5e5-41758b2012e9+27:73517:x1870854436336256:12345-192.168.203.12@tcp:101:touch.0 00010000:00010000:0.0:1784189334.622184:0:66169:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784189334.622205:0:66169:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc081b16000/0xcc1762b626f8cc5e lrc: 2/0,0 mode: --/CR res: [0x20000cf21:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbfc5de7fe6c4151 expref: -99 pid: 66169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189334.622259:0:66169:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc081b16000/0xcc1762b626f8cc5e lrc: 3/0,0 mode: CR/CR res: [0x20000cf21:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c4151 expref: 28 pid: 66169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189334.622275:0:66169:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc081b16000/0xcc1762b626f8cc5e lrc: 3/0,0 mode: CR/CR res: [0x20000cf21:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c4151 expref: 28 pid: 66169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189334.622309:0:66169:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x7:0x0].0x0 (ffff9dbf45994300) 00010000:00010000:0.0:1784189334.622313:0:66169:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1784189334.622350:0:66169:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc081b16000, rc 0) 00000100:00100000:0.0:1784189334.622405:0:66169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc04a64e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:debedd94-805c-42a0-a5e5-41758b2012e9+28:73517:x1870854436336256:12345-192.168.203.12@tcp:101:touch.0 Request processed in 238us (457us total) trans 0 rc 0/0 00000100:00100000:0.0:1784189334.622413:0:66169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1453 00000100:00100000:0.0:1784189334.624759:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1784189334.624840:0:26168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436336384 00000100:00100000:1.0:1784189334.624849:0:26168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436336384 00000100:00100000:1.0:1784189334.624906:0:26168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 5001 00000100:00100000:1.0:1784189334.624916:0:26168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf4859ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:debedd94-805c-42a0-a5e5-41758b2012e9+6:2397:x1870854436336384:12345-192.168.203.12@tcp:2:touch.0 00000100:00100000:1.0:1784189334.625128:0:26168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf4859ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:debedd94-805c-42a0-a5e5-41758b2012e9+7:2397:x1870854436336384:12345-192.168.203.12@tcp:2:touch.0 Request processed in 212us (375us total) trans 4294968958 rc 0/0 00000100:00100000:1.0:1784189334.625137:0:26168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 5001 00000100:00100000:3.0:1784189334.629294:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1784189334.633516:0:66173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436336640 00000100:00100000:0.0:1784189334.633532:0:66173:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436336640 00000100:00100000:0.0:1784189334.633601:0:66173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 246 00000100:00100000:0.0:1784189334.633611:0:66173:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc04a64f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:debedd94-805c-42a0-a5e5-41758b2012e9+28:73517:x1870854436336640:12345-192.168.203.12@tcp:35:touch.0 00000100:00100000:0.0:1784189334.633902:0:66173:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc04a64f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:debedd94-805c-42a0-a5e5-41758b2012e9+29:73517:x1870854436336640:12345-192.168.203.12@tcp:35:touch.0 Request processed in 291us (4615us total) trans 120259084300 rc 0/0 00000100:00100000:0.0:1784189334.633911:0:66173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 246 00000100:00100000:2.0:1784189334.636600:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1784189334.636911:0:66171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436336896 00000100:00100000:0.0:1784189334.636921:0:66171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436336896 00000100:00100000:0.0:1784189334.636991:0:66171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1454 00000100:00100000:0.0:1784189334.637001:0:66171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf4a340e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:debedd94-805c-42a0-a5e5-41758b2012e9+29:73517:x1870854436336896:12345-192.168.203.12@tcp:101:touch.0 00010000:00010000:0.0:1784189334.637143:0:66171:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784189334.637164:0:66171:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc081b17e00/0xcc1762b626f8cc65 lrc: 2/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbfc5de7fe6c4158 expref: -99 pid: 66171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189334.637263:0:66171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc081b17a00/0xcc1762b626f8cc6c lrc: 3/0,1 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189334.637297:0:66171:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc081b17a00/0xcc1762b626f8cc6c lrc: 3/0,1 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189334.637308:0:66171:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc081b17a00/0xcc1762b626f8cc6c lrc: 3/0,1 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189334.637407:0:66171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc081b16e00/0xcc1762b626f8cc73 lrc: 3/0,1 mode: --/PW res: [0x20000cf21:0x4:0x0].0x2c9ecea3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189334.637416:0:66171:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc081b16e00/0xcc1762b626f8cc73 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x4:0x0].0x2c9ecea3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189334.637423:0:66171:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc081b16e00/0xcc1762b626f8cc73 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x4:0x0].0x2c9ecea3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1784189334.637689:0:66171:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x764:0x0], index 0: 0 00010000:00010000:0.0:1784189334.637810:0:66171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc05ec0e400/0xcc1762b626f8cc7a lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0x8:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189334.637820:0:66171:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc05ec0e400/0xcc1762b626f8cc7a lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x8:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189334.637828:0:66171:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc05ec0e400/0xcc1762b626f8cc7a lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x8:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189334.639124:0:66171:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc081b17a00/0xcc1762b626f8cc6c lrc: 4/0,1 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189334.639139:0:66171:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc081b17a00/0xcc1762b626f8cc6c lrc: 4/0,1 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189334.639147:0:66171:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc081b17a00/0xcc1762b626f8cc6c lrc: 3/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189334.639169:0:66171:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dc081b17a00/0xcc1762b626f8cc6c lrc: 4/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189334.639175:0:66171:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc081b17a00 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:0.0:1784189334.639180:0:66171:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc081b17a00/0xcc1762b626f8cc6c lrc: 4/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189334.639188:0:66171:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc081b17a00/0xcc1762b626f8cc6c lrc: 5/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189334.639202:0:66171:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x0 (ffff9dbf45994c00) 00010000:00010000:0.0:1784189334.639206:0:66171:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784189334.639210:0:66171:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dc081b17a00/0xcc1762b626f8cc6c lrc: 3/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189334.639218:0:66171:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc081b17a00/0xcc1762b626f8cc6c lrc: 0/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1784189334.639233:0:66171:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000027d5c0ee reply state 00000000b2b138f6 transno 120259084301 ns: mdt-lustre-MDT0000_UUID lock: ffff9dc081b16e00/0xcc1762b626f8cc73 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x4:0x0].0x2c9ecea3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189334.639245:0:66171:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc081b16e00/0xcc1762b626f8cc73 lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x2c9ecea3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189334.639252:0:66171:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x2c9ecea3 (ffff9dc07fab4200) 00010000:00010000:0.0:1784189334.639255:0:66171:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1784189334.639257:0:66171:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1784189334.639298:0:66171:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc081b17e00/0xcc1762b626f8cc65 lrc: 0/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c4158 expref: 32 pid: 66171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189334.639314:0:66171:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc05ec0e400/0xcc1762b626f8cc7a lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x8:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c4158 expref: 31 pid: 66171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189334.639438:0:66171:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x8:0x0].0x0 (ffff9dc07fab4b00) 00010000:00010000:0.0:1784189334.639441:0:66171:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1784189334.639444:0:66171:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc05ec0e400, rc 0) 00000100:00100000:0.0:1784189334.639524:0:66171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf4a340e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:debedd94-805c-42a0-a5e5-41758b2012e9+32:73517:x1870854436336896:12345-192.168.203.12@tcp:101:touch.0 Request processed in 2523us (2930us total) trans 120259084301 rc 0/0 00000100:00100000:0.0:1784189334.639533:0:66171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1454 00000100:00100000:1.0:1784189334.645407:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1784189334.645489:0:66170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436337152 00000100:00100000:2.0:1784189334.645499:0:66170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436337152 00000100:00100000:2.0:1784189334.645554:0:66170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1455 00000100:00100000:2.0:1784189334.645562:0:66170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf43c5ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:debedd94-805c-42a0-a5e5-41758b2012e9+32:73517:x1870854436337152:12345-192.168.203.12@tcp:36:touch.0 00010000:00010000:2.0:1784189334.645617:0:66170:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784189334.645645:0:66170:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc05ec0e400/0xcc1762b626f8cc7a lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0x8:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c4158 expref: 32 pid: 66171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189334.645661:0:66170:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x8:0x0].0x0 (ffff9dc07fab4b00) 00010000:00010000:2.0:1784189334.645672:0:66170:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1784189334.645721:0:66170:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0565e6c00/0xcc1762b626f8cc88 lrc: 3/0,1 mode: --/PW res: [0x20000cf21:0x8:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189334.645734:0:66170:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0565e6c00/0xcc1762b626f8cc88 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189334.645744:0:66170:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0565e6c00/0xcc1762b626f8cc88 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1784189334.645844:0:66170:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000e26c4f78 reply state 00000000d7a37665 transno 120259084302 ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0565e6c00/0xcc1762b626f8cc88 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189334.645857:0:66170:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0565e6c00/0xcc1762b626f8cc88 lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189334.645864:0:66170:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x8:0x0].0x0 (ffff9dbf45994f00) 00010000:00010000:2.0:1784189334.645893:0:66170:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1784189334.645896:0:66170:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1784189334.645999:0:66170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf43c5ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:debedd94-805c-42a0-a5e5-41758b2012e9+33:73517:x1870854436337152:12345-192.168.203.12@tcp:36:touch.0 Request processed in 430us (594us total) trans 120259084302 rc 0/0 00000100:00100000:2.0:1784189334.646008:0:66170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1455 00000100:00100000:1.0:1784189334.650928:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1784189334.651039:0:66945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436337280 00000100:00100000:0.0:1784189334.651048:0:66945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436337280 00000100:00100000:0.0:1784189334.651108:0:66945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1456 00000100:00100000:0.0:1784189334.651117:0:66945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf4a32e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:debedd94-805c-42a0-a5e5-41758b2012e9+33:73517:x1870854436337280:12345-192.168.203.12@tcp:101:touch.0 00010000:00010000:0.0:1784189334.651138:0:66945:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784189334.651157:0:66945:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc05ec0f600/0xcc1762b626f8cc8f lrc: 2/0,0 mode: --/CR res: [0x20000cf21:0x8:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbfc5de7fe6c415f expref: -99 pid: 66945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189334.651207:0:66945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc05ec0f600/0xcc1762b626f8cc8f lrc: 3/0,0 mode: CR/CR res: [0x20000cf21:0x8:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c415f expref: 34 pid: 66945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189334.651221:0:66945:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc05ec0f600/0xcc1762b626f8cc8f lrc: 3/0,0 mode: CR/CR res: [0x20000cf21:0x8:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c415f expref: 34 pid: 66945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189334.651238:0:66945:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x8:0x0].0x0 (ffff9dbf45994f00) 00010000:00010000:0.0:1784189334.651241:0:66945:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1784189334.651245:0:66945:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc05ec0f600, rc 0) 00000100:00100000:0.0:1784189334.651299:0:66945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf4a32e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:debedd94-805c-42a0-a5e5-41758b2012e9+34:73517:x1870854436337280:12345-192.168.203.12@tcp:101:touch.0 Request processed in 182us (378us total) trans 0 rc 0/0 00000100:00100000:0.0:1784189334.651361:0:66945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1456 00000100:00100000:3.0:1784189334.654048:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1784189334.657530:0:26162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436337408 00000100:00100000:1.0:1784189334.657544:0:26162:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436337408 00000100:00100000:1.0:1784189334.657644:0:26162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 5002 00000100:00100000:1.0:1784189334.657654:0:26162:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc04a64d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:debedd94-805c-42a0-a5e5-41758b2012e9+7:2397:x1870854436337408:12345-192.168.203.12@tcp:2:touch.0 00000100:00100000:1.0:1784189334.657855:0:26162:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc04a64d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:debedd94-805c-42a0-a5e5-41758b2012e9+8:2397:x1870854436337408:12345-192.168.203.12@tcp:2:touch.0 Request processed in 202us (3881us total) trans 4294968959 rc 0/0 00000100:00100000:1.0:1784189334.657863:0:26162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 5002 00000100:00100000:0.0:1784189334.663536:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1784189334.663602:0:66173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436337664 00000100:00100000:3.0:1784189334.663624:0:66173:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436337664 00000100:00100000:3.0:1784189334.663679:0:66173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 247 00000100:00100000:3.0:1784189334.663688:0:66173:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf48599880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:debedd94-805c-42a0-a5e5-41758b2012e9+34:73517:x1870854436337664:12345-192.168.203.12@tcp:35:touch.0 00000100:00100000:3.0:1784189334.664123:0:66173:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf48599880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:debedd94-805c-42a0-a5e5-41758b2012e9+35:73517:x1870854436337664:12345-192.168.203.12@tcp:35:touch.0 Request processed in 278us (439us total) trans 120259084303 rc 0/0 00000100:00100000:3.0:1784189334.664134:0:66173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 247 00000100:00100000:2.0:1784189334.676679:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1784189334.676778:0:66171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436337920 00000100:00100000:0.0:1784189334.676787:0:66171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436337920 00000100:00100000:0.0:1784189334.676846:0:66171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1457 00000100:00100000:0.0:1784189334.676856:0:66171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf4a341500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:debedd94-805c-42a0-a5e5-41758b2012e9+35:73517:x1870854436337920:12345-192.168.203.12@tcp:101:touch.0 00010000:00010000:0.0:1784189334.676889:0:66171:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784189334.676912:0:66171:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc05ec0ea00/0xcc1762b626f8cc96 lrc: 2/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbfc5de7fe6c4166 expref: -99 pid: 66171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189334.677033:0:66171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc05ec0fa00/0xcc1762b626f8cc9d lrc: 3/0,1 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189334.677049:0:66171:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc05ec0fa00/0xcc1762b626f8cc9d lrc: 3/0,1 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189334.677059:0:66171:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc05ec0fa00/0xcc1762b626f8cc9d lrc: 3/0,1 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189334.677074:0:66171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc05ec0fe00/0xcc1762b626f8cca4 lrc: 3/0,1 mode: --/PW res: [0x20000cf21:0x4:0x0].0x74f887a3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189334.677080:0:66171:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc05ec0fe00/0xcc1762b626f8cca4 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x4:0x0].0x74f887a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189334.677087:0:66171:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc05ec0fe00/0xcc1762b626f8cca4 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x4:0x0].0x74f887a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1784189334.677458:0:66171:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x765:0x0], index 0: 0 00010000:00010000:0.0:1784189334.677714:0:66171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc05ec0e200/0xcc1762b626f8ccab lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189334.677730:0:66171:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc05ec0e200/0xcc1762b626f8ccab lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189334.677738:0:66171:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc05ec0e200/0xcc1762b626f8ccab lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189334.677773:0:66171:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc05ec0fa00/0xcc1762b626f8cc9d lrc: 4/0,1 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189334.677780:0:66171:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc05ec0fa00/0xcc1762b626f8cc9d lrc: 4/0,1 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189334.677786:0:66171:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc05ec0fa00/0xcc1762b626f8cc9d lrc: 3/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189334.677793:0:66171:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dc05ec0fa00/0xcc1762b626f8cc9d lrc: 4/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189334.677800:0:66171:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc05ec0fa00 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:0.0:1784189334.677805:0:66171:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc05ec0fa00/0xcc1762b626f8cc9d lrc: 4/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189334.677812:0:66171:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc05ec0fa00/0xcc1762b626f8cc9d lrc: 5/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189334.677823:0:66171:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x0 (ffff9dbf45994c00) 00010000:00010000:0.0:1784189334.677826:0:66171:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784189334.677831:0:66171:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dc05ec0fa00/0xcc1762b626f8cc9d lrc: 3/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189334.677838:0:66171:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc05ec0fa00/0xcc1762b626f8cc9d lrc: 0/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1784189334.677855:0:66171:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000ec2d8aba reply state 00000000d34c8ae1 transno 120259084304 ns: mdt-lustre-MDT0000_UUID lock: ffff9dc05ec0fe00/0xcc1762b626f8cca4 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x4:0x0].0x74f887a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189334.677866:0:66171:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc05ec0fe00/0xcc1762b626f8cca4 lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x74f887a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189334.677871:0:66171:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x74f887a3 (ffff9dc07fab4900) 00010000:00010000:0.0:1784189334.677874:0:66171:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1784189334.677876:0:66171:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1784189334.677916:0:66171:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc05ec0ea00/0xcc1762b626f8cc96 lrc: 0/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c4166 expref: 38 pid: 66171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189334.677931:0:66171:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc05ec0e200/0xcc1762b626f8ccab lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c4166 expref: 37 pid: 66171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189334.677938:0:66171:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x9:0x0].0x0 (ffff9dc07fab4500) 00010000:00010000:0.0:1784189334.677940:0:66171:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1784189334.677942:0:66171:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc05ec0e200, rc 0) 00000100:00100000:0.0:1784189334.678175:0:66171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf4a341500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:debedd94-805c-42a0-a5e5-41758b2012e9+38:73517:x1870854436337920:12345-192.168.203.12@tcp:101:touch.0 Request processed in 1319us (1503us total) trans 120259084304 rc 0/0 00000100:00100000:0.0:1784189334.678183:0:66171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1457 00000100:00100000:3.0:1784189334.685453:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1784189334.685533:0:66169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436338176 00000100:00100000:0.0:1784189334.685543:0:66169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436338176 00000100:00100000:0.0:1784189334.685605:0:66169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1458 00000100:00100000:0.0:1784189334.685615:0:66169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc05edaad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:debedd94-805c-42a0-a5e5-41758b2012e9+38:73517:x1870854436338176:12345-192.168.203.12@tcp:36:touch.0 00010000:00010000:0.0:1784189334.685672:0:66169:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784189334.685699:0:66169:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc05ec0e200/0xcc1762b626f8ccab lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c4166 expref: 38 pid: 66171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189334.685730:0:66169:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x9:0x0].0x0 (ffff9dc07fab4500) 00010000:00010000:0.0:1784189334.685740:0:66169:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1784189334.685792:0:66169:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc05ec0ea00/0xcc1762b626f8ccb9 lrc: 3/0,1 mode: --/PW res: [0x20000cf21:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189334.685804:0:66169:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc05ec0ea00/0xcc1762b626f8ccb9 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189334.685813:0:66169:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc05ec0ea00/0xcc1762b626f8ccb9 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1784189334.685920:0:66169:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000c45207e8 reply state 000000003e9207e5 transno 120259084305 ns: mdt-lustre-MDT0000_UUID lock: ffff9dc05ec0ea00/0xcc1762b626f8ccb9 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189334.685933:0:66169:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc05ec0ea00/0xcc1762b626f8ccb9 lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189334.685939:0:66169:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x9:0x0].0x0 (ffff9dc07fab4300) 00010000:00010000:0.0:1784189334.685942:0:66169:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1784189334.685945:0:66169:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1784189334.686159:0:66169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc05edaad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:debedd94-805c-42a0-a5e5-41758b2012e9+39:73517:x1870854436338176:12345-192.168.203.12@tcp:36:touch.0 Request processed in 545us (715us total) trans 120259084305 rc 0/0 00000100:00100000:0.0:1784189334.686167:0:66169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1458 00000100:00100000:1.0:1784189334.689051:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1784189334.689197:0:68287:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436338304 00000100:00100000:2.0:1784189334.689207:0:68287:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436338304 00000100:00100000:2.0:1784189334.689276:0:68287:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1459 00000100:00100000:2.0:1784189334.689287:0:68287:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf4a32f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:debedd94-805c-42a0-a5e5-41758b2012e9+39:73517:x1870854436338304:12345-192.168.203.12@tcp:101:touch.0 00010000:00010000:2.0:1784189334.689311:0:68287:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784189334.689365:0:68287:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0565e7400/0xcc1762b626f8ccc0 lrc: 2/0,0 mode: --/CR res: [0x20000cf21:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbfc5de7fe6c416d expref: -99 pid: 68287 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189334.689423:0:68287:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0565e7400/0xcc1762b626f8ccc0 lrc: 3/0,0 mode: CR/CR res: [0x20000cf21:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c416d expref: 40 pid: 68287 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189334.689448:0:68287:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0565e7400/0xcc1762b626f8ccc0 lrc: 3/0,0 mode: CR/CR res: [0x20000cf21:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c416d expref: 40 pid: 68287 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189334.689465:0:68287:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x9:0x0].0x0 (ffff9dc07fab4300) 00010000:00010000:2.0:1784189334.689469:0:68287:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1784189334.689472:0:68287:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc0565e7400, rc 0) 00000100:00100000:2.0:1784189334.689525:0:68287:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf4a32f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:debedd94-805c-42a0-a5e5-41758b2012e9+40:73517:x1870854436338304:12345-192.168.203.12@tcp:101:touch.0 Request processed in 240us (482us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189334.689531:0:68287:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1459 00000100:00100000:3.0:1784189334.698142:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1784189334.698368:0:26165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436338432 00000100:00100000:1.0:1784189334.698378:0:26165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436338432 00000100:00100000:1.0:1784189334.698439:0:26165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 5003 00000100:00100000:1.0:1784189334.698448:0:26165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc05eda9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:debedd94-805c-42a0-a5e5-41758b2012e9+8:2399:x1870854436338432:12345-192.168.203.12@tcp:2:touch.0 00000100:00100000:1.0:1784189334.698651:0:26165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc05eda9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:debedd94-805c-42a0-a5e5-41758b2012e9+9:2399:x1870854436338432:12345-192.168.203.12@tcp:2:touch.0 Request processed in 203us (517us total) trans 4294968960 rc 0/0 00000100:00100000:1.0:1784189334.698659:0:26165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 5003 00000100:00100000:3.0:1784189334.710719:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1784189334.710841:0:66172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436338688 00000100:00100000:0.0:1784189334.710851:0:66172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436338688 00000100:00100000:0.0:1784189334.710913:0:66172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 248 00000100:00100000:0.0:1784189334.710923:0:66172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc05eda8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:debedd94-805c-42a0-a5e5-41758b2012e9+40:73517:x1870854436338688:12345-192.168.203.12@tcp:35:touch.0 00000100:00100000:0.0:1784189334.711209:0:66172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc05eda8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:debedd94-805c-42a0-a5e5-41758b2012e9+41:73517:x1870854436338688:12345-192.168.203.12@tcp:35:touch.0 Request processed in 287us (498us total) trans 120259084306 rc 0/0 00000100:00100000:0.0:1784189334.711231:0:66172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 248 00000100:00100000:2.0:1784189334.714411:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1784189334.714604:0:66170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436338944 00000100:00100000:1.0:1784189334.714624:0:66170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436338944 00000100:00100000:1.0:1784189334.714684:0:66170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1460 00000100:00100000:1.0:1784189334.714693:0:66170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf4a341880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:debedd94-805c-42a0-a5e5-41758b2012e9+41:73517:x1870854436338944:12345-192.168.203.12@tcp:101:touch.0 00010000:00010000:1.0:1784189334.714716:0:66170:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784189334.714737:0:66170:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc042d66c00/0xcc1762b626f8ccc7 lrc: 2/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbfc5de7fe6c4174 expref: -99 pid: 66170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189334.714960:0:66170:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc042d67a00/0xcc1762b626f8ccce lrc: 3/0,1 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189334.714985:0:66170:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc042d67a00/0xcc1762b626f8ccce lrc: 3/0,1 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189334.714996:0:66170:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc042d67a00/0xcc1762b626f8ccce lrc: 3/0,1 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189334.715011:0:66170:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc042d66600/0xcc1762b626f8ccd5 lrc: 3/0,1 mode: --/PW res: [0x20000cf21:0x4:0x0].0xbd5240a3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189334.715018:0:66170:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc042d66600/0xcc1762b626f8ccd5 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x4:0x0].0xbd5240a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189334.715024:0:66170:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc042d66600/0xcc1762b626f8ccd5 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x4:0x0].0xbd5240a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1784189334.715369:0:66170:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x766:0x0], index 0: 0 00010000:00010000:1.0:1784189334.715512:0:66170:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc042d66400/0xcc1762b626f8ccdc lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189334.715522:0:66170:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc042d66400/0xcc1762b626f8ccdc lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0xa:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189334.715542:0:66170:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc042d66400/0xcc1762b626f8ccdc lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0xa:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189334.715576:0:66170:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc042d67a00/0xcc1762b626f8ccce lrc: 4/0,1 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189334.715584:0:66170:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc042d67a00/0xcc1762b626f8ccce lrc: 4/0,1 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189334.715591:0:66170:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc042d67a00/0xcc1762b626f8ccce lrc: 3/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189334.715598:0:66170:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dc042d67a00/0xcc1762b626f8ccce lrc: 4/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189334.715605:0:66170:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc042d67a00 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:1.0:1784189334.715610:0:66170:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc042d67a00/0xcc1762b626f8ccce lrc: 4/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189334.715617:0:66170:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc042d67a00/0xcc1762b626f8ccce lrc: 5/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189334.715629:0:66170:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x0 (ffff9dbf45994c00) 00010000:00010000:1.0:1784189334.715632:0:66170:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784189334.715637:0:66170:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dc042d67a00/0xcc1762b626f8ccce lrc: 3/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189334.715644:0:66170:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc042d67a00/0xcc1762b626f8ccce lrc: 0/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1784189334.715657:0:66170:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000f5fe016f reply state 00000000a3431702 transno 120259084307 ns: mdt-lustre-MDT0000_UUID lock: ffff9dc042d66600/0xcc1762b626f8ccd5 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x4:0x0].0xbd5240a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189334.715674:0:66170:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc042d66600/0xcc1762b626f8ccd5 lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0xbd5240a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189334.715681:0:66170:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0xbd5240a3 (ffff9dc05a487200) 00010000:00010000:1.0:1784189334.715683:0:66170:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1784189334.715686:0:66170:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1784189334.715714:0:66170:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc042d66c00/0xcc1762b626f8ccc7 lrc: 0/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c4174 expref: 44 pid: 66170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189334.715728:0:66170:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc042d66400/0xcc1762b626f8ccdc lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0xa:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c4174 expref: 43 pid: 66170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189334.715736:0:66170:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0xa:0x0].0x0 (ffff9dc05a487e00) 00010000:00010000:1.0:1784189334.715739:0:66170:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1784189334.715741:0:66170:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc042d66400, rc 0) 00000100:00100000:1.0:1784189334.716243:0:66170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf4a341880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:debedd94-805c-42a0-a5e5-41758b2012e9+44:73517:x1870854436338944:12345-192.168.203.12@tcp:101:touch.0 Request processed in 1549us (1839us total) trans 120259084307 rc 0/0 00000100:00100000:1.0:1784189334.716252:0:66170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1460 00000100:00100000:2.0:1784189334.725421:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1784189334.725530:0:66945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436339200 00000100:00100000:1.0:1784189334.725539:0:66945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436339200 00000100:00100000:1.0:1784189334.725596:0:66945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1461 00000100:00100000:1.0:1784189334.725606:0:66945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf4a343800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:debedd94-805c-42a0-a5e5-41758b2012e9+44:73517:x1870854436339200:12345-192.168.203.12@tcp:36:touch.0 00010000:00010000:1.0:1784189334.725661:0:66945:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784189334.725687:0:66945:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc042d66400/0xcc1762b626f8ccdc lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0xa:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c4174 expref: 44 pid: 66170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189334.725705:0:66945:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0xa:0x0].0x0 (ffff9dc05a487e00) 00010000:00010000:1.0:1784189334.725722:0:66945:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1784189334.725771:0:66945:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc042d66c00/0xcc1762b626f8ccea lrc: 3/0,1 mode: --/PW res: [0x20000cf21:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189334.725797:0:66945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc042d66c00/0xcc1762b626f8ccea lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189334.725807:0:66945:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc042d66c00/0xcc1762b626f8ccea lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1784189334.725919:0:66945:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000009dee7215 reply state 000000005f7167e6 transno 120259084308 ns: mdt-lustre-MDT0000_UUID lock: ffff9dc042d66c00/0xcc1762b626f8ccea lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189334.725932:0:66945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc042d66c00/0xcc1762b626f8ccea lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189334.725939:0:66945:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0xa:0x0].0x0 (ffff9dc05a487100) 00010000:00010000:1.0:1784189334.725941:0:66945:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1784189334.725944:0:66945:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1784189334.726099:0:66945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf4a343800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:debedd94-805c-42a0-a5e5-41758b2012e9+45:73517:x1870854436339200:12345-192.168.203.12@tcp:36:touch.0 Request processed in 493us (686us total) trans 120259084308 rc 0/0 00000100:00100000:1.0:1784189334.726107:0:66945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1461 00000100:00100000:3.0:1784189334.732818:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1784189334.732954:0:66171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436339328 00000100:00100000:0.0:1784189334.732964:0:66171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436339328 00000100:00100000:0.0:1784189334.733032:0:66171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1462 00000100:00100000:0.0:1784189334.733042:0:66171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc070222300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:debedd94-805c-42a0-a5e5-41758b2012e9+45:73517:x1870854436339328:12345-192.168.203.12@tcp:101:touch.0 00010000:00010000:0.0:1784189334.733066:0:66171:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784189334.733087:0:66171:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc05ec0e200/0xcc1762b626f8ccf1 lrc: 2/0,0 mode: --/CR res: [0x20000cf21:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbfc5de7fe6c417b expref: -99 pid: 66171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189334.733146:0:66171:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc05ec0e200/0xcc1762b626f8ccf1 lrc: 3/0,0 mode: CR/CR res: [0x20000cf21:0xa:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c417b expref: 46 pid: 66171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189334.733161:0:66171:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc05ec0e200/0xcc1762b626f8ccf1 lrc: 3/0,0 mode: CR/CR res: [0x20000cf21:0xa:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c417b expref: 46 pid: 66171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189334.733179:0:66171:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0xa:0x0].0x0 (ffff9dc05a487100) 00010000:00010000:0.0:1784189334.733181:0:66171:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1784189334.733185:0:66171:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc05ec0e200, rc 0) 00000100:00100000:0.0:1784189334.733246:0:66171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc070222300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:debedd94-805c-42a0-a5e5-41758b2012e9+46:73517:x1870854436339328:12345-192.168.203.12@tcp:101:touch.0 Request processed in 205us (437us total) trans 0 rc 0/0 00000100:00100000:0.0:1784189334.733253:0:66171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1462 00000100:00100000:3.0:1784189334.736072:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1784189334.736168:0:26163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436339456 00000100:00100000:2.0:1784189334.736177:0:26163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436339456 00000100:00100000:2.0:1784189334.736237:0:26163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 5004 00000100:00100000:2.0:1784189334.736247:0:26163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc070220700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:debedd94-805c-42a0-a5e5-41758b2012e9+9:2399:x1870854436339456:12345-192.168.203.12@tcp:2:touch.0 00000100:00100000:2.0:1784189334.736503:0:26163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc070220700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:debedd94-805c-42a0-a5e5-41758b2012e9+10:2399:x1870854436339456:12345-192.168.203.12@tcp:2:touch.0 Request processed in 256us (441us total) trans 4294968961 rc 0/0 00000100:00100000:2.0:1784189334.736510:0:26163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 5004 00000100:00100000:2.0:1784189334.744164:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1784189334.744261:0:66172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436339712 00000100:00100000:0.0:1784189334.744270:0:66172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436339712 00000100:00100000:0.0:1784189334.744360:0:66172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 249 00000100:00100000:0.0:1784189334.744370:0:66172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf4a342d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:debedd94-805c-42a0-a5e5-41758b2012e9+46:73517:x1870854436339712:12345-192.168.203.12@tcp:35:touch.0 00000100:00100000:0.0:1784189334.744643:0:66172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf4a342d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:debedd94-805c-42a0-a5e5-41758b2012e9+47:73517:x1870854436339712:12345-192.168.203.12@tcp:35:touch.0 Request processed in 274us (487us total) trans 120259084309 rc 0/0 00000100:00100000:0.0:1784189334.744665:0:66172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 249 00000100:00100000:3.0:1784189334.747741:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1784189334.747898:0:66170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436339968 00000100:00100000:1.0:1784189334.747908:0:66170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436339968 00000100:00100000:1.0:1784189334.747970:0:66170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1463 00000100:00100000:1.0:1784189334.747980:0:66170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc070222680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:debedd94-805c-42a0-a5e5-41758b2012e9+47:73517:x1870854436339968:12345-192.168.203.12@tcp:101:touch.0 00010000:00010000:1.0:1784189334.748003:0:66170:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784189334.748022:0:66170:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc042d66400/0xcc1762b626f8ccf8 lrc: 2/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbfc5de7fe6c4182 expref: -99 pid: 66170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189334.748128:0:66170:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc042d67a00/0xcc1762b626f8ccff lrc: 3/0,1 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189334.748153:0:66170:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc042d67a00/0xcc1762b626f8ccff lrc: 3/0,1 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189334.748164:0:66170:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc042d67a00/0xcc1762b626f8ccff lrc: 3/0,1 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189334.748178:0:66170:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc042d66200/0xcc1762b626f8cd06 lrc: 3/0,1 mode: --/PW res: [0x20000cf21:0x4:0x0].0x5abf9a3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189334.748185:0:66170:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc042d66200/0xcc1762b626f8cd06 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x4:0x0].0x5abf9a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189334.748191:0:66170:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc042d66200/0xcc1762b626f8cd06 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x4:0x0].0x5abf9a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1784189334.748504:0:66170:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x767:0x0], index 0: 0 00010000:00010000:1.0:1784189334.748625:0:66170:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc042d67e00/0xcc1762b626f8cd0d lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189334.748635:0:66170:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc042d67e00/0xcc1762b626f8cd0d lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189334.748642:0:66170:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc042d67e00/0xcc1762b626f8cd0d lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189334.748670:0:66170:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc042d67a00/0xcc1762b626f8ccff lrc: 4/0,1 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189334.748676:0:66170:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc042d67a00/0xcc1762b626f8ccff lrc: 4/0,1 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189334.748682:0:66170:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc042d67a00/0xcc1762b626f8ccff lrc: 3/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189334.748696:0:66170:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dc042d67a00/0xcc1762b626f8ccff lrc: 4/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189334.748702:0:66170:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc042d67a00 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:1.0:1784189334.748706:0:66170:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc042d67a00/0xcc1762b626f8ccff lrc: 4/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189334.748713:0:66170:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc042d67a00/0xcc1762b626f8ccff lrc: 5/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189334.748723:0:66170:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x0 (ffff9dbf45994c00) 00010000:00010000:1.0:1784189334.748726:0:66170:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784189334.748730:0:66170:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dc042d67a00/0xcc1762b626f8ccff lrc: 3/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189334.748736:0:66170:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc042d67a00/0xcc1762b626f8ccff lrc: 0/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1784189334.748748:0:66170:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000009ba33580 reply state 00000000472d91c1 transno 120259084310 ns: mdt-lustre-MDT0000_UUID lock: ffff9dc042d66200/0xcc1762b626f8cd06 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x4:0x0].0x5abf9a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189334.748759:0:66170:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc042d66200/0xcc1762b626f8cd06 lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x5abf9a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189334.748765:0:66170:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x5abf9a3 (ffff9dc05a487e00) 00010000:00010000:1.0:1784189334.748768:0:66170:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1784189334.748770:0:66170:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1784189334.748927:0:66170:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc042d66400/0xcc1762b626f8ccf8 lrc: 0/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c4182 expref: 50 pid: 66170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189334.748943:0:66170:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc042d67e00/0xcc1762b626f8cd0d lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c4182 expref: 49 pid: 66170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189334.748957:0:66170:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0xb:0x0].0x0 (ffff9dc05a487400) 00010000:00010000:1.0:1784189334.748959:0:66170:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1784189334.748962:0:66170:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc042d67e00, rc 0) 00000100:00100000:1.0:1784189334.749135:0:66170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc070222680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:debedd94-805c-42a0-a5e5-41758b2012e9+50:73517:x1870854436339968:12345-192.168.203.12@tcp:101:touch.0 Request processed in 1155us (1402us total) trans 120259084310 rc 0/0 00000100:00100000:1.0:1784189334.749143:0:66170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1463 00000100:00100000:2.0:1784189334.762560:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1784189334.764558:0:68287:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436340224 00000100:00100000:1.0:1784189334.764572:0:68287:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436340224 00000100:00100000:1.0:1784189334.764631:0:68287:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1464 00000100:00100000:1.0:1784189334.764642:0:68287:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf4a340380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:debedd94-805c-42a0-a5e5-41758b2012e9+50:73517:x1870854436340224:12345-192.168.203.12@tcp:36:touch.0 00010000:00010000:1.0:1784189334.764700:0:68287:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784189334.764726:0:68287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc042d67e00/0xcc1762b626f8cd0d lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c4182 expref: 50 pid: 66170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189334.764745:0:68287:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0xb:0x0].0x0 (ffff9dc05a487400) 00010000:00010000:1.0:1784189334.764756:0:68287:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1784189334.765690:0:68287:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc042d66400/0xcc1762b626f8cd1b lrc: 3/0,1 mode: --/PW res: [0x20000cf21:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189334.765711:0:68287:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc042d66400/0xcc1762b626f8cd1b lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189334.765721:0:68287:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc042d66400/0xcc1762b626f8cd1b lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1784189334.765994:0:68287:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000cee65f21 reply state 0000000064a37ea9 transno 120259084311 ns: mdt-lustre-MDT0000_UUID lock: ffff9dc042d66400/0xcc1762b626f8cd1b lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189334.766027:0:68287:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc042d66400/0xcc1762b626f8cd1b lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189334.766035:0:68287:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0xb:0x0].0x0 (ffff9dc05a487c00) 00010000:00010000:1.0:1784189334.766037:0:68287:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1784189334.766040:0:68287:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1784189334.769013:0:68287:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf4a340380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:debedd94-805c-42a0-a5e5-41758b2012e9+51:73517:x1870854436340224:12345-192.168.203.12@tcp:36:touch.0 Request processed in 4360us (6451us total) trans 120259084311 rc 0/0 00000100:00100000:1.0:1784189334.769027:0:68287:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1464 00000100:00100000:2.0:1784189334.782128:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1784189334.782903:0:66169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436340352 00000100:00100000:1.0:1784189334.782913:0:66169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436340352 00000100:00100000:1.0:1784189334.782982:0:66169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1465 00000100:00100000:1.0:1784189334.782999:0:66169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf4a340000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:debedd94-805c-42a0-a5e5-41758b2012e9+51:73517:x1870854436340352:12345-192.168.203.12@tcp:101:touch.0 00010000:00010000:1.0:1784189334.783023:0:66169:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784189334.783044:0:66169:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc042d67e00/0xcc1762b626f8cd22 lrc: 2/0,0 mode: --/CR res: [0x20000cf21:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbfc5de7fe6c4189 expref: -99 pid: 66169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189334.783101:0:66169:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc042d67e00/0xcc1762b626f8cd22 lrc: 3/0,0 mode: CR/CR res: [0x20000cf21:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c4189 expref: 52 pid: 66169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189334.783120:0:66169:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc042d67e00/0xcc1762b626f8cd22 lrc: 3/0,0 mode: CR/CR res: [0x20000cf21:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c4189 expref: 52 pid: 66169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189334.783140:0:66169:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0xb:0x0].0x0 (ffff9dc05a487c00) 00010000:00010000:1.0:1784189334.783143:0:66169:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1784189334.783146:0:66169:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc042d67e00, rc 0) 00000100:00100000:1.0:1784189334.783209:0:66169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf4a340000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:debedd94-805c-42a0-a5e5-41758b2012e9+52:73517:x1870854436340352:12345-192.168.203.12@tcp:101:touch.0 Request processed in 218us (1090us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189334.783229:0:66169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1465 00000100:00100000:3.0:1784189334.788680:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1784189334.788767:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436340480 00000100:00100000:0.0:1784189334.788778:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436340480 00000100:00100000:0.0:1784189334.788833:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 5005 00000100:00100000:0.0:1784189334.788843:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc070220000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:debedd94-805c-42a0-a5e5-41758b2012e9+10:2397:x1870854436340480:12345-192.168.203.12@tcp:2:touch.0 00000100:00100000:0.0:1784189334.789054:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc070220000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:debedd94-805c-42a0-a5e5-41758b2012e9+11:2397:x1870854436340480:12345-192.168.203.12@tcp:2:touch.0 Request processed in 212us (379us total) trans 4294968962 rc 0/0 00000100:00100000:0.0:1784189334.789062:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 5005 00000100:00100000:2.0:1784189334.798964:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1784189334.803228:0:66172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436340736 00000100:00100000:0.0:1784189334.803244:0:66172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436340736 00000100:00100000:0.0:1784189334.803340:0:66172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 250 00000100:00100000:0.0:1784189334.803351:0:66172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf4a343b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:debedd94-805c-42a0-a5e5-41758b2012e9+52:73517:x1870854436340736:12345-192.168.203.12@tcp:35:touch.0 00000100:00100000:0.0:1784189334.803758:0:66172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf4a343b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:debedd94-805c-42a0-a5e5-41758b2012e9+53:73517:x1870854436340736:12345-192.168.203.12@tcp:35:touch.0 Request processed in 407us (4801us total) trans 120259084312 rc 0/0 00000100:00100000:0.0:1784189334.803766:0:66172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 250 00000100:00100000:1.0:1784189334.806949:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1784189334.807048:0:66170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436340992 00000100:00100000:2.0:1784189334.807058:0:66170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436340992 00000100:00100000:2.0:1784189334.807126:0:66170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1466 00000100:00100000:2.0:1784189334.807137:0:66170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf4a32d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:debedd94-805c-42a0-a5e5-41758b2012e9+53:73517:x1870854436340992:12345-192.168.203.12@tcp:101:touch.0 00010000:00010000:2.0:1784189334.807160:0:66170:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784189334.807179:0:66170:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0565e6a00/0xcc1762b626f8cd29 lrc: 2/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbfc5de7fe6c4190 expref: -99 pid: 66170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189334.807622:0:66170:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0565e6000/0xcc1762b626f8cd30 lrc: 3/0,1 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189334.807639:0:66170:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0565e6000/0xcc1762b626f8cd30 lrc: 3/0,1 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189334.807650:0:66170:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0565e6000/0xcc1762b626f8cd30 lrc: 3/0,1 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189334.807666:0:66170:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0565e7200/0xcc1762b626f8cd37 lrc: 3/0,1 mode: --/PW res: [0x20000cf21:0x4:0x0].0x4e05b2a3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189334.807686:0:66170:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0565e7200/0xcc1762b626f8cd37 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x4:0x0].0x4e05b2a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189334.807692:0:66170:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0565e7200/0xcc1762b626f8cd37 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x4:0x0].0x4e05b2a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1784189334.808466:0:66170:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x768:0x0], index 0: 0 00010000:00010000:2.0:1784189334.809030:0:66170:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4710f400/0xcc1762b626f8cd3e lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0xc:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189334.809043:0:66170:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4710f400/0xcc1762b626f8cd3e lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189334.809052:0:66170:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4710f400/0xcc1762b626f8cd3e lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189334.809087:0:66170:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0565e6000/0xcc1762b626f8cd30 lrc: 4/0,1 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189334.809095:0:66170:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0565e6000/0xcc1762b626f8cd30 lrc: 4/0,1 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189334.809100:0:66170:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0565e6000/0xcc1762b626f8cd30 lrc: 3/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189334.809108:0:66170:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0565e6000/0xcc1762b626f8cd30 lrc: 4/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189334.809113:0:66170:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc0565e6000 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:2.0:1784189334.809118:0:66170:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0565e6000/0xcc1762b626f8cd30 lrc: 4/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189334.809138:0:66170:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0565e6000/0xcc1762b626f8cd30 lrc: 5/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189334.809150:0:66170:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x0 (ffff9dbf45994c00) 00010000:00010000:2.0:1784189334.809153:0:66170:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784189334.809157:0:66170:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0565e6000/0xcc1762b626f8cd30 lrc: 3/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189334.809163:0:66170:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0565e6000/0xcc1762b626f8cd30 lrc: 0/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1784189334.809176:0:66170:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000003339fe36 reply state 00000000d46a9649 transno 120259084313 ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0565e7200/0xcc1762b626f8cd37 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x4:0x0].0x4e05b2a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189334.809186:0:66170:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0565e7200/0xcc1762b626f8cd37 lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x4e05b2a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189334.809192:0:66170:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x4e05b2a3 (ffff9dbf45994700) 00010000:00010000:2.0:1784189334.809194:0:66170:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1784189334.809197:0:66170:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1784189334.809229:0:66170:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0565e6a00/0xcc1762b626f8cd29 lrc: 0/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c4190 expref: 56 pid: 66170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189334.809242:0:66170:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4710f400/0xcc1762b626f8cd3e lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c4190 expref: 55 pid: 66170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189334.809249:0:66170:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0xc:0x0].0x0 (ffff9dbf45994600) 00010000:00010000:2.0:1784189334.809251:0:66170:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784189334.809253:0:66170:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dbf4710f400, rc 0) 00000100:00100000:2.0:1784189334.809809:0:66170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf4a32d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:debedd94-805c-42a0-a5e5-41758b2012e9+56:73517:x1870854436340992:12345-192.168.203.12@tcp:101:touch.0 Request processed in 2673us (2868us total) trans 120259084313 rc 0/0 00000100:00100000:2.0:1784189334.809818:0:66170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1466 00000100:00100000:2.0:1784189334.818737:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1784189334.818829:0:68287:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436341248 00000100:00100000:0.0:1784189334.818839:0:68287:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436341248 00000100:00100000:0.0:1784189334.818919:0:68287:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1467 00000100:00100000:0.0:1784189334.818929:0:68287:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf4a341180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:debedd94-805c-42a0-a5e5-41758b2012e9+56:73517:x1870854436341248:12345-192.168.203.12@tcp:36:touch.0 00010000:00010000:0.0:1784189334.818988:0:68287:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784189334.819016:0:68287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4710f400/0xcc1762b626f8cd3e lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c4190 expref: 56 pid: 66170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189334.819045:0:68287:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0xc:0x0].0x0 (ffff9dbf45994600) 00010000:00010000:0.0:1784189334.819056:0:68287:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1784189334.819122:0:68287:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc05ec0fc00/0xcc1762b626f8cd4c lrc: 3/0,1 mode: --/PW res: [0x20000cf21:0xc:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189334.819137:0:68287:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc05ec0fc00/0xcc1762b626f8cd4c lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0xc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189334.819147:0:68287:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc05ec0fc00/0xcc1762b626f8cd4c lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0xc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1784189334.819245:0:68287:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000ad4631f0 reply state 00000000bd937b7d transno 120259084314 ns: mdt-lustre-MDT0000_UUID lock: ffff9dc05ec0fc00/0xcc1762b626f8cd4c lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0xc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189334.819257:0:68287:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc05ec0fc00/0xcc1762b626f8cd4c lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0xc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189334.819475:0:68287:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0xc:0x0].0x0 (ffff9dc07fab4500) 00010000:00010000:0.0:1784189334.819479:0:68287:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1784189334.819483:0:68287:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1784189334.819579:0:68287:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf4a341180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:debedd94-805c-42a0-a5e5-41758b2012e9+57:73517:x1870854436341248:12345-192.168.203.12@tcp:36:touch.0 Request processed in 650us (850us total) trans 120259084314 rc 0/0 00000100:00100000:0.0:1784189334.819586:0:68287:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1467 00000100:00100000:0.0:1784189334.826685:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1784189334.826773:0:66169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436341376 00000100:00100000:1.0:1784189334.826782:0:66169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436341376 00000100:00100000:1.0:1784189334.826843:0:66169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1468 00000100:00100000:1.0:1784189334.826854:0:66169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf4859a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:debedd94-805c-42a0-a5e5-41758b2012e9+57:73517:x1870854436341376:12345-192.168.203.12@tcp:101:touch.0 00010000:00010000:1.0:1784189334.826977:0:66169:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784189334.826999:0:66169:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc042d66000/0xcc1762b626f8cd53 lrc: 2/0,0 mode: --/CR res: [0x20000cf21:0xc:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbfc5de7fe6c4197 expref: -99 pid: 66169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189334.827057:0:66169:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc042d66000/0xcc1762b626f8cd53 lrc: 3/0,0 mode: CR/CR res: [0x20000cf21:0xc:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c4197 expref: 58 pid: 66169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189334.827073:0:66169:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc042d66000/0xcc1762b626f8cd53 lrc: 3/0,0 mode: CR/CR res: [0x20000cf21:0xc:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c4197 expref: 58 pid: 66169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189334.827090:0:66169:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0xc:0x0].0x0 (ffff9dc07fab4500) 00010000:00010000:1.0:1784189334.827093:0:66169:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1784189334.827097:0:66169:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc042d66000, rc 0) 00000100:00100000:1.0:1784189334.827159:0:66169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf4859a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:debedd94-805c-42a0-a5e5-41758b2012e9+58:73517:x1870854436341376:12345-192.168.203.12@tcp:101:touch.0 Request processed in 307us (483us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189334.827167:0:66169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1468 00000100:00100000:1.0:1784189334.833705:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1784189334.833827:0:14684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436341504 00000100:00100000:0.0:1784189334.833837:0:14684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436341504 00000100:00100000:0.0:1784189334.833908:0:14684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 5006 00000100:00100000:0.0:1784189334.833917:0:14684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf4a32d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:debedd94-805c-42a0-a5e5-41758b2012e9+11:2399:x1870854436341504:12345-192.168.203.12@tcp:2:touch.0 00000100:00100000:0.0:1784189334.834114:0:14684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf4a32d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:debedd94-805c-42a0-a5e5-41758b2012e9+12:2399:x1870854436341504:12345-192.168.203.12@tcp:2:touch.0 Request processed in 197us (416us total) trans 4294968963 rc 0/0 00000100:00100000:0.0:1784189334.834122:0:14684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 5006 00000100:00100000:2.0:1784189334.846736:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1784189334.846831:0:66172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436341760 00000100:00100000:0.0:1784189334.846855:0:66172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436341760 00000100:00100000:0.0:1784189334.846930:0:66172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 251 00000100:00100000:0.0:1784189334.846939:0:66172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf44d0b850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:debedd94-805c-42a0-a5e5-41758b2012e9+58:73517:x1870854436341760:12345-192.168.203.12@tcp:35:touch.0 00000100:00100000:0.0:1784189334.847232:0:66172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf44d0b850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:debedd94-805c-42a0-a5e5-41758b2012e9+59:73517:x1870854436341760:12345-192.168.203.12@tcp:35:touch.0 Request processed in 292us (504us total) trans 120259084315 rc 0/0 00000100:00100000:0.0:1784189334.847241:0:66172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 251 00000100:00100000:2.0:1784189334.855426:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1784189334.855517:0:66170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436342016 00000100:00100000:1.0:1784189334.855527:0:66170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436342016 00000100:00100000:1.0:1784189334.855591:0:66170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1469 00000100:00100000:1.0:1784189334.855602:0:66170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf4a340700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:debedd94-805c-42a0-a5e5-41758b2012e9+59:73517:x1870854436342016:12345-192.168.203.12@tcp:101:touch.0 00010000:00010000:1.0:1784189334.855639:0:66170:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784189334.855660:0:66170:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc042d67a00/0xcc1762b626f8cd5a lrc: 2/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbfc5de7fe6c419e expref: -99 pid: 66170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189334.855754:0:66170:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04152c200/0xcc1762b626f8cd61 lrc: 3/0,1 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189334.855769:0:66170:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04152c200/0xcc1762b626f8cd61 lrc: 3/0,1 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189334.855792:0:66170:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04152c200/0xcc1762b626f8cd61 lrc: 3/0,1 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189334.855807:0:66170:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04152d400/0xcc1762b626f8cd68 lrc: 3/0,1 mode: --/PW res: [0x20000cf21:0x4:0x0].0x965f6ba3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189334.855814:0:66170:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04152d400/0xcc1762b626f8cd68 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x4:0x0].0x965f6ba3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189334.855820:0:66170:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04152d400/0xcc1762b626f8cd68 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x4:0x0].0x965f6ba3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1784189334.856157:0:66170:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x769:0x0], index 0: 0 00010000:00010000:1.0:1784189334.856277:0:66170:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04152d200/0xcc1762b626f8cd6f lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189334.856287:0:66170:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04152d200/0xcc1762b626f8cd6f lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189334.856294:0:66170:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04152d200/0xcc1762b626f8cd6f lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189334.856385:0:66170:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04152c200/0xcc1762b626f8cd61 lrc: 4/0,1 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189334.856393:0:66170:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04152c200/0xcc1762b626f8cd61 lrc: 4/0,1 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189334.856400:0:66170:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04152c200/0xcc1762b626f8cd61 lrc: 3/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189334.856408:0:66170:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04152c200/0xcc1762b626f8cd61 lrc: 4/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189334.856414:0:66170:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc04152c200 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:1.0:1784189334.856418:0:66170:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04152c200/0xcc1762b626f8cd61 lrc: 4/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189334.856426:0:66170:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04152c200/0xcc1762b626f8cd61 lrc: 5/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189334.856451:0:66170:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x0 (ffff9dbf45994c00) 00010000:00010000:1.0:1784189334.856454:0:66170:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784189334.856458:0:66170:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04152c200/0xcc1762b626f8cd61 lrc: 3/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189334.856464:0:66170:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04152c200/0xcc1762b626f8cd61 lrc: 0/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1784189334.856477:0:66170:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000034ecfb0b reply state 00000000d0332913 transno 120259084316 ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04152d400/0xcc1762b626f8cd68 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x4:0x0].0x965f6ba3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189334.856487:0:66170:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04152d400/0xcc1762b626f8cd68 lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x965f6ba3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189334.856499:0:66170:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x965f6ba3 (ffff9dc05a487400) 00010000:00010000:1.0:1784189334.856502:0:66170:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1784189334.856504:0:66170:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1784189334.856532:0:66170:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc042d67a00/0xcc1762b626f8cd5a lrc: 0/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c419e expref: 62 pid: 66170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189334.856547:0:66170:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04152d200/0xcc1762b626f8cd6f lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c419e expref: 61 pid: 66170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189334.856553:0:66170:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0xd:0x0].0x0 (ffff9dc05a487f00) 00010000:00010000:1.0:1784189334.856556:0:66170:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1784189334.856558:0:66170:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc04152d200, rc 0) 00000100:00100000:1.0:1784189334.856620:0:66170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf4a340700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:debedd94-805c-42a0-a5e5-41758b2012e9+62:73517:x1870854436342016:12345-192.168.203.12@tcp:101:touch.0 Request processed in 1020us (1202us total) trans 120259084316 rc 0/0 00000100:00100000:1.0:1784189334.856627:0:66170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1469 00000100:00100000:1.0:1784189334.865420:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1784189334.865637:0:68287:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436342272 00000100:00100000:0.0:1784189334.865647:0:68287:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436342272 00000100:00100000:0.0:1784189334.865707:0:68287:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1470 00000100:00100000:0.0:1784189334.865718:0:68287:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf4a32f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:debedd94-805c-42a0-a5e5-41758b2012e9+62:73517:x1870854436342272:12345-192.168.203.12@tcp:36:touch.0 00010000:00010000:0.0:1784189334.865786:0:68287:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784189334.865814:0:68287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04152d200/0xcc1762b626f8cd6f lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c419e expref: 62 pid: 66170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189334.865834:0:68287:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0xd:0x0].0x0 (ffff9dc05a487f00) 00010000:00010000:0.0:1784189334.865846:0:68287:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1784189334.865917:0:68287:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc05ec0e000/0xcc1762b626f8cd7d lrc: 3/0,1 mode: --/PW res: [0x20000cf21:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189334.865930:0:68287:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc05ec0e000/0xcc1762b626f8cd7d lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189334.865940:0:68287:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc05ec0e000/0xcc1762b626f8cd7d lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1784189334.866055:0:68287:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000001cba283f reply state 00000000300596df transno 120259084317 ns: mdt-lustre-MDT0000_UUID lock: ffff9dc05ec0e000/0xcc1762b626f8cd7d lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189334.866068:0:68287:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc05ec0e000/0xcc1762b626f8cd7d lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189334.866084:0:68287:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0xd:0x0].0x0 (ffff9dc07fab4a00) 00010000:00010000:0.0:1784189334.866087:0:68287:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1784189334.866090:0:68287:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1784189334.866177:0:68287:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf4a32f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:debedd94-805c-42a0-a5e5-41758b2012e9+63:73517:x1870854436342272:12345-192.168.203.12@tcp:36:touch.0 Request processed in 460us (765us total) trans 120259084317 rc 0/0 00000100:00100000:0.0:1784189334.866185:0:68287:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1470 00000100:00100000:3.0:1784189334.869130:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1784189334.869214:0:66169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436342400 00000100:00100000:1.0:1784189334.869223:0:66169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436342400 00000100:00100000:1.0:1784189334.869278:0:66169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1471 00000100:00100000:1.0:1784189334.869288:0:66169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc070220a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:debedd94-805c-42a0-a5e5-41758b2012e9+63:73517:x1870854436342400:12345-192.168.203.12@tcp:101:touch.0 00010000:00010000:1.0:1784189334.869310:0:66169:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784189334.869357:0:66169:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04152d000/0xcc1762b626f8cd84 lrc: 2/0,0 mode: --/CR res: [0x20000cf21:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbfc5de7fe6c41a5 expref: -99 pid: 66169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189334.869407:0:66169:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04152d000/0xcc1762b626f8cd84 lrc: 3/0,0 mode: CR/CR res: [0x20000cf21:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c41a5 expref: 64 pid: 66169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189334.869450:0:66169:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04152d000/0xcc1762b626f8cd84 lrc: 3/0,0 mode: CR/CR res: [0x20000cf21:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c41a5 expref: 64 pid: 66169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189334.869468:0:66169:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0xd:0x0].0x0 (ffff9dc07fab4a00) 00010000:00010000:1.0:1784189334.869472:0:66169:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1784189334.869475:0:66169:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc04152d000, rc 0) 00000100:00100000:1.0:1784189334.869524:0:66169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc070220a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:debedd94-805c-42a0-a5e5-41758b2012e9+64:73517:x1870854436342400:12345-192.168.203.12@tcp:101:touch.0 Request processed in 237us (403us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189334.869531:0:66169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1471 00000100:00100000:1.0:1784189334.872386:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1784189334.872615:0:26159:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436342528 00000100:00100000:3.0:1784189334.872624:0:26159:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436342528 00000100:00100000:3.0:1784189334.872680:0:26159:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 5007 00000100:00100000:3.0:1784189334.872689:0:26159:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf4a32e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:debedd94-805c-42a0-a5e5-41758b2012e9+12:2396:x1870854436342528:12345-192.168.203.12@tcp:2:touch.0 00000100:00100000:3.0:1784189334.872898:0:26159:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf4a32e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:debedd94-805c-42a0-a5e5-41758b2012e9+13:2396:x1870854436342528:12345-192.168.203.12@tcp:2:touch.0 Request processed in 209us (520us total) trans 4294968964 rc 0/0 00000100:00100000:3.0:1784189334.872906:0:26159:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 5007 00000100:00100000:3.0:1784189334.884688:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1784189334.884818:0:66172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436342784 00000100:00100000:0.0:1784189334.884828:0:66172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436342784 00000100:00100000:0.0:1784189334.884898:0:66172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 252 00000100:00100000:0.0:1784189334.884909:0:66172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc070220e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:debedd94-805c-42a0-a5e5-41758b2012e9+64:73517:x1870854436342784:12345-192.168.203.12@tcp:35:touch.0 00000100:00100000:0.0:1784189334.885204:0:66172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc070220e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:debedd94-805c-42a0-a5e5-41758b2012e9+65:73517:x1870854436342784:12345-192.168.203.12@tcp:35:touch.0 Request processed in 295us (522us total) trans 120259084318 rc 0/0 00000100:00100000:0.0:1784189334.885213:0:66172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 252 00000100:00100000:0.0:1784189334.896223:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1784189334.900066:0:66170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436343040 00000100:00100000:1.0:1784189334.900083:0:66170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436343040 00000100:00100000:1.0:1784189334.900198:0:66170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1472 00000100:00100000:1.0:1784189334.900209:0:66170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf48599880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:debedd94-805c-42a0-a5e5-41758b2012e9+65:73517:x1870854436343040:12345-192.168.203.12@tcp:101:touch.0 00010000:00010000:1.0:1784189334.900232:0:66170:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784189334.900252:0:66170:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04152ca00/0xcc1762b626f8cd8b lrc: 2/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbfc5de7fe6c41ac expref: -99 pid: 66170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189334.900370:0:66170:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04152da00/0xcc1762b626f8cd92 lrc: 3/0,1 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189334.900386:0:66170:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04152da00/0xcc1762b626f8cd92 lrc: 3/0,1 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189334.900397:0:66170:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04152da00/0xcc1762b626f8cd92 lrc: 3/0,1 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189334.900427:0:66170:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04152c600/0xcc1762b626f8cd99 lrc: 3/0,1 mode: --/PW res: [0x20000cf21:0x4:0x0].0xdeb924a3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189334.900435:0:66170:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04152c600/0xcc1762b626f8cd99 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x4:0x0].0xdeb924a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189334.900442:0:66170:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04152c600/0xcc1762b626f8cd99 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x4:0x0].0xdeb924a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1784189334.900716:0:66170:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x76a:0x0], index 0: 0 00010000:00010000:1.0:1784189334.900852:0:66170:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04152ce00/0xcc1762b626f8cda0 lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189334.900861:0:66170:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04152ce00/0xcc1762b626f8cda0 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189334.900946:0:66170:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04152ce00/0xcc1762b626f8cda0 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189334.900981:0:66170:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04152da00/0xcc1762b626f8cd92 lrc: 4/0,1 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189334.900988:0:66170:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04152da00/0xcc1762b626f8cd92 lrc: 4/0,1 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189334.900994:0:66170:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04152da00/0xcc1762b626f8cd92 lrc: 3/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189334.901001:0:66170:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04152da00/0xcc1762b626f8cd92 lrc: 4/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189334.901007:0:66170:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc04152da00 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:1.0:1784189334.901018:0:66170:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04152da00/0xcc1762b626f8cd92 lrc: 4/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189334.901025:0:66170:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04152da00/0xcc1762b626f8cd92 lrc: 5/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189334.901038:0:66170:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x0 (ffff9dbf45994c00) 00010000:00010000:1.0:1784189334.901042:0:66170:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784189334.901046:0:66170:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04152da00/0xcc1762b626f8cd92 lrc: 3/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189334.901053:0:66170:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04152da00/0xcc1762b626f8cd92 lrc: 0/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1784189334.901066:0:66170:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000002e0376cb reply state 00000000ea735d3f transno 120259084319 ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04152c600/0xcc1762b626f8cd99 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x4:0x0].0xdeb924a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189334.901077:0:66170:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04152c600/0xcc1762b626f8cd99 lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0xdeb924a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189334.901083:0:66170:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0xdeb924a3 (ffff9dc05a487900) 00010000:00010000:1.0:1784189334.901086:0:66170:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1784189334.901088:0:66170:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1784189334.901115:0:66170:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04152ca00/0xcc1762b626f8cd8b lrc: 0/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c41ac expref: 68 pid: 66170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189334.901129:0:66170:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04152ce00/0xcc1762b626f8cda0 lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c41ac expref: 67 pid: 66170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189334.901136:0:66170:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0xe:0x0].0x0 (ffff9dc05a487800) 00010000:00010000:1.0:1784189334.901139:0:66170:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1784189334.901146:0:66170:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc04152ce00, rc 0) 00000100:00100000:1.0:1784189334.901214:0:66170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf48599880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:debedd94-805c-42a0-a5e5-41758b2012e9+68:73517:x1870854436343040:12345-192.168.203.12@tcp:101:touch.0 Request processed in 1006us (4998us total) trans 120259084319 rc 0/0 00000100:00100000:1.0:1784189334.901222:0:66170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1472 00000100:00100000:1.0:1784189334.907485:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1784189334.907550:0:66171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436343296 00000100:00100000:3.0:1784189334.907560:0:66171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436343296 00000100:00100000:3.0:1784189334.907618:0:66171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1473 00000100:00100000:3.0:1784189334.907628:0:66171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf4a32df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:debedd94-805c-42a0-a5e5-41758b2012e9+68:73517:x1870854436343296:12345-192.168.203.12@tcp:36:touch.0 00010000:00010000:3.0:1784189334.907696:0:66171:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784189334.907721:0:66171:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04152ce00/0xcc1762b626f8cda0 lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c41ac expref: 68 pid: 66170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189334.907740:0:66171:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0xe:0x0].0x0 (ffff9dc05a487800) 00010000:00010000:3.0:1784189334.907750:0:66171:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1784189334.907806:0:66171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc058f66000/0xcc1762b626f8cdae lrc: 3/0,1 mode: --/PW res: [0x20000cf21:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189334.907819:0:66171:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc058f66000/0xcc1762b626f8cdae lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0xe:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189334.907828:0:66171:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc058f66000/0xcc1762b626f8cdae lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0xe:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1784189334.907942:0:66171:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000004d7ce49e reply state 00000000463111c6 transno 120259084320 ns: mdt-lustre-MDT0000_UUID lock: ffff9dc058f66000/0xcc1762b626f8cdae lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0xe:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189334.907955:0:66171:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc058f66000/0xcc1762b626f8cdae lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0xe:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189334.907962:0:66171:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0xe:0x0].0x0 (ffff9dbf44851400) 00010000:00010000:3.0:1784189334.907965:0:66171:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1784189334.907978:0:66171:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1784189334.908082:0:66171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf4a32df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:debedd94-805c-42a0-a5e5-41758b2012e9+69:73517:x1870854436343296:12345-192.168.203.12@tcp:36:touch.0 Request processed in 454us (605us total) trans 120259084320 rc 0/0 00000100:00100000:3.0:1784189334.908089:0:66171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1473 00000100:00100000:3.0:1784189334.914623:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1784189334.914900:0:66945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436343424 00000100:00100000:0.0:1784189334.914911:0:66945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436343424 00000100:00100000:0.0:1784189334.914977:0:66945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1474 00000100:00100000:0.0:1784189334.914987:0:66945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc070223b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:debedd94-805c-42a0-a5e5-41758b2012e9+69:73517:x1870854436343424:12345-192.168.203.12@tcp:101:touch.0 00010000:00010000:0.0:1784189334.915011:0:66945:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784189334.915034:0:66945:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc05ec0ee00/0xcc1762b626f8cdb5 lrc: 2/0,0 mode: --/CR res: [0x20000cf21:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbfc5de7fe6c41b3 expref: -99 pid: 66945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189334.915090:0:66945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc05ec0ee00/0xcc1762b626f8cdb5 lrc: 3/0,0 mode: CR/CR res: [0x20000cf21:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c41b3 expref: 70 pid: 66945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189334.915104:0:66945:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc05ec0ee00/0xcc1762b626f8cdb5 lrc: 3/0,0 mode: CR/CR res: [0x20000cf21:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c41b3 expref: 70 pid: 66945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189334.915135:0:66945:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0xe:0x0].0x0 (ffff9dbf44851400) 00010000:00010000:0.0:1784189334.915138:0:66945:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1784189334.915142:0:66945:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc05ec0ee00, rc 0) 00000100:00100000:0.0:1784189334.915200:0:66945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc070223b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:debedd94-805c-42a0-a5e5-41758b2012e9+70:73517:x1870854436343424:12345-192.168.203.12@tcp:101:touch.0 Request processed in 214us (585us total) trans 0 rc 0/0 00000100:00100000:0.0:1784189334.915206:0:66945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1474 00000100:00100000:0.0:1784189334.932096:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1784189334.937904:0:26223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436343552 00000100:00100000:1.0:1784189334.937919:0:26223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436343552 00000100:00100000:2.0:1784189334.944178:0:26223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 5008 00000100:00100000:2.0:1784189334.944191:0:26223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf48598380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:debedd94-805c-42a0-a5e5-41758b2012e9+13:2397:x1870854436343552:12345-192.168.203.12@tcp:2:touch.0 00000100:00100000:2.0:1784189334.944435:0:26223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf48598380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:debedd94-805c-42a0-a5e5-41758b2012e9+14:2397:x1870854436343552:12345-192.168.203.12@tcp:2:touch.0 Request processed in 245us (12347us total) trans 4294968965 rc 0/0 00000100:00100000:2.0:1784189334.944443:0:26223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 5008 00000100:00100000:1.0:1784189334.952408:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1784189334.952500:0:66172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436343808 00000100:00100000:0.0:1784189334.952509:0:66172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436343808 00000100:00100000:0.0:1784189334.952562:0:66172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 253 00000100:00100000:0.0:1784189334.952571:0:66172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf4a32c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:debedd94-805c-42a0-a5e5-41758b2012e9+70:73517:x1870854436343808:12345-192.168.203.12@tcp:35:touch.0 00000100:00100000:0.0:1784189334.952848:0:66172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf4a32c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:debedd94-805c-42a0-a5e5-41758b2012e9+71:73517:x1870854436343808:12345-192.168.203.12@tcp:35:touch.0 Request processed in 276us (448us total) trans 120259084321 rc 0/0 00000100:00100000:0.0:1784189334.952855:0:66172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 253 00000100:00100000:3.0:1784189334.962435:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1784189334.962592:0:66170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436344064 00000100:00100000:1.0:1784189334.962602:0:66170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436344064 00000100:00100000:1.0:1784189334.962668:0:66170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1475 00000100:00100000:1.0:1784189334.962678:0:66170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc070221880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:debedd94-805c-42a0-a5e5-41758b2012e9+71:73517:x1870854436344064:12345-192.168.203.12@tcp:101:touch.0 00010000:00010000:1.0:1784189334.962701:0:66170:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784189334.962719:0:66170:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04152d800/0xcc1762b626f8cdbc lrc: 2/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbfc5de7fe6c41ba expref: -99 pid: 66170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189334.962829:0:66170:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04152da00/0xcc1762b626f8cdc3 lrc: 3/0,1 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189334.962844:0:66170:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04152da00/0xcc1762b626f8cdc3 lrc: 3/0,1 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189334.962855:0:66170:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04152da00/0xcc1762b626f8cdc3 lrc: 3/0,1 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189334.962889:0:66170:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04152ca00/0xcc1762b626f8cdca lrc: 3/0,1 mode: --/PW res: [0x20000cf21:0x4:0x0].0x6e9b5ca3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189334.962897:0:66170:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04152ca00/0xcc1762b626f8cdca lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x4:0x0].0x6e9b5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189334.962922:0:66170:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04152ca00/0xcc1762b626f8cdca lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x4:0x0].0x6e9b5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1784189334.963210:0:66170:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x76b:0x0], index 0: 0 00010000:00010000:1.0:1784189334.963629:0:66170:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04152ce00/0xcc1762b626f8cdd1 lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0xf:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189334.963639:0:66170:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04152ce00/0xcc1762b626f8cdd1 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0xf:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189334.963647:0:66170:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04152ce00/0xcc1762b626f8cdd1 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0xf:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189334.963680:0:66170:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04152da00/0xcc1762b626f8cdc3 lrc: 4/0,1 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189334.963687:0:66170:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04152da00/0xcc1762b626f8cdc3 lrc: 4/0,1 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189334.963692:0:66170:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04152da00/0xcc1762b626f8cdc3 lrc: 3/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189334.963699:0:66170:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04152da00/0xcc1762b626f8cdc3 lrc: 4/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189334.963705:0:66170:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc04152da00 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:1.0:1784189334.963708:0:66170:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04152da00/0xcc1762b626f8cdc3 lrc: 4/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189334.963715:0:66170:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04152da00/0xcc1762b626f8cdc3 lrc: 5/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189334.963739:0:66170:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x0 (ffff9dbf45994c00) 00010000:00010000:1.0:1784189334.963742:0:66170:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784189334.963746:0:66170:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04152da00/0xcc1762b626f8cdc3 lrc: 3/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189334.963753:0:66170:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04152da00/0xcc1762b626f8cdc3 lrc: 0/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1784189334.963766:0:66170:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000046748ebd reply state 00000000428baac0 transno 120259084322 ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04152ca00/0xcc1762b626f8cdca lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x4:0x0].0x6e9b5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189334.965049:0:66170:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04152ca00/0xcc1762b626f8cdca lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x6e9b5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189334.965060:0:66170:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x6e9b5ca3 (ffff9dc05a487d00) 00010000:00010000:1.0:1784189334.965062:0:66170:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1784189334.965066:0:66170:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1784189334.965122:0:66170:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04152d800/0xcc1762b626f8cdbc lrc: 0/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c41ba expref: 74 pid: 66170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189334.965143:0:66170:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04152ce00/0xcc1762b626f8cdd1 lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0xf:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c41ba expref: 73 pid: 66170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189334.965150:0:66170:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0xf:0x0].0x0 (ffff9dc05a487800) 00010000:00010000:1.0:1784189334.965152:0:66170:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1784189334.965154:0:66170:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc04152ce00, rc 0) 00000100:00100000:1.0:1784189334.966985:0:66170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc070221880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:debedd94-805c-42a0-a5e5-41758b2012e9+74:73517:x1870854436344064:12345-192.168.203.12@tcp:101:touch.0 Request processed in 4299us (4550us total) trans 120259084322 rc 0/0 00000100:00100000:1.0:1784189334.966998:0:66170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1475 00000100:00100000:0.0:1784189334.983084:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1784189334.985963:0:66171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436344320 00000100:00100000:1.0:1784189334.985977:0:66171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436344320 00000100:00100000:1.0:1784189334.986084:0:66171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1476 00000100:00100000:1.0:1784189334.986094:0:66171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf48598e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:debedd94-805c-42a0-a5e5-41758b2012e9+74:73517:x1870854436344320:12345-192.168.203.12@tcp:36:touch.0 00010000:00010000:1.0:1784189334.986168:0:66171:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784189334.986196:0:66171:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04152ce00/0xcc1762b626f8cdd1 lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0xf:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c41ba expref: 74 pid: 66170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189334.986214:0:66171:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0xf:0x0].0x0 (ffff9dc05a487800) 00010000:00010000:1.0:1784189334.986225:0:66171:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1784189334.986285:0:66171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04152d800/0xcc1762b626f8cddf lrc: 3/0,1 mode: --/PW res: [0x20000cf21:0xf:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189334.986298:0:66171:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04152d800/0xcc1762b626f8cddf lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0xf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189334.986307:0:66171:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04152d800/0xcc1762b626f8cddf lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0xf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1784189334.986430:0:66171:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000000f64a8d8 reply state 0000000050685819 transno 120259084323 ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04152d800/0xcc1762b626f8cddf lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0xf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189334.986442:0:66171:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04152d800/0xcc1762b626f8cddf lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0xf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189334.986448:0:66171:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0xf:0x0].0x0 (ffff9dc05a487f00) 00010000:00010000:1.0:1784189334.986451:0:66171:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1784189334.986453:0:66171:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1784189334.986546:0:66171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf48598e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:debedd94-805c-42a0-a5e5-41758b2012e9+75:73517:x1870854436344320:12345-192.168.203.12@tcp:36:touch.0 Request processed in 453us (3469us total) trans 120259084323 rc 0/0 00000100:00100000:1.0:1784189334.986565:0:66171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1476 00000100:00100000:2.0:1784189334.989256:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1784189334.997010:0:66945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436344448 00000100:00100000:0.0:1784189334.997025:0:66945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436344448 00000100:00100000:0.0:1784189334.997094:0:66945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1477 00000100:00100000:0.0:1784189334.997104:0:66945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf4a342680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:debedd94-805c-42a0-a5e5-41758b2012e9+75:73517:x1870854436344448:12345-192.168.203.12@tcp:101:touch.0 00010000:00010000:0.0:1784189334.997128:0:66945:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784189334.997148:0:66945:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc05ec0f400/0xcc1762b626f8cde6 lrc: 2/0,0 mode: --/CR res: [0x20000cf21:0xf:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbfc5de7fe6c41c1 expref: -99 pid: 66945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189334.997201:0:66945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc05ec0f400/0xcc1762b626f8cde6 lrc: 3/0,0 mode: CR/CR res: [0x20000cf21:0xf:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c41c1 expref: 76 pid: 66945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189334.997235:0:66945:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc05ec0f400/0xcc1762b626f8cde6 lrc: 3/0,0 mode: CR/CR res: [0x20000cf21:0xf:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c41c1 expref: 76 pid: 66945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189334.997254:0:66945:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0xf:0x0].0x0 (ffff9dc05a487f00) 00010000:00010000:0.0:1784189334.997257:0:66945:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1784189334.997261:0:66945:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc05ec0f400, rc 0) 00000100:00100000:0.0:1784189334.997335:0:66945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf4a342680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:debedd94-805c-42a0-a5e5-41758b2012e9+76:73517:x1870854436344448:12345-192.168.203.12@tcp:101:touch.0 Request processed in 216us (8071us total) trans 0 rc 0/0 00000100:00100000:0.0:1784189334.997343:0:66945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1477 00000100:00100000:1.0:1784189335.000563:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1784189335.000645:0:26169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436344576 00000100:00100000:3.0:1784189335.000665:0:26169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436344576 00000100:00100000:3.0:1784189335.000763:0:26169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 5009 00000100:00100000:3.0:1784189335.000782:0:26169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf4a32ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:debedd94-805c-42a0-a5e5-41758b2012e9+14:2396:x1870854436344576:12345-192.168.203.12@tcp:2:touch.0 00000100:00100000:3.0:1784189335.000982:0:26169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf4a32ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:debedd94-805c-42a0-a5e5-41758b2012e9+15:2396:x1870854436344576:12345-192.168.203.12@tcp:2:touch.0 Request processed in 209us (426us total) trans 4294968966 rc 0/0 00000100:00100000:3.0:1784189335.000990:0:26169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 5009 00000100:00080000:1.0:1784189335.006914:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1784189335.024404:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1784189335.024499:0:66172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436344832 00000100:00100000:2.0:1784189335.024509:0:66172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436344832 00000100:00100000:2.0:1784189335.024570:0:66172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 254 00000100:00100000:2.0:1784189335.024580:0:66172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf48599500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:debedd94-805c-42a0-a5e5-41758b2012e9+76:73517:x1870854436344832:12345-192.168.203.12@tcp:35:touch.0 00000100:00100000:2.0:1784189335.024853:0:66172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf48599500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:debedd94-805c-42a0-a5e5-41758b2012e9+77:73517:x1870854436344832:12345-192.168.203.12@tcp:35:touch.0 Request processed in 274us (458us total) trans 120259084324 rc 0/0 00000100:00100000:2.0:1784189335.024862:0:66172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 254 00000100:00080000:1.0:1784189335.026916:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1784189335.032080:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1784189335.032906:0:66170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436345088 00000100:00100000:1.0:1784189335.032917:0:66170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436345088 00000100:00100000:1.0:1784189335.032983:0:66170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1478 00000100:00100000:1.0:1784189335.032993:0:66170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf4a342d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:debedd94-805c-42a0-a5e5-41758b2012e9+77:73517:x1870854436345088:12345-192.168.203.12@tcp:101:touch.0 00010000:00010000:1.0:1784189335.033017:0:66170:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784189335.033038:0:66170:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04152ce00/0xcc1762b626f8cded lrc: 2/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbfc5de7fe6c41c8 expref: -99 pid: 66170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189335.033134:0:66170:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04152da00/0xcc1762b626f8cdf4 lrc: 3/0,1 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189335.033148:0:66170:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04152da00/0xcc1762b626f8cdf4 lrc: 3/0,1 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189335.033160:0:66170:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04152da00/0xcc1762b626f8cdf4 lrc: 3/0,1 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189335.033174:0:66170:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04152c200/0xcc1762b626f8cdfb lrc: 3/0,1 mode: --/PW res: [0x20000cf21:0x4:0x0].0xc8545ca3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189335.033181:0:66170:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04152c200/0xcc1762b626f8cdfb lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x4:0x0].0xc8545ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189335.033188:0:66170:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04152c200/0xcc1762b626f8cdfb lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x4:0x0].0xc8545ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1784189335.033498:0:66170:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x76c:0x0], index 0: 0 00010000:00010000:1.0:1784189335.033622:0:66170:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04152d200/0xcc1762b626f8ce02 lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189335.033631:0:66170:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04152d200/0xcc1762b626f8ce02 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189335.033640:0:66170:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04152d200/0xcc1762b626f8ce02 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189335.033667:0:66170:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04152da00/0xcc1762b626f8cdf4 lrc: 4/0,1 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189335.033675:0:66170:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04152da00/0xcc1762b626f8cdf4 lrc: 4/0,1 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189335.033681:0:66170:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04152da00/0xcc1762b626f8cdf4 lrc: 3/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189335.033688:0:66170:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04152da00/0xcc1762b626f8cdf4 lrc: 4/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189335.033695:0:66170:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc04152da00 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:1.0:1784189335.033699:0:66170:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04152da00/0xcc1762b626f8cdf4 lrc: 4/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189335.033707:0:66170:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04152da00/0xcc1762b626f8cdf4 lrc: 5/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189335.033717:0:66170:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x0 (ffff9dbf45994c00) 00010000:00010000:1.0:1784189335.033720:0:66170:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784189335.033730:0:66170:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04152da00/0xcc1762b626f8cdf4 lrc: 3/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189335.033737:0:66170:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04152da00/0xcc1762b626f8cdf4 lrc: 0/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1784189335.033750:0:66170:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000c85ac962 reply state 00000000d0b4901c transno 120259084325 ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04152c200/0xcc1762b626f8cdfb lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x4:0x0].0xc8545ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189335.033762:0:66170:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04152c200/0xcc1762b626f8cdfb lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0xc8545ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189335.033768:0:66170:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0xc8545ca3 (ffff9dc05a487800) 00010000:00010000:1.0:1784189335.033771:0:66170:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1784189335.033773:0:66170:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1784189335.033812:0:66170:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04152ce00/0xcc1762b626f8cded lrc: 0/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c41c8 expref: 80 pid: 66170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189335.033827:0:66170:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04152d200/0xcc1762b626f8ce02 lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c41c8 expref: 79 pid: 66170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189335.033835:0:66170:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x10:0x0].0x0 (ffff9dc05a487000) 00010000:00010000:1.0:1784189335.033838:0:66170:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1784189335.033840:0:66170:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc04152d200, rc 0) 00000100:00100000:1.0:1784189335.033905:0:66170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf4a342d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:debedd94-805c-42a0-a5e5-41758b2012e9+80:73517:x1870854436345088:12345-192.168.203.12@tcp:101:touch.0 Request processed in 913us (1836us total) trans 120259084325 rc 0/0 00000100:00100000:1.0:1784189335.033913:0:66170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1478 00000100:00100000:0.0:1784189335.039082:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1784189335.039198:0:66169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436345344 00000100:00100000:1.0:1784189335.039208:0:66169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436345344 00000100:00100000:1.0:1784189335.039269:0:66169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1479 00000100:00100000:1.0:1784189335.039278:0:66169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf4859aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:debedd94-805c-42a0-a5e5-41758b2012e9+80:73517:x1870854436345344:12345-192.168.203.12@tcp:36:touch.0 00010000:00010000:1.0:1784189335.039361:0:66169:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784189335.039388:0:66169:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04152d200/0xcc1762b626f8ce02 lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c41c8 expref: 80 pid: 66170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189335.039408:0:66169:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x10:0x0].0x0 (ffff9dc05a487000) 00010000:00010000:1.0:1784189335.039417:0:66169:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1784189335.039466:0:66169:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04152d600/0xcc1762b626f8ce10 lrc: 3/0,1 mode: --/PW res: [0x20000cf21:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189335.039478:0:66169:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04152d600/0xcc1762b626f8ce10 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189335.039487:0:66169:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04152d600/0xcc1762b626f8ce10 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1784189335.039589:0:66169:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000f003edec reply state 0000000094de4813 transno 120259084326 ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04152d600/0xcc1762b626f8ce10 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189335.039601:0:66169:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04152d600/0xcc1762b626f8ce10 lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189335.039608:0:66169:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x10:0x0].0x0 (ffff9dc05a487b00) 00010000:00010000:1.0:1784189335.039610:0:66169:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1784189335.039613:0:66169:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1784189335.039693:0:66169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf4859aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:debedd94-805c-42a0-a5e5-41758b2012e9+81:73517:x1870854436345344:12345-192.168.203.12@tcp:36:touch.0 Request processed in 415us (622us total) trans 120259084326 rc 0/0 00000100:00100000:1.0:1784189335.039700:0:66169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1479 00000100:00100000:2.0:1784189335.042954:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1784189335.043128:0:68287:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436345472 00000100:00100000:0.0:1784189335.043138:0:68287:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436345472 00000100:00100000:0.0:1784189335.043205:0:68287:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1480 00000100:00100000:0.0:1784189335.043216:0:68287:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf4a343b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:debedd94-805c-42a0-a5e5-41758b2012e9+81:73517:x1870854436345472:12345-192.168.203.12@tcp:101:touch.0 00010000:00010000:0.0:1784189335.043241:0:68287:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784189335.043263:0:68287:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc05ec0fa00/0xcc1762b626f8ce17 lrc: 2/0,0 mode: --/CR res: [0x20000cf21:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbfc5de7fe6c41cf expref: -99 pid: 68287 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189335.043344:0:68287:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc05ec0fa00/0xcc1762b626f8ce17 lrc: 3/0,0 mode: CR/CR res: [0x20000cf21:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c41cf expref: 82 pid: 68287 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189335.043359:0:68287:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc05ec0fa00/0xcc1762b626f8ce17 lrc: 3/0,0 mode: CR/CR res: [0x20000cf21:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c41cf expref: 82 pid: 68287 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189335.043376:0:68287:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x10:0x0].0x0 (ffff9dc05a487b00) 00010000:00010000:0.0:1784189335.043391:0:68287:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1784189335.043395:0:68287:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc05ec0fa00, rc 0) 00000100:00100000:0.0:1784189335.043452:0:68287:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf4a343b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:debedd94-805c-42a0-a5e5-41758b2012e9+82:73517:x1870854436345472:12345-192.168.203.12@tcp:101:touch.0 Request processed in 238us (507us total) trans 0 rc 0/0 00000100:00100000:0.0:1784189335.043459:0:68287:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1480 00000100:00100000:3.0:1784189335.047476:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1784189335.047904:0:26166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436345600 00000100:00100000:0.0:1784189335.047914:0:26166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436345600 00000100:00100000:0.0:1784189335.047972:0:26166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 5010 00000100:00100000:0.0:1784189335.047982:0:26166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc070221c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:debedd94-805c-42a0-a5e5-41758b2012e9+15:2397:x1870854436345600:12345-192.168.203.12@tcp:2:touch.0 00000100:00100000:0.0:1784189335.048182:0:26166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc070221c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:debedd94-805c-42a0-a5e5-41758b2012e9+16:2397:x1870854436345600:12345-192.168.203.12@tcp:2:touch.0 Request processed in 200us (713us total) trans 4294968967 rc 0/0 00000100:00100000:0.0:1784189335.048190:0:26166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 5010 00000100:00100000:2.0:1784189335.053829:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1784189335.053981:0:66172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436345856 00000100:00100000:0.0:1784189335.053990:0:66172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436345856 00000100:00100000:0.0:1784189335.054043:0:66172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 255 00000100:00100000:0.0:1784189335.054052:0:66172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc080f68380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:debedd94-805c-42a0-a5e5-41758b2012e9+82:73517:x1870854436345856:12345-192.168.203.12@tcp:35:touch.0 00000100:00100000:0.0:1784189335.054300:0:66172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc080f68380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:debedd94-805c-42a0-a5e5-41758b2012e9+83:73517:x1870854436345856:12345-192.168.203.12@tcp:35:touch.0 Request processed in 248us (479us total) trans 120259084327 rc 0/0 00000100:00100000:0.0:1784189335.054308:0:66172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 255 00000100:00100000:2.0:1784189335.060848:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1784189335.060962:0:66945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436346112 00000100:00100000:0.0:1784189335.060971:0:66945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436346112 00000100:00100000:0.0:1784189335.061072:0:66945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1481 00000100:00100000:0.0:1784189335.061083:0:66945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc080f6b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:debedd94-805c-42a0-a5e5-41758b2012e9+83:73517:x1870854436346112:12345-192.168.203.12@tcp:101:touch.0 00010000:00010000:0.0:1784189335.061105:0:66945:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784189335.061123:0:66945:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc05ec0e400/0xcc1762b626f8ce1e lrc: 2/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbfc5de7fe6c41d6 expref: -99 pid: 66945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189335.061236:0:66945:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc05ec0f200/0xcc1762b626f8ce25 lrc: 3/0,1 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189335.061250:0:66945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc05ec0f200/0xcc1762b626f8ce25 lrc: 3/0,1 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189335.061262:0:66945:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc05ec0f200/0xcc1762b626f8ce25 lrc: 3/0,1 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189335.061276:0:66945:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc05ec0f000/0xcc1762b626f8ce2c lrc: 3/0,1 mode: --/PW res: [0x20000cf21:0x4:0x0].0x220d5ca3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189335.061284:0:66945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc05ec0f000/0xcc1762b626f8ce2c lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x4:0x0].0x220d5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189335.061291:0:66945:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc05ec0f000/0xcc1762b626f8ce2c lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x4:0x0].0x220d5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1784189335.061653:0:66945:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x76d:0x0], index 0: 0 00010000:00010000:0.0:1784189335.061768:0:66945:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc081b17e00/0xcc1762b626f8ce33 lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0x11:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189335.061777:0:66945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc081b17e00/0xcc1762b626f8ce33 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189335.061785:0:66945:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc081b17e00/0xcc1762b626f8ce33 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189335.061816:0:66945:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc05ec0f200/0xcc1762b626f8ce25 lrc: 4/0,1 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189335.061833:0:66945:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc05ec0f200/0xcc1762b626f8ce25 lrc: 4/0,1 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189335.061840:0:66945:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc05ec0f200/0xcc1762b626f8ce25 lrc: 3/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189335.061846:0:66945:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dc05ec0f200/0xcc1762b626f8ce25 lrc: 4/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189335.061852:0:66945:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc05ec0f200 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:0.0:1784189335.061856:0:66945:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc05ec0f200/0xcc1762b626f8ce25 lrc: 4/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189335.061863:0:66945:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc05ec0f200/0xcc1762b626f8ce25 lrc: 5/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189335.061874:0:66945:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x0 (ffff9dbf45994c00) 00010000:00010000:0.0:1784189335.061884:0:66945:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784189335.061889:0:66945:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dc05ec0f200/0xcc1762b626f8ce25 lrc: 3/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189335.061895:0:66945:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc05ec0f200/0xcc1762b626f8ce25 lrc: 0/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1784189335.061908:0:66945:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000ae3964e9 reply state 000000009120d0c4 transno 120259084328 ns: mdt-lustre-MDT0000_UUID lock: ffff9dc05ec0f000/0xcc1762b626f8ce2c lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x4:0x0].0x220d5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189335.061918:0:66945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc05ec0f000/0xcc1762b626f8ce2c lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x220d5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189335.061924:0:66945:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x220d5ca3 (ffff9dc07fab4600) 00010000:00010000:0.0:1784189335.061934:0:66945:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1784189335.061937:0:66945:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1784189335.061966:0:66945:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc05ec0e400/0xcc1762b626f8ce1e lrc: 0/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c41d6 expref: 86 pid: 66945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189335.061980:0:66945:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc081b17e00/0xcc1762b626f8ce33 lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c41d6 expref: 85 pid: 66945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189335.061988:0:66945:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x11:0x0].0x0 (ffff9dc07fab4c00) 00010000:00010000:0.0:1784189335.061990:0:66945:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1784189335.061992:0:66945:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc081b17e00, rc 0) 00000100:00100000:0.0:1784189335.062054:0:66945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc080f6b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:debedd94-805c-42a0-a5e5-41758b2012e9+86:73517:x1870854436346112:12345-192.168.203.12@tcp:101:touch.0 Request processed in 972us (1213us total) trans 120259084328 rc 0/0 00000100:00100000:0.0:1784189335.062063:0:66945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1481 00000100:00100000:2.0:1784189335.069673:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1784189335.069822:0:66169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436346368 00000100:00100000:1.0:1784189335.069831:0:66169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436346368 00000100:00100000:1.0:1784189335.069904:0:66169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1482 00000100:00100000:1.0:1784189335.069927:0:66169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc05ed90000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:debedd94-805c-42a0-a5e5-41758b2012e9+86:73517:x1870854436346368:12345-192.168.203.12@tcp:36:touch.0 00010000:00010000:1.0:1784189335.070152:0:66169:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784189335.070178:0:66169:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc081b17e00/0xcc1762b626f8ce33 lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c41d6 expref: 86 pid: 66945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189335.070195:0:66169:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x11:0x0].0x0 (ffff9dc07fab4c00) 00010000:00010000:1.0:1784189335.070205:0:66169:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1784189335.070260:0:66169:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04152d200/0xcc1762b626f8ce41 lrc: 3/0,1 mode: --/PW res: [0x20000cf21:0x11:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189335.070274:0:66169:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04152d200/0xcc1762b626f8ce41 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x11:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189335.070284:0:66169:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04152d200/0xcc1762b626f8ce41 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x11:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1784189335.070398:0:66169:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000019fa6c3 reply state 00000000cb911e4b transno 120259084329 ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04152d200/0xcc1762b626f8ce41 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x11:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189335.070410:0:66169:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04152d200/0xcc1762b626f8ce41 lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x11:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189335.070417:0:66169:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x11:0x0].0x0 (ffff9dc05a487000) 00010000:00010000:1.0:1784189335.070419:0:66169:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1784189335.070422:0:66169:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1784189335.070569:0:66169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc05ed90000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:debedd94-805c-42a0-a5e5-41758b2012e9+87:73517:x1870854436346368:12345-192.168.203.12@tcp:36:touch.0 Request processed in 643us (903us total) trans 120259084329 rc 0/0 00000100:00100000:1.0:1784189335.070576:0:66169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1482 00000100:00100000:2.0:1784189335.074857:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1784189335.074948:0:66170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436346496 00000100:00100000:1.0:1784189335.074956:0:66170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436346496 00000100:00100000:1.0:1784189335.075036:0:66170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1483 00000100:00100000:1.0:1784189335.075046:0:66170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc05ed92a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:debedd94-805c-42a0-a5e5-41758b2012e9+87:73517:x1870854436346496:12345-192.168.203.12@tcp:101:touch.0 00010000:00010000:1.0:1784189335.075070:0:66170:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784189335.075089:0:66170:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04152ce00/0xcc1762b626f8ce48 lrc: 2/0,0 mode: --/CR res: [0x20000cf21:0x11:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbfc5de7fe6c41dd expref: -99 pid: 66170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189335.075140:0:66170:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04152ce00/0xcc1762b626f8ce48 lrc: 3/0,0 mode: CR/CR res: [0x20000cf21:0x11:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c41dd expref: 88 pid: 66170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189335.075155:0:66170:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04152ce00/0xcc1762b626f8ce48 lrc: 3/0,0 mode: CR/CR res: [0x20000cf21:0x11:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c41dd expref: 88 pid: 66170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189335.075173:0:66170:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x11:0x0].0x0 (ffff9dc05a487000) 00010000:00010000:1.0:1784189335.075176:0:66170:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1784189335.075179:0:66170:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc04152ce00, rc 0) 00000100:00100000:1.0:1784189335.075238:0:66170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc05ed92a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:debedd94-805c-42a0-a5e5-41758b2012e9+88:73517:x1870854436346496:12345-192.168.203.12@tcp:101:touch.0 Request processed in 194us (390us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189335.075246:0:66170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1483 00000100:00100000:2.0:1784189335.085771:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1784189335.088108:0:26171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436346624 00000100:00100000:3.0:1784189335.088121:0:26171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436346624 00000100:00100000:2.0:1784189335.092095:0:26171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 5011 00000100:00100000:2.0:1784189335.092119:0:26171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc07ab9b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:debedd94-805c-42a0-a5e5-41758b2012e9+16:2397:x1870854436346624:12345-192.168.203.12@tcp:2:touch.0 00000100:00100000:2.0:1784189335.092348:0:26171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc07ab9b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:debedd94-805c-42a0-a5e5-41758b2012e9+17:2397:x1870854436346624:12345-192.168.203.12@tcp:2:touch.0 Request processed in 239us (6587us total) trans 4294968968 rc 0/0 00000100:00100000:2.0:1784189335.092357:0:26171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 5011 00000100:00100000:2.0:1784189335.099955:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1784189335.102959:0:66172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436346880 00000100:00100000:0.0:1784189335.102973:0:66172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436346880 00000100:00100000:0.0:1784189335.103040:0:66172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 256 00000100:00100000:0.0:1784189335.103050:0:66172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc07ab99180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:debedd94-805c-42a0-a5e5-41758b2012e9+88:73517:x1870854436346880:12345-192.168.203.12@tcp:35:touch.0 00000100:00100000:0.0:1784189335.103376:0:66172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc07ab99180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:debedd94-805c-42a0-a5e5-41758b2012e9+89:73517:x1870854436346880:12345-192.168.203.12@tcp:35:touch.0 Request processed in 326us (3428us total) trans 120259084330 rc 0/0 00000100:00100000:0.0:1784189335.103384:0:66172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 256 00000100:00100000:0.0:1784189335.110516:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1784189335.110611:0:66945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436347136 00000100:00100000:1.0:1784189335.110621:0:66945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436347136 00000100:00100000:1.0:1784189335.110687:0:66945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1484 00000100:00100000:1.0:1784189335.110696:0:66945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf4859b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:debedd94-805c-42a0-a5e5-41758b2012e9+89:73517:x1870854436347136:12345-192.168.203.12@tcp:101:touch.0 00010000:00010000:1.0:1784189335.110718:0:66945:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784189335.110736:0:66945:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04152da00/0xcc1762b626f8ce4f lrc: 2/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbfc5de7fe6c41e4 expref: -99 pid: 66945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189335.110836:0:66945:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc042d67a00/0xcc1762b626f8ce56 lrc: 3/0,1 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189335.110865:0:66945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc042d67a00/0xcc1762b626f8ce56 lrc: 3/0,1 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189335.110892:0:66945:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc042d67a00/0xcc1762b626f8ce56 lrc: 3/0,1 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189335.110910:0:66945:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc07116e400/0xcc1762b626f8ce5d lrc: 3/0,1 mode: --/PW res: [0x20000cf21:0x4:0x0].0x7bc65ca3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189335.110918:0:66945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc07116e400/0xcc1762b626f8ce5d lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x4:0x0].0x7bc65ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189335.110925:0:66945:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc07116e400/0xcc1762b626f8ce5d lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x4:0x0].0x7bc65ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1784189335.111199:0:66945:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x76e:0x0], index 0: 0 00010000:00010000:1.0:1784189335.111360:0:66945:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc07116e600/0xcc1762b626f8ce64 lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0x12:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189335.111369:0:66945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc07116e600/0xcc1762b626f8ce64 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x12:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189335.111377:0:66945:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc07116e600/0xcc1762b626f8ce64 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x12:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189335.111407:0:66945:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc042d67a00/0xcc1762b626f8ce56 lrc: 4/0,1 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189335.111414:0:66945:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc042d67a00/0xcc1762b626f8ce56 lrc: 4/0,1 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189335.111421:0:66945:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc042d67a00/0xcc1762b626f8ce56 lrc: 3/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189335.111436:0:66945:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dc042d67a00/0xcc1762b626f8ce56 lrc: 4/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189335.111442:0:66945:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc042d67a00 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:1.0:1784189335.111446:0:66945:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc042d67a00/0xcc1762b626f8ce56 lrc: 4/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189335.111454:0:66945:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc042d67a00/0xcc1762b626f8ce56 lrc: 5/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189335.111465:0:66945:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x0 (ffff9dbf45994c00) 00010000:00010000:1.0:1784189335.111468:0:66945:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784189335.111472:0:66945:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dc042d67a00/0xcc1762b626f8ce56 lrc: 3/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189335.111478:0:66945:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc042d67a00/0xcc1762b626f8ce56 lrc: 0/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1784189335.111491:0:66945:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000ae3695b0 reply state 00000000452fa417 transno 120259084331 ns: mdt-lustre-MDT0000_UUID lock: ffff9dc07116e400/0xcc1762b626f8ce5d lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x4:0x0].0x7bc65ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189335.111502:0:66945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc07116e400/0xcc1762b626f8ce5d lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x7bc65ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189335.111508:0:66945:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x7bc65ca3 (ffff9dc07499b700) 00010000:00010000:1.0:1784189335.111511:0:66945:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1784189335.111513:0:66945:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1784189335.111543:0:66945:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04152da00/0xcc1762b626f8ce4f lrc: 0/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c41e4 expref: 92 pid: 66945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189335.111558:0:66945:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc07116e600/0xcc1762b626f8ce64 lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x12:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c41e4 expref: 91 pid: 66945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189335.111572:0:66945:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x12:0x0].0x0 (ffff9dc07499bd00) 00010000:00010000:1.0:1784189335.111574:0:66945:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1784189335.111577:0:66945:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc07116e600, rc 0) 00000100:00100000:1.0:1784189335.111641:0:66945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf4859b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:debedd94-805c-42a0-a5e5-41758b2012e9+92:73517:x1870854436347136:12345-192.168.203.12@tcp:101:touch.0 Request processed in 945us (1134us total) trans 120259084331 rc 0/0 00000100:00100000:1.0:1784189335.111649:0:66945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1484 00000100:00100000:2.0:1784189335.117051:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1784189335.117146:0:68287:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436347392 00000100:00100000:0.0:1784189335.117155:0:68287:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436347392 00000100:00100000:0.0:1784189335.117210:0:68287:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1485 00000100:00100000:0.0:1784189335.117218:0:68287:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc07ab98700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:debedd94-805c-42a0-a5e5-41758b2012e9+92:73517:x1870854436347392:12345-192.168.203.12@tcp:36:touch.0 00010000:00010000:0.0:1784189335.117292:0:68287:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784189335.117358:0:68287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc07116e600/0xcc1762b626f8ce64 lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0x12:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c41e4 expref: 92 pid: 66945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189335.117377:0:68287:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x12:0x0].0x0 (ffff9dc07499bd00) 00010000:00010000:0.0:1784189335.117387:0:68287:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1784189335.117439:0:68287:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc081b17a00/0xcc1762b626f8ce72 lrc: 3/0,1 mode: --/PW res: [0x20000cf21:0x12:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189335.117451:0:68287:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc081b17a00/0xcc1762b626f8ce72 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x12:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189335.117461:0:68287:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc081b17a00/0xcc1762b626f8ce72 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x12:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1784189335.117556:0:68287:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000008f0e8fae reply state 00000000eebb4a23 transno 120259084332 ns: mdt-lustre-MDT0000_UUID lock: ffff9dc081b17a00/0xcc1762b626f8ce72 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x12:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189335.117568:0:68287:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc081b17a00/0xcc1762b626f8ce72 lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x12:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189335.117574:0:68287:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x12:0x0].0x0 (ffff9dc07fab4400) 00010000:00010000:0.0:1784189335.117577:0:68287:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1784189335.117579:0:68287:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1784189335.117659:0:68287:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc07ab98700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:debedd94-805c-42a0-a5e5-41758b2012e9+93:73517:x1870854436347392:12345-192.168.203.12@tcp:36:touch.0 Request processed in 439us (615us total) trans 120259084332 rc 0/0 00000100:00100000:0.0:1784189335.117666:0:68287:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1485 00000100:00100000:3.0:1784189335.120137:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1784189335.120394:0:66171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436347520 00000100:00100000:1.0:1784189335.120402:0:66171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436347520 00000100:00100000:1.0:1784189335.120455:0:66171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1486 00000100:00100000:1.0:1784189335.120465:0:66171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc070223480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:debedd94-805c-42a0-a5e5-41758b2012e9+93:73517:x1870854436347520:12345-192.168.203.12@tcp:101:touch.0 00010000:00010000:1.0:1784189335.120486:0:66171:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784189335.120504:0:66171:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc07116fc00/0xcc1762b626f8ce79 lrc: 2/0,0 mode: --/CR res: [0x20000cf21:0x12:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbfc5de7fe6c41eb expref: -99 pid: 66171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189335.120556:0:66171:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc07116fc00/0xcc1762b626f8ce79 lrc: 3/0,0 mode: CR/CR res: [0x20000cf21:0x12:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c41eb expref: 94 pid: 66171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189335.120571:0:66171:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc07116fc00/0xcc1762b626f8ce79 lrc: 3/0,0 mode: CR/CR res: [0x20000cf21:0x12:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c41eb expref: 94 pid: 66171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189335.120591:0:66171:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x12:0x0].0x0 (ffff9dc07fab4400) 00010000:00010000:1.0:1784189335.120594:0:66171:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1784189335.120597:0:66171:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc07116fc00, rc 0) 00000100:00100000:1.0:1784189335.120641:0:66171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc070223480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:debedd94-805c-42a0-a5e5-41758b2012e9+94:73517:x1870854436347520:12345-192.168.203.12@tcp:101:touch.0 Request processed in 178us (513us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189335.120662:0:66171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1486 00000100:00100000:2.0:1784189335.123484:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1784189335.123570:0:26162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436347648 00000100:00100000:1.0:1784189335.123579:0:26162:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436347648 00000100:00100000:1.0:1784189335.123634:0:26162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 5012 00000100:00100000:1.0:1784189335.123644:0:26162:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc07ab9b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:debedd94-805c-42a0-a5e5-41758b2012e9+17:2397:x1870854436347648:12345-192.168.203.12@tcp:2:touch.0 00000100:00100000:1.0:1784189335.123841:0:26162:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc07ab9b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:debedd94-805c-42a0-a5e5-41758b2012e9+18:2397:x1870854436347648:12345-192.168.203.12@tcp:2:touch.0 Request processed in 198us (364us total) trans 4294968969 rc 0/0 00000100:00100000:1.0:1784189335.123849:0:26162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 5012 00000100:00100000:2.0:1784189335.131504:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1784189335.131616:0:66173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436347904 00000100:00100000:3.0:1784189335.131625:0:66173:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436347904 00000100:00100000:3.0:1784189335.131681:0:66173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 257 00000100:00100000:3.0:1784189335.131691:0:66173:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf44d08850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:debedd94-805c-42a0-a5e5-41758b2012e9+94:73517:x1870854436347904:12345-192.168.203.12@tcp:35:touch.0 00000100:00100000:3.0:1784189335.132451:0:66173:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf44d08850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:debedd94-805c-42a0-a5e5-41758b2012e9+95:73517:x1870854436347904:12345-192.168.203.12@tcp:35:touch.0 Request processed in 758us (952us total) trans 120259084333 rc 0/0 00000100:00100000:3.0:1784189335.132461:0:66173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 257 00000100:00100000:3.0:1784189335.135975:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1784189335.138976:0:66169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436348160 00000100:00100000:2.0:1784189335.138991:0:66169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436348160 00000100:00100000:2.0:1784189335.139071:0:66169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1487 00000100:00100000:2.0:1784189335.139081:0:66169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc070220e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:debedd94-805c-42a0-a5e5-41758b2012e9+95:73517:x1870854436348160:12345-192.168.203.12@tcp:101:touch.0 00010000:00010000:2.0:1784189335.139104:0:66169:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784189335.139124:0:66169:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4710ee00/0xcc1762b626f8ce80 lrc: 2/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbfc5de7fe6c41f2 expref: -99 pid: 66169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189335.139234:0:66169:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4710e600/0xcc1762b626f8ce87 lrc: 3/0,1 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189335.139250:0:66169:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4710e600/0xcc1762b626f8ce87 lrc: 3/0,1 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189335.139264:0:66169:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4710e600/0xcc1762b626f8ce87 lrc: 3/0,1 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189335.139279:0:66169:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4710e400/0xcc1762b626f8ce8e lrc: 3/0,1 mode: --/PW res: [0x20000cf21:0x4:0x0].0xd57f5ca3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189335.139306:0:66169:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4710e400/0xcc1762b626f8ce8e lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x4:0x0].0xd57f5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189335.139313:0:66169:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4710e400/0xcc1762b626f8ce8e lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x4:0x0].0xd57f5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1784189335.139646:0:66169:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x76f:0x0], index 0: 0 00010000:00010000:2.0:1784189335.139765:0:66169:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4710f600/0xcc1762b626f8ce95 lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0x13:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189335.139775:0:66169:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4710f600/0xcc1762b626f8ce95 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x13:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189335.139783:0:66169:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4710f600/0xcc1762b626f8ce95 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x13:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189335.139814:0:66169:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4710e600/0xcc1762b626f8ce87 lrc: 4/0,1 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189335.139821:0:66169:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4710e600/0xcc1762b626f8ce87 lrc: 4/0,1 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189335.139827:0:66169:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4710e600/0xcc1762b626f8ce87 lrc: 3/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189335.139834:0:66169:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4710e600/0xcc1762b626f8ce87 lrc: 4/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189335.139840:0:66169:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dbf4710e600 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:2.0:1784189335.139845:0:66169:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4710e600/0xcc1762b626f8ce87 lrc: 4/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189335.139866:0:66169:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4710e600/0xcc1762b626f8ce87 lrc: 5/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189335.139888:0:66169:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x0 (ffff9dbf45994c00) 00010000:00010000:2.0:1784189335.139892:0:66169:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784189335.139896:0:66169:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4710e600/0xcc1762b626f8ce87 lrc: 3/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189335.139903:0:66169:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4710e600/0xcc1762b626f8ce87 lrc: 0/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1784189335.139917:0:66169:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000cbd920ae reply state 000000008560e2c2 transno 120259084334 ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4710e400/0xcc1762b626f8ce8e lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x4:0x0].0xd57f5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189335.139927:0:66169:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4710e400/0xcc1762b626f8ce8e lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0xd57f5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189335.139933:0:66169:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0xd57f5ca3 (ffff9dbf45994400) 00010000:00010000:2.0:1784189335.139935:0:66169:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1784189335.139938:0:66169:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1784189335.139964:0:66169:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4710ee00/0xcc1762b626f8ce80 lrc: 0/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c41f2 expref: 98 pid: 66169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189335.139977:0:66169:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4710f600/0xcc1762b626f8ce95 lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x13:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c41f2 expref: 97 pid: 66169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189335.139984:0:66169:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x13:0x0].0x0 (ffff9dbf45994e00) 00010000:00010000:2.0:1784189335.139986:0:66169:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784189335.139988:0:66169:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dbf4710f600, rc 0) 00000100:00100000:2.0:1784189335.140070:0:66169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc070220e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:debedd94-805c-42a0-a5e5-41758b2012e9+98:73517:x1870854436348160:12345-192.168.203.12@tcp:101:touch.0 Request processed in 990us (4109us total) trans 120259084334 rc 0/0 00000100:00100000:2.0:1784189335.140078:0:66169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1487 00000100:00100000:2.0:1784189335.151000:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1784189335.151100:0:66170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436348416 00000100:00100000:1.0:1784189335.151110:0:66170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436348416 00000100:00100000:1.0:1784189335.151173:0:66170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1488 00000100:00100000:1.0:1784189335.151183:0:66170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc07ab99880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:debedd94-805c-42a0-a5e5-41758b2012e9+98:73517:x1870854436348416:12345-192.168.203.12@tcp:36:touch.0 00010000:00010000:1.0:1784189335.151237:0:66170:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784189335.151274:0:66170:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4710f600/0xcc1762b626f8ce95 lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0x13:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c41f2 expref: 98 pid: 66169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189335.151306:0:66170:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x13:0x0].0x0 (ffff9dbf45994e00) 00010000:00010000:1.0:1784189335.151362:0:66170:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1784189335.151412:0:66170:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc07116ec00/0xcc1762b626f8cea3 lrc: 3/0,1 mode: --/PW res: [0x20000cf21:0x13:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189335.151425:0:66170:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc07116ec00/0xcc1762b626f8cea3 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x13:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189335.151434:0:66170:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc07116ec00/0xcc1762b626f8cea3 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x13:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1784189335.151559:0:66170:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000b3bc9297 reply state 00000000b04309e5 transno 120259084335 ns: mdt-lustre-MDT0000_UUID lock: ffff9dc07116ec00/0xcc1762b626f8cea3 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x13:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189335.151572:0:66170:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc07116ec00/0xcc1762b626f8cea3 lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x13:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189335.151578:0:66170:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x13:0x0].0x0 (ffff9dc07499be00) 00010000:00010000:1.0:1784189335.151581:0:66170:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1784189335.151583:0:66170:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1784189335.151674:0:66170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc07ab99880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:debedd94-805c-42a0-a5e5-41758b2012e9+99:73517:x1870854436348416:12345-192.168.203.12@tcp:36:touch.0 Request processed in 491us (681us total) trans 120259084335 rc 0/0 00000100:00100000:1.0:1784189335.151680:0:66170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1488 00000100:00100000:3.0:1784189335.154639:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1784189335.154940:0:66945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436348544 00000100:00100000:0.0:1784189335.154949:0:66945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436348544 00000100:00100000:0.0:1784189335.155017:0:66945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1489 00000100:00100000:0.0:1784189335.155027:0:66945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc070223800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:debedd94-805c-42a0-a5e5-41758b2012e9+99:73517:x1870854436348544:12345-192.168.203.12@tcp:101:touch.0 00010000:00010000:0.0:1784189335.155072:0:66945:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784189335.155092:0:66945:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc081b17e00/0xcc1762b626f8ceaa lrc: 2/0,0 mode: --/CR res: [0x20000cf21:0x13:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbfc5de7fe6c41f9 expref: -99 pid: 66945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189335.155141:0:66945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc081b17e00/0xcc1762b626f8ceaa lrc: 3/0,0 mode: CR/CR res: [0x20000cf21:0x13:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c41f9 expref: 100 pid: 66945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189335.155155:0:66945:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc081b17e00/0xcc1762b626f8ceaa lrc: 3/0,0 mode: CR/CR res: [0x20000cf21:0x13:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c41f9 expref: 100 pid: 66945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189335.155173:0:66945:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x13:0x0].0x0 (ffff9dc07499be00) 00010000:00010000:0.0:1784189335.155176:0:66945:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1784189335.155179:0:66945:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc081b17e00, rc 0) 00000100:00100000:0.0:1784189335.155244:0:66945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc070223800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:debedd94-805c-42a0-a5e5-41758b2012e9+100:73517:x1870854436348544:12345-192.168.203.12@tcp:101:touch.0 Request processed in 218us (611us total) trans 0 rc 0/0 00000100:00100000:0.0:1784189335.155261:0:66945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1489 00000100:00100000:3.0:1784189335.158136:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1784189335.158372:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436348672 00000100:00100000:0.0:1784189335.158381:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436348672 00000100:00100000:0.0:1784189335.158439:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 5013 00000100:00100000:0.0:1784189335.158448:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc070222a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:debedd94-805c-42a0-a5e5-41758b2012e9+18:2396:x1870854436348672:12345-192.168.203.12@tcp:2:touch.0 00000100:00100000:0.0:1784189335.158652:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc070222a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:debedd94-805c-42a0-a5e5-41758b2012e9+19:2396:x1870854436348672:12345-192.168.203.12@tcp:2:touch.0 Request processed in 204us (522us total) trans 4294968970 rc 0/0 00000100:00100000:0.0:1784189335.158660:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 5013 00000100:00100000:3.0:1784189335.164170:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1784189335.164312:0:66172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436348928 00000100:00100000:0.0:1784189335.164415:0:66172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436348928 00000100:00100000:1.0:1784189335.169455:0:66172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 258 00000100:00100000:1.0:1784189335.169470:0:66172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc070221500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:debedd94-805c-42a0-a5e5-41758b2012e9+100:73517:x1870854436348928:12345-192.168.203.12@tcp:35:touch.0 00000100:00100000:1.0:1784189335.169805:0:66172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc070221500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:debedd94-805c-42a0-a5e5-41758b2012e9+101:73517:x1870854436348928:12345-192.168.203.12@tcp:35:touch.0 Request processed in 337us (5642us total) trans 120259084336 rc 0/0 00000100:00100000:1.0:1784189335.169813:0:66172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 258 00000100:00100000:3.0:1784189335.180146:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1784189335.180431:0:68287:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436349184 00000100:00100000:0.0:1784189335.180441:0:68287:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436349184 00000100:00100000:0.0:1784189335.180514:0:68287:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1490 00000100:00100000:0.0:1784189335.180524:0:68287:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc070223100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:debedd94-805c-42a0-a5e5-41758b2012e9+101:73517:x1870854436349184:12345-192.168.203.12@tcp:101:touch.0 00010000:00010000:0.0:1784189335.180549:0:68287:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784189335.180570:0:68287:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc05ec0e400/0xcc1762b626f8ceb1 lrc: 2/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbfc5de7fe6c4200 expref: -99 pid: 68287 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189335.180666:0:68287:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc05ec0f200/0xcc1762b626f8ceb8 lrc: 3/0,1 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189335.180682:0:68287:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc05ec0f200/0xcc1762b626f8ceb8 lrc: 3/0,1 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189335.180694:0:68287:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc05ec0f200/0xcc1762b626f8ceb8 lrc: 3/0,1 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189335.180709:0:68287:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc070147800/0xcc1762b626f8cebf lrc: 3/0,1 mode: --/PW res: [0x20000cf21:0x4:0x0].0x2f385ca3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189335.180716:0:68287:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc070147800/0xcc1762b626f8cebf lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x4:0x0].0x2f385ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189335.180722:0:68287:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc070147800/0xcc1762b626f8cebf lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x4:0x0].0x2f385ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1784189335.181019:0:68287:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x770:0x0], index 0: 0 00010000:00010000:0.0:1784189335.181144:0:68287:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc070147e00/0xcc1762b626f8cec6 lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0x14:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189335.181155:0:68287:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc070147e00/0xcc1762b626f8cec6 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x14:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189335.181163:0:68287:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc070147e00/0xcc1762b626f8cec6 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x14:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189335.181205:0:68287:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc05ec0f200/0xcc1762b626f8ceb8 lrc: 4/0,1 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189335.181213:0:68287:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc05ec0f200/0xcc1762b626f8ceb8 lrc: 4/0,1 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189335.181220:0:68287:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc05ec0f200/0xcc1762b626f8ceb8 lrc: 3/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189335.181228:0:68287:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dc05ec0f200/0xcc1762b626f8ceb8 lrc: 4/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189335.181235:0:68287:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc05ec0f200 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:0.0:1784189335.181239:0:68287:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc05ec0f200/0xcc1762b626f8ceb8 lrc: 4/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189335.181247:0:68287:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc05ec0f200/0xcc1762b626f8ceb8 lrc: 5/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189335.182054:0:68287:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x0 (ffff9dbf45994c00) 00010000:00010000:0.0:1784189335.182059:0:68287:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784189335.182064:0:68287:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dc05ec0f200/0xcc1762b626f8ceb8 lrc: 3/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189335.182072:0:68287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc05ec0f200/0xcc1762b626f8ceb8 lrc: 0/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1784189335.182088:0:68287:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000073f8b814 reply state 0000000077a1074a transno 120259084337 ns: mdt-lustre-MDT0000_UUID lock: ffff9dc070147800/0xcc1762b626f8cebf lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x4:0x0].0x2f385ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189335.182099:0:68287:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc070147800/0xcc1762b626f8cebf lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x2f385ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189335.182117:0:68287:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x2f385ca3 (ffff9dc07fab4c00) 00010000:00010000:0.0:1784189335.182120:0:68287:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1784189335.182122:0:68287:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1784189335.182161:0:68287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc05ec0e400/0xcc1762b626f8ceb1 lrc: 0/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c4200 expref: 104 pid: 68287 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189335.182177:0:68287:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc070147e00/0xcc1762b626f8cec6 lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x14:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c4200 expref: 103 pid: 68287 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189335.182185:0:68287:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x14:0x0].0x0 (ffff9dc07fab4b00) 00010000:00010000:0.0:1784189335.182188:0:68287:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1784189335.182191:0:68287:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc070147e00, rc 0) 00000100:00100000:0.0:1784189335.182394:0:68287:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc070223100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:debedd94-805c-42a0-a5e5-41758b2012e9+104:73517:x1870854436349184:12345-192.168.203.12@tcp:101:touch.0 Request processed in 1870us (2256us total) trans 120259084337 rc 0/0 00000100:00100000:0.0:1784189335.182404:0:68287:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1490 00000100:00100000:3.0:1784189335.197085:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1784189335.197164:0:66170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436349440 00000100:00100000:1.0:1784189335.197173:0:66170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436349440 00000100:00100000:1.0:1784189335.197234:0:66170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1491 00000100:00100000:1.0:1784189335.197244:0:66170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc070220380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:debedd94-805c-42a0-a5e5-41758b2012e9+104:73517:x1870854436349440:12345-192.168.203.12@tcp:36:touch.0 00010000:00010000:1.0:1784189335.197315:0:66170:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784189335.197367:0:66170:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc070147e00/0xcc1762b626f8cec6 lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0x14:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c4200 expref: 104 pid: 68287 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189335.197387:0:66170:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x14:0x0].0x0 (ffff9dc07fab4b00) 00010000:00010000:1.0:1784189335.197412:0:66170:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1784189335.197469:0:66170:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc07116e800/0xcc1762b626f8ced4 lrc: 3/0,1 mode: --/PW res: [0x20000cf21:0x14:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189335.197482:0:66170:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc07116e800/0xcc1762b626f8ced4 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x14:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189335.197491:0:66170:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc07116e800/0xcc1762b626f8ced4 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x14:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1784189335.197595:0:66170:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000004c394d13 reply state 0000000075df70e1 transno 120259084338 ns: mdt-lustre-MDT0000_UUID lock: ffff9dc07116e800/0xcc1762b626f8ced4 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x14:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189335.197608:0:66170:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc07116e800/0xcc1762b626f8ced4 lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x14:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189335.197615:0:66170:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x14:0x0].0x0 (ffff9dc07499b800) 00010000:00010000:1.0:1784189335.197617:0:66170:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1784189335.197620:0:66170:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1784189335.197712:0:66170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc070220380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:debedd94-805c-42a0-a5e5-41758b2012e9+105:73517:x1870854436349440:12345-192.168.203.12@tcp:36:touch.0 Request processed in 469us (635us total) trans 120259084338 rc 0/0 00000100:00100000:1.0:1784189335.197720:0:66170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1491 00000100:00100000:2.0:1784189335.201016:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1784189335.201167:0:66169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436349568 00000100:00100000:1.0:1784189335.201177:0:66169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436349568 00000100:00100000:1.0:1784189335.201238:0:66169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1492 00000100:00100000:1.0:1784189335.201248:0:66169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc07ab9bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:debedd94-805c-42a0-a5e5-41758b2012e9+105:73517:x1870854436349568:12345-192.168.203.12@tcp:101:touch.0 00010000:00010000:1.0:1784189335.201359:0:66169:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784189335.201379:0:66169:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc07116ee00/0xcc1762b626f8cedb lrc: 2/0,0 mode: --/CR res: [0x20000cf21:0x14:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbfc5de7fe6c4207 expref: -99 pid: 66169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189335.201434:0:66169:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc07116ee00/0xcc1762b626f8cedb lrc: 3/0,0 mode: CR/CR res: [0x20000cf21:0x14:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c4207 expref: 106 pid: 66169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189335.201463:0:66169:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc07116ee00/0xcc1762b626f8cedb lrc: 3/0,0 mode: CR/CR res: [0x20000cf21:0x14:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c4207 expref: 106 pid: 66169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189335.201485:0:66169:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x14:0x0].0x0 (ffff9dc07499b800) 00010000:00010000:1.0:1784189335.201488:0:66169:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1784189335.201492:0:66169:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc07116ee00, rc 0) 00000100:00100000:1.0:1784189335.201550:0:66169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc07ab9bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:debedd94-805c-42a0-a5e5-41758b2012e9+106:73517:x1870854436349568:12345-192.168.203.12@tcp:101:touch.0 Request processed in 304us (544us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189335.201557:0:66169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1492 00000100:00100000:3.0:1784189335.209262:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1784189335.210817:0:26164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436349696 00000100:00100000:0.0:1784189335.210829:0:26164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436349696 00000100:00100000:0.0:1784189335.210903:0:26164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 5014 00000100:00100000:0.0:1784189335.210913:0:26164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc080f68380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:debedd94-805c-42a0-a5e5-41758b2012e9+19:2398:x1870854436349696:12345-192.168.203.12@tcp:2:touch.0 00000100:00100000:0.0:1784189335.211761:0:26164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc080f68380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:debedd94-805c-42a0-a5e5-41758b2012e9+20:2398:x1870854436349696:12345-192.168.203.12@tcp:2:touch.0 Request processed in 847us (2506us total) trans 4294968971 rc 0/0 00000100:00100000:0.0:1784189335.211770:0:26164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 5014 00000100:00100000:3.0:1784189335.219177:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1784189335.219431:0:66173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436349952 00000100:00100000:0.0:1784189335.219442:0:66173:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436349952 00000100:00100000:0.0:1784189335.219502:0:66173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 259 00000100:00100000:0.0:1784189335.219511:0:66173:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc05edd7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:debedd94-805c-42a0-a5e5-41758b2012e9+106:73517:x1870854436349952:12345-192.168.203.12@tcp:35:touch.0 00000100:00100000:0.0:1784189335.219802:0:66173:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc05edd7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:debedd94-805c-42a0-a5e5-41758b2012e9+107:73517:x1870854436349952:12345-192.168.203.12@tcp:35:touch.0 Request processed in 291us (633us total) trans 120259084339 rc 0/0 00000100:00100000:0.0:1784189335.219810:0:66173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 259 00000100:00100000:2.0:1784189335.227045:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1784189335.227158:0:68287:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436350208 00000100:00100000:0.0:1784189335.227169:0:68287:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436350208 00000100:00100000:0.0:1784189335.227240:0:68287:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1493 00000100:00100000:0.0:1784189335.227249:0:68287:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc07ab9aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:debedd94-805c-42a0-a5e5-41758b2012e9+107:73517:x1870854436350208:12345-192.168.203.12@tcp:101:touch.0 00010000:00010000:0.0:1784189335.227274:0:68287:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784189335.227295:0:68287:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc070147a00/0xcc1762b626f8cee2 lrc: 2/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbfc5de7fe6c420e expref: -99 pid: 68287 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189335.227439:0:68287:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc070146600/0xcc1762b626f8cee9 lrc: 3/0,1 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189335.227455:0:68287:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc070146600/0xcc1762b626f8cee9 lrc: 3/0,1 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189335.227465:0:68287:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc070146600/0xcc1762b626f8cee9 lrc: 3/0,1 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189335.227480:0:68287:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc070146a00/0xcc1762b626f8cef0 lrc: 3/0,1 mode: --/PW res: [0x20000cf21:0x4:0x0].0x88f15ca3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189335.227487:0:68287:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc070146a00/0xcc1762b626f8cef0 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x4:0x0].0x88f15ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189335.227492:0:68287:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc070146a00/0xcc1762b626f8cef0 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x4:0x0].0x88f15ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1784189335.227815:0:68287:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x771:0x0], index 0: 0 00010000:00010000:0.0:1784189335.228022:0:68287:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc070146e00/0xcc1762b626f8cef7 lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0x15:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189335.228032:0:68287:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc070146e00/0xcc1762b626f8cef7 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x15:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189335.228039:0:68287:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc070146e00/0xcc1762b626f8cef7 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x15:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189335.228071:0:68287:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc070146600/0xcc1762b626f8cee9 lrc: 4/0,1 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189335.228078:0:68287:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc070146600/0xcc1762b626f8cee9 lrc: 4/0,1 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189335.228084:0:68287:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc070146600/0xcc1762b626f8cee9 lrc: 3/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189335.228090:0:68287:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dc070146600/0xcc1762b626f8cee9 lrc: 4/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189335.228096:0:68287:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc070146600 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:0.0:1784189335.228100:0:68287:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc070146600/0xcc1762b626f8cee9 lrc: 4/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189335.228107:0:68287:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc070146600/0xcc1762b626f8cee9 lrc: 5/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189335.228118:0:68287:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x0 (ffff9dbf45994c00) 00010000:00010000:0.0:1784189335.228120:0:68287:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784189335.228124:0:68287:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dc070146600/0xcc1762b626f8cee9 lrc: 3/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189335.228141:0:68287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc070146600/0xcc1762b626f8cee9 lrc: 0/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1784189335.228154:0:68287:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000657acd06 reply state 00000000b0bf40d8 transno 120259084340 ns: mdt-lustre-MDT0000_UUID lock: ffff9dc070146a00/0xcc1762b626f8cef0 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x4:0x0].0x88f15ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189335.228166:0:68287:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc070146a00/0xcc1762b626f8cef0 lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x88f15ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189335.228172:0:68287:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x88f15ca3 (ffff9dc07fab4f00) 00010000:00010000:0.0:1784189335.228174:0:68287:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1784189335.228177:0:68287:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1784189335.228204:0:68287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc070147a00/0xcc1762b626f8cee2 lrc: 0/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c420e expref: 110 pid: 68287 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189335.228217:0:68287:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc070146e00/0xcc1762b626f8cef7 lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x15:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c420e expref: 109 pid: 68287 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189335.228224:0:68287:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x15:0x0].0x0 (ffff9dc07fab4100) 00010000:00010000:0.0:1784189335.228226:0:68287:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1784189335.228228:0:68287:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc070146e00, rc 0) 00000100:00100000:0.0:1784189335.228297:0:68287:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc07ab9aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:debedd94-805c-42a0-a5e5-41758b2012e9+110:73517:x1870854436350208:12345-192.168.203.12@tcp:101:touch.0 Request processed in 1049us (1263us total) trans 120259084340 rc 0/0 00000100:00100000:0.0:1784189335.228305:0:68287:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1493 00000100:00100000:3.0:1784189335.235228:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1784189335.235374:0:66945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436350464 00000100:00100000:0.0:1784189335.235385:0:66945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436350464 00000100:00100000:0.0:1784189335.235445:0:66945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1494 00000100:00100000:0.0:1784189335.235456:0:66945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc05edd4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:debedd94-805c-42a0-a5e5-41758b2012e9+110:73517:x1870854436350464:12345-192.168.203.12@tcp:36:touch.0 00010000:00010000:0.0:1784189335.235520:0:66945:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784189335.235546:0:66945:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc070146e00/0xcc1762b626f8cef7 lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0x15:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c420e expref: 110 pid: 68287 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189335.235563:0:66945:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x15:0x0].0x0 (ffff9dc07fab4100) 00010000:00010000:0.0:1784189335.235573:0:66945:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1784189335.235623:0:66945:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc070147a00/0xcc1762b626f8cf05 lrc: 3/0,1 mode: --/PW res: [0x20000cf21:0x15:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189335.235635:0:66945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc070147a00/0xcc1762b626f8cf05 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x15:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189335.235644:0:66945:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc070147a00/0xcc1762b626f8cf05 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x15:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1784189335.235746:0:66945:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000f6945f3d reply state 00000000f37d24dc transno 120259084341 ns: mdt-lustre-MDT0000_UUID lock: ffff9dc070147a00/0xcc1762b626f8cf05 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x15:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189335.235760:0:66945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc070147a00/0xcc1762b626f8cf05 lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x15:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189335.235766:0:66945:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x15:0x0].0x0 (ffff9dc07fab4000) 00010000:00010000:0.0:1784189335.235768:0:66945:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1784189335.235771:0:66945:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1784189335.235859:0:66945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc05edd4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:debedd94-805c-42a0-a5e5-41758b2012e9+111:73517:x1870854436350464:12345-192.168.203.12@tcp:36:touch.0 Request processed in 404us (638us total) trans 120259084341 rc 0/0 00000100:00100000:0.0:1784189335.235866:0:66945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1494 00000100:00100000:3.0:1784189335.241521:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1784189335.241636:0:66169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436350592 00000100:00100000:1.0:1784189335.241646:0:66169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436350592 00000100:00100000:1.0:1784189335.241712:0:66169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1495 00000100:00100000:1.0:1784189335.241722:0:66169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf470e0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:debedd94-805c-42a0-a5e5-41758b2012e9+111:73517:x1870854436350592:12345-192.168.203.12@tcp:101:touch.0 00010000:00010000:1.0:1784189335.241746:0:66169:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784189335.241765:0:66169:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc07116f400/0xcc1762b626f8cf0c lrc: 2/0,0 mode: --/CR res: [0x20000cf21:0x15:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbfc5de7fe6c4215 expref: -99 pid: 66169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189335.241831:0:66169:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc07116f400/0xcc1762b626f8cf0c lrc: 3/0,0 mode: CR/CR res: [0x20000cf21:0x15:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c4215 expref: 112 pid: 66169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189335.241847:0:66169:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc07116f400/0xcc1762b626f8cf0c lrc: 3/0,0 mode: CR/CR res: [0x20000cf21:0x15:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c4215 expref: 112 pid: 66169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189335.241865:0:66169:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x15:0x0].0x0 (ffff9dc07fab4000) 00010000:00010000:1.0:1784189335.241868:0:66169:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1784189335.241889:0:66169:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc07116f400, rc 0) 00000100:00100000:1.0:1784189335.241950:0:66169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf470e0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:debedd94-805c-42a0-a5e5-41758b2012e9+112:73517:x1870854436350592:12345-192.168.203.12@tcp:101:touch.0 Request processed in 229us (437us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189335.241958:0:66169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1495 00000100:00100000:2.0:1784189335.252477:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1784189335.252695:0:26167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436350720 00000100:00100000:3.0:1784189335.252705:0:26167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436350720 00000100:00100000:3.0:1784189335.252765:0:26167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 5015 00000100:00100000:3.0:1784189335.252890:0:26167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc07ab9a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:debedd94-805c-42a0-a5e5-41758b2012e9+20:2397:x1870854436350720:12345-192.168.203.12@tcp:2:touch.0 00000100:00100000:3.0:1784189335.253483:0:26167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc07ab9a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:debedd94-805c-42a0-a5e5-41758b2012e9+21:2397:x1870854436350720:12345-192.168.203.12@tcp:2:touch.0 Request processed in 707us (1011us total) trans 4294968972 rc 0/0 00000100:00100000:3.0:1784189335.253493:0:26167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 5015 00000100:00100000:3.0:1784189335.258106:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1784189335.258255:0:66173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436350976 00000100:00100000:0.0:1784189335.258265:0:66173:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436350976 00000100:00100000:0.0:1784189335.258357:0:66173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 260 00000100:00100000:0.0:1784189335.258381:0:66173:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf470e2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:debedd94-805c-42a0-a5e5-41758b2012e9+112:73517:x1870854436350976:12345-192.168.203.12@tcp:35:touch.0 00000100:00100000:0.0:1784189335.258646:0:66173:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf470e2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:debedd94-805c-42a0-a5e5-41758b2012e9+113:73517:x1870854436350976:12345-192.168.203.12@tcp:35:touch.0 Request processed in 267us (549us total) trans 120259084342 rc 0/0 00000100:00100000:0.0:1784189335.258654:0:66173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 260 00000100:00100000:2.0:1784189335.264179:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1784189335.264281:0:66170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436351232 00000100:00100000:1.0:1784189335.264291:0:66170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436351232 00000100:00100000:1.0:1784189335.264379:0:66170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1496 00000100:00100000:1.0:1784189335.264389:0:66170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc07ab98e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:debedd94-805c-42a0-a5e5-41758b2012e9+113:73517:x1870854436351232:12345-192.168.203.12@tcp:101:touch.0 00010000:00010000:1.0:1784189335.264411:0:66170:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784189335.264431:0:66170:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc07116f600/0xcc1762b626f8cf13 lrc: 2/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbfc5de7fe6c421c expref: -99 pid: 66170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189335.264530:0:66170:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc07116ea00/0xcc1762b626f8cf1a lrc: 3/0,1 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189335.264545:0:66170:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc07116ea00/0xcc1762b626f8cf1a lrc: 3/0,1 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189335.264555:0:66170:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc07116ea00/0xcc1762b626f8cf1a lrc: 3/0,1 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189335.264569:0:66170:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc07116f800/0xcc1762b626f8cf21 lrc: 3/0,1 mode: --/PW res: [0x20000cf21:0x4:0x0].0xe2aa5ca3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189335.264576:0:66170:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc07116f800/0xcc1762b626f8cf21 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x4:0x0].0xe2aa5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189335.264583:0:66170:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc07116f800/0xcc1762b626f8cf21 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x4:0x0].0xe2aa5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1784189335.264915:0:66170:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x772:0x0], index 0: 0 00010000:00010000:1.0:1784189335.265070:0:66170:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc07116fe00/0xcc1762b626f8cf28 lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0x16:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189335.265079:0:66170:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc07116fe00/0xcc1762b626f8cf28 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x16:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189335.265087:0:66170:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc07116fe00/0xcc1762b626f8cf28 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x16:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189335.265117:0:66170:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc07116ea00/0xcc1762b626f8cf1a lrc: 4/0,1 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189335.265124:0:66170:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc07116ea00/0xcc1762b626f8cf1a lrc: 4/0,1 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189335.265130:0:66170:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc07116ea00/0xcc1762b626f8cf1a lrc: 3/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189335.265137:0:66170:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dc07116ea00/0xcc1762b626f8cf1a lrc: 4/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189335.265142:0:66170:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc07116ea00 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:1.0:1784189335.265147:0:66170:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc07116ea00/0xcc1762b626f8cf1a lrc: 4/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189335.265154:0:66170:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc07116ea00/0xcc1762b626f8cf1a lrc: 5/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189335.265165:0:66170:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x0 (ffff9dbf45994c00) 00010000:00010000:1.0:1784189335.265168:0:66170:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784189335.265172:0:66170:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dc07116ea00/0xcc1762b626f8cf1a lrc: 3/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189335.265187:0:66170:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc07116ea00/0xcc1762b626f8cf1a lrc: 0/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1784189335.265201:0:66170:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000f4da7674 reply state 0000000030f4cb43 transno 120259084343 ns: mdt-lustre-MDT0000_UUID lock: ffff9dc07116f800/0xcc1762b626f8cf21 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x4:0x0].0xe2aa5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189335.265211:0:66170:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc07116f800/0xcc1762b626f8cf21 lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0xe2aa5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189335.265216:0:66170:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0xe2aa5ca3 (ffff9dc07499b500) 00010000:00010000:1.0:1784189335.265219:0:66170:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1784189335.265221:0:66170:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1784189335.265246:0:66170:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc07116f600/0xcc1762b626f8cf13 lrc: 0/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c421c expref: 116 pid: 66170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189335.265260:0:66170:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc07116fe00/0xcc1762b626f8cf28 lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x16:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c421c expref: 115 pid: 66170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189335.265267:0:66170:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x16:0x0].0x0 (ffff9dc07499ba00) 00010000:00010000:1.0:1784189335.265269:0:66170:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1784189335.265271:0:66170:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc07116fe00, rc 0) 00000100:00100000:1.0:1784189335.265358:0:66170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc07ab98e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:debedd94-805c-42a0-a5e5-41758b2012e9+116:73517:x1870854436351232:12345-192.168.203.12@tcp:101:touch.0 Request processed in 971us (1189us total) trans 120259084343 rc 0/0 00000100:00100000:1.0:1784189335.265366:0:66170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1496 00000100:00100000:2.0:1784189335.265905:0:94322:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc07ab9b800 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:94322:1870854458258048:0@lo:5:osp-pre-0-0.0 00000100:00100000:2.0:1784189335.265953:0:94322:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784189335.265997:0:94322:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dc04b8e5e40 going to sleep for 11 seconds 00000100:00100000:1.0:1784189335.267051:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458258048 00000100:00100000:1.0:1784189335.267061:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458258048 00000100:00100000:1.0:1784189335.267123:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5016 00000100:00100000:1.0:1784189335.267131:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc07ab99f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:94322:x1870854458258048:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:1.0:1784189335.267180:0:8428:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000401 at 1922 00000100:00080000:2.0:1784189335.267942:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1784189335.270694:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc07ab99f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:94322:x1870854458258048:12345-0@lo:5:osp-pre-0-0.0 Request processed in 3558us (4734us total) trans 4294968973 rc 0/0 00000100:00100000:1.0:1784189335.270706:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5016 00000100:00100000:2.0:1784189335.270940:0:94322:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc07ab9b800 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:94322:1870854458258048:0@lo:5:osp-pre-0-0.0 00000004:00080000:2.0:1784189335.270956:0:94322:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x280000401:0x772:0x0]-[0x280000401:0x7a1:0x0] 00000100:00100000:2.0:1784189335.278413:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1784189335.278492:0:66171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436351488 00000100:00100000:3.0:1784189335.278502:0:66171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436351488 00000100:00100000:3.0:1784189335.278563:0:66171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1497 00000100:00100000:3.0:1784189335.278572:0:66171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc07ab99500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:debedd94-805c-42a0-a5e5-41758b2012e9+116:73517:x1870854436351488:12345-192.168.203.12@tcp:36:touch.0 00010000:00010000:3.0:1784189335.278622:0:66171:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784189335.278646:0:66171:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc07116fe00/0xcc1762b626f8cf28 lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0x16:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c421c expref: 116 pid: 66170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189335.278663:0:66171:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x16:0x0].0x0 (ffff9dc07499ba00) 00010000:00010000:3.0:1784189335.278672:0:66171:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1784189335.278732:0:66171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc058f66200/0xcc1762b626f8cf36 lrc: 3/0,1 mode: --/PW res: [0x20000cf21:0x16:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189335.278744:0:66171:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc058f66200/0xcc1762b626f8cf36 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x16:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189335.278753:0:66171:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc058f66200/0xcc1762b626f8cf36 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x16:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1784189335.278959:0:66171:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000f173d923 reply state 00000000770e2d32 transno 120259084344 ns: mdt-lustre-MDT0000_UUID lock: ffff9dc058f66200/0xcc1762b626f8cf36 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x16:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189335.279049:0:66171:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc058f66200/0xcc1762b626f8cf36 lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x16:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189335.279057:0:66171:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x16:0x0].0x0 (ffff9dbf44851900) 00010000:00010000:3.0:1784189335.279059:0:66171:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1784189335.279062:0:66171:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1784189335.279224:0:66171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc07ab99500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:debedd94-805c-42a0-a5e5-41758b2012e9+117:73517:x1870854436351488:12345-192.168.203.12@tcp:36:touch.0 Request processed in 652us (818us total) trans 120259084344 rc 0/0 00000100:00100000:3.0:1784189335.279232:0:66171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1497 00010000:00010000:3.0:1784189335.279526:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784189335.288798:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1784189335.288949:0:68287:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436351616 00000100:00100000:0.0:1784189335.288958:0:68287:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436351616 00000100:00100000:0.0:1784189335.289036:0:68287:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1498 00000100:00100000:0.0:1784189335.289056:0:68287:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf470e2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:debedd94-805c-42a0-a5e5-41758b2012e9+117:73517:x1870854436351616:12345-192.168.203.12@tcp:101:touch.0 00010000:00010000:0.0:1784189335.289077:0:68287:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784189335.289101:0:68287:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc070146e00/0xcc1762b626f8cf3d lrc: 2/0,0 mode: --/CR res: [0x20000cf21:0x16:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbfc5de7fe6c4223 expref: -99 pid: 68287 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189335.289157:0:68287:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc070146e00/0xcc1762b626f8cf3d lrc: 3/0,0 mode: CR/CR res: [0x20000cf21:0x16:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c4223 expref: 118 pid: 68287 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189335.289172:0:68287:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc070146e00/0xcc1762b626f8cf3d lrc: 3/0,0 mode: CR/CR res: [0x20000cf21:0x16:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c4223 expref: 118 pid: 68287 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189335.289192:0:68287:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x16:0x0].0x0 (ffff9dbf44851900) 00010000:00010000:0.0:1784189335.289196:0:68287:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1784189335.289199:0:68287:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc070146e00, rc 0) 00000100:00100000:0.0:1784189335.289256:0:68287:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf470e2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:debedd94-805c-42a0-a5e5-41758b2012e9+118:73517:x1870854436351616:12345-192.168.203.12@tcp:101:touch.0 Request processed in 202us (465us total) trans 0 rc 0/0 00000100:00100000:0.0:1784189335.289263:0:68287:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1498 00000100:00100000:2.0:1784189335.297434:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1784189335.298737:0:26170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436351744 00000100:00100000:1.0:1784189335.298749:0:26170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436351744 00000100:00100000:1.0:1784189335.298819:0:26170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 5017 00000100:00100000:1.0:1784189335.298829:0:26170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc07ab98000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:debedd94-805c-42a0-a5e5-41758b2012e9+21:2397:x1870854436351744:12345-192.168.203.12@tcp:2:touch.0 00000100:00100000:1.0:1784189335.299056:0:26170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc07ab98000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:debedd94-805c-42a0-a5e5-41758b2012e9+22:2397:x1870854436351744:12345-192.168.203.12@tcp:2:touch.0 Request processed in 228us (1630us total) trans 4294968974 rc 0/0 00000100:00100000:1.0:1784189335.299064:0:26170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 5017 00000100:00100000:2.0:1784189335.304420:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1784189335.304509:0:66173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436352000 00000100:00100000:0.0:1784189335.304519:0:66173:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436352000 00000100:00100000:0.0:1784189335.304592:0:66173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 261 00000100:00100000:0.0:1784189335.304602:0:66173:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc07ab98a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:debedd94-805c-42a0-a5e5-41758b2012e9+118:73517:x1870854436352000:12345-192.168.203.12@tcp:35:touch.0 00000100:00100000:0.0:1784189335.304906:0:66173:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc07ab98a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:debedd94-805c-42a0-a5e5-41758b2012e9+119:73517:x1870854436352000:12345-192.168.203.12@tcp:35:touch.0 Request processed in 305us (494us total) trans 120259084345 rc 0/0 00000100:00100000:0.0:1784189335.304914:0:66173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 261 00000100:00100000:3.0:1784189335.307851:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1784189335.308118:0:66945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436352256 00000100:00100000:0.0:1784189335.308128:0:66945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436352256 00000100:00100000:0.0:1784189335.308192:0:66945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1499 00000100:00100000:0.0:1784189335.308203:0:66945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf470e3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:debedd94-805c-42a0-a5e5-41758b2012e9+119:73517:x1870854436352256:12345-192.168.203.12@tcp:101:touch.0 00010000:00010000:0.0:1784189335.308227:0:66945:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784189335.308249:0:66945:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc070146600/0xcc1762b626f8cf44 lrc: 2/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbfc5de7fe6c422a expref: -99 pid: 66945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189335.308388:0:66945:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc070146200/0xcc1762b626f8cf4b lrc: 3/0,1 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189335.308403:0:66945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc070146200/0xcc1762b626f8cf4b lrc: 3/0,1 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189335.308413:0:66945:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc070146200/0xcc1762b626f8cf4b lrc: 3/0,1 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189335.308426:0:66945:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc070147c00/0xcc1762b626f8cf52 lrc: 3/0,1 mode: --/PW res: [0x20000cf21:0x4:0x0].0x3c635ca3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189335.308433:0:66945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc070147c00/0xcc1762b626f8cf52 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x4:0x0].0x3c635ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189335.308440:0:66945:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc070147c00/0xcc1762b626f8cf52 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x4:0x0].0x3c635ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1784189335.308736:0:66945:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x773:0x0], index 0: 0 00010000:00010000:0.0:1784189335.309121:0:66945:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc070147400/0xcc1762b626f8cf59 lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0x17:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189335.309131:0:66945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc070147400/0xcc1762b626f8cf59 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x17:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189335.309139:0:66945:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc070147400/0xcc1762b626f8cf59 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x17:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189335.309169:0:66945:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc070146200/0xcc1762b626f8cf4b lrc: 4/0,1 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189335.309177:0:66945:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc070146200/0xcc1762b626f8cf4b lrc: 4/0,1 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189335.309183:0:66945:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc070146200/0xcc1762b626f8cf4b lrc: 3/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189335.309190:0:66945:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dc070146200/0xcc1762b626f8cf4b lrc: 4/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189335.309197:0:66945:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc070146200 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:0.0:1784189335.309201:0:66945:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc070146200/0xcc1762b626f8cf4b lrc: 4/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189335.309209:0:66945:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc070146200/0xcc1762b626f8cf4b lrc: 5/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189335.309222:0:66945:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x0 (ffff9dbf45994c00) 00010000:00010000:0.0:1784189335.309225:0:66945:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784189335.309236:0:66945:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dc070146200/0xcc1762b626f8cf4b lrc: 3/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189335.309243:0:66945:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc070146200/0xcc1762b626f8cf4b lrc: 0/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1784189335.309257:0:66945:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000f1a1949b reply state 00000000fb9c7213 transno 120259084346 ns: mdt-lustre-MDT0000_UUID lock: ffff9dc070147c00/0xcc1762b626f8cf52 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x4:0x0].0x3c635ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189335.309268:0:66945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc070147c00/0xcc1762b626f8cf52 lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x3c635ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189335.309276:0:66945:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x3c635ca3 (ffff9dc07fab4100) 00010000:00010000:0.0:1784189335.309278:0:66945:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1784189335.309280:0:66945:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1784189335.309309:0:66945:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc070146600/0xcc1762b626f8cf44 lrc: 0/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c422a expref: 122 pid: 66945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189335.309416:0:66945:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc070147400/0xcc1762b626f8cf59 lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x17:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c422a expref: 121 pid: 66945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189335.309424:0:66945:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x17:0x0].0x0 (ffff9dc07fab4e00) 00010000:00010000:0.0:1784189335.309426:0:66945:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1784189335.309428:0:66945:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc070147400, rc 0) 00000100:00100000:0.0:1784189335.309499:0:66945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf470e3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:debedd94-805c-42a0-a5e5-41758b2012e9+122:73517:x1870854436352256:12345-192.168.203.12@tcp:101:touch.0 Request processed in 1298us (1656us total) trans 120259084346 rc 0/0 00000100:00100000:0.0:1784189335.309507:0:66945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1499 00000100:00100000:2.0:1784189335.320522:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1784189335.320610:0:66171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436352512 00000100:00100000:3.0:1784189335.320619:0:66171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436352512 00000100:00100000:3.0:1784189335.320680:0:66171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1500 00000100:00100000:3.0:1784189335.320690:0:66171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc07ab99c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:debedd94-805c-42a0-a5e5-41758b2012e9+122:73517:x1870854436352512:12345-192.168.203.12@tcp:36:touch.0 00010000:00010000:3.0:1784189335.320767:0:66171:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784189335.320805:0:66171:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc070147400/0xcc1762b626f8cf59 lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0x17:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c422a expref: 122 pid: 66945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189335.320824:0:66171:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x17:0x0].0x0 (ffff9dc07fab4e00) 00010000:00010000:3.0:1784189335.320834:0:66171:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1784189335.320895:0:66171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc058f66800/0xcc1762b626f8cf67 lrc: 3/0,1 mode: --/PW res: [0x20000cf21:0x17:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189335.320907:0:66171:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc058f66800/0xcc1762b626f8cf67 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x17:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189335.320927:0:66171:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc058f66800/0xcc1762b626f8cf67 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x17:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1784189335.321210:0:66171:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000003b1e9034 reply state 00000000e34088b2 transno 120259084347 ns: mdt-lustre-MDT0000_UUID lock: ffff9dc058f66800/0xcc1762b626f8cf67 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x17:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189335.321224:0:66171:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc058f66800/0xcc1762b626f8cf67 lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x17:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189335.321231:0:66171:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x17:0x0].0x0 (ffff9dbf44851b00) 00010000:00010000:3.0:1784189335.321234:0:66171:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1784189335.321236:0:66171:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1784189335.321457:0:66171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc07ab99c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:debedd94-805c-42a0-a5e5-41758b2012e9+123:73517:x1870854436352512:12345-192.168.203.12@tcp:36:touch.0 Request processed in 767us (941us total) trans 120259084347 rc 0/0 00000100:00100000:3.0:1784189335.321464:0:66171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1500 00000100:00100000:2.0:1784189335.327632:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1784189335.327720:0:66170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436352640 00000100:00100000:1.0:1784189335.327730:0:66170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436352640 00000100:00100000:1.0:1784189335.327795:0:66170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1501 00000100:00100000:1.0:1784189335.327805:0:66170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc07ab98380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:debedd94-805c-42a0-a5e5-41758b2012e9+123:73517:x1870854436352640:12345-192.168.203.12@tcp:101:touch.0 00010000:00010000:1.0:1784189335.327826:0:66170:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784189335.327843:0:66170:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc07116f600/0xcc1762b626f8cf6e lrc: 2/0,0 mode: --/CR res: [0x20000cf21:0x17:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbfc5de7fe6c4231 expref: -99 pid: 66170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189335.327906:0:66170:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc07116f600/0xcc1762b626f8cf6e lrc: 3/0,0 mode: CR/CR res: [0x20000cf21:0x17:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c4231 expref: 124 pid: 66170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189335.327921:0:66170:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc07116f600/0xcc1762b626f8cf6e lrc: 3/0,0 mode: CR/CR res: [0x20000cf21:0x17:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c4231 expref: 124 pid: 66170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189335.327936:0:66170:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x17:0x0].0x0 (ffff9dbf44851b00) 00010000:00010000:1.0:1784189335.327950:0:66170:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1784189335.327954:0:66170:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc07116f600, rc 0) 00000100:00100000:1.0:1784189335.328020:0:66170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc07ab98380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:debedd94-805c-42a0-a5e5-41758b2012e9+124:73517:x1870854436352640:12345-192.168.203.12@tcp:101:touch.0 Request processed in 217us (397us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189335.328027:0:66170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1501 00000100:00100000:0.0:1784189335.332154:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1784189335.332229:0:9982:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436352768 00000100:00100000:1.0:1784189335.332238:0:9982:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436352768 00000100:00100000:1.0:1784189335.332289:0:9982:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 5018 00000100:00100000:1.0:1784189335.332300:0:9982:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf48599f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:debedd94-805c-42a0-a5e5-41758b2012e9+22:2399:x1870854436352768:12345-192.168.203.12@tcp:2:touch.0 00000100:00100000:1.0:1784189335.332507:0:9982:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf48599f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:debedd94-805c-42a0-a5e5-41758b2012e9+23:2399:x1870854436352768:12345-192.168.203.12@tcp:2:touch.0 Request processed in 208us (360us total) trans 4294968975 rc 0/0 00000100:00100000:1.0:1784189335.332514:0:9982:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 5018 00000100:00100000:2.0:1784189335.342538:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1784189335.342631:0:66173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436353024 00000100:00100000:0.0:1784189335.342641:0:66173:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436353024 00000100:00100000:0.0:1784189335.342716:0:66173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 262 00000100:00100000:0.0:1784189335.342726:0:66173:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc07ab9a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:debedd94-805c-42a0-a5e5-41758b2012e9+124:73517:x1870854436353024:12345-192.168.203.12@tcp:35:touch.0 00000100:00100000:0.0:1784189335.343206:0:66173:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc07ab9a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:debedd94-805c-42a0-a5e5-41758b2012e9+125:73517:x1870854436353024:12345-192.168.203.12@tcp:35:touch.0 Request processed in 480us (675us total) trans 120259084348 rc 0/0 00000100:00100000:0.0:1784189335.343216:0:66173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 262 00000100:00100000:2.0:1784189335.348367:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1784189335.348460:0:66169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436353280 00000100:00100000:1.0:1784189335.348470:0:66169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436353280 00000100:00100000:1.0:1784189335.348521:0:66169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1502 00000100:00100000:1.0:1784189335.348530:0:66169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc07ab9ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:debedd94-805c-42a0-a5e5-41758b2012e9+125:73517:x1870854436353280:12345-192.168.203.12@tcp:101:touch.0 00010000:00010000:1.0:1784189335.348552:0:66169:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784189335.348573:0:66169:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc07116ea00/0xcc1762b626f8cf75 lrc: 2/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbfc5de7fe6c4238 expref: -99 pid: 66169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189335.348702:0:66169:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc07116f000/0xcc1762b626f8cf7c lrc: 3/0,1 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189335.348717:0:66169:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc07116f000/0xcc1762b626f8cf7c lrc: 3/0,1 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189335.348728:0:66169:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc07116f000/0xcc1762b626f8cf7c lrc: 3/0,1 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189335.348752:0:66169:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc07116e000/0xcc1762b626f8cf83 lrc: 3/0,1 mode: --/PW res: [0x20000cf21:0x4:0x0].0x961c5ca3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189335.348760:0:66169:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc07116e000/0xcc1762b626f8cf83 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x4:0x0].0x961c5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189335.348767:0:66169:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc07116e000/0xcc1762b626f8cf83 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x4:0x0].0x961c5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1784189335.349090:0:66169:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x774:0x0], index 0: 0 00010000:00010000:1.0:1784189335.349387:0:66169:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc07116fa00/0xcc1762b626f8cf8a lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0x18:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189335.349396:0:66169:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc07116fa00/0xcc1762b626f8cf8a lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x18:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189335.349404:0:66169:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc07116fa00/0xcc1762b626f8cf8a lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x18:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189335.349436:0:66169:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc07116f000/0xcc1762b626f8cf7c lrc: 4/0,1 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189335.349444:0:66169:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc07116f000/0xcc1762b626f8cf7c lrc: 4/0,1 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189335.349450:0:66169:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc07116f000/0xcc1762b626f8cf7c lrc: 3/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189335.349456:0:66169:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dc07116f000/0xcc1762b626f8cf7c lrc: 4/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189335.349461:0:66169:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc07116f000 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:1.0:1784189335.349472:0:66169:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc07116f000/0xcc1762b626f8cf7c lrc: 4/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189335.349479:0:66169:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc07116f000/0xcc1762b626f8cf7c lrc: 5/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189335.349489:0:66169:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x0 (ffff9dbf45994c00) 00010000:00010000:1.0:1784189335.349492:0:66169:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784189335.349496:0:66169:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dc07116f000/0xcc1762b626f8cf7c lrc: 3/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189335.349502:0:66169:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc07116f000/0xcc1762b626f8cf7c lrc: 0/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1784189335.349513:0:66169:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000f93fc72e reply state 00000000c38d646f transno 120259084349 ns: mdt-lustre-MDT0000_UUID lock: ffff9dc07116e000/0xcc1762b626f8cf83 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x4:0x0].0x961c5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189335.349524:0:66169:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc07116e000/0xcc1762b626f8cf83 lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x961c5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189335.349530:0:66169:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x961c5ca3 (ffff9dc07499b400) 00010000:00010000:1.0:1784189335.349532:0:66169:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1784189335.349534:0:66169:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1784189335.349560:0:66169:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc07116ea00/0xcc1762b626f8cf75 lrc: 0/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c4238 expref: 128 pid: 66169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189335.349574:0:66169:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc07116fa00/0xcc1762b626f8cf8a lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x18:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c4238 expref: 127 pid: 66169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189335.349580:0:66169:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x18:0x0].0x0 (ffff9dc07499bb00) 00010000:00010000:1.0:1784189335.349582:0:66169:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1784189335.349590:0:66169:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc07116fa00, rc 0) 00000100:00100000:1.0:1784189335.349643:0:66169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc07ab9ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:debedd94-805c-42a0-a5e5-41758b2012e9+128:73517:x1870854436353280:12345-192.168.203.12@tcp:101:touch.0 Request processed in 1113us (1283us total) trans 120259084349 rc 0/0 00000100:00100000:1.0:1784189335.349651:0:66169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1502 00000100:00100000:3.0:1784189335.355018:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1784189335.355164:0:66171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436353536 00000100:00100000:1.0:1784189335.355175:0:66171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436353536 00000100:00100000:1.0:1784189335.355238:0:66171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1503 00000100:00100000:1.0:1784189335.355248:0:66171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf470e2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:debedd94-805c-42a0-a5e5-41758b2012e9+128:73517:x1870854436353536:12345-192.168.203.12@tcp:36:touch.0 00010000:00010000:1.0:1784189335.355302:0:66171:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784189335.355361:0:66171:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc07116fa00/0xcc1762b626f8cf8a lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0x18:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c4238 expref: 128 pid: 66169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189335.355381:0:66171:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x18:0x0].0x0 (ffff9dc07499bb00) 00010000:00010000:1.0:1784189335.355390:0:66171:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1784189335.355442:0:66171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc07116f200/0xcc1762b626f8cf98 lrc: 3/0,1 mode: --/PW res: [0x20000cf21:0x18:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189335.355455:0:66171:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc07116f200/0xcc1762b626f8cf98 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x18:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189335.355464:0:66171:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc07116f200/0xcc1762b626f8cf98 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x18:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1784189335.355561:0:66171:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000092d8045 reply state 00000000bd13cb22 transno 120259084350 ns: mdt-lustre-MDT0000_UUID lock: ffff9dc07116f200/0xcc1762b626f8cf98 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x18:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189335.355574:0:66171:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc07116f200/0xcc1762b626f8cf98 lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x18:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189335.355580:0:66171:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x18:0x0].0x0 (ffff9dc07499b300) 00010000:00010000:1.0:1784189335.355598:0:66171:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1784189335.355601:0:66171:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1784189335.355685:0:66171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf470e2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:debedd94-805c-42a0-a5e5-41758b2012e9+129:73517:x1870854436353536:12345-192.168.203.12@tcp:36:touch.0 Request processed in 437us (676us total) trans 120259084350 rc 0/0 00000100:00100000:1.0:1784189335.355693:0:66171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1503 00000100:00100000:2.0:1784189335.361121:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1784189335.361206:0:66945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436353664 00000100:00100000:0.0:1784189335.361215:0:66945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436353664 00000100:00100000:0.0:1784189335.361267:0:66945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1504 00000100:00100000:0.0:1784189335.361276:0:66945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc07ab99180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:debedd94-805c-42a0-a5e5-41758b2012e9+129:73517:x1870854436353664:12345-192.168.203.12@tcp:101:touch.0 00010000:00010000:0.0:1784189335.361298:0:66945:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784189335.361353:0:66945:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc070146200/0xcc1762b626f8cf9f lrc: 2/0,0 mode: --/CR res: [0x20000cf21:0x18:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbfc5de7fe6c423f expref: -99 pid: 66945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189335.361406:0:66945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc070146200/0xcc1762b626f8cf9f lrc: 3/0,0 mode: CR/CR res: [0x20000cf21:0x18:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c423f expref: 130 pid: 66945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189335.361421:0:66945:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc070146200/0xcc1762b626f8cf9f lrc: 3/0,0 mode: CR/CR res: [0x20000cf21:0x18:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c423f expref: 130 pid: 66945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189335.361448:0:66945:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x18:0x0].0x0 (ffff9dc07499b300) 00010000:00010000:0.0:1784189335.361452:0:66945:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1784189335.361455:0:66945:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc070146200, rc 0) 00000100:00100000:0.0:1784189335.361506:0:66945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc07ab99180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:debedd94-805c-42a0-a5e5-41758b2012e9+130:73517:x1870854436353664:12345-192.168.203.12@tcp:101:touch.0 Request processed in 231us (395us total) trans 0 rc 0/0 00000100:00100000:0.0:1784189335.361513:0:66945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1504 00000100:00100000:3.0:1784189335.368198:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1784189335.368282:0:26160:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436353792 00000100:00100000:0.0:1784189335.368309:0:26160:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436353792 00000100:00100000:0.0:1784189335.368411:0:26160:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 5019 00000100:00100000:0.0:1784189335.368421:0:26160:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf470e0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:debedd94-805c-42a0-a5e5-41758b2012e9+23:2396:x1870854436353792:12345-192.168.203.12@tcp:2:touch.0 00000100:00100000:0.0:1784189335.368633:0:26160:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf470e0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:debedd94-805c-42a0-a5e5-41758b2012e9+24:2396:x1870854436353792:12345-192.168.203.12@tcp:2:touch.0 Request processed in 213us (445us total) trans 4294968976 rc 0/0 00000100:00100000:0.0:1784189335.368641:0:26160:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 5019 00000100:00100000:3.0:1784189335.377056:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1784189335.377198:0:66172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436354048 00000100:00100000:1.0:1784189335.377209:0:66172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436354048 00000100:00100000:1.0:1784189335.377269:0:66172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 263 00000100:00100000:1.0:1784189335.377280:0:66172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf44d09850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:debedd94-805c-42a0-a5e5-41758b2012e9+130:73517:x1870854436354048:12345-192.168.203.12@tcp:35:touch.0 00000100:00100000:1.0:1784189335.377606:0:66172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf44d09850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:debedd94-805c-42a0-a5e5-41758b2012e9+131:73517:x1870854436354048:12345-192.168.203.12@tcp:35:touch.0 Request processed in 326us (557us total) trans 120259084351 rc 0/0 00000100:00100000:1.0:1784189335.377614:0:66172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 263 00000100:00100000:1.0:1784189335.384586:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1784189335.384692:0:68287:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436354304 00000100:00100000:0.0:1784189335.384703:0:68287:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436354304 00000100:00100000:0.0:1784189335.384766:0:68287:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1505 00000100:00100000:0.0:1784189335.384784:0:68287:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf4a32f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:debedd94-805c-42a0-a5e5-41758b2012e9+131:73517:x1870854436354304:12345-192.168.203.12@tcp:101:touch.0 00010000:00010000:0.0:1784189335.384810:0:68287:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784189335.384832:0:68287:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc070146800/0xcc1762b626f8cfa6 lrc: 2/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbfc5de7fe6c4246 expref: -99 pid: 68287 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189335.384938:0:68287:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc070146c00/0xcc1762b626f8cfad lrc: 3/0,1 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189335.384953:0:68287:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc070146c00/0xcc1762b626f8cfad lrc: 3/0,1 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189335.384975:0:68287:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc070146c00/0xcc1762b626f8cfad lrc: 3/0,1 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189335.384999:0:68287:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc070146000/0xcc1762b626f8cfb4 lrc: 3/0,1 mode: --/PW res: [0x20000cf21:0x4:0x0].0xb6f515a3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189335.385186:0:68287:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc070146000/0xcc1762b626f8cfb4 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x4:0x0].0xb6f515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189335.385196:0:68287:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc070146000/0xcc1762b626f8cfb4 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x4:0x0].0xb6f515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1784189335.385573:0:68287:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x775:0x0], index 0: 0 00010000:00010000:0.0:1784189335.385702:0:68287:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc070147000/0xcc1762b626f8cfbb lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0x19:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189335.385714:0:68287:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc070147000/0xcc1762b626f8cfbb lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x19:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189335.385722:0:68287:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc070147000/0xcc1762b626f8cfbb lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x19:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189335.385754:0:68287:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc070146c00/0xcc1762b626f8cfad lrc: 4/0,1 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189335.385762:0:68287:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc070146c00/0xcc1762b626f8cfad lrc: 4/0,1 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189335.385767:0:68287:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc070146c00/0xcc1762b626f8cfad lrc: 3/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189335.386096:0:68287:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dc070146c00/0xcc1762b626f8cfad lrc: 4/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189335.386103:0:68287:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc070146c00 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:0.0:1784189335.386107:0:68287:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc070146c00/0xcc1762b626f8cfad lrc: 4/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189335.386115:0:68287:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc070146c00/0xcc1762b626f8cfad lrc: 5/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189335.386127:0:68287:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x0 (ffff9dbf45994c00) 00010000:00010000:0.0:1784189335.386130:0:68287:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784189335.386142:0:68287:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dc070146c00/0xcc1762b626f8cfad lrc: 3/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189335.386149:0:68287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc070146c00/0xcc1762b626f8cfad lrc: 0/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1784189335.386162:0:68287:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000d3e4bac0 reply state 00000000105b92f3 transno 120259084352 ns: mdt-lustre-MDT0000_UUID lock: ffff9dc070146000/0xcc1762b626f8cfb4 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x4:0x0].0xb6f515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189335.386172:0:68287:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc070146000/0xcc1762b626f8cfb4 lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0xb6f515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189335.386178:0:68287:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0xb6f515a3 (ffff9dc07fab4e00) 00010000:00010000:0.0:1784189335.386180:0:68287:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1784189335.386182:0:68287:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1784189335.387235:0:68287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc070146800/0xcc1762b626f8cfa6 lrc: 0/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c4246 expref: 134 pid: 68287 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189335.387260:0:68287:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc070147000/0xcc1762b626f8cfbb lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x19:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c4246 expref: 133 pid: 68287 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189335.387285:0:68287:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x19:0x0].0x0 (ffff9dc07fab4b00) 00010000:00010000:2.0:1784189335.387287:0:68287:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784189335.387289:0:68287:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc070147000, rc 0) 00000100:00100000:2.0:1784189335.387448:0:68287:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf4a32f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:debedd94-805c-42a0-a5e5-41758b2012e9+134:73517:x1870854436354304:12345-192.168.203.12@tcp:101:touch.0 Request processed in 2672us (2869us total) trans 120259084352 rc 0/0 00000100:00100000:2.0:1784189335.387457:0:68287:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1505 00000100:00100000:3.0:1784189335.391545:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1784189335.391613:0:66170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436354560 00000100:00100000:2.0:1784189335.391622:0:66170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436354560 00000100:00100000:2.0:1784189335.391680:0:66170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1506 00000100:00100000:2.0:1784189335.391689:0:66170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf470e0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:debedd94-805c-42a0-a5e5-41758b2012e9+134:73517:x1870854436354560:12345-192.168.203.12@tcp:36:touch.0 00010000:00010000:2.0:1784189335.391746:0:66170:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784189335.391783:0:66170:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc070147000/0xcc1762b626f8cfbb lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0x19:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c4246 expref: 134 pid: 68287 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189335.391801:0:66170:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x19:0x0].0x0 (ffff9dc07fab4b00) 00010000:00010000:2.0:1784189335.391812:0:66170:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1784189335.391868:0:66170:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4710f400/0xcc1762b626f8cfc9 lrc: 3/0,1 mode: --/PW res: [0x20000cf21:0x19:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189335.391891:0:66170:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4710f400/0xcc1762b626f8cfc9 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x19:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189335.391901:0:66170:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4710f400/0xcc1762b626f8cfc9 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x19:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1784189335.392222:0:66170:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000005ba859f3 reply state 00000000c99a437e transno 120259084353 ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4710f400/0xcc1762b626f8cfc9 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x19:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189335.392253:0:66170:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4710f400/0xcc1762b626f8cfc9 lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x19:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189335.392259:0:66170:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x19:0x0].0x0 (ffff9dbf45994d00) 00010000:00010000:2.0:1784189335.392262:0:66170:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1784189335.392264:0:66170:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1784189335.392423:0:66170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf470e0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:debedd94-805c-42a0-a5e5-41758b2012e9+135:73517:x1870854436354560:12345-192.168.203.12@tcp:36:touch.0 Request processed in 734us (885us total) trans 120259084353 rc 0/0 00000100:00100000:2.0:1784189335.392441:0:66170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1506 00000100:00100000:3.0:1784189335.395406:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1784189335.395606:0:66169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436354688 00000100:00100000:1.0:1784189335.395616:0:66169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436354688 00000100:00100000:1.0:1784189335.395671:0:66169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1507 00000100:00100000:1.0:1784189335.395681:0:66169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf470e1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:debedd94-805c-42a0-a5e5-41758b2012e9+135:73517:x1870854436354688:12345-192.168.203.12@tcp:101:touch.0 00010000:00010000:1.0:1784189335.395704:0:66169:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784189335.395725:0:66169:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc07116f000/0xcc1762b626f8cfd0 lrc: 2/0,0 mode: --/CR res: [0x20000cf21:0x19:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbfc5de7fe6c424d expref: -99 pid: 66169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189335.395845:0:66169:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc07116f000/0xcc1762b626f8cfd0 lrc: 3/0,0 mode: CR/CR res: [0x20000cf21:0x19:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c424d expref: 136 pid: 66169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189335.395862:0:66169:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc07116f000/0xcc1762b626f8cfd0 lrc: 3/0,0 mode: CR/CR res: [0x20000cf21:0x19:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c424d expref: 136 pid: 66169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189335.395911:0:66169:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x19:0x0].0x0 (ffff9dbf45994d00) 00010000:00010000:1.0:1784189335.395914:0:66169:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1784189335.395917:0:66169:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc07116f000, rc 0) 00000100:00100000:1.0:1784189335.395976:0:66169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf470e1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:debedd94-805c-42a0-a5e5-41758b2012e9+136:73517:x1870854436354688:12345-192.168.203.12@tcp:101:touch.0 Request processed in 296us (578us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189335.395984:0:66169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1507 00000100:00100000:1.0:1784189335.398957:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1784189335.399153:0:26168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436354816 00000100:00100000:0.0:1784189335.399164:0:26168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436354816 00000100:00100000:0.0:1784189335.399216:0:26168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 5020 00000100:00100000:0.0:1784189335.399227:0:26168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf4a32d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:debedd94-805c-42a0-a5e5-41758b2012e9+24:2396:x1870854436354816:12345-192.168.203.12@tcp:2:touch.0 00000100:00100000:0.0:1784189335.399435:0:26168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf4a32d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:debedd94-805c-42a0-a5e5-41758b2012e9+25:2396:x1870854436354816:12345-192.168.203.12@tcp:2:touch.0 Request processed in 209us (485us total) trans 4294968977 rc 0/0 00000100:00100000:0.0:1784189335.399443:0:26168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 5020 00000100:00100000:2.0:1784189335.402368:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1784189335.402458:0:66172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436355072 00000100:00100000:1.0:1784189335.402468:0:66172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436355072 00000100:00100000:1.0:1784189335.402509:0:66172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 264 00000100:00100000:1.0:1784189335.402517:0:66172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc07ab98a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:debedd94-805c-42a0-a5e5-41758b2012e9+136:73517:x1870854436355072:12345-192.168.203.12@tcp:35:touch.0 00000100:00100000:1.0:1784189335.402781:0:66172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc07ab98a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:debedd94-805c-42a0-a5e5-41758b2012e9+137:73517:x1870854436355072:12345-192.168.203.12@tcp:35:touch.0 Request processed in 255us (412us total) trans 120259084354 rc 0/0 00000100:00100000:1.0:1784189335.402790:0:66172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 264 00000100:00100000:0.0:1784189335.600495:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1784189335.600520:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc07ab9a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1870854458258176:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1784189335.600593:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784189335.600730:0:9466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458258176 00000100:00100000:2.0:1784189335.600738:0:9466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458258176 00000100:00100000:2.0:1784189335.600809:0:9466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2074 00000100:00100000:2.0:1784189335.600819:0:9466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf48599500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1870854458258176:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1784189335.600840:0:9466:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8617408 pending 0 free 3922481152 avail 3690958848 00000100:00100000:2.0:1784189335.600898:0:9466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf48599500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1870854458258176:12345-0@lo:13:osp-pre-0-1.0 Request processed in 79us (304us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189335.600905:0:9466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2074 00000100:00100000:2.0:1784189335.600948:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc07ab9a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1870854458258176:0@lo:13:osp-pre-0-1.0 00000100:00080000:3.0:1784189335.601085:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1784189335.601418:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1784189335.601431:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf4a32dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1870854458258304:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1784189335.601465:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784189335.601537:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458258304 00000100:00100000:0.0:1784189335.601541:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458258304 00000100:00100000:0.0:1784189335.601583:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2075 00000100:00100000:0.0:1784189335.601590:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf470e3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1870854458258304:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1784189335.601609:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8646976 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1784189335.601654:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf470e3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1870854458258304:12345-0@lo:13:osp-pre-1-1.0 Request processed in 65us (189us total) trans 0 rc 0/0 00000100:00100000:0.0:1784189335.601661:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2075 00000100:00080000:3.0:1784189335.601740:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1784189335.601767:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf4a32dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1870854458258304:0@lo:13:osp-pre-1-1.0 00010000:00010000:3.0:1784189336.303596:0:26173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784189337.245228:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1784189337.245368:0:68287:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436355200 00000100:00100000:2.0:1784189337.245377:0:68287:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436355200 00000100:00100000:2.0:1784189337.245457:0:68287:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1508 00000100:00100000:2.0:1784189337.245467:0:68287:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf4a32ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:debedd94-805c-42a0-a5e5-41758b2012e9+137:73545:x1870854436355200:12345-192.168.203.12@tcp:41:lfs.0 00000004:00000024:2.0:1784189337.245507:0:68287:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445249024 avail 1299009536 00000100:00100000:2.0:1784189337.245593:0:68287:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf4a32ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:debedd94-805c-42a0-a5e5-41758b2012e9+137:73545:x1870854436355200:12345-192.168.203.12@tcp:41:lfs.0 Request processed in 127us (373us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189337.245616:0:68287:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1508 00000100:00080000:3.0:1784189337.245680:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1784189337.250930:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1784189337.251089:0:66170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436355328 00000100:00100000:1.0:1784189337.251099:0:66170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436355328 00000100:00100000:1.0:1784189337.251185:0:66170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1509 00000100:00100000:1.0:1784189337.251197:0:66170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc07ab9a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:debedd94-805c-42a0-a5e5-41758b2012e9+11:73545:x1870854436355328:12345-192.168.203.12@tcp:41:lfs.0 00000004:00000024:1.0:1784189337.251235:0:66170:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445568512 avail 1299329024 00000100:00080000:3.0:1784189337.251378:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1784189337.251554:0:66170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc07ab9a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:debedd94-805c-42a0-a5e5-41758b2012e9+11:73545:x1870854436355328:12345-192.168.203.12@tcp:41:lfs.0 Request processed in 359us (631us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189337.251562:0:66170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1509 00000100:00100000:1.0:1784189337.259109:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1784189337.259795:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436355456 00000100:00100000:0.0:1784189337.259807:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436355456 00000100:00100000:0.0:1784189337.260005:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 2076 00000100:00100000:0.0:1784189337.260015:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf4a32ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:debedd94-805c-42a0-a5e5-41758b2012e9+25:73545:x1870854436355456:12345-192.168.203.12@tcp:13:lfs.0 00002000:00000024:0.0:1784189337.260047:0:8432:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8617408 pending 0 free 3922481152 avail 3690958848 00000100:00100000:0.0:1784189337.260419:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf4a32ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:debedd94-805c-42a0-a5e5-41758b2012e9+25:73545:x1870854436355456:12345-192.168.203.12@tcp:13:lfs.0 Request processed in 405us (1318us total) trans 0 rc 0/0 00000100:00100000:0.0:1784189337.260428:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 2076 00000100:00080000:3.0:1784189337.260759:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1784189337.263453:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1784189337.263605:0:9466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436355584 00000100:00100000:1.0:1784189337.263614:0:9466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436355584 00000100:00100000:1.0:1784189337.263679:0:9466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 2077 00000100:00100000:1.0:1784189337.263688:0:9466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf4859bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:debedd94-805c-42a0-a5e5-41758b2012e9+7:73545:x1870854436355584:12345-192.168.203.12@tcp:13:lfs.0 00002000:00000024:1.0:1784189337.263718:0:9466:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8646976 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1784189337.263783:0:9466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf4859bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:debedd94-805c-42a0-a5e5-41758b2012e9+7:73545:x1870854436355584:12345-192.168.203.12@tcp:13:lfs.0 Request processed in 96us (339us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189337.263789:0:9466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 2077 00000100:00080000:3.0:1784189337.266266:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1784189337.331867:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1784189338.095485:0:94304:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 120259084354 is committed 00010000:00010000:1.0:1784189338.095646:0:3627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc058f67200/0xcc1762b626f8cb7e lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189338.095659:0:3627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc058f67200/0xcc1762b626f8cb7e lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189338.095665:0:3627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dc058f67200/0xcc1762b626f8cb7e lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189338.095671:0:3627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc058f67200 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:1.0:1784189338.095676:0:3627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc058f67200/0xcc1762b626f8cb7e lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189338.095683:0:3627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc058f67200/0xcc1762b626f8cb7e lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189338.095700:0:3627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x1134d0c6 (ffff9dbf44851e00) 00010000:00010000:1.0:1784189338.095704:0:3627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784189338.095708:0:3627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dc058f67200/0xcc1762b626f8cb7e lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189338.095715:0:3627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc058f67200/0xcc1762b626f8cb7e lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189338.095743:0:3627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0565e6400/0xcc1762b626f8cb85 lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189338.095750:0:3627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0565e6400/0xcc1762b626f8cb85 lrc: 2/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189338.095757:0:3627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0565e6400/0xcc1762b626f8cb85 lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189338.095761:0:3627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc0565e6400 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:1.0:1784189338.095764:0:3627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0565e6400/0xcc1762b626f8cb85 lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189338.095770:0:3627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0565e6400/0xcc1762b626f8cb85 lrc: 4/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189338.095779:0:3627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x0 (ffff9dbf45994c00) 00010000:00010000:1.0:1784189338.095781:0:3627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784189338.095784:0:3627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0565e6400/0xcc1762b626f8cb85 lrc: 2/0,0 mode: --/TXN res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189338.095792:0:3627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0565e6400/0xcc1762b626f8cb85 lrc: 0/0,0 mode: --/TXN res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189338.095808:0:3627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc042d67200/0xcc1762b626f8cbe0 lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189338.095814:0:3627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc042d67200/0xcc1762b626f8cbe0 lrc: 2/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189338.095820:0:3627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dc042d67200/0xcc1762b626f8cbe0 lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189338.095831:0:3627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc042d67200 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:1.0:1784189338.095834:0:3627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc042d67200/0xcc1762b626f8cbe0 lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189338.095840:0:3627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc042d67200/0xcc1762b626f8cbe0 lrc: 4/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189338.095849:0:3627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x0 (ffff9dbf45994c00) 00010000:00010000:1.0:1784189338.096590:0:3627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1784189338.096614:0:3627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dc042d67200/0xcc1762b626f8cbe0 lrc: 2/0,0 mode: --/TXN res: [0x20000cf21:0x4:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189338.096630:0:3627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc042d67200/0xcc1762b626f8cbe0 lrc: 0/0,0 mode: --/TXN res: [0x20000cf21:0x4:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189338.096681:0:3627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc081b17400/0xcc1762b626f8cc11 lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x9beb5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189338.096689:0:3627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc081b17400/0xcc1762b626f8cc11 lrc: 2/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x9beb5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189338.096695:0:3627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dc081b17400/0xcc1762b626f8cc11 lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x9beb5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189338.096701:0:3627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc081b17400 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:1.0:1784189338.096704:0:3627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc081b17400/0xcc1762b626f8cc11 lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x9beb5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189338.096710:0:3627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc081b17400/0xcc1762b626f8cc11 lrc: 4/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x9beb5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189338.096750:0:3627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x9beb5ca3 (ffff9dc07fab4d00) 00010000:00010000:1.0:1784189338.096753:0:3627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784189338.096763:0:3627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dc081b17400/0xcc1762b626f8cc11 lrc: 2/0,0 mode: --/TXN res: [0x20000cf21:0x4:0x0].0x9beb5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189338.096769:0:3627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc081b17400/0xcc1762b626f8cc11 lrc: 0/0,0 mode: --/TXN res: [0x20000cf21:0x4:0x0].0x9beb5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189338.096795:0:3627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc042d66a00/0xcc1762b626f8cc26 lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189338.096801:0:3627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc042d66a00/0xcc1762b626f8cc26 lrc: 2/0,0 mode: TXN/TXN res: [0x20000cf21:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189338.096806:0:3627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dc042d66a00/0xcc1762b626f8cc26 lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189338.096811:0:3627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc042d66a00 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:1.0:1784189338.096814:0:3627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc042d66a00/0xcc1762b626f8cc26 lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189338.096819:0:3627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc042d66a00/0xcc1762b626f8cc26 lrc: 4/0,0 mode: TXN/TXN res: [0x20000cf21:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189338.096827:0:3627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x6:0x0].0x0 (ffff9dc05a487700) 00010000:00010000:1.0:1784189338.096829:0:3627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784189338.096832:0:3627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dc042d66a00/0xcc1762b626f8cc26 lrc: 2/0,0 mode: --/TXN res: [0x20000cf21:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189338.096837:0:3627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc042d66a00/0xcc1762b626f8cc26 lrc: 0/0,0 mode: --/TXN res: [0x20000cf21:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189338.097116:0:3627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc081b16800/0xcc1762b626f8cc42 lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0xe44515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189338.097122:0:3627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc081b16800/0xcc1762b626f8cc42 lrc: 2/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0xe44515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189338.097127:0:3627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dc081b16800/0xcc1762b626f8cc42 lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0xe44515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189338.097133:0:3627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc081b16800 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:1.0:1784189338.097136:0:3627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc081b16800/0xcc1762b626f8cc42 lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0xe44515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189338.097142:0:3627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc081b16800/0xcc1762b626f8cc42 lrc: 4/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0xe44515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189338.097151:0:3627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0xe44515a3 (ffff9dc07fab4700) 00010000:00010000:1.0:1784189338.097153:0:3627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784189338.097156:0:3627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dc081b16800/0xcc1762b626f8cc42 lrc: 2/0,0 mode: --/TXN res: [0x20000cf21:0x4:0x0].0xe44515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189338.097226:0:3627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc081b16800/0xcc1762b626f8cc42 lrc: 0/0,0 mode: --/TXN res: [0x20000cf21:0x4:0x0].0xe44515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189338.097254:0:3627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0565e7000/0xcc1762b626f8cc57 lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189338.097261:0:3627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0565e7000/0xcc1762b626f8cc57 lrc: 2/0,0 mode: TXN/TXN res: [0x20000cf21:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189338.097267:0:3627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0565e7000/0xcc1762b626f8cc57 lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189338.097278:0:3627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc0565e7000 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:1.0:1784189338.097282:0:3627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0565e7000/0xcc1762b626f8cc57 lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189338.097289:0:3627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0565e7000/0xcc1762b626f8cc57 lrc: 4/0,0 mode: TXN/TXN res: [0x20000cf21:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189338.097297:0:3627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x7:0x0].0x0 (ffff9dbf45994300) 00010000:00010000:1.0:1784189338.097300:0:3627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784189338.097303:0:3627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0565e7000/0xcc1762b626f8cc57 lrc: 2/0,0 mode: --/TXN res: [0x20000cf21:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189338.097308:0:3627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0565e7000/0xcc1762b626f8cc57 lrc: 0/0,0 mode: --/TXN res: [0x20000cf21:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189338.097340:0:3627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc081b16e00/0xcc1762b626f8cc73 lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x2c9ecea3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189338.097348:0:3627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc081b16e00/0xcc1762b626f8cc73 lrc: 2/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x2c9ecea3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189338.097354:0:3627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dc081b16e00/0xcc1762b626f8cc73 lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x2c9ecea3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189338.097359:0:3627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc081b16e00 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:1.0:1784189338.097362:0:3627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc081b16e00/0xcc1762b626f8cc73 lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x2c9ecea3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189338.097368:0:3627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc081b16e00/0xcc1762b626f8cc73 lrc: 4/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x2c9ecea3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189338.097386:0:3627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x2c9ecea3 (ffff9dc07fab4200) 00010000:00010000:1.0:1784189338.097389:0:3627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784189338.097392:0:3627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dc081b16e00/0xcc1762b626f8cc73 lrc: 2/0,0 mode: --/TXN res: [0x20000cf21:0x4:0x0].0x2c9ecea3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189338.097397:0:3627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc081b16e00/0xcc1762b626f8cc73 lrc: 0/0,0 mode: --/TXN res: [0x20000cf21:0x4:0x0].0x2c9ecea3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189338.097425:0:3627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0565e6c00/0xcc1762b626f8cc88 lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189338.097432:0:3627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0565e6c00/0xcc1762b626f8cc88 lrc: 2/0,0 mode: TXN/TXN res: [0x20000cf21:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189338.097438:0:3627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0565e6c00/0xcc1762b626f8cc88 lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189338.097443:0:3627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc0565e6c00 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:1.0:1784189338.097446:0:3627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0565e6c00/0xcc1762b626f8cc88 lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189338.097451:0:3627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0565e6c00/0xcc1762b626f8cc88 lrc: 4/0,0 mode: TXN/TXN res: [0x20000cf21:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189338.097458:0:3627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x8:0x0].0x0 (ffff9dbf45994f00) 00010000:00010000:1.0:1784189338.097461:0:3627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784189338.097463:0:3627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0565e6c00/0xcc1762b626f8cc88 lrc: 2/0,0 mode: --/TXN res: [0x20000cf21:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189338.097469:0:3627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0565e6c00/0xcc1762b626f8cc88 lrc: 0/0,0 mode: --/TXN res: [0x20000cf21:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189338.097501:0:3627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc05ec0fe00/0xcc1762b626f8cca4 lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x74f887a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189338.097507:0:3627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc05ec0fe00/0xcc1762b626f8cca4 lrc: 2/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x74f887a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189338.097523:0:3627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dc05ec0fe00/0xcc1762b626f8cca4 lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x74f887a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189338.097527:0:3627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc05ec0fe00 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:1.0:1784189338.097536:0:3627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc05ec0fe00/0xcc1762b626f8cca4 lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x74f887a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189338.097541:0:3627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc05ec0fe00/0xcc1762b626f8cca4 lrc: 4/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x74f887a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1784189338.097554:0:8423:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294968977 is committed 00000001:00080000:0.0:1784189338.097576:0:8423:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294968973 is committed 00010000:00010000:1.0:1784189338.098782:0:3627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x74f887a3 (ffff9dc07fab4900) 00010000:00010000:1.0:1784189338.098789:0:3627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784189338.098795:0:3627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dc05ec0fe00/0xcc1762b626f8cca4 lrc: 2/0,0 mode: --/TXN res: [0x20000cf21:0x4:0x0].0x74f887a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189338.098803:0:3627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc05ec0fe00/0xcc1762b626f8cca4 lrc: 0/0,0 mode: --/TXN res: [0x20000cf21:0x4:0x0].0x74f887a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189338.098839:0:3627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc05ec0ea00/0xcc1762b626f8ccb9 lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189338.098846:0:3627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc05ec0ea00/0xcc1762b626f8ccb9 lrc: 2/0,0 mode: TXN/TXN res: [0x20000cf21:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189338.098862:0:3627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dc05ec0ea00/0xcc1762b626f8ccb9 lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189338.098879:0:3627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc05ec0ea00 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:1.0:1784189338.098883:0:3627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc05ec0ea00/0xcc1762b626f8ccb9 lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189338.098889:0:3627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc05ec0ea00/0xcc1762b626f8ccb9 lrc: 4/0,0 mode: TXN/TXN res: [0x20000cf21:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189338.098900:0:3627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x9:0x0].0x0 (ffff9dc07fab4300) 00010000:00010000:1.0:1784189338.098902:0:3627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784189338.098905:0:3627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dc05ec0ea00/0xcc1762b626f8ccb9 lrc: 2/0,0 mode: --/TXN res: [0x20000cf21:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189338.098911:0:3627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc05ec0ea00/0xcc1762b626f8ccb9 lrc: 0/0,0 mode: --/TXN res: [0x20000cf21:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189338.098923:0:3627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc042d66600/0xcc1762b626f8ccd5 lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0xbd5240a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189338.098929:0:3627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc042d66600/0xcc1762b626f8ccd5 lrc: 2/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0xbd5240a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189338.098934:0:3627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dc042d66600/0xcc1762b626f8ccd5 lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0xbd5240a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189338.098938:0:3627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc042d66600 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:1.0:1784189338.098941:0:3627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc042d66600/0xcc1762b626f8ccd5 lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0xbd5240a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189338.098947:0:3627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc042d66600/0xcc1762b626f8ccd5 lrc: 4/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0xbd5240a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189338.098965:0:3627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0xbd5240a3 (ffff9dc05a487200) 00010000:00010000:1.0:1784189338.098968:0:3627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784189338.098971:0:3627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dc042d66600/0xcc1762b626f8ccd5 lrc: 2/0,0 mode: --/TXN res: [0x20000cf21:0x4:0x0].0xbd5240a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189338.098977:0:3627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc042d66600/0xcc1762b626f8ccd5 lrc: 0/0,0 mode: --/TXN res: [0x20000cf21:0x4:0x0].0xbd5240a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189338.098992:0:3627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc042d66c00/0xcc1762b626f8ccea lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189338.098998:0:3627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc042d66c00/0xcc1762b626f8ccea lrc: 2/0,0 mode: TXN/TXN res: [0x20000cf21:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189338.099003:0:3627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dc042d66c00/0xcc1762b626f8ccea lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189338.099008:0:3627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc042d66c00 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:1.0:1784189338.099011:0:3627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc042d66c00/0xcc1762b626f8ccea lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189338.099017:0:3627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc042d66c00/0xcc1762b626f8ccea lrc: 4/0,0 mode: TXN/TXN res: [0x20000cf21:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189338.099024:0:3627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0xa:0x0].0x0 (ffff9dc05a487100) 00010000:00010000:1.0:1784189338.099026:0:3627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784189338.099029:0:3627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dc042d66c00/0xcc1762b626f8ccea lrc: 2/0,0 mode: --/TXN res: [0x20000cf21:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189338.099035:0:3627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc042d66c00/0xcc1762b626f8ccea lrc: 0/0,0 mode: --/TXN res: [0x20000cf21:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189338.099071:0:3627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc042d66200/0xcc1762b626f8cd06 lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x5abf9a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189338.099077:0:3627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc042d66200/0xcc1762b626f8cd06 lrc: 2/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x5abf9a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189338.099083:0:3627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dc042d66200/0xcc1762b626f8cd06 lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x5abf9a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189338.099088:0:3627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc042d66200 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:1.0:1784189338.099091:0:3627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc042d66200/0xcc1762b626f8cd06 lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x5abf9a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189338.099098:0:3627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc042d66200/0xcc1762b626f8cd06 lrc: 4/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x5abf9a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189338.099106:0:3627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x5abf9a3 (ffff9dc05a487e00) 00010000:00010000:1.0:1784189338.099108:0:3627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784189338.099111:0:3627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dc042d66200/0xcc1762b626f8cd06 lrc: 2/0,0 mode: --/TXN res: [0x20000cf21:0x4:0x0].0x5abf9a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189338.099116:0:3627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc042d66200/0xcc1762b626f8cd06 lrc: 0/0,0 mode: --/TXN res: [0x20000cf21:0x4:0x0].0x5abf9a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189338.099141:0:3627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc042d66400/0xcc1762b626f8cd1b lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189338.099149:0:3627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc042d66400/0xcc1762b626f8cd1b lrc: 2/0,0 mode: TXN/TXN res: [0x20000cf21:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189338.099155:0:3627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dc042d66400/0xcc1762b626f8cd1b lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189338.099167:0:3627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc042d66400 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:1.0:1784189338.099171:0:3627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc042d66400/0xcc1762b626f8cd1b lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189338.099177:0:3627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc042d66400/0xcc1762b626f8cd1b lrc: 4/0,0 mode: TXN/TXN res: [0x20000cf21:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189338.099186:0:3627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0xb:0x0].0x0 (ffff9dc05a487c00) 00010000:00010000:1.0:1784189338.099188:0:3627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784189338.099191:0:3627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dc042d66400/0xcc1762b626f8cd1b lrc: 2/0,0 mode: --/TXN res: [0x20000cf21:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189338.099197:0:3627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc042d66400/0xcc1762b626f8cd1b lrc: 0/0,0 mode: --/TXN res: [0x20000cf21:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189338.099211:0:3627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0565e7200/0xcc1762b626f8cd37 lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x4e05b2a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189338.099217:0:3627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0565e7200/0xcc1762b626f8cd37 lrc: 2/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x4e05b2a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189338.099222:0:3627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0565e7200/0xcc1762b626f8cd37 lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x4e05b2a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189338.099227:0:3627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc0565e7200 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:1.0:1784189338.099230:0:3627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0565e7200/0xcc1762b626f8cd37 lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x4e05b2a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189338.099234:0:3627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0565e7200/0xcc1762b626f8cd37 lrc: 4/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x4e05b2a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189338.099252:0:3627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x4e05b2a3 (ffff9dbf45994700) 00010000:00010000:1.0:1784189338.099254:0:3627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784189338.099256:0:3627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0565e7200/0xcc1762b626f8cd37 lrc: 2/0,0 mode: --/TXN res: [0x20000cf21:0x4:0x0].0x4e05b2a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189338.099262:0:3627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0565e7200/0xcc1762b626f8cd37 lrc: 0/0,0 mode: --/TXN res: [0x20000cf21:0x4:0x0].0x4e05b2a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189338.099289:0:3627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc05ec0fc00/0xcc1762b626f8cd4c lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0xc:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189338.099295:0:3627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc05ec0fc00/0xcc1762b626f8cd4c lrc: 2/0,0 mode: TXN/TXN res: [0x20000cf21:0xc:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189338.099300:0:3627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dc05ec0fc00/0xcc1762b626f8cd4c lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0xc:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189338.099305:0:3627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc05ec0fc00 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:1.0:1784189338.099307:0:3627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc05ec0fc00/0xcc1762b626f8cd4c lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0xc:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189338.099313:0:3627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc05ec0fc00/0xcc1762b626f8cd4c lrc: 4/0,0 mode: TXN/TXN res: [0x20000cf21:0xc:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189338.099336:0:3627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0xc:0x0].0x0 (ffff9dc07fab4500) 00010000:00010000:1.0:1784189338.099338:0:3627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784189338.099341:0:3627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dc05ec0fc00/0xcc1762b626f8cd4c lrc: 2/0,0 mode: --/TXN res: [0x20000cf21:0xc:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189338.099347:0:3627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc05ec0fc00/0xcc1762b626f8cd4c lrc: 0/0,0 mode: --/TXN res: [0x20000cf21:0xc:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189338.099380:0:3627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04152d400/0xcc1762b626f8cd68 lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x965f6ba3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189338.099387:0:3627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04152d400/0xcc1762b626f8cd68 lrc: 2/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x965f6ba3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189338.099392:0:3627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04152d400/0xcc1762b626f8cd68 lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x965f6ba3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189338.099397:0:3627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc04152d400 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:1.0:1784189338.099401:0:3627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04152d400/0xcc1762b626f8cd68 lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x965f6ba3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189338.099406:0:3627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04152d400/0xcc1762b626f8cd68 lrc: 4/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x965f6ba3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189338.099415:0:3627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x965f6ba3 (ffff9dc05a487400) 00010000:00010000:1.0:1784189338.099418:0:3627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784189338.099420:0:3627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04152d400/0xcc1762b626f8cd68 lrc: 2/0,0 mode: --/TXN res: [0x20000cf21:0x4:0x0].0x965f6ba3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189338.099426:0:3627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04152d400/0xcc1762b626f8cd68 lrc: 0/0,0 mode: --/TXN res: [0x20000cf21:0x4:0x0].0x965f6ba3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189338.099441:0:3627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc05ec0e000/0xcc1762b626f8cd7d lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0xd:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189338.099448:0:3627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc05ec0e000/0xcc1762b626f8cd7d lrc: 2/0,0 mode: TXN/TXN res: [0x20000cf21:0xd:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189338.099454:0:3627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dc05ec0e000/0xcc1762b626f8cd7d lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0xd:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189338.099479:0:3627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc05ec0e000 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:1.0:1784189338.099483:0:3627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc05ec0e000/0xcc1762b626f8cd7d lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0xd:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189338.099489:0:3627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc05ec0e000/0xcc1762b626f8cd7d lrc: 4/0,0 mode: TXN/TXN res: [0x20000cf21:0xd:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189338.099497:0:3627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0xd:0x0].0x0 (ffff9dc07fab4a00) 00010000:00010000:1.0:1784189338.099499:0:3627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784189338.099502:0:3627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dc05ec0e000/0xcc1762b626f8cd7d lrc: 2/0,0 mode: --/TXN res: [0x20000cf21:0xd:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189338.099507:0:3627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc05ec0e000/0xcc1762b626f8cd7d lrc: 0/0,0 mode: --/TXN res: [0x20000cf21:0xd:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189338.099519:0:3627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04152c600/0xcc1762b626f8cd99 lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0xdeb924a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189338.099526:0:3627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04152c600/0xcc1762b626f8cd99 lrc: 2/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0xdeb924a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189338.099544:0:3627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04152c600/0xcc1762b626f8cd99 lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0xdeb924a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189338.100738:0:3627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc04152c600 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:1.0:1784189338.100742:0:3627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04152c600/0xcc1762b626f8cd99 lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0xdeb924a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189338.100750:0:3627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04152c600/0xcc1762b626f8cd99 lrc: 4/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0xdeb924a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189338.100774:0:3627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0xdeb924a3 (ffff9dc05a487900) 00010000:00010000:1.0:1784189338.100777:0:3627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784189338.100780:0:3627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04152c600/0xcc1762b626f8cd99 lrc: 2/0,0 mode: --/TXN res: [0x20000cf21:0x4:0x0].0xdeb924a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189338.100786:0:3627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04152c600/0xcc1762b626f8cd99 lrc: 0/0,0 mode: --/TXN res: [0x20000cf21:0x4:0x0].0xdeb924a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189338.100807:0:3627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc058f66000/0xcc1762b626f8cdae lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189338.100815:0:3627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc058f66000/0xcc1762b626f8cdae lrc: 2/0,0 mode: TXN/TXN res: [0x20000cf21:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189338.100821:0:3627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dc058f66000/0xcc1762b626f8cdae lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189338.100827:0:3627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc058f66000 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:1.0:1784189338.100830:0:3627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc058f66000/0xcc1762b626f8cdae lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189338.100837:0:3627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc058f66000/0xcc1762b626f8cdae lrc: 4/0,0 mode: TXN/TXN res: [0x20000cf21:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189338.100846:0:3627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0xe:0x0].0x0 (ffff9dbf44851400) 00010000:00010000:1.0:1784189338.100848:0:3627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784189338.100861:0:3627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dc058f66000/0xcc1762b626f8cdae lrc: 2/0,0 mode: --/TXN res: [0x20000cf21:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189338.100868:0:3627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc058f66000/0xcc1762b626f8cdae lrc: 0/0,0 mode: --/TXN res: [0x20000cf21:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189338.100889:0:3627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04152ca00/0xcc1762b626f8cdca lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x6e9b5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189338.100895:0:3627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04152ca00/0xcc1762b626f8cdca lrc: 2/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x6e9b5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189338.100901:0:3627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04152ca00/0xcc1762b626f8cdca lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x6e9b5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189338.100906:0:3627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc04152ca00 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:1.0:1784189338.100909:0:3627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04152ca00/0xcc1762b626f8cdca lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x6e9b5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189338.100914:0:3627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04152ca00/0xcc1762b626f8cdca lrc: 4/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x6e9b5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189338.100922:0:3627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x6e9b5ca3 (ffff9dc05a487d00) 00010000:00010000:1.0:1784189338.100925:0:3627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784189338.100928:0:3627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04152ca00/0xcc1762b626f8cdca lrc: 2/0,0 mode: --/TXN res: [0x20000cf21:0x4:0x0].0x6e9b5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189338.100933:0:3627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04152ca00/0xcc1762b626f8cdca lrc: 0/0,0 mode: --/TXN res: [0x20000cf21:0x4:0x0].0x6e9b5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189338.100960:0:3627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04152d800/0xcc1762b626f8cddf lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0xf:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189338.100967:0:3627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04152d800/0xcc1762b626f8cddf lrc: 2/0,0 mode: TXN/TXN res: [0x20000cf21:0xf:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189338.100973:0:3627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04152d800/0xcc1762b626f8cddf lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0xf:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189338.100984:0:3627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc04152d800 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:1.0:1784189338.100987:0:3627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04152d800/0xcc1762b626f8cddf lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0xf:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189338.100993:0:3627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04152d800/0xcc1762b626f8cddf lrc: 4/0,0 mode: TXN/TXN res: [0x20000cf21:0xf:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189338.101002:0:3627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0xf:0x0].0x0 (ffff9dc05a487f00) 00010000:00010000:1.0:1784189338.101004:0:3627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784189338.101007:0:3627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04152d800/0xcc1762b626f8cddf lrc: 2/0,0 mode: --/TXN res: [0x20000cf21:0xf:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189338.101012:0:3627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04152d800/0xcc1762b626f8cddf lrc: 0/0,0 mode: --/TXN res: [0x20000cf21:0xf:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189338.101025:0:3627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04152c200/0xcc1762b626f8cdfb lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0xc8545ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189338.101030:0:3627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04152c200/0xcc1762b626f8cdfb lrc: 2/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0xc8545ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189338.101037:0:3627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04152c200/0xcc1762b626f8cdfb lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0xc8545ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189338.101042:0:3627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc04152c200 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:1.0:1784189338.101045:0:3627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04152c200/0xcc1762b626f8cdfb lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0xc8545ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189338.101051:0:3627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04152c200/0xcc1762b626f8cdfb lrc: 4/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0xc8545ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189338.101068:0:3627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0xc8545ca3 (ffff9dc05a487800) 00010000:00010000:1.0:1784189338.101071:0:3627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784189338.101073:0:3627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04152c200/0xcc1762b626f8cdfb lrc: 2/0,0 mode: --/TXN res: [0x20000cf21:0x4:0x0].0xc8545ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189338.101079:0:3627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04152c200/0xcc1762b626f8cdfb lrc: 0/0,0 mode: --/TXN res: [0x20000cf21:0x4:0x0].0xc8545ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189338.101094:0:3627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04152d600/0xcc1762b626f8ce10 lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x10:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189338.101101:0:3627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04152d600/0xcc1762b626f8ce10 lrc: 2/0,0 mode: TXN/TXN res: [0x20000cf21:0x10:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189338.101107:0:3627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04152d600/0xcc1762b626f8ce10 lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x10:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189338.101112:0:3627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc04152d600 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:1.0:1784189338.101114:0:3627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04152d600/0xcc1762b626f8ce10 lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x10:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189338.101121:0:3627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04152d600/0xcc1762b626f8ce10 lrc: 4/0,0 mode: TXN/TXN res: [0x20000cf21:0x10:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189338.101129:0:3627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x10:0x0].0x0 (ffff9dc05a487b00) 00010000:00010000:1.0:1784189338.101131:0:3627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784189338.101135:0:3627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04152d600/0xcc1762b626f8ce10 lrc: 2/0,0 mode: --/TXN res: [0x20000cf21:0x10:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189338.101141:0:3627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04152d600/0xcc1762b626f8ce10 lrc: 0/0,0 mode: --/TXN res: [0x20000cf21:0x10:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189338.101815:0:3627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc05ec0f000/0xcc1762b626f8ce2c lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x220d5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189338.101826:0:3627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc05ec0f000/0xcc1762b626f8ce2c lrc: 2/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x220d5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189338.101833:0:3627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dc05ec0f000/0xcc1762b626f8ce2c lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x220d5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189338.101839:0:3627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc05ec0f000 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:1.0:1784189338.101842:0:3627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc05ec0f000/0xcc1762b626f8ce2c lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x220d5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189338.101848:0:3627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc05ec0f000/0xcc1762b626f8ce2c lrc: 4/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x220d5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189338.101868:0:3627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x220d5ca3 (ffff9dc07fab4600) 00010000:00010000:1.0:1784189338.101870:0:3627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784189338.101873:0:3627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dc05ec0f000/0xcc1762b626f8ce2c lrc: 2/0,0 mode: --/TXN res: [0x20000cf21:0x4:0x0].0x220d5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189338.101879:0:3627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc05ec0f000/0xcc1762b626f8ce2c lrc: 0/0,0 mode: --/TXN res: [0x20000cf21:0x4:0x0].0x220d5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189338.101907:0:3627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04152d200/0xcc1762b626f8ce41 lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x11:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189338.101913:0:3627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04152d200/0xcc1762b626f8ce41 lrc: 2/0,0 mode: TXN/TXN res: [0x20000cf21:0x11:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189338.101919:0:3627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04152d200/0xcc1762b626f8ce41 lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x11:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189338.101931:0:3627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc04152d200 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:1.0:1784189338.101934:0:3627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04152d200/0xcc1762b626f8ce41 lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x11:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189338.101940:0:3627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04152d200/0xcc1762b626f8ce41 lrc: 4/0,0 mode: TXN/TXN res: [0x20000cf21:0x11:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189338.101948:0:3627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x11:0x0].0x0 (ffff9dc05a487000) 00010000:00010000:1.0:1784189338.101951:0:3627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784189338.101954:0:3627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04152d200/0xcc1762b626f8ce41 lrc: 2/0,0 mode: --/TXN res: [0x20000cf21:0x11:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189338.101959:0:3627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04152d200/0xcc1762b626f8ce41 lrc: 0/0,0 mode: --/TXN res: [0x20000cf21:0x11:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189338.101972:0:3627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc07116e400/0xcc1762b626f8ce5d lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x7bc65ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189338.101977:0:3627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc07116e400/0xcc1762b626f8ce5d lrc: 2/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x7bc65ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189338.101982:0:3627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dc07116e400/0xcc1762b626f8ce5d lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x7bc65ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189338.101987:0:3627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc07116e400 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:1.0:1784189338.101990:0:3627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc07116e400/0xcc1762b626f8ce5d lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x7bc65ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189338.101995:0:3627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc07116e400/0xcc1762b626f8ce5d lrc: 4/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x7bc65ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189338.102013:0:3627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x7bc65ca3 (ffff9dc07499b700) 00010000:00010000:1.0:1784189338.102015:0:3627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784189338.102018:0:3627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dc07116e400/0xcc1762b626f8ce5d lrc: 2/0,0 mode: --/TXN res: [0x20000cf21:0x4:0x0].0x7bc65ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189338.102024:0:3627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc07116e400/0xcc1762b626f8ce5d lrc: 0/0,0 mode: --/TXN res: [0x20000cf21:0x4:0x0].0x7bc65ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189338.102040:0:3627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc081b17a00/0xcc1762b626f8ce72 lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x12:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189338.102046:0:3627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc081b17a00/0xcc1762b626f8ce72 lrc: 2/0,0 mode: TXN/TXN res: [0x20000cf21:0x12:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189338.102052:0:3627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dc081b17a00/0xcc1762b626f8ce72 lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x12:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189338.102057:0:3627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc081b17a00 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:1.0:1784189338.102060:0:3627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc081b17a00/0xcc1762b626f8ce72 lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x12:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189338.102066:0:3627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc081b17a00/0xcc1762b626f8ce72 lrc: 4/0,0 mode: TXN/TXN res: [0x20000cf21:0x12:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189338.102073:0:3627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x12:0x0].0x0 (ffff9dc07fab4400) 00010000:00010000:1.0:1784189338.102075:0:3627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784189338.102078:0:3627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dc081b17a00/0xcc1762b626f8ce72 lrc: 2/0,0 mode: --/TXN res: [0x20000cf21:0x12:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189338.102084:0:3627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc081b17a00/0xcc1762b626f8ce72 lrc: 0/0,0 mode: --/TXN res: [0x20000cf21:0x12:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189338.102105:0:3627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4710e400/0xcc1762b626f8ce8e lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0xd57f5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189338.102112:0:3627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4710e400/0xcc1762b626f8ce8e lrc: 2/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0xd57f5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189338.102118:0:3627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4710e400/0xcc1762b626f8ce8e lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0xd57f5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189338.102123:0:3627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dbf4710e400 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:1.0:1784189338.102126:0:3627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4710e400/0xcc1762b626f8ce8e lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0xd57f5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189338.102131:0:3627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4710e400/0xcc1762b626f8ce8e lrc: 4/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0xd57f5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189338.102140:0:3627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0xd57f5ca3 (ffff9dbf45994400) 00010000:00010000:1.0:1784189338.102143:0:3627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784189338.102146:0:3627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4710e400/0xcc1762b626f8ce8e lrc: 2/0,0 mode: --/TXN res: [0x20000cf21:0x4:0x0].0xd57f5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189338.102152:0:3627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4710e400/0xcc1762b626f8ce8e lrc: 0/0,0 mode: --/TXN res: [0x20000cf21:0x4:0x0].0xd57f5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189338.102883:0:3627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc07116ec00/0xcc1762b626f8cea3 lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x13:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189338.102892:0:3627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc07116ec00/0xcc1762b626f8cea3 lrc: 2/0,0 mode: TXN/TXN res: [0x20000cf21:0x13:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189338.102898:0:3627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dc07116ec00/0xcc1762b626f8cea3 lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x13:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189338.102910:0:3627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc07116ec00 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:1.0:1784189338.102914:0:3627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc07116ec00/0xcc1762b626f8cea3 lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x13:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189338.102921:0:3627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc07116ec00/0xcc1762b626f8cea3 lrc: 4/0,0 mode: TXN/TXN res: [0x20000cf21:0x13:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189338.102931:0:3627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x13:0x0].0x0 (ffff9dc07499be00) 00010000:00010000:1.0:1784189338.102933:0:3627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784189338.102937:0:3627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dc07116ec00/0xcc1762b626f8cea3 lrc: 2/0,0 mode: --/TXN res: [0x20000cf21:0x13:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189338.102943:0:3627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc07116ec00/0xcc1762b626f8cea3 lrc: 0/0,0 mode: --/TXN res: [0x20000cf21:0x13:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189338.102956:0:3627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc070147800/0xcc1762b626f8cebf lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x2f385ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189338.102962:0:3627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc070147800/0xcc1762b626f8cebf lrc: 2/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x2f385ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189338.102967:0:3627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dc070147800/0xcc1762b626f8cebf lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x2f385ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189338.102972:0:3627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc070147800 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:1.0:1784189338.102975:0:3627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc070147800/0xcc1762b626f8cebf lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x2f385ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189338.102981:0:3627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc070147800/0xcc1762b626f8cebf lrc: 4/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x2f385ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189338.102998:0:3627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x2f385ca3 (ffff9dc07fab4c00) 00010000:00010000:1.0:1784189338.103000:0:3627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784189338.103003:0:3627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dc070147800/0xcc1762b626f8cebf lrc: 2/0,0 mode: --/TXN res: [0x20000cf21:0x4:0x0].0x2f385ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189338.103009:0:3627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc070147800/0xcc1762b626f8cebf lrc: 0/0,0 mode: --/TXN res: [0x20000cf21:0x4:0x0].0x2f385ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189338.103025:0:3627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc07116e800/0xcc1762b626f8ced4 lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x14:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189338.103030:0:3627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc07116e800/0xcc1762b626f8ced4 lrc: 2/0,0 mode: TXN/TXN res: [0x20000cf21:0x14:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189338.103036:0:3627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dc07116e800/0xcc1762b626f8ced4 lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x14:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189338.103041:0:3627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc07116e800 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:1.0:1784189338.103044:0:3627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc07116e800/0xcc1762b626f8ced4 lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x14:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189338.103050:0:3627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc07116e800/0xcc1762b626f8ced4 lrc: 4/0,0 mode: TXN/TXN res: [0x20000cf21:0x14:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189338.103057:0:3627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x14:0x0].0x0 (ffff9dc07499b800) 00010000:00010000:1.0:1784189338.103059:0:3627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784189338.103062:0:3627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dc07116e800/0xcc1762b626f8ced4 lrc: 2/0,0 mode: --/TXN res: [0x20000cf21:0x14:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189338.103067:0:3627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc07116e800/0xcc1762b626f8ced4 lrc: 0/0,0 mode: --/TXN res: [0x20000cf21:0x14:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189338.103089:0:3627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc070146a00/0xcc1762b626f8cef0 lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x88f15ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189338.103094:0:3627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc070146a00/0xcc1762b626f8cef0 lrc: 2/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x88f15ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189338.103101:0:3627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dc070146a00/0xcc1762b626f8cef0 lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x88f15ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189338.103106:0:3627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc070146a00 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:1.0:1784189338.103110:0:3627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc070146a00/0xcc1762b626f8cef0 lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x88f15ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189338.103115:0:3627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc070146a00/0xcc1762b626f8cef0 lrc: 4/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x88f15ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189338.103123:0:3627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x88f15ca3 (ffff9dc07fab4f00) 00010000:00010000:1.0:1784189338.103125:0:3627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784189338.103128:0:3627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dc070146a00/0xcc1762b626f8cef0 lrc: 2/0,0 mode: --/TXN res: [0x20000cf21:0x4:0x0].0x88f15ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189338.103133:0:3627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc070146a00/0xcc1762b626f8cef0 lrc: 0/0,0 mode: --/TXN res: [0x20000cf21:0x4:0x0].0x88f15ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189338.103146:0:3627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc070147a00/0xcc1762b626f8cf05 lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x15:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189338.103152:0:3627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc070147a00/0xcc1762b626f8cf05 lrc: 2/0,0 mode: TXN/TXN res: [0x20000cf21:0x15:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189338.103169:0:3627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dc070147a00/0xcc1762b626f8cf05 lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x15:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189338.103181:0:3627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc070147a00 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:1.0:1784189338.103185:0:3627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc070147a00/0xcc1762b626f8cf05 lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x15:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189338.103190:0:3627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc070147a00/0xcc1762b626f8cf05 lrc: 4/0,0 mode: TXN/TXN res: [0x20000cf21:0x15:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189338.103199:0:3627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x15:0x0].0x0 (ffff9dc07fab4000) 00010000:00010000:1.0:1784189338.103202:0:3627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784189338.103205:0:3627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dc070147a00/0xcc1762b626f8cf05 lrc: 2/0,0 mode: --/TXN res: [0x20000cf21:0x15:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189338.103210:0:3627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc070147a00/0xcc1762b626f8cf05 lrc: 0/0,0 mode: --/TXN res: [0x20000cf21:0x15:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189338.103222:0:3627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc07116f800/0xcc1762b626f8cf21 lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0xe2aa5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189338.103228:0:3627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc07116f800/0xcc1762b626f8cf21 lrc: 2/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0xe2aa5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189338.103234:0:3627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dc07116f800/0xcc1762b626f8cf21 lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0xe2aa5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189338.103239:0:3627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc07116f800 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:1.0:1784189338.103242:0:3627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc07116f800/0xcc1762b626f8cf21 lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0xe2aa5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189338.103248:0:3627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc07116f800/0xcc1762b626f8cf21 lrc: 4/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0xe2aa5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189338.103266:0:3627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0xe2aa5ca3 (ffff9dc07499b500) 00010000:00010000:1.0:1784189338.103268:0:3627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784189338.103271:0:3627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dc07116f800/0xcc1762b626f8cf21 lrc: 2/0,0 mode: --/TXN res: [0x20000cf21:0x4:0x0].0xe2aa5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189338.103277:0:3627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc07116f800/0xcc1762b626f8cf21 lrc: 0/0,0 mode: --/TXN res: [0x20000cf21:0x4:0x0].0xe2aa5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189338.103293:0:3627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc058f66200/0xcc1762b626f8cf36 lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189338.103299:0:3627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc058f66200/0xcc1762b626f8cf36 lrc: 2/0,0 mode: TXN/TXN res: [0x20000cf21:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189338.103304:0:3627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dc058f66200/0xcc1762b626f8cf36 lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189338.103309:0:3627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc058f66200 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:1.0:1784189338.103312:0:3627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc058f66200/0xcc1762b626f8cf36 lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189338.103345:0:3627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc058f66200/0xcc1762b626f8cf36 lrc: 4/0,0 mode: TXN/TXN res: [0x20000cf21:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189338.103354:0:3627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x16:0x0].0x0 (ffff9dbf44851900) 00010000:00010000:1.0:1784189338.103356:0:3627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784189338.103358:0:3627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dc058f66200/0xcc1762b626f8cf36 lrc: 2/0,0 mode: --/TXN res: [0x20000cf21:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189338.103364:0:3627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc058f66200/0xcc1762b626f8cf36 lrc: 0/0,0 mode: --/TXN res: [0x20000cf21:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189338.103388:0:3627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc070147c00/0xcc1762b626f8cf52 lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x3c635ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189338.103394:0:3627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc070147c00/0xcc1762b626f8cf52 lrc: 2/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x3c635ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189338.103401:0:3627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dc070147c00/0xcc1762b626f8cf52 lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x3c635ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189338.103406:0:3627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc070147c00 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:1.0:1784189338.103409:0:3627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc070147c00/0xcc1762b626f8cf52 lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x3c635ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189338.103414:0:3627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc070147c00/0xcc1762b626f8cf52 lrc: 4/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x3c635ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189338.103422:0:3627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x3c635ca3 (ffff9dc07fab4100) 00010000:00010000:1.0:1784189338.103424:0:3627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784189338.103427:0:3627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dc070147c00/0xcc1762b626f8cf52 lrc: 2/0,0 mode: --/TXN res: [0x20000cf21:0x4:0x0].0x3c635ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189338.103431:0:3627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc070147c00/0xcc1762b626f8cf52 lrc: 0/0,0 mode: --/TXN res: [0x20000cf21:0x4:0x0].0x3c635ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189338.103444:0:3627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc058f66800/0xcc1762b626f8cf67 lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x17:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189338.103450:0:3627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc058f66800/0xcc1762b626f8cf67 lrc: 2/0,0 mode: TXN/TXN res: [0x20000cf21:0x17:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189338.103455:0:3627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dc058f66800/0xcc1762b626f8cf67 lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x17:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189338.103467:0:3627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc058f66800 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:1.0:1784189338.103470:0:3627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc058f66800/0xcc1762b626f8cf67 lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x17:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189338.103475:0:3627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc058f66800/0xcc1762b626f8cf67 lrc: 4/0,0 mode: TXN/TXN res: [0x20000cf21:0x17:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189338.103483:0:3627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x17:0x0].0x0 (ffff9dbf44851b00) 00010000:00010000:1.0:1784189338.103485:0:3627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784189338.103488:0:3627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dc058f66800/0xcc1762b626f8cf67 lrc: 2/0,0 mode: --/TXN res: [0x20000cf21:0x17:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189338.103493:0:3627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc058f66800/0xcc1762b626f8cf67 lrc: 0/0,0 mode: --/TXN res: [0x20000cf21:0x17:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189338.103505:0:3627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc07116e000/0xcc1762b626f8cf83 lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x961c5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189338.103524:0:3627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc07116e000/0xcc1762b626f8cf83 lrc: 2/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x961c5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189338.103535:0:3627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dc07116e000/0xcc1762b626f8cf83 lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x961c5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189338.103541:0:3627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc07116e000 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:1.0:1784189338.103544:0:3627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc07116e000/0xcc1762b626f8cf83 lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x961c5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189338.104862:0:3627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc07116e000/0xcc1762b626f8cf83 lrc: 4/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x961c5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189338.104889:0:3627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x961c5ca3 (ffff9dc07499b400) 00010000:00010000:1.0:1784189338.104892:0:3627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784189338.104896:0:3627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dc07116e000/0xcc1762b626f8cf83 lrc: 2/0,0 mode: --/TXN res: [0x20000cf21:0x4:0x0].0x961c5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189338.104903:0:3627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc07116e000/0xcc1762b626f8cf83 lrc: 0/0,0 mode: --/TXN res: [0x20000cf21:0x4:0x0].0x961c5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189338.104926:0:3627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc07116f200/0xcc1762b626f8cf98 lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x18:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189338.104933:0:3627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc07116f200/0xcc1762b626f8cf98 lrc: 2/0,0 mode: TXN/TXN res: [0x20000cf21:0x18:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189338.104939:0:3627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dc07116f200/0xcc1762b626f8cf98 lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x18:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189338.104944:0:3627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc07116f200 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:1.0:1784189338.104947:0:3627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc07116f200/0xcc1762b626f8cf98 lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x18:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189338.104953:0:3627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc07116f200/0xcc1762b626f8cf98 lrc: 4/0,0 mode: TXN/TXN res: [0x20000cf21:0x18:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189338.104959:0:3627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x18:0x0].0x0 (ffff9dc07499b300) 00010000:00010000:1.0:1784189338.104962:0:3627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784189338.104964:0:3627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dc07116f200/0xcc1762b626f8cf98 lrc: 2/0,0 mode: --/TXN res: [0x20000cf21:0x18:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189338.104971:0:3627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc07116f200/0xcc1762b626f8cf98 lrc: 0/0,0 mode: --/TXN res: [0x20000cf21:0x18:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189338.104992:0:3627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc070146000/0xcc1762b626f8cfb4 lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0xb6f515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189338.104998:0:3627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc070146000/0xcc1762b626f8cfb4 lrc: 2/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0xb6f515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189338.105003:0:3627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dc070146000/0xcc1762b626f8cfb4 lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0xb6f515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189338.105009:0:3627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc070146000 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:1.0:1784189338.105012:0:3627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc070146000/0xcc1762b626f8cfb4 lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0xb6f515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189338.105017:0:3627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc070146000/0xcc1762b626f8cfb4 lrc: 4/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0xb6f515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189338.105025:0:3627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0xb6f515a3 (ffff9dc07fab4e00) 00010000:00010000:1.0:1784189338.105027:0:3627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784189338.105029:0:3627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dc070146000/0xcc1762b626f8cfb4 lrc: 2/0,0 mode: --/TXN res: [0x20000cf21:0x4:0x0].0xb6f515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189338.105035:0:3627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc070146000/0xcc1762b626f8cfb4 lrc: 0/0,0 mode: --/TXN res: [0x20000cf21:0x4:0x0].0xb6f515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189338.105050:0:3627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4710f400/0xcc1762b626f8cfc9 lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x19:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189338.105056:0:3627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4710f400/0xcc1762b626f8cfc9 lrc: 2/0,0 mode: TXN/TXN res: [0x20000cf21:0x19:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189338.105061:0:3627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4710f400/0xcc1762b626f8cfc9 lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x19:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189338.105072:0:3627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dbf4710f400 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:1.0:1784189338.105075:0:3627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4710f400/0xcc1762b626f8cfc9 lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x19:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189338.105082:0:3627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4710f400/0xcc1762b626f8cfc9 lrc: 4/0,0 mode: TXN/TXN res: [0x20000cf21:0x19:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189338.105090:0:3627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x19:0x0].0x0 (ffff9dbf45994d00) 00010000:00010000:1.0:1784189338.105092:0:3627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784189338.105095:0:3627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4710f400/0xcc1762b626f8cfc9 lrc: 2/0,0 mode: --/TXN res: [0x20000cf21:0x19:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189338.105100:0:3627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4710f400/0xcc1762b626f8cfc9 lrc: 0/0,0 mode: --/TXN res: [0x20000cf21:0x19:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784189338.160178:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf4a32ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3641:1870854458258560:0@lo:400:kworker.0 00000100:00100000:1.0:1784189338.160247:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784189338.160260:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf4a32fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bd553d0d-03e2-4233-b06b-b55bbfa2b954:3640:1870854458258432:0@lo:400:kworker.0 00000100:00100000:1.0:1784189338.160280:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc05edd7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1870854458259072:0@lo:400:kworker.0 00000100:00100000:0.0:1784189338.160303:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784189338.160336:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784189338.160372:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc070221500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3640:1870854458258944:0@lo:400:kworker.0 00000100:00100000:1.0:1784189338.160374:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf425fb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1870854458259584:0@lo:400:kworker.0 00000100:00100000:0.0:1784189338.160407:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784189338.160413:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784189338.160428:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf425f8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3640:1870854458259456:0@lo:400:kworker.0 00000100:00100000:0.0:1784189338.160454:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784189338.160458:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf4a32dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3642:1870854458258688:0@lo:400:kworker.0 00000100:00100000:0.0:1784189338.160472:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc0762d7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3640:1870854458259968:0@lo:400:kworker.0 00000100:00100000:1.0:1784189338.160492:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784189338.160520:0:68287:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458258560 00000100:00100000:1.0:1784189338.160522:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf425f8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1870854458259200:0@lo:400:kworker.0 00000100:00100000:0.0:1784189338.160527:0:68287:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458258560 00000100:00100000:1.0:1784189338.160551:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784189338.160572:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc0762d5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1870854458259712:0@lo:400:kworker.0 00000100:00100000:0.0:1784189338.160585:0:68287:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458258944 00000100:00100000:0.0:1784189338.160589:0:68287:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458258944 00000100:00100000:0.0:1784189338.160611:0:68287:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1345 00000100:00100000:1.0:1784189338.160620:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784189338.160631:0:68287:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc0762d5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1870854458258560:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784189338.160643:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1784189338.160651:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf4a32c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3642:1870854458258816:0@lo:400:kworker.0 00000100:00100000:1.0:1784189338.160685:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784189338.160701:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf425fa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1870854458259328:0@lo:400:kworker.0 00000100:00100000:0.0:1784189338.160703:0:68287:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc0762d5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1870854458258560:12345-0@lo:400:kworker.0 Request processed in 62us (443us total) trans 0 rc 0/0 00000100:00100000:0.0:1784189338.160713:0:68287:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1345 00000100:00100000:1.0:1784189338.160724:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784189338.160731:0:68287:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458259456 00000100:00100000:0.0:1784189338.160736:0:68287:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458259456 00000100:00100000:1.0:1784189338.160747:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc0762d7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1870854458259840:0@lo:400:kworker.0 00000100:00100000:0.0:1784189338.160751:0:68287:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458258688 00000100:00100000:0.0:1784189338.160755:0:68287:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458258688 00000100:00100000:0.0:1784189338.160771:0:68287:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458258816 00000100:00100000:0.0:1784189338.160775:0:68287:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458258816 00000100:00100000:1.0:1784189338.160776:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784189338.160795:0:68287:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1346 00000100:00100000:0.0:1784189338.160804:0:68287:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc04a64f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1870854458258944:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784189338.160816:0:94309:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458258432 00000100:00100000:1.0:1784189338.160835:0:94309:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458258432 00000100:00100000:0.0:1784189338.160842:0:68287:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc04a64f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1870854458258944:12345-0@lo:400:kworker.0 Request processed in 39us (435us total) trans 0 rc 0/0 00000100:00100000:0.0:1784189338.160848:0:68287:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1346 00000100:00100000:0.0:1784189338.160873:0:68287:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1347 00000100:00100000:0.0:1784189338.160881:0:68287:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc05eda8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1870854458259456:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784189338.160886:0:94309:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:1.0:1784189338.160896:0:94309:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf44d0e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd553d0d-03e2-4233-b06b-b55bbfa2b954+24:3640:x1870854458258432:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784189338.160908:0:68287:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc05eda8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1870854458259456:12345-0@lo:400:kworker.0 Request processed in 28us (454us total) trans 0 rc 0/0 00000100:00100000:0.0:1784189338.160915:0:68287:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1347 00000100:00100000:0.0:1784189338.160928:0:68287:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1348 00000100:00100000:0.0:1784189338.160935:0:68287:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf4367f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1870854458258688:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784189338.160942:0:94309:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf44d0e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd553d0d-03e2-4233-b06b-b55bbfa2b954+24:3640:x1870854458258432:12345-0@lo:400:kworker.0 Request processed in 45us (637us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189338.160951:0:94309:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:0.0:1784189338.160971:0:68287:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf4367f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1870854458258688:12345-0@lo:400:kworker.0 Request processed in 37us (479us total) trans 0 rc 0/0 00000100:00100000:0.0:1784189338.160978:0:68287:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1348 00000100:00100000:1.0:1784189338.160988:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458259072 00000100:00100000:1.0:1784189338.160993:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458259072 00000100:00100000:0.0:1784189338.160994:0:68287:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1349 00000100:00100000:0.0:1784189338.161003:0:68287:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf4367ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3642:x1870854458258816:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784189338.161023:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458259584 00000100:00100000:1.0:1784189338.161027:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458259584 00000100:00100000:0.0:1784189338.161043:0:68287:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf4367ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3642:x1870854458258816:12345-0@lo:400:kworker.0 Request processed in 40us (357us total) trans 0 rc 0/0 00000100:00100000:0.0:1784189338.161052:0:68287:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1349 00000100:00100000:1.0:1784189338.161054:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3952 00000100:00100000:1.0:1784189338.161063:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc0762d5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3641:x1870854458259072:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1784189338.161077:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1784189338.161082:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1784189338.161108:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc0762d5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3641:x1870854458259072:12345-0@lo:400:kworker.0 Request processed in 45us (791us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189338.161115:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3952 00000100:00100000:1.0:1784189338.161128:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3953 00000100:00100000:1.0:1784189338.161134:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc0762d4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3641:x1870854458259584:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784189338.161173:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc0762d4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3641:x1870854458259584:12345-0@lo:400:kworker.0 Request processed in 39us (760us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189338.161180:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3953 00000100:00100000:1.0:1784189338.161204:0:26171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458259200 00000100:00100000:1.0:1784189338.161208:0:26171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458259200 00000100:00100000:1.0:1784189338.161246:0:26171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458259712 00000100:00100000:1.0:1784189338.161250:0:26171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458259712 00000100:00100000:1.0:1784189338.161268:0:26171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458259328 00000100:00100000:1.0:1784189338.161271:0:26171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458259328 00000100:00100000:1.0:1784189338.161290:0:26171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458259840 00000100:00100000:1.0:1784189338.161293:0:26171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458259840 00000100:00080000:0.0:1784189338.161306:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1784189338.161311:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1784189338.161338:0:26171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2589 00000100:00100000:1.0:1784189338.161347:0:26171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf4367c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0001-mdtlov_UUID+5:3642:x1870854458259200:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784189338.161389:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf4a32c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3642:1870854458258816:0@lo:400:kworker.0 00000100:00100000:1.0:1784189338.163308:0:26171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf4367c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0001-mdtlov_UUID+5:3642:x1870854458259200:12345-0@lo:400:kworker.0 Request processed in 1955us (2750us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189338.163335:0:26171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2589 00000100:00100000:1.0:1784189338.163368:0:26171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2590 00000100:00100000:1.0:1784189338.163379:0:26171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf4367c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+5:3642:x1870854458259712:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784189338.163424:0:26171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf4367c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+5:3642:x1870854458259712:12345-0@lo:400:kworker.0 Request processed in 48us (2805us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189338.163430:0:26171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2590 00000100:00100000:1.0:1784189338.163442:0:26171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2591 00000100:00100000:1.0:1784189338.163448:0:26171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf4367d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0001-mdtlov_UUID+5:3642:x1870854458259328:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784189338.164428:0:26171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf4367d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0001-mdtlov_UUID+5:3642:x1870854458259328:12345-0@lo:400:kworker.0 Request processed in 977us (3702us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189338.164438:0:26171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2591 00000100:00100000:1.0:1784189338.164460:0:26171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2592 00000100:00100000:1.0:1784189338.164627:0:26171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf4367d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+5:3642:x1870854458259840:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784189338.164672:0:26171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf4367d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+5:3642:x1870854458259840:12345-0@lo:400:kworker.0 Request processed in 49us (3898us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189338.164868:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1784189338.164888:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc07b5e0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1870854458260224:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1784189338.164938:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784189338.168063:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf4a32dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3642:1870854458258688:0@lo:400:kworker.0 00000100:00100000:0.0:1784189338.168081:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf425f8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1870854458259200:0@lo:400:kworker.0 00000100:00100000:0.0:1784189338.168091:0:3642:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294968973 gen 2 00000100:00100000:0.0:1784189338.168106:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc0762d5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1870854458259712:0@lo:400:kworker.0 00000100:00100000:0.0:1784189338.168132:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf425fa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1870854458259328:0@lo:400:kworker.0 00000100:00100000:0.0:1784189338.168142:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc0762d7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1870854458259840:0@lo:400:kworker.0 00000100:00100000:0.0:1784189338.168185:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc07b5e1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1870854458260096:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1784189338.168249:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784189338.168289:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf4a32ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3641:1870854458258560:0@lo:400:kworker.0 00000100:00100000:0.0:1784189338.168301:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc05edd7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1870854458259072:0@lo:400:kworker.0 00000100:00100000:0.0:1784189338.168311:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf425fb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1870854458259584:0@lo:400:kworker.0 00000100:00100000:0.0:1784189338.168361:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784189338.168388:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf4a32fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bd553d0d-03e2-4233-b06b-b55bbfa2b954:3640:1870854458258432:0@lo:400:kworker.0 00000100:00100000:0.0:1784189338.168399:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc070221500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3640:1870854458258944:0@lo:400:kworker.0 00000100:00100000:0.0:1784189338.168420:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf425f8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3640:1870854458259456:0@lo:400:kworker.0 00000100:00100000:0.0:1784189338.168441:0:68287:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458259968 00000100:00100000:0.0:1784189338.168447:0:68287:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458259968 00000100:00100000:0.0:1784189338.168485:0:68287:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1350 00000100:00100000:0.0:1784189338.168491:0:68287:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc0762d5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1870854458259968:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784189338.168590:0:68287:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc0762d5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1870854458259968:12345-0@lo:400:kworker.0 Request processed in 98us (228us total) trans 0 rc 0/0 00000100:00100000:0.0:1784189338.168597:0:68287:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1350 00000100:00100000:0.0:1784189338.168633:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc0762d7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3640:1870854458259968:0@lo:400:kworker.0 00000100:00100000:1.0:1784189338.168701:0:26171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2592 00000100:00100000:1.0:1784189338.168734:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458260224 00000100:00100000:1.0:1784189338.168738:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458260224 00000100:00100000:1.0:1784189338.168758:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458260096 00000100:00100000:1.0:1784189338.168761:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458260096 00000100:00100000:1.0:1784189338.168775:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3954 00000100:00100000:1.0:1784189338.168781:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf470e1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3643:x1870854458260224:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1784189338.168808:0:8438:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445568512 avail 1299329024 00000100:00100000:1.0:1784189338.168931:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf470e1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3643:x1870854458260224:12345-0@lo:41:osp-pre-1-0.0 Request processed in 149us (3991us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189338.169579:0:26492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3955 00000100:00100000:2.0:1784189338.169592:0:26492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc0762d7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3641:x1870854458260096:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1784189338.169613:0:26492:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445249024 avail 1299009536 00000100:00100000:2.0:1784189338.169654:0:26492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc0762d7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3641:x1870854458260096:12345-0@lo:41:osp-pre-0-1.0 Request processed in 68us (1406us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189338.169661:0:26492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3955 00000100:00100000:0.0:1784189338.170932:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc07b5e1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1870854458260096:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1784189338.171141:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3954 00000100:00100000:1.0:1784189338.171198:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc07b5e0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1870854458260224:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1784189338.190941:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1784189338.191264:0:66169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436355840 00000100:00100000:0.0:1784189338.191275:0:66169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436355840 00000100:00100000:0.0:1784189338.191483:0:66169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1510 00000100:00100000:0.0:1784189338.191493:0:66169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc07b5e3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:debedd94-805c-42a0-a5e5-41758b2012e9+31:73586:x1870854436355840:12345-192.168.203.12@tcp:36:mcreate.0 00010000:00010000:0.0:1784189338.191606:0:66169:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784189338.191632:0:66169:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc081b17800/0xcc1762b626f8cbbd lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c4127 expref: 31 pid: 66945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189338.191648:0:66169:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9dbf47406300) 00010000:00010000:0.0:1784189338.191652:0:66169:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1784189338.191788:0:66169:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc070146400/0xcc1762b626f8cfd7 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189338.191804:0:66169:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc070146400/0xcc1762b626f8cfd7 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189338.191827:0:66169:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc070146400/0xcc1762b626f8cfd7 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189338.191843:0:66169:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc070146c00/0xcc1762b626f8cfde lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x21e7de2f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189338.191860:0:66169:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc070146c00/0xcc1762b626f8cfde lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x21e7de2f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189338.191867:0:66169:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc070146c00/0xcc1762b626f8cfde lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x21e7de2f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189338.194394:0:66169:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc070146400/0xcc1762b626f8cfd7 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189338.194410:0:66169:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc070146400/0xcc1762b626f8cfd7 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189338.194417:0:66169:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc070146400/0xcc1762b626f8cfd7 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189338.194424:0:66169:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dc070146400/0xcc1762b626f8cfd7 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189338.194431:0:66169:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc070146400 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:0.0:1784189338.194435:0:66169:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc070146400/0xcc1762b626f8cfd7 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189338.194442:0:66169:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc070146400/0xcc1762b626f8cfd7 lrc: 5/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189338.194457:0:66169:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9dbf47406300) 00010000:00010000:0.0:1784189338.194471:0:66169:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784189338.194477:0:66169:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dc070146400/0xcc1762b626f8cfd7 lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189338.194484:0:66169:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc070146400/0xcc1762b626f8cfd7 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1784189338.194499:0:66169:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000000a54c746 reply state 00000000190f5319 transno 120259084355 ns: mdt-lustre-MDT0000_UUID lock: ffff9dc070146c00/0xcc1762b626f8cfde lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x21e7de2f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189338.194512:0:66169:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc070146c00/0xcc1762b626f8cfde lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x21e7de2f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189338.194519:0:66169:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x21e7de2f (ffff9dbf47f75a00) 00010000:00010000:0.0:1784189338.194522:0:66169:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1784189338.194524:0:66169:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1784189338.195958:0:66169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc07b5e3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:debedd94-805c-42a0-a5e5-41758b2012e9+32:73586:x1870854436355840:12345-192.168.203.12@tcp:36:mcreate.0 Request processed in 4459us (5019us total) trans 120259084355 rc 0/0 00000100:00100000:0.0:1784189338.195968:0:66169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1510 00000100:00100000:3.0:1784189338.215497:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1784189338.215624:0:66171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436355968 00000100:00100000:1.0:1784189338.215633:0:66171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436355968 00000100:00100000:1.0:1784189338.215687:0:66171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1511 00000100:00100000:1.0:1784189338.215696:0:66171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf470e2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:debedd94-805c-42a0-a5e5-41758b2012e9+32:73589:x1870854436355968:12345-192.168.203.12@tcp:101:rm.0 00010000:00010000:1.0:1784189338.215719:0:66171:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784189338.215737:0:66171:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc07116e000/0xcc1762b626f8cfe5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbfc5de7fe6c4254 expref: -99 pid: 66171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189338.215796:0:66171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc07116f800/0xcc1762b626f8cfec lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189338.215810:0:66171:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc07116f800/0xcc1762b626f8cfec lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189338.215840:0:66171:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc07116f800/0xcc1762b626f8cfec lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784189338.215892:0:66171:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1784189338.215896:0:66171:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1784189338.215916:0:66171:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9dc07116f800/0xcc1762b626f8cfec lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189338.215938:0:66171:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc07116e000/0xcc1762b626f8cfe5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c4254 expref: 34 pid: 66171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189338.215954:0:66171:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc07116f800/0xcc1762b626f8cfec lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c4254 expref: 33 pid: 66171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189338.215962:0:66171:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9dbf47406300) 00010000:00010000:1.0:1784189338.215965:0:66171:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1784189338.215968:0:66171:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc07116f800, rc 0) 00000100:00100000:1.0:1784189338.216025:0:66171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf470e2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:debedd94-805c-42a0-a5e5-41758b2012e9+33:73589:x1870854436355968:12345-192.168.203.12@tcp:101:rm.0 Request processed in 329us (536us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189338.216032:0:66171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1511 00000100:00100000:2.0:1784189338.224424:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1784189338.224579:0:66945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436356096 00000100:00100000:1.0:1784189338.224590:0:66945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436356096 00000100:00100000:1.0:1784189338.224650:0:66945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1512 00000100:00100000:1.0:1784189338.224659:0:66945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc07b5e0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:debedd94-805c-42a0-a5e5-41758b2012e9+33:73589:x1870854436356096:12345-192.168.203.12@tcp:101:rm.0 00010000:00010000:1.0:1784189338.224678:0:66945:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784189338.224697:0:66945:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc07116e800/0xcc1762b626f8cff3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbfc5de7fe6c425b expref: -99 pid: 66945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189338.224768:0:66945:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc07116ec00/0xcc1762b626f8cffa lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189338.224781:0:66945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc07116ec00/0xcc1762b626f8cffa lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189338.224792:0:66945:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc07116ec00/0xcc1762b626f8cffa lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189338.224802:0:66945:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc07116e400/0xcc1762b626f8d001 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x21e7de2f bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189338.224809:0:66945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc07116e400/0xcc1762b626f8d001 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x21e7de2f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189338.224825:0:66945:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc07116e400/0xcc1762b626f8d001 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x21e7de2f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189338.224911:0:66945:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc07116f200/0xcc1762b626f8d008 lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0x1a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189338.224920:0:66945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc07116f200/0xcc1762b626f8d008 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x1a:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189338.224926:0:66945:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc07116f200/0xcc1762b626f8d008 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x1a:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784189338.224968:0:66945:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000cf21:0x1a:0x0]: returning size 0 00000004:00200000:1.0:1784189338.224971:0:66945:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1784189338.224987:0:66945:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9dc07116f200/0xcc1762b626f8d008 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x1a:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189338.225008:0:66945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc07116f200/0xcc1762b626f8d008 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x1a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189338.225017:0:66945:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc07116ec00/0xcc1762b626f8cffa lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189338.225023:0:66945:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc07116ec00/0xcc1762b626f8cffa lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189338.225028:0:66945:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc07116ec00/0xcc1762b626f8cffa lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189338.225035:0:66945:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dc07116ec00/0xcc1762b626f8cffa lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189338.225040:0:66945:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc07116ec00 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:1.0:1784189338.225044:0:66945:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc07116ec00/0xcc1762b626f8cffa lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189338.225050:0:66945:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc07116ec00/0xcc1762b626f8cffa lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189338.225061:0:66945:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9dbf47406300) 00010000:00010000:1.0:1784189338.225064:0:66945:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784189338.225068:0:66945:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dc07116ec00/0xcc1762b626f8cffa lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189338.225074:0:66945:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc07116ec00/0xcc1762b626f8cffa lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189338.225085:0:66945:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc07116e400/0xcc1762b626f8d001 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x21e7de2f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189338.225096:0:66945:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc07116e400/0xcc1762b626f8d001 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x21e7de2f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189338.225101:0:66945:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dc07116e400/0xcc1762b626f8d001 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x21e7de2f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189338.225106:0:66945:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc07116e400 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:1.0:1784189338.225109:0:66945:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc07116e400/0xcc1762b626f8d001 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x21e7de2f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189338.225115:0:66945:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc07116e400/0xcc1762b626f8d001 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x21e7de2f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189338.225124:0:66945:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x21e7de2f (ffff9dbf47f75a00) 00010000:00010000:1.0:1784189338.225126:0:66945:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784189338.225129:0:66945:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dc07116e400/0xcc1762b626f8d001 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x21e7de2f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189338.225135:0:66945:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc07116e400/0xcc1762b626f8d001 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x21e7de2f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189338.225159:0:66945:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc07116e800/0xcc1762b626f8cff3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c425b expref: 35 pid: 66945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189338.225172:0:66945:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc07116f200/0xcc1762b626f8d008 lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x1a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c425b expref: 34 pid: 66945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189338.225179:0:66945:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x1a:0x0].0x0 (ffff9dc07499b400) 00010000:00010000:1.0:1784189338.225181:0:66945:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1784189338.225190:0:66945:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc07116f200, rc 0) 00000100:00100000:1.0:1784189338.225244:0:66945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc07b5e0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:debedd94-805c-42a0-a5e5-41758b2012e9+34:73589:x1870854436356096:12345-192.168.203.12@tcp:101:rm.0 Request processed in 587us (830us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189338.225252:0:66945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1512 00000100:00100000:2.0:1784189338.235440:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1784189338.235776:0:66169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436356352 00000100:00100000:1.0:1784189338.235785:0:66169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436356352 00000100:00100000:1.0:1784189338.235846:0:66169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1513 00000100:00100000:1.0:1784189338.235865:0:66169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc07b5e3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:debedd94-805c-42a0-a5e5-41758b2012e9+34:73589:x1870854436356352:12345-192.168.203.12@tcp:36:rm.0 00010000:00010000:1.0:1784189338.235918:0:66169:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:1.0:1784189338.235943:0:66169:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc07116f200/0xcc1762b626f8d008 lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0x1a:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c425b expref: 34 pid: 66945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189338.235958:0:66169:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x1a:0x0].0x0 (ffff9dc07499b400) 00010000:00010000:1.0:1784189338.235973:0:66169:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc07116f800/0xcc1762b626f8cfec lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c4254 expref: 33 pid: 66171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189338.235980:0:66169:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9dbf47406300) 00010000:00010000:1.0:1784189338.235983:0:66169:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1784189338.236003:0:66169:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc07116e800/0xcc1762b626f8d00f lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189338.236016:0:66169:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc07116e800/0xcc1762b626f8d00f lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189338.236024:0:66169:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc07116e800/0xcc1762b626f8d00f lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189338.236033:0:66169:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc07116e400/0xcc1762b626f8d016 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x21e7de2f bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189338.236051:0:66169:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc07116e400/0xcc1762b626f8d016 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x21e7de2f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189338.236058:0:66169:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc07116e400/0xcc1762b626f8d016 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x21e7de2f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189338.236132:0:66169:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc07116ec00/0xcc1762b626f8d01d lrc: 3/0,1 mode: --/EX res: [0x20000cf21:0x1a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189338.236140:0:66169:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc07116ec00/0xcc1762b626f8d01d lrc: 3/0,1 mode: EX/EX res: [0x20000cf21:0x1a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189338.236145:0:66169:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc07116ec00/0xcc1762b626f8d01d lrc: 3/0,1 mode: EX/EX res: [0x20000cf21:0x1a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189338.236350:0:66169:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc07116e000/0xcc1762b626f8d024 lrc: 3/0,1 mode: --/PW res: [0x20000cf21:0x1a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189338.236359:0:66169:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc07116e000/0xcc1762b626f8d024 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x1a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189338.236365:0:66169:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc07116e000/0xcc1762b626f8d024 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x1a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189338.236373:0:66169:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc07116e000/0xcc1762b626f8d024 lrc: 4/0,1 mode: PW/PW res: [0x20000cf21:0x1a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189338.236378:0:66169:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc07116e000/0xcc1762b626f8d024 lrc: 4/0,1 mode: PW/PW res: [0x20000cf21:0x1a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189338.236384:0:66169:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc07116e000/0xcc1762b626f8d024 lrc: 3/0,0 mode: PW/PW res: [0x20000cf21:0x1a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189338.236411:0:66169:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1784189338.236430:0:66169:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc07116ec00/0xcc1762b626f8d01d lrc: 3/0,1 mode: EX/EX res: [0x20000cf21:0x1a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189338.236435:0:66169:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc07116ec00/0xcc1762b626f8d01d lrc: 2/0,0 mode: EX/EX res: [0x20000cf21:0x1a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189338.236440:0:66169:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dc07116ec00/0xcc1762b626f8d01d lrc: 3/0,0 mode: EX/EX res: [0x20000cf21:0x1a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189338.236445:0:66169:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc07116ec00 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:1.0:1784189338.236449:0:66169:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc07116ec00/0xcc1762b626f8d01d lrc: 3/0,0 mode: EX/EX res: [0x20000cf21:0x1a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189338.236456:0:66169:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc07116ec00/0xcc1762b626f8d01d lrc: 4/0,0 mode: EX/EX res: [0x20000cf21:0x1a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189338.236464:0:66169:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x1a:0x0].0x0 (ffff9dc07499b500) 00010000:00010000:1.0:1784189338.236467:0:66169:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1784189338.236471:0:66169:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dc07116ec00/0xcc1762b626f8d01d lrc: 2/0,0 mode: --/EX res: [0x20000cf21:0x1a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189338.236477:0:66169:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc07116ec00/0xcc1762b626f8d01d lrc: 0/0,0 mode: --/EX res: [0x20000cf21:0x1a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189338.236492:0:66169:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc07116e800/0xcc1762b626f8d00f lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189338.236498:0:66169:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc07116e800/0xcc1762b626f8d00f lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189338.236502:0:66169:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc07116e800/0xcc1762b626f8d00f lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189338.236512:0:66169:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dc07116e800/0xcc1762b626f8d00f lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189338.236517:0:66169:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc07116e800 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:1.0:1784189338.236520:0:66169:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc07116e800/0xcc1762b626f8d00f lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189338.236525:0:66169:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc07116e800/0xcc1762b626f8d00f lrc: 5/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189338.236532:0:66169:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9dbf47406300) 00010000:00010000:1.0:1784189338.236534:0:66169:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784189338.236537:0:66169:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dc07116e800/0xcc1762b626f8d00f lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189338.236542:0:66169:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc07116e800/0xcc1762b626f8d00f lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1784189338.236551:0:66169:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000e9fe1717 reply state 0000000089a84f95 transno 120259084356 ns: mdt-lustre-MDT0000_UUID lock: ffff9dc07116e400/0xcc1762b626f8d016 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x21e7de2f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189338.236561:0:66169:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc07116e400/0xcc1762b626f8d016 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x21e7de2f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189338.236567:0:66169:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x21e7de2f (ffff9dbf47f75a00) 00010000:00010000:1.0:1784189338.236569:0:66169:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1784189338.236572:0:66169:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1784189338.236643:0:66169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc07b5e3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:debedd94-805c-42a0-a5e5-41758b2012e9+34:73589:x1870854436356352:12345-192.168.203.12@tcp:36:rm.0 Request processed in 778us (1210us total) trans 120259084356 rc 0/0 00000100:00100000:1.0:1784189338.236650:0:66169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1513 00010000:00010000:2.0:1784189338.237688:0:7454:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784189338.237698:0:7454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dc07116e000/0xcc1762b626f8d024 lrc: 2/0,0 mode: PW/PW res: [0x20000cf21:0x1a:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189338.237706:0:7454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc07116e000 already unused, calling callback (ffffffffc0b2e230) 00010000:00010000:2.0:1784189338.237710:0:7454:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc07116e000/0xcc1762b626f8d024 lrc: 2/0,0 mode: PW/PW res: [0x20000cf21:0x1a:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189338.237718:0:7454:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc07116e000/0xcc1762b626f8d024 lrc: 3/0,0 mode: PW/PW res: [0x20000cf21:0x1a:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189338.237730:0:7454:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x1a:0x0].0x0 (ffff9dc07499b500) 00010000:00010000:2.0:1784189338.237733:0:7454:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1784189338.237736:0:7454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dc07116e000/0xcc1762b626f8d024 lrc: 1/0,0 mode: --/PW res: [0x20000cf21:0x1a:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189338.237753:0:7454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc07116e000/0xcc1762b626f8d024 lrc: 0/0,0 mode: --/PW res: [0x20000cf21:0x1a:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189338.237769:0:7454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784189338.237771:0:7454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784189338.237772:0:7454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784189338.351563:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784189338.675110:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc0762d7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1870854458260352:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1784189338.675180:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784189338.675236:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458260352 00000100:00100000:0.0:1784189338.675244:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458260352 00000100:00100000:0.0:1784189338.675288:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2078 00000100:00100000:0.0:1784189338.675297:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc070221500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1870854458260352:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1784189338.675332:0:8432:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8646976 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1784189338.675375:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc070221500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1870854458260352:12345-0@lo:13:osp-pre-1-0.0 Request processed in 79us (195us total) trans 0 rc 0/0 00000100:00100000:0.0:1784189338.675383:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2078 00000100:00100000:0.0:1784189338.675437:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc0762d7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1870854458260352:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1784189338.680136:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc07b5e2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1870854458260480:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1784189338.680205:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784189338.680287:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458260480 00000100:00100000:1.0:1784189338.680296:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458260480 00000100:00100000:1.0:1784189338.680363:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2079 00000100:00100000:1.0:1784189338.680372:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc0762d7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1870854458260480:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1784189338.680394:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8617408 pending 0 free 3922481152 avail 3690958848 00000100:00100000:1.0:1784189338.682714:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc0762d7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1870854458260480:12345-0@lo:13:osp-pre-0-0.0 Request processed in 2335us (2501us total) trans 0 rc 0/0 00000100:00100000:0.0:1784189338.682721:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc07b5e2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1870854458260480:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1784189338.682729:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2079 00000100:00100000:3.0:1784189338.923202:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1784189338.923249:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1784189338.923272:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1784189338.923351:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1784189338.923376:0:26167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436356736 00000100:00100000:3.0:1784189338.923384:0:26167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436356736 00000100:00100000:3.0:1784189338.923424:0:26167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436356864 00000100:00100000:3.0:1784189338.923426:0:26167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436356864 00000100:00100000:3.0:1784189338.923444:0:26167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 2593 00000100:00100000:3.0:1784189338.923452:0:26167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc050542680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:debedd94-805c-42a0-a5e5-41758b2012e9+5:2397:x1870854436356736:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:3.0:1784189338.923523:0:26167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc050542680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:debedd94-805c-42a0-a5e5-41758b2012e9+5:2397:x1870854436356736:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 71us (272us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189338.923530:0:26167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 2593 00000100:00100000:3.0:1784189338.923585:0:26167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 2594 00000100:00100000:3.0:1784189338.923591:0:26167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc081cd2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:debedd94-805c-42a0-a5e5-41758b2012e9+7:2397:x1870854436356864:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:3.0:1784189338.923616:0:26167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc081cd2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:debedd94-805c-42a0-a5e5-41758b2012e9+7:2397:x1870854436356864:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 25us (265us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189338.923622:0:26167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 2594 00000100:00100000:3.0:1784189338.923775:0:68287:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436356608 00000100:00100000:3.0:1784189338.923779:0:68287:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436356608 00000100:00100000:3.0:1784189338.923808:0:68287:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1351 00000100:00100000:3.0:1784189338.923813:0:68287:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc050543100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:debedd94-805c-42a0-a5e5-41758b2012e9+11:2397:x1870854436356608:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:3.0:1784189338.923840:0:68287:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc050543100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:debedd94-805c-42a0-a5e5-41758b2012e9+11:2397:x1870854436356608:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 27us (567us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189338.923858:0:68287:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1351 00000100:00100000:1.0:1784189338.923984:0:94310:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436356480 00000100:00100000:1.0:1784189338.923988:0:94310:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436356480 00000100:00100000:1.0:1784189338.924042:0:94310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 175 00000100:00100000:1.0:1784189338.924050:0:94310:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc080e3b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:60f345e3-c70e-4f53-b5e7-c9671463c9a5+10:2397:x1870854436356480:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:1.0:1784189338.924097:0:94310:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc080e3b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:60f345e3-c70e-4f53-b5e7-c9671463c9a5+10:2397:x1870854436356480:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 39us (894us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189338.924103:0:94310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 175 00010000:00010000:1.0:1784189339.375489:0:26173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784189340.405870:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784189340.720522:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc07b5e3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1870854458260608:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1784189340.720583:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784189340.720649:0:9466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458260608 00000100:00100000:1.0:1784189340.720656:0:9466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458260608 00000100:00100000:1.0:1784189340.720712:0:9466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2080 00000100:00100000:1.0:1784189340.720721:0:9466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc05edd7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1870854458260608:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1784189340.720747:0:9466:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8617408 pending 0 free 3922481152 avail 3690958848 00010000:00000080:1.0:1784189340.720763:0:9466:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9dc05edd7b80 x1870854458260608/t0(0) o13->lustre-MDT0001-mdtlov_UUID@0@lo:531/0 lens 224/368 e 0 to 0 dl 1784189351 ref 1 fl Interpret:/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784189340.724039:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc07b5e0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1870854458260736:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1784189340.724100:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784189340.724154:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458260736 00000100:00100000:2.0:1784189340.724161:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458260736 00000100:00100000:2.0:1784189340.724199:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2081 00000100:00100000:2.0:1784189340.724209:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc07b5e2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1870854458260736:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1784189340.724235:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8646976 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1784189340.724276:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc07b5e2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1870854458260736:12345-0@lo:13:osp-pre-1-1.0 Request processed in 68us (174us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189340.724283:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2081 00000100:00100000:2.0:1784189340.724338:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc07b5e0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1870854458260736:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1784189340.724515:0:9466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc05edd7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1870854458260608:12345-0@lo:13:osp-pre-0-1.0 Request processed in 3793us (3929us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189340.724522:0:9466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2080 00000100:00100000:0.0:1784189340.724996:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc07b5e3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1870854458260608:0@lo:13:osp-pre-0-1.0 00000100:00080000:0.0:1784189340.725019:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1784189340.725023:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1784189341.424109:0:7454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784189342.458399:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784189343.281746:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf4367c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:bd553d0d-03e2-4233-b06b-b55bbfa2b954:3643:1870854458260864:0@lo:400:kworker.0 00000100:00100000:1.0:1784189343.281823:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784189343.281861:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc05659df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3643:1870854458261376:0@lo:400:kworker.0 00000100:00100000:1.0:1784189343.281889:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784189343.282961:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc075f7ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3643:1870854458261888:0@lo:400:kworker.0 00000100:00100000:1.0:1784189343.283004:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784189343.283027:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc075f7e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3643:1870854458262400:0@lo:400:kworker.0 00000100:00100000:1.0:1784189343.283047:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784189343.283073:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:1.0:1784189343.283080:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf4367d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3643:1870854458261248:0@lo:400:kworker.0 00000100:00100000:1.0:1784189343.283098:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784189343.283115:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc075f7d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1870854458261760:0@lo:400:kworker.0 00000100:00100000:1.0:1784189343.283138:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784189343.283155:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc075f7d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1870854458262272:0@lo:400:kworker.0 00000100:00100000:1.0:1784189343.284290:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784189343.284411:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf4367c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3640:1870854458260992:0@lo:400:kworker.0 00000100:00100000:1.0:1784189343.284443:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784189343.284462:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc075f7e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1870854458261504:0@lo:400:kworker.0 00000100:00100000:1.0:1784189343.284484:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784189343.284502:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc075f7df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1870854458262016:0@lo:400:kworker.0 00000100:00100000:1.0:1784189343.284523:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784189343.284540:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc050542680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1870854458262528:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1784189343.284559:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784189343.284590:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1784189343.284607:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf4367d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3640:1870854458261120:0@lo:400:kworker.0 00000100:00100000:1.0:1784189343.284631:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784189343.284642:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc075f7ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1870854458261632:0@lo:400:kworker.0 00000100:00100000:1.0:1784189343.284662:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784189343.284787:0:66170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458261376 00000100:00100000:2.0:1784189343.284794:0:66170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458261376 00000100:00100000:2.0:1784189343.284853:0:66170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458261888 00000100:00100000:2.0:1784189343.284857:0:66170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458261888 00000100:00100000:2.0:1784189343.284870:0:66170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458262400 00000100:00100000:2.0:1784189343.284873:0:66170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458262400 00000100:00100000:2.0:1784189343.284882:0:66170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458261248 00000100:00100000:2.0:1784189343.284884:0:66170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458261248 00000100:00100000:2.0:1784189343.284895:0:66170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458260992 00000100:00100000:2.0:1784189343.284913:0:66170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458260992 00000100:00100000:2.0:1784189343.284932:0:66170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458261120 00000100:00100000:2.0:1784189343.284935:0:66170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458261120 00000100:00100000:2.0:1784189343.284951:0:66170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1352 00000100:00100000:2.0:1784189343.284960:0:66170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc075f7f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1870854458261376:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784189343.285014:0:66170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc075f7f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1870854458261376:12345-0@lo:400:kworker.0 Request processed in 54us (3123us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189343.285021:0:66170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1352 00000100:00100000:2.0:1784189343.285037:0:66170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1353 00000100:00100000:2.0:1784189343.285043:0:66170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf44faea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1870854458261888:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784189343.285071:0:66170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf44faea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1870854458261888:12345-0@lo:400:kworker.0 Request processed in 29us (2067us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189343.285077:0:66170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1353 00000100:00100000:2.0:1784189343.285087:0:66170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1354 00000100:00100000:2.0:1784189343.285093:0:66170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf44fac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1870854458262400:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784189343.285134:0:66170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf44fac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1870854458262400:12345-0@lo:400:kworker.0 Request processed in 41us (2086us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189343.285141:0:66170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1354 00000100:00100000:2.0:1784189343.285152:0:66170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1355 00000100:00100000:2.0:1784189343.285158:0:66170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf44faf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1870854458261248:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784189343.285192:0:66170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf44faf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1870854458261248:12345-0@lo:400:kworker.0 Request processed in 35us (2093us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189343.285199:0:66170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1355 00000100:00100000:2.0:1784189343.285209:0:66170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1356 00000100:00100000:2.0:1784189343.285215:0:66170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc05f02d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1870854458260992:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784189343.285238:0:66170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc05f02d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1870854458260992:12345-0@lo:400:kworker.0 Request processed in 24us (794us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189343.285250:0:66170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1356 00000100:00100000:2.0:1784189343.285261:0:66170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1357 00000100:00100000:2.0:1784189343.285266:0:66170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc05f02df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1870854458261120:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784189343.285292:0:66170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc05f02df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1870854458261120:12345-0@lo:400:kworker.0 Request processed in 26us (660us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189343.285298:0:66170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1357 00000100:00080000:2.0:1784189343.285312:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1784189343.285316:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1784189343.290342:0:9982:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458261760 00000100:00100000:3.0:1784189343.290356:0:9982:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458261760 00000100:00100000:3.0:1784189343.293746:0:26160:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458262272 00000100:00100000:3.0:1784189343.293757:0:26160:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458262272 00000100:00100000:3.0:1784189343.293799:0:26160:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458261632 00000100:00100000:3.0:1784189343.293802:0:26160:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458261632 00000100:00100000:3.0:1784189343.293848:0:26160:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2595 00000100:00100000:3.0:1784189343.293859:0:26160:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc05f02c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:3643:x1870854458261760:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784189343.295723:0:26160:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc05f02c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:3643:x1870854458261760:12345-0@lo:400:kworker.0 Request processed in 1860us (12577us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189343.295736:0:26160:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2595 00000100:00100000:3.0:1784189343.295765:0:26160:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2596 00000100:00100000:3.0:1784189343.295775:0:26160:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc05f02f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+5:3643:x1870854458262272:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784189343.295832:0:26160:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc05f02f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+5:3643:x1870854458262272:12345-0@lo:400:kworker.0 Request processed in 60us (11543us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189343.295838:0:26160:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2596 00000100:00100000:3.0:1784189343.295850:0:26160:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2597 00000100:00100000:3.0:1784189343.295858:0:26160:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc05f02ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:3640:x1870854458261632:12345-0@lo:400:kworker.0 00010000:00000080:3.0:1784189343.295871:0:26160:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9dc05f02ce00 x1870854458261632/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:534/0 lens 224/224 e 0 to 0 dl 1784189354 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784189343.296253:0:26160:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc05f02ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:3640:x1870854458261632:12345-0@lo:400:kworker.0 Request processed in 395us (11589us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189343.296260:0:26160:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2597 00000100:00080000:3.0:1784189343.296372:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1784189343.296377:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1784189343.296449:0:94309:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458260864 00000100:00100000:3.0:1784189343.296456:0:94309:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458260864 00000100:00100000:3.0:1784189343.296498:0:94309:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:3.0:1784189343.296505:0:94309:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc080e38850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd553d0d-03e2-4233-b06b-b55bbfa2b954+24:3643:x1870854458260864:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784189343.296541:0:94309:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc080e38850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd553d0d-03e2-4233-b06b-b55bbfa2b954+24:3643:x1870854458260864:12345-0@lo:400:kworker.0 Request processed in 37us (14718us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189343.296548:0:94309:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:3.0:1784189343.296597:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc07b5e0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1870854458262656:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1784189343.296630:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784189343.296691:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458261504 00000100:00100000:3.0:1784189343.296695:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458261504 00000100:00100000:3.0:1784189343.296714:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458262016 00000100:00100000:3.0:1784189343.296717:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458262016 00000100:00100000:3.0:1784189343.296726:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458262528 00000100:00100000:3.0:1784189343.296728:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458262528 00000100:00100000:3.0:1784189343.296735:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458262656 00000100:00100000:3.0:1784189343.296737:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458262656 00000100:00100000:3.0:1784189343.296747:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3956 00000100:00100000:3.0:1784189343.296752:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc05f02f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:3640:x1870854458261504:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784189343.296786:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc05f02f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:3640:x1870854458261504:12345-0@lo:400:kworker.0 Request processed in 33us (12300us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189343.296791:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3956 00000100:00100000:1.0:1784189343.296942:0:23826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3957 00000100:00100000:1.0:1784189343.296950:0:23826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc05f02ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3640:x1870854458262016:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784189343.296984:0:23826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc05f02ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3640:x1870854458262016:12345-0@lo:400:kworker.0 Request processed in 36us (12460us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189343.296990:0:23826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3957 00000100:00100000:1.0:1784189343.297005:0:23826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3958 00000100:00100000:1.0:1784189343.297010:0:23826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc05f02dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3640:x1870854458262528:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1784189343.297033:0:23826:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445568512 avail 1299329024 00000100:00100000:1.0:1784189343.297067:0:23826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc05f02dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3640:x1870854458262528:12345-0@lo:41:osp-pre-1-0.0 Request processed in 56us (12507us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189343.297073:0:23826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3958 00000100:00100000:1.0:1784189343.297085:0:23826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3959 00000100:00100000:1.0:1784189343.297090:0:23826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc050540000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3641:x1870854458262656:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1784189343.297104:0:23826:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445249024 avail 1299009536 00000100:00100000:1.0:1784189343.297138:0:23826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc050540000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3641:x1870854458262656:12345-0@lo:41:osp-pre-0-1.0 Request processed in 48us (507us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189343.297144:0:23826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3959 00000100:00100000:1.0:1784189343.297207:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc07b5e0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1870854458262656:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1784189343.297240:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc075f7ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1870854458261632:0@lo:400:kworker.0 00000100:00100000:1.0:1784189343.297248:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc075f7c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1870854458262144:0@lo:400:kworker.0 00000100:00100000:1.0:1784189343.297282:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784189343.297307:0:26161:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458262144 00000100:00100000:1.0:1784189343.297310:0:26161:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458262144 00000100:00100000:1.0:1784189343.297369:0:26161:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2598 00000100:00100000:1.0:1784189343.297376:0:26161:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc05f02e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+5:3640:x1870854458262144:12345-0@lo:400:kworker.0 00010000:00000080:1.0:1784189343.297389:0:26161:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9dc05f02e300 x1870854458262144/t0(0) o400->lustre-MDT0000-mdtlov_UUID@0@lo:534/0 lens 224/224 e 0 to 0 dl 1784189354 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784189343.297414:0:26161:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc05f02e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+5:3640:x1870854458262144:12345-0@lo:400:kworker.0 Request processed in 40us (132us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189343.297420:0:26161:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2598 00000100:00080000:1.0:1784189343.297435:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1784189343.297464:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc075f7c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1870854458262144:0@lo:400:kworker.0 00000100:00100000:1.0:1784189343.297477:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf4367c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3640:1870854458260992:0@lo:400:kworker.0 00000100:00100000:1.0:1784189343.297485:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc075f7e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1870854458261504:0@lo:400:kworker.0 00000100:00100000:1.0:1784189343.297495:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc075f7df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1870854458262016:0@lo:400:kworker.0 00000100:00100000:1.0:1784189343.297505:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc050542680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1870854458262528:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1784189343.297542:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf4367d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3640:1870854458261120:0@lo:400:kworker.0 00000100:00100000:3.0:1784189343.298243:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf4367d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3643:1870854458261248:0@lo:400:kworker.0 00000100:00100000:3.0:1784189343.298258:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc075f7d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1870854458261760:0@lo:400:kworker.0 00000100:00100000:3.0:1784189343.298268:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc075f7d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1870854458262272:0@lo:400:kworker.0 00000100:00100000:3.0:1784189343.298277:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf4367c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:bd553d0d-03e2-4233-b06b-b55bbfa2b954:3643:1870854458260864:0@lo:400:kworker.0 00000100:00100000:3.0:1784189343.298287:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc05659df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3643:1870854458261376:0@lo:400:kworker.0 00000100:00100000:3.0:1784189343.298297:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc075f7ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3643:1870854458261888:0@lo:400:kworker.0 00000100:00100000:3.0:1784189343.298307:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc075f7e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3643:1870854458262400:0@lo:400:kworker.0 00010000:00010000:1.0:1784189343.473021:0:26173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784189343.799489:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf4367c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1870854458262912:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1784189343.799558:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784189343.799737:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458262912 00000100:00100000:1.0:1784189343.799746:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458262912 00000100:00100000:1.0:1784189343.799794:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2082 00000100:00100000:1.0:1784189343.799802:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc07b5e0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1870854458262912:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1784189343.799856:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8646976 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1784189343.799908:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc07b5e0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1870854458262912:12345-0@lo:13:osp-pre-1-0.0 Request processed in 107us (351us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189343.799930:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2082 00000100:00100000:2.0:1784189343.800497:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1784189343.800510:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf425f8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1870854458262784:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1784189343.800543:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784189343.800584:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf4367c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1870854458262912:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1784189343.801169:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458262784 00000100:00100000:2.0:1784189343.801175:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458262784 00000100:00100000:2.0:1784189343.801213:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2083 00000100:00100000:2.0:1784189343.801221:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc07b5e1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1870854458262784:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1784189343.801241:0:8432:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8617408 pending 0 free 3922481152 avail 3690958848 00010000:00000080:2.0:1784189343.801255:0:8432:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9dc07b5e1c00 x1870854458262784/t0(0) o13->lustre-MDT0000-mdtlov_UUID@0@lo:534/0 lens 224/368 e 0 to 0 dl 1784189354 ref 1 fl Interpret:/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784189343.801294:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc07b5e1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1870854458262784:12345-0@lo:13:osp-pre-0-0.0 Request processed in 75us (751us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189343.801301:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2083 00000100:00100000:2.0:1784189343.801358:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf425f8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1870854458262784:0@lo:13:osp-pre-0-0.0 00000001:00080000:0.0:1784189343.803103:0:94304:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 120259084356 is committed 00010000:00010000:2.0:1784189343.803222:0:3626:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc070146c00/0xcc1762b626f8cfde lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x21e7de2f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189343.803234:0:3626:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc070146c00/0xcc1762b626f8cfde lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x21e7de2f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189343.803242:0:3626:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dc070146c00/0xcc1762b626f8cfde lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x21e7de2f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189343.803248:0:3626:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc070146c00 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:2.0:1784189343.803253:0:3626:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc070146c00/0xcc1762b626f8cfde lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x21e7de2f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189343.803260:0:3626:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc070146c00/0xcc1762b626f8cfde lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x21e7de2f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189343.803278:0:3626:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x21e7de2f (ffff9dbf47f75a00) 00010000:00010000:2.0:1784189343.803281:0:3626:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784189343.803285:0:3626:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dc070146c00/0xcc1762b626f8cfde lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x21e7de2f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189343.803291:0:3626:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc070146c00/0xcc1762b626f8cfde lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x21e7de2f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189343.803310:0:3626:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc07116e400/0xcc1762b626f8d016 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x21e7de2f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189343.803345:0:3626:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc07116e400/0xcc1762b626f8d016 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x21e7de2f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189343.803353:0:3626:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dc07116e400/0xcc1762b626f8d016 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x21e7de2f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189343.803375:0:3626:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc07116e400 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:2.0:1784189343.803378:0:3626:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc07116e400/0xcc1762b626f8d016 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x21e7de2f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189343.803385:0:3626:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc07116e400/0xcc1762b626f8d016 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x21e7de2f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189343.803393:0:3626:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x21e7de2f (ffff9dbf47f75a00) 00010000:00010000:2.0:1784189343.803396:0:3626:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784189343.803399:0:3626:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dc07116e400/0xcc1762b626f8d016 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x21e7de2f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189343.803405:0:3626:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc07116e400/0xcc1762b626f8d016 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x21e7de2f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784189344.045729:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1784189344.045772:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1784189344.045801:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1784189344.045833:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1784189344.045859:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1784189344.045884:0:66170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436357248 00000100:00100000:1.0:1784189344.045904:0:66170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436357248 00000100:00100000:1.0:1784189344.045969:0:66170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436357120 00000100:00100000:1.0:1784189344.045972:0:66170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436357120 00000100:00100000:1.0:1784189344.046001:0:66170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1358 00000100:00100000:1.0:1784189344.046009:0:66170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf4367d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:debedd94-805c-42a0-a5e5-41758b2012e9+11:2397:x1870854436357248:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:1.0:1784189344.046077:0:66170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf4367d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:debedd94-805c-42a0-a5e5-41758b2012e9+11:2397:x1870854436357248:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 68us (303us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189344.046084:0:66170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1358 00000100:00100000:1.0:1784189344.046102:0:66170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1359 00000100:00100000:1.0:1784189344.046108:0:66170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf4367c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:debedd94-805c-42a0-a5e5-41758b2012e9+30:2397:x1870854436357120:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:1.0:1784189344.046136:0:66170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf4367c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:debedd94-805c-42a0-a5e5-41758b2012e9+30:2397:x1870854436357120:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 28us (302us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189344.046143:0:66170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1359 00000100:00100000:1.0:1784189344.046162:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436357504 00000100:00100000:1.0:1784189344.046165:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436357504 00000100:00100000:1.0:1784189344.046190:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436357376 00000100:00100000:1.0:1784189344.046193:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436357376 00000100:00100000:1.0:1784189344.046214:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 2599 00000100:00100000:1.0:1784189344.046220:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf4367d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:debedd94-805c-42a0-a5e5-41758b2012e9+7:2397:x1870854436357504:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:1.0:1784189344.046262:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf4367d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:debedd94-805c-42a0-a5e5-41758b2012e9+7:2397:x1870854436357504:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 41us (459us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189344.046268:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 2599 00000100:00100000:1.0:1784189344.046280:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 2600 00000100:00100000:1.0:1784189344.046285:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf4367c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:debedd94-805c-42a0-a5e5-41758b2012e9+5:2397:x1870854436357376:12345-192.168.203.12@tcp:400:kworker.0 00010000:00000080:1.0:1784189344.046297:0:8427:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9dbf4367c380 x1870854436357376/t0(0) o400->debedd94-805c-42a0-a5e5-41758b2012e9@192.168.203.12@tcp:535/0 lens 224/224 e 0 to 0 dl 1784189355 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784189344.046345:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf4367c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:debedd94-805c-42a0-a5e5-41758b2012e9+5:2397:x1870854436357376:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 33us (458us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189344.046351:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 2600 00000100:00080000:1.0:1784189344.046374:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1784189344.046378:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1784189344.046380:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1784189344.046381:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1784189344.046765:0:94308:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436356992 00000100:00100000:3.0:1784189344.046770:0:94308:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436356992 00000100:00100000:3.0:1784189344.046800:0:94308:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 177 00000100:00100000:3.0:1784189344.046818:0:94308:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc080e3a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:60f345e3-c70e-4f53-b5e7-c9671463c9a5+10:2397:x1870854436356992:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:3.0:1784189344.046854:0:94308:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc080e3a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:60f345e3-c70e-4f53-b5e7-c9671463c9a5+10:2397:x1870854436356992:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 38us (1135us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189344.046860:0:94308:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 177 00000001:02000400:1.0:1784189344.202168:0:95840:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: ost1 REPLAY BARRIER on lustre-OST0000 00000100:00100000:1.0:1784189344.486385:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1784189344.486482:0:66945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436357632 00000100:00100000:3.0:1784189344.486491:0:66945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436357632 00000100:00100000:3.0:1784189344.486561:0:66945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1514 00000100:00100000:3.0:1784189344.486572:0:66945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc075f7e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:debedd94-805c-42a0-a5e5-41758b2012e9+30:73668:x1870854436357632:12345-192.168.203.12@tcp:101:dd.0 00010000:00010000:3.0:1784189344.486592:0:66945:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784189344.486612:0:66945:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc058f66a00/0xcc1762b626f8d02b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbfc5de7fe6c4262 expref: -99 pid: 66945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189344.486672:0:66945:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc058f67600/0xcc1762b626f8d032 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189344.486699:0:66945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc058f67600/0xcc1762b626f8d032 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189344.486710:0:66945:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc058f67600/0xcc1762b626f8d032 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784189344.486772:0:66945:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1784189344.486775:0:66945:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1784189344.486817:0:66945:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9dc058f67600/0xcc1762b626f8d032 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189344.486843:0:66945:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc058f66a00/0xcc1762b626f8d02b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c4262 expref: 32 pid: 66945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189344.486862:0:66945:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc058f67600/0xcc1762b626f8d032 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c4262 expref: 31 pid: 66945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189344.486870:0:66945:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9dbf47406300) 00010000:00010000:3.0:1784189344.486873:0:66945:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1784189344.486877:0:66945:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc058f67600, rc 0) 00000100:00100000:3.0:1784189344.487179:0:66945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc075f7e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:debedd94-805c-42a0-a5e5-41758b2012e9+31:73668:x1870854436357632:12345-192.168.203.12@tcp:101:dd.0 Request processed in 607us (801us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189344.487187:0:66945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1514 00010000:00010000:1.0:1784189344.495832:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784189344.498684:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1784189344.498732:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1784189344.504642:0:68287:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436357760 00000100:00100000:1.0:1784189344.504655:0:68287:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436357760 00000100:00100000:1.0:1784189344.504723:0:68287:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436358016 00000100:00100000:1.0:1784189344.504727:0:68287:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436358016 00000100:00100000:1.0:1784189344.505089:0:68287:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1515 00000100:00100000:1.0:1784189344.505100:0:68287:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc050543480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:debedd94-805c-42a0-a5e5-41758b2012e9+32:73667:x1870854436357760:12345-192.168.203.12@tcp:101:dd.0 00010000:00010000:1.0:1784189344.505120:0:68287:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784189344.505139:0:68287:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc07116e600/0xcc1762b626f8d039 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbfc5de7fe6c4269 expref: -99 pid: 68287 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189344.505220:0:68287:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc07116e800/0xcc1762b626f8d040 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189344.505235:0:68287:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc07116e800/0xcc1762b626f8d040 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189344.505247:0:68287:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc07116e800/0xcc1762b626f8d040 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784189344.505289:0:68287:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1784189344.505292:0:68287:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1784189344.505311:0:68287:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9dc07116e800/0xcc1762b626f8d040 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189344.505357:0:68287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc07116e600/0xcc1762b626f8d039 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c4269 expref: 34 pid: 68287 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189344.505376:0:68287:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc07116e800/0xcc1762b626f8d040 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c4269 expref: 33 pid: 68287 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189344.505384:0:68287:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9dbf47406300) 00010000:00010000:1.0:1784189344.505388:0:68287:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1784189344.505391:0:68287:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc07116e800, rc 0) 00000100:00100000:1.0:1784189344.506618:0:68287:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc050543480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:debedd94-805c-42a0-a5e5-41758b2012e9+33:73667:x1870854436357760:12345-192.168.203.12@tcp:101:dd.0 Request processed in 1513us (7935us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189344.506628:0:68287:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1515 00000100:00100000:1.0:1784189344.506660:0:68287:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1516 00000100:00100000:1.0:1784189344.506669:0:68287:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc050541c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:debedd94-805c-42a0-a5e5-41758b2012e9+32:73668:x1870854436358016:12345-192.168.203.12@tcp:101:dd.0 00010000:00010000:1.0:1784189344.506695:0:68287:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784189344.506709:0:68287:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc07116ec00/0xcc1762b626f8d047 lrc: 2/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbfc5de7fe6c4270 expref: -99 pid: 68287 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189344.507047:0:68287:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc07116f800/0xcc1762b626f8d04e lrc: 3/1,0 mode: --/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189344.507060:0:68287:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc07116f800/0xcc1762b626f8d04e lrc: 3/1,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189344.507070:0:68287:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc07116f800/0xcc1762b626f8d04e lrc: 3/1,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189344.507083:0:68287:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc07116f200/0xcc1762b626f8d055 lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0x4:0x0].0xe44515a3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189344.507090:0:68287:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc07116f200/0xcc1762b626f8d055 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0xe44515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189344.507096:0:68287:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc07116f200/0xcc1762b626f8d055 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0xe44515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189344.507147:0:68287:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc07116fe00/0xcc1762b626f8d05c lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189344.507156:0:68287:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc07116fe00/0xcc1762b626f8d05c lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189344.507163:0:68287:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc07116fe00/0xcc1762b626f8d05c lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784189344.507172:0:68287:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000cf21:0x7:0x0]: returning size 0 00010000:00010000:1.0:1784189344.507264:0:68287:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc07116f800/0xcc1762b626f8d04e lrc: 4/1,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189344.507272:0:68287:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc07116f800/0xcc1762b626f8d04e lrc: 4/1,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189344.507277:0:68287:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc07116f800/0xcc1762b626f8d04e lrc: 3/0,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189344.507283:0:68287:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dc07116f800/0xcc1762b626f8d04e lrc: 4/0,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189344.507288:0:68287:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc07116f800 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:1.0:1784189344.507292:0:68287:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc07116f800/0xcc1762b626f8d04e lrc: 4/0,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189344.507298:0:68287:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc07116f800/0xcc1762b626f8d04e lrc: 5/0,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189344.507308:0:68287:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x0 (ffff9dbf45994c00) 00010000:00010000:1.0:1784189344.507310:0:68287:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784189344.507314:0:68287:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dc07116f800/0xcc1762b626f8d04e lrc: 3/0,0 mode: --/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189344.507346:0:68287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc07116f800/0xcc1762b626f8d04e lrc: 0/0,0 mode: --/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189344.507358:0:68287:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc07116f200/0xcc1762b626f8d055 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0xe44515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189344.507363:0:68287:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc07116f200/0xcc1762b626f8d055 lrc: 2/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0xe44515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189344.507368:0:68287:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dc07116f200/0xcc1762b626f8d055 lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0xe44515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189344.507380:0:68287:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc07116f200 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:1.0:1784189344.507383:0:68287:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc07116f200/0xcc1762b626f8d055 lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0xe44515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189344.507389:0:68287:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc07116f200/0xcc1762b626f8d055 lrc: 4/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0xe44515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189344.507397:0:68287:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0xe44515a3 (ffff9dc07499b000) 00010000:00010000:1.0:1784189344.507400:0:68287:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784189344.507402:0:68287:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dc07116f200/0xcc1762b626f8d055 lrc: 2/0,0 mode: --/PR res: [0x20000cf21:0x4:0x0].0xe44515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189344.507408:0:68287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc07116f200/0xcc1762b626f8d055 lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0x4:0x0].0xe44515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189344.508398:0:68287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc07116ec00/0xcc1762b626f8d047 lrc: 0/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c4270 expref: 35 pid: 68287 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189344.508419:0:68287:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc07116fe00/0xcc1762b626f8d05c lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c4270 expref: 34 pid: 68287 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189344.508715:0:68287:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x7:0x0].0x0 (ffff9dbf45994300) 00010000:00010000:1.0:1784189344.508719:0:68287:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1784189344.508722:0:68287:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc07116fe00, rc 0) 00000100:00100000:1.0:1784189344.509012:0:68287:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc050541c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:debedd94-805c-42a0-a5e5-41758b2012e9+34:73668:x1870854436358016:12345-192.168.203.12@tcp:101:dd.0 Request processed in 2342us (10276us total) trans 120259084357 rc 0/0 00000100:00100000:1.0:1784189344.509022:0:68287:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1516 00000100:00100000:0.0:1784189344.516146:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1784189344.517186:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1784189344.527735:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1784189344.527784:0:25703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436358528 00000100:00100000:3.0:1784189344.527815:0:25703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436358528 00000100:00100000:3.0:1784189344.527874:0:25703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 724 00000100:00100000:3.0:1784189344.527884:0:25703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc050543b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:debedd94-805c-42a0-a5e5-41758b2012e9+34:2398:x1870854436358528:12345-192.168.203.12@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1784189344.527911:0:25703:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784189344.529898:0:25703:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc07116e800/0xcc1762b626f8d040 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c4269 expref: 34 pid: 68287 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189344.529931:0:25703:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9dbf47406300) 00010000:00010000:3.0:1784189344.529937:0:25703:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784189344.530018:0:25703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc050543b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:debedd94-805c-42a0-a5e5-41758b2012e9+33:2398:x1870854436358528:12345-192.168.203.12@tcp:103:ldlm_bl.0 Request processed in 2134us (2290us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189344.530027:0:25703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 724 00000100:00100000:1.0:1784189344.533021:0:66170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436358144 00000100:00100000:1.0:1784189344.533051:0:66170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436358144 00000100:00100000:1.0:1784189344.539045:0:66170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436358400 00000100:00100000:2.0:1784189344.539059:0:66171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1517 00000100:00100000:1.0:1784189344.539059:0:66170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436358400 00000100:00100000:2.0:1784189344.539079:0:66171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf425fb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:debedd94-805c-42a0-a5e5-41758b2012e9+34:73668:x1870854436358144:12345-192.168.203.12@tcp:101:dd.0 00010000:00010000:2.0:1784189344.539101:0:66171:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1784189344.539114:0:66170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1518 00000100:00100000:1.0:1784189344.539121:0:66170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc050541880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:debedd94-805c-42a0-a5e5-41758b2012e9+34:73667:x1870854436358400:12345-192.168.203.12@tcp:101:dd.0 00010000:00010000:2.0:1784189344.539122:0:66171:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4710fc00/0xcc1762b626f8d06a lrc: 2/0,0 mode: --/PR res: [0x20000cf21:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbfc5de7fe6c4277 expref: -99 pid: 66171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189344.539133:0:66170:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784189344.539142:0:66170:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc07116e600/0xcc1762b626f8d071 lrc: 2/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbfc5de7fe6c427e expref: -99 pid: 66170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189344.539153:0:66171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4710e400/0xcc1762b626f8d078 lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189344.539166:0:66171:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4710e400/0xcc1762b626f8d078 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189344.539177:0:66171:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4710e400/0xcc1762b626f8d078 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189344.539292:0:66171:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4710fc00/0xcc1762b626f8d06a lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c4277 expref: 37 pid: 66171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189344.539342:0:66171:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4710e400/0xcc1762b626f8d078 lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c4277 expref: 36 pid: 66171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189344.539351:0:66171:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x7:0x0].0x0 (ffff9dbf45994300) 00010000:00010000:2.0:1784189344.539354:0:66171:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1784189344.539357:0:66171:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dbf4710e400, rc 0) 00000100:00100000:2.0:1784189344.539416:0:66171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf425fb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:debedd94-805c-42a0-a5e5-41758b2012e9+36:73668:x1870854436358144:12345-192.168.203.12@tcp:101:dd.0 Request processed in 347us (23280us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189344.539424:0:66171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1517 00010000:00010000:1.0:1784189344.540299:0:66170:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc07116fa00/0xcc1762b626f8d07f lrc: 3/1,0 mode: --/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189344.540312:0:66170:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc07116fa00/0xcc1762b626f8d07f lrc: 3/1,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189344.540338:0:66170:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc07116fa00/0xcc1762b626f8d07f lrc: 3/1,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189344.540353:0:66170:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc07116ea00/0xcc1762b626f8d086 lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0x4:0x0].0x9beb5ca3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189344.540360:0:66170:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc07116ea00/0xcc1762b626f8d086 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x9beb5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189344.540366:0:66170:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc07116ea00/0xcc1762b626f8d086 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x9beb5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189344.540418:0:66170:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc07116e000/0xcc1762b626f8d08d lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189344.540427:0:66170:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc07116e000/0xcc1762b626f8d08d lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189344.540456:0:66170:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc07116e000/0xcc1762b626f8d08d lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784189344.540468:0:66170:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000cf21:0x6:0x0]: returning size 0 00010000:00010000:1.0:1784189344.541026:0:66170:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc07116fa00/0xcc1762b626f8d07f lrc: 4/1,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189344.541034:0:66170:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc07116fa00/0xcc1762b626f8d07f lrc: 4/1,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189344.541040:0:66170:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc07116fa00/0xcc1762b626f8d07f lrc: 3/0,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189344.541046:0:66170:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dc07116fa00/0xcc1762b626f8d07f lrc: 4/0,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189344.541051:0:66170:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc07116fa00 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:1.0:1784189344.541055:0:66170:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc07116fa00/0xcc1762b626f8d07f lrc: 4/0,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189344.541062:0:66170:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc07116fa00/0xcc1762b626f8d07f lrc: 5/0,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189344.541074:0:66170:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x0 (ffff9dbf45994c00) 00010000:00010000:1.0:1784189344.541077:0:66170:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784189344.541080:0:66170:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dc07116fa00/0xcc1762b626f8d07f lrc: 3/0,0 mode: --/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189344.541087:0:66170:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc07116fa00/0xcc1762b626f8d07f lrc: 0/0,0 mode: --/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189344.541098:0:66170:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc07116ea00/0xcc1762b626f8d086 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x9beb5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189344.541110:0:66170:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc07116ea00/0xcc1762b626f8d086 lrc: 2/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x9beb5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189344.541116:0:66170:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dc07116ea00/0xcc1762b626f8d086 lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x9beb5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189344.541120:0:66170:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc07116ea00 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:1.0:1784189344.541123:0:66170:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc07116ea00/0xcc1762b626f8d086 lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x9beb5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189344.541128:0:66170:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc07116ea00/0xcc1762b626f8d086 lrc: 4/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x9beb5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189344.541135:0:66170:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x9beb5ca3 (ffff9dc07499b900) 00010000:00010000:1.0:1784189344.541137:0:66170:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784189344.541139:0:66170:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dc07116ea00/0xcc1762b626f8d086 lrc: 2/0,0 mode: --/PR res: [0x20000cf21:0x4:0x0].0x9beb5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189344.541144:0:66170:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc07116ea00/0xcc1762b626f8d086 lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0x4:0x0].0x9beb5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189344.541562:0:66170:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc07116e600/0xcc1762b626f8d071 lrc: 0/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c427e expref: 37 pid: 66170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189344.541581:0:66170:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc07116e000/0xcc1762b626f8d08d lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c427e expref: 36 pid: 66170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189344.541786:0:66170:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x6:0x0].0x0 (ffff9dc05a487700) 00010000:00010000:1.0:1784189344.541788:0:66170:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1784189344.541808:0:66170:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc07116e000, rc 0) 00000100:00100000:1.0:1784189344.541934:0:66170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc050541880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:debedd94-805c-42a0-a5e5-41758b2012e9+36:73667:x1870854436358400:12345-192.168.203.12@tcp:101:dd.0 Request processed in 2811us (24751us total) trans 120259084358 rc 0/0 00000100:00100000:1.0:1784189344.541943:0:66170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1518 00000100:00100000:0.0:1784189344.563364:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1784189344.563875:0:66945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436358784 00000100:00100000:2.0:1784189344.563885:0:66945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436358784 00000100:00100000:2.0:1784189344.563955:0:66945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1519 00000100:00100000:2.0:1784189344.563964:0:66945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf425fa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:debedd94-805c-42a0-a5e5-41758b2012e9+36:73668:x1870854436358784:12345-192.168.203.12@tcp:36:dd.0 00010000:00010000:2.0:1784189344.564016:0:66945:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784189344.564042:0:66945:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc07116fe00/0xcc1762b626f8d05c lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c4270 expref: 36 pid: 68287 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189344.564060:0:66945:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x7:0x0].0x0 (ffff9dbf45994300) 00010000:00010000:2.0:1784189344.564065:0:66945:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1784189344.564245:0:66945:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4710f400/0xcc1762b626f8d09b lrc: 3/0,1 mode: --/PW res: [0x20000cf21:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189344.564259:0:66945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4710f400/0xcc1762b626f8d09b lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189344.564282:0:66945:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4710f400/0xcc1762b626f8d09b lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1784189344.564344:0:66945:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 120259084359 00000004:00010000:2.0:1784189344.564366:0:66945:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000045ebccde reply state 00000000d498c179 transno 120259084360 ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4710f400/0xcc1762b626f8d09b lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189344.564379:0:66945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4710f400/0xcc1762b626f8d09b lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189344.564386:0:66945:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x7:0x0].0x0 (ffff9dbf45994300) 00010000:00010000:2.0:1784189344.564389:0:66945:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1784189344.564391:0:66945:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1784189344.564490:0:66945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf425fa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:debedd94-805c-42a0-a5e5-41758b2012e9+38:73668:x1870854436358784:12345-192.168.203.12@tcp:36:dd.0 Request processed in 525us (1133us total) trans 120259084360 rc 0/0 00000100:00100000:2.0:1784189344.564498:0:66945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1519 00000020:00080000:2.0:1784189344.564503:0:66945:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1784189344.575425:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1784189344.575744:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1784189344.575901:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1784189344.575980:0:26164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436359296 00000100:00100000:1.0:1784189344.575990:0:26164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436359296 00000100:00100000:1.0:1784189344.576052:0:26164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 5021 00000100:00100000:1.0:1784189344.576062:0:26164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc07faa9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:debedd94-805c-42a0-a5e5-41758b2012e9+5:73668:x1870854436359296:12345-192.168.203.12@tcp:101:dd.0 00010000:00010000:1.0:1784189344.576079:0:26164:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784189344.576099:0:26164:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e101baf9/0xcc1762b626f8d0a2 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x763:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xcbfc5de7fe6c4293 expref: -99 pid: 26164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1784189344.576123:0:26164:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x763:0x0] initial LVB size: 0, mtime: 0x6a589195, atime: 0x6a589195, ctime: 0x6a589195, blocks: 0x0 00010000:00010000:1.0:1784189344.576144:0:26164:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x763:0x0].0x0 since=3586s v=(0 0) 00010000:00010000:1.0:1784189344.576150:0:26164:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x763:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784189344.576158:0:26164:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e101baf9/0xcc1762b626f8d0a2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x763:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c4293 expref: 6 pid: 26164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189344.576174:0:26164:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000e101baf9/0xcc1762b626f8d0a2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x763:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c4293 expref: 6 pid: 26164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189344.576195:0:26164:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc07116e600, rc 0) 00010000:00000080:1.0:1784189344.576202:0:26164:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9dc07faa9180 x1870854436359296/t0(0) o101->debedd94-805c-42a0-a5e5-41758b2012e9@192.168.203.12@tcp:535/0 lens 328/400 e 0 to 0 dl 1784189355 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1784189344.576257:0:26164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc07faa9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:debedd94-805c-42a0-a5e5-41758b2012e9+6:73668:x1870854436359296:12345-192.168.203.12@tcp:101:dd.0 Request processed in 197us (355us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189344.576280:0:26164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 5021 00000100:00100000:0.0:1784189344.579165:0:66171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436358912 00000100:00100000:0.0:1784189344.579179:0:66171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436358912 00000100:00100000:0.0:1784189344.579249:0:66171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436359168 00000100:00100000:0.0:1784189344.579253:0:66171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436359168 00000100:00100000:0.0:1784189344.579278:0:66171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1520 00000100:00100000:0.0:1784189344.579286:0:66171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc07b5e0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:debedd94-805c-42a0-a5e5-41758b2012e9+39:73667:x1870854436358912:12345-192.168.203.12@tcp:101:dd.0 00010000:00010000:0.0:1784189344.579309:0:66171:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784189344.579349:0:66171:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc070147800/0xcc1762b626f8d0a9 lrc: 2/0,0 mode: --/PR res: [0x20000cf21:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbfc5de7fe6c4285 expref: -99 pid: 66171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189344.579382:0:66171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc070146a00/0xcc1762b626f8d0b0 lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189344.579395:0:66171:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc070146a00/0xcc1762b626f8d0b0 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189344.579422:0:66171:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc070146a00/0xcc1762b626f8d0b0 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189344.579555:0:66171:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc070147800/0xcc1762b626f8d0a9 lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c4285 expref: 41 pid: 66171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189344.579573:0:66171:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc070146a00/0xcc1762b626f8d0b0 lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c4285 expref: 40 pid: 66171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189344.579580:0:66171:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x6:0x0].0x0 (ffff9dc05a487700) 00010000:00010000:0.0:1784189344.579583:0:66171:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00000100:00100000:2.0:1784189344.579721:0:66945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1521 00000100:00100000:2.0:1784189344.579733:0:66945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc07b5e3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:debedd94-805c-42a0-a5e5-41758b2012e9+40:73669:x1870854436359168:12345-192.168.203.12@tcp:101:dd.0 00010000:00010000:2.0:1784189344.579743:0:66945:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784189344.579762:0:66945:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4710fc00/0xcc1762b626f8d0b7 lrc: 2/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbfc5de7fe6c428c expref: -99 pid: 66945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189344.579876:0:66945:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4710f200/0xcc1762b626f8d0be lrc: 3/1,0 mode: --/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189344.579905:0:66945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4710f200/0xcc1762b626f8d0be lrc: 3/1,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189344.579922:0:66945:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4710f200/0xcc1762b626f8d0be lrc: 3/1,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189344.579939:0:66945:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4710e000/0xcc1762b626f8d0c5 lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0x4:0x0].0x2c9ecea3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189344.579946:0:66945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4710e000/0xcc1762b626f8d0c5 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x2c9ecea3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189344.579952:0:66945:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4710e000/0xcc1762b626f8d0c5 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x2c9ecea3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189344.579994:0:66945:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4710e600/0xcc1762b626f8d0cc lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0x8:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189344.580003:0:66945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4710e600/0xcc1762b626f8d0cc lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x8:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189344.580009:0:66945:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4710e600/0xcc1762b626f8d0cc lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x8:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784189344.580018:0:66945:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000cf21:0x8:0x0]: returning size 0 00010000:00010000:2.0:1784189344.580085:0:66945:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4710f200/0xcc1762b626f8d0be lrc: 4/1,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189344.580093:0:66945:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4710f200/0xcc1762b626f8d0be lrc: 4/1,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189344.580099:0:66945:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4710f200/0xcc1762b626f8d0be lrc: 3/0,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189344.580111:0:66945:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4710f200/0xcc1762b626f8d0be lrc: 4/0,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189344.580117:0:66945:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dbf4710f200 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:2.0:1784189344.580121:0:66945:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4710f200/0xcc1762b626f8d0be lrc: 4/0,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189344.580129:0:66945:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4710f200/0xcc1762b626f8d0be lrc: 5/0,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189344.580139:0:66945:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x0 (ffff9dbf45994c00) 00010000:00010000:2.0:1784189344.580141:0:66945:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784189344.580145:0:66945:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4710f200/0xcc1762b626f8d0be lrc: 3/0,0 mode: --/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189344.580151:0:66945:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4710f200/0xcc1762b626f8d0be lrc: 0/0,0 mode: --/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189344.580172:0:66945:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4710e000/0xcc1762b626f8d0c5 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x2c9ecea3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189344.580179:0:66945:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4710e000/0xcc1762b626f8d0c5 lrc: 2/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x2c9ecea3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189344.580184:0:66945:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4710e000/0xcc1762b626f8d0c5 lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x2c9ecea3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189344.580190:0:66945:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dbf4710e000 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:2.0:1784189344.580192:0:66945:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4710e000/0xcc1762b626f8d0c5 lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x2c9ecea3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189344.580207:0:66945:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4710e000/0xcc1762b626f8d0c5 lrc: 4/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x2c9ecea3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189344.580215:0:66945:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x2c9ecea3 (ffff9dc051574500) 00010000:00010000:2.0:1784189344.580218:0:66945:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784189344.580221:0:66945:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4710e000/0xcc1762b626f8d0c5 lrc: 2/0,0 mode: --/PR res: [0x20000cf21:0x4:0x0].0x2c9ecea3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189344.580226:0:66945:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4710e000/0xcc1762b626f8d0c5 lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0x4:0x0].0x2c9ecea3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189344.580266:0:66945:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4710fc00/0xcc1762b626f8d0b7 lrc: 0/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c428c expref: 43 pid: 66945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189344.580279:0:66945:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4710e600/0xcc1762b626f8d0cc lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x8:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c428c expref: 42 pid: 66945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189344.580285:0:66945:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x8:0x0].0x0 (ffff9dbf45994f00) 00010000:00010000:2.0:1784189344.580287:0:66945:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784189344.580289:0:66945:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dbf4710e600, rc 0) 00000100:00100000:2.0:1784189344.580377:0:66945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc07b5e3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:debedd94-805c-42a0-a5e5-41758b2012e9+42:73669:x1870854436359168:12345-192.168.203.12@tcp:101:dd.0 Request processed in 647us (4632us total) trans 120259084361 rc 0/0 00000100:00100000:2.0:1784189344.580384:0:66945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1521 00010000:00010000:0.0:1784189344.581496:0:66171:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc070146a00, rc 0) 00000100:00100000:0.0:1784189344.581764:0:66171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc07b5e0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:debedd94-805c-42a0-a5e5-41758b2012e9+41:73667:x1870854436358912:12345-192.168.203.12@tcp:101:dd.0 Request processed in 2466us (6335us total) trans 0 rc 0/0 00000100:00100000:0.0:1784189344.581836:0:66171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1520 00000100:00100000:1.0:1784189344.582675:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1784189344.583856:0:24846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436359424 00000100:00100000:3.0:1784189344.583866:0:24846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436359424 00002000:00010000:3.0:1784189344.584004:0:24846:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/1891 (0->18446744073709551615) 00002000:00100000:3.0:1784189344.584010:0:24846:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9dc075f7ed80 with x1870854436359424 ext(0->18446744073709551615) 00002000:00010000:3.0:1784189344.584020:0:24846:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9dc075f7ed80. 00000100:00100000:3.0:1784189344.584099:0:24846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1008 00000100:00100000:3.0:1784189344.584110:0:24846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc075f7ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:debedd94-805c-42a0-a5e5-41758b2012e9+6:2396:x1870854436359424:12345-192.168.203.12@tcp:10:dd.0 00002000:00010000:3.0:1784189344.584269:0:24846:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x763:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1784189344.584273:0:24846:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x763:0x0] updating lvb mtime from disk: 1784189333 -> 1784189343 00002000:00010000:3.0:1784189344.584275:0:24846:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x763:0x0] updating lvb atime from disk: 1784189333 -> 1784189333 00002000:00010000:3.0:1784189344.584277:0:24846:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x763:0x0] updating lvb ctime from disk: 1784189333 -> 1784189343 00002000:00010000:3.0:1784189344.584279:0:24846:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x763:0x0] updating lvb blocks from disk: 0 -> 0 00010000:00000080:3.0:1784189344.584287:0:24846:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9dc075f7ed80 x1870854436359424/t4294968978(0) o10->debedd94-805c-42a0-a5e5-41758b2012e9@192.168.203.12@tcp:535/0 lens 440/432 e 0 to 0 dl 1784189355 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1784189344.584392:0:24846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc075f7ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:debedd94-805c-42a0-a5e5-41758b2012e9+7:2396:x1870854436359424:12345-192.168.203.12@tcp:10:dd.0 Request processed in 283us (1718us total) trans 4294968978 rc 0/0 00000100:00100000:3.0:1784189344.584400:0:24846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1008 00002000:00010000:3.0:1784189344.584404:0:24846:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/1891 (0->18446744073709551615) 00002000:00100000:3.0:1784189344.584406:0:24846:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9dc075f7ed80 with x1870854436359424 ext(0->18446744073709551615) 00002000:00010000:3.0:1784189344.584412:0:24846:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9dc075f7ed80. 00000100:00100000:2.0:1784189344.595353:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1784189344.595387:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1784189344.595414:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1784189344.595452:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1784189344.595726:0:66945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436359680 00000100:00100000:3.0:1784189344.595737:0:66945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436359680 00000100:00100000:3.0:1784189344.595789:0:66945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436359808 00000100:00100000:3.0:1784189344.595792:0:66945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436359808 00000100:00100000:3.0:1784189344.595821:0:66945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436360064 00000100:00100000:3.0:1784189344.595824:0:66945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436360064 00000100:00100000:3.0:1784189344.595841:0:66945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1522 00000100:00100000:3.0:1784189344.595850:0:66945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc07faab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:debedd94-805c-42a0-a5e5-41758b2012e9+43:73667:x1870854436359680:12345-192.168.203.12@tcp:36:dd.0 00010000:00010000:3.0:1784189344.595974:0:66945:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784189344.596001:0:66945:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc07116e000/0xcc1762b626f8d08d lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c427e expref: 43 pid: 66170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189344.596020:0:66945:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x6:0x0].0x0 (ffff9dc05a487700) 00010000:00010000:3.0:1784189344.596025:0:66945:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1784189344.596178:0:66945:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc058f66a00/0xcc1762b626f8d0da lrc: 3/0,1 mode: --/PW res: [0x20000cf21:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189344.596193:0:66945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc058f66a00/0xcc1762b626f8d0da lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189344.596202:0:66945:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc058f66a00/0xcc1762b626f8d0da lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1784189344.596257:0:66945:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 120259084362 00000004:00010000:3.0:1784189344.596280:0:66945:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000cb2daf43 reply state 000000001a73983d transno 120259084363 ns: mdt-lustre-MDT0000_UUID lock: ffff9dc058f66a00/0xcc1762b626f8d0da lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189344.596292:0:66945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc058f66a00/0xcc1762b626f8d0da lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189344.596297:0:66945:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x6:0x0].0x0 (ffff9dc05a487700) 00010000:00010000:3.0:1784189344.596300:0:66945:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1784189344.596302:0:66945:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1784189344.596377:0:66170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1523 00000100:00100000:2.0:1784189344.596393:0:66170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc07faa8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:debedd94-805c-42a0-a5e5-41758b2012e9+45:73669:x1870854436359808:12345-192.168.203.12@tcp:101:dd.0 00000100:00100000:3.0:1784189344.596394:0:66945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc07faab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:debedd94-805c-42a0-a5e5-41758b2012e9+45:73667:x1870854436359680:12345-192.168.203.12@tcp:36:dd.0 Request processed in 546us (1082us total) trans 120259084363 rc 0/0 00000100:00100000:3.0:1784189344.596400:0:66945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1522 00010000:00010000:2.0:1784189344.596404:0:66170:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000020:00080000:3.0:1784189344.596405:0:66945:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1784189344.596415:0:66170:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4710fc00/0xcc1762b626f8d0e1 lrc: 2/0,0 mode: --/PR res: [0x20000cf21:0x8:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbfc5de7fe6c429a expref: -99 pid: 66170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784189344.596421:0:66945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1524 00000100:00100000:3.0:1784189344.596426:0:66945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc07faaa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:debedd94-805c-42a0-a5e5-41758b2012e9+45:73670:x1870854436360064:12345-192.168.203.12@tcp:101:dd.0 00010000:00010000:2.0:1784189344.596438:0:66170:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4710e000/0xcc1762b626f8d0e8 lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0x8:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189344.596447:0:66170:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4710e000/0xcc1762b626f8d0e8 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x8:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189344.596455:0:66170:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4710e000/0xcc1762b626f8d0e8 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x8:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189344.596685:0:66170:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4710fc00/0xcc1762b626f8d0e1 lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0x8:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c429a expref: 46 pid: 66170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189344.596708:0:66170:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4710e000/0xcc1762b626f8d0e8 lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x8:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c429a expref: 45 pid: 66170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189344.596715:0:66170:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x8:0x0].0x0 (ffff9dbf45994f00) 00010000:00010000:2.0:1784189344.596717:0:66170:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1784189344.596720:0:66170:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dbf4710e000, rc 0) 00000100:00100000:2.0:1784189344.596747:0:66170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc07faa8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:debedd94-805c-42a0-a5e5-41758b2012e9+45:73669:x1870854436359808:12345-192.168.203.12@tcp:101:dd.0 Request processed in 358us (1360us total) trans 0 rc 0/0 00010000:00010000:3.0:1784189344.596858:0:66945:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784189344.596868:0:66945:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc058f66800/0xcc1762b626f8d0ef lrc: 2/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbfc5de7fe6c42a1 expref: -99 pid: 66945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189344.597027:0:66945:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc058f66200/0xcc1762b626f8d0f6 lrc: 3/1,0 mode: --/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189344.597036:0:66945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc058f66200/0xcc1762b626f8d0f6 lrc: 3/1,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189344.597044:0:66945:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc058f66200/0xcc1762b626f8d0f6 lrc: 3/1,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189344.597069:0:66945:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc058f66000/0xcc1762b626f8d0fd lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0x4:0x0].0x74f887a3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189344.597077:0:66945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc058f66000/0xcc1762b626f8d0fd lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x74f887a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189344.597084:0:66945:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc058f66000/0xcc1762b626f8d0fd lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x74f887a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189344.597130:0:66945:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc058f67200/0xcc1762b626f8d104 lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189344.597138:0:66945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc058f67200/0xcc1762b626f8d104 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189344.597145:0:66945:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc058f67200/0xcc1762b626f8d104 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784189344.597153:0:66945:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000cf21:0x9:0x0]: returning size 0 00000100:00100000:2.0:1784189344.597172:0:66170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1523 00010000:00010000:3.0:1784189344.597201:0:66945:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc058f66200/0xcc1762b626f8d0f6 lrc: 4/1,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189344.597209:0:66945:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc058f66200/0xcc1762b626f8d0f6 lrc: 4/1,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189344.597214:0:66945:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc058f66200/0xcc1762b626f8d0f6 lrc: 3/0,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189344.597220:0:66945:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dc058f66200/0xcc1762b626f8d0f6 lrc: 4/0,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189344.597227:0:66945:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc058f66200 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:3.0:1784189344.597236:0:66945:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc058f66200/0xcc1762b626f8d0f6 lrc: 4/0,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189344.597243:0:66945:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc058f66200/0xcc1762b626f8d0f6 lrc: 5/0,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189344.597252:0:66945:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x0 (ffff9dbf45994c00) 00010000:00010000:3.0:1784189344.597254:0:66945:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784189344.597257:0:66945:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dc058f66200/0xcc1762b626f8d0f6 lrc: 3/0,0 mode: --/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189344.597263:0:66945:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc058f66200/0xcc1762b626f8d0f6 lrc: 0/0,0 mode: --/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189344.597274:0:66945:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc058f66000/0xcc1762b626f8d0fd lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x74f887a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189344.597280:0:66945:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc058f66000/0xcc1762b626f8d0fd lrc: 2/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x74f887a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189344.597285:0:66945:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dc058f66000/0xcc1762b626f8d0fd lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x74f887a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189344.597289:0:66945:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc058f66000 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:3.0:1784189344.597292:0:66945:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc058f66000/0xcc1762b626f8d0fd lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x74f887a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189344.597298:0:66945:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc058f66000/0xcc1762b626f8d0fd lrc: 4/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x74f887a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189344.597306:0:66945:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x74f887a3 (ffff9dc0455f8d00) 00010000:00010000:3.0:1784189344.597308:0:66945:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784189344.597343:0:66945:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dc058f66000/0xcc1762b626f8d0fd lrc: 2/0,0 mode: --/PR res: [0x20000cf21:0x4:0x0].0x74f887a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189344.597351:0:66945:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc058f66000/0xcc1762b626f8d0fd lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0x4:0x0].0x74f887a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189344.597384:0:66945:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc058f66800/0xcc1762b626f8d0ef lrc: 0/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c42a1 expref: 47 pid: 66945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189344.597396:0:66945:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc058f67200/0xcc1762b626f8d104 lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c42a1 expref: 46 pid: 66945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189344.597403:0:66945:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x9:0x0].0x0 (ffff9dc07fab4300) 00010000:00010000:3.0:1784189344.597405:0:66945:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1784189344.597407:0:66945:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc058f67200, rc 0) 00000100:00100000:0.0:1784189344.597413:0:66173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436360320 00000100:00100000:0.0:1784189344.597419:0:66173:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436360320 00000100:00100000:3.0:1784189344.597448:0:66945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc07faaa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:debedd94-805c-42a0-a5e5-41758b2012e9+47:73670:x1870854436360064:12345-192.168.203.12@tcp:101:dd.0 Request processed in 1021us (2032us total) trans 120259084364 rc 0/0 00000100:00100000:3.0:1784189344.597454:0:66945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1524 00000100:00100000:0.0:1784189344.597461:0:66173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 265 00000100:00100000:0.0:1784189344.597469:0:66173:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc07faabb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:debedd94-805c-42a0-a5e5-41758b2012e9+46:73668:x1870854436360320:12345-192.168.203.12@tcp:35:dd.0 00000100:00100000:0.0:1784189344.597632:0:66173:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc07faabb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:debedd94-805c-42a0-a5e5-41758b2012e9+47:73668:x1870854436360320:12345-192.168.203.12@tcp:35:dd.0 Request processed in 163us (2178us total) trans 120259084365 rc 0/0 00000100:00100000:0.0:1784189344.597639:0:66173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 265 00000100:00100000:2.0:1784189344.604734:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1784189344.605291:0:26163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436360448 00000100:00100000:0.0:1784189344.605302:0:26163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436360448 00000100:00100000:0.0:1784189344.605400:0:26163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 5022 00000100:00100000:0.0:1784189344.605410:0:26163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc07faa8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:debedd94-805c-42a0-a5e5-41758b2012e9+7:73667:x1870854436360448:12345-192.168.203.12@tcp:101:dd.0 00010000:00010000:0.0:1784189344.605439:0:26163:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784189344.605460:0:26163:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000012da23a3/0xcc1762b626f8d112 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x762:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xcbfc5de7fe6c42a8 expref: -99 pid: 26163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1784189344.605557:0:26163:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x762:0x0] initial LVB size: 0, mtime: 0x6a589195, atime: 0x6a589195, ctime: 0x6a589195, blocks: 0x0 00010000:00010000:0.0:1784189344.605581:0:26163:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x762:0x0].0x0 since=3586s v=(0 0) 00010000:00010000:0.0:1784189344.605586:0:26163:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x762:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784189344.605865:0:26163:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000012da23a3/0xcc1762b626f8d112 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x762:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c42a8 expref: 8 pid: 26163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189344.605882:0:26163:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000012da23a3/0xcc1762b626f8d112 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x762:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c42a8 expref: 8 pid: 26163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189344.606598:0:26163:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc070147800, rc 0) 00010000:00000080:0.0:1784189344.606607:0:26163:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9dc07faa8e00 x1870854436360448/t0(0) o101->debedd94-805c-42a0-a5e5-41758b2012e9@192.168.203.12@tcp:535/0 lens 328/400 e 0 to 0 dl 1784189355 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1784189344.606948:0:26163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc07faa8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:debedd94-805c-42a0-a5e5-41758b2012e9+8:73667:x1870854436360448:12345-192.168.203.12@tcp:101:dd.0 Request processed in 1537us (2220us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189344.606957:0:26163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 5022 00000100:00100000:1.0:1784189344.610411:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1784189344.610441:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1784189344.610473:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1784189344.612924:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1784189344.614052:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436361216 00000100:00100000:1.0:1784189344.614064:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436361216 00002000:00010000:1.0:1784189344.614103:0:8435:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/1890 (0->18446744073709551615) 00002000:00100000:1.0:1784189344.614107:0:8435:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9dc075f7e680 with x1870854436361216 ext(0->18446744073709551615) 00002000:00010000:1.0:1784189344.614119:0:8435:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9dc075f7e680. 00000100:00100000:1.0:1784189344.614149:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1009 00000100:00100000:1.0:1784189344.614158:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc075f7e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:debedd94-805c-42a0-a5e5-41758b2012e9+8:2399:x1870854436361216:12345-192.168.203.12@tcp:10:dd.0 00002000:00010000:1.0:1784189344.614395:0:8435:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x762:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1784189344.614399:0:8435:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x762:0x0] updating lvb mtime from disk: 1784189333 -> 1784189343 00002000:00010000:1.0:1784189344.614402:0:8435:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x762:0x0] updating lvb atime from disk: 1784189333 -> 1784189333 00002000:00010000:1.0:1784189344.614404:0:8435:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x762:0x0] updating lvb ctime from disk: 1784189333 -> 1784189343 00002000:00010000:1.0:1784189344.614406:0:8435:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x762:0x0] updating lvb blocks from disk: 0 -> 0 00010000:00000080:1.0:1784189344.614415:0:8435:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9dc075f7e680 x1870854436361216/t4294968979(0) o10->debedd94-805c-42a0-a5e5-41758b2012e9@192.168.203.12@tcp:535/0 lens 440/432 e 0 to 0 dl 1784189355 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1784189344.616153:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc075f7e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:debedd94-805c-42a0-a5e5-41758b2012e9+9:2399:x1870854436361216:12345-192.168.203.12@tcp:10:dd.0 Request processed in 320us (1571us total) trans 4294968979 rc 0/0 00000100:00100000:1.0:1784189344.616245:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1009 00002000:00010000:1.0:1784189344.616252:0:8435:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/1890 (0->18446744073709551615) 00002000:00100000:1.0:1784189344.616256:0:8435:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9dc075f7e680 with x1870854436361216 ext(0->18446744073709551615) 00002000:00010000:1.0:1784189344.616266:0:8435:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9dc075f7e680. 00000100:00100000:0.0:1784189344.616421:0:66171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436360704 00000100:00100000:0.0:1784189344.616430:0:66171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436360704 00000100:00100000:2.0:1784189344.616571:0:66170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436361088 00000100:00100000:2.0:1784189344.616576:0:66170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436361088 00000100:00100000:2.0:1784189344.616639:0:66170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436360832 00000100:00100000:2.0:1784189344.616642:0:66170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436360832 00000100:00100000:2.0:1784189344.616661:0:66170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1525 00000100:00100000:2.0:1784189344.616669:0:66170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc075f7d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:debedd94-805c-42a0-a5e5-41758b2012e9+49:73671:x1870854436361088:12345-192.168.203.12@tcp:101:dd.0 00010000:00010000:2.0:1784189344.616692:0:66170:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784189344.616709:0:66170:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4710fc00/0xcc1762b626f8d119 lrc: 2/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbfc5de7fe6c42b6 expref: -99 pid: 66170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189344.617079:0:66170:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4710f200/0xcc1762b626f8d120 lrc: 3/1,0 mode: --/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189344.617093:0:66170:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4710f200/0xcc1762b626f8d120 lrc: 3/1,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189344.617103:0:66170:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4710f200/0xcc1762b626f8d120 lrc: 3/1,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189344.617116:0:66170:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4710f600/0xcc1762b626f8d127 lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0x4:0x0].0xbd5240a3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189344.617122:0:66170:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4710f600/0xcc1762b626f8d127 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0xbd5240a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189344.617128:0:66170:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4710f600/0xcc1762b626f8d127 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0xbd5240a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189344.617181:0:66170:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4710ee00/0xcc1762b626f8d12e lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784189344.617704:0:68287:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1526 00000100:00100000:3.0:1784189344.617718:0:68287:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc075f7df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:debedd94-805c-42a0-a5e5-41758b2012e9+50:73670:x1870854436360832:12345-192.168.203.12@tcp:101:dd.0 00010000:00010000:3.0:1784189344.617729:0:68287:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784189344.617740:0:68287:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc058f66800/0xcc1762b626f8d135 lrc: 2/0,0 mode: --/PR res: [0x20000cf21:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbfc5de7fe6c42af expref: -99 pid: 68287 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189344.617762:0:68287:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc058f66000/0xcc1762b626f8d13c lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189344.617772:0:68287:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc058f66000/0xcc1762b626f8d13c lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189344.617794:0:68287:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc058f66000/0xcc1762b626f8d13c lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189344.617961:0:68287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc058f66800/0xcc1762b626f8d135 lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c42af expref: 52 pid: 68287 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189344.617982:0:68287:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc058f66000/0xcc1762b626f8d13c lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c42af expref: 51 pid: 68287 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189344.617991:0:68287:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x9:0x0].0x0 (ffff9dc07fab4300) 00010000:00010000:3.0:1784189344.617994:0:68287:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1784189344.617998:0:68287:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc058f66000, rc 0) 00000100:00100000:3.0:1784189344.618060:0:68287:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc075f7df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:debedd94-805c-42a0-a5e5-41758b2012e9+51:73670:x1870854436360832:12345-192.168.203.12@tcp:101:dd.0 Request processed in 347us (7586us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189344.618060:0:66171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1527 00000100:00100000:3.0:1784189344.618067:0:68287:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1526 00000100:00100000:1.0:1784189344.618068:0:66171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc075f7d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:debedd94-805c-42a0-a5e5-41758b2012e9+51:73669:x1870854436360704:12345-192.168.203.12@tcp:36:dd.0 00010000:00010000:1.0:1784189344.618092:0:66171:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784189344.618106:0:66171:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4710e600/0xcc1762b626f8d0cc lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0x8:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c428c expref: 50 pid: 66945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189344.618118:0:66171:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x8:0x0].0x0 (ffff9dbf45994f00) 00010000:00010000:1.0:1784189344.618121:0:66171:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1784189344.620304:0:66170:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4710ee00/0xcc1762b626f8d12e lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0xa:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189344.620357:0:66170:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4710ee00/0xcc1762b626f8d12e lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0xa:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784189344.620373:0:66170:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000cf21:0xa:0x0]: returning size 0 00010000:00010000:2.0:1784189344.620469:0:66170:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4710f200/0xcc1762b626f8d120 lrc: 4/1,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189344.620730:0:66171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc07116e400/0xcc1762b626f8d14a lrc: 3/0,1 mode: --/PW res: [0x20000cf21:0x8:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189344.620740:0:66171:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc07116e400/0xcc1762b626f8d14a lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189344.620749:0:66171:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc07116e400/0xcc1762b626f8d14a lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189344.621681:0:66170:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4710f200/0xcc1762b626f8d120 lrc: 4/1,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189344.621689:0:66170:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4710f200/0xcc1762b626f8d120 lrc: 3/0,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189344.621697:0:66170:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4710f200/0xcc1762b626f8d120 lrc: 4/0,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189344.621703:0:66170:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dbf4710f200 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:2.0:1784189344.621707:0:66170:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4710f200/0xcc1762b626f8d120 lrc: 4/0,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189344.621714:0:66170:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4710f200/0xcc1762b626f8d120 lrc: 5/0,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189344.621727:0:66170:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x0 (ffff9dbf45994c00) 00010000:00010000:2.0:1784189344.621730:0:66170:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784189344.621733:0:66170:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4710f200/0xcc1762b626f8d120 lrc: 3/0,0 mode: --/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189344.621740:0:66170:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4710f200/0xcc1762b626f8d120 lrc: 0/0,0 mode: --/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1784189344.622017:0:66171:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 120259084367 00000004:00010000:1.0:1784189344.622051:0:66171:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000c162f1e0 reply state 000000006fc1d438 transno 120259084368 ns: mdt-lustre-MDT0000_UUID lock: ffff9dc07116e400/0xcc1762b626f8d14a lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189344.622064:0:66171:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc07116e400/0xcc1762b626f8d14a lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189344.622081:0:66171:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x8:0x0].0x0 (ffff9dbf45994f00) 00010000:00010000:1.0:1784189344.622083:0:66171:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1784189344.622086:0:66171:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1784189344.622578:0:66170:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4710f600/0xcc1762b626f8d127 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0xbd5240a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189344.622990:0:66170:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4710f600/0xcc1762b626f8d127 lrc: 2/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0xbd5240a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189344.622997:0:66170:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4710f600/0xcc1762b626f8d127 lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0xbd5240a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189344.623002:0:66170:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dbf4710f600 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:2.0:1784189344.623006:0:66170:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4710f600/0xcc1762b626f8d127 lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0xbd5240a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189344.623012:0:66170:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4710f600/0xcc1762b626f8d127 lrc: 4/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0xbd5240a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189344.623022:0:66170:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0xbd5240a3 (ffff9dc051574500) 00010000:00010000:2.0:1784189344.623024:0:66170:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784189344.623028:0:66170:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4710f600/0xcc1762b626f8d127 lrc: 2/0,0 mode: --/PR res: [0x20000cf21:0x4:0x0].0xbd5240a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189344.623033:0:66170:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4710f600/0xcc1762b626f8d127 lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0x4:0x0].0xbd5240a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189344.623083:0:66170:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4710fc00/0xcc1762b626f8d119 lrc: 0/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c42b6 expref: 54 pid: 66170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189344.623097:0:66170:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4710ee00/0xcc1762b626f8d12e lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0xa:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c42b6 expref: 53 pid: 66170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189344.623103:0:66170:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0xa:0x0].0x0 (ffff9dc05a487100) 00010000:00010000:2.0:1784189344.623106:0:66170:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784189344.623114:0:66170:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dbf4710ee00, rc 0) 00000100:00100000:2.0:1784189344.623145:0:66170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc075f7d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:debedd94-805c-42a0-a5e5-41758b2012e9+53:73671:x1870854436361088:12345-192.168.203.12@tcp:101:dd.0 Request processed in 6476us (12703us total) trans 120259084366 rc 0/0 00000100:00100000:2.0:1784189344.623153:0:66170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1525 00000100:00100000:1.0:1784189344.623272:0:66171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc075f7d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:debedd94-805c-42a0-a5e5-41758b2012e9+52:73669:x1870854436360704:12345-192.168.203.12@tcp:36:dd.0 Request processed in 4117us (11782us total) trans 120259084368 rc 0/0 00000100:00100000:1.0:1784189344.623279:0:66171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1527 00000020:00080000:1.0:1784189344.623283:0:66171:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1784189344.623433:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1784189344.625448:0:68287:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436361472 00000100:00100000:3.0:1784189344.625460:0:68287:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436361472 00000100:00100000:3.0:1784189344.625525:0:68287:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1528 00000100:00100000:3.0:1784189344.625534:0:68287:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc050541180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:debedd94-805c-42a0-a5e5-41758b2012e9+52:73670:x1870854436361472:12345-192.168.203.12@tcp:36:dd.0 00010000:00010000:3.0:1784189344.625596:0:68287:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784189344.625620:0:68287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc058f67200/0xcc1762b626f8d104 lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c42a1 expref: 52 pid: 66945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189344.625635:0:68287:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x9:0x0].0x0 (ffff9dc07fab4300) 00010000:00010000:3.0:1784189344.625639:0:68287:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1784189344.626046:0:68287:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0755a4000/0xcc1762b626f8d151 lrc: 3/0,1 mode: --/PW res: [0x20000cf21:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189344.626060:0:68287:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0755a4000/0xcc1762b626f8d151 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189344.626069:0:68287:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0755a4000/0xcc1762b626f8d151 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1784189344.626110:0:68287:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 120259084369 00000004:00010000:3.0:1784189344.626130:0:68287:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000dd092694 reply state 000000008b7cb6a3 transno 120259084370 ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0755a4000/0xcc1762b626f8d151 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189344.626142:0:68287:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0755a4000/0xcc1762b626f8d151 lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189344.626148:0:68287:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x9:0x0].0x0 (ffff9dc07fab4300) 00010000:00010000:3.0:1784189344.626150:0:68287:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1784189344.626152:0:68287:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1784189344.626296:0:68287:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc050541180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:debedd94-805c-42a0-a5e5-41758b2012e9+54:73670:x1870854436361472:12345-192.168.203.12@tcp:36:dd.0 Request processed in 761us (2861us total) trans 120259084370 rc 0/0 00000100:00100000:3.0:1784189344.626304:0:68287:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1528 00000020:00080000:3.0:1784189344.626309:0:68287:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1784189344.630577:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1784189344.630690:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1784189344.633611:0:26170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436361600 00000100:00100000:2.0:1784189344.633625:0:26170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436361600 00000100:00100000:2.0:1784189344.634608:0:26170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436361728 00000100:00100000:2.0:1784189344.634617:0:26170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436361728 00000100:00100000:2.0:1784189344.634658:0:26170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 5023 00000100:00100000:2.0:1784189344.634669:0:26170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc075f7c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:debedd94-805c-42a0-a5e5-41758b2012e9+10:73669:x1870854436361600:12345-192.168.203.12@tcp:101:dd.0 00010000:00010000:2.0:1784189344.634685:0:26170:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784189344.634706:0:26170:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000434d0145/0xcc1762b626f8d158 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x764:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xcbfc5de7fe6c42bd expref: -99 pid: 26170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1784189344.634732:0:26170:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x764:0x0] initial LVB size: 0, mtime: 0x6a589195, atime: 0x6a589195, ctime: 0x6a589195, blocks: 0x0 00010000:00010000:2.0:1784189344.634767:0:26170:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x764:0x0].0x0 since=3586s v=(0 0) 00010000:00010000:2.0:1784189344.634773:0:26170:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x764:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784189344.634781:0:26170:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000434d0145/0xcc1762b626f8d158 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x764:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c42bd expref: 11 pid: 26170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189344.634807:0:26170:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000434d0145/0xcc1762b626f8d158 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x764:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c42bd expref: 11 pid: 26170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189344.634820:0:26170:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc0565e6c00, rc 0) 00010000:00000080:2.0:1784189344.634828:0:26170:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9dc075f7c700 x1870854436361600/t0(0) o101->debedd94-805c-42a0-a5e5-41758b2012e9@192.168.203.12@tcp:535/0 lens 328/400 e 0 to 0 dl 1784189355 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1784189344.634896:0:26170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc075f7c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:debedd94-805c-42a0-a5e5-41758b2012e9+11:73669:x1870854436361600:12345-192.168.203.12@tcp:101:dd.0 Request processed in 229us (4328us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189344.634917:0:26170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 5023 00000100:00100000:2.0:1784189344.634937:0:26170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 5024 00000100:00100000:2.0:1784189344.634943:0:26170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc075f7ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:debedd94-805c-42a0-a5e5-41758b2012e9+10:73670:x1870854436361728:12345-192.168.203.12@tcp:101:dd.0 00010000:00010000:2.0:1784189344.634950:0:26170:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784189344.634960:0:26170:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000a795375/0xcc1762b626f8d15f lrc: 2/0,0 mode: --/PW res: [0x280000401:0x765:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xcbfc5de7fe6c42c4 expref: -99 pid: 26170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1784189344.634973:0:26170:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x765:0x0] initial LVB size: 0, mtime: 0x6a589196, atime: 0x6a589196, ctime: 0x6a589196, blocks: 0x0 00010000:00010000:2.0:1784189344.634982:0:26170:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x765:0x0].0x0 since=3586s v=(0 0) 00010000:00010000:2.0:1784189344.634985:0:26170:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x765:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784189344.634990:0:26170:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000a795375/0xcc1762b626f8d15f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x765:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c42c4 expref: 11 pid: 26170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189344.635000:0:26170:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000000a795375/0xcc1762b626f8d15f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x765:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c42c4 expref: 11 pid: 26170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189344.635009:0:26170:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc0565e7000, rc 0) 00010000:00000080:2.0:1784189344.635013:0:26170:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9dc075f7ea00 x1870854436361728/t0(0) o101->debedd94-805c-42a0-a5e5-41758b2012e9@192.168.203.12@tcp:535/0 lens 328/400 e 0 to 0 dl 1784189355 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1784189344.635037:0:26170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc075f7ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:debedd94-805c-42a0-a5e5-41758b2012e9+11:73670:x1870854436361728:12345-192.168.203.12@tcp:101:dd.0 Request processed in 95us (4348us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189344.635043:0:26170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 5024 00000100:00100000:2.0:1784189344.637191:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1784189344.637270:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1784189344.637379:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1784189344.637406:0:66170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436362112 00000100:00100000:2.0:1784189344.637414:0:66170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436362112 00000100:00100000:2.0:1784189344.637460:0:66170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436362368 00000100:00100000:2.0:1784189344.637464:0:66170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436362368 00000100:00100000:2.0:1784189344.637494:0:66170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1529 00000100:00100000:2.0:1784189344.637503:0:66170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc07faab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:debedd94-805c-42a0-a5e5-41758b2012e9+55:73671:x1870854436362112:12345-192.168.203.12@tcp:101:dd.0 00010000:00010000:2.0:1784189344.637524:0:66170:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784189344.637542:0:66170:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0565e6a00/0xcc1762b626f8d166 lrc: 2/0,0 mode: --/PR res: [0x20000cf21:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbfc5de7fe6c42cb expref: -99 pid: 66170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189344.637573:0:66170:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0565e6000/0xcc1762b626f8d16d lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189344.637597:0:66170:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0565e6000/0xcc1762b626f8d16d lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0xa:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189344.637609:0:66170:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0565e6000/0xcc1762b626f8d16d lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0xa:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189344.637707:0:66170:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0565e6a00/0xcc1762b626f8d166 lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0xa:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c42cb expref: 57 pid: 66170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189344.637724:0:66170:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0565e6000/0xcc1762b626f8d16d lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0xa:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c42cb expref: 56 pid: 66170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189344.637733:0:66170:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0xa:0x0].0x0 (ffff9dc05a487100) 00010000:00010000:2.0:1784189344.637736:0:66170:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1784189344.637739:0:66170:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc0565e6000, rc 0) 00000100:00100000:2.0:1784189344.638550:0:66170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc07faab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:debedd94-805c-42a0-a5e5-41758b2012e9+56:73671:x1870854436362112:12345-192.168.203.12@tcp:101:dd.0 Request processed in 1043us (1275us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189344.638565:0:66170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1529 00000100:00100000:2.0:1784189344.639219:0:66170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1530 00000100:00100000:2.0:1784189344.639233:0:66170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc07faaaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:debedd94-805c-42a0-a5e5-41758b2012e9+55:73672:x1870854436362368:12345-192.168.203.12@tcp:101:dd.0 00010000:00010000:2.0:1784189344.639248:0:66170:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784189344.639264:0:66170:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0565e7200/0xcc1762b626f8d174 lrc: 2/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbfc5de7fe6c42d2 expref: -99 pid: 66170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189344.639408:0:66170:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04a20bc00/0xcc1762b626f8d17b lrc: 3/1,0 mode: --/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189344.639420:0:66170:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04a20bc00/0xcc1762b626f8d17b lrc: 3/1,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189344.639439:0:66170:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04a20bc00/0xcc1762b626f8d17b lrc: 3/1,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189344.639455:0:66170:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04a20b200/0xcc1762b626f8d182 lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0x4:0x0].0x5abf9a3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189344.639462:0:66170:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04a20b200/0xcc1762b626f8d182 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x5abf9a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189344.639468:0:66170:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04a20b200/0xcc1762b626f8d182 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x5abf9a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189344.640082:0:66170:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04a20b400/0xcc1762b626f8d189 lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189344.640092:0:66170:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04a20b400/0xcc1762b626f8d189 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189344.640112:0:66170:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04a20b400/0xcc1762b626f8d189 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784189344.640122:0:66170:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000cf21:0xb:0x0]: returning size 0 00010000:00010000:2.0:1784189344.640195:0:66170:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04a20bc00/0xcc1762b626f8d17b lrc: 4/1,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189344.640203:0:66170:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04a20bc00/0xcc1762b626f8d17b lrc: 4/1,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189344.640209:0:66170:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04a20bc00/0xcc1762b626f8d17b lrc: 3/0,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189344.640216:0:66170:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04a20bc00/0xcc1762b626f8d17b lrc: 4/0,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189344.640221:0:66170:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc04a20bc00 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:2.0:1784189344.640225:0:66170:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04a20bc00/0xcc1762b626f8d17b lrc: 4/0,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189344.640232:0:66170:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04a20bc00/0xcc1762b626f8d17b lrc: 5/0,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189344.640242:0:66170:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x0 (ffff9dbf45994c00) 00010000:00010000:2.0:1784189344.640245:0:66170:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784189344.640250:0:66170:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04a20bc00/0xcc1762b626f8d17b lrc: 3/0,0 mode: --/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189344.640256:0:66170:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04a20bc00/0xcc1762b626f8d17b lrc: 0/0,0 mode: --/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189344.640268:0:66170:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04a20b200/0xcc1762b626f8d182 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x5abf9a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189344.640281:0:66170:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04a20b200/0xcc1762b626f8d182 lrc: 2/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x5abf9a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189344.640287:0:66170:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04a20b200/0xcc1762b626f8d182 lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x5abf9a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189344.640293:0:66170:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc04a20b200 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:2.0:1784189344.640296:0:66170:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04a20b200/0xcc1762b626f8d182 lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x5abf9a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189344.640302:0:66170:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04a20b200/0xcc1762b626f8d182 lrc: 4/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x5abf9a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189344.640310:0:66170:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x5abf9a3 (ffff9dc051574400) 00010000:00010000:2.0:1784189344.640312:0:66170:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784189344.640315:0:66170:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04a20b200/0xcc1762b626f8d182 lrc: 2/0,0 mode: --/PR res: [0x20000cf21:0x4:0x0].0x5abf9a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189344.640360:0:66170:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04a20b200/0xcc1762b626f8d182 lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0x4:0x0].0x5abf9a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189344.640402:0:66170:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0565e7200/0xcc1762b626f8d174 lrc: 0/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c42d2 expref: 58 pid: 66170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189344.640414:0:66170:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04a20b400/0xcc1762b626f8d189 lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c42d2 expref: 57 pid: 66170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189344.640421:0:66170:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0xb:0x0].0x0 (ffff9dc05a487c00) 00010000:00010000:2.0:1784189344.640424:0:66170:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784189344.640432:0:66170:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc04a20b400, rc 0) 00000100:00100000:2.0:1784189344.640492:0:66170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc07faaaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:debedd94-805c-42a0-a5e5-41758b2012e9+57:73672:x1870854436362368:12345-192.168.203.12@tcp:101:dd.0 Request processed in 1263us (3111us total) trans 120259084371 rc 0/0 00000100:00100000:2.0:1784189344.640500:0:66170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1530 00000100:00100000:1.0:1784189344.641379:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1784189344.641465:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1784189344.641746:0:24844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436362624 00000100:00100000:3.0:1784189344.641762:0:24844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436362624 00002000:00010000:3.0:1784189344.641792:0:24844:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/1893 (0->18446744073709551615) 00002000:00100000:3.0:1784189344.641797:0:24844:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9dbf4693ea00 with x1870854436362624 ext(0->18446744073709551615) 00002000:00010000:3.0:1784189344.641815:0:24844:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9dbf4693ea00. 00000100:00100000:3.0:1784189344.641838:0:24844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436362496 00000100:00100000:3.0:1784189344.641841:0:24844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436362496 00002000:00010000:3.0:1784189344.641852:0:24844:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/1892 (0->18446744073709551615) 00002000:00100000:3.0:1784189344.641855:0:24844:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9dbf4693e300 with x1870854436362496 ext(0->18446744073709551615) 00002000:00010000:3.0:1784189344.641870:0:24844:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9dbf4693e300. 00000100:00100000:3.0:1784189344.641900:0:24844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1010 00000100:00100000:3.0:1784189344.641908:0:24844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf4693ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:debedd94-805c-42a0-a5e5-41758b2012e9+12:2398:x1870854436362624:12345-192.168.203.12@tcp:10:dd.0 00002000:00010000:3.0:1784189344.642031:0:24844:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x765:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1784189344.642034:0:24844:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x765:0x0] updating lvb mtime from disk: 1784189334 -> 1784189343 00002000:00010000:3.0:1784189344.642036:0:24844:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x765:0x0] updating lvb atime from disk: 1784189334 -> 1784189334 00002000:00010000:3.0:1784189344.642038:0:24844:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x765:0x0] updating lvb ctime from disk: 1784189334 -> 1784189343 00002000:00010000:3.0:1784189344.642040:0:24844:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x765:0x0] updating lvb blocks from disk: 0 -> 0 00010000:00000080:3.0:1784189344.642048:0:24844:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9dbf4693ea00 x1870854436362624/t4294968980(0) o10->debedd94-805c-42a0-a5e5-41758b2012e9@192.168.203.12@tcp:535/0 lens 440/432 e 0 to 0 dl 1784189355 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1784189344.642882:0:24844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf4693ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:debedd94-805c-42a0-a5e5-41758b2012e9+13:2398:x1870854436362624:12345-192.168.203.12@tcp:10:dd.0 Request processed in 971us (1501us total) trans 4294968980 rc 0/0 00000100:00100000:3.0:1784189344.642950:0:24844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1010 00002000:00010000:3.0:1784189344.642955:0:24844:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/1893 (0->18446744073709551615) 00002000:00100000:3.0:1784189344.642958:0:24844:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9dbf4693ea00 with x1870854436362624 ext(0->18446744073709551615) 00002000:00010000:3.0:1784189344.642965:0:24844:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9dbf4693ea00. 00000100:00100000:3.0:1784189344.642988:0:24844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1011 00000100:00100000:3.0:1784189344.642998:0:24844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf4693e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:debedd94-805c-42a0-a5e5-41758b2012e9+12:2399:x1870854436362496:12345-192.168.203.12@tcp:10:dd.0 00002000:00010000:3.0:1784189344.643082:0:24844:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x764:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1784189344.643086:0:24844:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x764:0x0] updating lvb mtime from disk: 1784189333 -> 1784189343 00002000:00010000:3.0:1784189344.643089:0:24844:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x764:0x0] updating lvb atime from disk: 1784189333 -> 1784189333 00002000:00010000:3.0:1784189344.643091:0:24844:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x764:0x0] updating lvb ctime from disk: 1784189333 -> 1784189343 00002000:00010000:3.0:1784189344.643092:0:24844:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x764:0x0] updating lvb blocks from disk: 0 -> 0 00010000:00000080:3.0:1784189344.643099:0:24844:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9dbf4693e300 x1870854436362496/t4294968981(0) o10->debedd94-805c-42a0-a5e5-41758b2012e9@192.168.203.12@tcp:535/0 lens 440/432 e 0 to 0 dl 1784189355 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1784189344.643137:0:24844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf4693e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:debedd94-805c-42a0-a5e5-41758b2012e9+13:2399:x1870854436362496:12345-192.168.203.12@tcp:10:dd.0 Request processed in 142us (1672us total) trans 4294968981 rc 0/0 00000100:00100000:3.0:1784189344.643144:0:24844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1011 00002000:00010000:3.0:1784189344.643147:0:24844:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/1892 (0->18446744073709551615) 00002000:00100000:3.0:1784189344.643150:0:24844:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9dbf4693e300 with x1870854436362496 ext(0->18446744073709551615) 00002000:00010000:3.0:1784189344.643155:0:24844:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9dbf4693e300. 00000100:00100000:0.0:1784189344.645579:0:66173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436361984 00000100:00100000:0.0:1784189344.645668:0:66173:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436361984 00000100:00100000:0.0:1784189344.645783:0:66173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 266 00000100:00100000:0.0:1784189344.645794:0:66173:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc07faaa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:debedd94-805c-42a0-a5e5-41758b2012e9+57:73667:x1870854436361984:12345-192.168.203.12@tcp:35:dd.0 00000100:00100000:0.0:1784189344.646085:0:66173:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc07faaa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:debedd94-805c-42a0-a5e5-41758b2012e9+58:73667:x1870854436361984:12345-192.168.203.12@tcp:35:dd.0 Request processed in 292us (8900us total) trans 120259084372 rc 0/0 00000100:00100000:0.0:1784189344.646093:0:66173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 266 00000100:00100000:3.0:1784189344.649069:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1784189344.649114:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1784189344.649142:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1784189344.649161:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1784189344.649192:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1784189344.649197:0:66172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436363264 00000100:00100000:1.0:1784189344.649207:0:66172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436363264 00000100:00100000:1.0:1784189344.649256:0:66172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436363776 00000100:00100000:2.0:1784189344.649257:0:66170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436363008 00000100:00100000:1.0:1784189344.649261:0:66172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436363776 00000100:00100000:2.0:1784189344.649264:0:66170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436363008 00000100:00100000:1.0:1784189344.649280:0:66172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 267 00000100:00100000:1.0:1784189344.649292:0:66172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc050542a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:debedd94-805c-42a0-a5e5-41758b2012e9+60:73669:x1870854436363264:12345-192.168.203.12@tcp:35:dd.0 00000100:00100000:2.0:1784189344.649308:0:66170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436363520 00000100:00100000:2.0:1784189344.649313:0:66170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436363520 00000100:00100000:2.0:1784189344.649354:0:66170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436362880 00000100:00100000:2.0:1784189344.649357:0:66170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436362880 00000100:00100000:2.0:1784189344.649372:0:66170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1531 00000100:00100000:2.0:1784189344.649379:0:66170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc050543800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:debedd94-805c-42a0-a5e5-41758b2012e9+62:73672:x1870854436363008:12345-192.168.203.12@tcp:101:dd.0 00010000:00010000:2.0:1784189344.649390:0:66170:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784189344.649411:0:66170:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04a20a400/0xcc1762b626f8d197 lrc: 2/0,0 mode: --/PR res: [0x20000cf21:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbfc5de7fe6c42d9 expref: -99 pid: 66170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189344.649453:0:66170:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04a20aa00/0xcc1762b626f8d19e lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189344.649468:0:66170:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04a20aa00/0xcc1762b626f8d19e lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189344.649489:0:66170:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04a20aa00/0xcc1762b626f8d19e lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189344.649577:0:66170:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04a20a400/0xcc1762b626f8d197 lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c42d9 expref: 65 pid: 66170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189344.649606:0:66170:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04a20aa00/0xcc1762b626f8d19e lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c42d9 expref: 64 pid: 66170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784189344.649612:0:66172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc050542a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:debedd94-805c-42a0-a5e5-41758b2012e9+64:73669:x1870854436363264:12345-192.168.203.12@tcp:35:dd.0 Request processed in 320us (495us total) trans 120259084373 rc 0/0 00000100:00100000:1.0:1784189344.649625:0:66172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 267 00010000:00010000:2.0:1784189344.649637:0:66170:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0xb:0x0].0x0 (ffff9dc05a487c00) 00010000:00010000:2.0:1784189344.649640:0:66170:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1784189344.649645:0:66170:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc04a20aa00, rc 0) 00000100:00100000:1.0:1784189344.649647:0:66172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 268 00000100:00100000:1.0:1784189344.649656:0:66172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc056475180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:debedd94-805c-42a0-a5e5-41758b2012e9+63:73670:x1870854436363776:12345-192.168.203.12@tcp:35:dd.0 00000100:00100000:2.0:1784189344.649679:0:66170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc050543800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:debedd94-805c-42a0-a5e5-41758b2012e9+63:73672:x1870854436363008:12345-192.168.203.12@tcp:101:dd.0 Request processed in 299us (619us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189344.649686:0:66170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1531 00000100:00100000:1.0:1784189344.649768:0:66172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc056475180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:debedd94-805c-42a0-a5e5-41758b2012e9+63:73670:x1870854436363776:12345-192.168.203.12@tcp:35:dd.0 Request processed in 112us (575us total) trans 120259084374 rc 0/0 00000100:00100000:1.0:1784189344.649775:0:66172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 268 00000100:00100000:1.0:1784189344.649819:0:66171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1532 00000100:00100000:1.0:1784189344.649836:0:66171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc050542680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:debedd94-805c-42a0-a5e5-41758b2012e9+62:73686:x1870854436363520:12345-192.168.203.12@tcp:101:dd.0 00010000:00010000:1.0:1784189344.649846:0:66171:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784189344.649858:0:66171:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc07116f200/0xcc1762b626f8d1a5 lrc: 2/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbfc5de7fe6c42e0 expref: -99 pid: 66171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784189344.649862:0:66170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1533 00000100:00100000:2.0:1784189344.649876:0:66170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc05659df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:debedd94-805c-42a0-a5e5-41758b2012e9+63:73671:x1870854436362880:12345-192.168.203.12@tcp:36:dd.0 00010000:00010000:2.0:1784189344.649904:0:66170:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784189344.649920:0:66170:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4710ee00/0xcc1762b626f8d12e lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0xa:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c42b6 expref: 63 pid: 66170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189344.649932:0:66170:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0xa:0x0].0x0 (ffff9dc05a487100) 00010000:00010000:2.0:1784189344.649936:0:66170:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1784189344.649956:0:66171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc07116fe00/0xcc1762b626f8d1ac lrc: 3/1,0 mode: --/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189344.649968:0:66171:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc07116fe00/0xcc1762b626f8d1ac lrc: 3/1,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189344.649976:0:66171:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc07116fe00/0xcc1762b626f8d1ac lrc: 3/1,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189344.649991:0:66171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc07116ea00/0xcc1762b626f8d1b3 lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0x4:0x0].0xb6f515a3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189344.649997:0:66171:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc07116ea00/0xcc1762b626f8d1b3 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0xb6f515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189344.650004:0:66171:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc07116ea00/0xcc1762b626f8d1b3 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0xb6f515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189344.650019:0:66170:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04a20ac00/0xcc1762b626f8d1ba lrc: 3/0,1 mode: --/PW res: [0x20000cf21:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189344.650029:0:66170:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04a20ac00/0xcc1762b626f8d1ba lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189344.650037:0:66170:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04a20ac00/0xcc1762b626f8d1ba lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189344.650047:0:66171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc07116e800/0xcc1762b626f8d1c1 lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0x19:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189344.650057:0:66171:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc07116e800/0xcc1762b626f8d1c1 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x19:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189344.650065:0:66171:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc07116e800/0xcc1762b626f8d1c1 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x19:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1784189344.650077:0:66170:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 120259084375 00000004:00200000:1.0:1784189344.650084:0:66171:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000cf21:0x19:0x0]: returning size 0 00000004:00010000:2.0:1784189344.650101:0:66170:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000096662d1d reply state 00000000d3121164 transno 120259084376 ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04a20ac00/0xcc1762b626f8d1ba lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189344.650126:0:66170:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04a20ac00/0xcc1762b626f8d1ba lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189344.650133:0:66170:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0xa:0x0].0x0 (ffff9dc05a487100) 00010000:00010000:2.0:1784189344.650135:0:66170:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784189344.650136:0:66171:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc07116fe00/0xcc1762b626f8d1ac lrc: 4/1,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784189344.650143:0:66170:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1784189344.650146:0:66171:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc07116fe00/0xcc1762b626f8d1ac lrc: 4/1,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189344.650154:0:66171:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc07116fe00/0xcc1762b626f8d1ac lrc: 3/0,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189344.650161:0:66171:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dc07116fe00/0xcc1762b626f8d1ac lrc: 4/0,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189344.650167:0:66171:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc07116fe00 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:1.0:1784189344.650173:0:66171:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc07116fe00/0xcc1762b626f8d1ac lrc: 4/0,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189344.650181:0:66171:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc07116fe00/0xcc1762b626f8d1ac lrc: 5/0,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189344.650192:0:66171:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x0 (ffff9dbf45994c00) 00010000:00010000:1.0:1784189344.650195:0:66171:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784189344.650199:0:66171:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dc07116fe00/0xcc1762b626f8d1ac lrc: 3/0,0 mode: --/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784189344.650201:0:66170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc05659df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:debedd94-805c-42a0-a5e5-41758b2012e9+66:73671:x1870854436362880:12345-192.168.203.12@tcp:36:dd.0 Request processed in 327us (1037us total) trans 120259084376 rc 0/0 00010000:00010000:1.0:1784189344.650212:0:66171:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc07116fe00/0xcc1762b626f8d1ac lrc: 0/0,0 mode: --/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784189344.650216:0:66170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1533 00000020:00080000:2.0:1784189344.650223:0:66170:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1784189344.650228:0:66171:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc07116ea00/0xcc1762b626f8d1b3 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0xb6f515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189344.650246:0:66171:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc07116ea00/0xcc1762b626f8d1b3 lrc: 2/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0xb6f515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189344.650252:0:66171:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dc07116ea00/0xcc1762b626f8d1b3 lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0xb6f515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189344.650257:0:66171:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc07116ea00 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:1.0:1784189344.650261:0:66171:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc07116ea00/0xcc1762b626f8d1b3 lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0xb6f515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189344.650267:0:66171:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc07116ea00/0xcc1762b626f8d1b3 lrc: 4/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0xb6f515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189344.650279:0:66171:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0xb6f515a3 (ffff9dc07499bc00) 00010000:00010000:1.0:1784189344.650282:0:66171:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784189344.650285:0:66171:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dc07116ea00/0xcc1762b626f8d1b3 lrc: 2/0,0 mode: --/PR res: [0x20000cf21:0x4:0x0].0xb6f515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189344.650291:0:66171:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc07116ea00/0xcc1762b626f8d1b3 lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0x4:0x0].0xb6f515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189344.650344:0:66171:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc07116f200/0xcc1762b626f8d1a5 lrc: 0/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c42e0 expref: 66 pid: 66171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189344.650357:0:66171:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc07116e800/0xcc1762b626f8d1c1 lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x19:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c42e0 expref: 65 pid: 66171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189344.650364:0:66171:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x19:0x0].0x0 (ffff9dbf45994d00) 00010000:00010000:1.0:1784189344.650367:0:66171:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1784189344.650375:0:66171:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc07116e800, rc 0) 00000100:00100000:1.0:1784189344.650406:0:66171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc050542680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:debedd94-805c-42a0-a5e5-41758b2012e9+65:73686:x1870854436363520:12345-192.168.203.12@tcp:101:dd.0 Request processed in 572us (1263us total) trans 120259084377 rc 0/0 00000100:00100000:1.0:1784189344.650412:0:66171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1532 00000100:00100000:0.0:1784189344.657841:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1784189344.657894:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1784189344.657980:0:66169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436364160 00000100:00100000:1.0:1784189344.657991:0:66169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436364160 00000100:00100000:3.0:1784189344.658030:0:26160:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436363904 00000100:00100000:3.0:1784189344.658045:0:26160:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436363904 00000100:00100000:1.0:1784189344.658061:0:66169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1534 00000100:00100000:1.0:1784189344.658074:0:66169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf425f8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:debedd94-805c-42a0-a5e5-41758b2012e9+65:73672:x1870854436364160:12345-192.168.203.12@tcp:36:dd.0 00010000:00010000:1.0:1784189344.658138:0:66169:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1784189344.658189:0:26160:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 5025 00000100:00100000:3.0:1784189344.658204:0:26160:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf425f8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:debedd94-805c-42a0-a5e5-41758b2012e9+13:73671:x1870854436363904:12345-192.168.203.12@tcp:101:dd.0 00010000:00010000:3.0:1784189344.658222:0:26160:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784189344.658249:0:26160:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000097385c8a/0xcc1762b626f8d1cf lrc: 2/0,0 mode: --/PW res: [0x280000401:0x766:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xcbfc5de7fe6c42e7 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1784189344.658286:0:26160:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x766:0x0] initial LVB size: 0, mtime: 0x6a589196, atime: 0x6a589196, ctime: 0x6a589196, blocks: 0x0 00010000:00010000:3.0:1784189344.658314:0:26160:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x766:0x0].0x0 since=3586s v=(0 0) 00010000:00010000:3.0:1784189344.658357:0:26160:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x766:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784189344.658369:0:26160:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000097385c8a/0xcc1762b626f8d1cf lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x766:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c42e7 expref: 14 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189344.658491:0:26160:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000097385c8a/0xcc1762b626f8d1cf lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x766:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c42e7 expref: 14 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189344.658508:0:26160:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc0755a5400, rc 0) 00010000:00000080:3.0:1784189344.658519:0:26160:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9dbf425f8e00 x1870854436363904/t0(0) o101->debedd94-805c-42a0-a5e5-41758b2012e9@192.168.203.12@tcp:535/0 lens 328/400 e 0 to 0 dl 1784189355 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1784189344.658608:0:26160:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf425f8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:debedd94-805c-42a0-a5e5-41758b2012e9+14:73671:x1870854436363904:12345-192.168.203.12@tcp:101:dd.0 Request processed in 408us (775us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189344.658616:0:26160:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 5025 00010000:00010000:1.0:1784189344.658696:0:66169:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04a20b400/0xcc1762b626f8d189 lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c42d2 expref: 65 pid: 66170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189344.658720:0:66169:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0xb:0x0].0x0 (ffff9dc05a487c00) 00010000:00010000:1.0:1784189344.658725:0:66169:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1784189344.660009:0:66169:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc07116ec00/0xcc1762b626f8d1d6 lrc: 3/0,1 mode: --/PW res: [0x20000cf21:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189344.660037:0:66169:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc07116ec00/0xcc1762b626f8d1d6 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189344.660051:0:66169:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc07116ec00/0xcc1762b626f8d1d6 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1784189344.660094:0:66169:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 120259084378 00000004:00010000:1.0:1784189344.660118:0:66169:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000034634822 reply state 00000000d8d3f27e transno 120259084379 ns: mdt-lustre-MDT0000_UUID lock: ffff9dc07116ec00/0xcc1762b626f8d1d6 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189344.660129:0:66169:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc07116ec00/0xcc1762b626f8d1d6 lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189344.660154:0:66169:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0xb:0x0].0x0 (ffff9dc05a487c00) 00010000:00010000:1.0:1784189344.660157:0:66169:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1784189344.660160:0:66169:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1784189344.660265:0:66169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf425f8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:debedd94-805c-42a0-a5e5-41758b2012e9+67:73672:x1870854436364160:12345-192.168.203.12@tcp:36:dd.0 Request processed in 2192us (2367us total) trans 120259084379 rc 0/0 00000100:00100000:1.0:1784189344.660274:0:66169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1534 00000020:00080000:1.0:1784189344.660280:0:66169:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1784189344.671514:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1784189344.671551:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1784189344.671592:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1784189344.671713:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1784189344.671949:0:9982:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436364800 00000100:00100000:3.0:1784189344.671960:0:9982:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436364800 00000100:00100000:3.0:1784189344.672039:0:9982:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 5026 00000100:00100000:3.0:1784189344.672049:0:9982:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf4a32d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:debedd94-805c-42a0-a5e5-41758b2012e9+14:73672:x1870854436364800:12345-192.168.203.12@tcp:101:dd.0 00010000:00010000:3.0:1784189344.672067:0:9982:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784189344.672086:0:9982:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000090219bd6/0xcc1762b626f8d1dd lrc: 2/0,0 mode: --/PW res: [0x280000401:0x767:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xcbfc5de7fe6c42fc expref: -99 pid: 9982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1784189344.672115:0:9982:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x767:0x0] initial LVB size: 0, mtime: 0x6a589196, atime: 0x6a589196, ctime: 0x6a589196, blocks: 0x0 00010000:00010000:3.0:1784189344.672136:0:9982:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x767:0x0].0x0 since=3586s v=(0 0) 00010000:00010000:3.0:1784189344.672142:0:9982:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x767:0x0].0x0 since=0s v=(0 0) 00000100:00100000:1.0:1784189344.672149:0:25599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436364672 00010000:00010000:3.0:1784189344.672152:0:9982:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000090219bd6/0xcc1762b626f8d1dd lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x767:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c42fc expref: 15 pid: 9982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784189344.672155:0:25599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436364672 00010000:00010000:3.0:1784189344.672173:0:9982:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000090219bd6/0xcc1762b626f8d1dd lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x767:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c42fc expref: 16 pid: 9982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1784189344.672182:0:25599:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/1894 (0->18446744073709551615) 00002000:00100000:1.0:1784189344.672187:0:25599:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9dbf4a32ed80 with x1870854436364672 ext(0->18446744073709551615) 00002000:00010000:1.0:1784189344.672196:0:25599:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9dbf4a32ed80. 00010000:00010000:3.0:1784189344.672222:0:9982:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc0755a5800, rc 0) 00000100:00100000:1.0:1784189344.672226:0:25599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1012 00010000:00000080:3.0:1784189344.672234:0:9982:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9dbf4a32d880 x1870854436364800/t0(0) o101->debedd94-805c-42a0-a5e5-41758b2012e9@192.168.203.12@tcp:535/0 lens 328/400 e 0 to 0 dl 1784189355 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1784189344.672238:0:25599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf4a32ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:debedd94-805c-42a0-a5e5-41758b2012e9+16:2398:x1870854436364672:12345-192.168.203.12@tcp:10:dd.0 00000100:00100000:3.0:1784189344.672295:0:9982:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf4a32d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:debedd94-805c-42a0-a5e5-41758b2012e9+16:73672:x1870854436364800:12345-192.168.203.12@tcp:101:dd.0 Request processed in 247us (582us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189344.672302:0:9982:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 5026 00000100:00100000:3.0:1784189344.672346:0:68287:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436364416 00000100:00100000:3.0:1784189344.672351:0:68287:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436364416 00000100:00100000:3.0:1784189344.672395:0:68287:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436364544 00000100:00100000:3.0:1784189344.672398:0:68287:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436364544 00000100:00100000:3.0:1784189344.672420:0:68287:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1535 00000100:00100000:3.0:1784189344.672428:0:68287:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf4a32d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:debedd94-805c-42a0-a5e5-41758b2012e9+68:73673:x1870854436364416:12345-192.168.203.12@tcp:101:dd.0 00002000:00010000:1.0:1784189344.672430:0:25599:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x766:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1784189344.672435:0:25599:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x766:0x0] updating lvb mtime from disk: 1784189334 -> 1784189343 00002000:00010000:1.0:1784189344.672437:0:25599:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x766:0x0] updating lvb atime from disk: 1784189334 -> 1784189334 00010000:00010000:3.0:1784189344.672439:0:68287:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00002000:00010000:1.0:1784189344.672440:0:25599:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x766:0x0] updating lvb ctime from disk: 1784189334 -> 1784189343 00002000:00010000:1.0:1784189344.672444:0:25599:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x766:0x0] updating lvb blocks from disk: 0 -> 0 00010000:00000080:1.0:1784189344.672452:0:25599:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9dbf4a32ed80 x1870854436364672/t4294968982(0) o10->debedd94-805c-42a0-a5e5-41758b2012e9@192.168.203.12@tcp:535/0 lens 440/432 e 0 to 0 dl 1784189355 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00010000:00010000:3.0:1784189344.672455:0:68287:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0755a4400/0xcc1762b626f8d1e4 lrc: 2/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbfc5de7fe6c42ee expref: -99 pid: 68287 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784189344.672488:0:25599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf4a32ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:debedd94-805c-42a0-a5e5-41758b2012e9+16:2398:x1870854436364672:12345-192.168.203.12@tcp:10:dd.0 Request processed in 254us (895us total) trans 4294968982 rc 0/0 00000100:00100000:1.0:1784189344.672494:0:25599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1012 00002000:00010000:1.0:1784189344.672497:0:25599:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/1894 (0->18446744073709551615) 00002000:00100000:1.0:1784189344.672505:0:25599:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9dbf4a32ed80 with x1870854436364672 ext(0->18446744073709551615) 00002000:00010000:1.0:1784189344.672511:0:25599:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9dbf4a32ed80. 00000100:00100000:1.0:1784189344.672535:0:66171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1536 00000100:00100000:1.0:1784189344.672543:0:66171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf4a32e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:debedd94-805c-42a0-a5e5-41758b2012e9+69:73686:x1870854436364544:12345-192.168.203.12@tcp:101:dd.0 00010000:00010000:1.0:1784189344.672557:0:66171:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784189344.672580:0:66171:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc07116f200/0xcc1762b626f8d1eb lrc: 2/0,0 mode: --/PR res: [0x20000cf21:0x19:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbfc5de7fe6c42f5 expref: -99 pid: 66171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189344.672593:0:68287:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0755a5600/0xcc1762b626f8d1f2 lrc: 3/1,0 mode: --/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189344.672606:0:66171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc07116ea00/0xcc1762b626f8d1f9 lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0x19:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189344.672608:0:68287:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0755a5600/0xcc1762b626f8d1f2 lrc: 3/1,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189344.672625:0:66171:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc07116ea00/0xcc1762b626f8d1f9 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x19:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189344.672628:0:68287:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0755a5600/0xcc1762b626f8d1f2 lrc: 3/1,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189344.672642:0:66171:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc07116ea00/0xcc1762b626f8d1f9 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x19:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189344.672651:0:68287:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0755a5000/0xcc1762b626f8d200 lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0x4:0x0].0x4e05b2a3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189344.672671:0:68287:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0755a5000/0xcc1762b626f8d200 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x4e05b2a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189344.672678:0:68287:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0755a5000/0xcc1762b626f8d200 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x4e05b2a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189344.672742:0:68287:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0755a4600/0xcc1762b626f8d207 lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0xc:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189344.673101:0:66171:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc07116f200/0xcc1762b626f8d1eb lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0x19:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c42f5 expref: 71 pid: 66171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189344.673118:0:66171:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc07116ea00/0xcc1762b626f8d1f9 lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x19:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c42f5 expref: 70 pid: 66171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189344.673126:0:66171:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x19:0x0].0x0 (ffff9dbf45994d00) 00010000:00010000:1.0:1784189344.673129:0:66171:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1784189344.673131:0:66171:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc07116ea00, rc 0) 00000100:00100000:1.0:1784189344.673166:0:66171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf4a32e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:debedd94-805c-42a0-a5e5-41758b2012e9+70:73686:x1870854436364544:12345-192.168.203.12@tcp:101:dd.0 Request processed in 625us (1614us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189344.673181:0:66171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1536 00010000:00010000:3.0:1784189344.673845:0:68287:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0755a4600/0xcc1762b626f8d207 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189344.673861:0:68287:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0755a4600/0xcc1762b626f8d207 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784189344.673874:0:68287:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000cf21:0xc:0x0]: returning size 0 00010000:00010000:3.0:1784189344.673959:0:68287:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0755a5600/0xcc1762b626f8d1f2 lrc: 4/1,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189344.673966:0:68287:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0755a5600/0xcc1762b626f8d1f2 lrc: 4/1,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189344.673973:0:68287:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0755a5600/0xcc1762b626f8d1f2 lrc: 3/0,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189344.673980:0:68287:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0755a5600/0xcc1762b626f8d1f2 lrc: 4/0,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189344.673986:0:68287:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc0755a5600 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:3.0:1784189344.673990:0:68287:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0755a5600/0xcc1762b626f8d1f2 lrc: 4/0,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189344.674011:0:68287:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0755a5600/0xcc1762b626f8d1f2 lrc: 5/0,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189344.674024:0:68287:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x0 (ffff9dbf45994c00) 00010000:00010000:3.0:1784189344.674026:0:68287:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784189344.674031:0:68287:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0755a5600/0xcc1762b626f8d1f2 lrc: 3/0,0 mode: --/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189344.674038:0:68287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0755a5600/0xcc1762b626f8d1f2 lrc: 0/0,0 mode: --/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189344.674049:0:68287:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0755a5000/0xcc1762b626f8d200 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x4e05b2a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189344.674056:0:68287:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0755a5000/0xcc1762b626f8d200 lrc: 2/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x4e05b2a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189344.674062:0:68287:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0755a5000/0xcc1762b626f8d200 lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x4e05b2a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189344.674067:0:68287:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc0755a5000 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:3.0:1784189344.674070:0:68287:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0755a5000/0xcc1762b626f8d200 lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x4e05b2a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189344.674076:0:68287:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0755a5000/0xcc1762b626f8d200 lrc: 4/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x4e05b2a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189344.674083:0:68287:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x4e05b2a3 (ffff9dc081250d00) 00010000:00010000:3.0:1784189344.674086:0:68287:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784189344.674088:0:68287:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0755a5000/0xcc1762b626f8d200 lrc: 2/0,0 mode: --/PR res: [0x20000cf21:0x4:0x0].0x4e05b2a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189344.674103:0:68287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0755a5000/0xcc1762b626f8d200 lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0x4:0x0].0x4e05b2a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189344.674142:0:68287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0755a4400/0xcc1762b626f8d1e4 lrc: 0/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c42ee expref: 71 pid: 68287 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189344.674157:0:68287:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0755a4600/0xcc1762b626f8d207 lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c42ee expref: 70 pid: 68287 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189344.674165:0:68287:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0xc:0x0].0x0 (ffff9dc07fab4500) 00010000:00010000:3.0:1784189344.674168:0:68287:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1784189344.674170:0:68287:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc0755a4600, rc 0) 00000100:00100000:3.0:1784189344.676087:0:68287:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf4a32d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:debedd94-805c-42a0-a5e5-41758b2012e9+70:73673:x1870854436364416:12345-192.168.203.12@tcp:101:dd.0 Request processed in 3649us (4577us total) trans 120259084380 rc 0/0 00000100:00100000:3.0:1784189344.676098:0:68287:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1535 00000100:00100000:2.0:1784189344.686596:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1784189344.686681:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1784189344.686868:0:66169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436365056 00000100:00100000:1.0:1784189344.686880:0:66169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436365056 00000100:00100000:1.0:1784189344.686936:0:66169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436365184 00000100:00100000:1.0:1784189344.686940:0:66169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436365184 00000100:00100000:1.0:1784189344.686984:0:66169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1537 00000100:00100000:1.0:1784189344.686994:0:66169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc07faa9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:debedd94-805c-42a0-a5e5-41758b2012e9+71:73686:x1870854436365056:12345-192.168.203.12@tcp:36:dd.0 00010000:00010000:1.0:1784189344.687048:0:66169:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784189344.687075:0:66169:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc07116e800/0xcc1762b626f8d1c1 lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0x19:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c42e0 expref: 71 pid: 66171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189344.687094:0:66169:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x19:0x0].0x0 (ffff9dbf45994d00) 00010000:00010000:1.0:1784189344.687099:0:66169:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1784189344.687258:0:66169:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc07116f200/0xcc1762b626f8d215 lrc: 3/0,1 mode: --/PW res: [0x20000cf21:0x19:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189344.687272:0:66169:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc07116f200/0xcc1762b626f8d215 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x19:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189344.687282:0:66169:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc07116f200/0xcc1762b626f8d215 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x19:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1784189344.687360:0:66169:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 120259084381 00000004:00010000:1.0:1784189344.687383:0:66169:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000ecdca30e reply state 00000000cac3ad9f transno 120259084382 ns: mdt-lustre-MDT0000_UUID lock: ffff9dc07116f200/0xcc1762b626f8d215 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x19:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189344.687396:0:66169:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc07116f200/0xcc1762b626f8d215 lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x19:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189344.687402:0:66169:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x19:0x0].0x0 (ffff9dbf45994d00) 00010000:00010000:1.0:1784189344.687414:0:66169:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1784189344.687417:0:66169:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1784189344.687499:0:66169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc07faa9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:debedd94-805c-42a0-a5e5-41758b2012e9+73:73686:x1870854436365056:12345-192.168.203.12@tcp:36:dd.0 Request processed in 506us (920us total) trans 120259084382 rc 0/0 00000100:00100000:0.0:1784189344.690677:0:66171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1538 00000100:00100000:0.0:1784189344.690700:0:66171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc07faaad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:debedd94-805c-42a0-a5e5-41758b2012e9+73:73673:x1870854436365184:12345-192.168.203.12@tcp:101:dd.0 00010000:00010000:0.0:1784189344.690726:0:66171:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784189344.690746:0:66171:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc070146c00/0xcc1762b626f8d21c lrc: 2/0,0 mode: --/PR res: [0x20000cf21:0xc:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbfc5de7fe6c4303 expref: -99 pid: 66171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189344.690791:0:66171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc070147c00/0xcc1762b626f8d223 lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0xc:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189344.690812:0:66171:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc070147c00/0xcc1762b626f8d223 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0xc:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189344.690824:0:66171:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc070147c00/0xcc1762b626f8d223 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0xc:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189344.690952:0:66171:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc070146c00/0xcc1762b626f8d21c lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0xc:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c4303 expref: 75 pid: 66171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189344.690971:0:66171:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc070147c00/0xcc1762b626f8d223 lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0xc:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c4303 expref: 74 pid: 66171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189344.690979:0:66171:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0xc:0x0].0x0 (ffff9dc07fab4500) 00010000:00010000:0.0:1784189344.690982:0:66171:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1784189344.690992:0:66171:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc070147c00, rc 0) 00000100:00100000:0.0:1784189344.691622:0:66171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc07faaad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:debedd94-805c-42a0-a5e5-41758b2012e9+74:73673:x1870854436365184:12345-192.168.203.12@tcp:101:dd.0 Request processed in 361us (4368us total) trans 0 rc 0/0 00000100:00100000:0.0:1784189344.691632:0:66171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1538 00000100:00100000:0.0:1784189344.691710:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1784189344.691739:0:24834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436365568 00000100:00100000:0.0:1784189344.691744:0:24834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436365568 00002000:00010000:0.0:1784189344.691766:0:24834:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/1895 (0->18446744073709551615) 00002000:00100000:0.0:1784189344.691769:0:24834:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9dbf4a32fb80 with x1870854436365568 ext(0->18446744073709551615) 00002000:00010000:0.0:1784189344.691777:0:24834:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9dbf4a32fb80. 00000100:00100000:0.0:1784189344.691855:0:24834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1013 00000100:00100000:0.0:1784189344.691863:0:24834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf4a32fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:debedd94-805c-42a0-a5e5-41758b2012e9+16:2397:x1870854436365568:12345-192.168.203.12@tcp:10:dd.0 00002000:00010000:0.0:1784189344.691996:0:24834:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x767:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1784189344.691999:0:24834:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x767:0x0] updating lvb mtime from disk: 1784189334 -> 1784189343 00002000:00010000:0.0:1784189344.692003:0:24834:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x767:0x0] updating lvb atime from disk: 1784189334 -> 1784189334 00002000:00010000:0.0:1784189344.692005:0:24834:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x767:0x0] updating lvb ctime from disk: 1784189334 -> 1784189343 00002000:00010000:0.0:1784189344.692007:0:24834:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x767:0x0] updating lvb blocks from disk: 0 -> 0 00010000:00000080:0.0:1784189344.692015:0:24834:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9dbf4a32fb80 x1870854436365568/t4294968983(0) o10->debedd94-805c-42a0-a5e5-41758b2012e9@192.168.203.12@tcp:535/0 lens 440/432 e 0 to 0 dl 1784189355 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1784189344.692047:0:24834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf4a32fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:debedd94-805c-42a0-a5e5-41758b2012e9+17:2397:x1870854436365568:12345-192.168.203.12@tcp:10:dd.0 Request processed in 185us (337us total) trans 4294968983 rc 0/0 00000100:00100000:0.0:1784189344.692054:0:24834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1013 00002000:00010000:0.0:1784189344.692057:0:24834:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/1895 (0->18446744073709551615) 00002000:00100000:0.0:1784189344.692060:0:24834:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9dbf4a32fb80 with x1870854436365568 ext(0->18446744073709551615) 00002000:00010000:0.0:1784189344.692065:0:24834:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9dbf4a32fb80. 00000100:00100000:0.0:1784189344.692130:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1784189344.692580:0:66169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1537 00000020:00080000:1.0:1784189344.692587:0:66169:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1784189344.692617:0:66169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436365440 00000100:00100000:1.0:1784189344.692621:0:66169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436365440 00000100:00100000:1.0:1784189344.692649:0:66169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1539 00000100:00100000:1.0:1784189344.692656:0:66169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf4a32ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:debedd94-805c-42a0-a5e5-41758b2012e9+73:73674:x1870854436365440:12345-192.168.203.12@tcp:101:dd.0 00010000:00010000:1.0:1784189344.692669:0:66169:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784189344.692682:0:66169:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc07116fe00/0xcc1762b626f8d22a lrc: 2/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbfc5de7fe6c430a expref: -99 pid: 66169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189344.692796:0:66169:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc07116fa00/0xcc1762b626f8d231 lrc: 3/1,0 mode: --/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189344.692824:0:66169:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc07116fa00/0xcc1762b626f8d231 lrc: 3/1,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189344.692836:0:66169:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc07116fa00/0xcc1762b626f8d231 lrc: 3/1,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189344.692850:0:66169:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc07116f800/0xcc1762b626f8d238 lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0x4:0x0].0x965f6ba3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189344.692857:0:66169:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc07116f800/0xcc1762b626f8d238 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x965f6ba3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189344.692864:0:66169:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc07116f800/0xcc1762b626f8d238 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x965f6ba3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189344.692932:0:66169:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc07116e000/0xcc1762b626f8d23f lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189344.692940:0:66169:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc07116e000/0xcc1762b626f8d23f lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189344.692947:0:66169:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc07116e000/0xcc1762b626f8d23f lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784189344.693143:0:66169:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000cf21:0xd:0x0]: returning size 0 00000100:00100000:2.0:1784189344.693183:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1784189344.693208:0:66172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436365824 00000100:00100000:2.0:1784189344.693213:0:66172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436365824 00000100:00100000:2.0:1784189344.693241:0:66172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 269 00000100:00100000:2.0:1784189344.693249:0:66172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf44d0a050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:debedd94-805c-42a0-a5e5-41758b2012e9+75:73671:x1870854436365824:12345-192.168.203.12@tcp:35:dd.0 00010000:00010000:0.0:1784189344.693400:0:66169:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc07116fa00/0xcc1762b626f8d231 lrc: 4/1,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189344.693408:0:66169:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc07116fa00/0xcc1762b626f8d231 lrc: 4/1,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189344.693414:0:66169:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc07116fa00/0xcc1762b626f8d231 lrc: 3/0,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189344.693420:0:66169:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dc07116fa00/0xcc1762b626f8d231 lrc: 4/0,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189344.693426:0:66169:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc07116fa00 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:0.0:1784189344.693430:0:66169:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc07116fa00/0xcc1762b626f8d231 lrc: 4/0,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189344.693438:0:66169:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc07116fa00/0xcc1762b626f8d231 lrc: 5/0,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189344.693450:0:66169:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x0 (ffff9dbf45994c00) 00010000:00010000:0.0:1784189344.693453:0:66169:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784189344.693458:0:66169:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dc07116fa00/0xcc1762b626f8d231 lrc: 3/0,0 mode: --/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189344.693465:0:66169:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc07116fa00/0xcc1762b626f8d231 lrc: 0/0,0 mode: --/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189344.693479:0:66169:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc07116f800/0xcc1762b626f8d238 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x965f6ba3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189344.693484:0:66169:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc07116f800/0xcc1762b626f8d238 lrc: 2/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x965f6ba3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189344.693501:0:66169:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dc07116f800/0xcc1762b626f8d238 lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x965f6ba3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189344.693505:0:66169:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc07116f800 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:0.0:1784189344.693508:0:66169:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc07116f800/0xcc1762b626f8d238 lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x965f6ba3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189344.693513:0:66169:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc07116f800/0xcc1762b626f8d238 lrc: 4/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x965f6ba3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189344.693521:0:66169:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x965f6ba3 (ffff9dc07499bc00) 00010000:00010000:0.0:1784189344.693523:0:66169:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784189344.693525:0:66169:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dc07116f800/0xcc1762b626f8d238 lrc: 2/0,0 mode: --/PR res: [0x20000cf21:0x4:0x0].0x965f6ba3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189344.693530:0:66169:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc07116f800/0xcc1762b626f8d238 lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0x4:0x0].0x965f6ba3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189344.693568:0:66169:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc07116fe00/0xcc1762b626f8d22a lrc: 0/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c430a expref: 77 pid: 66169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189344.693582:0:66169:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc07116e000/0xcc1762b626f8d23f lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c430a expref: 76 pid: 66169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189344.693590:0:66169:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0xd:0x0].0x0 (ffff9dc07fab4a00) 00010000:00010000:0.0:1784189344.693592:0:66169:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1784189344.693594:0:66169:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc07116e000, rc 0) 00000100:00100000:0.0:1784189344.693628:0:66169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf4a32ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:debedd94-805c-42a0-a5e5-41758b2012e9+76:73674:x1870854436365440:12345-192.168.203.12@tcp:101:dd.0 Request processed in 972us (1497us total) trans 120259084383 rc 0/0 00000100:00100000:0.0:1784189344.693644:0:66169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1539 00000001:00080000:2.0:1784189344.694181:0:66172:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 120259084384 00000100:00100000:2.0:1784189344.694246:0:66172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf44d0a050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:debedd94-805c-42a0-a5e5-41758b2012e9+77:73671:x1870854436365824:12345-192.168.203.12@tcp:35:dd.0 Request processed in 997us (1064us total) trans 120259084385 rc 0/0 00000100:00100000:2.0:1784189344.694254:0:66172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 269 00000020:00080000:2.0:1784189344.694257:0:66172:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1784189344.707875:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1784189344.707915:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1784189344.707943:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1784189344.707993:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1784189344.708024:0:66170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436366080 00000100:00100000:0.0:1784189344.708025:0:66171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436366336 00000100:00100000:0.0:1784189344.708036:0:66171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436366336 00000100:00100000:2.0:1784189344.708044:0:66170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436366080 00000100:00100000:0.0:1784189344.708086:0:66171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436366592 00000100:00100000:0.0:1784189344.708090:0:66171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436366592 00000100:00100000:1.0:1784189344.708111:0:26161:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436365952 00000100:00100000:1.0:1784189344.708117:0:26161:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436365952 00000100:00100000:3.0:1784189344.708150:0:68287:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1540 00000100:00100000:1.0:1784189344.708153:0:26161:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 5027 00000100:00100000:1.0:1784189344.708168:0:26161:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc07faabb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:debedd94-805c-42a0-a5e5-41758b2012e9+17:73686:x1870854436365952:12345-192.168.203.12@tcp:101:dd.0 00000100:00100000:3.0:1784189344.708169:0:68287:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc07faa8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:debedd94-805c-42a0-a5e5-41758b2012e9+79:73673:x1870854436366336:12345-192.168.203.12@tcp:36:dd.0 00010000:00010000:1.0:1784189344.708191:0:26161:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784189344.708211:0:26161:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d2d1b2ae/0xcc1762b626f8d24d lrc: 2/0,0 mode: --/PW res: [0x280000401:0x775:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xcbfc5de7fe6c4311 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189344.708228:0:68287:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1784189344.708236:0:26161:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x775:0x0] initial LVB size: 0, mtime: 0x6a589196, atime: 0x6a589196, ctime: 0x6a589196, blocks: 0x0 00010000:00010000:1.0:1784189344.708255:0:26161:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x775:0x0].0x0 since=3586s v=(0 0) 00010000:00010000:3.0:1784189344.708256:0:68287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0755a4600/0xcc1762b626f8d207 lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c42ee expref: 79 pid: 68287 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189344.708263:0:26161:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x775:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784189344.708274:0:26161:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d2d1b2ae/0xcc1762b626f8d24d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x775:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c4311 expref: 18 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189344.708277:0:68287:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0xc:0x0].0x0 (ffff9dc07fab4500) 00010000:00010000:3.0:1784189344.708285:0:68287:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1784189344.708295:0:26161:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000d2d1b2ae/0xcc1762b626f8d24d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x775:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c4311 expref: 18 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189344.708343:0:26161:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dbf4710fc00, rc 0) 00010000:00000080:1.0:1784189344.708353:0:26161:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9dc07faabb80 x1870854436365952/t0(0) o101->debedd94-805c-42a0-a5e5-41758b2012e9@192.168.203.12@tcp:535/0 lens 328/400 e 0 to 0 dl 1784189355 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1784189344.708409:0:26161:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc07faabb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:debedd94-805c-42a0-a5e5-41758b2012e9+18:73686:x1870854436365952:12345-192.168.203.12@tcp:101:dd.0 Request processed in 247us (543us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189344.708418:0:26161:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 5027 00010000:00010000:3.0:1784189344.708478:0:68287:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0755a4400/0xcc1762b626f8d254 lrc: 3/0,1 mode: --/PW res: [0x20000cf21:0xc:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189344.708491:0:68287:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0755a4400/0xcc1762b626f8d254 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189344.708508:0:68287:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0755a4400/0xcc1762b626f8d254 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1784189344.708551:0:68287:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 120259084386 00000004:00010000:3.0:1784189344.708572:0:68287:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000c756bf0a reply state 00000000e982cd74 transno 120259084387 ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0755a4400/0xcc1762b626f8d254 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189344.708583:0:68287:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0755a4400/0xcc1762b626f8d254 lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189344.708589:0:68287:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0xc:0x0].0x0 (ffff9dc07fab4500) 00010000:00010000:3.0:1784189344.708603:0:68287:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1784189344.708607:0:68287:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1784189344.708673:0:68287:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc07faa8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:debedd94-805c-42a0-a5e5-41758b2012e9+81:73673:x1870854436366336:12345-192.168.203.12@tcp:36:dd.0 Request processed in 511us (728us total) trans 120259084387 rc 0/0 00000100:00100000:3.0:1784189344.708679:0:68287:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1540 00000020:00080000:3.0:1784189344.708682:0:68287:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1784189344.709220:0:66170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1541 00000100:00100000:2.0:1784189344.709232:0:66170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc07faaa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:debedd94-805c-42a0-a5e5-41758b2012e9+81:73674:x1870854436366080:12345-192.168.203.12@tcp:101:dd.0 00010000:00010000:2.0:1784189344.709243:0:66170:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784189344.709256:0:66170:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04a20b200/0xcc1762b626f8d25b lrc: 2/0,0 mode: --/PR res: [0x20000cf21:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbfc5de7fe6c4318 expref: -99 pid: 66170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189344.709280:0:66170:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04a20a400/0xcc1762b626f8d262 lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189344.709290:0:66170:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04a20a400/0xcc1762b626f8d262 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189344.709299:0:66170:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04a20a400/0xcc1762b626f8d262 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189344.709452:0:66170:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04a20b200/0xcc1762b626f8d25b lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c4318 expref: 83 pid: 66170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189344.709468:0:66170:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04a20a400/0xcc1762b626f8d262 lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c4318 expref: 82 pid: 66170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189344.709475:0:66170:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0xd:0x0].0x0 (ffff9dc07fab4a00) 00010000:00010000:2.0:1784189344.709478:0:66170:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1784189344.709481:0:66170:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc04a20a400, rc 0) 00000100:00100000:2.0:1784189344.709516:0:66170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc07faaa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:debedd94-805c-42a0-a5e5-41758b2012e9+82:73674:x1870854436366080:12345-192.168.203.12@tcp:101:dd.0 Request processed in 288us (1600us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189344.709523:0:66170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1541 00000100:00100000:1.0:1784189344.718148:0:66945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1542 00000100:00100000:1.0:1784189344.718168:0:66945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc07faab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:debedd94-805c-42a0-a5e5-41758b2012e9+81:73675:x1870854436366592:12345-192.168.203.12@tcp:101:dd.0 00010000:00010000:1.0:1784189344.718189:0:66945:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784189344.718210:0:66945:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4710e600/0xcc1762b626f8d269 lrc: 2/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbfc5de7fe6c431f expref: -99 pid: 66945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189344.718431:0:66945:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4710f200/0xcc1762b626f8d270 lrc: 3/1,0 mode: --/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189344.718446:0:66945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4710f200/0xcc1762b626f8d270 lrc: 3/1,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189344.718459:0:66945:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4710f200/0xcc1762b626f8d270 lrc: 3/1,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189344.718473:0:66945:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4710f600/0xcc1762b626f8d277 lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0x4:0x0].0xdeb924a3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189344.718481:0:66945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4710f600/0xcc1762b626f8d277 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0xdeb924a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189344.718499:0:66945:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4710f600/0xcc1762b626f8d277 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0xdeb924a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189344.718559:0:66945:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4710ee00/0xcc1762b626f8d27e lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189344.718567:0:66945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4710ee00/0xcc1762b626f8d27e lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189344.718575:0:66945:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4710ee00/0xcc1762b626f8d27e lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784189344.718870:0:66945:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000cf21:0xe:0x0]: returning size 0 00010000:00010000:1.0:1784189344.718949:0:66945:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4710f200/0xcc1762b626f8d270 lrc: 4/1,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189344.718958:0:66945:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4710f200/0xcc1762b626f8d270 lrc: 4/1,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189344.718965:0:66945:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4710f200/0xcc1762b626f8d270 lrc: 3/0,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189344.718971:0:66945:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4710f200/0xcc1762b626f8d270 lrc: 4/0,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189344.718977:0:66945:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dbf4710f200 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:1.0:1784189344.718981:0:66945:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4710f200/0xcc1762b626f8d270 lrc: 4/0,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189344.718988:0:66945:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4710f200/0xcc1762b626f8d270 lrc: 5/0,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189344.719011:0:66945:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x0 (ffff9dbf45994c00) 00010000:00010000:1.0:1784189344.719015:0:66945:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784189344.719019:0:66945:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4710f200/0xcc1762b626f8d270 lrc: 3/0,0 mode: --/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189344.719026:0:66945:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4710f200/0xcc1762b626f8d270 lrc: 0/0,0 mode: --/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189344.719047:0:66945:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4710f600/0xcc1762b626f8d277 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0xdeb924a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189344.719054:0:66945:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4710f600/0xcc1762b626f8d277 lrc: 2/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0xdeb924a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189344.719059:0:66945:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4710f600/0xcc1762b626f8d277 lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0xdeb924a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189344.719069:0:66945:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dbf4710f600 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:1.0:1784189344.719072:0:66945:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4710f600/0xcc1762b626f8d277 lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0xdeb924a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189344.719078:0:66945:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4710f600/0xcc1762b626f8d277 lrc: 4/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0xdeb924a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189344.719085:0:66945:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0xdeb924a3 (ffff9dc07499b200) 00010000:00010000:1.0:1784189344.719087:0:66945:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784189344.719090:0:66945:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4710f600/0xcc1762b626f8d277 lrc: 2/0,0 mode: --/PR res: [0x20000cf21:0x4:0x0].0xdeb924a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189344.719096:0:66945:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4710f600/0xcc1762b626f8d277 lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0x4:0x0].0xdeb924a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784189344.719138:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00010000:00010000:1.0:1784189344.719150:0:66945:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4710e600/0xcc1762b626f8d269 lrc: 0/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c431f expref: 83 pid: 66945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189344.719166:0:66945:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4710ee00/0xcc1762b626f8d27e lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c431f expref: 82 pid: 66945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189344.719173:0:66945:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0xe:0x0].0x0 (ffff9dbf44851400) 00010000:00010000:1.0:1784189344.719175:0:66945:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1784189344.719178:0:66945:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dbf4710ee00, rc 0) 00000100:00100000:2.0:1784189344.719181:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1784189344.719202:0:24846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436366976 00000100:00100000:2.0:1784189344.719210:0:24846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436366976 00000100:00100000:1.0:1784189344.719227:0:66945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc07faab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:debedd94-805c-42a0-a5e5-41758b2012e9+82:73675:x1870854436366592:12345-192.168.203.12@tcp:101:dd.0 Request processed in 1068us (11233us total) trans 120259084388 rc 0/0 00000100:00100000:1.0:1784189344.719235:0:66945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1542 00002000:00010000:2.0:1784189344.719238:0:24846:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/1909 (0->18446744073709551615) 00002000:00100000:2.0:1784189344.719243:0:24846:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9dc07faa9880 with x1870854436366976 ext(0->18446744073709551615) 00002000:00010000:2.0:1784189344.719251:0:24846:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9dc07faa9880. 00000100:00100000:2.0:1784189344.719274:0:24846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1014 00000100:00100000:3.0:1784189344.719281:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1784189344.719287:0:24846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc07faa9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:debedd94-805c-42a0-a5e5-41758b2012e9+18:2396:x1870854436366976:12345-192.168.203.12@tcp:10:dd.0 00000100:00100000:3.0:1784189344.719360:0:26168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436367104 00000100:00100000:3.0:1784189344.719365:0:26168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436367104 00000100:00100000:3.0:1784189344.719396:0:26168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 5028 00000100:00100000:3.0:1784189344.719406:0:26168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc056475180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:debedd94-805c-42a0-a5e5-41758b2012e9+20:73673:x1870854436367104:12345-192.168.203.12@tcp:101:dd.0 00010000:00010000:3.0:1784189344.719416:0:26168:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00002000:00010000:2.0:1784189344.719425:0:24846:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x775:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1784189344.719430:0:24846:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x775:0x0] updating lvb mtime from disk: 1784189334 -> 1784189344 00002000:00010000:2.0:1784189344.719432:0:24846:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x775:0x0] updating lvb atime from disk: 1784189334 -> 1784189334 00002000:00010000:2.0:1784189344.719434:0:24846:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x775:0x0] updating lvb ctime from disk: 1784189334 -> 1784189344 00002000:00010000:2.0:1784189344.719437:0:24846:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x775:0x0] updating lvb blocks from disk: 0 -> 0 00010000:00010000:3.0:1784189344.719440:0:26168:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000090923e4f/0xcc1762b626f8d28c lrc: 2/0,0 mode: --/PW res: [0x280000401:0x768:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xcbfc5de7fe6c4326 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000080:2.0:1784189344.719446:0:24846:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9dc07faa9880 x1870854436366976/t4294968984(0) o10->debedd94-805c-42a0-a5e5-41758b2012e9@192.168.203.12@tcp:535/0 lens 440/432 e 0 to 0 dl 1784189355 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00010000:3.0:1784189344.719468:0:26168:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x768:0x0] initial LVB size: 0, mtime: 0x6a589196, atime: 0x6a589196, ctime: 0x6a589196, blocks: 0x0 00010000:00010000:3.0:1784189344.719483:0:26168:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x768:0x0].0x0 since=3586s v=(0 0) 00000100:00100000:2.0:1784189344.719487:0:24846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc07faa9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:debedd94-805c-42a0-a5e5-41758b2012e9+21:2396:x1870854436366976:12345-192.168.203.12@tcp:10:dd.0 Request processed in 204us (305us total) trans 4294968984 rc 0/0 00010000:00010000:3.0:1784189344.719499:0:26168:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x768:0x0].0x0 since=0s v=(0 0) 00000100:00100000:2.0:1784189344.719500:0:24846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1014 00002000:00010000:2.0:1784189344.719506:0:24846:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/1909 (0->18446744073709551615) 00002000:00100000:2.0:1784189344.719509:0:24846:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9dc07faa9880 with x1870854436366976 ext(0->18446744073709551615) 00010000:00010000:3.0:1784189344.719513:0:26168:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000090923e4f/0xcc1762b626f8d28c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x768:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c4326 expref: 21 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1784189344.719516:0:24846:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9dc07faa9880. 00010000:00010000:3.0:1784189344.719532:0:26168:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000090923e4f/0xcc1762b626f8d28c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x768:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c4326 expref: 20 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189344.719542:0:26168:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc0755a5c00, rc 0) 00010000:00000080:3.0:1784189344.719548:0:26168:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9dc056475180 x1870854436367104/t0(0) o101->debedd94-805c-42a0-a5e5-41758b2012e9@192.168.203.12@tcp:535/0 lens 328/400 e 0 to 0 dl 1784189355 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1784189344.719771:0:26168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc056475180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:debedd94-805c-42a0-a5e5-41758b2012e9+20:73673:x1870854436367104:12345-192.168.203.12@tcp:101:dd.0 Request processed in 366us (491us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189344.719778:0:26168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 5028 00000100:00100000:2.0:1784189344.720382:0:66173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436366848 00000100:00100000:2.0:1784189344.720389:0:66173:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436366848 00000100:00100000:2.0:1784189344.720427:0:66173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 270 00000100:00100000:2.0:1784189344.720434:0:66173:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc07faa9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:debedd94-805c-42a0-a5e5-41758b2012e9+82:73672:x1870854436366848:12345-192.168.203.12@tcp:35:dd.0 00000001:00080000:2.0:1784189344.720601:0:66173:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 120259084389 00000100:00100000:2.0:1784189344.720745:0:66173:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc07faa9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:debedd94-805c-42a0-a5e5-41758b2012e9+84:73672:x1870854436366848:12345-192.168.203.12@tcp:35:dd.0 Request processed in 310us (1607us total) trans 120259084390 rc 0/0 00000100:00100000:2.0:1784189344.720753:0:66173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 270 00000020:00080000:2.0:1784189344.720757:0:66173:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1784189344.738442:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1784189344.738482:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1784189344.738515:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1784189344.738556:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1784189344.738586:0:68287:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436367360 00000100:00100000:3.0:1784189344.738595:0:68287:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436367360 00000100:00100000:0.0:1784189344.738616:0:66945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436367872 00000100:00100000:0.0:1784189344.738623:0:66945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436367872 00000100:00100000:3.0:1784189344.738643:0:68287:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436367616 00000100:00100000:3.0:1784189344.738648:0:68287:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436367616 00000100:00100000:0.0:1784189344.738662:0:66945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1543 00000100:00100000:0.0:1784189344.738674:0:66945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf4a343100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:debedd94-805c-42a0-a5e5-41758b2012e9+86:73674:x1870854436367360:12345-192.168.203.12@tcp:36:dd.0 00010000:00010000:0.0:1784189344.738731:0:66945:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784189344.738758:0:66945:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc07116e000/0xcc1762b626f8d23f lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c430a expref: 86 pid: 66169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189344.738779:0:66945:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0xd:0x0].0x0 (ffff9dc07fab4a00) 00010000:00010000:0.0:1784189344.738784:0:66945:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784189344.738822:0:66170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1544 00000100:00100000:2.0:1784189344.738834:0:66170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc0477c2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:debedd94-805c-42a0-a5e5-41758b2012e9+85:73677:x1870854436367872:12345-192.168.203.12@tcp:101:dd.0 00010000:00010000:2.0:1784189344.738848:0:66170:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784189344.738864:0:66170:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04a20b200/0xcc1762b626f8d293 lrc: 2/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbfc5de7fe6c4334 expref: -99 pid: 66170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784189344.738918:0:24831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436367488 00000100:00100000:1.0:1784189344.738923:0:24831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436367488 00002000:00010000:1.0:1784189344.738944:0:24831:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/1896 (0->18446744073709551615) 00002000:00100000:1.0:1784189344.738948:0:24831:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9dbf4a341f80 with x1870854436367488 ext(0->18446744073709551615) 00002000:00010000:1.0:1784189344.738957:0:24831:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9dbf4a341f80. 00010000:00010000:0.0:1784189344.738976:0:66945:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc070146c00/0xcc1762b626f8d29a lrc: 3/0,1 mode: --/PW res: [0x20000cf21:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784189344.738981:0:24831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1015 00010000:00010000:2.0:1784189344.738988:0:66170:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04a20a200/0xcc1762b626f8d2a1 lrc: 3/1,0 mode: --/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784189344.738991:0:24831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf4a341f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:debedd94-805c-42a0-a5e5-41758b2012e9+20:2397:x1870854436367488:12345-192.168.203.12@tcp:10:dd.0 00010000:00010000:0.0:1784189344.738994:0:66945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc070146c00/0xcc1762b626f8d29a lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189344.739001:0:66170:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04a20a200/0xcc1762b626f8d2a1 lrc: 3/1,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189344.739007:0:66945:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc070146c00/0xcc1762b626f8d29a lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189344.739012:0:66170:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04a20a200/0xcc1762b626f8d2a1 lrc: 3/1,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189344.739028:0:66170:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04a20b000/0xcc1762b626f8d2a8 lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0x4:0x0].0xc8545ca3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189344.739034:0:66170:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04a20b000/0xcc1762b626f8d2a8 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0xc8545ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189344.739041:0:66170:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04a20b000/0xcc1762b626f8d2a8 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0xc8545ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1784189344.739058:0:66945:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 120259084391 00010000:00010000:2.0:1784189344.739081:0:66170:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04a20b800/0xcc1762b626f8d2af lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1784189344.739087:0:66945:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000ab619133 reply state 0000000033b6925c transno 120259084392 ns: mdt-lustre-MDT0000_UUID lock: ffff9dc070146c00/0xcc1762b626f8d29a lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1784189344.739092:0:24831:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x768:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1784189344.739098:0:24831:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x768:0x0] updating lvb mtime from disk: 1784189334 -> 1784189344 00002000:00010000:1.0:1784189344.739101:0:24831:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x768:0x0] updating lvb atime from disk: 1784189334 -> 1784189334 00002000:00010000:1.0:1784189344.739104:0:24831:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x768:0x0] updating lvb ctime from disk: 1784189334 -> 1784189344 00010000:00010000:0.0:1784189344.739105:0:66945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc070146c00/0xcc1762b626f8d29a lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1784189344.739106:0:24831:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x768:0x0] updating lvb blocks from disk: 0 -> 0 00010000:00010000:2.0:1784189344.739108:0:66170:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04a20b800/0xcc1762b626f8d2af lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189344.739115:0:66170:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04a20b800/0xcc1762b626f8d2af lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00000080:1.0:1784189344.739115:0:24831:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9dbf4a341f80 x1870854436367488/t4294968985(0) o10->debedd94-805c-42a0-a5e5-41758b2012e9@192.168.203.12@tcp:535/0 lens 440/432 e 0 to 0 dl 1784189355 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00010000:00010000:0.0:1784189344.739128:0:66945:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0xd:0x0].0x0 (ffff9dc07fab4a00) 00000004:00200000:2.0:1784189344.739131:0:66170:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000cf21:0x10:0x0]: returning size 0 00010000:00010000:0.0:1784189344.739132:0:66945:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1784189344.739138:0:66945:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1784189344.739178:0:24831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf4a341f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:debedd94-805c-42a0-a5e5-41758b2012e9+21:2397:x1870854436367488:12345-192.168.203.12@tcp:10:dd.0 Request processed in 187us (694us total) trans 4294968985 rc 0/0 00010000:00010000:2.0:1784189344.739183:0:66170:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04a20a200/0xcc1762b626f8d2a1 lrc: 4/1,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784189344.739185:0:24831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1015 00002000:00010000:1.0:1784189344.739189:0:24831:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/1896 (0->18446744073709551615) 00010000:00010000:2.0:1784189344.739191:0:66170:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04a20a200/0xcc1762b626f8d2a1 lrc: 4/1,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00002000:00100000:1.0:1784189344.739193:0:24831:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9dbf4a341f80 with x1870854436367488 ext(0->18446744073709551615) 00010000:00010000:2.0:1784189344.739200:0:66170:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04a20a200/0xcc1762b626f8d2a1 lrc: 3/0,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1784189344.739200:0:24831:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9dbf4a341f80. 00000100:00100000:0.0:1784189344.739200:0:66945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf4a343100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:debedd94-805c-42a0-a5e5-41758b2012e9+90:73674:x1870854436367360:12345-192.168.203.12@tcp:36:dd.0 Request processed in 525us (765us total) trans 120259084392 rc 0/0 00010000:00010000:2.0:1784189344.739216:0:66170:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04a20a200/0xcc1762b626f8d2a1 lrc: 4/0,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784189344.739216:0:66945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1543 00000020:00080000:0.0:1784189344.739224:0:66945:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1784189344.739226:0:66170:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc04a20a200 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:2.0:1784189344.739232:0:66170:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04a20a200/0xcc1762b626f8d2a1 lrc: 4/0,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189344.739239:0:66170:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04a20a200/0xcc1762b626f8d2a1 lrc: 5/0,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189344.739248:0:66170:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x0 (ffff9dbf45994c00) 00010000:00010000:2.0:1784189344.739251:0:66170:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784189344.739255:0:66170:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04a20a200/0xcc1762b626f8d2a1 lrc: 3/0,0 mode: --/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189344.739261:0:66170:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04a20a200/0xcc1762b626f8d2a1 lrc: 0/0,0 mode: --/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189344.739278:0:66170:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04a20b000/0xcc1762b626f8d2a8 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0xc8545ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189344.739283:0:66170:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04a20b000/0xcc1762b626f8d2a8 lrc: 2/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0xc8545ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189344.739288:0:66170:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04a20b000/0xcc1762b626f8d2a8 lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0xc8545ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189344.739293:0:66170:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc04a20b000 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:2.0:1784189344.739296:0:66170:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04a20b000/0xcc1762b626f8d2a8 lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0xc8545ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189344.739301:0:66170:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04a20b000/0xcc1762b626f8d2a8 lrc: 4/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0xc8545ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189344.739309:0:66170:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0xc8545ca3 (ffff9dc051574400) 00010000:00010000:2.0:1784189344.739311:0:66170:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784189344.739314:0:66170:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04a20b000/0xcc1762b626f8d2a8 lrc: 2/0,0 mode: --/PR res: [0x20000cf21:0x4:0x0].0xc8545ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189344.739349:0:66170:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04a20b000/0xcc1762b626f8d2a8 lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0x4:0x0].0xc8545ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189344.739384:0:66170:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04a20b200/0xcc1762b626f8d293 lrc: 0/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c4334 expref: 90 pid: 66170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189344.739397:0:66170:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04a20b800/0xcc1762b626f8d2af lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c4334 expref: 89 pid: 66170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189344.739414:0:66170:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x10:0x0].0x0 (ffff9dc05a487b00) 00010000:00010000:2.0:1784189344.739416:0:66170:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784189344.739419:0:66170:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc04a20b800, rc 0) 00000100:00100000:2.0:1784189344.739458:0:66170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc0477c2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:debedd94-805c-42a0-a5e5-41758b2012e9+89:73677:x1870854436367872:12345-192.168.203.12@tcp:101:dd.0 Request processed in 627us (941us total) trans 120259084393 rc 0/0 00000100:00100000:2.0:1784189344.739465:0:66170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1544 00000100:00100000:3.0:1784189344.739694:0:68287:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1545 00000100:00100000:3.0:1784189344.739703:0:68287:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc0477c0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:debedd94-805c-42a0-a5e5-41758b2012e9+88:73675:x1870854436367616:12345-192.168.203.12@tcp:101:dd.0 00010000:00010000:3.0:1784189344.739711:0:68287:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784189344.739723:0:68287:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0755a4600/0xcc1762b626f8d2bd lrc: 2/0,0 mode: --/PR res: [0x20000cf21:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbfc5de7fe6c432d expref: -99 pid: 68287 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189344.739757:0:68287:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0755a4800/0xcc1762b626f8d2c4 lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189344.739766:0:68287:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0755a4800/0xcc1762b626f8d2c4 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189344.739773:0:68287:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0755a4800/0xcc1762b626f8d2c4 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189344.739853:0:68287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0755a4600/0xcc1762b626f8d2bd lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c432d expref: 90 pid: 68287 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189344.739867:0:68287:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0755a4800/0xcc1762b626f8d2c4 lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c432d expref: 89 pid: 68287 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189344.739874:0:68287:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0xe:0x0].0x0 (ffff9dbf44851400) 00010000:00010000:3.0:1784189344.739876:0:68287:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1784189344.739879:0:68287:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc0755a4800, rc 0) 00000100:00100000:3.0:1784189344.739916:0:68287:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc0477c0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:debedd94-805c-42a0-a5e5-41758b2012e9+89:73675:x1870854436367616:12345-192.168.203.12@tcp:101:dd.0 Request processed in 215us (1359us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189344.739923:0:68287:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1545 00000100:00100000:1.0:1784189344.745419:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1784189344.745881:0:66172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436368128 00000100:00100000:2.0:1784189344.745902:0:66172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436368128 00000100:00100000:2.0:1784189344.745949:0:66172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 271 00000100:00100000:2.0:1784189344.745970:0:66172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf4693d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:debedd94-805c-42a0-a5e5-41758b2012e9+89:73686:x1870854436368128:12345-192.168.203.12@tcp:35:dd.0 00000100:00100000:2.0:1784189344.746225:0:66172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf4693d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:debedd94-805c-42a0-a5e5-41758b2012e9+90:73686:x1870854436368128:12345-192.168.203.12@tcp:35:dd.0 Request processed in 255us (813us total) trans 120259084394 rc 0/0 00000100:00100000:2.0:1784189344.746233:0:66172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 271 00000100:00100000:0.0:1784189344.746710:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1784189344.746743:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1784189344.746782:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1784189344.746786:0:26165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436368640 00000100:00100000:1.0:1784189344.746794:0:26165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436368640 00000100:00100000:1.0:1784189344.746846:0:26165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 5029 00000100:00100000:1.0:1784189344.746854:0:26165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf4a32dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:debedd94-805c-42a0-a5e5-41758b2012e9+21:73674:x1870854436368640:12345-192.168.203.12@tcp:101:dd.0 00010000:00010000:1.0:1784189344.746866:0:26165:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784189344.746884:0:26165:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000067956617/0xcc1762b626f8d2cb lrc: 2/0,0 mode: --/PW res: [0x280000401:0x769:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xcbfc5de7fe6c433b expref: -99 pid: 26165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1784189344.746909:0:26165:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x769:0x0] initial LVB size: 0, mtime: 0x6a589196, atime: 0x6a589196, ctime: 0x6a589196, blocks: 0x0 00010000:00010000:1.0:1784189344.746927:0:26165:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x769:0x0].0x0 since=3586s v=(0 0) 00010000:00010000:1.0:1784189344.746931:0:26165:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x769:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784189344.746941:0:26165:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000067956617/0xcc1762b626f8d2cb lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x769:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c433b expref: 22 pid: 26165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189344.746958:0:26165:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000067956617/0xcc1762b626f8d2cb lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x769:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c433b expref: 22 pid: 26165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784189344.746967:0:66169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436368384 00010000:00010000:1.0:1784189344.746970:0:26165:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc07116e800, rc 0) 00000100:00100000:3.0:1784189344.746971:0:66169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436368384 00010000:00000080:1.0:1784189344.746989:0:26165:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9dbf4a32dc00 x1870854436368640/t0(0) o101->debedd94-805c-42a0-a5e5-41758b2012e9@192.168.203.12@tcp:535/0 lens 328/400 e 0 to 0 dl 1784189355 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1784189344.747005:0:66169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436368512 00000100:00100000:3.0:1784189344.747008:0:66169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436368512 00000100:00100000:3.0:1784189344.747025:0:66169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1546 00000100:00100000:1.0:1784189344.747025:0:26165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf4a32dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:debedd94-805c-42a0-a5e5-41758b2012e9+22:73674:x1870854436368640:12345-192.168.203.12@tcp:101:dd.0 Request processed in 172us (317us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189344.747032:0:66169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf4a32c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:debedd94-805c-42a0-a5e5-41758b2012e9+91:73675:x1870854436368384:12345-192.168.203.12@tcp:36:dd.0 00000100:00100000:1.0:1784189344.747032:0:26165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 5029 00000100:00100000:0.0:1784189344.747049:0:66170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1547 00000100:00100000:0.0:1784189344.747062:0:66170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc07ab98a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:debedd94-805c-42a0-a5e5-41758b2012e9+91:73677:x1870854436368512:12345-192.168.203.12@tcp:101:dd.0 00010000:00010000:3.0:1784189344.747073:0:66169:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784189344.747073:0:66170:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784189344.747089:0:66170:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc070146800/0xcc1762b626f8d2d2 lrc: 2/0,0 mode: --/PR res: [0x20000cf21:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbfc5de7fe6c4342 expref: -99 pid: 66170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189344.747097:0:66169:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4710ee00/0xcc1762b626f8d27e lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c431f expref: 91 pid: 66945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189344.747114:0:66169:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0xe:0x0].0x0 (ffff9dbf44851400) 00010000:00010000:0.0:1784189344.747117:0:66170:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc070147400/0xcc1762b626f8d2d9 lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189344.747119:0:66169:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1784189344.747131:0:66170:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc070147400/0xcc1762b626f8d2d9 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189344.747141:0:66170:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc070147400/0xcc1762b626f8d2d9 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189344.747217:0:66170:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc070146800/0xcc1762b626f8d2d2 lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c4342 expref: 93 pid: 66170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189344.747224:0:66169:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0755a5600/0xcc1762b626f8d2e0 lrc: 3/0,1 mode: --/PW res: [0x20000cf21:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189344.747242:0:66169:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0755a5600/0xcc1762b626f8d2e0 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189344.747252:0:66169:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0755a5600/0xcc1762b626f8d2e0 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189344.747252:0:66170:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc070147400/0xcc1762b626f8d2d9 lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c4342 expref: 92 pid: 66170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189344.747271:0:66170:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x10:0x0].0x0 (ffff9dc05a487b00) 00010000:00010000:0.0:1784189344.747275:0:66170:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1784189344.747277:0:66170:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc070147400, rc 0) 00000001:00080000:3.0:1784189344.747304:0:66169:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 120259084395 00000100:00100000:0.0:1784189344.747335:0:66170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc07ab98a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:debedd94-805c-42a0-a5e5-41758b2012e9+93:73677:x1870854436368512:12345-192.168.203.12@tcp:101:dd.0 Request processed in 258us (534us total) trans 0 rc 0/0 00000100:00100000:0.0:1784189344.747343:0:66170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1547 00000004:00010000:3.0:1784189344.747353:0:66169:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000b8b317a1 reply state 00000000688f74ca transno 120259084396 ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0755a5600/0xcc1762b626f8d2e0 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189344.747366:0:66169:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0755a5600/0xcc1762b626f8d2e0 lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189344.747373:0:66169:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0xe:0x0].0x0 (ffff9dbf44851400) 00010000:00010000:3.0:1784189344.747376:0:66169:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1784189344.747379:0:66169:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1784189344.747546:0:66169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf4a32c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:debedd94-805c-42a0-a5e5-41758b2012e9+93:73675:x1870854436368384:12345-192.168.203.12@tcp:36:dd.0 Request processed in 402us (690us total) trans 120259084396 rc 0/0 00000100:00100000:3.0:1784189344.747553:0:66169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1546 00000020:00080000:3.0:1784189344.747557:0:66169:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1784189344.752622:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1784189344.752673:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1784189344.752743:0:66173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436368896 00000100:00100000:2.0:1784189344.752752:0:66173:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436368896 00000100:00100000:2.0:1784189344.752813:0:66173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 272 00000100:00100000:2.0:1784189344.752823:0:66173:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf4693f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:debedd94-805c-42a0-a5e5-41758b2012e9+93:73673:x1870854436368896:12345-192.168.203.12@tcp:35:dd.0 00000100:00100000:2.0:1784189344.753090:0:66173:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf4693f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:debedd94-805c-42a0-a5e5-41758b2012e9+94:73673:x1870854436368896:12345-192.168.203.12@tcp:35:dd.0 Request processed in 269us (476us total) trans 120259084397 rc 0/0 00000100:00100000:2.0:1784189344.753098:0:66173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 272 00000100:00100000:3.0:1784189344.753362:0:68287:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436369152 00000100:00100000:3.0:1784189344.753378:0:68287:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436369152 00000100:00100000:3.0:1784189344.753409:0:68287:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1548 00000100:00100000:3.0:1784189344.753416:0:68287:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf4693e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:debedd94-805c-42a0-a5e5-41758b2012e9+94:73676:x1870854436369152:12345-192.168.203.12@tcp:101:dd.0 00010000:00010000:3.0:1784189344.753426:0:68287:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784189344.753442:0:68287:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0755a4600/0xcc1762b626f8d2e7 lrc: 2/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbfc5de7fe6c4349 expref: -99 pid: 68287 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189344.753806:0:68287:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0755a5000/0xcc1762b626f8d2ee lrc: 3/1,0 mode: --/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189344.753821:0:68287:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0755a5000/0xcc1762b626f8d2ee lrc: 3/1,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189344.753832:0:68287:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0755a5000/0xcc1762b626f8d2ee lrc: 3/1,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189344.753848:0:68287:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0755a4200/0xcc1762b626f8d2f5 lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0x4:0x0].0x6e9b5ca3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189344.753855:0:68287:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0755a4200/0xcc1762b626f8d2f5 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x6e9b5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189344.753862:0:68287:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0755a4200/0xcc1762b626f8d2f5 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x6e9b5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189344.753905:0:68287:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0755a5e00/0xcc1762b626f8d2fc lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0xf:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189344.753914:0:68287:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0755a5e00/0xcc1762b626f8d2fc lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0xf:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189344.754576:0:68287:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0755a5e00/0xcc1762b626f8d2fc lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0xf:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784189344.754596:0:68287:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000cf21:0xf:0x0]: returning size 0 00010000:00010000:3.0:1784189344.754659:0:68287:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0755a5000/0xcc1762b626f8d2ee lrc: 4/1,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189344.754668:0:68287:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0755a5000/0xcc1762b626f8d2ee lrc: 4/1,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189344.754674:0:68287:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0755a5000/0xcc1762b626f8d2ee lrc: 3/0,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189344.754680:0:68287:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0755a5000/0xcc1762b626f8d2ee lrc: 4/0,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189344.754686:0:68287:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc0755a5000 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:3.0:1784189344.754689:0:68287:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0755a5000/0xcc1762b626f8d2ee lrc: 4/0,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189344.754696:0:68287:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0755a5000/0xcc1762b626f8d2ee lrc: 5/0,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189344.754708:0:68287:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x0 (ffff9dbf45994c00) 00010000:00010000:3.0:1784189344.754711:0:68287:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784189344.754715:0:68287:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0755a5000/0xcc1762b626f8d2ee lrc: 3/0,0 mode: --/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189344.754721:0:68287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0755a5000/0xcc1762b626f8d2ee lrc: 0/0,0 mode: --/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189344.754734:0:68287:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0755a4200/0xcc1762b626f8d2f5 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x6e9b5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189344.754740:0:68287:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0755a4200/0xcc1762b626f8d2f5 lrc: 2/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x6e9b5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189344.754752:0:68287:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0755a4200/0xcc1762b626f8d2f5 lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x6e9b5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189344.754757:0:68287:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc0755a4200 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:3.0:1784189344.754760:0:68287:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0755a4200/0xcc1762b626f8d2f5 lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x6e9b5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189344.754765:0:68287:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0755a4200/0xcc1762b626f8d2f5 lrc: 4/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x6e9b5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189344.754773:0:68287:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x6e9b5ca3 (ffff9dc081250f00) 00010000:00010000:3.0:1784189344.754775:0:68287:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784189344.754778:0:68287:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0755a4200/0xcc1762b626f8d2f5 lrc: 2/0,0 mode: --/PR res: [0x20000cf21:0x4:0x0].0x6e9b5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189344.754784:0:68287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0755a4200/0xcc1762b626f8d2f5 lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0x4:0x0].0x6e9b5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189344.754833:0:68287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0755a4600/0xcc1762b626f8d2e7 lrc: 0/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c4349 expref: 97 pid: 68287 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189344.754848:0:68287:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0755a5e00/0xcc1762b626f8d2fc lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0xf:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c4349 expref: 96 pid: 68287 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189344.754855:0:68287:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0xf:0x0].0x0 (ffff9dc05a487f00) 00010000:00010000:3.0:1784189344.754857:0:68287:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1784189344.754859:0:68287:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc0755a5e00, rc 0) 00000100:00100000:3.0:1784189344.754897:0:68287:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf4693e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:debedd94-805c-42a0-a5e5-41758b2012e9+96:73676:x1870854436369152:12345-192.168.203.12@tcp:101:dd.0 Request processed in 1480us (2222us total) trans 120259084398 rc 0/0 00000100:00100000:3.0:1784189344.754912:0:68287:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1548 00000100:00100000:1.0:1784189344.756556:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1784189344.756631:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1784189344.756692:0:24843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436369536 00000100:00100000:3.0:1784189344.756700:0:24843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436369536 00002000:00010000:3.0:1784189344.756732:0:24843:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/1897 (0->18446744073709551615) 00002000:00100000:3.0:1784189344.756737:0:24843:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9dbf4693d180 with x1870854436369536 ext(0->18446744073709551615) 00002000:00010000:3.0:1784189344.756747:0:24843:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9dbf4693d180. 00000100:00100000:3.0:1784189344.756780:0:24843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1016 00000100:00100000:3.0:1784189344.756806:0:24843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf4693d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:debedd94-805c-42a0-a5e5-41758b2012e9+22:2397:x1870854436369536:12345-192.168.203.12@tcp:10:dd.0 00002000:00010000:3.0:1784189344.756947:0:24843:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x769:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1784189344.756950:0:24843:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x769:0x0] updating lvb mtime from disk: 1784189334 -> 1784189344 00002000:00010000:3.0:1784189344.756953:0:24843:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x769:0x0] updating lvb atime from disk: 1784189334 -> 1784189334 00002000:00010000:3.0:1784189344.756955:0:24843:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x769:0x0] updating lvb ctime from disk: 1784189334 -> 1784189344 00002000:00010000:3.0:1784189344.756958:0:24843:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x769:0x0] updating lvb blocks from disk: 0 -> 0 00010000:00000080:3.0:1784189344.756967:0:24843:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9dbf4693d180 x1870854436369536/t4294968986(0) o10->debedd94-805c-42a0-a5e5-41758b2012e9@192.168.203.12@tcp:535/0 lens 440/432 e 0 to 0 dl 1784189355 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1784189344.757037:0:24843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf4693d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:debedd94-805c-42a0-a5e5-41758b2012e9+23:2397:x1870854436369536:12345-192.168.203.12@tcp:10:dd.0 Request processed in 240us (405us total) trans 4294968986 rc 0/0 00000100:00100000:3.0:1784189344.757046:0:24843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1016 00002000:00010000:3.0:1784189344.757050:0:24843:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/1897 (0->18446744073709551615) 00002000:00100000:3.0:1784189344.757053:0:24843:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9dbf4693d180 with x1870854436369536 ext(0->18446744073709551615) 00002000:00010000:3.0:1784189344.757057:0:24843:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9dbf4693d180. 00000100:00100000:0.0:1784189344.757730:0:66945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436369408 00000100:00100000:0.0:1784189344.757738:0:66945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436369408 00000100:00100000:1.0:1784189344.757929:0:66945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1549 00000100:00100000:1.0:1784189344.757939:0:66945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf4693df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:debedd94-805c-42a0-a5e5-41758b2012e9+96:73677:x1870854436369408:12345-192.168.203.12@tcp:36:dd.0 00010000:00010000:1.0:1784189344.757978:0:66945:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784189344.758013:0:66945:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04a20b800/0xcc1762b626f8d2af lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c4334 expref: 96 pid: 66170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189344.758031:0:66945:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x10:0x0].0x0 (ffff9dc05a487b00) 00010000:00010000:1.0:1784189344.758036:0:66945:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1784189344.758279:0:66945:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc07116fe00/0xcc1762b626f8d30a lrc: 3/0,1 mode: --/PW res: [0x20000cf21:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189344.758294:0:66945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc07116fe00/0xcc1762b626f8d30a lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189344.758305:0:66945:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc07116fe00/0xcc1762b626f8d30a lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1784189344.758455:0:66945:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 120259084399 00000004:00010000:1.0:1784189344.758491:0:66945:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000003da556fc reply state 00000000cbd6d02e transno 120259084400 ns: mdt-lustre-MDT0000_UUID lock: ffff9dc07116fe00/0xcc1762b626f8d30a lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189344.758520:0:66945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc07116fe00/0xcc1762b626f8d30a lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189344.758527:0:66945:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x10:0x0].0x0 (ffff9dc05a487b00) 00010000:00010000:1.0:1784189344.758529:0:66945:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1784189344.758531:0:66945:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1784189344.758613:0:66945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf4693df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:debedd94-805c-42a0-a5e5-41758b2012e9+98:73677:x1870854436369408:12345-192.168.203.12@tcp:36:dd.0 Request processed in 675us (2062us total) trans 120259084400 rc 0/0 00000100:00100000:1.0:1784189344.758621:0:66945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1549 00000020:00080000:1.0:1784189344.758625:0:66945:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1784189344.759268:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1784189344.759348:0:26171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436369664 00000100:00100000:2.0:1784189344.759355:0:26171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436369664 00000100:00100000:2.0:1784189344.759393:0:26171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 5030 00000100:00100000:2.0:1784189344.759402:0:26171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf4693c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:debedd94-805c-42a0-a5e5-41758b2012e9+23:73675:x1870854436369664:12345-192.168.203.12@tcp:101:dd.0 00010000:00010000:2.0:1784189344.759421:0:26171:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784189344.759437:0:26171:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000041e819fd/0xcc1762b626f8d311 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x76a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xcbfc5de7fe6c4350 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1784189344.759457:0:26171:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x76a:0x0] initial LVB size: 0, mtime: 0x6a589196, atime: 0x6a589196, ctime: 0x6a589196, blocks: 0x0 00010000:00010000:2.0:1784189344.759472:0:26171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x76a:0x0].0x0 since=3586s v=(0 0) 00010000:00010000:2.0:1784189344.759487:0:26171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x76a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784189344.759496:0:26171:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000041e819fd/0xcc1762b626f8d311 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x76a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c4350 expref: 24 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189344.759511:0:26171:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000041e819fd/0xcc1762b626f8d311 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x76a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c4350 expref: 24 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189344.759522:0:26171:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc04a20a200, rc 0) 00010000:00000080:2.0:1784189344.759528:0:26171:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9dbf4693c380 x1870854436369664/t0(0) o101->debedd94-805c-42a0-a5e5-41758b2012e9@192.168.203.12@tcp:535/0 lens 328/400 e 0 to 0 dl 1784189355 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1784189344.759572:0:26171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf4693c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:debedd94-805c-42a0-a5e5-41758b2012e9+24:73675:x1870854436369664:12345-192.168.203.12@tcp:101:dd.0 Request processed in 171us (305us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189344.759578:0:26171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 5030 00000100:00100000:3.0:1784189344.761105:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1784189344.761244:0:66169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436369792 00000100:00100000:1.0:1784189344.761251:0:66169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436369792 00000100:00100000:1.0:1784189344.761304:0:66169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1550 00000100:00100000:1.0:1784189344.761314:0:66169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc0477c1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:debedd94-805c-42a0-a5e5-41758b2012e9+98:73676:x1870854436369792:12345-192.168.203.12@tcp:101:dd.0 00010000:00010000:1.0:1784189344.761367:0:66169:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784189344.761384:0:66169:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc07116e000/0xcc1762b626f8d318 lrc: 2/0,0 mode: --/PR res: [0x20000cf21:0xf:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbfc5de7fe6c4357 expref: -99 pid: 66169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189344.761415:0:66169:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc07116fa00/0xcc1762b626f8d31f lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0xf:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189344.761427:0:66169:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc07116fa00/0xcc1762b626f8d31f lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0xf:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189344.761437:0:66169:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc07116fa00/0xcc1762b626f8d31f lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0xf:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189344.761704:0:66169:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc07116e000/0xcc1762b626f8d318 lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0xf:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c4357 expref: 100 pid: 66169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189344.761728:0:66169:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc07116fa00/0xcc1762b626f8d31f lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0xf:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c4357 expref: 99 pid: 66169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189344.761737:0:66169:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0xf:0x0].0x0 (ffff9dc05a487f00) 00010000:00010000:1.0:1784189344.761740:0:66169:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1784189344.761743:0:66169:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc07116fa00, rc 0) 00000100:00100000:1.0:1784189344.761855:0:66169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc0477c1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:debedd94-805c-42a0-a5e5-41758b2012e9+99:73676:x1870854436369792:12345-192.168.203.12@tcp:101:dd.0 Request processed in 542us (899us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189344.761862:0:66169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1550 00000100:00100000:3.0:1784189344.763407:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1784189344.763487:0:66170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436370048 00000100:00100000:2.0:1784189344.763494:0:66170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436370048 00000100:00100000:2.0:1784189344.763551:0:66170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1551 00000100:00100000:2.0:1784189344.763560:0:66170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc0477c1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:debedd94-805c-42a0-a5e5-41758b2012e9+99:73678:x1870854436370048:12345-192.168.203.12@tcp:101:dd.0 00010000:00010000:2.0:1784189344.763578:0:66170:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784189344.763595:0:66170:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04a20b800/0xcc1762b626f8d326 lrc: 2/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbfc5de7fe6c435e expref: -99 pid: 66170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189344.763721:0:66170:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04a20b000/0xcc1762b626f8d32d lrc: 3/1,0 mode: --/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189344.763734:0:66170:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04a20b000/0xcc1762b626f8d32d lrc: 3/1,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189344.763744:0:66170:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04a20b000/0xcc1762b626f8d32d lrc: 3/1,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189344.763759:0:66170:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04a20b200/0xcc1762b626f8d334 lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0x4:0x0].0x220d5ca3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189344.763766:0:66170:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04a20b200/0xcc1762b626f8d334 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x220d5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189344.763772:0:66170:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04a20b200/0xcc1762b626f8d334 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x220d5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189344.763848:0:66170:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04a20bc00/0xcc1762b626f8d33b lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0x11:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189344.763857:0:66170:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04a20bc00/0xcc1762b626f8d33b lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189344.763864:0:66170:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04a20bc00/0xcc1762b626f8d33b lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784189344.763873:0:66170:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000cf21:0x11:0x0]: returning size 0 00010000:00010000:2.0:1784189344.763958:0:66170:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04a20b000/0xcc1762b626f8d32d lrc: 4/1,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189344.763966:0:66170:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04a20b000/0xcc1762b626f8d32d lrc: 4/1,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189344.763978:0:66170:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04a20b000/0xcc1762b626f8d32d lrc: 3/0,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189344.764261:0:66170:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04a20b000/0xcc1762b626f8d32d lrc: 4/0,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189344.764268:0:66170:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc04a20b000 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:2.0:1784189344.764272:0:66170:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04a20b000/0xcc1762b626f8d32d lrc: 4/0,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189344.764279:0:66170:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04a20b000/0xcc1762b626f8d32d lrc: 5/0,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189344.764289:0:66170:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x0 (ffff9dbf45994c00) 00010000:00010000:2.0:1784189344.764291:0:66170:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784189344.764295:0:66170:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04a20b000/0xcc1762b626f8d32d lrc: 3/0,0 mode: --/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189344.764300:0:66170:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04a20b000/0xcc1762b626f8d32d lrc: 0/0,0 mode: --/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189344.764312:0:66170:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04a20b200/0xcc1762b626f8d334 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x220d5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189344.764347:0:66170:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04a20b200/0xcc1762b626f8d334 lrc: 2/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x220d5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189344.764354:0:66170:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04a20b200/0xcc1762b626f8d334 lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x220d5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189344.764360:0:66170:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc04a20b200 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:2.0:1784189344.764369:0:66170:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04a20b200/0xcc1762b626f8d334 lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x220d5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189344.764376:0:66170:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04a20b200/0xcc1762b626f8d334 lrc: 4/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x220d5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189344.764385:0:66170:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x220d5ca3 (ffff9dc051574300) 00010000:00010000:2.0:1784189344.764387:0:66170:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784189344.764391:0:66170:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04a20b200/0xcc1762b626f8d334 lrc: 2/0,0 mode: --/PR res: [0x20000cf21:0x4:0x0].0x220d5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189344.764397:0:66170:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04a20b200/0xcc1762b626f8d334 lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0x4:0x0].0x220d5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189344.764432:0:66170:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04a20b800/0xcc1762b626f8d326 lrc: 0/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c435e expref: 102 pid: 66170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189344.764444:0:66170:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04a20bc00/0xcc1762b626f8d33b lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c435e expref: 101 pid: 66170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189344.764452:0:66170:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x11:0x0].0x0 (ffff9dc05a487000) 00010000:00010000:2.0:1784189344.764453:0:66170:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784189344.764456:0:66170:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc04a20bc00, rc 0) 00000100:00100000:2.0:1784189344.764598:0:66170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc0477c1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:debedd94-805c-42a0-a5e5-41758b2012e9+101:73678:x1870854436370048:12345-192.168.203.12@tcp:101:dd.0 Request processed in 1038us (1195us total) trans 120259084401 rc 0/0 00000100:00100000:2.0:1784189344.764606:0:66170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1551 00000100:00100000:3.0:1784189344.767181:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1784189344.767225:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1784189344.767248:0:24833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436370176 00000100:00100000:2.0:1784189344.767257:0:24833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436370176 00002000:00010000:2.0:1784189344.767289:0:24833:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/1898 (0->18446744073709551615) 00002000:00100000:2.0:1784189344.767293:0:24833:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9dc05ed9a680 with x1870854436370176 ext(0->18446744073709551615) 00002000:00010000:2.0:1784189344.767309:0:24833:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9dc05ed9a680. 00000100:00100000:2.0:1784189344.767381:0:24833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1017 00000100:00100000:2.0:1784189344.767391:0:24833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc05ed9a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:debedd94-805c-42a0-a5e5-41758b2012e9+24:2396:x1870854436370176:12345-192.168.203.12@tcp:10:dd.0 00002000:00010000:2.0:1784189344.767537:0:24833:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x76a:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1784189344.767540:0:24833:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x76a:0x0] updating lvb mtime from disk: 1784189334 -> 1784189344 00002000:00010000:2.0:1784189344.767543:0:24833:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x76a:0x0] updating lvb atime from disk: 1784189334 -> 1784189334 00002000:00010000:2.0:1784189344.767545:0:24833:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x76a:0x0] updating lvb ctime from disk: 1784189334 -> 1784189344 00002000:00010000:2.0:1784189344.767547:0:24833:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x76a:0x0] updating lvb blocks from disk: 0 -> 0 00010000:00000080:2.0:1784189344.767554:0:24833:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9dc05ed9a680 x1870854436370176/t4294968987(0) o10->debedd94-805c-42a0-a5e5-41758b2012e9@192.168.203.12@tcp:535/0 lens 440/432 e 0 to 0 dl 1784189355 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1784189344.767609:0:24833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc05ed9a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:debedd94-805c-42a0-a5e5-41758b2012e9+25:2396:x1870854436370176:12345-192.168.203.12@tcp:10:dd.0 Request processed in 221us (439us total) trans 4294968987 rc 0/0 00000100:00100000:2.0:1784189344.767616:0:24833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1017 00002000:00010000:2.0:1784189344.767619:0:24833:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/1898 (0->18446744073709551615) 00002000:00100000:2.0:1784189344.767621:0:24833:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9dc05ed9a680 with x1870854436370176 ext(0->18446744073709551615) 00002000:00010000:2.0:1784189344.767625:0:24833:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9dc05ed9a680. 00000100:00100000:0.0:1784189344.767825:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436370304 00000100:00100000:0.0:1784189344.767830:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436370304 00000100:00100000:0.0:1784189344.767866:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 5031 00000100:00100000:0.0:1784189344.767873:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf43c5d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:debedd94-805c-42a0-a5e5-41758b2012e9+25:73677:x1870854436370304:12345-192.168.203.12@tcp:101:dd.0 00010000:00010000:0.0:1784189344.767883:0:8429:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784189344.767899:0:8429:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000034a0fccf/0xcc1762b626f8d349 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x76c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xcbfc5de7fe6c4365 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1784189344.767916:0:8429:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x76c:0x0] initial LVB size: 0, mtime: 0x6a589196, atime: 0x6a589196, ctime: 0x6a589196, blocks: 0x0 00010000:00010000:0.0:1784189344.767931:0:8429:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x76c:0x0].0x0 since=3586s v=(0 0) 00010000:00010000:0.0:1784189344.767936:0:8429:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x76c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784189344.767944:0:8429:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000034a0fccf/0xcc1762b626f8d349 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x76c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c4365 expref: 26 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189344.767973:0:8429:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000034a0fccf/0xcc1762b626f8d349 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x76c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c4365 expref: 26 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189344.768078:0:8429:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc070146800, rc 0) 00010000:00000080:0.0:1784189344.768085:0:8429:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9dbf43c5d180 x1870854436370304/t0(0) o101->debedd94-805c-42a0-a5e5-41758b2012e9@192.168.203.12@tcp:535/0 lens 328/400 e 0 to 0 dl 1784189355 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1784189344.768123:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf43c5d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:debedd94-805c-42a0-a5e5-41758b2012e9+26:73677:x1870854436370304:12345-192.168.203.12@tcp:101:dd.0 Request processed in 250us (897us total) trans 0 rc 0/0 00000100:00100000:0.0:1784189344.768135:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 5031 00000100:00100000:3.0:1784189344.770137:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1784189344.770268:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1784189344.772450:0:66173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436370816 00000100:00100000:2.0:1784189344.772464:0:66173:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436370816 00000100:00100000:2.0:1784189344.772537:0:66173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 273 00000100:00100000:2.0:1784189344.772547:0:66173:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc04a64f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:debedd94-805c-42a0-a5e5-41758b2012e9+101:73674:x1870854436370816:12345-192.168.203.12@tcp:35:dd.0 00000100:00100000:2.0:1784189344.772825:0:66173:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc04a64f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:debedd94-805c-42a0-a5e5-41758b2012e9+102:73674:x1870854436370816:12345-192.168.203.12@tcp:35:dd.0 Request processed in 278us (2557us total) trans 120259084402 rc 0/0 00000100:00100000:2.0:1784189344.772835:0:66173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 273 00000100:00100000:2.0:1784189344.772901:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1784189344.778726:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1784189344.778726:0:66945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436370560 00000100:00100000:1.0:1784189344.778739:0:66945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436370560 00000100:00100000:2.0:1784189344.778777:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1784189344.778815:0:66945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436370944 00000100:00100000:2.0:1784189344.778820:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436371328 00000100:00100000:1.0:1784189344.778820:0:66945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436370944 00000100:00100000:2.0:1784189344.778827:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436371328 00000100:00100000:1.0:1784189344.778850:0:66945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436371200 00000100:00100000:1.0:1784189344.778855:0:66945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436371200 00002000:00010000:2.0:1784189344.778857:0:8434:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/1900 (0->18446744073709551615) 00002000:00100000:2.0:1784189344.778863:0:8434:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9dc07faa9f80 with x1870854436371328 ext(0->18446744073709551615) 00002000:00010000:2.0:1784189344.778875:0:8434:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9dc07faa9f80. 00000100:00100000:1.0:1784189344.778878:0:66945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1552 00000100:00100000:1.0:1784189344.778889:0:66945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf46902300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:debedd94-805c-42a0-a5e5-41758b2012e9+104:73676:x1870854436370560:12345-192.168.203.12@tcp:36:dd.0 00000100:00100000:2.0:1784189344.778899:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1018 00000100:00100000:2.0:1784189344.778908:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc07faa9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:debedd94-805c-42a0-a5e5-41758b2012e9+26:2396:x1870854436371328:12345-192.168.203.12@tcp:10:dd.0 00010000:00010000:1.0:1784189344.778938:0:66945:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784189344.779042:0:66945:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0755a5e00/0xcc1762b626f8d2fc lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0xf:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c4349 expref: 104 pid: 68287 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1784189344.779059:0:8434:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x76c:0x0] updating lvb size from disk: 0 -> 0 00010000:00010000:1.0:1784189344.779063:0:66945:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0xf:0x0].0x0 (ffff9dc05a487f00) 00002000:00010000:2.0:1784189344.779064:0:8434:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x76c:0x0] updating lvb mtime from disk: 1784189334 -> 1784189344 00002000:00010000:2.0:1784189344.779068:0:8434:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x76c:0x0] updating lvb atime from disk: 1784189334 -> 1784189334 00010000:00010000:1.0:1784189344.779072:0:66945:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00002000:00010000:2.0:1784189344.779073:0:8434:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x76c:0x0] updating lvb ctime from disk: 1784189334 -> 1784189344 00002000:00010000:2.0:1784189344.779078:0:8434:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x76c:0x0] updating lvb blocks from disk: 0 -> 0 00010000:00000080:2.0:1784189344.779087:0:8434:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9dc07faa9f80 x1870854436371328/t4294968988(0) o10->debedd94-805c-42a0-a5e5-41758b2012e9@192.168.203.12@tcp:535/0 lens 440/432 e 0 to 0 dl 1784189355 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1784189344.779142:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc07faa9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:debedd94-805c-42a0-a5e5-41758b2012e9+27:2396:x1870854436371328:12345-192.168.203.12@tcp:10:dd.0 Request processed in 235us (364us total) trans 4294968988 rc 0/0 00000100:00100000:2.0:1784189344.779149:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1018 00002000:00010000:2.0:1784189344.779152:0:8434:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/1900 (0->18446744073709551615) 00002000:00100000:2.0:1784189344.779155:0:8434:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9dc07faa9f80 with x1870854436371328 ext(0->18446744073709551615) 00002000:00010000:2.0:1784189344.779160:0:8434:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9dc07faa9f80. 00010000:00010000:1.0:1784189344.779206:0:66945:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc07116e000/0xcc1762b626f8d350 lrc: 3/0,1 mode: --/PW res: [0x20000cf21:0xf:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784189344.779213:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00010000:00010000:1.0:1784189344.779226:0:66945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc07116e000/0xcc1762b626f8d350 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0xf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784189344.779238:0:66172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436371584 00000100:00100000:2.0:1784189344.779243:0:66172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436371584 00010000:00010000:1.0:1784189344.779251:0:66945:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc07116e000/0xcc1762b626f8d350 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0xf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784189344.779266:0:66172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 274 00000100:00100000:2.0:1784189344.779273:0:66172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc050542a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:debedd94-805c-42a0-a5e5-41758b2012e9+105:73675:x1870854436371584:12345-192.168.203.12@tcp:35:dd.0 00000001:00080000:1.0:1784189344.779295:0:66945:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 120259084403 00000004:00010000:1.0:1784189344.779340:0:66945:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000002848a489 reply state 00000000b1dd88f5 transno 120259084404 ns: mdt-lustre-MDT0000_UUID lock: ffff9dc07116e000/0xcc1762b626f8d350 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0xf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189344.779354:0:66945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc07116e000/0xcc1762b626f8d350 lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0xf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189344.779361:0:66945:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0xf:0x0].0x0 (ffff9dc05a487f00) 00010000:00010000:1.0:1784189344.779364:0:66945:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1784189344.779367:0:66945:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1784189344.779427:0:66945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf46902300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:debedd94-805c-42a0-a5e5-41758b2012e9+108:73676:x1870854436370560:12345-192.168.203.12@tcp:36:dd.0 Request processed in 539us (9527us total) trans 120259084404 rc 0/0 00000100:00100000:1.0:1784189344.779435:0:66945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1552 00000020:00080000:1.0:1784189344.779439:0:66945:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1784189344.779445:0:66172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc050542a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:debedd94-805c-42a0-a5e5-41758b2012e9+108:73675:x1870854436371584:12345-192.168.203.12@tcp:35:dd.0 Request processed in 170us (233us total) trans 120259084405 rc 0/0 00000100:00100000:2.0:1784189344.779454:0:66172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 274 00000100:00100000:1.0:1784189344.779459:0:66945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1553 00000100:00100000:1.0:1784189344.779470:0:66945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc07faa8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:debedd94-805c-42a0-a5e5-41758b2012e9+106:73678:x1870854436370944:12345-192.168.203.12@tcp:101:dd.0 00010000:00010000:1.0:1784189344.779480:0:66945:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784189344.779491:0:66945:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc07116f800/0xcc1762b626f8d357 lrc: 2/0,0 mode: --/PR res: [0x20000cf21:0x11:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbfc5de7fe6c436c expref: -99 pid: 66945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189344.779515:0:66945:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4710ee00/0xcc1762b626f8d35e lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0x11:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189344.779524:0:66945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4710ee00/0xcc1762b626f8d35e lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x11:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189344.779544:0:66945:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4710ee00/0xcc1762b626f8d35e lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x11:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784189344.779556:0:66171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1554 00000100:00100000:0.0:1784189344.779566:0:66171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc07faa8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:debedd94-805c-42a0-a5e5-41758b2012e9+107:73679:x1870854436371200:12345-192.168.203.12@tcp:101:dd.0 00010000:00010000:0.0:1784189344.779575:0:66171:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784189344.779586:0:66171:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc070146600/0xcc1762b626f8d365 lrc: 2/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbfc5de7fe6c4373 expref: -99 pid: 66171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189344.779622:0:66945:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc07116f800/0xcc1762b626f8d357 lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0x11:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c436c expref: 109 pid: 66945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189344.779640:0:66945:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4710ee00/0xcc1762b626f8d35e lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x11:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c436c expref: 108 pid: 66945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189344.779648:0:66945:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x11:0x0].0x0 (ffff9dc05a487000) 00010000:00010000:1.0:1784189344.779650:0:66945:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1784189344.779653:0:66945:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dbf4710ee00, rc 0) 00010000:00010000:0.0:1784189344.779676:0:66171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc070147e00/0xcc1762b626f8d36c lrc: 3/1,0 mode: --/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189344.779686:0:66171:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc070147e00/0xcc1762b626f8d36c lrc: 3/1,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189344.779695:0:66171:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc070147e00/0xcc1762b626f8d36c lrc: 3/1,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189344.779707:0:66171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc070147000/0xcc1762b626f8d373 lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0x4:0x0].0x7bc65ca3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189344.779720:0:66171:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc070147000/0xcc1762b626f8d373 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x7bc65ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189344.779726:0:66171:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc070147000/0xcc1762b626f8d373 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x7bc65ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189344.779766:0:66171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc070146000/0xcc1762b626f8d37a lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0x12:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189344.779775:0:66171:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc070146000/0xcc1762b626f8d37a lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x12:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189344.779781:0:66171:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc070146000/0xcc1762b626f8d37a lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x12:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784189344.779812:0:66171:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000cf21:0x12:0x0]: returning size 0 00010000:00010000:0.0:1784189344.779860:0:66171:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc070147e00/0xcc1762b626f8d36c lrc: 4/1,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189344.779867:0:66171:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc070147e00/0xcc1762b626f8d36c lrc: 4/1,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189344.779872:0:66171:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc070147e00/0xcc1762b626f8d36c lrc: 3/0,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189344.779878:0:66171:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dc070147e00/0xcc1762b626f8d36c lrc: 4/0,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189344.779883:0:66171:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc070147e00 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:0.0:1784189344.779887:0:66171:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc070147e00/0xcc1762b626f8d36c lrc: 4/0,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189344.779904:0:66171:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc070147e00/0xcc1762b626f8d36c lrc: 5/0,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189344.779913:0:66171:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x0 (ffff9dbf45994c00) 00010000:00010000:0.0:1784189344.779916:0:66171:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784189344.779920:0:66171:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dc070147e00/0xcc1762b626f8d36c lrc: 3/0,0 mode: --/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189344.779926:0:66171:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc070147e00/0xcc1762b626f8d36c lrc: 0/0,0 mode: --/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189344.779936:0:66171:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc070147000/0xcc1762b626f8d373 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x7bc65ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189344.779941:0:66171:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc070147000/0xcc1762b626f8d373 lrc: 2/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x7bc65ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189344.779946:0:66171:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dc070147000/0xcc1762b626f8d373 lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x7bc65ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189344.779951:0:66171:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc070147000 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:0.0:1784189344.779954:0:66171:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc070147000/0xcc1762b626f8d373 lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x7bc65ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189344.779960:0:66171:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc070147000/0xcc1762b626f8d373 lrc: 4/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x7bc65ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189344.779967:0:66171:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x7bc65ca3 (ffff9dbf47f75600) 00010000:00010000:0.0:1784189344.779969:0:66171:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784189344.779972:0:66171:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dc070147000/0xcc1762b626f8d373 lrc: 2/0,0 mode: --/PR res: [0x20000cf21:0x4:0x0].0x7bc65ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189344.779998:0:66171:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc070147000/0xcc1762b626f8d373 lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0x4:0x0].0x7bc65ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189344.780031:0:66171:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc070146600/0xcc1762b626f8d365 lrc: 0/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c4373 expref: 110 pid: 66171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189344.780044:0:66171:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc070146000/0xcc1762b626f8d37a lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x12:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c4373 expref: 109 pid: 66171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189344.780051:0:66171:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x12:0x0].0x0 (ffff9dc07fab4400) 00010000:00010000:0.0:1784189344.780053:0:66171:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1784189344.780055:0:66171:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc070146000, rc 0) 00000100:00100000:1.0:1784189344.780068:0:66945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc07faa8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:debedd94-805c-42a0-a5e5-41758b2012e9+109:73678:x1870854436370944:12345-192.168.203.12@tcp:101:dd.0 Request processed in 599us (7165us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189344.780076:0:66945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1553 00000100:00100000:0.0:1784189344.780095:0:66171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc07faa8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:debedd94-805c-42a0-a5e5-41758b2012e9+108:73679:x1870854436371200:12345-192.168.203.12@tcp:101:dd.0 Request processed in 528us (1374us total) trans 120259084406 rc 0/0 00000100:00100000:0.0:1784189344.780102:0:66171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1554 00000100:00100000:2.0:1784189344.783985:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1784189344.784852:0:66172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436371840 00000100:00100000:3.0:1784189344.784863:0:66172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436371840 00000100:00100000:3.0:1784189344.784938:0:66172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 275 00000100:00100000:3.0:1784189344.784949:0:66172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf44d08050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:debedd94-805c-42a0-a5e5-41758b2012e9+108:73677:x1870854436371840:12345-192.168.203.12@tcp:35:dd.0 00000100:00100000:3.0:1784189344.785222:0:66172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf44d08050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:debedd94-805c-42a0-a5e5-41758b2012e9+109:73677:x1870854436371840:12345-192.168.203.12@tcp:35:dd.0 Request processed in 275us (1299us total) trans 120259084407 rc 0/0 00000100:00100000:3.0:1784189344.785231:0:66172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 275 00000100:00100000:2.0:1784189344.792441:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1784189344.792572:0:26163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436371968 00000100:00100000:1.0:1784189344.792581:0:26163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436371968 00000100:00100000:1.0:1784189344.792641:0:26163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 5032 00000100:00100000:1.0:1784189344.792650:0:26163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc050542a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:debedd94-805c-42a0-a5e5-41758b2012e9+27:73676:x1870854436371968:12345-192.168.203.12@tcp:101:dd.0 00010000:00010000:1.0:1784189344.792666:0:26163:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784189344.792685:0:26163:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008c7612c6/0xcc1762b626f8d388 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x76b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xcbfc5de7fe6c437a expref: -99 pid: 26163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1784189344.792708:0:26163:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x76b:0x0] initial LVB size: 0, mtime: 0x6a589196, atime: 0x6a589196, ctime: 0x6a589196, blocks: 0x0 00010000:00010000:1.0:1784189344.792730:0:26163:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x76b:0x0].0x0 since=3587s v=(0 0) 00010000:00010000:1.0:1784189344.792734:0:26163:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x76b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784189344.792756:0:26163:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008c7612c6/0xcc1762b626f8d388 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x76b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c437a expref: 28 pid: 26163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189344.792776:0:26163:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000008c7612c6/0xcc1762b626f8d388 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x76b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c437a expref: 28 pid: 26163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189344.792807:0:26163:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dbf4710e600, rc 0) 00010000:00000080:1.0:1784189344.792815:0:26163:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9dc050542a00 x1870854436371968/t0(0) o101->debedd94-805c-42a0-a5e5-41758b2012e9@192.168.203.12@tcp:535/0 lens 328/400 e 0 to 0 dl 1784189355 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1784189344.792879:0:26163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc050542a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:debedd94-805c-42a0-a5e5-41758b2012e9+28:73676:x1870854436371968:12345-192.168.203.12@tcp:101:dd.0 Request processed in 231us (448us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189344.792886:0:26163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 5032 00000100:00100000:0.0:1784189344.804551:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1784189344.804589:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1784189344.804633:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1784189344.804709:0:68287:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436372352 00000100:00100000:3.0:1784189344.804718:0:68287:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436372352 00000100:00100000:3.0:1784189344.804766:0:68287:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436372224 00000100:00100000:3.0:1784189344.804769:0:68287:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436372224 00000100:00100000:3.0:1784189344.804791:0:68287:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436372608 00000100:00100000:3.0:1784189344.804794:0:68287:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436372608 00000100:00100000:3.0:1784189344.804818:0:68287:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1555 00000100:00100000:3.0:1784189344.804827:0:68287:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc07ab9b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:debedd94-805c-42a0-a5e5-41758b2012e9+111:73679:x1870854436372352:12345-192.168.203.12@tcp:101:dd.0 00010000:00010000:3.0:1784189344.804852:0:68287:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784189344.804872:0:68287:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0755a4c00/0xcc1762b626f8d38f lrc: 2/0,0 mode: --/PR res: [0x20000cf21:0x12:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbfc5de7fe6c4381 expref: -99 pid: 68287 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189344.804904:0:68287:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0755a4600/0xcc1762b626f8d396 lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0x12:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189344.804917:0:68287:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0755a4600/0xcc1762b626f8d396 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x12:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189344.804942:0:68287:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0755a4600/0xcc1762b626f8d396 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x12:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189344.805057:0:68287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0755a4c00/0xcc1762b626f8d38f lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0x12:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c4381 expref: 113 pid: 68287 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189344.805076:0:68287:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0755a4600/0xcc1762b626f8d396 lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x12:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c4381 expref: 112 pid: 68287 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189344.805084:0:68287:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x12:0x0].0x0 (ffff9dc07fab4400) 00010000:00010000:3.0:1784189344.805087:0:68287:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1784189344.805091:0:68287:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc0755a4600, rc 0) 00000100:00100000:3.0:1784189344.805138:0:68287:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc07ab9b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:debedd94-805c-42a0-a5e5-41758b2012e9+112:73679:x1870854436372352:12345-192.168.203.12@tcp:101:dd.0 Request processed in 312us (667us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189344.805146:0:68287:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1555 00000100:00100000:3.0:1784189344.805162:0:68287:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1556 00000100:00100000:3.0:1784189344.805169:0:68287:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc07ab9b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:debedd94-805c-42a0-a5e5-41758b2012e9+111:73678:x1870854436372224:12345-192.168.203.12@tcp:36:dd.0 00010000:00010000:3.0:1784189344.805193:0:68287:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784189344.805206:0:68287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04a20bc00/0xcc1762b626f8d33b lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c435e expref: 111 pid: 66170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189344.805216:0:68287:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x11:0x0].0x0 (ffff9dc05a487000) 00010000:00010000:3.0:1784189344.805219:0:68287:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1784189344.805393:0:68287:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0755a4200/0xcc1762b626f8d39d lrc: 3/0,1 mode: --/PW res: [0x20000cf21:0x11:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189344.805403:0:68287:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0755a4200/0xcc1762b626f8d39d lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x11:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189344.805410:0:68287:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0755a4200/0xcc1762b626f8d39d lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x11:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1784189344.805454:0:68287:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 120259084408 00000004:00010000:3.0:1784189344.805472:0:68287:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000efe1d83a reply state 00000000aead9c79 transno 120259084409 ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0755a4200/0xcc1762b626f8d39d lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x11:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189344.805659:0:68287:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0755a4200/0xcc1762b626f8d39d lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x11:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189344.805666:0:68287:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x11:0x0].0x0 (ffff9dc05a487000) 00010000:00010000:3.0:1784189344.805668:0:68287:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1784189344.805670:0:68287:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1784189344.805722:0:68287:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc07ab9b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:debedd94-805c-42a0-a5e5-41758b2012e9+113:73678:x1870854436372224:12345-192.168.203.12@tcp:36:dd.0 Request processed in 553us (1132us total) trans 120259084409 rc 0/0 00000100:00100000:3.0:1784189344.805728:0:68287:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1556 00000020:00080000:3.0:1784189344.805732:0:68287:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1784189344.805744:0:68287:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1557 00000100:00100000:3.0:1784189344.805751:0:68287:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc07ab9a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:debedd94-805c-42a0-a5e5-41758b2012e9+112:73680:x1870854436372608:12345-192.168.203.12@tcp:101:dd.0 00010000:00010000:3.0:1784189344.805759:0:68287:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784189344.805767:0:68287:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0755a5000/0xcc1762b626f8d3a4 lrc: 2/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbfc5de7fe6c4388 expref: -99 pid: 68287 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189344.805856:0:68287:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0755a4e00/0xcc1762b626f8d3ab lrc: 3/1,0 mode: --/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189344.805866:0:68287:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0755a4e00/0xcc1762b626f8d3ab lrc: 3/1,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189344.805873:0:68287:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0755a4e00/0xcc1762b626f8d3ab lrc: 3/1,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189344.805896:0:68287:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0755a5a00/0xcc1762b626f8d3b2 lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0x4:0x0].0xd57f5ca3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189344.805903:0:68287:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0755a5a00/0xcc1762b626f8d3b2 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0xd57f5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189344.805911:0:68287:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0755a5a00/0xcc1762b626f8d3b2 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0xd57f5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189344.806204:0:68287:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0755a4a00/0xcc1762b626f8d3b9 lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0x13:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189344.806214:0:68287:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0755a4a00/0xcc1762b626f8d3b9 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x13:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189344.806222:0:68287:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0755a4a00/0xcc1762b626f8d3b9 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x13:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784189344.806230:0:68287:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000cf21:0x13:0x0]: returning size 0 00010000:00010000:3.0:1784189344.806272:0:68287:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0755a4e00/0xcc1762b626f8d3ab lrc: 4/1,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189344.806279:0:68287:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0755a4e00/0xcc1762b626f8d3ab lrc: 4/1,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189344.806286:0:68287:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0755a4e00/0xcc1762b626f8d3ab lrc: 3/0,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189344.806293:0:68287:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0755a4e00/0xcc1762b626f8d3ab lrc: 4/0,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189344.806298:0:68287:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc0755a4e00 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:3.0:1784189344.806308:0:68287:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0755a4e00/0xcc1762b626f8d3ab lrc: 4/0,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189344.806315:0:68287:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0755a4e00/0xcc1762b626f8d3ab lrc: 5/0,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189344.806355:0:68287:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x0 (ffff9dbf45994c00) 00010000:00010000:3.0:1784189344.806358:0:68287:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784189344.806362:0:68287:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0755a4e00/0xcc1762b626f8d3ab lrc: 3/0,0 mode: --/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189344.806369:0:68287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0755a4e00/0xcc1762b626f8d3ab lrc: 0/0,0 mode: --/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189344.806380:0:68287:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0755a5a00/0xcc1762b626f8d3b2 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0xd57f5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189344.806385:0:68287:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0755a5a00/0xcc1762b626f8d3b2 lrc: 2/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0xd57f5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189344.806392:0:68287:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0755a5a00/0xcc1762b626f8d3b2 lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0xd57f5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189344.806397:0:68287:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc0755a5a00 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:3.0:1784189344.806399:0:68287:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0755a5a00/0xcc1762b626f8d3b2 lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0xd57f5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189344.806405:0:68287:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0755a5a00/0xcc1762b626f8d3b2 lrc: 4/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0xd57f5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189344.806411:0:68287:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0xd57f5ca3 (ffff9dc081250f00) 00010000:00010000:3.0:1784189344.806413:0:68287:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784189344.806420:0:68287:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0755a5a00/0xcc1762b626f8d3b2 lrc: 2/0,0 mode: --/PR res: [0x20000cf21:0x4:0x0].0xd57f5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189344.806426:0:68287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0755a5a00/0xcc1762b626f8d3b2 lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0x4:0x0].0xd57f5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189344.806455:0:68287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0755a5000/0xcc1762b626f8d3a4 lrc: 0/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c4388 expref: 115 pid: 68287 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189344.806467:0:68287:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0755a4a00/0xcc1762b626f8d3b9 lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x13:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c4388 expref: 114 pid: 68287 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189344.806474:0:68287:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x13:0x0].0x0 (ffff9dc07499be00) 00010000:00010000:3.0:1784189344.806678:0:68287:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1784189344.806681:0:68287:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc0755a4a00, rc 0) 00000100:00100000:3.0:1784189344.806716:0:68287:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc07ab9a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:debedd94-805c-42a0-a5e5-41758b2012e9+114:73680:x1870854436372608:12345-192.168.203.12@tcp:101:dd.0 Request processed in 965us (2082us total) trans 120259084410 rc 0/0 00000100:00100000:3.0:1784189344.806723:0:68287:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1557 00000100:00100000:2.0:1784189344.813735:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1784189344.813836:0:66170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436372864 00000100:00100000:0.0:1784189344.813846:0:66170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436372864 00000100:00100000:0.0:1784189344.813901:0:66170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1558 00000100:00100000:0.0:1784189344.813911:0:66170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc05ed7aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:debedd94-805c-42a0-a5e5-41758b2012e9+114:73679:x1870854436372864:12345-192.168.203.12@tcp:36:dd.0 00010000:00010000:0.0:1784189344.813970:0:66170:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784189344.813996:0:66170:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc070146000/0xcc1762b626f8d37a lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0x12:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c4373 expref: 114 pid: 66171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189344.814030:0:66170:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x12:0x0].0x0 (ffff9dc07fab4400) 00010000:00010000:0.0:1784189344.814034:0:66170:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1784189344.814202:0:66170:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc070147000/0xcc1762b626f8d3c7 lrc: 3/0,1 mode: --/PW res: [0x20000cf21:0x12:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189344.814215:0:66170:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc070147000/0xcc1762b626f8d3c7 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x12:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189344.814224:0:66170:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc070147000/0xcc1762b626f8d3c7 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x12:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1784189344.814267:0:66170:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 120259084411 00000004:00010000:0.0:1784189344.814290:0:66170:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000baa44602 reply state 00000000243a372b transno 120259084412 ns: mdt-lustre-MDT0000_UUID lock: ffff9dc070147000/0xcc1762b626f8d3c7 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x12:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189344.814302:0:66170:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc070147000/0xcc1762b626f8d3c7 lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x12:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189344.814307:0:66170:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x12:0x0].0x0 (ffff9dc07fab4400) 00010000:00010000:0.0:1784189344.814309:0:66170:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1784189344.814312:0:66170:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1784189344.814600:0:66170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc05ed7aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:debedd94-805c-42a0-a5e5-41758b2012e9+116:73679:x1870854436372864:12345-192.168.203.12@tcp:36:dd.0 Request processed in 690us (874us total) trans 120259084412 rc 0/0 00000100:00100000:0.0:1784189344.814608:0:66170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1558 00000020:00080000:0.0:1784189344.814613:0:66170:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1784189344.818428:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1784189344.818650:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436372992 00000100:00100000:1.0:1784189344.818659:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436372992 00002000:00010000:1.0:1784189344.818697:0:8433:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/1899 (0->18446744073709551615) 00002000:00100000:1.0:1784189344.818702:0:8433:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9dc04a64f800 with x1870854436372992 ext(0->18446744073709551615) 00002000:00010000:1.0:1784189344.818714:0:8433:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9dc04a64f800. 00000100:00100000:1.0:1784189344.818749:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1019 00000100:00100000:1.0:1784189344.818759:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc04a64f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:debedd94-805c-42a0-a5e5-41758b2012e9+28:2397:x1870854436372992:12345-192.168.203.12@tcp:10:dd.0 00002000:00010000:1.0:1784189344.818905:0:8433:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x76b:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1784189344.818909:0:8433:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x76b:0x0] updating lvb mtime from disk: 1784189334 -> 1784189344 00002000:00010000:1.0:1784189344.818911:0:8433:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x76b:0x0] updating lvb atime from disk: 1784189334 -> 1784189334 00002000:00010000:1.0:1784189344.818914:0:8433:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x76b:0x0] updating lvb ctime from disk: 1784189334 -> 1784189344 00002000:00010000:1.0:1784189344.818916:0:8433:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x76b:0x0] updating lvb blocks from disk: 0 -> 0 00010000:00000080:1.0:1784189344.818924:0:8433:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9dc04a64f800 x1870854436372992/t4294968989(0) o10->debedd94-805c-42a0-a5e5-41758b2012e9@192.168.203.12@tcp:535/0 lens 440/432 e 0 to 0 dl 1784189355 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1784189344.818993:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc04a64f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:debedd94-805c-42a0-a5e5-41758b2012e9+29:2397:x1870854436372992:12345-192.168.203.12@tcp:10:dd.0 Request processed in 235us (574us total) trans 4294968989 rc 0/0 00000100:00100000:1.0:1784189344.819001:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1019 00002000:00010000:1.0:1784189344.819005:0:8433:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/1899 (0->18446744073709551615) 00002000:00100000:1.0:1784189344.819007:0:8433:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9dc04a64f800 with x1870854436372992 ext(0->18446744073709551615) 00002000:00010000:1.0:1784189344.819012:0:8433:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9dc04a64f800. 00000100:00100000:3.0:1784189344.819214:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1784189344.819262:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1784189344.819282:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1784189344.819486:0:66169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436373376 00000100:00100000:2.0:1784189344.819491:0:66169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436373376 00000100:00100000:2.0:1784189344.819526:0:66169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436373504 00000100:00100000:2.0:1784189344.819529:0:66169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436373504 00000100:00100000:2.0:1784189344.819545:0:66169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1559 00000100:00100000:2.0:1784189344.819551:0:66169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc04a64d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:debedd94-805c-42a0-a5e5-41758b2012e9+117:73681:x1870854436373376:12345-192.168.203.12@tcp:101:dd.0 00010000:00010000:2.0:1784189344.819567:0:66169:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784189344.819583:0:66169:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04a20b400/0xcc1762b626f8d3ce lrc: 2/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbfc5de7fe6c4396 expref: -99 pid: 66169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189344.819686:0:66169:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04a20b000/0xcc1762b626f8d3d5 lrc: 3/1,0 mode: --/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189344.819699:0:66169:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04a20b000/0xcc1762b626f8d3d5 lrc: 3/1,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189344.819709:0:66169:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04a20b000/0xcc1762b626f8d3d5 lrc: 3/1,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189344.819724:0:66169:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04a20bc00/0xcc1762b626f8d3dc lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0x4:0x0].0x2f385ca3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189344.819730:0:66169:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04a20bc00/0xcc1762b626f8d3dc lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x2f385ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189344.819746:0:66169:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04a20bc00/0xcc1762b626f8d3dc lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x2f385ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189344.819795:0:66169:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04a20b200/0xcc1762b626f8d3e3 lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0x14:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189344.819814:0:66169:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04a20b200/0xcc1762b626f8d3e3 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x14:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189344.819821:0:66169:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04a20b200/0xcc1762b626f8d3e3 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x14:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784189344.819831:0:66169:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000cf21:0x14:0x0]: returning size 0 00010000:00010000:2.0:1784189344.819891:0:66169:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04a20b000/0xcc1762b626f8d3d5 lrc: 4/1,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189344.819899:0:66169:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04a20b000/0xcc1762b626f8d3d5 lrc: 4/1,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189344.819905:0:66169:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04a20b000/0xcc1762b626f8d3d5 lrc: 3/0,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189344.819911:0:66169:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04a20b000/0xcc1762b626f8d3d5 lrc: 4/0,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189344.819917:0:66169:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc04a20b000 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:2.0:1784189344.819922:0:66169:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04a20b000/0xcc1762b626f8d3d5 lrc: 4/0,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189344.819928:0:66169:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04a20b000/0xcc1762b626f8d3d5 lrc: 5/0,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189344.819948:0:66169:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x0 (ffff9dbf45994c00) 00010000:00010000:2.0:1784189344.819951:0:66169:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784189344.819956:0:66169:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04a20b000/0xcc1762b626f8d3d5 lrc: 3/0,0 mode: --/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189344.819963:0:66169:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04a20b000/0xcc1762b626f8d3d5 lrc: 0/0,0 mode: --/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189344.819976:0:66169:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04a20bc00/0xcc1762b626f8d3dc lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x2f385ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189344.819982:0:66169:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04a20bc00/0xcc1762b626f8d3dc lrc: 2/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x2f385ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189344.819988:0:66169:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04a20bc00/0xcc1762b626f8d3dc lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x2f385ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189344.819993:0:66169:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc04a20bc00 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:2.0:1784189344.819996:0:66169:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04a20bc00/0xcc1762b626f8d3dc lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x2f385ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189344.820002:0:66169:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04a20bc00/0xcc1762b626f8d3dc lrc: 4/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x2f385ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189344.820008:0:66169:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x2f385ca3 (ffff9dc051574300) 00010000:00010000:2.0:1784189344.820011:0:66169:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784189344.820014:0:66169:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04a20bc00/0xcc1762b626f8d3dc lrc: 2/0,0 mode: --/PR res: [0x20000cf21:0x4:0x0].0x2f385ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189344.820019:0:66169:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04a20bc00/0xcc1762b626f8d3dc lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0x4:0x0].0x2f385ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189344.820067:0:66169:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04a20b400/0xcc1762b626f8d3ce lrc: 0/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c4396 expref: 120 pid: 66169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189344.820081:0:66169:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04a20b200/0xcc1762b626f8d3e3 lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x14:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c4396 expref: 119 pid: 66169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189344.820089:0:66169:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x14:0x0].0x0 (ffff9dc07499b800) 00010000:00010000:2.0:1784189344.820091:0:66169:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784189344.820093:0:66169:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc04a20b200, rc 0) 00000100:00100000:2.0:1784189344.820128:0:66169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc04a64d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:debedd94-805c-42a0-a5e5-41758b2012e9+119:73681:x1870854436373376:12345-192.168.203.12@tcp:101:dd.0 Request processed in 577us (865us total) trans 120259084413 rc 0/0 00000100:00100000:2.0:1784189344.820135:0:66169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1559 00000100:00100000:2.0:1784189344.820151:0:66169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1560 00000100:00100000:2.0:1784189344.820169:0:66169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc07faa9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:debedd94-805c-42a0-a5e5-41758b2012e9+118:73680:x1870854436373504:12345-192.168.203.12@tcp:101:dd.0 00010000:00010000:2.0:1784189344.820178:0:66169:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784189344.820185:0:66169:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04a20b800/0xcc1762b626f8d3f1 lrc: 2/0,0 mode: --/PR res: [0x20000cf21:0x13:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbfc5de7fe6c439d expref: -99 pid: 66169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189344.820203:0:66169:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc080f05a00/0xcc1762b626f8d3f8 lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0x13:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189344.820211:0:66169:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc080f05a00/0xcc1762b626f8d3f8 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x13:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189344.820218:0:66169:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc080f05a00/0xcc1762b626f8d3f8 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x13:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189344.820289:0:66169:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04a20b800/0xcc1762b626f8d3f1 lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0x13:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c439d expref: 120 pid: 66169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189344.820302:0:66169:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc080f05a00/0xcc1762b626f8d3f8 lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x13:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c439d expref: 119 pid: 66169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189344.820309:0:66169:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x13:0x0].0x0 (ffff9dc07499be00) 00010000:00010000:2.0:1784189344.820311:0:66169:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1784189344.820313:0:66169:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc080f05a00, rc 0) 00000100:00100000:2.0:1784189344.820382:0:66169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc07faa9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:debedd94-805c-42a0-a5e5-41758b2012e9+119:73680:x1870854436373504:12345-192.168.203.12@tcp:101:dd.0 Request processed in 224us (1098us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189344.820389:0:66169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1560 00000100:00100000:1.0:1784189344.820728:0:26169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436373120 00000100:00100000:1.0:1784189344.820734:0:26169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436373120 00000100:00100000:1.0:1784189344.820829:0:26169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 5033 00000100:00100000:1.0:1784189344.820837:0:26169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc04a64ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:debedd94-805c-42a0-a5e5-41758b2012e9+29:73678:x1870854436373120:12345-192.168.203.12@tcp:101:dd.0 00010000:00010000:1.0:1784189344.820844:0:26169:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784189344.820857:0:26169:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d369237c/0xcc1762b626f8d3ff lrc: 2/0,0 mode: --/PW res: [0x280000401:0x76d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xcbfc5de7fe6c438f expref: -99 pid: 26169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1784189344.820876:0:26169:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x76d:0x0] initial LVB size: 0, mtime: 0x6a589196, atime: 0x6a589196, ctime: 0x6a589196, blocks: 0x0 00010000:00010000:1.0:1784189344.820889:0:26169:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x76d:0x0].0x0 since=3587s v=(0 0) 00010000:00010000:1.0:1784189344.820894:0:26169:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x76d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784189344.820901:0:26169:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d369237c/0xcc1762b626f8d3ff lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x76d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c438f expref: 30 pid: 26169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189344.820913:0:26169:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000d369237c/0xcc1762b626f8d3ff lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x76d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c438f expref: 30 pid: 26169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189344.820921:0:26169:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dbf4710f600, rc 0) 00010000:00000080:1.0:1784189344.820926:0:26169:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9dc04a64ed80 x1870854436373120/t0(0) o101->debedd94-805c-42a0-a5e5-41758b2012e9@192.168.203.12@tcp:535/0 lens 328/400 e 0 to 0 dl 1784189355 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1784189344.820964:0:26169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc04a64ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:debedd94-805c-42a0-a5e5-41758b2012e9+30:73678:x1870854436373120:12345-192.168.203.12@tcp:101:dd.0 Request processed in 128us (1751us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189344.820970:0:26169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 5033 00000100:00100000:0.0:1784189344.824625:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1784189344.824655:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1784189344.824729:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436373632 00000100:00100000:1.0:1784189344.824738:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436373632 00000100:00100000:1.0:1784189344.824789:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 5034 00000100:00100000:1.0:1784189344.824807:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc07ab99f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:debedd94-805c-42a0-a5e5-41758b2012e9+30:73679:x1870854436373632:12345-192.168.203.12@tcp:101:dd.0 00010000:00010000:1.0:1784189344.824825:0:8428:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784189344.824844:0:8428:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000819a0594/0xcc1762b626f8d406 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x76e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xcbfc5de7fe6c43a4 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1784189344.824867:0:8428:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x76e:0x0] initial LVB size: 0, mtime: 0x6a589196, atime: 0x6a589196, ctime: 0x6a589196, blocks: 0x0 00010000:00010000:1.0:1784189344.824888:0:8428:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x76e:0x0].0x0 since=3587s v=(0 0) 00010000:00010000:1.0:1784189344.824893:0:8428:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x76e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784189344.824901:0:8428:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000819a0594/0xcc1762b626f8d406 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x76e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c43a4 expref: 31 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189344.824915:0:8428:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000819a0594/0xcc1762b626f8d406 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x76e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c43a4 expref: 31 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189344.824938:0:8428:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dbf4710f200, rc 0) 00010000:00000080:1.0:1784189344.824945:0:8428:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9dc07ab99f80 x1870854436373632/t0(0) o101->debedd94-805c-42a0-a5e5-41758b2012e9@192.168.203.12@tcp:535/0 lens 328/400 e 0 to 0 dl 1784189355 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1784189344.825008:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc07ab99f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:debedd94-805c-42a0-a5e5-41758b2012e9+31:73679:x1870854436373632:12345-192.168.203.12@tcp:101:dd.0 Request processed in 211us (393us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189344.825030:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 5034 00000100:00100000:2.0:1784189344.825093:0:66171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436373888 00000100:00100000:2.0:1784189344.825098:0:66171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436373888 00000100:00100000:2.0:1784189344.825146:0:66171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1561 00000100:00100000:2.0:1784189344.825154:0:66171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc07ab98000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:debedd94-805c-42a0-a5e5-41758b2012e9+119:73680:x1870854436373888:12345-192.168.203.12@tcp:36:dd.0 00010000:00010000:2.0:1784189344.825205:0:66171:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784189344.825226:0:66171:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0755a4a00/0xcc1762b626f8d3b9 lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0x13:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c4388 expref: 119 pid: 68287 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189344.825244:0:66171:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x13:0x0].0x0 (ffff9dc07499be00) 00010000:00010000:2.0:1784189344.825248:0:66171:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1784189344.826347:0:66171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc080f04200/0xcc1762b626f8d40d lrc: 3/0,1 mode: --/PW res: [0x20000cf21:0x13:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189344.826365:0:66171:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc080f04200/0xcc1762b626f8d40d lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189344.826383:0:66171:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc080f04200/0xcc1762b626f8d40d lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1784189344.826430:0:66171:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 120259084414 00000004:00010000:2.0:1784189344.826450:0:66171:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000002a162df4 reply state 000000004c123002 transno 120259084415 ns: mdt-lustre-MDT0000_UUID lock: ffff9dc080f04200/0xcc1762b626f8d40d lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189344.826462:0:66171:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc080f04200/0xcc1762b626f8d40d lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189344.826468:0:66171:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x13:0x0].0x0 (ffff9dc07499be00) 00010000:00010000:2.0:1784189344.826471:0:66171:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1784189344.826473:0:66171:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1784189344.827681:0:66171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc07ab98000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:debedd94-805c-42a0-a5e5-41758b2012e9+121:73680:x1870854436373888:12345-192.168.203.12@tcp:36:dd.0 Request processed in 2522us (3018us total) trans 120259084415 rc 0/0 00000100:00100000:2.0:1784189344.827690:0:66171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1561 00000020:00080000:2.0:1784189344.827696:0:66171:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1784189344.831436:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1784189344.831484:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1784189344.831526:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1784189344.831651:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436374016 00000100:00100000:2.0:1784189344.831661:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436374016 00002000:00010000:2.0:1784189344.831697:0:8435:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/1901 (0->18446744073709551615) 00002000:00100000:2.0:1784189344.831702:0:8435:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9dbf44c89c00 with x1870854436374016 ext(0->18446744073709551615) 00002000:00010000:2.0:1784189344.831713:0:8435:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9dbf44c89c00. 00000100:00100000:2.0:1784189344.831744:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436374144 00000100:00100000:2.0:1784189344.831748:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436374144 00002000:00010000:2.0:1784189344.831759:0:8435:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/1902 (0->18446744073709551615) 00002000:00100000:2.0:1784189344.831763:0:8435:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9dbf43f58e00 with x1870854436374144 ext(0->18446744073709551615) 00002000:00010000:2.0:1784189344.831768:0:8435:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9dbf43f58e00. 00000100:00100000:2.0:1784189344.831784:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1020 00000100:00100000:2.0:1784189344.831793:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf44c89c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:debedd94-805c-42a0-a5e5-41758b2012e9+32:2396:x1870854436374016:12345-192.168.203.12@tcp:10:dd.0 00002000:00010000:2.0:1784189344.831944:0:8435:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x76d:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1784189344.831947:0:8435:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x76d:0x0] updating lvb mtime from disk: 1784189334 -> 1784189344 00002000:00010000:2.0:1784189344.831950:0:8435:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x76d:0x0] updating lvb atime from disk: 1784189334 -> 1784189334 00002000:00010000:2.0:1784189344.831952:0:8435:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x76d:0x0] updating lvb ctime from disk: 1784189334 -> 1784189344 00002000:00010000:2.0:1784189344.831954:0:8435:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x76d:0x0] updating lvb blocks from disk: 0 -> 0 00010000:00000080:2.0:1784189344.831964:0:8435:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9dbf44c89c00 x1870854436374016/t4294968990(0) o10->debedd94-805c-42a0-a5e5-41758b2012e9@192.168.203.12@tcp:535/0 lens 440/432 e 0 to 0 dl 1784189355 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1784189344.832016:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf44c89c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:debedd94-805c-42a0-a5e5-41758b2012e9+33:2396:x1870854436374016:12345-192.168.203.12@tcp:10:dd.0 Request processed in 224us (540us total) trans 4294968990 rc 0/0 00000100:00100000:2.0:1784189344.832023:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1020 00002000:00010000:2.0:1784189344.832027:0:8435:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/1901 (0->18446744073709551615) 00002000:00100000:2.0:1784189344.832031:0:8435:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9dbf44c89c00 with x1870854436374016 ext(0->18446744073709551615) 00002000:00010000:2.0:1784189344.832036:0:8435:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9dbf44c89c00. 00000100:00100000:2.0:1784189344.832051:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1021 00000100:00100000:2.0:1784189344.832057:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf43f58e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:debedd94-805c-42a0-a5e5-41758b2012e9+32:2396:x1870854436374144:12345-192.168.203.12@tcp:10:dd.0 00002000:00010000:2.0:1784189344.832107:0:8435:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x76e:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1784189344.832110:0:8435:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x76e:0x0] updating lvb mtime from disk: 1784189334 -> 1784189344 00002000:00010000:2.0:1784189344.832112:0:8435:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x76e:0x0] updating lvb atime from disk: 1784189334 -> 1784189334 00002000:00010000:2.0:1784189344.832114:0:8435:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x76e:0x0] updating lvb ctime from disk: 1784189334 -> 1784189344 00002000:00010000:2.0:1784189344.832116:0:8435:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x76e:0x0] updating lvb blocks from disk: 0 -> 0 00010000:00000080:2.0:1784189344.832121:0:8435:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9dbf43f58e00 x1870854436374144/t4294968991(0) o10->debedd94-805c-42a0-a5e5-41758b2012e9@192.168.203.12@tcp:535/0 lens 440/432 e 0 to 0 dl 1784189355 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1784189344.832142:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf43f58e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:debedd94-805c-42a0-a5e5-41758b2012e9+33:2396:x1870854436374144:12345-192.168.203.12@tcp:10:dd.0 Request processed in 86us (616us total) trans 4294968991 rc 0/0 00000100:00100000:2.0:1784189344.832157:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1021 00002000:00010000:2.0:1784189344.832159:0:8435:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/1902 (0->18446744073709551615) 00002000:00100000:2.0:1784189344.832162:0:8435:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9dbf43f58e00 with x1870854436374144 ext(0->18446744073709551615) 00002000:00010000:2.0:1784189344.832166:0:8435:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9dbf43f58e00. 00000100:00100000:3.0:1784189344.832626:0:26160:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436374272 00000100:00100000:3.0:1784189344.832632:0:26160:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436374272 00000100:00100000:3.0:1784189344.832667:0:26160:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 5035 00000100:00100000:3.0:1784189344.832675:0:26160:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc07ab9b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:debedd94-805c-42a0-a5e5-41758b2012e9+33:73680:x1870854436374272:12345-192.168.203.12@tcp:101:dd.0 00010000:00010000:3.0:1784189344.832686:0:26160:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784189344.832704:0:26160:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c9d589c0/0xcc1762b626f8d414 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x76f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xcbfc5de7fe6c43ab expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1784189344.832733:0:26160:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x76f:0x0] initial LVB size: 0, mtime: 0x6a589196, atime: 0x6a589196, ctime: 0x6a589196, blocks: 0x0 00010000:00010000:3.0:1784189344.832751:0:26160:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x76f:0x0].0x0 since=3587s v=(0 0) 00010000:00010000:3.0:1784189344.832755:0:26160:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x76f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784189344.832763:0:26160:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c9d589c0/0xcc1762b626f8d414 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x76f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c43ab expref: 34 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189344.832779:0:26160:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000c9d589c0/0xcc1762b626f8d414 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x76f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c43ab expref: 34 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189344.832789:0:26160:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc0755a4c00, rc 0) 00010000:00000080:3.0:1784189344.832795:0:26160:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9dc07ab9b800 x1870854436374272/t0(0) o101->debedd94-805c-42a0-a5e5-41758b2012e9@192.168.203.12@tcp:535/0 lens 328/400 e 0 to 0 dl 1784189355 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1784189344.832832:0:26160:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc07ab9b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:debedd94-805c-42a0-a5e5-41758b2012e9+34:73680:x1870854436374272:12345-192.168.203.12@tcp:101:dd.0 Request processed in 158us (1405us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189344.832839:0:26160:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 5035 00000100:00100000:2.0:1784189344.836762:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1784189344.836858:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1784189344.836929:0:66945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436374912 00000100:00100000:1.0:1784189344.836938:0:66945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436374912 00000100:00100000:1.0:1784189344.836997:0:66945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1562 00000100:00100000:1.0:1784189344.837006:0:66945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc05ed7ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:debedd94-805c-42a0-a5e5-41758b2012e9+121:73682:x1870854436374912:12345-192.168.203.12@tcp:101:dd.0 00010000:00010000:1.0:1784189344.837030:0:66945:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784189344.837052:0:66945:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc07116f800/0xcc1762b626f8d41b lrc: 2/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbfc5de7fe6c43b9 expref: -99 pid: 66945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189344.837180:0:66945:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc081b17800/0xcc1762b626f8d422 lrc: 3/1,0 mode: --/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189344.837195:0:66945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc081b17800/0xcc1762b626f8d422 lrc: 3/1,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189344.837207:0:66945:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc081b17800/0xcc1762b626f8d422 lrc: 3/1,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189344.837220:0:66945:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc081b17a00/0xcc1762b626f8d429 lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0x4:0x0].0x88f15ca3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189344.837226:0:66945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc081b17a00/0xcc1762b626f8d429 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x88f15ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189344.837233:0:66945:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc081b17a00/0xcc1762b626f8d429 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x88f15ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189344.837287:0:66945:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc081b16e00/0xcc1762b626f8d430 lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0x15:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189344.837313:0:66945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc081b16e00/0xcc1762b626f8d430 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x15:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189344.837344:0:66945:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc081b16e00/0xcc1762b626f8d430 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x15:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784189344.837355:0:66945:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000cf21:0x15:0x0]: returning size 0 00010000:00010000:1.0:1784189344.837434:0:66945:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc081b17800/0xcc1762b626f8d422 lrc: 4/1,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189344.837441:0:66945:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc081b17800/0xcc1762b626f8d422 lrc: 4/1,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189344.837447:0:66945:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc081b17800/0xcc1762b626f8d422 lrc: 3/0,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189344.837453:0:66945:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dc081b17800/0xcc1762b626f8d422 lrc: 4/0,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189344.837459:0:66945:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc081b17800 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:1.0:1784189344.837463:0:66945:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc081b17800/0xcc1762b626f8d422 lrc: 4/0,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189344.837470:0:66945:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc081b17800/0xcc1762b626f8d422 lrc: 5/0,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189344.837603:0:66945:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x0 (ffff9dbf45994c00) 00010000:00010000:1.0:1784189344.837607:0:66945:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784189344.837611:0:66945:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dc081b17800/0xcc1762b626f8d422 lrc: 3/0,0 mode: --/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189344.837618:0:66945:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc081b17800/0xcc1762b626f8d422 lrc: 0/0,0 mode: --/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189344.837638:0:66945:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc081b17a00/0xcc1762b626f8d429 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x88f15ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189344.837644:0:66945:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc081b17a00/0xcc1762b626f8d429 lrc: 2/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x88f15ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189344.837650:0:66945:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dc081b17a00/0xcc1762b626f8d429 lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x88f15ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189344.837655:0:66945:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc081b17a00 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:1.0:1784189344.837658:0:66945:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc081b17a00/0xcc1762b626f8d429 lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x88f15ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189344.837664:0:66945:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc081b17a00/0xcc1762b626f8d429 lrc: 4/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x88f15ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189344.837672:0:66945:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x88f15ca3 (ffff9dc07499bd00) 00010000:00010000:1.0:1784189344.837675:0:66945:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784189344.837677:0:66945:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dc081b17a00/0xcc1762b626f8d429 lrc: 2/0,0 mode: --/PR res: [0x20000cf21:0x4:0x0].0x88f15ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189344.837683:0:66945:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc081b17a00/0xcc1762b626f8d429 lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0x4:0x0].0x88f15ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189344.837725:0:66945:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc07116f800/0xcc1762b626f8d41b lrc: 0/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c43b9 expref: 124 pid: 66945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189344.837738:0:66945:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc081b16e00/0xcc1762b626f8d430 lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x15:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c43b9 expref: 123 pid: 66945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189344.837757:0:66945:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x15:0x0].0x0 (ffff9dc07fab4000) 00010000:00010000:1.0:1784189344.837759:0:66945:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1784189344.837762:0:66945:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc081b16e00, rc 0) 00000100:00100000:1.0:1784189344.837830:0:66945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc05ed7ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:debedd94-805c-42a0-a5e5-41758b2012e9+123:73682:x1870854436374912:12345-192.168.203.12@tcp:101:dd.0 Request processed in 824us (970us total) trans 120259084416 rc 0/0 00000100:00100000:1.0:1784189344.837838:0:66945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1562 00000100:00100000:0.0:1784189344.837932:0:66173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436374528 00000100:00100000:0.0:1784189344.837938:0:66173:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436374528 00000100:00100000:0.0:1784189344.837979:0:66173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 276 00000100:00100000:0.0:1784189344.837987:0:66173:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc05ed78a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:debedd94-805c-42a0-a5e5-41758b2012e9+123:73676:x1870854436374528:12345-192.168.203.12@tcp:35:dd.0 00000100:00100000:0.0:1784189344.838172:0:66173:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc05ed78a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:debedd94-805c-42a0-a5e5-41758b2012e9+124:73676:x1870854436374528:12345-192.168.203.12@tcp:35:dd.0 Request processed in 185us (1417us total) trans 120259084417 rc 0/0 00000100:00100000:0.0:1784189344.838178:0:66173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 276 00000100:00100000:2.0:1784189344.844358:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1784189344.844390:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1784189344.844410:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1784189344.844432:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1784189344.844450:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1784189344.844474:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1784189344.844500:0:66171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436374656 00000100:00100000:2.0:1784189344.844507:0:66171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436374656 00000100:00100000:2.0:1784189344.844549:0:66171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436375424 00000100:00100000:2.0:1784189344.844551:0:66171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436375424 00000100:00100000:2.0:1784189344.844563:0:66171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436375680 00000100:00100000:2.0:1784189344.844565:0:66171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436375680 00000100:00100000:2.0:1784189344.844578:0:66171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1563 00000100:00100000:2.0:1784189344.844597:0:66171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc05ed79880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:debedd94-805c-42a0-a5e5-41758b2012e9+126:73681:x1870854436374656:12345-192.168.203.12@tcp:101:dd.0 00010000:00010000:2.0:1784189344.844616:0:66171:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784189344.844633:0:66171:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc080f05e00/0xcc1762b626f8d43e lrc: 2/0,0 mode: --/PR res: [0x20000cf21:0x14:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbfc5de7fe6c43b2 expref: -99 pid: 66171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189344.844664:0:66171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc080f04400/0xcc1762b626f8d445 lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0x14:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189344.844677:0:66171:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc080f04400/0xcc1762b626f8d445 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x14:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189344.844700:0:66171:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc080f04400/0xcc1762b626f8d445 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x14:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189344.844794:0:66171:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc080f05e00/0xcc1762b626f8d43e lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0x14:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c43b2 expref: 128 pid: 66171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189344.844823:0:66171:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc080f04400/0xcc1762b626f8d445 lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x14:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c43b2 expref: 127 pid: 66171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189344.844831:0:66171:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x14:0x0].0x0 (ffff9dc07499b800) 00010000:00010000:2.0:1784189344.844834:0:66171:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1784189344.844837:0:66171:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc080f04400, rc 0) 00000100:00100000:2.0:1784189344.844895:0:66171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc05ed79880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:debedd94-805c-42a0-a5e5-41758b2012e9+127:73681:x1870854436374656:12345-192.168.203.12@tcp:101:dd.0 Request processed in 298us (577us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189344.844902:0:66171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1563 00000100:00100000:2.0:1784189344.844920:0:66171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1564 00000100:00100000:2.0:1784189344.844926:0:66171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf46954a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:debedd94-805c-42a0-a5e5-41758b2012e9+126:73682:x1870854436375424:12345-192.168.203.12@tcp:101:dd.0 00010000:00010000:2.0:1784189344.844936:0:66171:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784189344.844943:0:66171:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc080f05800/0xcc1762b626f8d44c lrc: 2/0,0 mode: --/PR res: [0x20000cf21:0x15:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbfc5de7fe6c43c0 expref: -99 pid: 66171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189344.844958:0:66171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc080f04c00/0xcc1762b626f8d453 lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0x15:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189344.844966:0:66171:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc080f04c00/0xcc1762b626f8d453 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x15:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189344.844983:0:66171:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc080f04c00/0xcc1762b626f8d453 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x15:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189344.845039:0:66171:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc080f05800/0xcc1762b626f8d44c lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0x15:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c43c0 expref: 128 pid: 66171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189344.845051:0:66171:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc080f04c00/0xcc1762b626f8d453 lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x15:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c43c0 expref: 127 pid: 66171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189344.845058:0:66171:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x15:0x0].0x0 (ffff9dc07fab4000) 00010000:00010000:2.0:1784189344.845060:0:66171:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1784189344.845063:0:66171:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc080f04c00, rc 0) 00000100:00100000:2.0:1784189344.845081:0:66171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf46954a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:debedd94-805c-42a0-a5e5-41758b2012e9+127:73682:x1870854436375424:12345-192.168.203.12@tcp:101:dd.0 Request processed in 155us (648us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189344.845086:0:66171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1564 00000100:00100000:2.0:1784189344.845098:0:66171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1565 00000100:00100000:2.0:1784189344.845103:0:66171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf46957800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:debedd94-805c-42a0-a5e5-41758b2012e9+126:73683:x1870854436375680:12345-192.168.203.12@tcp:101:dd.0 00010000:00010000:2.0:1784189344.845110:0:66171:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784189344.845118:0:66171:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc080f04800/0xcc1762b626f8d45a lrc: 2/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbfc5de7fe6c43c7 expref: -99 pid: 66171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784189344.845190:0:24845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436375040 00000100:00100000:1.0:1784189344.845197:0:24845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436375040 00010000:00010000:2.0:1784189344.845206:0:66171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc080f05200/0xcc1762b626f8d461 lrc: 3/1,0 mode: --/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189344.845216:0:66171:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc080f05200/0xcc1762b626f8d461 lrc: 3/1,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1784189344.845221:0:24845:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/1903 (0->18446744073709551615) 00002000:00100000:1.0:1784189344.845227:0:24845:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9dbf46954e00 with x1870854436375040 ext(0->18446744073709551615) 00010000:00010000:2.0:1784189344.845240:0:66171:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc080f05200/0xcc1762b626f8d461 lrc: 3/1,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1784189344.845241:0:24845:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9dbf46954e00. 00010000:00010000:2.0:1784189344.845260:0:66171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc080f04e00/0xcc1762b626f8d468 lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0x4:0x0].0xe2aa5ca3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784189344.845267:0:24845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1022 00010000:00010000:2.0:1784189344.845268:0:66171:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc080f04e00/0xcc1762b626f8d468 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0xe2aa5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784189344.845276:0:24845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf46954e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:debedd94-805c-42a0-a5e5-41758b2012e9+34:2396:x1870854436375040:12345-192.168.203.12@tcp:10:dd.0 00010000:00010000:2.0:1784189344.845278:0:66171:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc080f04e00/0xcc1762b626f8d468 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0xe2aa5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189344.845348:0:66171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc080f05600/0xcc1762b626f8d46f lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0x16:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189344.845356:0:66171:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc080f05600/0xcc1762b626f8d46f lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x16:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189344.845362:0:66171:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc080f05600/0xcc1762b626f8d46f lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x16:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784189344.845371:0:66171:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000cf21:0x16:0x0]: returning size 0 00002000:00010000:1.0:1784189344.845420:0:24845:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x76f:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1784189344.845424:0:24845:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x76f:0x0] updating lvb mtime from disk: 1784189334 -> 1784189344 00002000:00010000:1.0:1784189344.845427:0:24845:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x76f:0x0] updating lvb atime from disk: 1784189334 -> 1784189334 00002000:00010000:1.0:1784189344.845430:0:24845:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x76f:0x0] updating lvb ctime from disk: 1784189334 -> 1784189344 00002000:00010000:1.0:1784189344.845432:0:24845:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x76f:0x0] updating lvb blocks from disk: 0 -> 0 00010000:00010000:2.0:1784189344.845438:0:66171:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc080f05200/0xcc1762b626f8d461 lrc: 4/1,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00000080:1.0:1784189344.845440:0:24845:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9dbf46954e00 x1870854436375040/t4294968992(0) o10->debedd94-805c-42a0-a5e5-41758b2012e9@192.168.203.12@tcp:535/0 lens 440/432 e 0 to 0 dl 1784189355 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00010000:00010000:2.0:1784189344.845456:0:66171:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc080f05200/0xcc1762b626f8d461 lrc: 4/1,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189344.845464:0:66171:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc080f05200/0xcc1762b626f8d461 lrc: 3/0,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189344.845471:0:66171:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dc080f05200/0xcc1762b626f8d461 lrc: 4/0,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189344.845484:0:66171:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc080f05200 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:2.0:1784189344.845488:0:66171:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc080f05200/0xcc1762b626f8d461 lrc: 4/0,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189344.845494:0:66171:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc080f05200/0xcc1762b626f8d461 lrc: 5/0,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784189344.845499:0:24845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf46954e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:debedd94-805c-42a0-a5e5-41758b2012e9+35:2396:x1870854436375040:12345-192.168.203.12@tcp:10:dd.0 Request processed in 223us (1085us total) trans 4294968992 rc 0/0 00000100:00100000:1.0:1784189344.845509:0:24845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1022 00010000:00010000:2.0:1784189344.845510:0:66171:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x0 (ffff9dbf45994c00) 00002000:00010000:1.0:1784189344.845513:0:24845:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/1903 (0->18446744073709551615) 00010000:00010000:2.0:1784189344.845515:0:66171:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784189344.845519:0:66171:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dc080f05200/0xcc1762b626f8d461 lrc: 3/0,0 mode: --/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00002000:00100000:1.0:1784189344.845525:0:24845:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9dbf46954e00 with x1870854436375040 ext(0->18446744073709551615) 00010000:00010000:2.0:1784189344.845531:0:66171:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc080f05200/0xcc1762b626f8d461 lrc: 0/0,0 mode: --/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1784189344.845533:0:24845:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9dbf46954e00. 00010000:00010000:2.0:1784189344.845548:0:66171:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc080f04e00/0xcc1762b626f8d468 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0xe2aa5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189344.845555:0:66171:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc080f04e00/0xcc1762b626f8d468 lrc: 2/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0xe2aa5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189344.845560:0:66171:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dc080f04e00/0xcc1762b626f8d468 lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0xe2aa5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784189344.845565:0:66172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436375296 00010000:00010000:2.0:1784189344.845566:0:66171:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc080f04e00 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:2.0:1784189344.845571:0:66171:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc080f04e00/0xcc1762b626f8d468 lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0xe2aa5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784189344.845571:0:66172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436375296 00010000:00010000:2.0:1784189344.845581:0:66171:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc080f04e00/0xcc1762b626f8d468 lrc: 4/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0xe2aa5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784189344.845591:0:66172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436375936 00000100:00100000:1.0:1784189344.845595:0:66172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436375936 00010000:00010000:2.0:1784189344.845607:0:66171:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0xe2aa5ca3 (ffff9dc051574300) 00010000:00010000:2.0:1784189344.845612:0:66171:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1784189344.845612:0:66172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 277 00010000:00010000:2.0:1784189344.845619:0:66171:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dc080f04e00/0xcc1762b626f8d468 lrc: 2/0,0 mode: --/PR res: [0x20000cf21:0x4:0x0].0xe2aa5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784189344.845623:0:66172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf46956300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:debedd94-805c-42a0-a5e5-41758b2012e9+130:73679:x1870854436375296:12345-192.168.203.12@tcp:35:dd.0 00010000:00010000:2.0:1784189344.845633:0:66171:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc080f04e00/0xcc1762b626f8d468 lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0x4:0x0].0xe2aa5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189344.845671:0:66171:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc080f04800/0xcc1762b626f8d45a lrc: 0/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c43c7 expref: 131 pid: 66171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189344.845683:0:66171:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc080f05600/0xcc1762b626f8d46f lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x16:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c43c7 expref: 130 pid: 66171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189344.845690:0:66171:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x16:0x0].0x0 (ffff9dbf44851900) 00010000:00010000:2.0:1784189344.845692:0:66171:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784189344.845695:0:66171:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc080f05600, rc 0) 00000100:00100000:2.0:1784189344.845719:0:66171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf46957800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:debedd94-805c-42a0-a5e5-41758b2012e9+131:73683:x1870854436375680:12345-192.168.203.12@tcp:101:dd.0 Request processed in 615us (1267us total) trans 120259084418 rc 0/0 00000100:00100000:2.0:1784189344.845726:0:66171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1565 00000100:00100000:1.0:1784189344.845784:0:66172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf46956300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:debedd94-805c-42a0-a5e5-41758b2012e9+130:73679:x1870854436375296:12345-192.168.203.12@tcp:35:dd.0 Request processed in 162us (1392us total) trans 120259084419 rc 0/0 00000100:00100000:1.0:1784189344.845792:0:66172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 277 00000100:00100000:1.0:1784189344.845818:0:66172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 278 00000100:00100000:1.0:1784189344.845826:0:66172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf46955500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:debedd94-805c-42a0-a5e5-41758b2012e9+129:73678:x1870854436375936:12345-192.168.203.12@tcp:35:dd.0 00000100:00100000:1.0:1784189344.845918:0:66172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf46955500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:debedd94-805c-42a0-a5e5-41758b2012e9+130:73678:x1870854436375936:12345-192.168.203.12@tcp:35:dd.0 Request processed in 92us (1442us total) trans 120259084420 rc 0/0 00000100:00100000:1.0:1784189344.845936:0:66172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 278 00000100:00100000:2.0:1784189344.857950:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1784189344.858112:0:66171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436376448 00000100:00100000:0.0:1784189344.858122:0:66171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436376448 00000100:00100000:0.0:1784189344.858185:0:66171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1566 00000100:00100000:0.0:1784189344.858194:0:66171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf46957480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:debedd94-805c-42a0-a5e5-41758b2012e9+130:73682:x1870854436376448:12345-192.168.203.12@tcp:36:dd.0 00010000:00010000:0.0:1784189344.858248:0:66171:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784189344.858275:0:66171:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc081b16e00/0xcc1762b626f8d430 lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0x15:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c43b9 expref: 130 pid: 66945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189344.858294:0:66171:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x15:0x0].0x0 (ffff9dc07fab4000) 00010000:00010000:0.0:1784189344.858298:0:66171:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1784189344.858545:0:66171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc070146000/0xcc1762b626f8d47d lrc: 3/0,1 mode: --/PW res: [0x20000cf21:0x15:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189344.858559:0:66171:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc070146000/0xcc1762b626f8d47d lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x15:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189344.858568:0:66171:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc070146000/0xcc1762b626f8d47d lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x15:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1784189344.858759:0:66171:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 120259084421 00000004:00010000:1.0:1784189344.858787:0:66171:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000ebc9ec8f reply state 00000000fb9b6a06 transno 120259084422 ns: mdt-lustre-MDT0000_UUID lock: ffff9dc070146000/0xcc1762b626f8d47d lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x15:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189344.858812:0:66171:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc070146000/0xcc1762b626f8d47d lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x15:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189344.858819:0:66171:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x15:0x0].0x0 (ffff9dc07fab4000) 00010000:00010000:1.0:1784189344.858822:0:66171:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1784189344.858825:0:66171:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1784189344.858935:0:66171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf46957480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:debedd94-805c-42a0-a5e5-41758b2012e9+132:73682:x1870854436376448:12345-192.168.203.12@tcp:36:dd.0 Request processed in 729us (979us total) trans 120259084422 rc 0/0 00000100:00100000:1.0:1784189344.858961:0:66171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1566 00000020:00080000:1.0:1784189344.858966:0:66171:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1784189344.863403:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1784189344.863465:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1784189344.863619:0:66173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436376704 00000100:00100000:0.0:1784189344.863640:0:66173:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436376704 00000100:00100000:0.0:1784189344.863702:0:66173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 279 00000100:00100000:0.0:1784189344.863712:0:66173:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc05eda9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:debedd94-805c-42a0-a5e5-41758b2012e9+132:73680:x1870854436376704:12345-192.168.203.12@tcp:35:dd.0 00000100:00100000:0.0:1784189344.864493:0:66173:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc05eda9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:debedd94-805c-42a0-a5e5-41758b2012e9+133:73680:x1870854436376704:12345-192.168.203.12@tcp:35:dd.0 Request processed in 779us (1097us total) trans 120259084423 rc 0/0 00000100:00100000:0.0:1784189344.864502:0:66173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 279 00000100:00100000:1.0:1784189344.864628:0:66169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436376192 00000100:00100000:1.0:1784189344.864635:0:66169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436376192 00000100:00100000:1.0:1784189344.864680:0:66169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1567 00000100:00100000:1.0:1784189344.864688:0:66169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc070220700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:debedd94-805c-42a0-a5e5-41758b2012e9+133:73681:x1870854436376192:12345-192.168.203.12@tcp:36:dd.0 00010000:00010000:1.0:1784189344.864719:0:66169:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784189344.864745:0:66169:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04a20b200/0xcc1762b626f8d3e3 lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0x14:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c4396 expref: 133 pid: 66169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189344.864763:0:66169:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x14:0x0].0x0 (ffff9dc07499b800) 00010000:00010000:1.0:1784189344.864767:0:66169:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1784189344.864874:0:66169:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc081b17a00/0xcc1762b626f8d484 lrc: 3/0,1 mode: --/PW res: [0x20000cf21:0x14:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189344.864888:0:66169:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc081b17a00/0xcc1762b626f8d484 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x14:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189344.864898:0:66169:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc081b17a00/0xcc1762b626f8d484 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x14:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1784189344.864945:0:66169:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 120259084424 00000004:00010000:1.0:1784189344.864969:0:66169:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000007c5b21d5 reply state 0000000073bcfb30 transno 120259084425 ns: mdt-lustre-MDT0000_UUID lock: ffff9dc081b17a00/0xcc1762b626f8d484 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x14:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189344.864981:0:66169:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc081b17a00/0xcc1762b626f8d484 lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x14:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189344.864988:0:66169:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x14:0x0].0x0 (ffff9dc07499b800) 00010000:00010000:1.0:1784189344.864999:0:66169:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1784189344.865003:0:66169:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1784189344.865065:0:66169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc070220700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:debedd94-805c-42a0-a5e5-41758b2012e9+135:73681:x1870854436376192:12345-192.168.203.12@tcp:36:dd.0 Request processed in 377us (1599us total) trans 120259084425 rc 0/0 00000100:00100000:1.0:1784189344.865072:0:66169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1567 00000020:00080000:1.0:1784189344.865075:0:66169:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1784189344.866502:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1784189344.866558:0:26223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436376832 00000100:00100000:0.0:1784189344.866566:0:26223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436376832 00000100:00100000:0.0:1784189344.866614:0:26223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 5036 00000100:00100000:0.0:1784189344.866624:0:26223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc070220000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:debedd94-805c-42a0-a5e5-41758b2012e9+35:73682:x1870854436376832:12345-192.168.203.12@tcp:101:dd.0 00010000:00010000:0.0:1784189344.866637:0:26223:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784189344.866656:0:26223:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006dde6b82/0xcc1762b626f8d48b lrc: 2/0,0 mode: --/PW res: [0x280000401:0x771:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xcbfc5de7fe6c43ce expref: -99 pid: 26223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1784189344.866680:0:26223:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x771:0x0] initial LVB size: 0, mtime: 0x6a589196, atime: 0x6a589196, ctime: 0x6a589196, blocks: 0x0 00010000:00010000:0.0:1784189344.866698:0:26223:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x771:0x0].0x0 since=3587s v=(0 0) 00010000:00010000:0.0:1784189344.866704:0:26223:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x771:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784189344.866712:0:26223:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006dde6b82/0xcc1762b626f8d48b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x771:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c43ce expref: 36 pid: 26223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189344.866728:0:26223:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000006dde6b82/0xcc1762b626f8d48b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x771:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c43ce expref: 36 pid: 26223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189344.866739:0:26223:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc070147200, rc 0) 00010000:00000080:0.0:1784189344.866746:0:26223:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9dc070220000 x1870854436376832/t0(0) o101->debedd94-805c-42a0-a5e5-41758b2012e9@192.168.203.12@tcp:535/0 lens 328/400 e 0 to 0 dl 1784189355 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1784189344.866826:0:26223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc070220000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:debedd94-805c-42a0-a5e5-41758b2012e9+36:73682:x1870854436376832:12345-192.168.203.12@tcp:101:dd.0 Request processed in 202us (328us total) trans 0 rc 0/0 00000100:00100000:0.0:1784189344.866833:0:26223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 5036 00000100:00100000:2.0:1784189344.870201:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1784189344.870360:0:68287:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436376960 00000100:00100000:3.0:1784189344.870368:0:68287:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436376960 00000100:00100000:3.0:1784189344.870423:0:68287:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1568 00000100:00100000:3.0:1784189344.870433:0:68287:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf46954700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:debedd94-805c-42a0-a5e5-41758b2012e9+135:73683:x1870854436376960:12345-192.168.203.12@tcp:101:dd.0 00010000:00010000:3.0:1784189344.870457:0:68287:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784189344.870489:0:68287:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0755a5a00/0xcc1762b626f8d492 lrc: 2/0,0 mode: --/PR res: [0x20000cf21:0x16:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbfc5de7fe6c43d5 expref: -99 pid: 68287 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189344.870541:0:68287:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0755a5000/0xcc1762b626f8d499 lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0x16:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189344.870555:0:68287:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0755a5000/0xcc1762b626f8d499 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x16:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189344.870569:0:68287:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0755a5000/0xcc1762b626f8d499 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x16:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189344.870676:0:68287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0755a5a00/0xcc1762b626f8d492 lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0x16:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c43d5 expref: 137 pid: 68287 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189344.870695:0:68287:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0755a5000/0xcc1762b626f8d499 lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x16:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c43d5 expref: 136 pid: 68287 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189344.870705:0:68287:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x16:0x0].0x0 (ffff9dbf44851900) 00010000:00010000:3.0:1784189344.870708:0:68287:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1784189344.870711:0:68287:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc0755a5000, rc 0) 00000100:00100000:3.0:1784189344.870770:0:68287:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf46954700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:debedd94-805c-42a0-a5e5-41758b2012e9+136:73683:x1870854436376960:12345-192.168.203.12@tcp:101:dd.0 Request processed in 338us (578us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189344.870777:0:68287:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1568 00000100:00100000:0.0:1784189344.871087:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1784189344.871463:0:66170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436377216 00000100:00100000:2.0:1784189344.871469:0:66170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436377216 00000100:00100000:2.0:1784189344.871514:0:66170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1569 00000100:00100000:2.0:1784189344.871521:0:66170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf43f58a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:debedd94-805c-42a0-a5e5-41758b2012e9+136:73684:x1870854436377216:12345-192.168.203.12@tcp:101:dd.0 00010000:00010000:2.0:1784189344.871532:0:66170:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784189344.871552:0:66170:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc080f05800/0xcc1762b626f8d4a0 lrc: 2/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbfc5de7fe6c43dc expref: -99 pid: 66170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189344.871669:0:66170:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc080f05e00/0xcc1762b626f8d4a7 lrc: 3/1,0 mode: --/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189344.871679:0:66170:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc080f05e00/0xcc1762b626f8d4a7 lrc: 3/1,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189344.871689:0:66170:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc080f05e00/0xcc1762b626f8d4a7 lrc: 3/1,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189344.871703:0:66170:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc080f05000/0xcc1762b626f8d4ae lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0x4:0x0].0x3c635ca3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189344.871710:0:66170:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc080f05000/0xcc1762b626f8d4ae lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x3c635ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189344.871716:0:66170:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc080f05000/0xcc1762b626f8d4ae lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x3c635ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189344.871762:0:66170:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc080f05c00/0xcc1762b626f8d4b5 lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0x17:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189344.871771:0:66170:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc080f05c00/0xcc1762b626f8d4b5 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x17:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189344.871778:0:66170:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc080f05c00/0xcc1762b626f8d4b5 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x17:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784189344.871788:0:66170:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000cf21:0x17:0x0]: returning size 0 00010000:00010000:2.0:1784189344.871871:0:66170:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc080f05e00/0xcc1762b626f8d4a7 lrc: 4/1,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189344.871890:0:66170:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc080f05e00/0xcc1762b626f8d4a7 lrc: 4/1,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189344.871896:0:66170:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc080f05e00/0xcc1762b626f8d4a7 lrc: 3/0,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189344.871904:0:66170:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dc080f05e00/0xcc1762b626f8d4a7 lrc: 4/0,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189344.871910:0:66170:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc080f05e00 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:2.0:1784189344.871915:0:66170:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc080f05e00/0xcc1762b626f8d4a7 lrc: 4/0,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189344.871937:0:66170:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc080f05e00/0xcc1762b626f8d4a7 lrc: 5/0,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189344.871947:0:66170:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x0 (ffff9dbf45994c00) 00010000:00010000:2.0:1784189344.871950:0:66170:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784189344.871954:0:66170:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dc080f05e00/0xcc1762b626f8d4a7 lrc: 3/0,0 mode: --/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189344.871961:0:66170:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc080f05e00/0xcc1762b626f8d4a7 lrc: 0/0,0 mode: --/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189344.871973:0:66170:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc080f05000/0xcc1762b626f8d4ae lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x3c635ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189344.871979:0:66170:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc080f05000/0xcc1762b626f8d4ae lrc: 2/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x3c635ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189344.871985:0:66170:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dc080f05000/0xcc1762b626f8d4ae lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x3c635ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189344.871997:0:66170:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc080f05000 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:2.0:1784189344.872000:0:66170:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc080f05000/0xcc1762b626f8d4ae lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x3c635ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189344.872006:0:66170:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc080f05000/0xcc1762b626f8d4ae lrc: 4/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x3c635ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189344.872015:0:66170:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x3c635ca3 (ffff9dc051574300) 00010000:00010000:2.0:1784189344.872017:0:66170:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784189344.872020:0:66170:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dc080f05000/0xcc1762b626f8d4ae lrc: 2/0,0 mode: --/PR res: [0x20000cf21:0x4:0x0].0x3c635ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189344.872026:0:66170:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc080f05000/0xcc1762b626f8d4ae lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0x4:0x0].0x3c635ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189344.872062:0:66170:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc080f05800/0xcc1762b626f8d4a0 lrc: 0/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c43dc expref: 139 pid: 66170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189344.872074:0:66170:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc080f05c00/0xcc1762b626f8d4b5 lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x17:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c43dc expref: 138 pid: 66170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189344.872081:0:66170:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x17:0x0].0x0 (ffff9dbf44851b00) 00010000:00010000:2.0:1784189344.872084:0:66170:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784189344.872086:0:66170:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc080f05c00, rc 0) 00000100:00100000:2.0:1784189344.872123:0:66170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf43f58a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:debedd94-805c-42a0-a5e5-41758b2012e9+138:73684:x1870854436377216:12345-192.168.203.12@tcp:101:dd.0 Request processed in 602us (1036us total) trans 120259084426 rc 0/0 00000100:00100000:2.0:1784189344.872129:0:66170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1569 00000100:00100000:0.0:1784189344.873876:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1784189344.873916:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1784189344.874070:0:25599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436377472 00000100:00100000:2.0:1784189344.874088:0:25599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436377472 00002000:00010000:2.0:1784189344.874121:0:25599:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/1905 (0->18446744073709551615) 00002000:00100000:2.0:1784189344.874126:0:25599:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9dc07016fb80 with x1870854436377472 ext(0->18446744073709551615) 00002000:00010000:2.0:1784189344.874137:0:25599:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9dc07016fb80. 00000100:00100000:2.0:1784189344.874179:0:25599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1023 00000100:00100000:2.0:1784189344.874188:0:25599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc07016fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:debedd94-805c-42a0-a5e5-41758b2012e9+36:2397:x1870854436377472:12345-192.168.203.12@tcp:10:dd.0 00002000:00010000:2.0:1784189344.874312:0:25599:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x771:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1784189344.874344:0:25599:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x771:0x0] updating lvb mtime from disk: 1784189334 -> 1784189344 00002000:00010000:2.0:1784189344.874347:0:25599:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x771:0x0] updating lvb atime from disk: 1784189334 -> 1784189334 00002000:00010000:2.0:1784189344.874350:0:25599:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x771:0x0] updating lvb ctime from disk: 1784189334 -> 1784189344 00002000:00010000:2.0:1784189344.874352:0:25599:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x771:0x0] updating lvb blocks from disk: 0 -> 0 00010000:00000080:2.0:1784189344.874361:0:25599:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9dc07016fb80 x1870854436377472/t4294968993(0) o10->debedd94-805c-42a0-a5e5-41758b2012e9@192.168.203.12@tcp:535/0 lens 440/432 e 0 to 0 dl 1784189355 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1784189344.874406:0:25599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc07016fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:debedd94-805c-42a0-a5e5-41758b2012e9+37:2397:x1870854436377472:12345-192.168.203.12@tcp:10:dd.0 Request processed in 220us (490us total) trans 4294968993 rc 0/0 00000100:00100000:2.0:1784189344.874413:0:25599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1023 00002000:00010000:2.0:1784189344.874416:0:25599:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/1905 (0->18446744073709551615) 00002000:00100000:2.0:1784189344.874419:0:25599:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9dc07016fb80 with x1870854436377472 ext(0->18446744073709551615) 00002000:00010000:2.0:1784189344.874423:0:25599:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9dc07016fb80. 00000100:00100000:1.0:1784189344.874686:0:14684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436377344 00000100:00100000:1.0:1784189344.874691:0:14684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436377344 00000100:00100000:1.0:1784189344.874726:0:14684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 5037 00000100:00100000:1.0:1784189344.874733:0:14684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc07016ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:debedd94-805c-42a0-a5e5-41758b2012e9+37:73681:x1870854436377344:12345-192.168.203.12@tcp:101:dd.0 00010000:00010000:1.0:1784189344.874743:0:14684:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784189344.874759:0:14684:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008da15b72/0xcc1762b626f8d4c3 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x770:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xcbfc5de7fe6c43e3 expref: -99 pid: 14684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1784189344.874775:0:14684:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x770:0x0] initial LVB size: 0, mtime: 0x6a589196, atime: 0x6a589196, ctime: 0x6a589196, blocks: 0x0 00010000:00010000:1.0:1784189344.874790:0:14684:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x770:0x0].0x0 since=3587s v=(0 0) 00010000:00010000:1.0:1784189344.874795:0:14684:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x770:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784189344.874812:0:14684:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008da15b72/0xcc1762b626f8d4c3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x770:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c43e3 expref: 38 pid: 14684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189344.874828:0:14684:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000008da15b72/0xcc1762b626f8d4c3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x770:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c43e3 expref: 38 pid: 14684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189344.874840:0:14684:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc081b17800, rc 0) 00010000:00000080:1.0:1784189344.874845:0:14684:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9dc07016ce00 x1870854436377344/t0(0) o101->debedd94-805c-42a0-a5e5-41758b2012e9@192.168.203.12@tcp:535/0 lens 328/400 e 0 to 0 dl 1784189355 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1784189344.874873:0:14684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc07016ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:debedd94-805c-42a0-a5e5-41758b2012e9+38:73681:x1870854436377344:12345-192.168.203.12@tcp:101:dd.0 Request processed in 141us (1003us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189344.874886:0:14684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 5037 00000100:00100000:2.0:1784189344.878723:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1784189344.878804:0:66945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436377728 00000100:00100000:3.0:1784189344.878814:0:66945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436377728 00000100:00100000:3.0:1784189344.878878:0:66945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1570 00000100:00100000:3.0:1784189344.878888:0:66945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc080e62a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:debedd94-805c-42a0-a5e5-41758b2012e9+138:73685:x1870854436377728:12345-192.168.203.12@tcp:101:dd.0 00010000:00010000:3.0:1784189344.878913:0:66945:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784189344.879080:0:66945:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0755a5a00/0xcc1762b626f8d4ca lrc: 2/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbfc5de7fe6c43ea expref: -99 pid: 66945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189344.879297:0:66945:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0755a4e00/0xcc1762b626f8d4d1 lrc: 3/1,0 mode: --/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189344.879311:0:66945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0755a4e00/0xcc1762b626f8d4d1 lrc: 3/1,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189344.879465:0:66945:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0755a4e00/0xcc1762b626f8d4d1 lrc: 3/1,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189344.879482:0:66945:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0755a5200/0xcc1762b626f8d4d8 lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0x4:0x0].0x961c5ca3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189344.879489:0:66945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0755a5200/0xcc1762b626f8d4d8 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x961c5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189344.879496:0:66945:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0755a5200/0xcc1762b626f8d4d8 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x961c5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189344.879553:0:66945:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0755a4a00/0xcc1762b626f8d4df lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0x18:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189344.879562:0:66945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0755a4a00/0xcc1762b626f8d4df lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x18:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189344.879569:0:66945:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0755a4a00/0xcc1762b626f8d4df lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x18:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784189344.879579:0:66945:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000cf21:0x18:0x0]: returning size 0 00010000:00010000:3.0:1784189344.879653:0:66945:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0755a4e00/0xcc1762b626f8d4d1 lrc: 4/1,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189344.879662:0:66945:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0755a4e00/0xcc1762b626f8d4d1 lrc: 4/1,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189344.879675:0:66945:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0755a4e00/0xcc1762b626f8d4d1 lrc: 3/0,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189344.879681:0:66945:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0755a4e00/0xcc1762b626f8d4d1 lrc: 4/0,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189344.879687:0:66945:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc0755a4e00 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:3.0:1784189344.879691:0:66945:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0755a4e00/0xcc1762b626f8d4d1 lrc: 4/0,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189344.879700:0:66945:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0755a4e00/0xcc1762b626f8d4d1 lrc: 5/0,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189344.879711:0:66945:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x0 (ffff9dbf45994c00) 00010000:00010000:3.0:1784189344.879715:0:66945:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784189344.879719:0:66945:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0755a4e00/0xcc1762b626f8d4d1 lrc: 3/0,0 mode: --/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189344.879725:0:66945:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0755a4e00/0xcc1762b626f8d4d1 lrc: 0/0,0 mode: --/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189344.879738:0:66945:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0755a5200/0xcc1762b626f8d4d8 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x961c5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189344.879744:0:66945:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0755a5200/0xcc1762b626f8d4d8 lrc: 2/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x961c5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189344.879750:0:66945:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0755a5200/0xcc1762b626f8d4d8 lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x961c5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189344.879755:0:66945:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc0755a5200 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:3.0:1784189344.879763:0:66945:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0755a5200/0xcc1762b626f8d4d8 lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x961c5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189344.879769:0:66945:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0755a5200/0xcc1762b626f8d4d8 lrc: 4/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x961c5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189344.879777:0:66945:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x961c5ca3 (ffff9dc081250100) 00010000:00010000:3.0:1784189344.879780:0:66945:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784189344.879782:0:66945:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0755a5200/0xcc1762b626f8d4d8 lrc: 2/0,0 mode: --/PR res: [0x20000cf21:0x4:0x0].0x961c5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189344.879788:0:66945:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0755a5200/0xcc1762b626f8d4d8 lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0x4:0x0].0x961c5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189344.879838:0:66945:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0755a5a00/0xcc1762b626f8d4ca lrc: 0/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c43ea expref: 141 pid: 66945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189344.879853:0:66945:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0755a4a00/0xcc1762b626f8d4df lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x18:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c43ea expref: 140 pid: 66945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189344.879860:0:66945:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x18:0x0].0x0 (ffff9dc07499b300) 00010000:00010000:3.0:1784189344.879862:0:66945:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1784189344.879865:0:66945:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc0755a4a00, rc 0) 00000100:00100000:3.0:1784189344.880068:0:66945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc080e62a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:debedd94-805c-42a0-a5e5-41758b2012e9+140:73685:x1870854436377728:12345-192.168.203.12@tcp:101:dd.0 Request processed in 1180us (1352us total) trans 120259084427 rc 0/0 00000100:00100000:3.0:1784189344.880077:0:66945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1570 00000100:00100000:0.0:1784189344.893100:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1784189344.893240:0:66170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436377856 00000100:00100000:3.0:1784189344.893249:0:66170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436377856 00000100:00100000:3.0:1784189344.893302:0:66170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1571 00000100:00100000:3.0:1784189344.893310:0:66170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf464ac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:debedd94-805c-42a0-a5e5-41758b2012e9+140:73684:x1870854436377856:12345-192.168.203.12@tcp:101:dd.0 00010000:00010000:3.0:1784189344.893360:0:66170:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784189344.893381:0:66170:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0755a5e00/0xcc1762b626f8d4ed lrc: 2/0,0 mode: --/PR res: [0x20000cf21:0x17:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbfc5de7fe6c43f1 expref: -99 pid: 66170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189344.893415:0:66170:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0565e7200/0xcc1762b626f8d4f4 lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0x17:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189344.893429:0:66170:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0565e7200/0xcc1762b626f8d4f4 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x17:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189344.893439:0:66170:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0565e7200/0xcc1762b626f8d4f4 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x17:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189344.893542:0:66170:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0755a5e00/0xcc1762b626f8d4ed lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0x17:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c43f1 expref: 142 pid: 66170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189344.893560:0:66170:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0565e7200/0xcc1762b626f8d4f4 lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x17:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c43f1 expref: 141 pid: 66170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189344.893568:0:66170:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x17:0x0].0x0 (ffff9dbf44851b00) 00010000:00010000:3.0:1784189344.893571:0:66170:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1784189344.893575:0:66170:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc0565e7200, rc 0) 00000100:00100000:3.0:1784189344.893626:0:66170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf464ac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:debedd94-805c-42a0-a5e5-41758b2012e9+141:73684:x1870854436377856:12345-192.168.203.12@tcp:101:dd.0 Request processed in 317us (535us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189344.893632:0:66170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1571 00000100:00100000:0.0:1784189344.893779:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1784189344.893850:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1784189344.893884:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1784189344.893941:0:66171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436378112 00000100:00100000:3.0:1784189344.893946:0:66171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436378112 00000100:00100000:3.0:1784189344.893977:0:66171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1572 00000100:00100000:3.0:1784189344.893984:0:66171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf464ad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:debedd94-805c-42a0-a5e5-41758b2012e9+141:73683:x1870854436378112:12345-192.168.203.12@tcp:36:dd.0 00010000:00010000:3.0:1784189344.894019:0:66171:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784189344.894035:0:66171:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc080f05600/0xcc1762b626f8d46f lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0x16:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c43c7 expref: 141 pid: 66171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189344.894046:0:66171:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x16:0x0].0x0 (ffff9dbf44851900) 00010000:00010000:3.0:1784189344.894050:0:66171:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1784189344.894197:0:66171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0565e6a00/0xcc1762b626f8d4fb lrc: 3/0,1 mode: --/PW res: [0x20000cf21:0x16:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189344.894208:0:66171:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0565e6a00/0xcc1762b626f8d4fb lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x16:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189344.894216:0:66171:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0565e6a00/0xcc1762b626f8d4fb lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x16:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1784189344.894257:0:66171:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 120259084428 00000004:00010000:3.0:1784189344.894279:0:66171:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000a4768dc0 reply state 00000000d0bfc438 transno 120259084429 ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0565e6a00/0xcc1762b626f8d4fb lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x16:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189344.894292:0:66171:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0565e6a00/0xcc1762b626f8d4fb lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x16:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189344.894297:0:66171:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x16:0x0].0x0 (ffff9dbf44851900) 00010000:00010000:3.0:1784189344.894300:0:66171:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1784189344.894302:0:66171:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1784189344.894376:0:66171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf464ad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:debedd94-805c-42a0-a5e5-41758b2012e9+143:73683:x1870854436378112:12345-192.168.203.12@tcp:36:dd.0 Request processed in 392us (596us total) trans 120259084429 rc 0/0 00000100:00100000:3.0:1784189344.894383:0:66171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1572 00000020:00080000:3.0:1784189344.894387:0:66171:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1784189344.894679:0:66172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436378368 00000100:00100000:2.0:1784189344.894684:0:66172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436378368 00000100:00100000:2.0:1784189344.894722:0:66172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 280 00000100:00100000:2.0:1784189344.894731:0:66172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf464ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:debedd94-805c-42a0-a5e5-41758b2012e9+143:73682:x1870854436378368:12345-192.168.203.12@tcp:35:dd.0 00000100:00100000:2.0:1784189344.894879:0:66172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf464ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:debedd94-805c-42a0-a5e5-41758b2012e9+144:73682:x1870854436378368:12345-192.168.203.12@tcp:35:dd.0 Request processed in 149us (1028us total) trans 120259084430 rc 0/0 00000100:00100000:2.0:1784189344.894894:0:66172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 280 00000100:00100000:2.0:1784189344.894914:0:24834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436378496 00000100:00100000:2.0:1784189344.894986:0:24834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436378496 00002000:00010000:2.0:1784189344.895010:0:24834:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/1904 (0->18446744073709551615) 00002000:00100000:2.0:1784189344.895014:0:24834:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9dbf47545180 with x1870854436378496 ext(0->18446744073709551615) 00002000:00010000:2.0:1784189344.895024:0:24834:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9dbf47545180. 00000100:00100000:2.0:1784189344.895053:0:24834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1024 00000100:00100000:2.0:1784189344.895060:0:24834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf47545180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:debedd94-805c-42a0-a5e5-41758b2012e9+38:2397:x1870854436378496:12345-192.168.203.12@tcp:10:dd.0 00002000:00010000:2.0:1784189344.895149:0:24834:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x770:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1784189344.895152:0:24834:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x770:0x0] updating lvb mtime from disk: 1784189334 -> 1784189344 00002000:00010000:2.0:1784189344.895605:0:24834:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x770:0x0] updating lvb atime from disk: 1784189334 -> 1784189334 00002000:00010000:2.0:1784189344.895608:0:24834:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x770:0x0] updating lvb ctime from disk: 1784189334 -> 1784189344 00002000:00010000:2.0:1784189344.895610:0:24834:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x770:0x0] updating lvb blocks from disk: 0 -> 0 00010000:00000080:2.0:1784189344.895620:0:24834:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9dbf47545180 x1870854436378496/t4294968994(0) o10->debedd94-805c-42a0-a5e5-41758b2012e9@192.168.203.12@tcp:535/0 lens 440/432 e 0 to 0 dl 1784189355 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1784189344.895654:0:24834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf47545180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:debedd94-805c-42a0-a5e5-41758b2012e9+39:2397:x1870854436378496:12345-192.168.203.12@tcp:10:dd.0 Request processed in 594us (1768us total) trans 4294968994 rc 0/0 00000100:00100000:2.0:1784189344.895662:0:24834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1024 00002000:00010000:2.0:1784189344.895665:0:24834:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/1904 (0->18446744073709551615) 00002000:00100000:2.0:1784189344.895668:0:24834:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9dbf47545180 with x1870854436378496 ext(0->18446744073709551615) 00002000:00010000:2.0:1784189344.895674:0:24834:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9dbf47545180. 00000100:00100000:1.0:1784189344.897937:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1784189344.897972:0:66169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436378752 00000100:00100000:1.0:1784189344.897980:0:66169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436378752 00000100:00100000:1.0:1784189344.898028:0:66169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1573 00000100:00100000:1.0:1784189344.898037:0:66169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf4693f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:debedd94-805c-42a0-a5e5-41758b2012e9+144:73684:x1870854436378752:12345-192.168.203.12@tcp:36:dd.0 00010000:00010000:1.0:1784189344.898081:0:66169:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784189344.898106:0:66169:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc080f05c00/0xcc1762b626f8d4b5 lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0x17:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c43dc expref: 144 pid: 66170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189344.898125:0:66169:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x17:0x0].0x0 (ffff9dbf44851b00) 00010000:00010000:1.0:1784189344.898130:0:66169:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1784189344.898449:0:66169:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc081b16e00/0xcc1762b626f8d502 lrc: 3/0,1 mode: --/PW res: [0x20000cf21:0x17:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189344.898464:0:66169:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc081b16e00/0xcc1762b626f8d502 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x17:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189344.898475:0:66169:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc081b16e00/0xcc1762b626f8d502 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x17:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1784189344.898517:0:66169:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 120259084431 00000004:00010000:1.0:1784189344.898541:0:66169:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000168127a6 reply state 000000009a540bc8 transno 120259084432 ns: mdt-lustre-MDT0000_UUID lock: ffff9dc081b16e00/0xcc1762b626f8d502 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x17:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189344.898554:0:66169:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc081b16e00/0xcc1762b626f8d502 lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x17:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189344.898560:0:66169:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x17:0x0].0x0 (ffff9dbf44851b00) 00010000:00010000:1.0:1784189344.898575:0:66169:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1784189344.898579:0:66169:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1784189344.898661:0:66169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf4693f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:debedd94-805c-42a0-a5e5-41758b2012e9+146:73684:x1870854436378752:12345-192.168.203.12@tcp:36:dd.0 Request processed in 625us (743us total) trans 120259084432 rc 0/0 00000100:00100000:1.0:1784189344.898670:0:66169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1573 00000020:00080000:1.0:1784189344.898675:0:66169:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1784189344.907362:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1784189344.907397:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1784189344.907425:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1784189344.907492:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1784189344.907563:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436379136 00000100:00100000:0.0:1784189344.907573:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436379136 00000100:00100000:0.0:1784189344.907623:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436379008 00000100:00100000:0.0:1784189344.907626:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436379008 00000100:00100000:0.0:1784189344.907648:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 5038 00000100:00100000:0.0:1784189344.907657:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf4693c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:debedd94-805c-42a0-a5e5-41758b2012e9+40:73684:x1870854436379136:12345-192.168.203.12@tcp:101:dd.0 00010000:00010000:0.0:1784189344.907675:0:8427:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784189344.907697:0:8427:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005168a0f1/0xcc1762b626f8d509 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x773:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xcbfc5de7fe6c4406 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1784189344.907720:0:8427:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x773:0x0] initial LVB size: 0, mtime: 0x6a589196, atime: 0x6a589196, ctime: 0x6a589196, blocks: 0x0 00010000:00010000:0.0:1784189344.907740:0:8427:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x773:0x0].0x0 since=3587s v=(0 0) 00010000:00010000:0.0:1784189344.907745:0:8427:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x773:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784189344.907754:0:8427:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005168a0f1/0xcc1762b626f8d509 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x773:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c4406 expref: 41 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189344.907791:0:8427:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000005168a0f1/0xcc1762b626f8d509 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x773:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c4406 expref: 41 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189344.907814:0:8427:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc070146400, rc 0) 00010000:00000080:0.0:1784189344.907823:0:8427:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9dbf4693c700 x1870854436379136/t0(0) o101->debedd94-805c-42a0-a5e5-41758b2012e9@192.168.203.12@tcp:535/0 lens 328/400 e 0 to 0 dl 1784189355 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1784189344.907880:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf4693c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:debedd94-805c-42a0-a5e5-41758b2012e9+41:73684:x1870854436379136:12345-192.168.203.12@tcp:101:dd.0 Request processed in 224us (482us total) trans 0 rc 0/0 00000100:00100000:0.0:1784189344.907887:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 5038 00000100:00100000:0.0:1784189344.907905:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 5039 00000100:00100000:0.0:1784189344.907912:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf4693d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:debedd94-805c-42a0-a5e5-41758b2012e9+40:73683:x1870854436379008:12345-192.168.203.12@tcp:101:dd.0 00010000:00010000:0.0:1784189344.907932:0:8427:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784189344.907943:0:8427:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cd45e61e/0xcc1762b626f8d510 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x772:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xcbfc5de7fe6c43ff expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1784189344.907955:0:8427:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x772:0x0] initial LVB size: 0, mtime: 0x6a589196, atime: 0x6a589196, ctime: 0x6a589196, blocks: 0x0 00010000:00010000:0.0:1784189344.907964:0:8427:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x772:0x0].0x0 since=3587s v=(0 0) 00010000:00010000:0.0:1784189344.907967:0:8427:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x772:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784189344.907972:0:8427:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cd45e61e/0xcc1762b626f8d510 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x772:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c43ff expref: 41 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189344.907982:0:8427:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000cd45e61e/0xcc1762b626f8d510 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x772:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c43ff expref: 41 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189344.908004:0:8427:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc070146600, rc 0) 00010000:00000080:0.0:1784189344.908009:0:8427:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9dbf4693d880 x1870854436379008/t0(0) o101->debedd94-805c-42a0-a5e5-41758b2012e9@192.168.203.12@tcp:535/0 lens 328/400 e 0 to 0 dl 1784189355 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1784189344.908035:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf4693d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:debedd94-805c-42a0-a5e5-41758b2012e9+41:73683:x1870854436379008:12345-192.168.203.12@tcp:101:dd.0 Request processed in 123us (543us total) trans 0 rc 0/0 00000100:00100000:0.0:1784189344.908042:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 5039 00000100:00100000:2.0:1784189344.908487:0:66172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436379392 00000100:00100000:2.0:1784189344.908493:0:66172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436379392 00000100:00100000:2.0:1784189344.908533:0:66172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 281 00000100:00100000:2.0:1784189344.908541:0:66172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf44d0a850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:debedd94-805c-42a0-a5e5-41758b2012e9+146:73681:x1870854436379392:12345-192.168.203.12@tcp:35:dd.0 00000100:00100000:2.0:1784189344.908778:0:66172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf44d0a850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:debedd94-805c-42a0-a5e5-41758b2012e9+147:73681:x1870854436379392:12345-192.168.203.12@tcp:35:dd.0 Request processed in 238us (1351us total) trans 120259084433 rc 0/0 00000100:00100000:2.0:1784189344.908785:0:66172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 281 00000100:00100000:3.0:1784189344.909037:0:66171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436378880 00000100:00100000:3.0:1784189344.909047:0:66171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436378880 00000100:00100000:3.0:1784189344.909087:0:66171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1574 00000100:00100000:3.0:1784189344.909093:0:66171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf4693dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:debedd94-805c-42a0-a5e5-41758b2012e9+147:73685:x1870854436378880:12345-192.168.203.12@tcp:101:dd.0 00010000:00010000:3.0:1784189344.909101:0:66171:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784189344.909115:0:66171:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0565e6400/0xcc1762b626f8d517 lrc: 2/0,0 mode: --/PR res: [0x20000cf21:0x18:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbfc5de7fe6c43f8 expref: -99 pid: 66171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189344.909143:0:66171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0755a5e00/0xcc1762b626f8d51e lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0x18:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189344.909221:0:66171:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0755a5e00/0xcc1762b626f8d51e lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x18:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189344.909235:0:66171:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0755a5e00/0xcc1762b626f8d51e lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x18:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189344.909309:0:66171:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0565e6400/0xcc1762b626f8d517 lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0x18:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c43f8 expref: 149 pid: 66171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189344.909355:0:66171:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0755a5e00/0xcc1762b626f8d51e lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x18:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c43f8 expref: 148 pid: 66171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189344.909365:0:66171:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x18:0x0].0x0 (ffff9dc07499b300) 00010000:00010000:3.0:1784189344.909367:0:66171:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1784189344.909371:0:66171:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc0755a5e00, rc 0) 00000100:00100000:3.0:1784189344.909398:0:66171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf4693dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:debedd94-805c-42a0-a5e5-41758b2012e9+148:73685:x1870854436378880:12345-192.168.203.12@tcp:101:dd.0 Request processed in 305us (2045us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189344.909403:0:66171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1574 00000100:00100000:3.0:1784189344.912088:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1784189344.912274:0:24846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436379520 00000100:00100000:2.0:1784189344.912282:0:24846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436379520 00002000:00010000:2.0:1784189344.912347:0:24846:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/1906 (0->18446744073709551615) 00002000:00100000:2.0:1784189344.912351:0:24846:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9dc070221c00 with x1870854436379520 ext(0->18446744073709551615) 00002000:00010000:2.0:1784189344.912361:0:24846:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9dc070221c00. 00000100:00100000:2.0:1784189344.912388:0:24846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1025 00000100:00100000:2.0:1784189344.912396:0:24846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc070221c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:debedd94-805c-42a0-a5e5-41758b2012e9+41:2396:x1870854436379520:12345-192.168.203.12@tcp:10:dd.0 00002000:00010000:2.0:1784189344.912522:0:24846:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x772:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1784189344.912526:0:24846:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x772:0x0] updating lvb mtime from disk: 1784189334 -> 1784189344 00002000:00010000:2.0:1784189344.912528:0:24846:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x772:0x0] updating lvb atime from disk: 1784189334 -> 1784189334 00002000:00010000:2.0:1784189344.912530:0:24846:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x772:0x0] updating lvb ctime from disk: 1784189334 -> 1784189344 00002000:00010000:2.0:1784189344.912532:0:24846:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x772:0x0] updating lvb blocks from disk: 0 -> 0 00010000:00000080:2.0:1784189344.912541:0:24846:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9dc070221c00 x1870854436379520/t4294968995(0) o10->debedd94-805c-42a0-a5e5-41758b2012e9@192.168.203.12@tcp:535/0 lens 440/432 e 0 to 0 dl 1784189355 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1784189344.912596:0:24846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc070221c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:debedd94-805c-42a0-a5e5-41758b2012e9+42:2396:x1870854436379520:12345-192.168.203.12@tcp:10:dd.0 Request processed in 201us (515us total) trans 4294968995 rc 0/0 00000100:00100000:2.0:1784189344.912604:0:24846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1025 00002000:00010000:2.0:1784189344.912607:0:24846:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/1906 (0->18446744073709551615) 00002000:00100000:2.0:1784189344.912610:0:24846:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9dc070221c00 with x1870854436379520 ext(0->18446744073709551615) 00002000:00010000:2.0:1784189344.912614:0:24846:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9dc070221c00. 00000100:00100000:3.0:1784189344.914454:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1784189344.914524:0:24843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436379648 00000100:00100000:0.0:1784189344.914534:0:24843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436379648 00002000:00010000:0.0:1784189344.914568:0:24843:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/1907 (0->18446744073709551615) 00002000:00100000:0.0:1784189344.914573:0:24843:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9dc070222a00 with x1870854436379648 ext(0->18446744073709551615) 00002000:00010000:0.0:1784189344.914582:0:24843:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9dc070222a00. 00000100:00100000:0.0:1784189344.914621:0:24843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1026 00000100:00100000:0.0:1784189344.914629:0:24843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc070222a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:debedd94-805c-42a0-a5e5-41758b2012e9+42:2398:x1870854436379648:12345-192.168.203.12@tcp:10:dd.0 00002000:00010000:0.0:1784189344.914761:0:24843:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x773:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1784189344.914765:0:24843:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x773:0x0] updating lvb mtime from disk: 1784189334 -> 1784189344 00002000:00010000:0.0:1784189344.914767:0:24843:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x773:0x0] updating lvb atime from disk: 1784189334 -> 1784189334 00002000:00010000:0.0:1784189344.914769:0:24843:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x773:0x0] updating lvb ctime from disk: 1784189334 -> 1784189344 00002000:00010000:0.0:1784189344.914772:0:24843:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x773:0x0] updating lvb blocks from disk: 0 -> 0 00010000:00000080:0.0:1784189344.914780:0:24843:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9dc070222a00 x1870854436379648/t4294968996(0) o10->debedd94-805c-42a0-a5e5-41758b2012e9@192.168.203.12@tcp:535/0 lens 440/432 e 0 to 0 dl 1784189355 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1784189344.920731:0:24843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc070222a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:debedd94-805c-42a0-a5e5-41758b2012e9+43:2398:x1870854436379648:12345-192.168.203.12@tcp:10:dd.0 Request processed in 6088us (6269us total) trans 4294968996 rc 0/0 00000100:00100000:0.0:1784189344.920748:0:24843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1026 00002000:00010000:0.0:1784189344.920771:0:24843:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/1907 (0->18446744073709551615) 00002000:00100000:0.0:1784189344.920775:0:24843:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9dc070222a00 with x1870854436379648 ext(0->18446744073709551615) 00002000:00010000:0.0:1784189344.920787:0:24843:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9dc070222a00. 00000100:00100000:2.0:1784189344.922616:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1784189344.922715:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1784189344.922852:0:66172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436380160 00000100:00100000:3.0:1784189344.922863:0:66172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436380160 00000100:00100000:3.0:1784189344.923068:0:66172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 282 00000100:00100000:3.0:1784189344.923079:0:66172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc080e62680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:debedd94-805c-42a0-a5e5-41758b2012e9+148:73683:x1870854436380160:12345-192.168.203.12@tcp:35:dd.0 00000100:00100000:3.0:1784189344.923468:0:66172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc080e62680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:debedd94-805c-42a0-a5e5-41758b2012e9+149:73683:x1870854436380160:12345-192.168.203.12@tcp:35:dd.0 Request processed in 390us (750us total) trans 120259084434 rc 0/0 00000100:00100000:3.0:1784189344.923476:0:66172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 282 00000100:00100000:1.0:1784189344.924265:0:66169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436379904 00000100:00100000:1.0:1784189344.924275:0:66169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436379904 00000100:00100000:1.0:1784189344.924363:0:66169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1575 00000100:00100000:1.0:1784189344.924373:0:66169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc080e63480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:debedd94-805c-42a0-a5e5-41758b2012e9+149:73685:x1870854436379904:12345-192.168.203.12@tcp:36:dd.0 00010000:00010000:1.0:1784189344.924411:0:66169:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784189344.924436:0:66169:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0755a4a00/0xcc1762b626f8d4df lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0x18:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c43ea expref: 149 pid: 66945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189344.924456:0:66169:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x18:0x0].0x0 (ffff9dc07499b300) 00010000:00010000:1.0:1784189344.924461:0:66169:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1784189344.924586:0:66169:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc081b17400/0xcc1762b626f8d525 lrc: 3/0,1 mode: --/PW res: [0x20000cf21:0x18:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189344.924601:0:66169:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc081b17400/0xcc1762b626f8d525 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189344.924609:0:66169:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc081b17400/0xcc1762b626f8d525 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1784189344.924649:0:66169:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 120259084435 00000004:00010000:1.0:1784189344.924690:0:66169:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000fe0793dd reply state 000000006b5c4fdb transno 120259084436 ns: mdt-lustre-MDT0000_UUID lock: ffff9dc081b17400/0xcc1762b626f8d525 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189344.924705:0:66169:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc081b17400/0xcc1762b626f8d525 lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189344.924711:0:66169:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x18:0x0].0x0 (ffff9dc07499b300) 00010000:00010000:1.0:1784189344.924714:0:66169:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1784189344.924716:0:66169:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1784189344.924810:0:66169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc080e63480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:debedd94-805c-42a0-a5e5-41758b2012e9+151:73685:x1870854436379904:12345-192.168.203.12@tcp:36:dd.0 Request processed in 439us (2200us total) trans 120259084436 rc 0/0 00000100:00100000:1.0:1784189344.924817:0:66169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1575 00000020:00080000:1.0:1784189344.924822:0:66169:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1784189344.939114:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1784189344.939148:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1784189344.939268:0:66172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436380544 00000100:00100000:3.0:1784189344.939277:0:66172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436380544 00000100:00100000:1.0:1784189344.939397:0:26164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436380288 00000100:00100000:1.0:1784189344.939401:0:26164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436380288 00000100:00100000:3.0:1784189344.939402:0:66172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 283 00000100:00100000:3.0:1784189344.939412:0:66172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf46956300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:debedd94-805c-42a0-a5e5-41758b2012e9+151:73684:x1870854436380544:12345-192.168.203.12@tcp:35:dd.0 00000100:00100000:1.0:1784189344.939431:0:26164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 5040 00000100:00100000:1.0:1784189344.939437:0:26164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc05ed78a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:debedd94-805c-42a0-a5e5-41758b2012e9+43:73685:x1870854436380288:12345-192.168.203.12@tcp:101:dd.0 00010000:00010000:1.0:1784189344.939446:0:26164:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784189344.939465:0:26164:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d0a53c2a/0xcc1762b626f8d52c lrc: 2/0,0 mode: --/PW res: [0x280000401:0x774:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xcbfc5de7fe6c440d expref: -99 pid: 26164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1784189344.939498:0:26164:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x774:0x0] initial LVB size: 0, mtime: 0x6a589196, atime: 0x6a589196, ctime: 0x6a589196, blocks: 0x0 00010000:00010000:1.0:1784189344.939515:0:26164:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x774:0x0].0x0 since=3587s v=(0 0) 00010000:00010000:1.0:1784189344.939520:0:26164:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x774:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784189344.939527:0:26164:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d0a53c2a/0xcc1762b626f8d52c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x774:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c440d expref: 44 pid: 26164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189344.939542:0:26164:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000d0a53c2a/0xcc1762b626f8d52c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x774:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c440d expref: 44 pid: 26164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189344.939572:0:26164:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc081b16800, rc 0) 00010000:00000080:1.0:1784189344.939579:0:26164:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9dc05ed78a80 x1870854436380288/t0(0) o101->debedd94-805c-42a0-a5e5-41758b2012e9@192.168.203.12@tcp:535/0 lens 328/400 e 0 to 0 dl 1784189355 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1784189344.939629:0:26164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc05ed78a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:debedd94-805c-42a0-a5e5-41758b2012e9+44:73685:x1870854436380288:12345-192.168.203.12@tcp:101:dd.0 Request processed in 192us (523us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189344.939630:0:66172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf46956300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:debedd94-805c-42a0-a5e5-41758b2012e9+152:73684:x1870854436380544:12345-192.168.203.12@tcp:35:dd.0 Request processed in 219us (481us total) trans 120259084437 rc 0/0 00000100:00100000:3.0:1784189344.939637:0:66172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 283 00000100:00100000:1.0:1784189344.939637:0:26164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 5040 00000100:00100000:2.0:1784189344.946392:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1784189344.948442:0:24844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436380672 00000100:00100000:0.0:1784189344.948457:0:24844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436380672 00002000:00010000:0.0:1784189344.948507:0:24844:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/1908 (0->18446744073709551615) 00002000:00100000:0.0:1784189344.948512:0:24844:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9dbf46955500 with x1870854436380672 ext(0->18446744073709551615) 00002000:00010000:0.0:1784189344.948524:0:24844:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9dbf46955500. 00000100:00100000:0.0:1784189344.948553:0:24844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1027 00000100:00100000:0.0:1784189344.948563:0:24844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf46955500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:debedd94-805c-42a0-a5e5-41758b2012e9+44:2396:x1870854436380672:12345-192.168.203.12@tcp:10:dd.0 00002000:00010000:1.0:1784189344.948722:0:24844:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x774:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1784189344.948726:0:24844:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x774:0x0] updating lvb mtime from disk: 1784189334 -> 1784189344 00002000:00010000:1.0:1784189344.948729:0:24844:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x774:0x0] updating lvb atime from disk: 1784189334 -> 1784189334 00002000:00010000:1.0:1784189344.948731:0:24844:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x774:0x0] updating lvb ctime from disk: 1784189334 -> 1784189344 00002000:00010000:1.0:1784189344.948733:0:24844:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x774:0x0] updating lvb blocks from disk: 0 -> 0 00010000:00000080:1.0:1784189344.948742:0:24844:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9dbf46955500 x1870854436380672/t4294968997(0) o10->debedd94-805c-42a0-a5e5-41758b2012e9@192.168.203.12@tcp:535/0 lens 440/432 e 0 to 0 dl 1784189355 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1784189344.948821:0:24844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf46955500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:debedd94-805c-42a0-a5e5-41758b2012e9+45:2396:x1870854436380672:12345-192.168.203.12@tcp:10:dd.0 Request processed in 259us (2666us total) trans 4294968997 rc 0/0 00000100:00100000:1.0:1784189344.948829:0:24844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1027 00002000:00010000:1.0:1784189344.948833:0:24844:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/1908 (0->18446744073709551615) 00002000:00100000:1.0:1784189344.948836:0:24844:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9dbf46955500 with x1870854436380672 ext(0->18446744073709551615) 00002000:00010000:1.0:1784189344.948840:0:24844:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9dbf46955500. 00000100:00100000:2.0:1784189344.953626:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1784189344.953702:0:66173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436380928 00000100:00100000:0.0:1784189344.953711:0:66173:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436380928 00000100:00100000:0.0:1784189344.953770:0:66173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 284 00000100:00100000:0.0:1784189344.953780:0:66173:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc05eda9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:debedd94-805c-42a0-a5e5-41758b2012e9+152:73685:x1870854436380928:12345-192.168.203.12@tcp:35:dd.0 00000100:00100000:0.0:1784189344.954061:0:66173:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc05eda9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:debedd94-805c-42a0-a5e5-41758b2012e9+153:73685:x1870854436380928:12345-192.168.203.12@tcp:35:dd.0 Request processed in 282us (443us total) trans 120259084438 rc 0/0 00000100:00100000:0.0:1784189344.954069:0:66173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 284 00000100:00100000:2.0:1784189345.064315:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1784189345.064532:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1784189345.064618:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436381184 00000100:00100000:0.0:1784189345.064629:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436381184 00000100:00100000:0.0:1784189345.064692:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 5041 00000100:00100000:0.0:1784189345.064701:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc080e7f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:debedd94-805c-42a0-a5e5-41758b2012e9+45:2397:x1870854436381184:12345-192.168.203.12@tcp:16:kworker.0 00000001:00080000:3.0:1784189345.065252:0:8423:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294968997 is committed 00000100:00100000:1.0:1784189345.065397:0:24833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436381056 00000100:00100000:1.0:1784189345.065403:0:24833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436381056 00002000:00100000:1.0:1784189345.065435:0:24833:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x762:0x0] (0->1023) req@ffff9dbf464ad880 x1870854436381056/t0(0) o4->debedd94-805c-42a0-a5e5-41758b2012e9@192.168.203.12@tcp:536/0 lens 1512/0 e 0 to 0 dl 1784189356 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1784189345.065462:0:24833:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9dbf464ad880 with x1870854436381056 ext(0->1023) 00002000:00010000:1.0:1784189345.065469:0:24833:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9dbf464ad880 00000100:00100000:1.0:1784189345.065498:0:24833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1028 00000100:00100000:1.0:1784189345.065506:0:24833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf464ad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:debedd94-805c-42a0-a5e5-41758b2012e9+26:2397:x1870854436381056:12345-192.168.203.12@tcp:4:dd.0 00010000:00000080:1.0:1784189345.065922:0:24833:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9dbf464ad880 x1870854436381056/t4294968998(0) o4->debedd94-805c-42a0-a5e5-41758b2012e9@192.168.203.12@tcp:536/0 lens 1512/448 e 0 to 0 dl 1784189356 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00010000:00000080:0.0:1784189345.066171:0:8429:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9dc080e7f480 x1870854436381184/t0(0) o16->debedd94-805c-42a0-a5e5-41758b2012e9@192.168.203.12@tcp:536/0 lens 440/432 e 0 to 0 dl 1784189356 ref 1 fl Interpret:/600/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1784189345.066216:0:24833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf464ad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:debedd94-805c-42a0-a5e5-41758b2012e9+28:2397:x1870854436381056:12345-192.168.203.12@tcp:4:dd.0 Request processed in 710us (1910us total) trans 4294968998 rc 0/0 00000100:00100000:1.0:1784189345.066225:0:24833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1028 00002000:00100000:1.0:1784189345.066232:0:24833:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x762:0x0] (0->1023) req@ffff9dbf464ad880 x1870854436381056/t4294968998(0) o4->debedd94-805c-42a0-a5e5-41758b2012e9@192.168.203.12@tcp:536/0 lens 1512/448 e 0 to 0 dl 1784189356 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1784189345.066240:0:24833:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9dbf464ad880 with x1870854436381056 ext(0->1023) 00002000:00010000:1.0:1784189345.066244:0:24833:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9dbf464ad880 00000100:00100000:0.0:1784189345.073359:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc080e7f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:debedd94-805c-42a0-a5e5-41758b2012e9+27:2397:x1870854436381184:12345-192.168.203.12@tcp:16:kworker.0 Request processed in 8646us (8814us total) trans 0 rc 0/0 00000100:00100000:0.0:1784189345.073399:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 5041 00000100:00100000:3.0:1784189345.089402:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1784189345.089438:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1784189345.090033:0:26170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436381440 00000100:00100000:0.0:1784189345.090043:0:26170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436381440 00000100:00100000:0.0:1784189345.090102:0:26170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 5042 00000100:00100000:0.0:1784189345.090114:0:26170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc080f68a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:debedd94-805c-42a0-a5e5-41758b2012e9+27:2396:x1870854436381440:12345-192.168.203.12@tcp:16:kworker.0 00010000:00000080:0.0:1784189345.090360:0:26170:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9dc080f68a80 x1870854436381440/t0(0) o16->debedd94-805c-42a0-a5e5-41758b2012e9@192.168.203.12@tcp:536/0 lens 440/432 e 0 to 0 dl 1784189356 ref 1 fl Interpret:/600/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1784189345.090415:0:26170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc080f68a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:debedd94-805c-42a0-a5e5-41758b2012e9+27:2396:x1870854436381440:12345-192.168.203.12@tcp:16:kworker.0 Request processed in 304us (1021us total) trans 0 rc 0/0 00000100:00100000:0.0:1784189345.090422:0:26170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 5042 00000100:00100000:1.0:1784189345.092298:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436381312 00000100:00100000:1.0:1784189345.092312:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436381312 00002000:00100000:1.0:1784189345.092377:0:8434:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x763:0x0] (0->1023) req@ffff9dc080f6b800 x1870854436381312/t0(0) o4->debedd94-805c-42a0-a5e5-41758b2012e9@192.168.203.12@tcp:536/0 lens 1512/0 e 0 to 0 dl 1784189356 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1784189345.092388:0:8434:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9dc080f6b800 with x1870854436381312 ext(0->1023) 00002000:00010000:1.0:1784189345.092394:0:8434:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9dc080f6b800 00000100:00100000:1.0:1784189345.092426:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1029 00000100:00100000:1.0:1784189345.092435:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc080f6b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:debedd94-805c-42a0-a5e5-41758b2012e9+27:2396:x1870854436381312:12345-192.168.203.12@tcp:4:dd.0 00010000:00000080:1.0:1784189345.092771:0:8434:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9dc080f6b800 x1870854436381312/t4294968999(0) o4->debedd94-805c-42a0-a5e5-41758b2012e9@192.168.203.12@tcp:536/0 lens 1512/448 e 0 to 0 dl 1784189356 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1784189345.093042:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc080f6b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:debedd94-805c-42a0-a5e5-41758b2012e9+29:2396:x1870854436381312:12345-192.168.203.12@tcp:4:dd.0 Request processed in 607us (3601us total) trans 4294968999 rc 0/0 00000100:00100000:1.0:1784189345.093051:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1029 00002000:00100000:1.0:1784189345.093058:0:8434:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x763:0x0] (0->1023) req@ffff9dc080f6b800 x1870854436381312/t4294968999(0) o4->debedd94-805c-42a0-a5e5-41758b2012e9@192.168.203.12@tcp:536/0 lens 1512/448 e 0 to 0 dl 1784189356 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1784189345.093067:0:8434:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9dc080f6b800 with x1870854436381312 ext(0->1023) 00002000:00010000:1.0:1784189345.093071:0:8434:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9dc080f6b800 00000100:00100000:3.0:1784189345.110039:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1784189345.110089:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1784189345.110297:0:26159:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436381696 00000100:00100000:0.0:1784189345.110307:0:26159:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436381696 00000100:00100000:0.0:1784189345.110390:0:26159:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 5043 00000100:00100000:0.0:1784189345.110400:0:26159:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc080f6b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:debedd94-805c-42a0-a5e5-41758b2012e9+29:2396:x1870854436381696:12345-192.168.203.12@tcp:16:kworker.0 00010000:00000080:0.0:1784189345.110456:0:26159:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9dc080f6b100 x1870854436381696/t0(0) o16->debedd94-805c-42a0-a5e5-41758b2012e9@192.168.203.12@tcp:536/0 lens 440/432 e 0 to 0 dl 1784189356 ref 1 fl Interpret:/600/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1784189345.110514:0:26159:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc080f6b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:debedd94-805c-42a0-a5e5-41758b2012e9+29:2396:x1870854436381696:12345-192.168.203.12@tcp:16:kworker.0 Request processed in 115us (485us total) trans 0 rc 0/0 00000100:00100000:0.0:1784189345.110522:0:26159:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 5043 00000100:00100000:1.0:1784189345.111533:0:24834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436381568 00000100:00100000:1.0:1784189345.111542:0:24834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436381568 00002000:00100000:1.0:1784189345.111577:0:24834:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x764:0x0] (0->1023) req@ffff9dc080f68e00 x1870854436381568/t0(0) o4->debedd94-805c-42a0-a5e5-41758b2012e9@192.168.203.12@tcp:536/0 lens 1512/0 e 0 to 0 dl 1784189356 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1784189345.111587:0:24834:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9dc080f68e00 with x1870854436381568 ext(0->1023) 00002000:00010000:1.0:1784189345.111592:0:24834:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9dc080f68e00 00000100:00100000:1.0:1784189345.111621:0:24834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1030 00000100:00100000:1.0:1784189345.111628:0:24834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc080f68e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:debedd94-805c-42a0-a5e5-41758b2012e9+29:2396:x1870854436381568:12345-192.168.203.12@tcp:4:dd.0 00010000:00000080:1.0:1784189345.111995:0:24834:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9dc080f68e00 x1870854436381568/t4294969000(0) o4->debedd94-805c-42a0-a5e5-41758b2012e9@192.168.203.12@tcp:536/0 lens 1512/448 e 0 to 0 dl 1784189356 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1784189345.112052:0:24834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc080f68e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:debedd94-805c-42a0-a5e5-41758b2012e9+31:2396:x1870854436381568:12345-192.168.203.12@tcp:4:dd.0 Request processed in 424us (1962us total) trans 4294969000 rc 0/0 00000100:00100000:1.0:1784189345.112059:0:24834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1030 00002000:00100000:1.0:1784189345.112065:0:24834:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x764:0x0] (0->1023) req@ffff9dc080f68e00 x1870854436381568/t4294969000(0) o4->debedd94-805c-42a0-a5e5-41758b2012e9@192.168.203.12@tcp:536/0 lens 1512/448 e 0 to 0 dl 1784189356 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1784189345.112072:0:24834:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9dc080f68e00 with x1870854436381568 ext(0->1023) 00002000:00010000:1.0:1784189345.112081:0:24834:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9dc080f68e00 00000100:00100000:2.0:1784189345.128273:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1784189345.128316:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1784189345.128473:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436381824 00000100:00100000:1.0:1784189345.128482:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436381824 00002000:00100000:1.0:1784189345.128528:0:8435:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x765:0x0] (0->1023) req@ffff9dc080e7ed80 x1870854436381824/t0(0) o4->debedd94-805c-42a0-a5e5-41758b2012e9@192.168.203.12@tcp:536/0 lens 1512/0 e 0 to 0 dl 1784189356 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1784189345.128539:0:8435:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9dc080e7ed80 with x1870854436381824 ext(0->1023) 00002000:00010000:1.0:1784189345.128545:0:8435:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9dc080e7ed80 00000100:00100000:1.0:1784189345.128575:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1031 00000100:00100000:1.0:1784189345.128584:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc080e7ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:debedd94-805c-42a0-a5e5-41758b2012e9+31:2398:x1870854436381824:12345-192.168.203.12@tcp:4:dd.0 00010000:00000080:1.0:1784189345.128951:0:8435:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9dc080e7ed80 x1870854436381824/t4294969001(0) o4->debedd94-805c-42a0-a5e5-41758b2012e9@192.168.203.12@tcp:536/0 lens 1512/448 e 0 to 0 dl 1784189356 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1784189345.129021:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc080e7ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:debedd94-805c-42a0-a5e5-41758b2012e9+33:2398:x1870854436381824:12345-192.168.203.12@tcp:4:dd.0 Request processed in 438us (757us total) trans 4294969001 rc 0/0 00000100:00100000:1.0:1784189345.129029:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1031 00002000:00100000:1.0:1784189345.129035:0:8435:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x765:0x0] (0->1023) req@ffff9dc080e7ed80 x1870854436381824/t4294969001(0) o4->debedd94-805c-42a0-a5e5-41758b2012e9@192.168.203.12@tcp:536/0 lens 1512/448 e 0 to 0 dl 1784189356 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1784189345.129044:0:8435:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9dc080e7ed80 with x1870854436381824 ext(0->1023) 00002000:00010000:1.0:1784189345.129047:0:8435:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9dc080e7ed80 00000100:00100000:0.0:1784189345.129568:0:26166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436381952 00000100:00100000:0.0:1784189345.129575:0:26166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436381952 00000100:00100000:0.0:1784189345.129621:0:26166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 5044 00000100:00100000:0.0:1784189345.129630:0:26166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc080e7e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:debedd94-805c-42a0-a5e5-41758b2012e9+33:2398:x1870854436381952:12345-192.168.203.12@tcp:16:kworker.0 00000001:00080000:0.0:1784189345.129897:0:8423:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294969001 is committed 00010000:00000080:0.0:1784189345.129947:0:26166:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9dc080e7e300 x1870854436381952/t0(0) o16->debedd94-805c-42a0-a5e5-41758b2012e9@192.168.203.12@tcp:536/0 lens 440/432 e 0 to 0 dl 1784189356 ref 1 fl Interpret:/600/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1784189345.129995:0:26166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc080e7e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:debedd94-805c-42a0-a5e5-41758b2012e9+25:2398:x1870854436381952:12345-192.168.203.12@tcp:16:kworker.0 Request processed in 366us (1677us total) trans 0 rc 0/0 00000100:00100000:0.0:1784189345.130002:0:26166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 5044 00000100:00100000:2.0:1784189345.140409:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1784189345.140454:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1784189345.140582:0:24843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436382080 00000100:00100000:0.0:1784189345.140591:0:24843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436382080 00002000:00100000:0.0:1784189345.140638:0:24843:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x766:0x0] (0->1023) req@ffff9dc080e7c700 x1870854436382080/t0(0) o4->debedd94-805c-42a0-a5e5-41758b2012e9@192.168.203.12@tcp:536/0 lens 1512/0 e 0 to 0 dl 1784189356 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1784189345.140650:0:24843:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9dc080e7c700 with x1870854436382080 ext(0->1023) 00002000:00010000:0.0:1784189345.140655:0:24843:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9dc080e7c700 00000100:00100000:0.0:1784189345.140687:0:24843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1032 00000100:00100000:0.0:1784189345.140696:0:24843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc080e7c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:debedd94-805c-42a0-a5e5-41758b2012e9+25:2396:x1870854436382080:12345-192.168.203.12@tcp:4:dd.0 00000100:00100000:3.0:1784189345.142273:0:9982:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436382208 00000100:00100000:3.0:1784189345.142284:0:9982:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436382208 00000100:00100000:3.0:1784189345.142377:0:9982:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 5045 00000100:00100000:3.0:1784189345.142387:0:9982:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc080e7df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:debedd94-805c-42a0-a5e5-41758b2012e9+26:2396:x1870854436382208:12345-192.168.203.12@tcp:16:kworker.0 00010000:00000080:3.0:1784189345.142434:0:9982:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9dc080e7df80 x1870854436382208/t0(0) o16->debedd94-805c-42a0-a5e5-41758b2012e9@192.168.203.12@tcp:536/0 lens 440/432 e 0 to 0 dl 1784189356 ref 1 fl Interpret:/600/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1784189345.142517:0:9982:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc080e7df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:debedd94-805c-42a0-a5e5-41758b2012e9+26:2396:x1870854436382208:12345-192.168.203.12@tcp:16:kworker.0 Request processed in 133us (2117us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189345.142524:0:9982:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 5045 00010000:00000080:0.0:1784189345.147065:0:24843:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9dc080e7c700 x1870854436382080/t4294969002(0) o4->debedd94-805c-42a0-a5e5-41758b2012e9@192.168.203.12@tcp:536/0 lens 1512/448 e 0 to 0 dl 1784189356 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1784189345.154885:0:24843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc080e7c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:debedd94-805c-42a0-a5e5-41758b2012e9+27:2396:x1870854436382080:12345-192.168.203.12@tcp:4:dd.0 Request processed in 14177us (14417us total) trans 4294969002 rc 0/0 00000100:00100000:0.0:1784189345.154901:0:24843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1032 00002000:00100000:0.0:1784189345.154915:0:24843:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x766:0x0] (0->1023) req@ffff9dc080e7c700 x1870854436382080/t4294969002(0) o4->debedd94-805c-42a0-a5e5-41758b2012e9@192.168.203.12@tcp:536/0 lens 1512/448 e 0 to 0 dl 1784189356 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1784189345.154927:0:24843:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9dc080e7c700 with x1870854436382080 ext(0->1023) 00002000:00010000:0.0:1784189345.154934:0:24843:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9dc080e7c700 00000100:00100000:3.0:1784189345.155186:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1784189345.155221:0:26161:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436382464 00000100:00100000:3.0:1784189345.155228:0:26161:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436382464 00000100:00100000:3.0:1784189345.155270:0:26161:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 5046 00000100:00100000:3.0:1784189345.155279:0:26161:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc080f6bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:debedd94-805c-42a0-a5e5-41758b2012e9+27:2399:x1870854436382464:12345-192.168.203.12@tcp:16:kworker.0 00010000:00000080:3.0:1784189345.155344:0:26161:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9dc080f6bb80 x1870854436382464/t0(0) o16->debedd94-805c-42a0-a5e5-41758b2012e9@192.168.203.12@tcp:536/0 lens 440/432 e 0 to 0 dl 1784189356 ref 1 fl Interpret:/600/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1784189345.155388:0:26161:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc080f6bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:debedd94-805c-42a0-a5e5-41758b2012e9+27:2399:x1870854436382464:12345-192.168.203.12@tcp:16:kworker.0 Request processed in 111us (204us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189345.155395:0:26161:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 5046 00000100:00100000:3.0:1784189345.155469:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1784189345.155488:0:24844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436382336 00000100:00100000:3.0:1784189345.155492:0:24844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436382336 00002000:00100000:3.0:1784189345.155512:0:24844:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x767:0x0] (0->1023) req@ffff9dc080f6a300 x1870854436382336/t0(0) o4->debedd94-805c-42a0-a5e5-41758b2012e9@192.168.203.12@tcp:536/0 lens 1512/0 e 0 to 0 dl 1784189356 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1784189345.155520:0:24844:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9dc080f6a300 with x1870854436382336 ext(0->1023) 00002000:00010000:3.0:1784189345.155523:0:24844:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9dc080f6a300 00000100:00100000:3.0:1784189345.155537:0:24844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1033 00000100:00100000:3.0:1784189345.155543:0:24844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc080f6a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:debedd94-805c-42a0-a5e5-41758b2012e9+27:2399:x1870854436382336:12345-192.168.203.12@tcp:4:dd.0 00010000:00000080:3.0:1784189345.156367:0:24844:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9dc080f6a300 x1870854436382336/t4294969003(0) o4->debedd94-805c-42a0-a5e5-41758b2012e9@192.168.203.12@tcp:536/0 lens 1512/448 e 0 to 0 dl 1784189356 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1784189345.156415:0:24844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc080f6a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:debedd94-805c-42a0-a5e5-41758b2012e9+29:2399:x1870854436382336:12345-192.168.203.12@tcp:4:dd.0 Request processed in 872us (946us total) trans 4294969003 rc 0/0 00000100:00100000:3.0:1784189345.156423:0:24844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1033 00002000:00100000:3.0:1784189345.156431:0:24844:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x767:0x0] (0->1023) req@ffff9dc080f6a300 x1870854436382336/t4294969003(0) o4->debedd94-805c-42a0-a5e5-41758b2012e9@192.168.203.12@tcp:536/0 lens 1512/448 e 0 to 0 dl 1784189356 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1784189345.156438:0:24844:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9dc080f6a300 with x1870854436382336 ext(0->1023) 00002000:00010000:3.0:1784189345.156443:0:24844:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9dc080f6a300 00000100:00100000:1.0:1784189345.162143:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1784189345.162312:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1784189345.169391:0:26168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436382720 00000100:00100000:0.0:1784189345.169407:0:26168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436382720 00000100:00100000:0.0:1784189345.169485:0:26168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 5047 00000100:00100000:0.0:1784189345.169512:0:26168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc07fb37480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:debedd94-805c-42a0-a5e5-41758b2012e9+29:2397:x1870854436382720:12345-192.168.203.12@tcp:16:kworker.0 00010000:00000080:0.0:1784189345.169567:0:26168:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9dc07fb37480 x1870854436382720/t0(0) o16->debedd94-805c-42a0-a5e5-41758b2012e9@192.168.203.12@tcp:536/0 lens 440/432 e 0 to 0 dl 1784189356 ref 1 fl Interpret:/600/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1784189345.169642:0:26168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc07fb37480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:debedd94-805c-42a0-a5e5-41758b2012e9+29:2397:x1870854436382720:12345-192.168.203.12@tcp:16:kworker.0 Request processed in 132us (7329us total) trans 0 rc 0/0 00000100:00100000:0.0:1784189345.169650:0:26168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 5047 00000100:00100000:3.0:1784189345.170377:0:24833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436382592 00000100:00100000:3.0:1784189345.170384:0:24833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436382592 00002000:00100000:2.0:1784189345.170622:0:24833:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x768:0x0] (0->1023) req@ffff9dbf4693f100 x1870854436382592/t0(0) o4->debedd94-805c-42a0-a5e5-41758b2012e9@192.168.203.12@tcp:536/0 lens 1512/0 e 0 to 0 dl 1784189356 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1784189345.170632:0:24833:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9dbf4693f100 with x1870854436382592 ext(0->1023) 00002000:00010000:2.0:1784189345.170637:0:24833:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9dbf4693f100 00000100:00100000:2.0:1784189345.170664:0:24833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1034 00000100:00100000:2.0:1784189345.170672:0:24833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf4693f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:debedd94-805c-42a0-a5e5-41758b2012e9+29:2397:x1870854436382592:12345-192.168.203.12@tcp:4:dd.0 00010000:00000080:1.0:1784189345.171372:0:24833:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9dbf4693f100 x1870854436382592/t4294969004(0) o4->debedd94-805c-42a0-a5e5-41758b2012e9@192.168.203.12@tcp:536/0 lens 1512/448 e 0 to 0 dl 1784189356 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1784189345.171429:0:24833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf4693f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:debedd94-805c-42a0-a5e5-41758b2012e9+31:2397:x1870854436382592:12345-192.168.203.12@tcp:4:dd.0 Request processed in 758us (9295us total) trans 4294969004 rc 0/0 00000100:00100000:1.0:1784189345.171448:0:24833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1034 00002000:00100000:1.0:1784189345.171456:0:24833:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x768:0x0] (0->1023) req@ffff9dbf4693f100 x1870854436382592/t4294969004(0) o4->debedd94-805c-42a0-a5e5-41758b2012e9@192.168.203.12@tcp:536/0 lens 1512/448 e 0 to 0 dl 1784189356 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1784189345.171464:0:24833:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9dbf4693f100 with x1870854436382592 ext(0->1023) 00002000:00010000:1.0:1784189345.171468:0:24833:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9dbf4693f100 00000100:00100000:3.0:1784189345.174138:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1784189345.174192:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1784189345.174277:0:26162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436382976 00000100:00100000:0.0:1784189345.174286:0:26162:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436382976 00000100:00100000:0.0:1784189345.174352:0:26162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 5048 00000100:00100000:0.0:1784189345.174363:0:26162:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc080f69c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:debedd94-805c-42a0-a5e5-41758b2012e9+31:2398:x1870854436382976:12345-192.168.203.12@tcp:16:kworker.0 00010000:00000080:0.0:1784189345.174415:0:26162:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9dc080f69c00 x1870854436382976/t0(0) o16->debedd94-805c-42a0-a5e5-41758b2012e9@192.168.203.12@tcp:536/0 lens 440/432 e 0 to 0 dl 1784189356 ref 1 fl Interpret:/600/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1784189345.174475:0:26162:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc080f69c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:debedd94-805c-42a0-a5e5-41758b2012e9+31:2398:x1870854436382976:12345-192.168.203.12@tcp:16:kworker.0 Request processed in 114us (345us total) trans 0 rc 0/0 00000100:00100000:0.0:1784189345.174483:0:26162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 5048 00000100:00100000:2.0:1784189345.174896:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436382848 00000100:00100000:2.0:1784189345.174901:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436382848 00002000:00100000:2.0:1784189345.174927:0:8434:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x769:0x0] (0->1023) req@ffff9dc07b9cc850 x1870854436382848/t0(0) o4->debedd94-805c-42a0-a5e5-41758b2012e9@192.168.203.12@tcp:536/0 lens 1512/0 e 0 to 0 dl 1784189356 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1784189345.174937:0:8434:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9dc07b9cc850 with x1870854436382848 ext(0->1023) 00002000:00010000:2.0:1784189345.174942:0:8434:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9dc07b9cc850 00000100:00100000:2.0:1784189345.174967:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1035 00000100:00100000:2.0:1784189345.174975:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc07b9cc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:debedd94-805c-42a0-a5e5-41758b2012e9+31:2398:x1870854436382848:12345-192.168.203.12@tcp:4:dd.0 00010000:00000080:2.0:1784189345.175384:0:8434:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9dc07b9cc850 x1870854436382848/t4294969005(0) o4->debedd94-805c-42a0-a5e5-41758b2012e9@192.168.203.12@tcp:536/0 lens 1512/448 e 0 to 0 dl 1784189356 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1784189345.175434:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc07b9cc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:debedd94-805c-42a0-a5e5-41758b2012e9+33:2398:x1870854436382848:12345-192.168.203.12@tcp:4:dd.0 Request processed in 460us (1241us total) trans 4294969005 rc 0/0 00000100:00100000:2.0:1784189345.175441:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1035 00002000:00100000:2.0:1784189345.175448:0:8434:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x769:0x0] (0->1023) req@ffff9dc07b9cc850 x1870854436382848/t4294969005(0) o4->debedd94-805c-42a0-a5e5-41758b2012e9@192.168.203.12@tcp:536/0 lens 1512/448 e 0 to 0 dl 1784189356 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1784189345.175456:0:8434:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9dc07b9cc850 with x1870854436382848 ext(0->1023) 00002000:00010000:2.0:1784189345.175460:0:8434:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9dc07b9cc850 00000100:00100000:3.0:1784189345.178686:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1784189345.178722:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1784189345.178778:0:26165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436383232 00000100:00100000:1.0:1784189345.178786:0:26165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436383232 00000100:00100000:1.0:1784189345.178878:0:26165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 5049 00000100:00100000:1.0:1784189345.178888:0:26165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc080f6b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:debedd94-805c-42a0-a5e5-41758b2012e9+33:2398:x1870854436383232:12345-192.168.203.12@tcp:16:kworker.0 00000100:00100000:2.0:1784189345.178928:0:24846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436383104 00000100:00100000:2.0:1784189345.178934:0:24846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436383104 00010000:00000080:1.0:1784189345.178936:0:26165:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9dc080f6b800 x1870854436383232/t0(0) o16->debedd94-805c-42a0-a5e5-41758b2012e9@192.168.203.12@tcp:536/0 lens 440/432 e 0 to 0 dl 1784189356 ref 1 fl Interpret:/600/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1784189345.178965:0:24846:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x76a:0x0] (0->1023) req@ffff9dc080f68380 x1870854436383104/t0(0) o4->debedd94-805c-42a0-a5e5-41758b2012e9@192.168.203.12@tcp:536/0 lens 1512/0 e 0 to 0 dl 1784189356 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1784189345.178975:0:24846:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9dc080f68380 with x1870854436383104 ext(0->1023) 00000100:00100000:1.0:1784189345.178997:0:26165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc080f6b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:debedd94-805c-42a0-a5e5-41758b2012e9+34:2398:x1870854436383232:12345-192.168.203.12@tcp:16:kworker.0 Request processed in 109us (272us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189345.179004:0:26165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 5049 00002000:00010000:2.0:1784189345.179242:0:24846:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9dc080f68380 00000100:00100000:2.0:1784189345.179306:0:24846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1036 00000100:00100000:2.0:1784189345.179315:0:24846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc080f68380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:debedd94-805c-42a0-a5e5-41758b2012e9+33:2398:x1870854436383104:12345-192.168.203.12@tcp:4:dd.0 00010000:00000080:2.0:1784189345.179645:0:24846:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9dc080f68380 x1870854436383104/t4294969006(0) o4->debedd94-805c-42a0-a5e5-41758b2012e9@192.168.203.12@tcp:536/0 lens 1512/448 e 0 to 0 dl 1784189356 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1784189345.179682:0:24846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc080f68380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:debedd94-805c-42a0-a5e5-41758b2012e9+35:2398:x1870854436383104:12345-192.168.203.12@tcp:4:dd.0 Request processed in 368us (1003us total) trans 4294969006 rc 0/0 00000100:00100000:2.0:1784189345.179689:0:24846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1036 00002000:00100000:2.0:1784189345.179695:0:24846:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x76a:0x0] (0->1023) req@ffff9dc080f68380 x1870854436383104/t4294969006(0) o4->debedd94-805c-42a0-a5e5-41758b2012e9@192.168.203.12@tcp:536/0 lens 1512/448 e 0 to 0 dl 1784189356 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1784189345.179704:0:24846:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9dc080f68380 with x1870854436383104 ext(0->1023) 00002000:00010000:2.0:1784189345.179714:0:24846:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9dc080f68380 00000100:00100000:2.0:1784189345.190419:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1784189345.190841:0:26167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436383488 00000100:00100000:3.0:1784189345.190852:0:26167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436383488 00000100:00100000:3.0:1784189345.190916:0:26167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 5050 00000100:00100000:3.0:1784189345.190926:0:26167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc080e7d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:debedd94-805c-42a0-a5e5-41758b2012e9+35:2398:x1870854436383488:12345-192.168.203.12@tcp:16:kworker.0 00010000:00000080:3.0:1784189345.190982:0:26167:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9dc080e7d880 x1870854436383488/t0(0) o16->debedd94-805c-42a0-a5e5-41758b2012e9@192.168.203.12@tcp:536/0 lens 440/432 e 0 to 0 dl 1784189356 ref 1 fl Interpret:/600/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1784189345.191043:0:26167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc080e7d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:debedd94-805c-42a0-a5e5-41758b2012e9+35:2398:x1870854436383488:12345-192.168.203.12@tcp:16:kworker.0 Request processed in 119us (634us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189345.191062:0:26167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 5050 00000100:00100000:0.0:1784189345.191477:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1784189345.193984:0:24831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436383360 00000100:00100000:3.0:1784189345.193999:0:24831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436383360 00002000:00100000:3.0:1784189345.194046:0:24831:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x76b:0x0] (0->1023) req@ffff9dbf47544a80 x1870854436383360/t0(0) o4->debedd94-805c-42a0-a5e5-41758b2012e9@192.168.203.12@tcp:536/0 lens 1512/0 e 0 to 0 dl 1784189356 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1784189345.194072:0:24831:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9dbf47544a80 with x1870854436383360 ext(0->1023) 00002000:00010000:3.0:1784189345.194078:0:24831:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9dbf47544a80 00000100:00100000:3.0:1784189345.194116:0:24831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1037 00000100:00100000:3.0:1784189345.194125:0:24831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf47544a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:debedd94-805c-42a0-a5e5-41758b2012e9+35:2398:x1870854436383360:12345-192.168.203.12@tcp:4:dd.0 00010000:00000080:3.0:1784189345.194626:0:24831:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9dbf47544a80 x1870854436383360/t4294969007(0) o4->debedd94-805c-42a0-a5e5-41758b2012e9@192.168.203.12@tcp:536/0 lens 1512/448 e 0 to 0 dl 1784189356 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1784189345.194695:0:24831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf47544a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:debedd94-805c-42a0-a5e5-41758b2012e9+37:2398:x1870854436383360:12345-192.168.203.12@tcp:4:dd.0 Request processed in 571us (3220us total) trans 4294969007 rc 0/0 00000100:00100000:3.0:1784189345.194703:0:24831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1037 00002000:00100000:3.0:1784189345.194710:0:24831:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x76b:0x0] (0->1023) req@ffff9dbf47544a80 x1870854436383360/t4294969007(0) o4->debedd94-805c-42a0-a5e5-41758b2012e9@192.168.203.12@tcp:536/0 lens 1512/448 e 0 to 0 dl 1784189356 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1784189345.194718:0:24831:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9dbf47544a80 with x1870854436383360 ext(0->1023) 00002000:00010000:3.0:1784189345.194722:0:24831:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9dbf47544a80 00000100:00100000:0.0:1784189345.194995:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1784189345.195112:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1784189345.195138:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436383744 00000100:00100000:0.0:1784189345.195143:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436383744 00000100:00100000:3.0:1784189345.195340:0:24843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436383616 00000100:00100000:3.0:1784189345.195344:0:24843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436383616 00002000:00100000:3.0:1784189345.195360:0:24843:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x76c:0x0] (0->1023) req@ffff9dbf47545880 x1870854436383616/t0(0) o4->debedd94-805c-42a0-a5e5-41758b2012e9@192.168.203.12@tcp:536/0 lens 1512/0 e 0 to 0 dl 1784189356 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1784189345.195367:0:24843:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9dbf47545880 with x1870854436383616 ext(0->1023) 00002000:00010000:3.0:1784189345.195370:0:24843:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9dbf47545880 00000100:00100000:3.0:1784189345.195387:0:24843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1038 00000100:00100000:3.0:1784189345.195395:0:24843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf47545880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:debedd94-805c-42a0-a5e5-41758b2012e9+38:2399:x1870854436383616:12345-192.168.203.12@tcp:4:dd.0 00010000:00000080:3.0:1784189345.195576:0:24843:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9dbf47545880 x1870854436383616/t4294969008(0) o4->debedd94-805c-42a0-a5e5-41758b2012e9@192.168.203.12@tcp:536/0 lens 1512/448 e 0 to 0 dl 1784189356 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1784189345.195613:0:24843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf47545880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:debedd94-805c-42a0-a5e5-41758b2012e9+40:2399:x1870854436383616:12345-192.168.203.12@tcp:4:dd.0 Request processed in 220us (619us total) trans 4294969008 rc 0/0 00000100:00100000:3.0:1784189345.195617:0:24843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1038 00002000:00100000:3.0:1784189345.195622:0:24843:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x76c:0x0] (0->1023) req@ffff9dbf47545880 x1870854436383616/t4294969008(0) o4->debedd94-805c-42a0-a5e5-41758b2012e9@192.168.203.12@tcp:536/0 lens 1512/448 e 0 to 0 dl 1784189356 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1784189345.195627:0:24843:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9dbf47545880 with x1870854436383616 ext(0->1023) 00002000:00010000:3.0:1784189345.195629:0:24843:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9dbf47545880 00000100:00100000:0.0:1784189345.195863:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 5051 00000100:00100000:0.0:1784189345.195872:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf47544700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:debedd94-805c-42a0-a5e5-41758b2012e9+39:2399:x1870854436383744:12345-192.168.203.12@tcp:16:kworker.0 00000001:00080000:0.0:1784189345.196129:0:8423:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294969008 is committed 00010000:00000080:2.0:1784189345.196219:0:8429:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9dbf47544700 x1870854436383744/t0(0) o16->debedd94-805c-42a0-a5e5-41758b2012e9@192.168.203.12@tcp:536/0 lens 440/432 e 0 to 0 dl 1784189356 ref 1 fl Interpret:/600/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1784189345.196261:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf47544700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:debedd94-805c-42a0-a5e5-41758b2012e9+25:2399:x1870854436383744:12345-192.168.203.12@tcp:16:kworker.0 Request processed in 391us (1149us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189345.196269:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 5051 00000100:00100000:0.0:1784189345.209241:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1784189345.209263:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1784189345.209296:0:26170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436384000 00000100:00100000:0.0:1784189345.209312:0:26170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436384000 00000100:00100000:0.0:1784189345.209397:0:26170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 5052 00000100:00100000:0.0:1784189345.209408:0:26170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc080f68e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:debedd94-805c-42a0-a5e5-41758b2012e9+25:2396:x1870854436384000:12345-192.168.203.12@tcp:16:kworker.0 00010000:00000080:0.0:1784189345.209465:0:26170:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9dc080f68e00 x1870854436384000/t0(0) o16->debedd94-805c-42a0-a5e5-41758b2012e9@192.168.203.12@tcp:536/0 lens 440/432 e 0 to 0 dl 1784189356 ref 1 fl Interpret:/600/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1784189345.209523:0:26170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc080f68e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:debedd94-805c-42a0-a5e5-41758b2012e9+25:2396:x1870854436384000:12345-192.168.203.12@tcp:16:kworker.0 Request processed in 117us (261us total) trans 0 rc 0/0 00000100:00100000:0.0:1784189345.209531:0:26170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 5052 00000100:00100000:2.0:1784189345.212220:0:25599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436383872 00000100:00100000:2.0:1784189345.212233:0:25599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436383872 00002000:00100000:2.0:1784189345.212283:0:25599:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x76d:0x0] (0->1023) req@ffff9dbf47545180 x1870854436383872/t0(0) o4->debedd94-805c-42a0-a5e5-41758b2012e9@192.168.203.12@tcp:536/0 lens 1512/0 e 0 to 0 dl 1784189356 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1784189345.212294:0:25599:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9dbf47545180 with x1870854436383872 ext(0->1023) 00002000:00010000:2.0:1784189345.212299:0:25599:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9dbf47545180 00000100:00100000:2.0:1784189345.212354:0:25599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1039 00000100:00100000:2.0:1784189345.212364:0:25599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf47545180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:debedd94-805c-42a0-a5e5-41758b2012e9+25:2397:x1870854436383872:12345-192.168.203.12@tcp:4:dd.0 00010000:00000080:2.0:1784189345.212726:0:25599:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9dbf47545180 x1870854436383872/t4294969009(0) o4->debedd94-805c-42a0-a5e5-41758b2012e9@192.168.203.12@tcp:536/0 lens 1512/448 e 0 to 0 dl 1784189356 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1784189345.212803:0:25599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf47545180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:debedd94-805c-42a0-a5e5-41758b2012e9+27:2397:x1870854436383872:12345-192.168.203.12@tcp:4:dd.0 Request processed in 431us (3561us total) trans 4294969009 rc 0/0 00000100:00100000:2.0:1784189345.212813:0:25599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1039 00002000:00100000:2.0:1784189345.212819:0:25599:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x76d:0x0] (0->1023) req@ffff9dbf47545180 x1870854436383872/t4294969009(0) o4->debedd94-805c-42a0-a5e5-41758b2012e9@192.168.203.12@tcp:536/0 lens 1512/448 e 0 to 0 dl 1784189356 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1784189345.212828:0:25599:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9dbf47545180 with x1870854436383872 ext(0->1023) 00002000:00010000:2.0:1784189345.212831:0:25599:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9dbf47545180 00000100:00100000:3.0:1784189345.213836:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1784189345.214039:0:24833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436384128 00000100:00100000:2.0:1784189345.214046:0:24833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436384128 00002000:00100000:2.0:1784189345.214076:0:24833:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x76e:0x0] (0->1023) req@ffff9dc080f6a300 x1870854436384128/t0(0) o4->debedd94-805c-42a0-a5e5-41758b2012e9@192.168.203.12@tcp:536/0 lens 1512/0 e 0 to 0 dl 1784189356 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1784189345.214085:0:24833:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9dc080f6a300 with x1870854436384128 ext(0->1023) 00002000:00010000:2.0:1784189345.214089:0:24833:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9dc080f6a300 00000100:00100000:2.0:1784189345.214119:0:24833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1040 00000100:00100000:2.0:1784189345.214128:0:24833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc080f6a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:debedd94-805c-42a0-a5e5-41758b2012e9+27:2397:x1870854436384128:12345-192.168.203.12@tcp:4:dd.0 00010000:00000080:2.0:1784189345.214671:0:24833:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9dc080f6a300 x1870854436384128/t4294969010(0) o4->debedd94-805c-42a0-a5e5-41758b2012e9@192.168.203.12@tcp:536/0 lens 1512/448 e 0 to 0 dl 1784189356 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1784189345.215019:0:24833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc080f6a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:debedd94-805c-42a0-a5e5-41758b2012e9+29:2397:x1870854436384128:12345-192.168.203.12@tcp:4:dd.0 Request processed in 890us (1184us total) trans 4294969010 rc 0/0 00000100:00100000:2.0:1784189345.215029:0:24833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1040 00002000:00100000:2.0:1784189345.215037:0:24833:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x76e:0x0] (0->1023) req@ffff9dc080f6a300 x1870854436384128/t4294969010(0) o4->debedd94-805c-42a0-a5e5-41758b2012e9@192.168.203.12@tcp:536/0 lens 1512/448 e 0 to 0 dl 1784189356 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1784189345.215047:0:24833:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9dc080f6a300 with x1870854436384128 ext(0->1023) 00002000:00010000:2.0:1784189345.215051:0:24833:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9dc080f6a300 00000100:00100000:3.0:1784189345.215458:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1784189345.215499:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436384256 00000100:00100000:3.0:1784189345.215505:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436384256 00000100:00100000:3.0:1784189345.215548:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 5053 00000100:00100000:3.0:1784189345.215556:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf4859b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:debedd94-805c-42a0-a5e5-41758b2012e9+29:2396:x1870854436384256:12345-192.168.203.12@tcp:16:kworker.0 00000001:00080000:3.0:1784189345.216072:0:8423:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294969010 is committed 00010000:00000080:0.0:1784189345.216158:0:8428:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9dbf4859b800 x1870854436384256/t0(0) o16->debedd94-805c-42a0-a5e5-41758b2012e9@192.168.203.12@tcp:536/0 lens 440/432 e 0 to 0 dl 1784189356 ref 1 fl Interpret:/600/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1784189345.216214:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf4859b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:debedd94-805c-42a0-a5e5-41758b2012e9+25:2396:x1870854436384256:12345-192.168.203.12@tcp:16:kworker.0 Request processed in 659us (757us total) trans 0 rc 0/0 00000100:00100000:0.0:1784189345.216222:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 5053 00000100:00100000:3.0:1784189345.220300:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1784189345.220358:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1784189345.221057:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436384384 00000100:00100000:2.0:1784189345.221067:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436384384 00002000:00100000:2.0:1784189345.221118:0:8434:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x76f:0x0] (0->1023) req@ffff9dbf48598700 x1870854436384384/t0(0) o4->debedd94-805c-42a0-a5e5-41758b2012e9@192.168.203.12@tcp:536/0 lens 1512/0 e 0 to 0 dl 1784189356 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1784189345.221129:0:8434:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9dbf48598700 with x1870854436384384 ext(0->1023) 00002000:00010000:2.0:1784189345.221134:0:8434:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9dbf48598700 00000100:00100000:2.0:1784189345.221165:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1041 00000100:00100000:2.0:1784189345.221175:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf48598700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:debedd94-805c-42a0-a5e5-41758b2012e9+25:2399:x1870854436384384:12345-192.168.203.12@tcp:4:dd.0 00010000:00000080:2.0:1784189345.221558:0:8434:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9dbf48598700 x1870854436384384/t4294969011(0) o4->debedd94-805c-42a0-a5e5-41758b2012e9@192.168.203.12@tcp:536/0 lens 1512/448 e 0 to 0 dl 1784189356 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1784189345.221610:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf48598700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:debedd94-805c-42a0-a5e5-41758b2012e9+27:2399:x1870854436384384:12345-192.168.203.12@tcp:4:dd.0 Request processed in 437us (1320us total) trans 4294969011 rc 0/0 00000100:00100000:2.0:1784189345.221617:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1041 00002000:00100000:2.0:1784189345.221624:0:8434:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x76f:0x0] (0->1023) req@ffff9dbf48598700 x1870854436384384/t4294969011(0) o4->debedd94-805c-42a0-a5e5-41758b2012e9@192.168.203.12@tcp:536/0 lens 1512/448 e 0 to 0 dl 1784189356 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1784189345.221632:0:8434:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9dbf48598700 with x1870854436384384 ext(0->1023) 00002000:00010000:2.0:1784189345.221635:0:8434:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9dbf48598700 00000100:00100000:1.0:1784189345.222377:0:26160:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436384512 00000100:00100000:1.0:1784189345.222386:0:26160:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436384512 00000100:00100000:1.0:1784189345.222488:0:26160:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 5054 00000100:00100000:1.0:1784189345.222497:0:26160:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf4859ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:debedd94-805c-42a0-a5e5-41758b2012e9+27:2399:x1870854436384512:12345-192.168.203.12@tcp:16:kworker.0 00000001:00080000:0.0:1784189345.223313:0:8423:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294969011 is committed 00010000:00000080:3.0:1784189345.225379:0:26160:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9dbf4859ad80 x1870854436384512/t0(0) o16->debedd94-805c-42a0-a5e5-41758b2012e9@192.168.203.12@tcp:536/0 lens 440/432 e 0 to 0 dl 1784189356 ref 1 fl Interpret:/600/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1784189345.225462:0:26160:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf4859ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:debedd94-805c-42a0-a5e5-41758b2012e9+25:2399:x1870854436384512:12345-192.168.203.12@tcp:16:kworker.0 Request processed in 2966us (5102us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189345.225472:0:26160:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 5054 00000100:00100000:3.0:1784189345.231446:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1784189345.231506:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1784189345.231665:0:26223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436384768 00000100:00100000:2.0:1784189345.231674:0:26223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436384768 00000100:00100000:2.0:1784189345.231721:0:26223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 5055 00000100:00100000:2.0:1784189345.231730:0:26223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf48598380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:debedd94-805c-42a0-a5e5-41758b2012e9+25:2396:x1870854436384768:12345-192.168.203.12@tcp:16:kworker.0 00010000:00000080:2.0:1784189345.231782:0:26223:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9dbf48598380 x1870854436384768/t0(0) o16->debedd94-805c-42a0-a5e5-41758b2012e9@192.168.203.12@tcp:536/0 lens 440/432 e 0 to 0 dl 1784189356 ref 1 fl Interpret:/600/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1784189345.231855:0:26223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf48598380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:debedd94-805c-42a0-a5e5-41758b2012e9+25:2396:x1870854436384768:12345-192.168.203.12@tcp:16:kworker.0 Request processed in 125us (417us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189345.231862:0:26223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 5055 00000100:00100000:2.0:1784189345.231885:0:24846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436384640 00000100:00100000:2.0:1784189345.231888:0:24846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436384640 00002000:00100000:2.0:1784189345.231908:0:24846:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x770:0x0] (0->1023) req@ffff9dbf48599f80 x1870854436384640/t0(0) o4->debedd94-805c-42a0-a5e5-41758b2012e9@192.168.203.12@tcp:536/0 lens 1512/0 e 0 to 0 dl 1784189356 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1784189345.231916:0:24846:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9dbf48599f80 with x1870854436384640 ext(0->1023) 00002000:00010000:2.0:1784189345.231921:0:24846:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9dbf48599f80 00000100:00100000:2.0:1784189345.231947:0:24846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1042 00000100:00100000:2.0:1784189345.231955:0:24846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf48599f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:debedd94-805c-42a0-a5e5-41758b2012e9+25:2396:x1870854436384640:12345-192.168.203.12@tcp:4:dd.0 00010000:00000080:2.0:1784189345.232303:0:24846:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9dbf48599f80 x1870854436384640/t4294969012(0) o4->debedd94-805c-42a0-a5e5-41758b2012e9@192.168.203.12@tcp:536/0 lens 1512/448 e 0 to 0 dl 1784189356 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1784189345.232362:0:24846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf48599f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:debedd94-805c-42a0-a5e5-41758b2012e9+27:2396:x1870854436384640:12345-192.168.203.12@tcp:4:dd.0 Request processed in 407us (855us total) trans 4294969012 rc 0/0 00000100:00100000:2.0:1784189345.232369:0:24846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1042 00002000:00100000:2.0:1784189345.232375:0:24846:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x770:0x0] (0->1023) req@ffff9dbf48599f80 x1870854436384640/t4294969012(0) o4->debedd94-805c-42a0-a5e5-41758b2012e9@192.168.203.12@tcp:536/0 lens 1512/448 e 0 to 0 dl 1784189356 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1784189345.232383:0:24846:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9dbf48599f80 with x1870854436384640 ext(0->1023) 00002000:00010000:2.0:1784189345.232386:0:24846:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9dbf48599f80 00000100:00100000:3.0:1784189345.239431:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1784189345.239476:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1784189345.239505:0:14684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436385024 00000100:00100000:0.0:1784189345.239511:0:24831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436384896 00000100:00100000:3.0:1784189345.239514:0:14684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436385024 00000100:00100000:0.0:1784189345.239518:0:24831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436384896 00002000:00100000:0.0:1784189345.239564:0:24831:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x771:0x0] (0->1023) req@ffff9dbf470e0700 x1870854436384896/t0(0) o4->debedd94-805c-42a0-a5e5-41758b2012e9@192.168.203.12@tcp:536/0 lens 1512/0 e 0 to 0 dl 1784189356 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1784189345.239572:0:14684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 5056 00000100:00100000:3.0:1784189345.239585:0:14684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc07b5b1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:debedd94-805c-42a0-a5e5-41758b2012e9+28:2399:x1870854436385024:12345-192.168.203.12@tcp:16:kworker.0 00010000:00000080:3.0:1784189345.239628:0:14684:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9dc07b5b1880 x1870854436385024/t0(0) o16->debedd94-805c-42a0-a5e5-41758b2012e9@192.168.203.12@tcp:536/0 lens 440/432 e 0 to 0 dl 1784189356 ref 1 fl Interpret:/600/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1784189345.239655:0:24831:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9dbf470e0700 with x1870854436384896 ext(0->1023) 00002000:00010000:0.0:1784189345.239662:0:24831:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9dbf470e0700 00000100:00100000:3.0:1784189345.239679:0:14684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc07b5b1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:debedd94-805c-42a0-a5e5-41758b2012e9+28:2399:x1870854436385024:12345-192.168.203.12@tcp:16:kworker.0 Request processed in 96us (202us total) trans 0 rc 0/0 00000100:00100000:0.0:1784189345.239689:0:24831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1043 00000100:00100000:3.0:1784189345.239690:0:14684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 5056 00000100:00100000:0.0:1784189345.239702:0:24831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf470e0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:debedd94-805c-42a0-a5e5-41758b2012e9+28:2398:x1870854436384896:12345-192.168.203.12@tcp:4:dd.0 00010000:00000080:0.0:1784189345.240041:0:24831:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9dbf470e0700 x1870854436384896/t4294969013(0) o4->debedd94-805c-42a0-a5e5-41758b2012e9@192.168.203.12@tcp:536/0 lens 1512/448 e 0 to 0 dl 1784189356 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1784189345.240090:0:24831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf470e0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:debedd94-805c-42a0-a5e5-41758b2012e9+29:2398:x1870854436384896:12345-192.168.203.12@tcp:4:dd.0 Request processed in 391us (667us total) trans 4294969013 rc 0/0 00000100:00100000:0.0:1784189345.240103:0:24831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1043 00002000:00100000:0.0:1784189345.240110:0:24831:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x771:0x0] (0->1023) req@ffff9dbf470e0700 x1870854436384896/t4294969013(0) o4->debedd94-805c-42a0-a5e5-41758b2012e9@192.168.203.12@tcp:536/0 lens 1512/448 e 0 to 0 dl 1784189356 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1784189345.240118:0:24831:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9dbf470e0700 with x1870854436384896 ext(0->1023) 00002000:00010000:0.0:1784189345.240122:0:24831:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9dbf470e0700 00000100:00100000:1.0:1784189345.249234:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1784189345.249375:0:24844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436385152 00000100:00100000:3.0:1784189345.249385:0:24844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436385152 00002000:00100000:3.0:1784189345.249436:0:24844:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x772:0x0] (0->1023) req@ffff9dc07fb36d80 x1870854436385152/t0(0) o4->debedd94-805c-42a0-a5e5-41758b2012e9@192.168.203.12@tcp:536/0 lens 1512/0 e 0 to 0 dl 1784189356 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1784189345.249447:0:24844:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9dc07fb36d80 with x1870854436385152 ext(0->1023) 00002000:00010000:3.0:1784189345.249453:0:24844:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9dc07fb36d80 00000100:00100000:3.0:1784189345.249485:0:24844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1044 00000100:00100000:3.0:1784189345.249494:0:24844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc07fb36d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:debedd94-805c-42a0-a5e5-41758b2012e9+29:2398:x1870854436385152:12345-192.168.203.12@tcp:4:dd.0 00010000:00000080:3.0:1784189345.249844:0:24844:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9dc07fb36d80 x1870854436385152/t4294969014(0) o4->debedd94-805c-42a0-a5e5-41758b2012e9@192.168.203.12@tcp:536/0 lens 1512/448 e 0 to 0 dl 1784189356 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1784189345.252875:0:24844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc07fb36d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:debedd94-805c-42a0-a5e5-41758b2012e9+31:2398:x1870854436385152:12345-192.168.203.12@tcp:4:dd.0 Request processed in 416us (684us total) trans 4294969014 rc 0/0 00000100:00100000:3.0:1784189345.252901:0:24844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1044 00000100:00100000:2.0:1784189345.253044:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00002000:00100000:3.0:1784189345.253513:0:24844:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x772:0x0] (0->1023) req@ffff9dc07fb36d80 x1870854436385152/t4294969014(0) o4->debedd94-805c-42a0-a5e5-41758b2012e9@192.168.203.12@tcp:536/0 lens 1512/448 e 0 to 0 dl 1784189356 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1784189345.253530:0:24844:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9dc07fb36d80 with x1870854436385152 ext(0->1023) 00002000:00010000:3.0:1784189345.253536:0:24844:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9dc07fb36d80 00000100:00100000:1.0:1784189345.254010:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436385280 00000100:00100000:1.0:1784189345.254020:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436385280 00000100:00100000:1.0:1784189345.254067:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 5057 00000100:00100000:1.0:1784189345.254077:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc081cd1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:debedd94-805c-42a0-a5e5-41758b2012e9+31:2398:x1870854436385280:12345-192.168.203.12@tcp:16:kworker.0 00000001:00080000:2.0:1784189345.257014:0:8423:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294969014 is committed 00010000:00000080:1.0:1784189345.257200:0:8427:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9dc081cd1c50 x1870854436385280/t0(0) o16->debedd94-805c-42a0-a5e5-41758b2012e9@192.168.203.12@tcp:536/0 lens 440/432 e 0 to 0 dl 1784189356 ref 1 fl Interpret:/600/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1784189345.257297:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc081cd1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:debedd94-805c-42a0-a5e5-41758b2012e9+25:2398:x1870854436385280:12345-192.168.203.12@tcp:16:kworker.0 Request processed in 3220us (4252us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189345.257306:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 5057 00000100:00100000:3.0:1784189345.264955:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1784189345.265022:0:25599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436385408 00000100:00100000:0.0:1784189345.265032:0:25599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436385408 00002000:00100000:0.0:1784189345.265086:0:25599:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x773:0x0] (0->1023) req@ffff9dc07b5b3b80 x1870854436385408/t0(0) o4->debedd94-805c-42a0-a5e5-41758b2012e9@192.168.203.12@tcp:536/0 lens 1512/0 e 0 to 0 dl 1784189356 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1784189345.265096:0:25599:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9dc07b5b3b80 with x1870854436385408 ext(0->1023) 00002000:00010000:0.0:1784189345.265101:0:25599:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9dc07b5b3b80 00000100:00100000:0.0:1784189345.265133:0:25599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1045 00000100:00100000:0.0:1784189345.265143:0:25599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc07b5b3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:debedd94-805c-42a0-a5e5-41758b2012e9+25:2397:x1870854436385408:12345-192.168.203.12@tcp:4:dd.0 00010000:00000080:0.0:1784189345.265529:0:25599:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9dc07b5b3b80 x1870854436385408/t4294969015(0) o4->debedd94-805c-42a0-a5e5-41758b2012e9@192.168.203.12@tcp:536/0 lens 1512/448 e 0 to 0 dl 1784189356 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1784189345.265590:0:25599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc07b5b3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:debedd94-805c-42a0-a5e5-41758b2012e9+27:2397:x1870854436385408:12345-192.168.203.12@tcp:4:dd.0 Request processed in 448us (642us total) trans 4294969015 rc 0/0 00000100:00100000:0.0:1784189345.265598:0:25599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1045 00002000:00100000:0.0:1784189345.265605:0:25599:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x773:0x0] (0->1023) req@ffff9dc07b5b3b80 x1870854436385408/t4294969015(0) o4->debedd94-805c-42a0-a5e5-41758b2012e9@192.168.203.12@tcp:536/0 lens 1512/448 e 0 to 0 dl 1784189356 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1784189345.265614:0:25599:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9dc07b5b3b80 with x1870854436385408 ext(0->1023) 00002000:00010000:0.0:1784189345.265618:0:25599:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9dc07b5b3b80 00000100:00100000:3.0:1784189345.268293:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1784189345.268509:0:26162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436385536 00000100:00100000:0.0:1784189345.268531:0:26162:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436385536 00000100:00100000:0.0:1784189345.268585:0:26162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 5058 00000100:00100000:0.0:1784189345.268594:0:26162:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc07b5b1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:debedd94-805c-42a0-a5e5-41758b2012e9+27:2396:x1870854436385536:12345-192.168.203.12@tcp:16:kworker.0 00000001:00080000:1.0:1784189345.268884:0:8423:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294969015 is committed 00010000:00000080:0.0:1784189345.269072:0:26162:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9dc07b5b1180 x1870854436385536/t0(0) o16->debedd94-805c-42a0-a5e5-41758b2012e9@192.168.203.12@tcp:536/0 lens 440/432 e 0 to 0 dl 1784189356 ref 1 fl Interpret:/600/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1784189345.269137:0:26162:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc07b5b1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:debedd94-805c-42a0-a5e5-41758b2012e9+25:2396:x1870854436385536:12345-192.168.203.12@tcp:16:kworker.0 Request processed in 544us (851us total) trans 0 rc 0/0 00000100:00100000:0.0:1784189345.269144:0:26162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 5058 00000100:00100000:0.0:1784189345.273983:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1784189345.274137:0:24833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436385664 00000100:00100000:1.0:1784189345.274147:0:24833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436385664 00002000:00100000:1.0:1784189345.274205:0:24833:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x774:0x0] (0->1023) req@ffff9dbf47544700 x1870854436385664/t0(0) o4->debedd94-805c-42a0-a5e5-41758b2012e9@192.168.203.12@tcp:536/0 lens 1512/0 e 0 to 0 dl 1784189356 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1784189345.274218:0:24833:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9dbf47544700 with x1870854436385664 ext(0->1023) 00002000:00010000:1.0:1784189345.274224:0:24833:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9dbf47544700 00000100:00100000:1.0:1784189345.274256:0:24833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1046 00000100:00100000:1.0:1784189345.274265:0:24833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf47544700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:debedd94-805c-42a0-a5e5-41758b2012e9+25:2398:x1870854436385664:12345-192.168.203.12@tcp:4:dd.0 00010000:00000080:1.0:1784189345.274633:0:24833:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9dbf47544700 x1870854436385664/t4294969016(0) o4->debedd94-805c-42a0-a5e5-41758b2012e9@192.168.203.12@tcp:536/0 lens 1512/448 e 0 to 0 dl 1784189356 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1784189345.274687:0:24833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf47544700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:debedd94-805c-42a0-a5e5-41758b2012e9+27:2398:x1870854436385664:12345-192.168.203.12@tcp:4:dd.0 Request processed in 423us (714us total) trans 4294969016 rc 0/0 00000100:00100000:1.0:1784189345.274694:0:24833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1046 00002000:00100000:1.0:1784189345.274701:0:24833:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x774:0x0] (0->1023) req@ffff9dbf47544700 x1870854436385664/t4294969016(0) o4->debedd94-805c-42a0-a5e5-41758b2012e9@192.168.203.12@tcp:536/0 lens 1512/448 e 0 to 0 dl 1784189356 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1784189345.274709:0:24833:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9dbf47544700 with x1870854436385664 ext(0->1023) 00002000:00010000:1.0:1784189345.274713:0:24833:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9dbf47544700 00000100:00100000:3.0:1784189345.274828:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1784189345.275180:0:26165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436385792 00000100:00100000:0.0:1784189345.275186:0:26165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436385792 00000100:00100000:0.0:1784189345.275223:0:26165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 5059 00000100:00100000:0.0:1784189345.275232:0:26165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc07b5b1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:debedd94-805c-42a0-a5e5-41758b2012e9+27:2398:x1870854436385792:12345-192.168.203.12@tcp:16:kworker.0 00000001:00080000:1.0:1784189345.275510:0:8423:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294969016 is committed 00010000:00000080:0.0:1784189345.276253:0:26165:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9dc07b5b1880 x1870854436385792/t0(0) o16->debedd94-805c-42a0-a5e5-41758b2012e9@192.168.203.12@tcp:536/0 lens 440/432 e 0 to 0 dl 1784189356 ref 1 fl Interpret:/600/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1784189345.276388:0:26165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc07b5b1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:debedd94-805c-42a0-a5e5-41758b2012e9+25:2398:x1870854436385792:12345-192.168.203.12@tcp:16:kworker.0 Request processed in 1156us (1559us total) trans 0 rc 0/0 00000100:00100000:0.0:1784189345.276396:0:26165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 5059 00000100:00100000:3.0:1784189345.285780:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1784189345.285781:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1784189345.285865:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436385920 00000100:00100000:0.0:1784189345.285873:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436385920 00002000:00100000:0.0:1784189345.286054:0:8435:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x775:0x0] (0->1023) req@ffff9dc06b98df80 x1870854436385920/t0(0) o4->debedd94-805c-42a0-a5e5-41758b2012e9@192.168.203.12@tcp:536/0 lens 1512/0 e 0 to 0 dl 1784189356 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1784189345.286066:0:8435:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9dc06b98df80 with x1870854436385920 ext(0->1023) 00002000:00010000:0.0:1784189345.286073:0:8435:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9dc06b98df80 00000100:00100000:0.0:1784189345.286141:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1047 00000100:00100000:0.0:1784189345.286222:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc06b98df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:debedd94-805c-42a0-a5e5-41758b2012e9+25:2397:x1870854436385920:12345-192.168.203.12@tcp:4:dd.0 00000100:00100000:2.0:1784189345.286746:0:26163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436386048 00000100:00100000:2.0:1784189345.286752:0:26163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436386048 00000100:00100000:2.0:1784189345.286837:0:26163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 5060 00000100:00100000:2.0:1784189345.286846:0:26163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc07fb37480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:debedd94-805c-42a0-a5e5-41758b2012e9+26:2397:x1870854436386048:12345-192.168.203.12@tcp:16:kworker.0 00010000:00000080:2.0:1784189345.286880:0:26163:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9dc07fb37480 x1870854436386048/t0(0) o16->debedd94-805c-42a0-a5e5-41758b2012e9@192.168.203.12@tcp:536/0 lens 440/432 e 0 to 0 dl 1784189356 ref 1 fl Interpret:/600/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1784189345.287115:0:26163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc07fb37480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:debedd94-805c-42a0-a5e5-41758b2012e9+26:2397:x1870854436386048:12345-192.168.203.12@tcp:16:kworker.0 Request processed in 203us (1274us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189345.287125:0:26163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 5060 00010000:00000080:1.0:1784189345.288734:0:8435:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9dc06b98df80 x1870854436385920/t4294969017(0) o4->debedd94-805c-42a0-a5e5-41758b2012e9@192.168.203.12@tcp:536/0 lens 1512/448 e 0 to 0 dl 1784189356 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1784189345.288848:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc06b98df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:debedd94-805c-42a0-a5e5-41758b2012e9+27:2397:x1870854436385920:12345-192.168.203.12@tcp:4:dd.0 Request processed in 2628us (3080us total) trans 4294969017 rc 0/0 00000100:00100000:1.0:1784189345.288859:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1047 00002000:00100000:1.0:1784189345.288868:0:8435:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x775:0x0] (0->1023) req@ffff9dc06b98df80 x1870854436385920/t4294969017(0) o4->debedd94-805c-42a0-a5e5-41758b2012e9@192.168.203.12@tcp:536/0 lens 1512/448 e 0 to 0 dl 1784189356 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1784189345.288877:0:8435:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9dc06b98df80 with x1870854436385920 ext(0->1023) 00002000:00010000:1.0:1784189345.288891:0:8435:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9dc06b98df80 00010000:00010000:2.0:1784189345.519585:0:7454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784189345.839544:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc080e7f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1870854458263040:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1784189345.839614:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784189345.839766:0:9466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458263040 00000100:00100000:2.0:1784189345.839774:0:9466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458263040 00000100:00100000:2.0:1784189345.839853:0:9466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2084 00000100:00100000:2.0:1784189345.839863:0:9466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc07fb37100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1870854458263040:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1784189345.839889:0:9466:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8646976 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1784189345.839933:0:9466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc07fb37100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1870854458263040:12345-0@lo:13:osp-pre-1-1.0 Request processed in 73us (319us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189345.839939:0:9466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2084 00000100:00080000:1.0:1784189345.840064:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1784189345.840099:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc080e7f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1870854458263040:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1784189345.841430:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1784189345.841446:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc080e7d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1870854458263168:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1784189345.841496:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784189345.841936:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458263168 00000100:00100000:2.0:1784189345.841943:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458263168 00000100:00100000:2.0:1784189345.842000:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2085 00000100:00100000:2.0:1784189345.842009:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc07fb35500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1870854458263168:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1784189345.842033:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 176827840 pending 28672 free 3922399232 avail 3690876928 00010000:00000080:2.0:1784189345.842045:0:8431:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9dc07fb35500 x1870854458263168/t0(0) o13->lustre-MDT0001-mdtlov_UUID@0@lo:536/0 lens 224/368 e 0 to 0 dl 1784189356 ref 1 fl Interpret:/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784189345.842086:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc07fb35500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1870854458263168:12345-0@lo:13:osp-pre-0-1.0 Request processed in 80us (589us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189345.842093:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2085 00000100:00080000:1.0:1784189345.842235:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1784189345.842264:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc080e7d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1870854458263168:0@lo:13:osp-pre-0-1.0 00010000:00010000:3.0:1784189346.543614:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1784189346.972840:0:95938:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-OST0000 00010000:00010000:3.0:1784189346.972913:0:95938:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff9dc042d67800/0xcc1762b626f8cb3f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc1762b626f8cb46 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189346.972928:0:95938:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff9dc042d67800/0xcc1762b626f8cb3f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0xcc1762b626f8cb46 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189346.972935:0:95938:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff9dc042d67800/0xcc1762b626f8cb3f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0xcc1762b626f8cb46 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189346.972942:0:95938:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.112@tcp lock: ffff9dc042d67800/0xcc1762b626f8cb3f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0xcc1762b626f8cb46 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189346.973143:0:95938:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1784189346.973150:0:95938:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:3.0:1784189346.973176:0:95938:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1784189346.973181:0:95938:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:3.0:1784189346.973186:0:95938:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1784189346.973209:0:95938:0:(import.c:65:import_set_state_nolock()) ffff9dbf42271800 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00010000:00010000:1.0:1784189346.973267:0:26173:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784189346.973274:0:26173:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.112@tcp lock: ffff9dc042d67800/0xcc1762b626f8cb3f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0xcc1762b626f8cb46 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189346.973282:0:26173:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc042d67800 already unused, calling callback (ffffffffc114ac20) 10000000:00010000:1.0:1784189346.973285:0:26173:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.112@tcp lock: ffff9dc042d67800/0xcc1762b626f8cb3f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0xcc1762b626f8cb46 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189346.973293:0:26173:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.112@tcp lock: ffff9dc042d67800/0xcc1762b626f8cb3f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1008400000000 nid: local remote: 0xcc1762b626f8cb46 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1784189346.973314:0:26173:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.112@tcp lock: ffff9dc042d67800/0xcc1762b626f8cb3f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1009400000000 nid: local remote: 0xcc1762b626f8cb46 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784189346.973354:0:26173:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1784189346.973357:0:26173:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:1.0:1784189346.973359:0:26173:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:1.0:1784189346.973391:0:26173:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.112@tcp lock: ffff9dc042d67800/0xcc1762b626f8cb3f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0xcc1762b626f8cb46 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189346.973398:0:26173:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1784189346.973420:0:26173:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.112@tcp lock: ffff9dc042d67800/0xcc1762b626f8cb3f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0xcc1762b626f8cb46 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189346.973427:0:26173:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.112@tcp lock: ffff9dc042d67800/0xcc1762b626f8cb3f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0xcc1762b626f8cb46 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189346.973439:0:26173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784189346.973441:0:26173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784189346.973443:0:26173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784189346.973451:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1784189346.973468:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc07fb35180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:bd553d0d-03e2-4233-b06b-b55bbfa2b954:3643:1870854458263424:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1784189346.973530:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784189346.973741:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc06b98ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3639:1870854458263296:0@lo:39:umount.0 00000100:00100000:0.0:1784189346.973775:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784189346.973857:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458263424 00000100:00100000:0.0:1784189346.973863:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458263424 00000100:00100000:0.0:1784189346.974102:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 725 00000100:00100000:0.0:1784189346.974112:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc07fb34a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bd553d0d-03e2-4233-b06b-b55bbfa2b954+24:3643:x1870854458263424:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1784189346.974123:0:6500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784189346.974137:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dc081b16400/0xcc1762b626f8cb46 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xcc1762b626f8cb3f expref: 24 pid: 94309 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189346.974150:0:6500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784189346.974186:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc07fb34a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bd553d0d-03e2-4233-b06b-b55bbfa2b954+23:3643:x1870854458263424:12345-0@lo:103:ldlm_bl.0 Request processed in 75us (655us total) trans 0 rc 0/0 00000100:00100000:0.0:1784189346.974193:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 725 00000100:00100000:0.0:1784189346.974229:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc07fb35180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:bd553d0d-03e2-4233-b06b-b55bbfa2b954:3643:1870854458263424:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1784189346.977582:0:66170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458263296 00000100:00100000:3.0:1784189346.977597:0:66170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458263296 00000100:00100000:3.0:1784189346.977722:0:66170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1576 00000100:00100000:3.0:1784189346.977733:0:66170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc05eddca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1870854458263296:12345-0@lo:39:umount.0 00000020:00000080:3.0:1784189346.977759:0:66170:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xcc1762b626f8c779 00000100:00080000:3.0:1784189346.977775:0:66170:0:(import.c:65:import_set_state_nolock()) ffff9dbf46b09800 : changing import state from FULL to CLOSED 00000100:00100000:3.0:1784189346.977889:0:66170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc05eddca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+1:3639:x1870854458263296:12345-0@lo:39:umount.0 Request processed in 158us (4112us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189346.977906:0:66170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1576 00000020:00000080:3.0:1784189346.977916:0:66170:0:(genops.c:906:class_export_put()) final put ffff9dbf46b0c000/lustre-MDT0000-lwp-OST0000_UUID 00010000:00010000:2.0:1784189346.978176:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1784189346.978186:0:63468:0:(genops.c:865:class_export_destroy()) destroying export ffff9dbf46b0c000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00000080:2.0:1784189346.978236:0:63468:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9dbf46b09800 for lustre-MDT0000 00000100:00080000:0.0:1784189346.978341:0:3639:0:(import.c:65:import_set_state_nolock()) ffff9dbf42271800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:0.0:1784189346.978360:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc06b98ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3639:1870854458263296:0@lo:39:umount.0 00000100:00080000:2.0:1784189346.978427:0:95938:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1784189346.978431:0:95938:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:2.0:1784189346.978435:0:95938:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:2.0:1784189346.979684:0:95938:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1784189346.979691:0:95938:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:2.0:1784189346.979695:0:95938:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00080000:2.0:1784189346.979715:0:95938:0:(import.c:65:import_set_state_nolock()) ffff9dc07a8f7000 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:0.0:1784189346.979762:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc080e7ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3639:1870854458263552:0@lo:39:umount.0 00000100:00100000:0.0:1784189346.979832:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784189346.980056:0:68287:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458263552 00000100:00100000:3.0:1784189346.980062:0:68287:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458263552 00000100:00080000:1.0:1784189346.980132:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1784189346.980137:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1784189346.980304:0:68287:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1577 00000100:00100000:3.0:1784189346.980314:0:68287:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc05eddd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1870854458263552:12345-0@lo:39:umount.0 00000020:00000080:3.0:1784189346.980382:0:68287:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xcc1762b626f8653a 00000100:00080000:3.0:1784189346.980389:0:68287:0:(import.c:65:import_set_state_nolock()) ffff9dbf43fb9800 : changing import state from FULL to CLOSED 00000100:00100000:3.0:1784189346.980833:0:68287:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc05eddd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+1:3639:x1870854458263552:12345-0@lo:39:umount.0 Request processed in 520us (999us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189346.980842:0:68287:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1577 00000020:00000080:3.0:1784189346.980850:0:68287:0:(genops.c:906:class_export_put()) final put ffff9dc06bb5b000/lustre-MDT0001-lwp-OST0000_UUID 00010000:00010000:3.0:1784189346.981033:0:7454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1784189346.981074:0:3639:0:(import.c:65:import_set_state_nolock()) ffff9dc07a8f7000 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:0.0:1784189346.981120:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc080e7ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3639:1870854458263552:0@lo:39:umount.0 00000020:00000080:1.0:1784189346.981251:0:93049:0:(genops.c:865:class_export_destroy()) destroying export ffff9dc06bb5b000/lustre-MDT0001-lwp-OST0000_UUID for lustre-MDT0001 00000020:00000080:1.0:1784189346.981295:0:93049:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9dbf43fb9800 for lustre-MDT0001 00000100:00080000:2.0:1784189346.981338:0:95938:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1784189346.981353:0:95938:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:2.0:1784189346.981356:0:95938:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:2.0:1784189346.982651:0:95938:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff9dc042d67600/0xcc1762b626f8cb4d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc1762b626f8cb54 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189346.982667:0:95938:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff9dc042d67600/0xcc1762b626f8cb4d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0xcc1762b626f8cb54 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189346.982674:0:95938:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff9dc042d67600/0xcc1762b626f8cb4d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0xcc1762b626f8cb54 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189346.982681:0:95938:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.112@tcp lock: ffff9dc042d67600/0xcc1762b626f8cb4d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0xcc1762b626f8cb54 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189346.982726:0:95938:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1784189346.982733:0:95938:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff9dc058f67a00/0xcc1762b626f8c72c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc1762b626f8c733 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189346.982740:0:95938:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff9dc058f67a00/0xcc1762b626f8c72c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xcc1762b626f8c733 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189346.982746:0:95938:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff9dc058f67a00/0xcc1762b626f8c72c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xcc1762b626f8c733 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189346.982752:0:95938:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.112@tcp lock: ffff9dc058f67a00/0xcc1762b626f8c72c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xcc1762b626f8c733 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189346.983236:0:6502:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1784189346.983243:0:6502:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.112@tcp lock: ffff9dc042d67600/0xcc1762b626f8cb4d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0xcc1762b626f8cb54 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189346.983251:0:6502:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc042d67600 already unused, calling callback (ffffffffc114ac20) 10000000:00010000:3.0:1784189346.983255:0:6502:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.112@tcp lock: ffff9dc042d67600/0xcc1762b626f8cb4d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0xcc1762b626f8cb54 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189346.983264:0:6502:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.112@tcp lock: ffff9dc042d67600/0xcc1762b626f8cb4d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1008400000000 nid: local remote: 0xcc1762b626f8cb54 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1784189346.983287:0:6502:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.112@tcp lock: ffff9dc042d67600/0xcc1762b626f8cb4d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1009400000000 nid: local remote: 0xcc1762b626f8cb54 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784189346.983293:0:6502:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1784189346.983296:0:6502:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0000: stopping, won't requeue 00010000:00010000:3.0:1784189346.983352:0:6502:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.112@tcp lock: ffff9dc042d67600/0xcc1762b626f8cb4d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0xcc1762b626f8cb54 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189346.983358:0:6502:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1784189346.983380:0:6502:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.112@tcp lock: ffff9dc042d67600/0xcc1762b626f8cb4d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0xcc1762b626f8cb54 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189346.983387:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.112@tcp lock: ffff9dc042d67600/0xcc1762b626f8cb4d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0xcc1762b626f8cb54 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189346.983399:0:6502:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784189346.983401:0:6502:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.112@tcp lock: ffff9dc058f67a00/0xcc1762b626f8c72c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xcc1762b626f8c733 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189346.983407:0:6502:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc058f67a00 already unused, calling callback (ffffffffc114ac20) 10000000:00010000:3.0:1784189346.983409:0:6502:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.112@tcp lock: ffff9dc058f67a00/0xcc1762b626f8c72c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xcc1762b626f8c733 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189346.983416:0:6502:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.112@tcp lock: ffff9dc058f67a00/0xcc1762b626f8c72c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0xcc1762b626f8c733 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1784189346.983423:0:6502:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.112@tcp lock: ffff9dc058f67a00/0xcc1762b626f8c72c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0xcc1762b626f8c733 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784189346.983428:0:6502:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:3.0:1784189346.983435:0:6502:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 00010000:00010000:3.0:1784189346.983458:0:6502:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.112@tcp lock: ffff9dc058f67a00/0xcc1762b626f8c72c lrc: 3/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xcc1762b626f8c733 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189346.983464:0:6502:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1784189346.983480:0:6502:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.112@tcp lock: ffff9dc058f67a00/0xcc1762b626f8c72c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xcc1762b626f8c733 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189346.983488:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784189346.983489:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784189346.983491:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784189346.983505:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc06b98f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bd553d0d-03e2-4233-b06b-b55bbfa2b954:3640:1870854458263808:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1784189346.983556:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784189346.983603:0:7455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458263808 00000100:00100000:3.0:1784189346.983608:0:7455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458263808 00000100:00100000:3.0:1784189346.983646:0:7455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 726 00000100:00100000:3.0:1784189346.983653:0:7455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc06b98d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bd553d0d-03e2-4233-b06b-b55bbfa2b954+23:3640:x1870854458263808:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1784189346.983663:0:7455:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784189346.983676:0:7455:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dc04a20ba00/0xcc1762b626f8c733 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xcc1762b626f8c72c expref: 23 pid: 94309 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189346.983687:0:7455:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784189346.983713:0:7455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc06b98d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bd553d0d-03e2-4233-b06b-b55bbfa2b954+22:3640:x1870854458263808:12345-0@lo:103:ldlm_bl.0 Request processed in 61us (157us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189346.983720:0:7455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 726 00000100:00100000:3.0:1784189346.983751:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc06b98f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bd553d0d-03e2-4233-b06b-b55bbfa2b954:3640:1870854458263808:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1784189346.983861:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc06b98fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:bd553d0d-03e2-4233-b06b-b55bbfa2b954:3643:1870854458263680:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1784189346.983909:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784189346.984132:0:25703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458263680 00000100:00100000:3.0:1784189346.984137:0:25703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458263680 00000100:00100000:3.0:1784189346.984175:0:25703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 727 00000100:00100000:3.0:1784189346.984189:0:25703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc05eddf480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:bd553d0d-03e2-4233-b06b-b55bbfa2b954+22:3643:x1870854458263680:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1784189346.984197:0:25703:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784189346.984206:0:25703:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dc0565e7a00/0xcc1762b626f8cb54 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xcc1762b626f8cb4d expref: 22 pid: 94308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189346.984215:0:25703:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784189346.984242:0:25703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc05eddf480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:bd553d0d-03e2-4233-b06b-b55bbfa2b954+21:3643:x1870854458263680:12345-0@lo:103:ldlm_bl.0 Request processed in 55us (333us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189346.984248:0:25703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 727 00000100:00100000:3.0:1784189346.984272:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc06b98fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:bd553d0d-03e2-4233-b06b-b55bbfa2b954:3643:1870854458263680:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1784189346.984532:0:95938:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1784189346.984538:0:95938:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.112@tcp lock: ffff9dc058f67a00/0xcc1762b626f8c72c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xcc1762b626f8c733 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784189346.984559:0:95938:0:(mgc_request.c:130:config_log_put()) dropping config log params 10000000:01000000:2.0:1784189346.984564:0:95938:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0000 10000000:01000000:2.0:1784189346.984567:0:95938:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0000 (0) 00000020:01000004:2.0:1784189346.984632:0:95938:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-OST0000 00000020:01000000:2.0:1784189346.984636:0:95938:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000 (flags='FA') 00000020:00000080:2.0:1784189346.984641:0:95938:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:02000400:2.0:1784189346.984647:0:95938:0:(obd_config.c:932:class_cleanup()) Failing over lustre-OST0000 00010000:00010000:1.0:1784189346.987110:0:26173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00000080:2.0:1784189346.987700:0:95938:0:(ofd_obd.c:1267:ofd_iocontrol()) lustre-OST0000: cmd=40086672 len=0 karg=0000000000000000 uarg=0000000000000000 00002000:00100000:2.0:1784189346.987746:0:95938:0:(ofd_obd.c:1281:ofd_iocontrol()) syncing ost lustre-OST0000 00000001:00080000:1.0:1784189346.988426:0:8423:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294969017 is committed 00000020:00000080:2.0:1784189346.988614:0:95938:0:(obd_config.c:955:class_cleanup()) lustre-OST0000: forcing exports to disconnect: 3/7 00000020:00080000:2.0:1784189346.988625:0:95938:0:(genops.c:1840:print_export_data()) lustre-OST0000: ACTIVE ffff9dc07110f800 debedd94-805c-42a0-a5e5-41758b2012e9 192.168.203.12@tcp 24 (0 0 20) 0 0 0 0: 0000000000000000 4294969017 stale:0 00000020:00080000:2.0:1784189346.988632:0:95938:0:(genops.c:1840:print_export_data()) lustre-OST0000: ACTIVE ffff9dbf43e98000 lustre-MDT0000-mdtlov_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 4294968973 stale:0 00000020:00080000:2.0:1784189346.988637:0:95938:0:(genops.c:1840:print_export_data()) lustre-OST0000: ACTIVE ffff9dc042e32800 lustre-MDT0001-mdtlov_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 4294968955 stale:0 00000020:00080000:2.0:1784189346.988641:0:95938:0:(genops.c:1574:class_disconnect_exports()) OBD device 18 (ffff9dbf42003380) has exports, disconnecting them 00000020:00080000:2.0:1784189346.988646:0:95938:0:(genops.c:1549:class_disconnect_export_list()) lustre-OST0000: disconnecting export at 192.168.203.12@tcp (ffff9dc07110f800), last request at 1784189345 00000020:00000080:2.0:1784189346.988652:0:95938:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xcc1762b626f8c98d 00000020:00010000:2.0:1784189346.988660:0:95938:0:(genops.c:1942:obd_stale_export_put()) Put export ffff9dc07110f800: total 0 00000100:00080000:2.0:1784189346.988665:0:95938:0:(import.c:65:import_set_state_nolock()) ffff9dc06b8e0000 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1784189346.988689:0:95938:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 192.168.203.12@tcp (ffff9dc07110f800): rc 0 00000020:00080000:2.0:1784189346.988692:0:95938:0:(genops.c:1549:class_disconnect_export_list()) lustre-OST0000: disconnecting export at 0@lo (ffff9dbf43e98000), last request at 1784189343 00000020:00000080:2.0:1784189346.988695:0:95938:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xcc1762b626f8c63e 00000100:00080000:2.0:1784189346.988700:0:95938:0:(import.c:65:import_set_state_nolock()) ffff9dbf43e99000 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1784189346.988712:0:95938:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9dbf43e98000): rc 0 00000020:00000080:2.0:1784189346.988714:0:95938:0:(genops.c:906:class_export_put()) final put ffff9dbf43e98000/lustre-MDT0000-mdtlov_UUID 00000020:00080000:2.0:1784189346.988722:0:95938:0:(genops.c:1549:class_disconnect_export_list()) lustre-OST0000: disconnecting export at 0@lo (ffff9dc042e32800), last request at 1784189345 00000020:00000080:2.0:1784189346.988724:0:95938:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xcc1762b626f864ae 00000100:00080000:2.0:1784189346.988729:0:95938:0:(import.c:65:import_set_state_nolock()) ffff9dc042e36800 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1784189346.988746:0:95938:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9dc042e32800): rc 0 00000020:00000080:2.0:1784189346.988748:0:95938:0:(genops.c:906:class_export_put()) final put ffff9dc042e32800/lustre-MDT0001-mdtlov_UUID 00000020:00080000:2.0:1784189346.988773:0:95938:0:(genops.c:1579:class_disconnect_exports()) OBD device 18 (ffff9dbf42003380) has no exports 00000020:00010000:1.0:1784189346.989530:0:6501:0:(genops.c:1928:obd_stale_export_get()) Get export ffff9dc07110f800: total 2 00010000:00010000:1.0:1784189346.989595:0:6501:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff9dc07110f800, canceled 0 locks, left on hash table 20. 00002000:00010000:1.0:1784189346.989623:0:6501:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x773:0x0] updating lvb size from disk: 0 -> 1024 00002000:00010000:1.0:1784189346.989627:0:6501:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x773:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:1.0:1784189346.989653:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005168a0f1/0xcc1762b626f8d509 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x773:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801080000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c4406 expref: 21 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1784189346.989678:0:6501:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x762:0x0] updating lvb size from disk: 0 -> 1024 00002000:00010000:1.0:1784189346.989680:0:6501:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x762:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:1.0:1784189346.989688:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000012da23a3/0xcc1762b626f8d112 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x762:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801080000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c42a8 expref: 20 pid: 26163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1784189346.989702:0:6501:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x766:0x0] updating lvb size from disk: 0 -> 1024 00002000:00010000:1.0:1784189346.989705:0:6501:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x766:0x0] updating lvb mtime from disk: 1784189343 -> 1784189344 00002000:00010000:1.0:1784189346.989707:0:6501:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x766:0x0] updating lvb ctime from disk: 1784189343 -> 1784189344 00002000:00010000:1.0:1784189346.989709:0:6501:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x766:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:1.0:1784189346.989716:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000097385c8a/0xcc1762b626f8d1cf lrc: 0/0,0 mode: --/PW res: [0x280000401:0x766:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801080000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c42e7 expref: 19 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1784189346.989731:0:6501:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x768:0x0] updating lvb size from disk: 0 -> 1024 00002000:00010000:1.0:1784189346.989734:0:6501:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x768:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:1.0:1784189346.989741:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000090923e4f/0xcc1762b626f8d28c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x768:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801080000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c4326 expref: 18 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1784189346.989755:0:6501:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x76c:0x0] updating lvb size from disk: 0 -> 1024 00002000:00010000:1.0:1784189346.989757:0:6501:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x76c:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:1.0:1784189346.989764:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000034a0fccf/0xcc1762b626f8d349 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x76c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801080000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c4365 expref: 17 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1784189346.989806:0:6501:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x76e:0x0] updating lvb size from disk: 0 -> 1024 00002000:00010000:1.0:1784189346.989808:0:6501:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x76e:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:1.0:1784189346.989817:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000819a0594/0xcc1762b626f8d406 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x76e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801080000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c43a4 expref: 16 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1784189346.989842:0:6501:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x770:0x0] updating lvb size from disk: 0 -> 1024 00002000:00010000:1.0:1784189346.989844:0:6501:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x770:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:1.0:1784189346.989851:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008da15b72/0xcc1762b626f8d4c3 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x770:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801080000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c43e3 expref: 15 pid: 14684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1784189346.989865:0:6501:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x765:0x0] updating lvb size from disk: 0 -> 1024 00002000:00010000:1.0:1784189346.989867:0:6501:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x765:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:1.0:1784189346.989873:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000a795375/0xcc1762b626f8d15f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x765:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801080000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c42c4 expref: 14 pid: 26170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1784189346.989889:0:6501:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x763:0x0] updating lvb size from disk: 0 -> 1024 00002000:00010000:1.0:1784189346.989891:0:6501:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x763:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:1.0:1784189346.990042:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e101baf9/0xcc1762b626f8d0a2 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x763:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801080000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c4293 expref: 13 pid: 26164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1784189346.990062:0:6501:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x775:0x0] updating lvb size from disk: 0 -> 1024 00002000:00010000:1.0:1784189346.990065:0:6501:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x775:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:1.0:1784189346.990073:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d2d1b2ae/0xcc1762b626f8d24d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x775:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801080000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c4311 expref: 12 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1784189346.990106:0:6501:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x771:0x0] updating lvb size from disk: 0 -> 1024 00002000:00010000:1.0:1784189346.990109:0:6501:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x771:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:1.0:1784189346.990119:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006dde6b82/0xcc1762b626f8d48b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x771:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801080000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c43ce expref: 11 pid: 26223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1784189346.990135:0:6501:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x774:0x0] updating lvb size from disk: 0 -> 1024 00002000:00010000:1.0:1784189346.990138:0:6501:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x774:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:1.0:1784189346.990145:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d0a53c2a/0xcc1762b626f8d52c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x774:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801080000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c440d expref: 10 pid: 26164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1784189346.990158:0:6501:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x772:0x0] updating lvb size from disk: 0 -> 1024 00002000:00010000:1.0:1784189346.990160:0:6501:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x772:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:1.0:1784189346.990167:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cd45e61e/0xcc1762b626f8d510 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x772:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801080000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c43ff expref: 9 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1784189346.990182:0:6501:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x76a:0x0] updating lvb size from disk: 0 -> 1024 00002000:00010000:1.0:1784189346.990184:0:6501:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x76a:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:1.0:1784189346.990191:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000041e819fd/0xcc1762b626f8d311 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x76a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801080000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c4350 expref: 8 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1784189346.990207:0:6501:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x76d:0x0] updating lvb size from disk: 0 -> 1024 00002000:00010000:1.0:1784189346.990210:0:6501:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x76d:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:1.0:1784189346.990217:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d369237c/0xcc1762b626f8d3ff lrc: 0/0,0 mode: --/PW res: [0x280000401:0x76d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801080000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c438f expref: 7 pid: 26169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1784189346.990249:0:6501:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x76f:0x0] updating lvb size from disk: 0 -> 1024 00002000:00010000:1.0:1784189346.990252:0:6501:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x76f:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:1.0:1784189346.990261:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c9d589c0/0xcc1762b626f8d414 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x76f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801080000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c43ab expref: 6 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1784189346.990278:0:6501:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x764:0x0] updating lvb size from disk: 0 -> 1024 00002000:00010000:1.0:1784189346.990281:0:6501:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x764:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:1.0:1784189346.990288:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000434d0145/0xcc1762b626f8d158 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x764:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801080000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c42bd expref: 5 pid: 26170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1784189346.990302:0:6501:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x767:0x0] updating lvb size from disk: 0 -> 1024 00002000:00010000:1.0:1784189346.990305:0:6501:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x767:0x0] updating lvb mtime from disk: 1784189343 -> 1784189344 00002000:00010000:1.0:1784189346.990307:0:6501:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x767:0x0] updating lvb ctime from disk: 1784189343 -> 1784189344 00002000:00010000:1.0:1784189346.990309:0:6501:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x767:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:1.0:1784189346.990346:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000090219bd6/0xcc1762b626f8d1dd lrc: 0/0,0 mode: --/PW res: [0x280000401:0x767:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801080000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c42fc expref: 4 pid: 9982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1784189346.990364:0:6501:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x769:0x0] updating lvb size from disk: 0 -> 1024 00002000:00010000:1.0:1784189346.990366:0:6501:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x769:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:1.0:1784189346.990374:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000067956617/0xcc1762b626f8d2cb lrc: 0/0,0 mode: --/PW res: [0x280000401:0x769:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801080000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c433b expref: 3 pid: 26165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1784189346.990388:0:6501:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x76b:0x0] updating lvb size from disk: 0 -> 1024 00002000:00010000:1.0:1784189346.990391:0:6501:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x76b:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:1.0:1784189346.990408:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008c7612c6/0xcc1762b626f8d388 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x76b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801080000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c437a expref: 2 pid: 26163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189346.990424:0:6501:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff9dc07110f800, canceled 20 locks, left on hash table 0. 00000020:00000080:0.0:1784189346.992107:0:63468:0:(genops.c:865:class_export_destroy()) destroying export ffff9dbf43e98000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:0.0:1784189346.992168:0:63468:0:(genops.c:865:class_export_destroy()) destroying export ffff9dc042e32800/lustre-MDT0001-mdtlov_UUID for lustre-OST0000 00000020:00000080:0.0:1784189346.992186:0:63468:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9dbf43e99000 for lustre-OST0000 00000020:00000080:0.0:1784189346.992191:0:63468:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9dc042e36800 for lustre-OST0000 00010000:00010000:3.0:1784189346.993208:0:7454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784189346.993216:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1784189346.994172:0:6501:0:(genops.c:906:class_export_put()) final put ffff9dc07110f800/debedd94-805c-42a0-a5e5-41758b2012e9 00010000:00010000:1.0:1784189346.994239:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784189346.994242:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784189346.994245:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1784189346.994567:0:93049:0:(genops.c:865:class_export_destroy()) destroying export ffff9dc07110f800/debedd94-805c-42a0-a5e5-41758b2012e9 for lustre-OST0000 00000020:00000080:0.0:1784189346.994729:0:93049:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9dc06b8e0000 for lustre-OST0000 00000020:01000000:2.0:1784189346.994795:0:95938:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9dbf43507180 - data ffff9dc06bec5948/ffff9dc07620c800 00000020:01000000:2.0:1784189346.995134:0:95938:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9dbf4212d780 - data ffff9dc06be83288/ffff9dbf42257000 00100000:10000000:2.0:1784189347.014236:0:95938:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0000-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:2.0:1784189347.033113:0:95938:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xcc1762b626f46699 00000020:00000080:2.0:1784189347.033126:0:95938:0:(genops.c:906:class_export_put()) final put ffff9dbf41bfd000/lustre-OST0000-osd_UUID 00000020:01000004:2.0:1784189347.033148:0:95938:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9dc07b5d6800 from lustre-OST0000, refs=2 00000020:01000004:2.0:1784189347.033153:0:95938:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9dc07b5d6800 2 00000020:01000004:2.0:1784189347.033157:0:95938:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9dc07b5d6800 from lustre-OST0000 00000020:00000080:2.0:1784189347.033181:0:95938:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1784189347.033194:0:95938:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:00000080:2.0:1784189347.033198:0:95938:0:(genops.c:906:class_export_put()) final put ffff9dbf41bf9800/lustre-OST0000_UUID 00000020:00000080:2.0:1784189347.033201:0:95938:0:(genops.c:865:class_export_destroy()) destroying export ffff9dbf41bf9800/lustre-OST0000_UUID for lustre-OST0000 00000020:01000000:2.0:1784189347.033209:0:95938:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000 (lustre-OST0000_UUID) 00000020:01000004:2.0:1784189347.033271:0:95938:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 3 references. 00000020:01000000:2.0:1784189347.033275:0:95938:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0000 (flags='F') 00000020:00000080:2.0:1784189347.033279:0:95938:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1784189347.033285:0:95938:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1784189347.033290:0:95938:0:(genops.c:1840:print_export_data()) lustre-MDT0000-lwp-OST0000: ACTIVE ffff9dbf42273000 lustre-MDT0000-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1784189347.033296:0:95938:0:(genops.c:1574:class_disconnect_exports()) OBD device 19 (ffff9dc0754799c0) has exports, disconnecting them 00000020:00080000:2.0:1784189347.033301:0:95938:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0000: disconnecting export at 0@lo (ffff9dbf42273000), last request at 1784185960 00000020:00000080:2.0:1784189347.033304:0:95938:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xcc1762b626f466c3 00000020:00080000:2.0:1784189347.033313:0:95938:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9dbf42273000): rc 0 00000020:00000080:2.0:1784189347.033335:0:95938:0:(genops.c:906:class_export_put()) final put ffff9dbf42273000/lustre-MDT0000-lwp-OST0000 00000020:00000080:0.0:1784189347.033697:0:93049:0:(genops.c:865:class_export_destroy()) destroying export ffff9dbf41bfd000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:0.0:1784189347.033982:0:93049:0:(genops.c:865:class_export_destroy()) destroying export ffff9dbf42273000/lustre-MDT0000-lwp-OST0000 for lustre-MDT0000-lwp-OST0000 00010000:01000000:0.0:1784189347.046397:0:95938:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0000: client import never connected 00000100:00080000:0.0:1784189347.046406:0:95938:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1784189347.046410:0:95938:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:0.0:1784189347.046418:0:95938:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1784189347.046561:0:95938:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1784189347.046575:0:95938:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000000:0.0:1784189347.046581:0:95938:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-lwp-OST0000 (flags='F') 00000020:00000080:0.0:1784189347.046588:0:95938:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1784189347.046593:0:95938:0:(obd_config.c:955:class_cleanup()) lustre-MDT0001-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1784189347.046601:0:95938:0:(genops.c:1840:print_export_data()) lustre-MDT0001-lwp-OST0000: ACTIVE ffff9dbf424c8000 lustre-MDT0001-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1784189347.046607:0:95938:0:(genops.c:1574:class_disconnect_exports()) OBD device 20 (ffff9dbf42004d40) has exports, disconnecting them 00000020:00080000:0.0:1784189347.046611:0:95938:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0001-lwp-OST0000: disconnecting export at 0@lo (ffff9dbf424c8000), last request at 1784185960 00000020:00000080:0.0:1784189347.046615:0:95938:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xcc1762b626f466d8 00000020:00080000:0.0:1784189347.046631:0:95938:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9dbf424c8000): rc 0 00000020:00000080:0.0:1784189347.046636:0:95938:0:(genops.c:906:class_export_put()) final put ffff9dbf424c8000/lustre-MDT0001-lwp-OST0000 00000020:00000080:1.0:1784189347.046737:0:93049:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9dbf42271800 for lustre-MDT0000-lwp-OST0000 00000020:00000080:1.0:1784189347.046744:0:93049:0:(genops.c:906:class_export_put()) final put ffff9dbf410f1800/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:1.0:1784189347.046747:0:93049:0:(genops.c:865:class_export_destroy()) destroying export ffff9dbf410f1800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000-lwp-OST0000 00000020:01000000:1.0:1784189347.046758:0:93049:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0000 (lustre-MDT0000-lwp-OST0000_UUID) 00000020:00000080:1.0:1784189347.046900:0:93049:0:(genops.c:865:class_export_destroy()) destroying export ffff9dbf424c8000/lustre-MDT0001-lwp-OST0000 for lustre-MDT0001-lwp-OST0000 00010000:01000000:1.0:1784189347.047641:0:95938:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0001-lwp-OST0000: client import never connected 00000100:00080000:1.0:1784189347.047645:0:95938:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1784189347.047647:0:95938:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:1.0:1784189347.047656:0:95938:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1784189347.047676:0:93049:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9dc07a8f7000 for lustre-MDT0001-lwp-OST0000 00000020:00000080:1.0:1784189347.047761:0:95938:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1784189347.047771:0:95938:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000020:00000080:1.0:1784189347.047774:0:95938:0:(genops.c:906:class_export_put()) final put ffff9dbf41bfe000/lustre-MDT0001-lwp-OST0000_UUID 00000020:00000080:1.0:1784189347.047778:0:95938:0:(genops.c:865:class_export_destroy()) destroying export ffff9dbf41bfe000/lustre-MDT0001-lwp-OST0000_UUID for lustre-MDT0001-lwp-OST0000 00000020:01000000:1.0:1784189347.047796:0:95938:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-lwp-OST0000 (lustre-MDT0001-lwp-OST0000_UUID) 00000020:01000004:1.0:1784189347.047845:0:95938:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9dc07b5d6800 1 00000020:00000080:1.0:1784189347.047851:0:95938:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xcc1762b626f46661 00000020:00000080:1.0:1784189347.047856:0:95938:0:(genops.c:906:class_export_put()) final put ffff9dc0762e3000/lustre-OST0000-osd_UUID 00000020:01000000:1.0:1784189347.047863:0:95938:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osd (flags='') 00000020:00000080:1.0:1784189347.047870:0:93049:0:(genops.c:865:class_export_destroy()) destroying export ffff9dc0762e3000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:1.0:1784189347.047892:0:95938:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1784189347.047897:0:95938:0:(obd_config.c:955:class_cleanup()) lustre-OST0000-osd: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1784189347.047900:0:95938:0:(genops.c:1579:class_disconnect_exports()) OBD device 16 (ffff9dc07629cd40) has no exports 00000020:00000080:1.0:1784189347.151206:0:95938:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1784189347.151224:0:95938:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00000020:00000080:1.0:1784189347.151231:0:95938:0:(genops.c:906:class_export_put()) final put ffff9dc045ad2000/lustre-OST0000-osd_UUID 00000020:00000080:1.0:1784189347.151236:0:95938:0:(genops.c:865:class_export_destroy()) destroying export ffff9dc045ad2000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:1.0:1784189347.151250:0:95938:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osd (lustre-OST0000-osd_UUID) 00000020:01000004:1.0:1784189347.151389:0:95938:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9dc07b5d0800 00000020:02000400:1.0:1784189347.151451:0:95938:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-OST0000 complete 00010000:00010000:1.0:1784189347.567617:0:26173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784189348.399608:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1784189348.399631:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc080e7ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1870854458263936:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1784189348.399697:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784189348.399712:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1784189348.399722:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc06b98fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1870854458264064:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1784189348.399751:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784189348.399798:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458263936 00000100:00100000:3.0:1784189348.399806:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458263936 00000100:00100000:3.0:1784189348.399849:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458264064 00000100:00100000:3.0:1784189348.399852:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458264064 00000100:00100000:3.0:1784189348.399872:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3960 00000100:00100000:3.0:1784189348.399880:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc080e7ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3640:x1870854458263936:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1784189348.399913:0:8438:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445249024 avail 1299009536 00000100:00100000:3.0:1784189348.399953:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc080e7ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3640:x1870854458263936:12345-0@lo:41:osp-pre-0-1.0 Request processed in 73us (256us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189348.399960:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3960 00000100:00100000:3.0:1784189348.399988:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3961 00000100:00100000:3.0:1784189348.399994:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc06b98f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3643:x1870854458264064:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1784189348.400016:0:8438:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445568512 avail 1299329024 00000100:00100000:2.0:1784189348.400038:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc080e7ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1870854458263936:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1784189348.400045:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc06b98f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3643:x1870854458264064:12345-0@lo:41:osp-pre-1-0.0 Request processed in 52us (294us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189348.400051:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3961 00000100:00100000:3.0:1784189348.400082:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc06b98fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1870854458264064:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1784189348.402279:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc05edde300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:bd553d0d-03e2-4233-b06b-b55bbfa2b954:3643:1870854458264192:0@lo:400:kworker.0 00000100:00100000:3.0:1784189348.402365:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784189348.402459:0:94309:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458264192 00000100:00100000:2.0:1784189348.402466:0:94309:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458264192 00000100:00100000:2.0:1784189348.402515:0:94309:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:2.0:1784189348.402523:0:94309:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc080e3a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd553d0d-03e2-4233-b06b-b55bbfa2b954+21:3643:x1870854458264192:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784189348.402564:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1784189348.402571:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc05edde680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1870854458264576:0@lo:400:kworker.0 00000100:00100000:1.0:1784189348.402601:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc05edddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3641:1870854458264448:0@lo:400:kworker.0 00000100:00100000:3.0:1784189348.402887:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784189348.402948:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc05eddf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1870854458264704:0@lo:400:kworker.0 00000100:00100000:3.0:1784189348.402983:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784189348.403030:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784189348.403057:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc05eddfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1870854458264960:0@lo:400:kworker.0 00000100:00100000:1.0:1784189348.403090:0:66945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458264448 00000100:00100000:1.0:1784189348.403094:0:66945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458264448 00000100:00100000:3.0:1784189348.403098:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc05edddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3643:1870854458265216:0@lo:400:kworker.0 00000100:00100000:3.0:1784189348.403123:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784189348.403134:0:66945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458265216 00000100:00100000:1.0:1784189348.403137:0:66945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458265216 00000100:00100000:3.0:1784189348.403143:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1784189348.403148:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc05eddc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1870854458265088:0@lo:400:kworker.0 00000100:00100000:1.0:1784189348.403155:0:66945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1360 00000100:00100000:3.0:1784189348.403168:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784189348.403184:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458264576 00000100:00100000:0.0:1784189348.403188:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458264576 00000100:00100000:0.0:1784189348.403211:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458264704 00000100:00100000:0.0:1784189348.403214:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458264704 00000100:00100000:1.0:1784189348.403234:0:66945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc07fb34700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1870854458264448:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784189348.403237:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2601 00000100:00100000:0.0:1784189348.403243:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc06b98ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1870854458264704:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784189348.403269:0:66945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc07fb34700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1870854458264448:12345-0@lo:400:kworker.0 Request processed in 37us (239us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189348.403276:0:66945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1360 00000100:00100000:0.0:1784189348.403284:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc06b98ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1870854458264704:12345-0@lo:400:kworker.0 Request processed in 42us (311us total) trans 0 rc 0/0 00000100:00100000:0.0:1784189348.403290:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2601 00000100:00100000:1.0:1784189348.403291:0:66945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1361 00000100:00100000:1.0:1784189348.403296:0:66945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc06b98c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1870854458265216:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784189348.403300:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5061 00000100:00100000:0.0:1784189348.403304:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc06b98fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3643:x1870854458264576:12345-0@lo:400:kworker.0 00000020:00080000:0.0:1784189348.403309:0:8429:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:1.0:1784189348.403342:0:66945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc06b98c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1870854458265216:12345-0@lo:400:kworker.0 Request processed in 45us (218us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189348.403348:0:66945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1361 00000100:00100000:0.0:1784189348.403350:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc06b98fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3643:x1870854458264576:12345-0@lo:400:kworker.0 Request processed in 46us (464us total) trans 0 rc -107/-107 00000100:00100000:0.0:1784189348.403355:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5061 00000100:00080000:1.0:1784189348.403370:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1784189348.403470:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1784189348.403526:0:94309:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc080e3a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd553d0d-03e2-4233-b06b-b55bbfa2b954+21:3643:x1870854458264192:12345-0@lo:400:kworker.0 Request processed in 1003us (1161us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189348.403533:0:94309:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:2.0:1784189348.403641:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc05eddd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3640:1870854458264320:0@lo:400:kworker.0 00000100:00100000:2.0:1784189348.403668:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784189348.403694:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc05eddc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3640:1870854458264832:0@lo:400:kworker.0 00000100:00100000:2.0:1784189348.403715:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784189348.403854:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc05eddf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1870854458264704:0@lo:400:kworker.0 00000100:00100000:3.0:1784189348.403867:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc05edddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3643:1870854458265216:0@lo:400:kworker.0 00000100:00100000:1.0:1784189348.403868:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1784189348.403876:0:3643:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-OST0000-osc-MDT0001 of lustre-OST0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1784189348.403881:0:3643:0:(import.c:65:import_set_state_nolock()) ffff9dbf43114800 lustre-OST0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:3.0:1784189348.403884:0:3643:0:(import.c:182:ptlrpc_set_import_discon()) lustre-OST0000-osc-MDT0001: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000004:00080000:3.0:1784189348.403895:0:3643:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000100:00080000:3.0:1784189348.403904:0:3643:0:(import.c:65:import_set_state_nolock()) ffff9dbf43114800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1784189348.403908:0:3643:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 2737 00000100:00080000:3.0:1784189348.403914:0:3643:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff9dbf43114800 using connection 192.168.203.112@tcp/0@lo 00000100:00100000:3.0:1784189348.403939:0:3643:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9dc06b98f100 x1870854458265344/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1784189348.403956:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc05edde680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1870854458264576:0@lo:400:kworker.0 00000100:00100000:2.0:1784189348.403967:0:9982:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458265088 00000100:00100000:3.0:1784189348.403968:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc05edde300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:bd553d0d-03e2-4233-b06b-b55bbfa2b954:3643:1870854458264192:0@lo:400:kworker.0 00000100:00100000:2.0:1784189348.403970:0:9982:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458265088 00000100:00100000:2.0:1784189348.404001:0:9982:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458264960 00000100:00100000:2.0:1784189348.404004:0:9982:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458264960 00000100:00100000:2.0:1784189348.404018:0:9982:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2602 00000100:00100000:2.0:1784189348.404025:0:9982:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc06b98f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3643:x1870854458265088:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784189348.404056:0:9982:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc06b98f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3643:x1870854458265088:12345-0@lo:400:kworker.0 Request processed in 31us (886us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189348.404062:0:9982:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2602 00000100:00100000:3.0:1784189348.404067:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc05eddc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1870854458265088:0@lo:400:kworker.0 00000100:00100000:2.0:1784189348.404073:0:9982:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5062 00000100:00100000:2.0:1784189348.404077:0:9982:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc07fb34380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3641:x1870854458264960:12345-0@lo:400:kworker.0 00000020:00080000:2.0:1784189348.404081:0:9982:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:2.0:1784189348.404101:0:9982:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc07fb34380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3641:x1870854458264960:12345-0@lo:400:kworker.0 Request processed in 24us (233us total) trans 0 rc -107/-107 00000100:00100000:0.0:1784189348.404133:0:68287:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458264320 00000100:00100000:0.0:1784189348.404137:0:68287:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458264320 00000100:00100000:0.0:1784189348.404165:0:68287:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458264832 00000100:00100000:0.0:1784189348.404168:0:68287:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458264832 00000100:00100000:0.0:1784189348.404184:0:68287:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1362 00000100:00100000:0.0:1784189348.404190:0:68287:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc080e7ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3640:x1870854458264320:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784189348.404226:0:68287:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc080e7ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3640:x1870854458264320:12345-0@lo:400:kworker.0 Request processed in 36us (558us total) trans 0 rc 0/0 00000100:00100000:0.0:1784189348.404232:0:68287:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1362 00000100:00100000:0.0:1784189348.404244:0:68287:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1363 00000100:00100000:0.0:1784189348.404248:0:68287:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc080e7c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1870854458264832:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784189348.404271:0:68287:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc080e7c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1870854458264832:12345-0@lo:400:kworker.0 Request processed in 23us (556us total) trans 0 rc 0/0 00000100:00100000:0.0:1784189348.404276:0:68287:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1363 00000100:00100000:0.0:1784189348.404297:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc06b98f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3639:1870854458265344:0@lo:8:ptlrpcd_00_03.0 00000100:00100000:0.0:1784189348.404347:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784189348.404374:0:26161:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458265344 00000100:00100000:0.0:1784189348.404384:0:26161:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458265344 00000100:00100000:0.0:1784189348.404407:0:26161:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5063 00000100:00100000:0.0:1784189348.404423:0:26161:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc05edded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:0+-99:3639:x1870854458265344:12345-0@lo:8:ptlrpcd_00_03.0 00010000:00020000:0.0:1784189348.404441:0:26161:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-OST0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1784189348.404447:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc05edddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3641:1870854458264448:0@lo:400:kworker.0 00000100:00080000:1.0:1784189348.404467:0:3641:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-OST0000-osc-MDT0000 of lustre-OST0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00100000:0.0:1784189348.404469:0:26161:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc05edded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:0+-99:3639:x1870854458265344:12345-0@lo:8:ptlrpcd_00_03.0 Request processed in 58us (122us total) trans 0 rc -19/-19 00000100:00080000:1.0:1784189348.404470:0:3641:0:(import.c:65:import_set_state_nolock()) ffff9dc075655000 lustre-OST0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:1.0:1784189348.404473:0:3641:0:(import.c:182:ptlrpc_set_import_discon()) lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00100000:0.0:1784189348.404475:0:26161:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5063 00000004:00080000:1.0:1784189348.404482:0:3641:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000100:00080000:1.0:1784189348.404484:0:3641:0:(import.c:65:import_set_state_nolock()) ffff9dc075655000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1784189348.404487:0:3641:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 3544 00000100:00080000:1.0:1784189348.404492:0:3641:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9dc075655000 using connection 192.168.203.112@tcp/0@lo 00000100:00080000:0.0:1784189348.404504:0:3639:0:(import.c:65:import_set_state_nolock()) ffff9dbf43114800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00100000:1.0:1784189348.404506:0:3641:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9dc07fb35180 x1870854458265472/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1784189348.404507:0:3639:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1784189348.404510:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc06b98f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3639:1870854458265344:0@lo:8:ptlrpcd_00_03.0 00000100:00100000:1.0:1784189348.404517:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc05eddfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1870854458264960:0@lo:400:kworker.0 00000100:00100000:0.0:1784189348.404523:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc07fb35180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3639:1870854458265472:0@lo:8:ptlrpcd_00_01.0 00000100:00100000:0.0:1784189348.404544:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784189348.404657:0:26168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458265472 00000100:00100000:1.0:1784189348.404662:0:26168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458265472 00000100:00100000:1.0:1784189348.404691:0:26168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5064 00000100:00100000:1.0:1784189348.404695:0:26168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc05eddfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:0+-99:3639:x1870854458265472:12345-0@lo:8:ptlrpcd_00_01.0 00010000:00020000:1.0:1784189348.404706:0:26168:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-OST0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1784189348.404869:0:9982:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5062 00000100:00080000:2.0:1784189348.404957:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1784189348.404961:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1784189348.405590:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc05eddd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3640:1870854458264320:0@lo:400:kworker.0 00000100:00100000:0.0:1784189348.405777:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc05eddc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3640:1870854458264832:0@lo:400:kworker.0 00000100:00100000:1.0:1784189348.405886:0:26168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc05eddfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:0+-99:3639:x1870854458265472:12345-0@lo:8:ptlrpcd_00_01.0 Request processed in 1188us (1340us total) trans 0 rc -19/-19 00000100:00100000:1.0:1784189348.405894:0:26168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5064 00000100:00080000:0.0:1784189348.405963:0:3639:0:(import.c:65:import_set_state_nolock()) ffff9dc075655000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1784189348.405968:0:3639:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1784189348.405971:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc07fb35180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3639:1870854458265472:0@lo:8:ptlrpcd_00_01.0 00010000:00010000:3.0:1784189348.597293:0:7454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784189348.911543:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc080e7ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1870854458265600:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1784189348.911738:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784189348.911812:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458265600 00000100:00100000:2.0:1784189348.911819:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458265600 00000100:00100000:2.0:1784189348.912044:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2086 00000100:00100000:2.0:1784189348.912055:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc080e7d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1870854458265600:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1784189348.912170:0:8432:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8646976 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1784189348.912219:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc080e7d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1870854458265600:12345-0@lo:13:osp-pre-1-0.0 Request processed in 167us (481us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189348.912227:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2086 00000100:00100000:2.0:1784189348.912280:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc080e7ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1870854458265600:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1784189349.161272:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1784189349.161373:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1784189349.161400:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1784189349.161435:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1784189349.161458:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1784189349.161648:0:94308:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436386176 00000100:00100000:2.0:1784189349.161657:0:94308:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436386176 00000100:00100000:2.0:1784189349.161726:0:94308:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 179 00000100:00100000:2.0:1784189349.161736:0:94308:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc080e3ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:60f345e3-c70e-4f53-b5e7-c9671463c9a5+10:2399:x1870854436386176:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:2.0:1784189349.161820:0:94308:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc080e3ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:60f345e3-c70e-4f53-b5e7-c9671463c9a5+10:2399:x1870854436386176:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 86us (418us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189349.161828:0:94308:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 179 00000100:00100000:1.0:1784189349.161951:0:66169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436386304 00000100:00100000:1.0:1784189349.161955:0:66169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436386304 00000100:00100000:1.0:1784189349.162010:0:66169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436386432 00000100:00100000:1.0:1784189349.162014:0:66169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436386432 00000100:00100000:1.0:1784189349.162052:0:66169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1364 00000100:00100000:1.0:1784189349.162060:0:66169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc06b98f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:debedd94-805c-42a0-a5e5-41758b2012e9+153:2399:x1870854436386304:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:1.0:1784189349.162096:0:66169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc06b98f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:debedd94-805c-42a0-a5e5-41758b2012e9+153:2399:x1870854436386304:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 38us (846us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189349.162102:0:66169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1364 00000100:00100000:1.0:1784189349.162116:0:66169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1365 00000100:00100000:1.0:1784189349.162122:0:66169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc071536300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:debedd94-805c-42a0-a5e5-41758b2012e9+11:2399:x1870854436386432:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:1.0:1784189349.162144:0:66169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc071536300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:debedd94-805c-42a0-a5e5-41758b2012e9+11:2399:x1870854436386432:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 23us (708us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189349.162150:0:66169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1365 00000100:00080000:2.0:1784189349.162437:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1784189349.162441:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1784189349.162898:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436386560 00000100:00100000:0.0:1784189349.162906:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436386560 00000100:00100000:0.0:1784189349.162947:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436386688 00000100:00100000:0.0:1784189349.162950:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436386688 00000100:00100000:0.0:1784189349.162980:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 2603 00000100:00100000:0.0:1784189349.162987:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc071537480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:debedd94-805c-42a0-a5e5-41758b2012e9+7:2399:x1870854436386688:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:0.0:1784189349.163025:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc071537480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:debedd94-805c-42a0-a5e5-41758b2012e9+7:2399:x1870854436386688:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 39us (1565us total) trans 0 rc 0/0 00000100:00100000:0.0:1784189349.163032:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 2603 00000100:00100000:0.0:1784189349.163054:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 5065 00000100:00100000:0.0:1784189349.163059:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc06b98ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2399:x1870854436386560:12345-192.168.203.12@tcp:400:kworker.0 00000020:00080000:0.0:1784189349.163065:0:8427:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-192.168.203.12@tcp 00000100:00100000:0.0:1784189349.163088:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc06b98ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2399:x1870854436386560:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 28us (1715us total) trans 0 rc -107/-107 00000100:00100000:0.0:1784189349.163093:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 5065 00000100:00080000:2.0:1784189349.165388:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1784189349.177074:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1784189349.177631:0:26165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436386816 00000100:00100000:0.0:1784189349.177641:0:26165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436386816 00000100:00100000:0.0:1784189349.177696:0:26165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 5066 00000100:00100000:0.0:1784189349.177704:0:26165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc07fb35180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:0+-99:2395:x1870854436386816:12345-192.168.203.12@tcp:8:ptlrpcd_01_01.0 00010000:00020000:0.0:1784189349.177729:0:26165:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-OST0000: not available for connect from 192.168.203.12@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1784189349.177803:0:26165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc07fb35180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:0+-99:2395:x1870854436386816:12345-192.168.203.12@tcp:8:ptlrpcd_01_01.0 Request processed in 98us (738us total) trans 0 rc -19/-19 00000100:00100000:0.0:1784189349.177811:0:26165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 5066 00010000:00010000:3.0:1784189349.616772:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784189350.640308:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784189350.961003:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc071535500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1870854458265728:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1784189350.961114:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784189350.961155:0:9466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458265728 00000100:00100000:0.0:1784189350.961163:0:9466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458265728 00000100:00100000:0.0:1784189350.961219:0:9466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2087 00000100:00100000:0.0:1784189350.961232:0:9466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc05f02c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1870854458265728:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1784189350.961257:0:9466:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8646976 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1784189350.963278:0:9466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc05f02c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1870854458265728:12345-0@lo:13:osp-pre-1-1.0 Request processed in 2041us (2156us total) trans 0 rc 0/0 00000100:00100000:0.0:1784189350.963291:0:9466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2087 00000100:00100000:1.0:1784189350.967174:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc071535500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1870854458265728:0@lo:13:osp-pre-1-1.0 00000100:00080000:1.0:1784189350.967397:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00080000:1.0:1784189350.973376:0:94304:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 120259084438 is committed 00010000:00010000:0.0:1784189350.974009:0:3627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4710f400/0xcc1762b626f8d09b lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189350.974023:0:3627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4710f400/0xcc1762b626f8d09b lrc: 2/0,0 mode: TXN/TXN res: [0x20000cf21:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189350.974043:0:3627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4710f400/0xcc1762b626f8d09b lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189350.974050:0:3627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dbf4710f400 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:0.0:1784189350.974056:0:3627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4710f400/0xcc1762b626f8d09b lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189350.974063:0:3627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4710f400/0xcc1762b626f8d09b lrc: 4/0,0 mode: TXN/TXN res: [0x20000cf21:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189350.974082:0:3627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x7:0x0].0x0 (ffff9dbf45994300) 00010000:00010000:0.0:1784189350.974085:0:3627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784189350.974090:0:3627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4710f400/0xcc1762b626f8d09b lrc: 2/0,0 mode: --/TXN res: [0x20000cf21:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189350.974096:0:3627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dbf4710f400/0xcc1762b626f8d09b lrc: 0/0,0 mode: --/TXN res: [0x20000cf21:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189350.974169:0:3627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc058f66a00/0xcc1762b626f8d0da lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189350.974176:0:3627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc058f66a00/0xcc1762b626f8d0da lrc: 2/0,0 mode: TXN/TXN res: [0x20000cf21:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189350.974181:0:3627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dc058f66a00/0xcc1762b626f8d0da lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189350.974186:0:3627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc058f66a00 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:0.0:1784189350.974188:0:3627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc058f66a00/0xcc1762b626f8d0da lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189350.974205:0:3627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc058f66a00/0xcc1762b626f8d0da lrc: 4/0,0 mode: TXN/TXN res: [0x20000cf21:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189350.974214:0:3627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x6:0x0].0x0 (ffff9dc05a487700) 00010000:00010000:0.0:1784189350.974216:0:3627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784189350.974219:0:3627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dc058f66a00/0xcc1762b626f8d0da lrc: 2/0,0 mode: --/TXN res: [0x20000cf21:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189350.974225:0:3627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc058f66a00/0xcc1762b626f8d0da lrc: 0/0,0 mode: --/TXN res: [0x20000cf21:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189350.974238:0:3627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc07116e400/0xcc1762b626f8d14a lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189350.974244:0:3627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc07116e400/0xcc1762b626f8d14a lrc: 2/0,0 mode: TXN/TXN res: [0x20000cf21:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189350.974250:0:3627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dc07116e400/0xcc1762b626f8d14a lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189350.974255:0:3627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc07116e400 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:0.0:1784189350.974258:0:3627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc07116e400/0xcc1762b626f8d14a lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189350.974265:0:3627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc07116e400/0xcc1762b626f8d14a lrc: 4/0,0 mode: TXN/TXN res: [0x20000cf21:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189350.974272:0:3627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x8:0x0].0x0 (ffff9dbf45994f00) 00010000:00010000:0.0:1784189350.974274:0:3627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784189350.974277:0:3627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dc07116e400/0xcc1762b626f8d14a lrc: 2/0,0 mode: --/TXN res: [0x20000cf21:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189350.974293:0:3627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc07116e400/0xcc1762b626f8d14a lrc: 0/0,0 mode: --/TXN res: [0x20000cf21:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189350.974306:0:3627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0755a4000/0xcc1762b626f8d151 lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189350.974311:0:3627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0755a4000/0xcc1762b626f8d151 lrc: 2/0,0 mode: TXN/TXN res: [0x20000cf21:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189350.974335:0:3627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0755a4000/0xcc1762b626f8d151 lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189350.974340:0:3627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc0755a4000 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:0.0:1784189350.974344:0:3627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0755a4000/0xcc1762b626f8d151 lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189350.974350:0:3627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0755a4000/0xcc1762b626f8d151 lrc: 4/0,0 mode: TXN/TXN res: [0x20000cf21:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189350.974371:0:3627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x9:0x0].0x0 (ffff9dc07fab4300) 00010000:00010000:0.0:1784189350.974374:0:3627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784189350.974377:0:3627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0755a4000/0xcc1762b626f8d151 lrc: 2/0,0 mode: --/TXN res: [0x20000cf21:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189350.974383:0:3627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0755a4000/0xcc1762b626f8d151 lrc: 0/0,0 mode: --/TXN res: [0x20000cf21:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189350.974398:0:3627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04a20ac00/0xcc1762b626f8d1ba lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189350.974405:0:3627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04a20ac00/0xcc1762b626f8d1ba lrc: 2/0,0 mode: TXN/TXN res: [0x20000cf21:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189350.974418:0:3627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04a20ac00/0xcc1762b626f8d1ba lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189350.974423:0:3627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc04a20ac00 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:0.0:1784189350.974427:0:3627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04a20ac00/0xcc1762b626f8d1ba lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189350.974433:0:3627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04a20ac00/0xcc1762b626f8d1ba lrc: 4/0,0 mode: TXN/TXN res: [0x20000cf21:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189350.974442:0:3627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0xa:0x0].0x0 (ffff9dc05a487100) 00010000:00010000:0.0:1784189350.974445:0:3627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784189350.974448:0:3627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04a20ac00/0xcc1762b626f8d1ba lrc: 2/0,0 mode: --/TXN res: [0x20000cf21:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189350.974453:0:3627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc04a20ac00/0xcc1762b626f8d1ba lrc: 0/0,0 mode: --/TXN res: [0x20000cf21:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189350.974469:0:3627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc07116ec00/0xcc1762b626f8d1d6 lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189350.974474:0:3627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc07116ec00/0xcc1762b626f8d1d6 lrc: 2/0,0 mode: TXN/TXN res: [0x20000cf21:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189350.974479:0:3627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dc07116ec00/0xcc1762b626f8d1d6 lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189350.974484:0:3627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc07116ec00 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:0.0:1784189350.974487:0:3627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc07116ec00/0xcc1762b626f8d1d6 lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189350.975031:0:3627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc07116ec00/0xcc1762b626f8d1d6 lrc: 4/0,0 mode: TXN/TXN res: [0x20000cf21:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189350.975047:0:3627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0xb:0x0].0x0 (ffff9dc05a487c00) 00010000:00010000:0.0:1784189350.975050:0:3627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784189350.975054:0:3627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dc07116ec00/0xcc1762b626f8d1d6 lrc: 2/0,0 mode: --/TXN res: [0x20000cf21:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189350.975060:0:3627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc07116ec00/0xcc1762b626f8d1d6 lrc: 0/0,0 mode: --/TXN res: [0x20000cf21:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189350.975078:0:3627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc07116f200/0xcc1762b626f8d215 lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x19:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189350.975084:0:3627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc07116f200/0xcc1762b626f8d215 lrc: 2/0,0 mode: TXN/TXN res: [0x20000cf21:0x19:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189350.975090:0:3627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dc07116f200/0xcc1762b626f8d215 lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x19:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189350.975095:0:3627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc07116f200 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:0.0:1784189350.975098:0:3627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc07116f200/0xcc1762b626f8d215 lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x19:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189350.975104:0:3627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc07116f200/0xcc1762b626f8d215 lrc: 4/0,0 mode: TXN/TXN res: [0x20000cf21:0x19:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189350.975111:0:3627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x19:0x0].0x0 (ffff9dbf45994d00) 00010000:00010000:0.0:1784189350.975114:0:3627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784189350.975117:0:3627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dc07116f200/0xcc1762b626f8d215 lrc: 2/0,0 mode: --/TXN res: [0x20000cf21:0x19:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189350.975134:0:3627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc07116f200/0xcc1762b626f8d215 lrc: 0/0,0 mode: --/TXN res: [0x20000cf21:0x19:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189350.975151:0:3627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0755a4400/0xcc1762b626f8d254 lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189350.975157:0:3627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0755a4400/0xcc1762b626f8d254 lrc: 2/0,0 mode: TXN/TXN res: [0x20000cf21:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189350.975163:0:3627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0755a4400/0xcc1762b626f8d254 lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189350.975168:0:3627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc0755a4400 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:0.0:1784189350.975172:0:3627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0755a4400/0xcc1762b626f8d254 lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189350.975177:0:3627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0755a4400/0xcc1762b626f8d254 lrc: 4/0,0 mode: TXN/TXN res: [0x20000cf21:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189350.975187:0:3627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0xc:0x0].0x0 (ffff9dc07fab4500) 00010000:00010000:0.0:1784189350.975188:0:3627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784189350.975191:0:3627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0755a4400/0xcc1762b626f8d254 lrc: 2/0,0 mode: --/TXN res: [0x20000cf21:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189350.975196:0:3627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0755a4400/0xcc1762b626f8d254 lrc: 0/0,0 mode: --/TXN res: [0x20000cf21:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189350.976151:0:3627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc070146c00/0xcc1762b626f8d29a lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189350.976162:0:3627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc070146c00/0xcc1762b626f8d29a lrc: 2/0,0 mode: TXN/TXN res: [0x20000cf21:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189350.976180:0:3627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dc070146c00/0xcc1762b626f8d29a lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189350.976185:0:3627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc070146c00 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:0.0:1784189350.976189:0:3627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc070146c00/0xcc1762b626f8d29a lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189350.976195:0:3627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc070146c00/0xcc1762b626f8d29a lrc: 4/0,0 mode: TXN/TXN res: [0x20000cf21:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189350.976209:0:3627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0xd:0x0].0x0 (ffff9dc07fab4a00) 00010000:00010000:0.0:1784189350.976211:0:3627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784189350.976214:0:3627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dc070146c00/0xcc1762b626f8d29a lrc: 2/0,0 mode: --/TXN res: [0x20000cf21:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189350.976220:0:3627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc070146c00/0xcc1762b626f8d29a lrc: 0/0,0 mode: --/TXN res: [0x20000cf21:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189350.977019:0:3627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0755a5600/0xcc1762b626f8d2e0 lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189350.977029:0:3627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0755a5600/0xcc1762b626f8d2e0 lrc: 2/0,0 mode: TXN/TXN res: [0x20000cf21:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189350.977035:0:3627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0755a5600/0xcc1762b626f8d2e0 lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189350.977040:0:3627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc0755a5600 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:0.0:1784189350.977044:0:3627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0755a5600/0xcc1762b626f8d2e0 lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189350.977064:0:3627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0755a5600/0xcc1762b626f8d2e0 lrc: 4/0,0 mode: TXN/TXN res: [0x20000cf21:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189350.977075:0:3627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0xe:0x0].0x0 (ffff9dbf44851400) 00010000:00010000:0.0:1784189350.977078:0:3627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784189350.977081:0:3627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0755a5600/0xcc1762b626f8d2e0 lrc: 2/0,0 mode: --/TXN res: [0x20000cf21:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189350.977088:0:3627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0755a5600/0xcc1762b626f8d2e0 lrc: 0/0,0 mode: --/TXN res: [0x20000cf21:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189350.977105:0:3627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc07116fe00/0xcc1762b626f8d30a lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189350.977110:0:3627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc07116fe00/0xcc1762b626f8d30a lrc: 2/0,0 mode: TXN/TXN res: [0x20000cf21:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189350.977116:0:3627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dc07116fe00/0xcc1762b626f8d30a lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189350.977121:0:3627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc07116fe00 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:0.0:1784189350.977124:0:3627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc07116fe00/0xcc1762b626f8d30a lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189350.977130:0:3627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc07116fe00/0xcc1762b626f8d30a lrc: 4/0,0 mode: TXN/TXN res: [0x20000cf21:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189350.977138:0:3627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x10:0x0].0x0 (ffff9dc05a487b00) 00010000:00010000:0.0:1784189350.977140:0:3627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784189350.977143:0:3627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dc07116fe00/0xcc1762b626f8d30a lrc: 2/0,0 mode: --/TXN res: [0x20000cf21:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189350.977157:0:3627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc07116fe00/0xcc1762b626f8d30a lrc: 0/0,0 mode: --/TXN res: [0x20000cf21:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189350.977169:0:3627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc07116e000/0xcc1762b626f8d350 lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0xf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189350.977174:0:3627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc07116e000/0xcc1762b626f8d350 lrc: 2/0,0 mode: TXN/TXN res: [0x20000cf21:0xf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189350.977180:0:3627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dc07116e000/0xcc1762b626f8d350 lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0xf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189350.977184:0:3627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc07116e000 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:0.0:1784189350.977187:0:3627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc07116e000/0xcc1762b626f8d350 lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0xf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189350.977193:0:3627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc07116e000/0xcc1762b626f8d350 lrc: 4/0,0 mode: TXN/TXN res: [0x20000cf21:0xf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189350.977202:0:3627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0xf:0x0].0x0 (ffff9dc05a487f00) 00010000:00010000:0.0:1784189350.977204:0:3627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784189350.977206:0:3627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dc07116e000/0xcc1762b626f8d350 lrc: 2/0,0 mode: --/TXN res: [0x20000cf21:0xf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189350.977211:0:3627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc07116e000/0xcc1762b626f8d350 lrc: 0/0,0 mode: --/TXN res: [0x20000cf21:0xf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189350.977222:0:3627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0755a4200/0xcc1762b626f8d39d lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x11:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189350.977228:0:3627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0755a4200/0xcc1762b626f8d39d lrc: 2/0,0 mode: TXN/TXN res: [0x20000cf21:0x11:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189350.977254:0:3627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0755a4200/0xcc1762b626f8d39d lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x11:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189350.977258:0:3627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc0755a4200 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:0.0:1784189350.977261:0:3627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0755a4200/0xcc1762b626f8d39d lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x11:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189350.977267:0:3627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0755a4200/0xcc1762b626f8d39d lrc: 4/0,0 mode: TXN/TXN res: [0x20000cf21:0x11:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189350.977275:0:3627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x11:0x0].0x0 (ffff9dc05a487000) 00010000:00010000:0.0:1784189350.977279:0:3627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784189350.977281:0:3627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0755a4200/0xcc1762b626f8d39d lrc: 2/0,0 mode: --/TXN res: [0x20000cf21:0x11:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189350.977287:0:3627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0755a4200/0xcc1762b626f8d39d lrc: 0/0,0 mode: --/TXN res: [0x20000cf21:0x11:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 68287 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189350.977300:0:3627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc070147000/0xcc1762b626f8d3c7 lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x12:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189350.977306:0:3627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc070147000/0xcc1762b626f8d3c7 lrc: 2/0,0 mode: TXN/TXN res: [0x20000cf21:0x12:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189350.977313:0:3627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dc070147000/0xcc1762b626f8d3c7 lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x12:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189350.977333:0:3627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc070147000 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:0.0:1784189350.977336:0:3627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc070147000/0xcc1762b626f8d3c7 lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x12:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189350.978192:0:3627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc070147000/0xcc1762b626f8d3c7 lrc: 4/0,0 mode: TXN/TXN res: [0x20000cf21:0x12:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189350.978214:0:3627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x12:0x0].0x0 (ffff9dc07fab4400) 00010000:00010000:0.0:1784189350.978216:0:3627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784189350.978221:0:3627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dc070147000/0xcc1762b626f8d3c7 lrc: 2/0,0 mode: --/TXN res: [0x20000cf21:0x12:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189350.978442:0:3627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc070147000/0xcc1762b626f8d3c7 lrc: 0/0,0 mode: --/TXN res: [0x20000cf21:0x12:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189350.978466:0:3627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc080f04200/0xcc1762b626f8d40d lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189350.978472:0:3627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc080f04200/0xcc1762b626f8d40d lrc: 2/0,0 mode: TXN/TXN res: [0x20000cf21:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189350.978479:0:3627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dc080f04200/0xcc1762b626f8d40d lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189350.978484:0:3627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc080f04200 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:0.0:1784189350.978487:0:3627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc080f04200/0xcc1762b626f8d40d lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189350.978494:0:3627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc080f04200/0xcc1762b626f8d40d lrc: 4/0,0 mode: TXN/TXN res: [0x20000cf21:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189350.979657:0:3627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x13:0x0].0x0 (ffff9dc07499be00) 00010000:00010000:0.0:1784189350.979664:0:3627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784189350.979670:0:3627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dc080f04200/0xcc1762b626f8d40d lrc: 2/0,0 mode: --/TXN res: [0x20000cf21:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189350.979695:0:3627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc080f04200/0xcc1762b626f8d40d lrc: 0/0,0 mode: --/TXN res: [0x20000cf21:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189350.979717:0:3627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc070146000/0xcc1762b626f8d47d lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x15:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189350.979724:0:3627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc070146000/0xcc1762b626f8d47d lrc: 2/0,0 mode: TXN/TXN res: [0x20000cf21:0x15:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189350.979730:0:3627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dc070146000/0xcc1762b626f8d47d lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x15:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189350.979735:0:3627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc070146000 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:0.0:1784189350.979738:0:3627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc070146000/0xcc1762b626f8d47d lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x15:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189350.979744:0:3627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc070146000/0xcc1762b626f8d47d lrc: 4/0,0 mode: TXN/TXN res: [0x20000cf21:0x15:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189350.979764:0:3627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x15:0x0].0x0 (ffff9dc07fab4000) 00010000:00010000:0.0:1784189350.979767:0:3627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784189350.979769:0:3627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dc070146000/0xcc1762b626f8d47d lrc: 2/0,0 mode: --/TXN res: [0x20000cf21:0x15:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189350.979775:0:3627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc070146000/0xcc1762b626f8d47d lrc: 0/0,0 mode: --/TXN res: [0x20000cf21:0x15:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189350.979789:0:3627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc081b17a00/0xcc1762b626f8d484 lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x14:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189350.979794:0:3627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc081b17a00/0xcc1762b626f8d484 lrc: 2/0,0 mode: TXN/TXN res: [0x20000cf21:0x14:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189350.979806:0:3627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dc081b17a00/0xcc1762b626f8d484 lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x14:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189350.979811:0:3627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc081b17a00 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:0.0:1784189350.979814:0:3627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc081b17a00/0xcc1762b626f8d484 lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x14:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189350.979820:0:3627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc081b17a00/0xcc1762b626f8d484 lrc: 4/0,0 mode: TXN/TXN res: [0x20000cf21:0x14:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189350.979845:0:3627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x14:0x0].0x0 (ffff9dc07499b800) 00010000:00010000:0.0:1784189350.979848:0:3627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784189350.979851:0:3627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dc081b17a00/0xcc1762b626f8d484 lrc: 2/0,0 mode: --/TXN res: [0x20000cf21:0x14:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189350.979858:0:3627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc081b17a00/0xcc1762b626f8d484 lrc: 0/0,0 mode: --/TXN res: [0x20000cf21:0x14:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189350.979873:0:3627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0565e6a00/0xcc1762b626f8d4fb lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x16:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189350.979878:0:3627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0565e6a00/0xcc1762b626f8d4fb lrc: 2/0,0 mode: TXN/TXN res: [0x20000cf21:0x16:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189350.979884:0:3627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0565e6a00/0xcc1762b626f8d4fb lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x16:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189350.979889:0:3627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc0565e6a00 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:0.0:1784189350.979893:0:3627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0565e6a00/0xcc1762b626f8d4fb lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x16:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189350.979908:0:3627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0565e6a00/0xcc1762b626f8d4fb lrc: 4/0,0 mode: TXN/TXN res: [0x20000cf21:0x16:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189350.979918:0:3627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x16:0x0].0x0 (ffff9dbf44851900) 00010000:00010000:0.0:1784189350.979920:0:3627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784189350.979923:0:3627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0565e6a00/0xcc1762b626f8d4fb lrc: 2/0,0 mode: --/TXN res: [0x20000cf21:0x16:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189350.979929:0:3627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc0565e6a00/0xcc1762b626f8d4fb lrc: 0/0,0 mode: --/TXN res: [0x20000cf21:0x16:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189350.979945:0:3627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc081b16e00/0xcc1762b626f8d502 lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x17:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189350.979951:0:3627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc081b16e00/0xcc1762b626f8d502 lrc: 2/0,0 mode: TXN/TXN res: [0x20000cf21:0x17:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189350.979957:0:3627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dc081b16e00/0xcc1762b626f8d502 lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x17:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189350.979963:0:3627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc081b16e00 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:0.0:1784189350.979967:0:3627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc081b16e00/0xcc1762b626f8d502 lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x17:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189350.979974:0:3627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc081b16e00/0xcc1762b626f8d502 lrc: 4/0,0 mode: TXN/TXN res: [0x20000cf21:0x17:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189350.979983:0:3627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x17:0x0].0x0 (ffff9dbf44851b00) 00010000:00010000:0.0:1784189350.979986:0:3627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784189350.979989:0:3627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dc081b16e00/0xcc1762b626f8d502 lrc: 2/0,0 mode: --/TXN res: [0x20000cf21:0x17:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189350.980005:0:3627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc081b16e00/0xcc1762b626f8d502 lrc: 0/0,0 mode: --/TXN res: [0x20000cf21:0x17:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189350.980021:0:3627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc081b17400/0xcc1762b626f8d525 lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189350.980027:0:3627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc081b17400/0xcc1762b626f8d525 lrc: 2/0,0 mode: TXN/TXN res: [0x20000cf21:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189350.980033:0:3627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dc081b17400/0xcc1762b626f8d525 lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189350.980038:0:3627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc081b17400 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:0.0:1784189350.980042:0:3627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc081b17400/0xcc1762b626f8d525 lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189350.980047:0:3627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc081b17400/0xcc1762b626f8d525 lrc: 4/0,0 mode: TXN/TXN res: [0x20000cf21:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189350.980057:0:3627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x18:0x0].0x0 (ffff9dc07499b300) 00010000:00010000:0.0:1784189350.980059:0:3627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784189350.980062:0:3627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dc081b17400/0xcc1762b626f8d525 lrc: 2/0,0 mode: --/TXN res: [0x20000cf21:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189350.980067:0:3627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc081b17400/0xcc1762b626f8d525 lrc: 0/0,0 mode: --/TXN res: [0x20000cf21:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189351.665591:0:26173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784189352.688788:0:7454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784189353.521461:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1784189353.521483:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc05f02f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1870854458265856:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1784189353.521576:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784189353.521620:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458265856 00000100:00100000:1.0:1784189353.521627:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458265856 00000100:00100000:1.0:1784189353.521671:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3962 00000100:00100000:1.0:1784189353.521679:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc05f02ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3643:x1870854458265856:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1784189353.521717:0:8438:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445249024 avail 1299009536 00000100:00100000:1.0:1784189353.521767:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc05f02ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3643:x1870854458265856:12345-0@lo:41:osp-pre-0-1.0 Request processed in 89us (191us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189353.521774:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3962 00000100:00100000:1.0:1784189353.521820:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc05f02f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1870854458265856:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1784189353.526002:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc05eddc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1870854458265984:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1784189353.526068:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784189353.526121:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458265984 00000100:00100000:0.0:1784189353.526134:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458265984 00000100:00100000:0.0:1784189353.526176:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3963 00000100:00100000:0.0:1784189353.526184:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc05eddd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3643:x1870854458265984:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1784189353.526219:0:8439:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445568512 avail 1299329024 00000100:00100000:0.0:1784189353.526259:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc05eddd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3643:x1870854458265984:12345-0@lo:41:osp-pre-1-0.0 Request processed in 76us (191us total) trans 0 rc 0/0 00000100:00100000:0.0:1784189353.526265:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3963 00000100:00100000:0.0:1784189353.526304:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc05eddc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1870854458265984:0@lo:41:osp-pre-1-0.0 00000100:00080000:1.0:1784189353.526443:0:63468:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1784189353.526447:0:63468:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1784189353.526450:0:63468:0:(import.c:65:import_set_state_nolock()) ffff9dbf43114800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1784189353.526456:0:63468:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 3590 00000100:00080000:1.0:1784189353.526459:0:63468:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1784189353.526464:0:63468:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff9dbf43114800 using connection 192.168.203.112@tcp/0@lo 00000100:00100000:1.0:1784189353.526484:0:63468:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9dc07ab9b800 x1870854458266496/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1784189353.526513:0:63468:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1784189353.526516:0:63468:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1784189353.526518:0:63468:0:(import.c:65:import_set_state_nolock()) ffff9dc075655000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1784189353.526521:0:63468:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 3590 00000100:00080000:1.0:1784189353.526524:0:63468:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1784189353.526527:0:63468:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9dc075655000 using connection 192.168.203.112@tcp/0@lo 00000100:00100000:1.0:1784189353.526537:0:63468:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9dc080f6bb80 x1870854458266880/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1784189353.526582:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc05f02e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3641:1870854458266240:0@lo:400:kworker.0 00000100:00100000:1.0:1784189353.526629:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784189353.526650:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc080f69c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1870854458267008:0@lo:400:kworker.0 00000100:00100000:1.0:1784189353.526681:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784189353.526700:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1784189353.526705:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc05f02f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:bd553d0d-03e2-4233-b06b-b55bbfa2b954:3641:1870854458266112:0@lo:400:kworker.0 00000100:00100000:1.0:1784189353.526744:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784189353.526766:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc080f6b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3641:1870854458266752:0@lo:400:kworker.0 00000100:00100000:1.0:1784189353.526785:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784189353.526808:0:66945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458266240 00000100:00100000:1.0:1784189353.526811:0:66945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458266240 00000100:00100000:1.0:1784189353.526849:0:66945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458266752 00000100:00100000:1.0:1784189353.526852:0:66945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458266752 00000100:00100000:1.0:1784189353.526872:0:66945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1366 00000100:00100000:1.0:1784189353.526879:0:66945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc080f68e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1870854458266240:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784189353.526914:0:66945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc080f68e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1870854458266240:12345-0@lo:400:kworker.0 Request processed in 35us (284us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189353.526921:0:66945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1366 00000100:00100000:1.0:1784189353.526934:0:66945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1367 00000100:00100000:1.0:1784189353.526939:0:66945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf4859ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1870854458266752:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784189353.526964:0:66945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf4859ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1870854458266752:12345-0@lo:400:kworker.0 Request processed in 25us (178us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189353.526970:0:66945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1367 00000100:00100000:1.0:1784189353.526986:0:26163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458267008 00000100:00100000:1.0:1784189353.526989:0:26163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458267008 00000100:00100000:1.0:1784189353.527013:0:26163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2604 00000100:00100000:1.0:1784189353.527019:0:26163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf4859b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+5:3641:x1870854458267008:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784189353.527047:0:26163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf4859b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+5:3641:x1870854458267008:12345-0@lo:400:kworker.0 Request processed in 27us (365us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189353.527063:0:26163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2604 00000100:00100000:1.0:1784189353.527080:0:94314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458266112 00000100:00100000:1.0:1784189353.527083:0:94314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458266112 00000100:00100000:1.0:1784189353.527105:0:94314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:1.0:1784189353.527109:0:94314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc080e39850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:bd553d0d-03e2-4233-b06b-b55bbfa2b954+21:3641:x1870854458266112:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784189353.527133:0:94314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc080e39850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:bd553d0d-03e2-4233-b06b-b55bbfa2b954+21:3641:x1870854458266112:12345-0@lo:400:kworker.0 Request processed in 24us (390us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189353.527138:0:94314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00080000:1.0:1784189353.527161:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1784189353.527165:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1784189353.527189:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc05f02f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:bd553d0d-03e2-4233-b06b-b55bbfa2b954:3641:1870854458266112:0@lo:400:kworker.0 00000100:00100000:1.0:1784189353.527200:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc080f6b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3641:1870854458266752:0@lo:400:kworker.0 00000100:00100000:1.0:1784189353.527208:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc05f02e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3641:1870854458266240:0@lo:400:kworker.0 00000100:00100000:1.0:1784189353.527215:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc080f69c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1870854458267008:0@lo:400:kworker.0 00000100:00100000:0.0:1784189353.527474:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc07ab9b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3639:1870854458266496:0@lo:8:kworker.0 00000100:00100000:0.0:1784189353.527525:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784189353.527545:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc080f6bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3639:1870854458266880:0@lo:8:kworker.0 00000100:00100000:0.0:1784189353.527564:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784189353.527605:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458266496 00000100:00100000:0.0:1784189353.527609:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458266496 00000100:00100000:0.0:1784189353.527628:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458266880 00000100:00100000:0.0:1784189353.527630:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458266880 00000100:00100000:0.0:1784189353.527643:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5067 00000100:00100000:0.0:1784189353.527648:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc05eddc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3639:x1870854458266496:12345-0@lo:8:kworker.0 00010000:00020000:0.0:1784189353.527664:0:8429:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-OST0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1784189353.527696:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc05eddc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3639:x1870854458266496:12345-0@lo:8:kworker.0 Request processed in 47us (171us total) trans 0 rc -19/-19 00000100:00100000:0.0:1784189353.527703:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5067 00000100:00100000:0.0:1784189353.527715:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5068 00000100:00100000:0.0:1784189353.527718:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc05edddf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3639:x1870854458266880:12345-0@lo:8:kworker.0 00010000:00020000:0.0:1784189353.527739:0:8429:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-OST0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1784189353.527773:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc05edddf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3639:x1870854458266880:12345-0@lo:8:kworker.0 Request processed in 53us (208us total) trans 0 rc -19/-19 00000100:00100000:0.0:1784189353.527780:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5068 00000100:00080000:0.0:1784189353.527816:0:3639:0:(import.c:65:import_set_state_nolock()) ffff9dbf43114800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1784189353.527821:0:3639:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1784189353.527824:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc07ab9b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3639:1870854458266496:0@lo:8:kworker.0 00000100:00080000:0.0:1784189353.527833:0:3639:0:(import.c:65:import_set_state_nolock()) ffff9dc075655000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1784189353.527836:0:3639:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1784189353.527839:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc080f6bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3639:1870854458266880:0@lo:8:kworker.0 00000100:00100000:0.0:1784189353.527859:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc080f68a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1870854458266624:0@lo:400:kworker.0 00000100:00100000:0.0:1784189353.527882:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784189353.527901:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1784189353.527908:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc07ab99f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3643:1870854458266368:0@lo:400:kworker.0 00000100:00100000:0.0:1784189353.527928:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784189353.527943:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc080f6b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3643:1870854458267136:0@lo:400:kworker.0 00000100:00100000:0.0:1784189353.527962:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784189353.527984:0:26161:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458266624 00000100:00100000:0.0:1784189353.527988:0:26161:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458266624 00000100:00100000:0.0:1784189353.528018:0:26161:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2605 00000100:00100000:0.0:1784189353.528024:0:26161:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc05eddc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:3643:x1870854458266624:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784189353.528057:0:26161:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc05eddc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:3643:x1870854458266624:12345-0@lo:400:kworker.0 Request processed in 34us (174us total) trans 0 rc 0/0 00000100:00100000:0.0:1784189353.528064:0:26161:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2605 00000100:00100000:0.0:1784189353.528080:0:68287:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458266368 00000100:00100000:0.0:1784189353.528083:0:68287:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458266368 00000100:00100000:0.0:1784189353.528117:0:68287:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458267136 00000100:00100000:0.0:1784189353.528121:0:68287:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458267136 00000100:00100000:0.0:1784189353.528138:0:68287:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1368 00000100:00100000:0.0:1784189353.528144:0:68287:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc05edde300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1870854458266368:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784189353.528173:0:68287:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc05edde300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1870854458266368:12345-0@lo:400:kworker.0 Request processed in 29us (245us total) trans 0 rc 0/0 00000100:00100000:0.0:1784189353.528180:0:68287:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1368 00000100:00100000:0.0:1784189353.528191:0:68287:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1369 00000100:00100000:0.0:1784189353.528197:0:68287:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc05edde680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1870854458267136:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784189353.528225:0:68287:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc05edde680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1870854458267136:12345-0@lo:400:kworker.0 Request processed in 28us (262us total) trans 0 rc 0/0 00000100:00100000:0.0:1784189353.528231:0:68287:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1369 00000100:00080000:0.0:1784189353.528251:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1784189353.528254:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1784189353.528275:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc07ab99f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3643:1870854458266368:0@lo:400:kworker.0 00000100:00100000:0.0:1784189353.528286:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc080f6b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3643:1870854458267136:0@lo:400:kworker.0 00000100:00100000:0.0:1784189353.528296:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc080f68a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1870854458266624:0@lo:400:kworker.0 00010000:00010000:2.0:1784189353.711829:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1784189353.781978:0:96283:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg312-server.virtnet: executing load_module ../libcfs/libcfs/libcfs 00000100:00100000:0.0:1784189354.034161:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc071535c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1870854458267264:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1784189354.034234:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784189354.034257:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458267264 00000100:00100000:2.0:1784189354.034265:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458267264 00000100:00100000:2.0:1784189354.034306:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2088 00000100:00100000:2.0:1784189354.034315:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc05edddc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1870854458267264:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1784189354.034473:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8646976 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1784189354.034525:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc05edddc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1870854458267264:12345-0@lo:13:osp-pre-1-0.0 Request processed in 211us (291us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189354.034534:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2088 00000100:00100000:2.0:1784189354.034585:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc071535c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1870854458267264:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1784189354.279418:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1784189354.279469:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1784189354.279511:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1784189354.279537:0:66170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436387072 00000100:00100000:1.0:1784189354.279548:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1784189354.279555:0:66170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436387072 00000100:00100000:2.0:1784189354.279605:0:9982:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436387456 00000100:00100000:2.0:1784189354.279616:0:9982:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436387456 00000100:00100000:0.0:1784189354.279652:0:94308:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436386944 00000100:00100000:0.0:1784189354.279659:0:94308:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436386944 00000100:00100000:3.0:1784189354.279678:0:66170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436387200 00000100:00100000:3.0:1784189354.279686:0:66170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436387200 00000100:00100000:2.0:1784189354.279691:0:9982:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 2606 00000100:00100000:2.0:1784189354.279706:0:9982:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc080f68a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:debedd94-805c-42a0-a5e5-41758b2012e9+7:2398:x1870854436387456:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:0.0:1784189354.279708:0:94308:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 181 00000100:00100000:0.0:1784189354.279735:0:94308:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc080e39050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:60f345e3-c70e-4f53-b5e7-c9671463c9a5+10:2398:x1870854436386944:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:3.0:1784189354.279749:0:66170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1370 00000100:00100000:3.0:1784189354.279766:0:66170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf48598380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:debedd94-805c-42a0-a5e5-41758b2012e9+51:2398:x1870854436387072:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:2.0:1784189354.279805:0:9982:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc080f68a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:debedd94-805c-42a0-a5e5-41758b2012e9+7:2398:x1870854436387456:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 100us (331us total) trans 0 rc 0/0 00000100:00080000:1.0:1784189354.279807:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1784189354.279815:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1784189354.279819:0:9982:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 2606 00000100:00080000:1.0:1784189354.279820:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1784189354.279877:0:66171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1371 00000100:00100000:2.0:1784189354.279888:0:66171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc080f6b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:debedd94-805c-42a0-a5e5-41758b2012e9+11:2398:x1870854436387200:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:0.0:1784189354.280312:0:94308:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc080e39050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:60f345e3-c70e-4f53-b5e7-c9671463c9a5+10:2398:x1870854436386944:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 592us (798us total) trans 0 rc 0/0 00000100:00100000:0.0:1784189354.280362:0:94308:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 181 00000100:00100000:3.0:1784189354.286049:0:66170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf48598380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:debedd94-805c-42a0-a5e5-41758b2012e9+51:2398:x1870854436387072:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 6270us (6618us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189354.286071:0:66170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1370 00000100:00100000:2.0:1784189354.289903:0:66171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc080f6b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:debedd94-805c-42a0-a5e5-41758b2012e9+11:2398:x1870854436387200:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 10005us (10346us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189354.289919:0:66171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1371 00000100:00100000:1.0:1784189354.290770:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1784189354.290867:0:26223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436387328 00000100:00100000:1.0:1784189354.290876:0:26223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436387328 00000100:00100000:1.0:1784189354.290977:0:26223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 5069 00000100:00100000:1.0:1784189354.290985:0:26223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc080f6bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:0+-99:2395:x1870854436387328:12345-192.168.203.12@tcp:8:kworker.0 00010000:00020000:1.0:1784189354.291020:0:26223:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-OST0000: not available for connect from 192.168.203.12@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1784189354.291066:0:26223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc080f6bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:0+-99:2395:x1870854436387328:12345-192.168.203.12@tcp:8:kworker.0 Request processed in 81us (298us total) trans 0 rc -19/-19 00000100:00100000:1.0:1784189354.291073:0:26223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 5069 00010000:00010000:1.0:1784189354.738456:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784189355.761460:0:26173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000040:1.0:1784189356.079438:0:75599:0:(genops.c:1231:class_import_get()) import ffff9dc080cc8800 refcount=3 obd=lustre-OST0001-osc-MDT0001 00000100:00000040:1.0:1784189356.079473:0:75599:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [0000000030e9636e] to pc [ptlrpcd_00_00+0] req@ffff9dc080f69c00 x1870854458267392/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/200/ffffffff rc 0/-1 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784189356.079507:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00000040:1.0:1784189356.079521:0:3641:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff9dc080f69c00 x1870854458267392/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/200/ffffffff rc 0/-1 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784189356.079533:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc080f69c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1870854458267392:0@lo:13:osp-pre-1-1.0 00000100:00000040:1.0:1784189356.079558:0:3641:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff9dc080f69c00 x1870854458267392/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784189372 ref 2 fl Rpc:r/200/ffffffff rc 0/-1 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1784189356.079567:0:3641:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:1.0:1784189356.079605:0:3641:0:(events.c:337:request_in_callback()) incoming req@ffff9dc080f6b100 x1870854458267392 msgsize 224 00000100:00100000:1.0:1784189356.079609:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:1.0:1784189356.079631:0:3641:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff9dc080f69c00 x1870854458267392/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784189372 ref 2 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1784189356.079643:0:3641:0:(niobuf.c:635:kick_cpu_latency()) lustre-OST0001-osc-MDT0001: using a timeout of 5102 usecs (6 jiffies) 00000100:00100000:1.0:1784189356.079666:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458267392 00000100:00100000:1.0:1784189356.079672:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458267392 00000020:00000040:1.0:1784189356.079676:0:8432:0:(genops.c:825:class_conn2export()) looking for export cookie 0xcc1762b626f864bc 00000020:00000040:1.0:1784189356.079680:0:8432:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9dbf42277000 refcount=5 00000020:00000040:1.0:1784189356.079691:0:8432:0:(obd_config.c:994:class_incref()) incref lustre-OST0001 (ffff9dbf4312b380) now 10 - evictor 00000100:00000040:1.0:1784189356.079722:0:8432:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_create at +6s 00000100:00100000:1.0:1784189356.079758:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2089 00000100:00000040:1.0:1784189356.079762:0:8432:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9dbf42277000 : new rpc_count 1 00000100:00000040:1.0:1784189356.079766:0:8432:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9dc080f6b100 x1870854458267392/t0(0) o13->lustre-MDT0001-mdtlov_UUID@0@lo:547/0 lens 224/0 e 0 to 0 dl 1784189367 ref 1 fl New:/200/ffffffff rc 0/-1 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784189356.079778:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc080f6b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1870854458267392:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1784189356.079806:0:8432:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8646976 pending 0 free 3923529728 avail 3692007424 00010000:00000040:1.0:1784189356.079816:0:8432:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 4294968945, transno 0, xid 1870854458267392 00000100:00000040:1.0:1784189356.079836:0:8432:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9dc0710a1d00 refcount 52 to 0@lo 00000100:00000040:1.0:1784189356.079841:0:8432:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:1.0:1784189356.079859:0:8432:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=368 offset=224 replen=368 req@ffff9dc080f69c00 x1870854458267392/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784189372 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1784189356.079877:0:8432:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff9dc0710a1d00 refcount 51 to 0@lo 00000100:00000040:1.0:1784189356.079882:0:8432:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9dc080f6b100 x1870854458267392/t0(0) o13->lustre-MDT0001-mdtlov_UUID@0@lo:547/0 lens 224/368 e 0 to 0 dl 1784189367 ref 1 fl Interpret:/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784189356.079890:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc080f6b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1870854458267392:12345-0@lo:13:osp-pre-1-1.0 Request processed in 115us (284us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189356.079897:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2089 00000100:00000040:1.0:1784189356.079900:0:8432:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9dbf42277000 : new rpc_count 0 00000020:00000040:1.0:1784189356.079910:0:8432:0:(genops.c:900:class_export_put()) PUTting export ffff9dbf42277000 : new refcount 4 00000100:00080000:1.0:1784189356.079923:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000020:00000040:1.0:1784189356.079926:0:6509:0:(obd_config.c:1022:class_decref()) Decref lustre-OST0001 (ffff9dbf4312b380) now 10 - evictor 00000100:00000040:1.0:1784189356.079954:0:3641:0:(client.c:3108:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: skip recheck: last_committed 4294968945 00000100:00000040:1.0:1784189356.079960:0:3641:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff9dc080f69c00 x1870854458267392/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784189372 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000004:00000040:1.0:1784189356.079969:0:3641:0:(osp_precreate.c:87:osp_pre_update_status_msfs()) lustre-OST0001-osc-MDT0001: Updating status = 0 00000004:00000040:1.0:1784189356.079972:0:3641:0:(osp_precreate.c:1081:osp_pre_update_msfs()) lustre-OST0001-osc-MDT0001: blocks=958279 free=957893 avail=901318 avail_mb=3520 hwm_mb=7 files=262144 ffree=261731 state=0: rc = 0 00000100:00000040:1.0:1784189356.079978:0:3641:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9dc080f69c00 x1870854458267392/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784189372 ref 1 fl Interpret:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784189356.080200:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc080f69c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1870854458267392:0@lo:13:osp-pre-1-1.0 00000100:00000040:1.0:1784189356.080207:0:3641:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff9dc080f69c00 x1870854458267392/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784189372 ref 1 fl Complete:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000020:00000040:1.0:1784189356.080216:0:3641:0:(genops.c:1244:class_import_put()) import ffff9dc080cc8800 refcount=2 obd=lustre-OST0001-osc-MDT0001 00010000:00010000:3.0:1784189356.790497:0:7454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784189357.809599:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000040:1.0:1784189358.641340:0:94320:0:(genops.c:1231:class_import_get()) import ffff9dbf436c1800 refcount=3 obd=lustre-MDT0001-osp-MDT0000 00000100:00000040:2.0:1784189358.641371:0:63468:0:(pinger.c:229:ptlrpc_pinger_process_import()) bd553d0d-03e2-4233-b06b-b55bbfa2b954->MGS: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000020:00000040:2.0:1784189358.641379:0:63468:0:(genops.c:1231:class_import_get()) import ffff9dc07110c800 refcount=4 obd=MGC192.168.203.112@tcp 00000100:00000040:1.0:1784189358.641382:0:94320:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [0000000030e9636e] to pc [ptlrpcd_00_01+1] req@ffff9dc080f69c00 x1870854458267520/t0(0) o41->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/200/ffffffff rc 0/-1 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1784189358.641397:0:63468:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging bd553d0d-03e2-4233-b06b-b55bbfa2b954->MGS req@ffff9dc080e7ea00 x1870854458267648/t0(0) o400->MGC192.168.203.112@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:2.0:1784189358.641418:0:63468:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [000000000d13032f] to pc [ptlrpcd_00_02+2] req@ffff9dc080e7ea00 x1870854458267648/t0(0) o400->MGC192.168.203.112@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1784189358.641418:0:3641:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff9dc080f69c00 x1870854458267520/t0(0) o41->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/200/ffffffff rc 0/-1 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784189358.641431:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc080f69c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1870854458267520:0@lo:41:osp-pre-1-0.0 00000100:00000040:2.0:1784189358.641436:0:63468:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000020:00000040:2.0:1784189358.641441:0:63468:0:(genops.c:1231:class_import_get()) import ffff9dbf425f4800 refcount=3 obd=lustre-MDT0000-lwp-OST0001 00000100:00000040:2.0:1784189358.641447:0:63468:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID req@ffff9dc080e7f100 x1870854458267776/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:2.0:1784189358.641454:0:63468:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [00000000e1b7dcc6] to pc [ptlrpcd_00_03+3] req@ffff9dc080e7f100 x1870854458267776/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1784189358.641458:0:3641:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff9dc080f69c00 x1870854458267520/t0(0) o41->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/368 e 0 to 0 dl 1784189374 ref 2 fl Rpc:r/200/ffffffff rc 0/-1 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1784189358.641461:0:63468:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000020:00000040:2.0:1784189358.641466:0:63468:0:(genops.c:1231:class_import_get()) import ffff9dbf43115800 refcount=3 obd=lustre-MDT0001-lwp-OST0001 00000100:00000040:1.0:1784189358.641466:0:3641:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1784189358.641471:0:63468:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID req@ffff9dc080e7f480 x1870854458267904/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:2.0:1784189358.641477:0:63468:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [00000000f6f1dd87] to pc [ptlrpcd_00_00+0] req@ffff9dc080e7f480 x1870854458267904/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1784189358.641484:0:63468:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000020:00000040:2.0:1784189358.641488:0:63468:0:(genops.c:1231:class_import_get()) import ffff9dbf436c4000 refcount=3 obd=lustre-MDT0000-osp-MDT0001 00000100:00000040:2.0:1784189358.641493:0:63468:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID req@ffff9dc080e7e300 x1870854458268032/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:2.0:1784189358.641500:0:63468:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [00000000c1976ed2] to pc [ptlrpcd_00_01+1] req@ffff9dc080e7e300 x1870854458268032/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1784189358.641503:0:3641:0:(events.c:337:request_in_callback()) incoming req@ffff9dc05f02e300 x1870854458267520 msgsize 224 00000100:00080000:2.0:1784189358.641507:0:63468:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00100000:1.0:1784189358.641507:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1784189358.641510:0:63468:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1784189358.641518:0:63468:0:(import.c:65:import_set_state_nolock()) ffff9dbf43114800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1784189358.641523:0:63468:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 3595 00000100:00000040:1.0:1784189358.641524:0:3641:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff9dc080f69c00 x1870854458267520/t0(0) o41->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/368 e 0 to 0 dl 1784189374 ref 2 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1784189358.641528:0:63468:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 10s 00000100:00000040:2.0:1784189358.641530:0:63468:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff9dc0710a1d00 refcount 50 to 0@lo 00000100:00000040:2.0:1784189358.641533:0:63468:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9dc0710a1d00 refcount 51 to 0@lo 00000020:00000040:2.0:1784189358.641536:0:63468:0:(genops.c:825:class_conn2export()) looking for export cookie 0xcc1762b626f86499 00000020:00000040:2.0:1784189358.641541:0:63468:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9dc0477d0000 refcount=4 00000100:00000040:2.0:1784189358.641544:0:63468:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff9dc0710a1d00 refcount 50 to 0@lo 00000100:00000040:2.0:1784189358.641546:0:63468:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9dc0710a1d00 refcount 51 to 0@lo 00000020:00000040:2.0:1784189358.641548:0:63468:0:(genops.c:900:class_export_put()) PUTting export ffff9dc0477d0000 : new refcount 3 00000100:00080000:2.0:1784189358.641550:0:63468:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff9dbf43114800 using connection 192.168.203.112@tcp/0@lo 00000020:00000040:2.0:1784189358.641560:0:63468:0:(genops.c:1231:class_import_get()) import ffff9dbf43114800 refcount=3 obd=lustre-OST0000-osc-MDT0001 00000100:00100000:2.0:1784189358.641572:0:63468:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9dc080e7df80 x1870854458268160/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:2.0:1784189358.641581:0:63468:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [000000004bf53187] to pc [ptlrpcd_rcv+-1] req@ffff9dc080e7df80 x1870854458268160/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1784189358.641596:0:63468:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000020:00000040:2.0:1784189358.641601:0:63468:0:(genops.c:1231:class_import_get()) import ffff9dc080cc8800 refcount=3 obd=lustre-OST0001-osc-MDT0001 00000100:00000040:2.0:1784189358.641607:0:63468:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID req@ffff9dc080e7d880 x1870854458268288/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:1.0:1784189358.641612:0:3641:0:(niobuf.c:635:kick_cpu_latency()) lustre-MDT0001-osp-MDT0000: using a timeout of 8053 usecs (9 jiffies) 00000100:00000040:2.0:1784189358.641615:0:63468:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [00000000d7139c41] to pc [ptlrpcd_00_02+2] req@ffff9dc080e7d880 x1870854458268288/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1784189358.641622:0:63468:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000020:00000040:2.0:1784189358.641626:0:63468:0:(genops.c:1231:class_import_get()) import ffff9dbf43690800 refcount=3 obd=lustre-MDT0000-lwp-MDT0001 00000100:00000040:1.0:1784189358.641628:0:3641:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff9dc080e7e300 x1870854458268032/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1784189358.641631:0:63468:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID req@ffff9dc07130e300 x1870854458268416/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1784189358.641636:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc080e7e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1870854458268032:0@lo:400:kworker.0 00000100:00000040:2.0:1784189358.641651:0:63468:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [000000007bd84682] to pc [ptlrpcd_00_03+3] req@ffff9dc07130e300 x1870854458268416/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1784189358.641658:0:63468:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1784189358.641662:0:63468:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1784189358.641663:0:63468:0:(import.c:65:import_set_state_nolock()) ffff9dc075655000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1784189358.641666:0:63468:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 3595 00000100:00080000:2.0:1784189358.641669:0:63468:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00000040:2.0:1784189358.641671:0:63468:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff9dc0710a1d00 refcount 50 to 0@lo 00000100:00000040:2.0:1784189358.641673:0:63468:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9dc0710a1d00 refcount 51 to 0@lo 00000020:00000040:2.0:1784189358.641675:0:63468:0:(genops.c:825:class_conn2export()) looking for export cookie 0xcc1762b626f8c629 00000020:00000040:2.0:1784189358.641678:0:63468:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9dc047a84000 refcount=4 00000100:00000040:2.0:1784189358.641680:0:63468:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff9dc0710a1d00 refcount 50 to 0@lo 00000100:00000040:2.0:1784189358.641682:0:63468:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9dc0710a1d00 refcount 51 to 0@lo 00000020:00000040:2.0:1784189358.641693:0:63468:0:(genops.c:900:class_export_put()) PUTting export ffff9dc047a84000 : new refcount 3 00000100:00080000:2.0:1784189358.641696:0:63468:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9dc075655000 using connection 192.168.203.112@tcp/0@lo 00000020:00000040:2.0:1784189358.641703:0:63468:0:(genops.c:1231:class_import_get()) import ffff9dc075655000 refcount=3 obd=lustre-OST0000-osc-MDT0000 00000100:00100000:2.0:1784189358.641712:0:63468:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9dc07130df80 x1870854458268544/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:1.0:1784189358.641756:0:3641:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff9dc080e7e300 x1870854458268032/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1784189374 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1784189358.641763:0:3641:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:1.0:1784189358.641784:0:3641:0:(events.c:337:request_in_callback()) incoming req@ffff9dc05f02f800 x1870854458268032 msgsize 224 00000100:00100000:1.0:1784189358.641788:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:1.0:1784189358.641802:0:3641:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff9dc080e7e300 x1870854458268032/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1784189374 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1784189358.641811:0:3641:0:(niobuf.c:635:kick_cpu_latency()) lustre-MDT0000-osp-MDT0001: using a timeout of 1826090 usecs (1827 jiffies) 00000100:00000040:2.0:1784189358.641857:0:63468:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [000000007fdec724] to pc [ptlrpcd_rcv+-1] req@ffff9dc07130df80 x1870854458268544/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1784189358.641867:0:63468:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000020:00000040:2.0:1784189358.641872:0:63468:0:(genops.c:1231:class_import_get()) import ffff9dbf4845c000 refcount=3 obd=lustre-OST0001-osc-MDT0000 00000100:00000040:2.0:1784189358.641880:0:63468:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID req@ffff9dc07130e680 x1870854458268672/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1784189358.641888:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00000040:2.0:1784189358.641890:0:63468:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [00000000f4b75469] to pc [ptlrpcd_00_00+0] req@ffff9dc07130e680 x1870854458268672/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1784189358.641893:0:3641:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff9dc080e7f480 x1870854458267904/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1784189358.641904:0:63468:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00100000:1.0:1784189358.641906:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc080e7f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3641:1870854458267904:0@lo:400:kworker.0 00000020:00000040:2.0:1784189358.641909:0:63468:0:(genops.c:1231:class_import_get()) import ffff9dbf43fcb000 refcount=3 obd=lustre-MDT0000-lwp-MDT0000 00000100:00000040:2.0:1784189358.641917:0:63468:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID req@ffff9dc07130fb80 x1870854458268800/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:2.0:1784189358.641926:0:63468:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [00000000e6f6e407] to pc [ptlrpcd_00_01+1] req@ffff9dc07130fb80 x1870854458268800/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1784189358.641936:0:63468:0:(pinger.c:304:ptlrpc_pinger_main()) next wakeup in 5 (3605) 00000100:00000040:2.0:1784189358.641957:0:3642:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff9dc080e7ea00 x1870854458267648/t0(0) o400->MGC192.168.203.112@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784189358.641965:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc080e7ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bd553d0d-03e2-4233-b06b-b55bbfa2b954:3642:1870854458267648:0@lo:400:kworker.0 00000100:00000040:2.0:1784189358.641979:0:3642:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff9dc080e7ea00 x1870854458267648/t0(0) o400->MGC192.168.203.112@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1784189374 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1784189358.641986:0:3642:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1784189358.642004:0:3642:0:(events.c:337:request_in_callback()) incoming req@ffff9dc080e3a450 x1870854458267648 msgsize 224 00000100:00100000:2.0:1784189358.642007:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:2.0:1784189358.642009:0:3642:0:(events.c:349:request_in_callback()) Buffer complete: 63 buffers still posted 00000100:00000040:2.0:1784189358.642025:0:3642:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff9dc080e7ea00 x1870854458267648/t0(0) o400->MGC192.168.203.112@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1784189374 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1784189358.642046:0:3642:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff9dc080e7d880 x1870854458268288/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784189358.642053:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc080e7d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1870854458268288:0@lo:400:kworker.0 00000100:00000040:2.0:1784189358.642065:0:3642:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff9dc080e7d880 x1870854458268288/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784189374 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1784189358.642071:0:3642:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1784189358.642084:0:3642:0:(events.c:337:request_in_callback()) incoming req@ffff9dc07130ce00 x1870854458268288 msgsize 224 00000100:00100000:2.0:1784189358.642095:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:2.0:1784189358.642111:0:3642:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff9dc080e7d880 x1870854458268288/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784189374 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1784189358.642120:0:3642:0:(niobuf.c:635:kick_cpu_latency()) lustre-OST0001-osc-MDT0001: using a timeout of 5090 usecs (6 jiffies) 00000100:00100000:2.0:1784189358.642129:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00000040:2.0:1784189358.642134:0:3642:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff9dc080e7f100 x1870854458267776/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784189358.642141:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc080e7f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3642:1870854458267776:0@lo:400:kworker.0 00000100:00000040:2.0:1784189358.642154:0:3642:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff9dc080e7f100 x1870854458267776/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784189374 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1784189358.642161:0:3642:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1784189358.642174:0:3642:0:(events.c:337:request_in_callback()) incoming req@ffff9dc07130c000 x1870854458267776 msgsize 224 00000100:00100000:2.0:1784189358.642178:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:2.0:1784189358.642191:0:3642:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff9dc080e7f100 x1870854458267776/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784189374 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1784189358.642200:0:3642:0:(niobuf.c:635:kick_cpu_latency()) lustre-MDT0000-lwp-OST0001: using a timeout of 7615 usecs (8 jiffies) 00000100:00000040:2.0:1784189358.642204:0:3642:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff9dc07130e300 x1870854458268416/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784189358.642212:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc07130e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3642:1870854458268416:0@lo:400:kworker.0 00000100:00000040:2.0:1784189358.642221:0:3642:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff9dc07130e300 x1870854458268416/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784189374 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1784189358.642228:0:3642:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1784189358.642238:0:3642:0:(events.c:337:request_in_callback()) incoming req@ffff9dc07130c380 x1870854458268416 msgsize 224 00000100:00100000:2.0:1784189358.642242:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:2.0:1784189358.642255:0:3642:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff9dc07130e300 x1870854458268416/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784189374 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1784189358.642265:0:3642:0:(niobuf.c:635:kick_cpu_latency()) lustre-MDT0000-lwp-MDT0001: using a timeout of 73473 usecs (74 jiffies) 00000100:00000040:2.0:1784189358.642284:0:3639:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff9dc080e7df80 x1870854458268160/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784189358.642298:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc080e7df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3639:1870854458268160:0@lo:8:kworker.0 00000100:00000040:2.0:1784189358.642312:0:3639:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff9dc080e7df80 x1870854458268160/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 1784189378 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1784189358.642344:0:3639:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1784189358.642358:0:3639:0:(events.c:337:request_in_callback()) incoming req@ffff9dc07130d500 x1870854458268160 msgsize 520 00000100:00100000:2.0:1784189358.642361:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:2.0:1784189358.642374:0:3639:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff9dc080e7df80 x1870854458268160/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 1784189378 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1784189358.642383:0:3639:0:(niobuf.c:635:kick_cpu_latency()) lustre-OST0000-osc-MDT0001: using a timeout of 4961 usecs (5 jiffies) 00000100:00000040:2.0:1784189358.642388:0:3639:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff9dc07130df80 x1870854458268544/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784189358.642395:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc07130df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3639:1870854458268544:0@lo:8:kworker.0 00000020:00000040:3.0:1784189358.642737:0:75595:0:(genops.c:1231:class_import_get()) import ffff9dbf436c4000 refcount=4 obd=lustre-MDT0000-osp-MDT0001 00000100:00000040:3.0:1784189358.642756:0:75595:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [0000000089a0722f] to pc [ptlrpcd_00_02+2] req@ffff9dc071537b80 x1870854458268928/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/200/ffffffff rc 0/-1 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784189358.642779:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00000040:3.0:1784189358.642787:0:3643:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff9dc071537b80 x1870854458268928/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/200/ffffffff rc 0/-1 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784189358.642795:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc071537b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1870854458268928:0@lo:41:osp-pre-0-1.0 00000100:00000040:3.0:1784189358.642807:0:3643:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff9dc071537b80 x1870854458268928/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/368 e 0 to 0 dl 1784189374 ref 2 fl Rpc:r/200/ffffffff rc 0/-1 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1784189358.642814:0:3643:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:3.0:1784189358.642829:0:3643:0:(events.c:337:request_in_callback()) incoming req@ffff9dc071535180 x1870854458268928 msgsize 224 00000100:00100000:3.0:1784189358.642833:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:3.0:1784189358.642847:0:3643:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff9dc071537b80 x1870854458268928/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/368 e 0 to 0 dl 1784189374 ref 2 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1784189358.642857:0:3643:0:(niobuf.c:635:kick_cpu_latency()) lustre-MDT0000-osp-MDT0001: using a timeout of 1826090 usecs (1827 jiffies) 00000100:00100000:3.0:1784189358.642874:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458267520 00000100:00100000:3.0:1784189358.642880:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458267520 00000020:00000040:3.0:1784189358.642883:0:8439:0:(genops.c:825:class_conn2export()) looking for export cookie 0xcc1762b626f8c622 00000020:00000040:3.0:1784189358.642886:0:8439:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9dc047a80000 refcount=5 00000100:00000040:3.0:1784189358.642906:0:8439:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_out at +6s 00000100:00100000:3.0:1784189358.642925:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458268032 00000100:00100000:3.0:1784189358.642928:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458268032 00000020:00000040:3.0:1784189358.642930:0:8439:0:(genops.c:825:class_conn2export()) looking for export cookie 0xcc1762b626f8c5dc 00000020:00000040:3.0:1784189358.642932:0:8439:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9dbf47a3f000 refcount=7 00000100:00100000:3.0:1784189358.642944:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458268928 00000100:00100000:3.0:1784189358.642947:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458268928 00000020:00000040:3.0:1784189358.642948:0:8439:0:(genops.c:825:class_conn2export()) looking for export cookie 0xcc1762b626f8c5dc 00000020:00000040:3.0:1784189358.642950:0:8439:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9dbf47a3f000 refcount=8 00000100:00100000:3.0:1784189358.642961:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3964 00000100:00000040:3.0:1784189358.642972:0:8439:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9dc047a80000 : new rpc_count 1 00000100:00000040:3.0:1784189358.642977:0:8439:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9dc05f02e300 x1870854458267520/t0(0) o41->lustre-MDT0000-mdtlov_UUID@0@lo:549/0 lens 224/0 e 0 to 0 dl 1784189369 ref 1 fl New:/200/ffffffff rc 0/-1 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784189358.642988:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc05f02e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3641:x1870854458267520:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1784189358.643022:0:8439:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445568512 avail 1299329024 00010000:00000040:3.0:1784189358.643033:0:8439:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 0, transno 0, xid 1870854458267520 00000100:00000040:3.0:1784189358.643041:0:8439:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9dc0710a1d00 refcount 52 to 0@lo 00000100:00000040:3.0:1784189358.643046:0:8439:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:3.0:1784189358.643065:0:8439:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=368 offset=224 replen=368 req@ffff9dc080f69c00 x1870854458267520/t0(0) o41->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/368 e 0 to 0 dl 1784189374 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1784189358.643079:0:8439:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff9dc0710a1d00 refcount 51 to 0@lo 00000100:00000040:3.0:1784189358.643083:0:8439:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9dc05f02e300 x1870854458267520/t0(0) o41->lustre-MDT0000-mdtlov_UUID@0@lo:549/0 lens 224/368 e 0 to 0 dl 1784189369 ref 1 fl Interpret:/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784189358.643092:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc05f02e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3641:x1870854458267520:12345-0@lo:41:osp-pre-1-0.0 Request processed in 105us (1587us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189358.643099:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3964 00000100:00000040:3.0:1784189358.643102:0:8439:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9dc047a80000 : new rpc_count 0 00000020:00000040:3.0:1784189358.643111:0:8439:0:(genops.c:900:class_export_put()) PUTting export ffff9dc047a80000 : new refcount 4 00000100:00100000:3.0:1784189358.643120:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3965 00000100:00000040:3.0:1784189358.643122:0:8439:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9dbf47a3f000 : new rpc_count 1 00000100:00000040:3.0:1784189358.643126:0:8439:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9dc05f02f800 x1870854458268032/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:549/0 lens 224/0 e 0 to 0 dl 1784189369 ref 1 fl New:/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784189358.643135:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc05f02f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:3641:x1870854458268032:12345-0@lo:400:kworker.0 00010000:00000040:3.0:1784189358.643145:0:8439:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 120259084290, transno 0, xid 1870854458268032 00000100:00000040:3.0:1784189358.643149:0:8439:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9dc0710a1d00 refcount 52 to 0@lo 00000100:00000040:3.0:1784189358.643152:0:8439:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:3.0:1784189358.643171:0:8439:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff9dc080e7e300 x1870854458268032/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1784189374 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1784189358.643181:0:8439:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff9dc0710a1d00 refcount 51 to 0@lo 00000100:00000040:3.0:1784189358.643185:0:8439:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9dc05f02f800 x1870854458268032/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:549/0 lens 224/224 e 0 to 0 dl 1784189369 ref 1 fl Interpret:/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784189358.643194:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc05f02f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:3641:x1870854458268032:12345-0@lo:400:kworker.0 Request processed in 60us (1408us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189358.643200:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3965 00000100:00000040:3.0:1784189358.643202:0:8439:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9dbf47a3f000 : new rpc_count 0 00000020:00000040:3.0:1784189358.643208:0:8439:0:(genops.c:900:class_export_put()) PUTting export ffff9dbf47a3f000 : new refcount 7 00000100:00100000:3.0:1784189358.643217:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3966 00000100:00000040:3.0:1784189358.643219:0:8439:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9dbf47a3f000 : new rpc_count 1 00000100:00000040:3.0:1784189358.643222:0:8439:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9dc071535180 x1870854458268928/t0(0) o41->lustre-MDT0001-mdtlov_UUID@0@lo:549/0 lens 224/0 e 0 to 0 dl 1784189369 ref 1 fl New:/200/ffffffff rc 0/-1 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784189358.643233:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc071535180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3643:x1870854458268928:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1784189358.643247:0:8439:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445249024 avail 1299009536 00010000:00000040:3.0:1784189358.643254:0:8439:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 120259084290, transno 0, xid 1870854458268928 00000100:00000040:3.0:1784189358.643258:0:8439:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9dc0710a1d00 refcount 52 to 0@lo 00000100:00000040:3.0:1784189358.643261:0:8439:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:3.0:1784189358.643272:0:8439:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=368 offset=224 replen=368 req@ffff9dc071537b80 x1870854458268928/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/368 e 0 to 0 dl 1784189374 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1784189358.643288:0:8439:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff9dc0710a1d00 refcount 51 to 0@lo 00000100:00000040:3.0:1784189358.643292:0:8439:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9dc071535180 x1870854458268928/t0(0) o41->lustre-MDT0001-mdtlov_UUID@0@lo:549/0 lens 224/368 e 0 to 0 dl 1784189369 ref 1 fl Interpret:/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784189358.643299:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc071535180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3643:x1870854458268928:12345-0@lo:41:osp-pre-0-1.0 Request processed in 67us (468us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189358.643304:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3966 00000100:00000040:3.0:1784189358.643311:0:8439:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9dbf47a3f000 : new rpc_count 0 00000020:00000040:3.0:1784189358.643337:0:8439:0:(genops.c:900:class_export_put()) PUTting export ffff9dbf47a3f000 : new refcount 6 00000100:00000040:3.0:1784189358.643370:0:3643:0:(client.c:3108:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: skip recheck: last_committed 120259084290 00000100:00000040:3.0:1784189358.643376:0:3643:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff9dc071537b80 x1870854458268928/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/368 e 0 to 0 dl 1784189374 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000004:00000040:3.0:1784189358.643386:0:3643:0:(osp_precreate.c:1081:osp_pre_update_msfs()) lustre-MDT0000-osp-MDT0001: blocks=353529 free=352844 avail=317141 avail_mb=1238 hwm_mb=3 files=1024000 ffree=1023576 state=0: rc = 0 00000100:00000040:3.0:1784189358.643393:0:3643:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9dc071537b80 x1870854458268928/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/368 e 0 to 0 dl 1784189374 ref 1 fl Interpret:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784189358.643399:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc071537b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1870854458268928:0@lo:41:osp-pre-0-1.0 00000100:00000040:3.0:1784189358.643404:0:3643:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff9dc071537b80 x1870854458268928/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/368 e 0 to 0 dl 1784189374 ref 1 fl Complete:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000020:00000040:3.0:1784189358.643657:0:3643:0:(genops.c:1244:class_import_put()) import ffff9dbf436c4000 refcount=3 obd=lustre-MDT0000-osp-MDT0001 00000100:00100000:3.0:1784189358.643938:0:66945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458267776 00000100:00100000:3.0:1784189358.643944:0:66945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458267776 00000020:00000040:3.0:1784189358.643947:0:66945:0:(genops.c:825:class_conn2export()) looking for export cookie 0xcc1762b626f8c780 00000020:00000040:3.0:1784189358.643949:0:66945:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9dbf46b0a800 refcount=5 00000020:00000040:3.0:1784189358.643962:0:66945:0:(obd_config.c:994:class_incref()) incref lustre-MDT0000 (ffff9dc075478000) now 14 - evictor 00000100:00000040:3.0:1784189358.644052:0:66945:0:(service.c:1432:ptlrpc_at_set_timer()) armed mdt at +6s 00000100:00100000:3.0:1784189358.644078:0:66945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458268416 00000100:00100000:3.0:1784189358.644082:0:66945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458268416 00000020:00000040:3.0:1784189358.644083:0:66945:0:(genops.c:825:class_conn2export()) looking for export cookie 0xcc1762b626f8c787 00000020:00000040:3.0:1784189358.644086:0:66945:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9dbf46b0e000 refcount=5 00000100:00100000:3.0:1784189358.644107:0:66945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1372 00000100:00000040:3.0:1784189358.644110:0:66945:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9dbf46b0a800 : new rpc_count 1 00000100:00000040:3.0:1784189358.644115:0:66945:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9dc07130c000 x1870854458267776/t0(0) o400->lustre-MDT0000-lwp-OST0001_UUID@0@lo:549/0 lens 224/0 e 0 to 0 dl 1784189369 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784189358.644126:0:66945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc07130c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3642:x1870854458267776:12345-0@lo:400:kworker.0 00010000:00000040:3.0:1784189358.644147:0:66945:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 0, transno 0, xid 1870854458267776 00000100:00000040:3.0:1784189358.644153:0:66945:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9dc0710a1d00 refcount 52 to 0@lo 00000100:00000040:3.0:1784189358.644156:0:66945:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:3.0:1784189358.644180:0:66945:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff9dc080e7f100 x1870854458267776/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784189374 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1784189358.644198:0:66945:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff9dc0710a1d00 refcount 51 to 0@lo 00000100:00000040:3.0:1784189358.644202:0:66945:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9dc07130c000 x1870854458267776/t0(0) o400->lustre-MDT0000-lwp-OST0001_UUID@0@lo:549/0 lens 224/224 e 0 to 0 dl 1784189369 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784189358.644210:0:66945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc07130c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3642:x1870854458267776:12345-0@lo:400:kworker.0 Request processed in 86us (2034us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189358.644215:0:66945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1372 00000100:00000040:3.0:1784189358.644217:0:66945:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9dbf46b0a800 : new rpc_count 0 00000020:00000040:3.0:1784189358.644224:0:66945:0:(genops.c:900:class_export_put()) PUTting export ffff9dbf46b0a800 : new refcount 4 00000100:00100000:3.0:1784189358.644232:0:66945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1373 00000100:00000040:3.0:1784189358.644235:0:66945:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9dbf46b0e000 : new rpc_count 1 00000100:00000040:3.0:1784189358.644238:0:66945:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9dc07130c380 x1870854458268416/t0(0) o400->lustre-MDT0000-lwp-MDT0001_UUID@0@lo:549/0 lens 224/0 e 0 to 0 dl 1784189369 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784189358.644248:0:66945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc07130c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1870854458268416:12345-0@lo:400:kworker.0 00010000:00000040:3.0:1784189358.644256:0:66945:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 0, transno 0, xid 1870854458268416 00000100:00000040:3.0:1784189358.644261:0:66945:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9dc0710a1d00 refcount 52 to 0@lo 00000100:00000040:3.0:1784189358.644264:0:66945:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:3.0:1784189358.644278:0:66945:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff9dc07130e300 x1870854458268416/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784189374 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1784189358.644289:0:66945:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff9dc0710a1d00 refcount 51 to 0@lo 00000100:00000040:3.0:1784189358.644293:0:66945:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9dc07130c380 x1870854458268416/t0(0) o400->lustre-MDT0000-lwp-MDT0001_UUID@0@lo:549/0 lens 224/224 e 0 to 0 dl 1784189369 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784189358.644311:0:66945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc07130c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1870854458268416:12345-0@lo:400:kworker.0 Request processed in 65us (2070us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189358.644342:0:66945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1373 00000100:00000040:3.0:1784189358.644344:0:66945:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9dbf46b0e000 : new rpc_count 0 00000020:00000040:3.0:1784189358.644350:0:66945:0:(genops.c:900:class_export_put()) PUTting export ffff9dbf46b0e000 : new refcount 4 00000100:00100000:3.0:1784189358.644365:0:26168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458268288 00000100:00100000:3.0:1784189358.644369:0:26168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458268288 00000020:00000040:3.0:1784189358.644371:0:26168:0:(genops.c:825:class_conn2export()) looking for export cookie 0xcc1762b626f864bc 00000020:00000040:3.0:1784189358.644373:0:26168:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9dbf42277000 refcount=5 00000020:00000040:3.0:1784189358.644380:0:26168:0:(obd_config.c:994:class_incref()) incref lustre-OST0001 (ffff9dbf4312b380) now 10 - evictor 00000100:00000040:3.0:1784189358.644387:0:26168:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost at +6s 00000100:00100000:3.0:1784189358.644401:0:26168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458268160 00000100:00100000:3.0:1784189358.644404:0:26168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458268160 00000100:00000040:2.0:1784189358.644628:0:3639:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff9dc07130df80 x1870854458268544/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 1784189378 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1784189358.644638:0:3639:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1784189358.644657:0:3639:0:(events.c:337:request_in_callback()) incoming req@ffff9dc07130dc00 x1870854458268544 msgsize 520 00000100:00100000:2.0:1784189358.644661:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:2.0:1784189358.644676:0:3639:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff9dc07130df80 x1870854458268544/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 1784189378 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1784189358.644695:0:3639:0:(niobuf.c:635:kick_cpu_latency()) lustre-OST0000-osc-MDT0000: using a timeout of 8148 usecs (9 jiffies) 00000100:00100000:2.0:1784189358.644732:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458268544 00000100:00100000:2.0:1784189358.644735:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458268544 00000020:00000040:2.0:1784189358.644737:0:8427:0:(genops.c:825:class_conn2export()) looking for export cookie 0xcc1762b626f8c63e 00000100:00100000:2.0:1784189358.644758:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2607 00000100:00000040:2.0:1784189358.644761:0:8427:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9dbf42277000 : new rpc_count 1 00000100:00000040:2.0:1784189358.644766:0:8427:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9dc07130ce00 x1870854458268288/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:549/0 lens 224/0 e 0 to 0 dl 1784189369 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784189358.644790:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc07130ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3642:x1870854458268288:12345-0@lo:400:kworker.0 00010000:00000040:2.0:1784189358.644801:0:8427:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 4294968945, transno 0, xid 1870854458268288 00000100:00000040:2.0:1784189358.644806:0:8427:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9dc0710a1d00 refcount 52 to 0@lo 00000100:00000040:2.0:1784189358.644809:0:8427:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1784189358.644826:0:8427:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff9dc080e7d880 x1870854458268288/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784189374 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1784189358.644839:0:8427:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff9dc0710a1d00 refcount 51 to 0@lo 00000100:00000040:2.0:1784189358.644843:0:8427:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9dc07130ce00 x1870854458268288/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:549/0 lens 224/224 e 0 to 0 dl 1784189369 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784189358.644851:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc07130ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3642:x1870854458268288:12345-0@lo:400:kworker.0 Request processed in 64us (2765us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189358.644857:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2607 00000100:00000040:2.0:1784189358.644860:0:8427:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9dbf42277000 : new rpc_count 0 00000020:00000040:2.0:1784189358.644866:0:8427:0:(genops.c:900:class_export_put()) PUTting export ffff9dbf42277000 : new refcount 4 00000100:00100000:2.0:1784189358.644874:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5070 00000100:00000040:2.0:1784189358.644878:0:8427:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9dc07130dc00 x1870854458268544/t0(0) o8->@:0/0 lens 520/0 e 0 to 0 dl 1784189378 ref 1 fl New:/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784189358.644885:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc07130dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3639:x1870854458268544:12345-0@lo:8:kworker.0 00010000:00020000:2.0:1784189358.644903:0:8427:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-OST0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00000040:2.0:1784189358.644913:0:8427:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9dc0710a1d00 refcount 52 to 0@lo 00000100:00000040:2.0:1784189358.644916:0:8427:0:(connection.c:149:ptlrpc_connection_get()) conn=ffff9dc0710a1d00 refcount 52 to 0@lo 00000100:00000040:2.0:1784189358.644919:0:8427:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1784189358.644931:0:8427:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=0 replen=544 req@ffff9dc07130df80 x1870854458268544/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 1784189378 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1784189358.644947:0:8427:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff9dc0710a1d00 refcount 51 to 0@lo 00000100:00000040:2.0:1784189358.644957:0:8427:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9dc07130dc00 x1870854458268544/t0(0) o8->@:0/0 lens 520/224 e 0 to 0 dl 1784189378 ref 1 fl Interpret:/200/0 rc -19/-19 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784189358.644965:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc07130dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3639:x1870854458268544:12345-0@lo:8:kworker.0 Request processed in 79us (306us total) trans 0 rc -19/-19 00000100:00100000:2.0:1784189358.644972:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5070 00000100:00000040:2.0:1784189358.645010:0:3639:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff9dc07130df80 x1870854458268544/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/224 e 0 to 0 dl 1784189378 ref 1 fl Rpc:RNQU/200/0 rc -19/-19 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1784189358.645019:0:3639:0:(import.c:65:import_set_state_nolock()) ffff9dc075655000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1784189358.645023:0:3639:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-19) 00000100:00000040:2.0:1784189358.645028:0:3639:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9dc07130df80 x1870854458268544/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/224 e 0 to 0 dl 1784189378 ref 1 fl Interpret:RNQU/200/0 rc -19/-19 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784189358.645035:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc07130df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3639:1870854458268544:0@lo:8:kworker.0 00000100:00000040:2.0:1784189358.645040:0:3639:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff9dc07130df80 x1870854458268544/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/224 e 0 to 0 dl 1784189378 ref 1 fl Complete:RNQU/200/0 rc -19/-19 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:2.0:1784189358.645047:0:3639:0:(genops.c:1244:class_import_put()) import ffff9dc075655000 refcount=2 obd=lustre-OST0000-osc-MDT0000 00000100:00000040:1.0:1784189358.645474:0:3641:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff9dc080e7f480 x1870854458267904/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784189374 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1784189358.645483:0:3641:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:1.0:1784189358.645510:0:3641:0:(events.c:337:request_in_callback()) incoming req@ffff9dbf46437100 x1870854458267904 msgsize 224 00000100:00100000:1.0:1784189358.645515:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:1.0:1784189358.645544:0:3641:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff9dc080e7f480 x1870854458267904/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784189374 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1784189358.645554:0:3641:0:(niobuf.c:635:kick_cpu_latency()) lustre-MDT0001-lwp-OST0001: using a timeout of 7110 usecs (8 jiffies) 00000100:00000040:1.0:1784189358.645571:0:3641:0:(client.c:3108:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: skip recheck: last_committed 120259084290 00000100:00000040:1.0:1784189358.645576:0:3641:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff9dc080e7e300 x1870854458268032/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1784189374 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1784189358.645583:0:3641:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9dc080e7e300 x1870854458268032/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1784189374 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784189358.645590:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc080e7e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1870854458268032:0@lo:400:kworker.0 00000100:00000040:1.0:1784189358.645602:0:3641:0:(client.c:3108:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: skip recheck: last_committed 0 00000100:00000040:1.0:1784189358.645606:0:3641:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff9dc080f69c00 x1870854458267520/t0(0) o41->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/368 e 0 to 0 dl 1784189374 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000004:00000040:1.0:1784189358.645616:0:3641:0:(osp_precreate.c:1081:osp_pre_update_msfs()) lustre-MDT0001-osp-MDT0000: blocks=353529 free=352922 avail=317219 avail_mb=1239 hwm_mb=3 files=1024000 ffree=1023682 state=0: rc = 0 00000020:00000040:3.0:1784189358.645620:0:26168:0:(genops.c:825:class_conn2export()) looking for export cookie 0xcc1762b626f864ae 00000100:00000040:1.0:1784189358.645632:0:3641:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9dc080f69c00 x1870854458267520/t0(0) o41->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/368 e 0 to 0 dl 1784189374 ref 1 fl Interpret:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784189358.645639:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc080f69c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1870854458267520:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1784189358.645647:0:26168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5071 00000100:00000040:3.0:1784189358.645652:0:26168:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9dc07130d500 x1870854458268160/t0(0) o8->@:0/0 lens 520/0 e 0 to 0 dl 1784189378 ref 1 fl New:/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784189358.645661:0:26168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc07130d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:0+-99:3639:x1870854458268160:12345-0@lo:8:kworker.0 00010000:00020000:3.0:1784189358.645676:0:26168:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-OST0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00000040:3.0:1784189358.645695:0:26168:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9dc0710a1d00 refcount 52 to 0@lo 00000100:00000040:3.0:1784189358.645697:0:26168:0:(connection.c:149:ptlrpc_connection_get()) conn=ffff9dc0710a1d00 refcount 52 to 0@lo 00000100:00000040:3.0:1784189358.645701:0:26168:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:1.0:1784189358.645787:0:3641:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff9dc080e7e300 x1870854458268032/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1784189374 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:1.0:1784189358.645798:0:3641:0:(genops.c:1244:class_import_put()) import ffff9dbf436c4000 refcount=2 obd=lustre-MDT0000-osp-MDT0001 00000100:00000040:1.0:1784189358.645805:0:3641:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff9dc080f69c00 x1870854458267520/t0(0) o41->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/368 e 0 to 0 dl 1784189374 ref 1 fl Complete:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000020:00000040:1.0:1784189358.645811:0:3641:0:(genops.c:1244:class_import_put()) import ffff9dbf436c1800 refcount=2 obd=lustre-MDT0001-osp-MDT0000 00000100:00000040:1.0:1784189358.645822:0:3641:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff9dc07130fb80 x1870854458268800/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784189358.645833:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc07130fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3641:1870854458268800:0@lo:400:kworker.0 00000100:00100000:0.0:1784189358.645844:0:66169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458267904 00000100:00000040:1.0:1784189358.645849:0:3641:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff9dc07130fb80 x1870854458268800/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784189374 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784189358.645849:0:66169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458267904 00000020:00000040:0.0:1784189358.645851:0:66169:0:(genops.c:825:class_conn2export()) looking for export cookie 0xcc1762b626f86541 00000020:00000040:0.0:1784189358.645854:0:66169:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9dbf43d8f800 refcount=5 00000100:00000040:1.0:1784189358.645855:0:3641:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000020:00000040:0.0:1784189358.645863:0:66169:0:(obd_config.c:994:class_incref()) incref lustre-MDT0001 (ffff9dc071094d40) now 10 - evictor 00000100:00000040:1.0:1784189358.645868:0:3641:0:(events.c:337:request_in_callback()) incoming req@ffff9dbf46436a00 x1870854458268800 msgsize 224 00000100:00100000:1.0:1784189358.645871:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:0.0:1784189358.645874:0:66169:0:(service.c:1432:ptlrpc_at_set_timer()) armed mdt at +6s 00000100:00000040:1.0:1784189358.645884:0:3641:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff9dc07130fb80 x1870854458268800/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784189374 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784189358.645889:0:66169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458268800 00000100:00100000:0.0:1784189358.645891:0:66169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458268800 00000100:00000040:1.0:1784189358.645893:0:3641:0:(niobuf.c:635:kick_cpu_latency()) lustre-MDT0000-lwp-MDT0000: using a timeout of 8200 usecs (9 jiffies) 00000020:00000040:0.0:1784189358.645893:0:66169:0:(genops.c:825:class_conn2export()) looking for export cookie 0xcc1762b626f8c78e 00000020:00000040:0.0:1784189358.645895:0:66169:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9dc06b8e5800 refcount=5 00000100:00100000:1.0:1784189358.645900:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00000040:1.0:1784189358.645905:0:3641:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff9dc07130e680 x1870854458268672/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784189358.645909:0:66169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1374 00000100:00000040:0.0:1784189358.645911:0:66169:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9dbf43d8f800 : new rpc_count 1 00000100:00100000:1.0:1784189358.645914:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc07130e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1870854458268672:0@lo:400:kworker.0 00000100:00000040:0.0:1784189358.645915:0:66169:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9dbf46437100 x1870854458267904/t0(0) o400->lustre-MDT0001-lwp-OST0001_UUID@0@lo:549/0 lens 224/0 e 0 to 0 dl 1784189369 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784189358.645924:0:66169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf46437100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1870854458267904:12345-0@lo:400:kworker.0 00000100:00000040:1.0:1784189358.645925:0:3641:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff9dc07130e680 x1870854458268672/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784189374 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00010000:00000040:0.0:1784189358.645935:0:66169:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 0, transno 0, xid 1870854458267904 00000100:00000040:1.0:1784189358.645937:0:3641:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1784189358.645939:0:66169:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9dc0710a1d00 refcount 53 to 0@lo 00000100:00000040:1.0:1784189358.645951:0:3641:0:(events.c:337:request_in_callback()) incoming req@ffff9dbf46436300 x1870854458268672 msgsize 224 00000100:00100000:1.0:1784189358.645955:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:1.0:1784189358.645970:0:3641:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff9dc07130e680 x1870854458268672/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784189374 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1784189358.645979:0:3641:0:(niobuf.c:635:kick_cpu_latency()) lustre-OST0001-osc-MDT0000: using a timeout of 7253 usecs (8 jiffies) 00000100:00000040:3.0:1784189358.646055:0:26168:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=0 replen=544 req@ffff9dc080e7df80 x1870854458268160/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 1784189378 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784189358.646062:0:26165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458268672 00000100:00100000:1.0:1784189358.646065:0:26165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458268672 00000020:00000040:1.0:1784189358.646067:0:26165:0:(genops.c:825:class_conn2export()) looking for export cookie 0xcc1762b626f8c64c 00000020:00000040:1.0:1784189358.646069:0:26165:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9dbf47452800 refcount=5 00000100:00000040:3.0:1784189358.646074:0:26168:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff9dc0710a1d00 refcount 52 to 0@lo 00000100:00000040:3.0:1784189358.646078:0:26168:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9dc07130d500 x1870854458268160/t0(0) o8->@:0/0 lens 520/224 e 0 to 0 dl 1784189378 ref 1 fl Interpret:/200/0 rc -19/-19 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1784189358.646084:0:26165:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost at +6s 00000100:00100000:3.0:1784189358.646095:0:26168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc07130d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:0+-99:3639:x1870854458268160:12345-0@lo:8:kworker.0 Request processed in 434us (3735us total) trans 0 rc -19/-19 00000100:00100000:1.0:1784189358.646100:0:26165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2608 00000100:00000040:1.0:1784189358.646102:0:26165:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9dbf47452800 : new rpc_count 1 00000100:00100000:3.0:1784189358.646103:0:26168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5071 00000100:00000040:1.0:1784189358.646106:0:26165:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9dbf46436300 x1870854458268672/t0(0) o400->lustre-MDT0000-mdtlov_UUID@0@lo:549/0 lens 224/0 e 0 to 0 dl 1784189369 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784189358.646115:0:26165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf46436300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+5:3641:x1870854458268672:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784189358.646124:0:94314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458267648 00010000:00000040:1.0:1784189358.646124:0:26165:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 4294968960, transno 0, xid 1870854458268672 00000100:00100000:3.0:1784189358.646127:0:94314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458267648 00000020:00000040:3.0:1784189358.646129:0:94314:0:(genops.c:825:class_conn2export()) looking for export cookie 0xcc1762b626f8c573 00000100:00000040:1.0:1784189358.646129:0:26165:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9dc0710a1d00 refcount 53 to 0@lo 00000020:00000040:3.0:1784189358.646132:0:94314:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9dc050ae5000 refcount=21 00000100:00000040:1.0:1784189358.646132:0:26165:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:3.0:1784189358.646141:0:94314:0:(service.c:1432:ptlrpc_at_set_timer()) armed mgs at +6s 00000100:00000040:1.0:1784189358.646147:0:26165:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff9dc07130e680 x1870854458268672/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784189374 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784189358.646159:0:94314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00000040:3.0:1784189358.646161:0:94314:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9dc050ae5000 : new rpc_count 1 00000100:00000040:1.0:1784189358.646161:0:26165:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff9dc0710a1d00 refcount 52 to 0@lo 00000100:00000040:3.0:1784189358.646166:0:94314:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9dc080e3a450 x1870854458267648/t0(0) o400->bd553d0d-03e2-4233-b06b-b55bbfa2b954@0@lo:549/0 lens 224/0 e 0 to 0 dl 1784189369 ref 1 fl New:/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1784189358.646166:0:26165:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9dbf46436300 x1870854458268672/t0(0) o400->lustre-MDT0000-mdtlov_UUID@0@lo:549/0 lens 224/224 e 0 to 0 dl 1784189369 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784189358.646175:0:26165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf46436300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+5:3641:x1870854458268672:12345-0@lo:400:kworker.0 Request processed in 61us (222us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189358.646177:0:94314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc080e3a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:bd553d0d-03e2-4233-b06b-b55bbfa2b954+21:3642:x1870854458267648:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784189358.646181:0:26165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2608 00010000:00000040:3.0:1784189358.646185:0:94314:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 0, transno 0, xid 1870854458267648 00000100:00000040:1.0:1784189358.646188:0:26165:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9dbf47452800 : new rpc_count 0 00000100:00000040:3.0:1784189358.646189:0:94314:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9dc0710a1d00 refcount 53 to 0@lo 00000100:00000040:3.0:1784189358.646192:0:94314:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000020:00000040:1.0:1784189358.646196:0:26165:0:(genops.c:900:class_export_put()) PUTting export ffff9dbf47452800 : new refcount 4 00000100:00000040:3.0:1784189358.646210:0:94314:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff9dc080e7ea00 x1870854458267648/t0(0) o400->MGC192.168.203.112@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1784189374 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1784189358.646221:0:94314:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff9dc0710a1d00 refcount 52 to 0@lo 00000100:00000040:1.0:1784189358.646222:0:3641:0:(client.c:3108:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: skip recheck: last_committed 4294968960 00000100:00000040:3.0:1784189358.646225:0:94314:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9dc080e3a450 x1870854458267648/t0(0) o400->bd553d0d-03e2-4233-b06b-b55bbfa2b954@0@lo:549/0 lens 224/224 e 0 to 0 dl 1784189369 ref 1 fl Interpret:/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1784189358.646226:0:3641:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff9dc07130e680 x1870854458268672/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784189374 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784189358.646234:0:94314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc080e3a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:bd553d0d-03e2-4233-b06b-b55bbfa2b954+21:3642:x1870854458267648:12345-0@lo:400:kworker.0 Request processed in 58us (4228us total) trans 0 rc 0/0 00000100:00000040:1.0:1784189358.646235:0:3641:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9dc07130e680 x1870854458268672/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784189374 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784189358.646240:0:94314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00000040:3.0:1784189358.646242:0:94314:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9dc050ae5000 : new rpc_count 0 00000100:00100000:1.0:1784189358.646242:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc07130e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1870854458268672:0@lo:400:kworker.0 00000020:00000040:3.0:1784189358.646247:0:94314:0:(genops.c:900:class_export_put()) PUTting export ffff9dc050ae5000 : new refcount 20 00000100:00000040:1.0:1784189358.646248:0:3641:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff9dc07130e680 x1870854458268672/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784189374 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:1.0:1784189358.646254:0:3641:0:(genops.c:1244:class_import_put()) import ffff9dbf4845c000 refcount=2 obd=lustre-OST0001-osc-MDT0000 00000100:00080000:3.0:1784189358.646268:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000020:00000040:3.0:1784189358.646277:0:6509:0:(obd_config.c:1022:class_decref()) Decref lustre-MDT0001 (ffff9dc071094d40) now 10 - evictor 00000100:00080000:3.0:1784189358.646280:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000020:00000040:3.0:1784189358.646282:0:6509:0:(obd_config.c:1022:class_decref()) Decref lustre-OST0001 (ffff9dbf4312b380) now 10 - evictor 00000100:00080000:3.0:1784189358.646284:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000020:00000040:3.0:1784189358.646286:0:6509:0:(obd_config.c:1022:class_decref()) Decref lustre-MDT0000 (ffff9dc075478000) now 14 - evictor 00000100:00100000:3.0:1784189358.646300:0:66170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1375 00000100:00000040:3.0:1784189358.646303:0:66170:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9dc06b8e5800 : new rpc_count 1 00000100:00000040:3.0:1784189358.646308:0:66170:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9dbf46436a00 x1870854458268800/t0(0) o400->lustre-MDT0000-lwp-MDT0000_UUID@0@lo:549/0 lens 224/0 e 0 to 0 dl 1784189369 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784189358.646342:0:66170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf46436a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1870854458268800:12345-0@lo:400:kworker.0 00010000:00000040:3.0:1784189358.646352:0:66170:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 0, transno 0, xid 1870854458268800 00000100:00000040:3.0:1784189358.646356:0:66170:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9dc0710a1d00 refcount 53 to 0@lo 00000100:00000040:3.0:1784189358.646359:0:66170:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:3.0:1784189358.646373:0:66170:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff9dc07130fb80 x1870854458268800/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784189374 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1784189358.646388:0:66170:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff9dc0710a1d00 refcount 52 to 0@lo 00000100:00000040:3.0:1784189358.646392:0:66170:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9dbf46436a00 x1870854458268800/t0(0) o400->lustre-MDT0000-lwp-MDT0000_UUID@0@lo:549/0 lens 224/224 e 0 to 0 dl 1784189369 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784189358.646398:0:66170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf46436a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1870854458268800:12345-0@lo:400:kworker.0 Request processed in 83us (529us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189358.646403:0:66170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1375 00000100:00000040:0.0:1784189358.646804:0:66169:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1784189358.646825:0:66169:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff9dc080e7f480 x1870854458267904/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784189374 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1784189358.646838:0:66169:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff9dc0710a1d00 refcount 51 to 0@lo 00000100:00000040:0.0:1784189358.646842:0:66169:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9dbf46437100 x1870854458267904/t0(0) o400->lustre-MDT0001-lwp-OST0001_UUID@0@lo:549/0 lens 224/224 e 0 to 0 dl 1784189369 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784189358.646849:0:66169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf46437100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1870854458267904:12345-0@lo:400:kworker.0 Request processed in 926us (1338us total) trans 0 rc 0/0 00000100:00100000:0.0:1784189358.646856:0:66169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1374 00000100:00000040:0.0:1784189358.646865:0:66169:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9dbf43d8f800 : new rpc_count 0 00000020:00000040:0.0:1784189358.646873:0:66169:0:(genops.c:900:class_export_put()) PUTting export ffff9dbf43d8f800 : new refcount 4 00000100:00000040:0.0:1784189358.646943:0:3642:0:(client.c:3108:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: skip recheck: last_committed 0 00000100:00000040:2.0:1784189358.647194:0:3639:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff9dc080e7df80 x1870854458268160/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/224 e 0 to 0 dl 1784189378 ref 1 fl Rpc:RNQU/200/0 rc -19/-19 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1784189358.647204:0:3639:0:(import.c:65:import_set_state_nolock()) ffff9dbf43114800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1784189358.647208:0:3639:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-19) 00000100:00000040:2.0:1784189358.647212:0:3639:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9dc080e7df80 x1870854458268160/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/224 e 0 to 0 dl 1784189378 ref 1 fl Interpret:RNQU/200/0 rc -19/-19 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784189358.647218:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc080e7df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3639:1870854458268160:0@lo:8:kworker.0 00000100:00000040:2.0:1784189358.647224:0:3639:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff9dc080e7df80 x1870854458268160/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/224 e 0 to 0 dl 1784189378 ref 1 fl Complete:RNQU/200/0 rc -19/-19 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:2.0:1784189358.647232:0:3639:0:(genops.c:1244:class_import_put()) import ffff9dbf43114800 refcount=2 obd=lustre-OST0000-osc-MDT0001 00000100:00000040:0.0:1784189358.647386:0:3642:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff9dc080e7f100 x1870854458267776/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784189374 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1784189358.647394:0:3642:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9dc080e7f100 x1870854458267776/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784189374 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784189358.647400:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc080e7f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3642:1870854458267776:0@lo:400:kworker.0 00000100:00000040:0.0:1784189358.647699:0:3642:0:(client.c:3108:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: skip recheck: last_committed 0 00000100:00000040:0.0:1784189358.647705:0:3642:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff9dc07130e300 x1870854458268416/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784189374 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1784189358.647713:0:3642:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9dc07130e300 x1870854458268416/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784189374 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1784189358.647922:0:66170:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9dc06b8e5800 : new rpc_count 0 00000020:00000040:3.0:1784189358.647935:0:66170:0:(genops.c:900:class_export_put()) PUTting export ffff9dc06b8e5800 : new refcount 4 00000100:00100000:0.0:1784189358.648015:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc07130e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3642:1870854458268416:0@lo:400:kworker.0 00000100:00000040:0.0:1784189358.648032:0:3642:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff9dc080e7ea00 x1870854458267648/t0(0) o400->MGC192.168.203.112@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1784189374 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1784189358.648040:0:3642:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9dc080e7ea00 x1870854458267648/t0(0) o400->MGC192.168.203.112@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1784189374 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784189358.648047:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc080e7ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bd553d0d-03e2-4233-b06b-b55bbfa2b954:3642:1870854458267648:0@lo:400:kworker.0 00000100:00000040:0.0:1784189358.648060:0:3642:0:(client.c:3108:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: skip recheck: last_committed 4294968945 00000100:00000040:0.0:1784189358.648063:0:3642:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff9dc080e7d880 x1870854458268288/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784189374 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1784189358.648071:0:3642:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9dc080e7d880 x1870854458268288/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784189374 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784189358.648092:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc080e7d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1870854458268288:0@lo:400:kworker.0 00000100:00000040:0.0:1784189358.648098:0:3642:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff9dc080e7f100 x1870854458267776/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784189374 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:0.0:1784189358.648107:0:3642:0:(genops.c:1244:class_import_put()) import ffff9dbf425f4800 refcount=2 obd=lustre-MDT0000-lwp-OST0001 00000100:00000040:0.0:1784189358.648115:0:3642:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff9dc07130e300 x1870854458268416/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784189374 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:0.0:1784189358.648121:0:3642:0:(genops.c:1244:class_import_put()) import ffff9dbf43690800 refcount=2 obd=lustre-MDT0000-lwp-MDT0001 00000100:00000040:0.0:1784189358.648126:0:3642:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff9dc080e7ea00 x1870854458267648/t0(0) o400->MGC192.168.203.112@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1784189374 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:0.0:1784189358.648131:0:3642:0:(genops.c:1244:class_import_put()) import ffff9dc07110c800 refcount=3 obd=MGC192.168.203.112@tcp 00000100:00000040:0.0:1784189358.648136:0:3642:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff9dc080e7d880 x1870854458268288/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784189374 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:0.0:1784189358.648141:0:3642:0:(genops.c:1244:class_import_put()) import ffff9dc080cc8800 refcount=2 obd=lustre-OST0001-osc-MDT0001 00000100:00000040:3.0:1784189358.650249:0:3641:0:(client.c:3108:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: skip recheck: last_committed 0 00000100:00000040:3.0:1784189358.650263:0:3641:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff9dc07130fb80 x1870854458268800/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784189374 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1784189358.650276:0:3641:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9dc07130fb80 x1870854458268800/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784189374 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784189358.650302:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc07130fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3641:1870854458268800:0@lo:400:kworker.0 00000100:00000040:3.0:1784189358.650336:0:3641:0:(client.c:3108:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: skip recheck: last_committed 0 00000100:00000040:3.0:1784189358.650341:0:3641:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff9dc080e7f480 x1870854458267904/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784189374 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1784189358.650349:0:3641:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9dc080e7f480 x1870854458267904/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784189374 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784189358.650356:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc080e7f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3641:1870854458267904:0@lo:400:kworker.0 00000100:00000040:3.0:1784189358.650362:0:3641:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff9dc07130fb80 x1870854458268800/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784189374 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:3.0:1784189358.650373:0:3641:0:(genops.c:1244:class_import_put()) import ffff9dbf43fcb000 refcount=2 obd=lustre-MDT0000-lwp-MDT0000 00000100:00000040:3.0:1784189358.650382:0:3641:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff9dc080e7f480 x1870854458267904/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784189374 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:3.0:1784189358.650389:0:3641:0:(genops.c:1244:class_import_put()) import ffff9dbf43115800 refcount=2 obd=lustre-MDT0001-lwp-OST0001 00010000:00010000:2.0:1784189358.832972:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000040:3.0:1784189359.151517:0:94324:0:(genops.c:1231:class_import_get()) import ffff9dbf4845c000 refcount=3 obd=lustre-OST0001-osc-MDT0000 00000100:00000040:3.0:1784189359.151558:0:94324:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [0000000089a0722f] to pc [ptlrpcd_00_03+3] req@ffff9dc071537b80 x1870854458269056/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/200/ffffffff rc 0/-1 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784189359.151647:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00000040:2.0:1784189359.151663:0:3642:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff9dc071537b80 x1870854458269056/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/200/ffffffff rc 0/-1 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784189359.151675:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc071537b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1870854458269056:0@lo:13:osp-pre-1-0.0 00000100:00000040:2.0:1784189359.151714:0:3642:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff9dc071537b80 x1870854458269056/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784189375 ref 2 fl Rpc:r/200/ffffffff rc 0/-1 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1784189359.151721:0:3642:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1784189359.151760:0:3642:0:(events.c:337:request_in_callback()) incoming req@ffff9dc07130df80 x1870854458269056 msgsize 224 00000100:00100000:2.0:1784189359.151764:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:2.0:1784189359.151798:0:3642:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff9dc071537b80 x1870854458269056/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784189375 ref 2 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1784189359.151812:0:3642:0:(niobuf.c:635:kick_cpu_latency()) lustre-OST0001-osc-MDT0000: using a timeout of 7180 usecs (8 jiffies) 00000100:00100000:3.0:1784189359.151875:0:9466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458269056 00000100:00100000:3.0:1784189359.151882:0:9466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458269056 00000020:00000040:3.0:1784189359.151886:0:9466:0:(genops.c:825:class_conn2export()) looking for export cookie 0xcc1762b626f8c64c 00000020:00000040:3.0:1784189359.151890:0:9466:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9dbf47452800 refcount=5 00000100:00000040:3.0:1784189359.151914:0:9466:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_create at +6s 00000100:00100000:3.0:1784189359.151948:0:9466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2090 00000100:00000040:3.0:1784189359.151952:0:9466:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9dbf47452800 : new rpc_count 1 00000100:00000040:3.0:1784189359.151958:0:9466:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9dc07130df80 x1870854458269056/t0(0) o13->lustre-MDT0000-mdtlov_UUID@0@lo:550/0 lens 224/0 e 0 to 0 dl 1784189370 ref 1 fl New:/200/ffffffff rc 0/-1 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784189359.151985:0:9466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc07130df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1870854458269056:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1784189359.152014:0:9466:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8646976 pending 0 free 3923529728 avail 3692007424 00010000:00000040:3.0:1784189359.152025:0:9466:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 4294968960, transno 0, xid 1870854458269056 00000100:00000040:3.0:1784189359.152034:0:9466:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9dc0710a1d00 refcount 52 to 0@lo 00000100:00000040:3.0:1784189359.152038:0:9466:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:3.0:1784189359.152058:0:9466:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=368 offset=224 replen=368 req@ffff9dc071537b80 x1870854458269056/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784189375 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1784189359.152074:0:9466:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff9dc0710a1d00 refcount 51 to 0@lo 00000100:00000040:3.0:1784189359.152078:0:9466:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9dc07130df80 x1870854458269056/t0(0) o13->lustre-MDT0000-mdtlov_UUID@0@lo:550/0 lens 224/368 e 0 to 0 dl 1784189370 ref 1 fl Interpret:/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784189359.152087:0:9466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc07130df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1870854458269056:12345-0@lo:13:osp-pre-1-0.0 Request processed in 104us (325us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189359.152093:0:9466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2090 00000100:00000040:3.0:1784189359.152096:0:9466:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9dbf47452800 : new rpc_count 0 00000020:00000040:3.0:1784189359.152105:0:9466:0:(genops.c:900:class_export_put()) PUTting export ffff9dbf47452800 : new refcount 4 00000100:00000040:2.0:1784189359.152306:0:3642:0:(client.c:3108:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: skip recheck: last_committed 4294968960 00000100:00000040:2.0:1784189359.152313:0:3642:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff9dc071537b80 x1870854458269056/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784189375 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000004:00000040:2.0:1784189359.152347:0:3642:0:(osp_precreate.c:87:osp_pre_update_status_msfs()) lustre-OST0001-osc-MDT0000: Updating status = 0 00000004:00000040:2.0:1784189359.152349:0:3642:0:(osp_precreate.c:1081:osp_pre_update_msfs()) lustre-OST0001-osc-MDT0000: blocks=958279 free=957893 avail=901318 avail_mb=3520 hwm_mb=7 files=262144 ffree=261731 state=0: rc = 0 00000100:00000040:2.0:1784189359.152357:0:3642:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9dc071537b80 x1870854458269056/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784189375 ref 1 fl Interpret:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784189359.152364:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc071537b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1870854458269056:0@lo:13:osp-pre-1-0.0 00000100:00000040:2.0:1784189359.152370:0:3642:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff9dc071537b80 x1870854458269056/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784189375 ref 1 fl Complete:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000020:00000040:2.0:1784189359.152379:0:3642:0:(genops.c:1244:class_import_put()) import ffff9dbf4845c000 refcount=2 obd=lustre-OST0001-osc-MDT0000 00000100:00000040:1.0:1784189359.404423:0:3634:0:(events.c:337:request_in_callback()) incoming req@ffff9dbf46434e00 x1870854436387712 msgsize 224 00000100:00100000:1.0:1784189359.404436:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00000040:1.0:1784189359.404461:0:3634:0:(events.c:337:request_in_callback()) incoming req@ffff9dbf46435880 x1870854436388096 msgsize 224 00000100:00100000:1.0:1784189359.404465:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00000040:1.0:1784189359.404487:0:3634:0:(events.c:337:request_in_callback()) incoming req@ffff9dc080e39450 x1870854436387584 msgsize 224 00000100:00100000:1.0:1784189359.404491:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00000040:1.0:1784189359.404493:0:3634:0:(events.c:349:request_in_callback()) Buffer complete: 63 buffers still posted 00000100:00000040:1.0:1784189359.404508:0:3634:0:(events.c:337:request_in_callback()) incoming req@ffff9dbf46437b80 x1870854436387840 msgsize 224 00000100:00100000:1.0:1784189359.404511:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00000040:1.0:1784189359.404531:0:3634:0:(events.c:337:request_in_callback()) incoming req@ffff9dbf46436d80 x1870854436387968 msgsize 520 00000100:00100000:1.0:1784189359.404535:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1784189359.404631:0:66171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436387712 00000100:00100000:1.0:1784189359.404639:0:66171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436387712 00000020:00000040:1.0:1784189359.404642:0:66171:0:(genops.c:825:class_conn2export()) looking for export cookie 0xcc1762b626f8c5e3 00000020:00000040:1.0:1784189359.404646:0:66171:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9dbf47a3b800 refcount=51 00000020:00000040:1.0:1784189359.404660:0:66171:0:(obd_config.c:994:class_incref()) incref lustre-MDT0000 (ffff9dc075478000) now 14 - evictor 00000100:00000040:1.0:1784189359.404696:0:66171:0:(service.c:1432:ptlrpc_at_set_timer()) armed mdt at +6s 00000100:00100000:1.0:1784189359.404728:0:66171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436387840 00000100:00100000:1.0:1784189359.404731:0:66171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436387840 00000020:00000040:1.0:1784189359.404733:0:66171:0:(genops.c:825:class_conn2export()) looking for export cookie 0xcc1762b626f8bbf6 00000020:00000040:1.0:1784189359.404736:0:66171:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9dc04ffb2000 refcount=11 00000020:00000040:1.0:1784189359.404743:0:66171:0:(obd_config.c:994:class_incref()) incref lustre-MDT0001 (ffff9dc071094d40) now 10 - evictor 00000100:00100000:1.0:1784189359.404765:0:66171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1376 00000100:00000040:1.0:1784189359.404769:0:66171:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9dbf47a3b800 : new rpc_count 1 00000100:00000040:1.0:1784189359.404776:0:66171:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9dbf46434e00 x1870854436387712/t0(0) o400->debedd94-805c-42a0-a5e5-41758b2012e9@192.168.203.12@tcp:550/0 lens 224/0 e 0 to 0 dl 1784189370 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784189359.404788:0:66171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf46434e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:debedd94-805c-42a0-a5e5-41758b2012e9+51:2398:x1870854436387712:12345-192.168.203.12@tcp:400:kworker.0 00010000:00000040:1.0:1784189359.404812:0:66171:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 120259084438, transno 0, xid 1870854436387712 00000100:00000040:1.0:1784189359.404822:0:66171:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9dbf4274f140 refcount 9 to 192.168.203.12@tcp 00000100:00000040:1.0:1784189359.404828:0:66171:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.203.12@tcp 00000100:00000040:1.0:1784189359.404868:0:66171:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff9dbf4274f140 refcount 8 to 192.168.203.12@tcp 00000100:00000040:1.0:1784189359.404874:0:66171:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9dbf46434e00 x1870854436387712/t0(0) o400->debedd94-805c-42a0-a5e5-41758b2012e9@192.168.203.12@tcp:550/0 lens 224/224 e 0 to 0 dl 1784189370 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784189359.404882:0:66171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf46434e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:debedd94-805c-42a0-a5e5-41758b2012e9+51:2398:x1870854436387712:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 96us (460us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189359.404889:0:66171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1376 00000100:00000040:1.0:1784189359.404892:0:66171:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9dbf47a3b800 : new rpc_count 0 00000020:00000040:1.0:1784189359.404903:0:66171:0:(genops.c:900:class_export_put()) PUTting export ffff9dbf47a3b800 : new refcount 50 00000100:00100000:1.0:1784189359.404913:0:66171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1377 00000100:00000040:1.0:1784189359.404916:0:66171:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9dc04ffb2000 : new rpc_count 1 00000100:00000040:1.0:1784189359.404920:0:66171:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9dbf46437b80 x1870854436387840/t0(0) o400->debedd94-805c-42a0-a5e5-41758b2012e9@192.168.203.12@tcp:550/0 lens 224/0 e 0 to 0 dl 1784189370 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784189359.404931:0:66171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf46437b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:debedd94-805c-42a0-a5e5-41758b2012e9+11:2398:x1870854436387840:12345-192.168.203.12@tcp:400:kworker.0 00010000:00000040:1.0:1784189359.404954:0:66171:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 81604378768, transno 0, xid 1870854436387840 00000100:00000040:1.0:1784189359.404960:0:66171:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9dbf4274f140 refcount 9 to 192.168.203.12@tcp 00000100:00000040:1.0:1784189359.404964:0:66171:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.203.12@tcp 00000100:00000040:1.0:1784189359.404981:0:66171:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff9dbf4274f140 refcount 8 to 192.168.203.12@tcp 00000100:00000040:1.0:1784189359.404986:0:66171:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9dbf46437b80 x1870854436387840/t0(0) o400->debedd94-805c-42a0-a5e5-41758b2012e9@192.168.203.12@tcp:550/0 lens 224/224 e 0 to 0 dl 1784189370 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784189359.404994:0:66171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf46437b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:debedd94-805c-42a0-a5e5-41758b2012e9+11:2398:x1870854436387840:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 65us (484us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189359.405000:0:66171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1377 00000100:00000040:1.0:1784189359.405002:0:66171:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9dc04ffb2000 : new rpc_count 0 00000020:00000040:1.0:1784189359.405008:0:66171:0:(genops.c:900:class_export_put()) PUTting export ffff9dc04ffb2000 : new refcount 10 00000100:00100000:1.0:1784189359.405026:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436388096 00000100:00100000:1.0:1784189359.405029:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436388096 00000020:00000040:1.0:1784189359.405031:0:8429:0:(genops.c:825:class_conn2export()) looking for export cookie 0xcc1762b626f8c994 00000020:00000040:1.0:1784189359.405034:0:8429:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9dc047a82800 refcount=7 00000020:00000040:1.0:1784189359.405044:0:8429:0:(obd_config.c:994:class_incref()) incref lustre-OST0001 (ffff9dbf4312b380) now 10 - evictor 00000100:00000040:1.0:1784189359.405052:0:8429:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost at +6s 00000100:00100000:1.0:1784189359.405069:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436387968 00000100:00100000:1.0:1784189359.405073:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436387968 00000020:00000040:1.0:1784189359.405077:0:8429:0:(genops.c:825:class_conn2export()) looking for export cookie 0xcc1762b626f8c98d 00000100:00100000:1.0:1784189359.405095:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 2609 00000100:00000040:1.0:1784189359.405098:0:8429:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9dc047a82800 : new rpc_count 1 00000100:00000040:1.0:1784189359.405102:0:8429:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9dbf46435880 x1870854436388096/t0(0) o400->debedd94-805c-42a0-a5e5-41758b2012e9@192.168.203.12@tcp:550/0 lens 224/0 e 0 to 0 dl 1784189370 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784189359.405114:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf46435880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:debedd94-805c-42a0-a5e5-41758b2012e9+7:2398:x1870854436388096:12345-192.168.203.12@tcp:400:kworker.0 00010000:00000040:1.0:1784189359.405124:0:8429:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 0, transno 0, xid 1870854436388096 00000100:00000040:1.0:1784189359.405130:0:8429:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9dbf4274f140 refcount 9 to 192.168.203.12@tcp 00000100:00000040:1.0:1784189359.405141:0:8429:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.203.12@tcp 00000100:00000040:1.0:1784189359.405156:0:8429:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff9dbf4274f140 refcount 8 to 192.168.203.12@tcp 00000100:00000040:1.0:1784189359.405162:0:8429:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9dbf46435880 x1870854436388096/t0(0) o400->debedd94-805c-42a0-a5e5-41758b2012e9@192.168.203.12@tcp:550/0 lens 224/224 e 0 to 0 dl 1784189370 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784189359.405170:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf46435880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:debedd94-805c-42a0-a5e5-41758b2012e9+7:2398:x1870854436388096:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 58us (707us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189359.405176:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 2609 00000100:00000040:1.0:1784189359.405178:0:8429:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9dc047a82800 : new rpc_count 0 00000020:00000040:1.0:1784189359.405185:0:8429:0:(genops.c:900:class_export_put()) PUTting export ffff9dc047a82800 : new refcount 6 00000100:00100000:1.0:1784189359.405194:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 5072 00000100:00000040:1.0:1784189359.405198:0:8429:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9dbf46436d80 x1870854436387968/t0(0) o8->@:0/0 lens 520/0 e 0 to 0 dl 1784189379 ref 1 fl New:/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784189359.405205:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf46436d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2395:x1870854436387968:12345-192.168.203.12@tcp:8:kworker.0 00010000:00020000:1.0:1784189359.405224:0:8429:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-OST0000: not available for connect from 192.168.203.12@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00000040:1.0:1784189359.405235:0:8429:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9dbf4274f140 refcount 9 to 192.168.203.12@tcp 00000100:00000040:1.0:1784189359.405238:0:8429:0:(connection.c:149:ptlrpc_connection_get()) conn=ffff9dbf4274f140 refcount 9 to 192.168.203.12@tcp 00000100:00000040:1.0:1784189359.405241:0:8429:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.203.12@tcp 00000100:00000040:1.0:1784189359.405252:0:8429:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff9dbf4274f140 refcount 8 to 192.168.203.12@tcp 00000100:00000040:1.0:1784189359.405256:0:8429:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9dbf46436d80 x1870854436387968/t0(0) o8->@:0/0 lens 520/224 e 0 to 0 dl 1784189379 ref 1 fl Interpret:/200/0 rc -19/-19 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784189359.405263:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf46436d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2395:x1870854436387968:12345-192.168.203.12@tcp:8:kworker.0 Request processed in 57us (730us total) trans 0 rc -19/-19 00000100:00100000:1.0:1784189359.405268:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 5072 00000100:00100000:1.0:1784189359.405287:0:94310:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436387584 00000100:00100000:1.0:1784189359.405291:0:94310:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436387584 00000020:00000040:1.0:1784189359.405293:0:94310:0:(genops.c:825:class_conn2export()) looking for export cookie 0xcc1762b626f8c756 00000020:00000040:1.0:1784189359.405295:0:94310:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9dc0756a3800 refcount=10 00000100:00000040:1.0:1784189359.405312:0:94310:0:(service.c:1432:ptlrpc_at_set_timer()) armed mgs at +6s 00000100:00100000:1.0:1784189359.405368:0:94310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 183 00000100:00000040:1.0:1784189359.405371:0:94310:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9dc0756a3800 : new rpc_count 1 00000100:00000040:1.0:1784189359.405375:0:94310:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9dc080e39450 x1870854436387584/t0(0) o400->60f345e3-c70e-4f53-b5e7-c9671463c9a5@192.168.203.12@tcp:550/0 lens 224/0 e 0 to 0 dl 1784189370 ref 1 fl New:/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784189359.405385:0:94310:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc080e39450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:60f345e3-c70e-4f53-b5e7-c9671463c9a5+10:2398:x1870854436387584:12345-192.168.203.12@tcp:400:kworker.0 00010000:00000040:1.0:1784189359.405396:0:94310:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 0, transno 0, xid 1870854436387584 00000100:00000040:1.0:1784189359.405400:0:94310:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9dbf4274f140 refcount 9 to 192.168.203.12@tcp 00000100:00000040:1.0:1784189359.405403:0:94310:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.203.12@tcp 00000100:00000040:1.0:1784189359.405417:0:94310:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff9dbf4274f140 refcount 8 to 192.168.203.12@tcp 00000100:00000040:1.0:1784189359.405421:0:94310:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9dc080e39450 x1870854436387584/t0(0) o400->60f345e3-c70e-4f53-b5e7-c9671463c9a5@192.168.203.12@tcp:550/0 lens 224/224 e 0 to 0 dl 1784189370 ref 1 fl Interpret:/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784189359.405429:0:94310:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc080e39450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:60f345e3-c70e-4f53-b5e7-c9671463c9a5+10:2398:x1870854436387584:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 45us (940us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189359.405434:0:94310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 183 00000100:00000040:1.0:1784189359.405437:0:94310:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9dc0756a3800 : new rpc_count 0 00000020:00000040:1.0:1784189359.405442:0:94310:0:(genops.c:900:class_export_put()) PUTting export ffff9dc0756a3800 : new refcount 9 00000100:00080000:1.0:1784189359.405472:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000020:00000040:1.0:1784189359.405476:0:6509:0:(obd_config.c:1022:class_decref()) Decref lustre-OST0001 (ffff9dbf4312b380) now 10 - evictor 00000100:00080000:1.0:1784189359.405480:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000020:00000040:1.0:1784189359.405482:0:6509:0:(obd_config.c:1022:class_decref()) Decref lustre-MDT0001 (ffff9dc071094d40) now 10 - evictor 00000100:00080000:1.0:1784189359.405484:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000020:00000040:1.0:1784189359.405486:0:6509:0:(obd_config.c:1022:class_decref()) Decref lustre-MDT0000 (ffff9dc075478000) now 14 - evictor 00010000:00010000:1.0:1784189359.855914:0:26173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784189360.881470:0:7454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000040:2.0:1784189361.201286:0:75599:0:(genops.c:1231:class_import_get()) import ffff9dc080cc8800 refcount=3 obd=lustre-OST0001-osc-MDT0001 00000100:00000040:2.0:1784189361.201358:0:75599:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [0000000019c8e48f] to pc [ptlrpcd_00_00+0] req@ffff9dc07130d880 x1870854458269184/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/200/ffffffff rc 0/-1 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1784189361.201413:0:3640:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff9dc07130d880 x1870854458269184/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/200/ffffffff rc 0/-1 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784189361.201430:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc07130d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1870854458269184:0@lo:13:osp-pre-1-1.0 00000100:00000040:2.0:1784189361.201468:0:3640:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff9dc07130d880 x1870854458269184/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784189377 ref 2 fl Rpc:r/200/ffffffff rc 0/-1 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1784189361.201479:0:3640:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1784189361.201528:0:3640:0:(events.c:337:request_in_callback()) incoming req@ffff9dc07130f800 x1870854458269184 msgsize 224 00000100:00100000:2.0:1784189361.201533:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:2.0:1784189361.201556:0:3640:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff9dc07130d880 x1870854458269184/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784189377 ref 2 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1784189361.201570:0:3640:0:(niobuf.c:635:kick_cpu_latency()) lustre-OST0001-osc-MDT0001: using a timeout of 5097 usecs (6 jiffies) 00000100:00100000:2.0:1784189361.201609:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458269184 00000100:00100000:2.0:1784189361.201618:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458269184 00000020:00000040:2.0:1784189361.201622:0:8431:0:(genops.c:825:class_conn2export()) looking for export cookie 0xcc1762b626f864bc 00000020:00000040:2.0:1784189361.201627:0:8431:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9dbf42277000 refcount=5 00000020:00000040:2.0:1784189361.201644:0:8431:0:(obd_config.c:994:class_incref()) incref lustre-OST0001 (ffff9dbf4312b380) now 10 - evictor 00000100:00000040:2.0:1784189361.201681:0:8431:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_create at +6s 00000100:00100000:2.0:1784189361.201714:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2091 00000100:00000040:2.0:1784189361.201720:0:8431:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9dbf42277000 : new rpc_count 1 00000100:00000040:2.0:1784189361.201727:0:8431:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9dc07130f800 x1870854458269184/t0(0) o13->lustre-MDT0001-mdtlov_UUID@0@lo:552/0 lens 224/0 e 0 to 0 dl 1784189372 ref 1 fl New:/200/ffffffff rc 0/-1 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784189361.201741:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc07130f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1870854458269184:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1784189361.201851:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8646976 pending 0 free 3923529728 avail 3692007424 00010000:00000040:2.0:1784189361.201867:0:8431:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 4294968945, transno 0, xid 1870854458269184 00000100:00000040:2.0:1784189361.201879:0:8431:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9dc0710a1d00 refcount 52 to 0@lo 00000100:00000040:2.0:1784189361.201885:0:8431:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1784189361.201906:0:8431:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=368 offset=224 replen=368 req@ffff9dc07130d880 x1870854458269184/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784189377 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1784189361.201934:0:8431:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff9dc0710a1d00 refcount 51 to 0@lo 00000100:00000040:2.0:1784189361.201939:0:8431:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9dc07130f800 x1870854458269184/t0(0) o13->lustre-MDT0001-mdtlov_UUID@0@lo:552/0 lens 224/368 e 0 to 0 dl 1784189372 ref 1 fl Interpret:/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784189361.201949:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc07130f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1870854458269184:12345-0@lo:13:osp-pre-1-1.0 Request processed in 211us (418us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189361.201956:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2091 00000100:00000040:2.0:1784189361.201960:0:8431:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9dbf42277000 : new rpc_count 0 00000020:00000040:2.0:1784189361.201970:0:8431:0:(genops.c:900:class_export_put()) PUTting export ffff9dbf42277000 : new refcount 4 00000100:00080000:2.0:1784189361.201987:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000020:00000040:2.0:1784189361.201992:0:6509:0:(obd_config.c:1022:class_decref()) Decref lustre-OST0001 (ffff9dbf4312b380) now 10 - evictor 00000100:00000040:2.0:1784189361.202027:0:3640:0:(client.c:3108:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: skip recheck: last_committed 4294968945 00000100:00000040:2.0:1784189361.202034:0:3640:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff9dc07130d880 x1870854458269184/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784189377 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000004:00000040:2.0:1784189361.202045:0:3640:0:(osp_precreate.c:87:osp_pre_update_status_msfs()) lustre-OST0001-osc-MDT0001: Updating status = 0 00000004:00000040:2.0:1784189361.202048:0:3640:0:(osp_precreate.c:1081:osp_pre_update_msfs()) lustre-OST0001-osc-MDT0001: blocks=958279 free=957893 avail=901318 avail_mb=3520 hwm_mb=7 files=262144 ffree=261731 state=0: rc = 0 00000100:00000040:2.0:1784189361.202056:0:3640:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9dc07130d880 x1870854458269184/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784189377 ref 1 fl Interpret:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784189361.202063:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc07130d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1870854458269184:0@lo:13:osp-pre-1-1.0 00000100:00000040:2.0:1784189361.202069:0:3640:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff9dc07130d880 x1870854458269184/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784189377 ref 1 fl Complete:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000020:00000040:2.0:1784189361.202080:0:3640:0:(genops.c:1244:class_import_put()) import ffff9dc080cc8800 refcount=2 obd=lustre-OST0001-osc-MDT0001 00010000:00010000:2.0:1784189361.903556:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784189362.930571:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000040:1.0:1784189363.759426:0:94320:0:(genops.c:1231:class_import_get()) import ffff9dbf436c1800 refcount=3 obd=lustre-MDT0001-osp-MDT0000 00000100:00000040:1.0:1784189363.759467:0:94320:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [00000000ec614dc3] to pc [ptlrpcd_00_01+1] req@ffff9dbf46435500 x1870854458269312/t0(0) o41->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/200/ffffffff rc 0/-1 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784189363.759561:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00000040:0.0:1784189363.759580:0:3640:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff9dbf46435500 x1870854458269312/t0(0) o41->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/200/ffffffff rc 0/-1 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784189363.759594:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf46435500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1870854458269312:0@lo:41:osp-pre-1-0.0 00000100:00000040:0.0:1784189363.759623:0:3640:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff9dbf46435500 x1870854458269312/t0(0) o41->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/368 e 0 to 0 dl 1784189379 ref 2 fl Rpc:r/200/ffffffff rc 0/-1 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1784189363.759631:0:3640:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1784189363.759683:0:3640:0:(events.c:337:request_in_callback()) incoming req@ffff9dc05eddf800 x1870854458269312 msgsize 224 00000100:00100000:0.0:1784189363.759688:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:0.0:1784189363.759717:0:3640:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff9dbf46435500 x1870854458269312/t0(0) o41->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/368 e 0 to 0 dl 1784189379 ref 2 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1784189363.759729:0:3640:0:(niobuf.c:635:kick_cpu_latency()) lustre-MDT0001-osp-MDT0000: using a timeout of 7937 usecs (8 jiffies) 00000100:00100000:1.0:1784189363.759777:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458269312 00000100:00100000:1.0:1784189363.759785:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458269312 00000020:00000040:1.0:1784189363.759788:0:8439:0:(genops.c:825:class_conn2export()) looking for export cookie 0xcc1762b626f8c622 00000020:00000040:1.0:1784189363.759792:0:8439:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9dc047a80000 refcount=5 00000100:00000040:1.0:1784189363.759823:0:8439:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_out at +6s 00000100:00100000:1.0:1784189363.759855:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3967 00000100:00000040:1.0:1784189363.759859:0:8439:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9dc047a80000 : new rpc_count 1 00000100:00000040:1.0:1784189363.759865:0:8439:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9dc05eddf800 x1870854458269312/t0(0) o41->lustre-MDT0000-mdtlov_UUID@0@lo:554/0 lens 224/0 e 0 to 0 dl 1784189374 ref 1 fl New:/200/ffffffff rc 0/-1 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784189363.759877:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc05eddf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3640:x1870854458269312:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1784189363.759913:0:8439:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445568512 avail 1299329024 00010000:00000040:1.0:1784189363.759925:0:8439:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 0, transno 0, xid 1870854458269312 00000100:00000040:1.0:1784189363.759935:0:8439:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9dc0710a1d00 refcount 52 to 0@lo 00000100:00000040:1.0:1784189363.759940:0:8439:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:1.0:1784189363.759959:0:8439:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=368 offset=224 replen=368 req@ffff9dbf46435500 x1870854458269312/t0(0) o41->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/368 e 0 to 0 dl 1784189379 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1784189363.759979:0:8439:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff9dc0710a1d00 refcount 51 to 0@lo 00000100:00000040:1.0:1784189363.759984:0:8439:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9dc05eddf800 x1870854458269312/t0(0) o41->lustre-MDT0000-mdtlov_UUID@0@lo:554/0 lens 224/368 e 0 to 0 dl 1784189374 ref 1 fl Interpret:/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784189363.759991:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc05eddf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3640:x1870854458269312:12345-0@lo:41:osp-pre-1-0.0 Request processed in 117us (307us total) trans 0 rc 0/0 00000100:00000040:3.0:1784189363.759997:0:3640:0:(client.c:3108:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: skip recheck: last_committed 0 00000100:00100000:1.0:1784189363.759997:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3967 00000100:00000040:1.0:1784189363.760000:0:8439:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9dc047a80000 : new rpc_count 0 00000100:00000040:3.0:1784189363.760003:0:3640:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff9dbf46435500 x1870854458269312/t0(0) o41->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/368 e 0 to 0 dl 1784189379 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000020:00000040:1.0:1784189363.760010:0:8439:0:(genops.c:900:class_export_put()) PUTting export ffff9dc047a80000 : new refcount 4 00000004:00000040:3.0:1784189363.760012:0:3640:0:(osp_precreate.c:1081:osp_pre_update_msfs()) lustre-MDT0001-osp-MDT0000: blocks=353529 free=352922 avail=317219 avail_mb=1239 hwm_mb=3 files=1024000 ffree=1023682 state=0: rc = 0 00000100:00000040:3.0:1784189363.760019:0:3640:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9dbf46435500 x1870854458269312/t0(0) o41->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/368 e 0 to 0 dl 1784189379 ref 1 fl Interpret:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784189363.760026:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf46435500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1870854458269312:0@lo:41:osp-pre-1-0.0 00000100:00000040:3.0:1784189363.760032:0:3640:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff9dbf46435500 x1870854458269312/t0(0) o41->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/368 e 0 to 0 dl 1784189379 ref 1 fl Complete:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000020:00000040:3.0:1784189363.760066:0:3640:0:(genops.c:1244:class_import_put()) import ffff9dbf436c1800 refcount=2 obd=lustre-MDT0001-osp-MDT0000 00000020:00000040:3.0:1784189363.760633:0:75595:0:(genops.c:1231:class_import_get()) import ffff9dbf436c4000 refcount=3 obd=lustre-MDT0000-osp-MDT0001 00000100:00000040:3.0:1784189363.760677:0:75595:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [00000000fcaf7782] to pc [ptlrpcd_00_02+2] req@ffff9dc071535880 x1870854458269440/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/200/ffffffff rc 0/-1 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1784189363.760837:0:3642:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff9dc071535880 x1870854458269440/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/200/ffffffff rc 0/-1 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784189363.760858:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc071535880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1870854458269440:0@lo:41:osp-pre-0-1.0 00000100:00000040:0.0:1784189363.760880:0:3642:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff9dc071535880 x1870854458269440/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/368 e 0 to 0 dl 1784189379 ref 2 fl Rpc:r/200/ffffffff rc 0/-1 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1784189363.760888:0:3642:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1784189363.760911:0:3642:0:(events.c:337:request_in_callback()) incoming req@ffff9dc07ab99f80 x1870854458269440 msgsize 224 00000100:00100000:0.0:1784189363.760915:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:0.0:1784189363.760940:0:3642:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff9dc071535880 x1870854458269440/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/368 e 0 to 0 dl 1784189379 ref 2 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1784189363.760952:0:3642:0:(niobuf.c:635:kick_cpu_latency()) lustre-MDT0000-osp-MDT0001: using a timeout of 1814513 usecs (1815 jiffies) 00000100:00100000:3.0:1784189363.761136:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458269440 00000100:00100000:3.0:1784189363.761142:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458269440 00000020:00000040:3.0:1784189363.761145:0:8438:0:(genops.c:825:class_conn2export()) looking for export cookie 0xcc1762b626f8c5dc 00000020:00000040:3.0:1784189363.761149:0:8438:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9dbf47a3f000 refcount=7 00000100:00000040:3.0:1784189363.761167:0:8438:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_out at +6s 00000100:00100000:3.0:1784189363.761195:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3968 00000100:00000040:3.0:1784189363.761199:0:8438:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9dbf47a3f000 : new rpc_count 1 00000100:00000040:3.0:1784189363.761204:0:8438:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9dc07ab99f80 x1870854458269440/t0(0) o41->lustre-MDT0001-mdtlov_UUID@0@lo:554/0 lens 224/0 e 0 to 0 dl 1784189374 ref 1 fl New:/200/ffffffff rc 0/-1 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784189363.761216:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc07ab99f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3642:x1870854458269440:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1784189363.761311:0:8438:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445249024 avail 1299009536 00010000:00000040:3.0:1784189363.761397:0:8438:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 120259084290, transno 0, xid 1870854458269440 00000100:00000040:3.0:1784189363.761405:0:8438:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9dc0710a1d00 refcount 52 to 0@lo 00000100:00000040:3.0:1784189363.761409:0:8438:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:3.0:1784189363.761430:0:8438:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=368 offset=224 replen=368 req@ffff9dc071535880 x1870854458269440/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/368 e 0 to 0 dl 1784189379 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1784189363.761450:0:8438:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff9dc0710a1d00 refcount 51 to 0@lo 00000100:00000040:3.0:1784189363.761455:0:8438:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9dc07ab99f80 x1870854458269440/t0(0) o41->lustre-MDT0001-mdtlov_UUID@0@lo:554/0 lens 224/368 e 0 to 0 dl 1784189374 ref 1 fl Interpret:/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784189363.761464:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc07ab99f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3642:x1870854458269440:12345-0@lo:41:osp-pre-0-1.0 Request processed in 250us (550us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189363.761470:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3968 00000100:00000040:3.0:1784189363.761479:0:8438:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9dbf47a3f000 : new rpc_count 0 00000020:00000040:3.0:1784189363.761490:0:8438:0:(genops.c:900:class_export_put()) PUTting export ffff9dbf47a3f000 : new refcount 6 00000100:00000040:0.0:1784189363.761513:0:3642:0:(client.c:3108:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: skip recheck: last_committed 120259084290 00000100:00000040:0.0:1784189363.761520:0:3642:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff9dc071535880 x1870854458269440/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/368 e 0 to 0 dl 1784189379 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000004:00000040:0.0:1784189363.761530:0:3642:0:(osp_precreate.c:1081:osp_pre_update_msfs()) lustre-MDT0000-osp-MDT0001: blocks=353529 free=352844 avail=317141 avail_mb=1238 hwm_mb=3 files=1024000 ffree=1023576 state=0: rc = 0 00000100:00000040:0.0:1784189363.761537:0:3642:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9dc071535880 x1870854458269440/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/368 e 0 to 0 dl 1784189379 ref 1 fl Interpret:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784189363.761544:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc071535880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1870854458269440:0@lo:41:osp-pre-0-1.0 00000100:00000040:0.0:1784189363.761550:0:3642:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff9dc071535880 x1870854458269440/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/368 e 0 to 0 dl 1784189379 ref 1 fl Complete:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000020:00000040:0.0:1784189363.761558:0:3642:0:(genops.c:1244:class_import_put()) import ffff9dbf436c4000 refcount=2 obd=lustre-MDT0000-osp-MDT0001 00000100:00000040:0.0:1784189363.771904:0:93049:0:(pinger.c:229:ptlrpc_pinger_process_import()) bd553d0d-03e2-4233-b06b-b55bbfa2b954->MGS: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000020:00000040:0.0:1784189363.771923:0:93049:0:(genops.c:1231:class_import_get()) import ffff9dc07110c800 refcount=4 obd=MGC192.168.203.112@tcp 00000100:00000040:0.0:1784189363.771950:0:93049:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging bd553d0d-03e2-4233-b06b-b55bbfa2b954->MGS req@ffff9dc07ab9b800 x1870854458269568/t0(0) o400->MGC192.168.203.112@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:0.0:1784189363.771966:0:93049:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [00000000897e6e04] to pc [ptlrpcd_00_03+3] req@ffff9dc07ab9b800 x1870854458269568/t0(0) o400->MGC192.168.203.112@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1784189363.772143:0:3643:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff9dc07ab9b800 x1870854458269568/t0(0) o400->MGC192.168.203.112@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784189363.772156:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc07ab9b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:bd553d0d-03e2-4233-b06b-b55bbfa2b954:3643:1870854458269568:0@lo:400:kworker.0 00000100:00000040:1.0:1784189363.772197:0:3643:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff9dc07ab9b800 x1870854458269568/t0(0) o400->MGC192.168.203.112@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1784189379 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1784189363.772205:0:3643:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:1.0:1784189363.772246:0:3643:0:(events.c:337:request_in_callback()) incoming req@ffff9dc080e3b450 x1870854458269568 msgsize 224 00000100:00100000:1.0:1784189363.772250:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:1.0:1784189363.772252:0:3643:0:(events.c:349:request_in_callback()) Buffer complete: 63 buffers still posted 00000100:00000040:0.0:1784189363.772332:0:93049:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000020:00000040:0.0:1784189363.772341:0:93049:0:(genops.c:1231:class_import_get()) import ffff9dbf425f4800 refcount=3 obd=lustre-MDT0000-lwp-OST0001 00000100:00000040:0.0:1784189363.772351:0:93049:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID req@ffff9dc05edd0e00 x1870854458269696/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:0.0:1784189363.772362:0:93049:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [0000000012acec6a] to pc [ptlrpcd_00_00+0] req@ffff9dc05edd0e00 x1870854458269696/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1784189363.772380:0:93049:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000020:00000040:0.0:1784189363.772385:0:93049:0:(genops.c:1231:class_import_get()) import ffff9dbf43115800 refcount=3 obd=lustre-MDT0001-lwp-OST0001 00000100:00000040:0.0:1784189363.772393:0:93049:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID req@ffff9dc05edd3480 x1870854458269824/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:0.0:1784189363.772401:0:93049:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [0000000028340d0d] to pc [ptlrpcd_00_01+1] req@ffff9dc05edd3480 x1870854458269824/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1784189363.772409:0:93049:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1784189363.772413:0:93049:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1784189363.772415:0:93049:0:(import.c:65:import_set_state_nolock()) ffff9dbf43114800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1784189363.772420:0:93049:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 3600 00000100:00080000:0.0:1784189363.772425:0:93049:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 15s 00000100:00000040:0.0:1784189363.772427:0:93049:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff9dc0710a1d00 refcount 50 to 0@lo 00000100:00000040:0.0:1784189363.772431:0:93049:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9dc0710a1d00 refcount 51 to 0@lo 00000020:00000040:0.0:1784189363.772434:0:93049:0:(genops.c:825:class_conn2export()) looking for export cookie 0xcc1762b626f86499 00000020:00000040:0.0:1784189363.772438:0:93049:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9dc0477d0000 refcount=4 00000100:00000040:0.0:1784189363.772440:0:93049:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff9dc0710a1d00 refcount 50 to 0@lo 00000100:00000040:0.0:1784189363.772442:0:93049:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9dc0710a1d00 refcount 51 to 0@lo 00000020:00000040:0.0:1784189363.772445:0:93049:0:(genops.c:900:class_export_put()) PUTting export ffff9dc0477d0000 : new refcount 3 00000100:00080000:0.0:1784189363.772448:0:93049:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff9dbf43114800 using connection 192.168.203.112@tcp/0@lo 00000020:00000040:0.0:1784189363.772463:0:93049:0:(genops.c:1231:class_import_get()) import ffff9dbf43114800 refcount=3 obd=lustre-OST0000-osc-MDT0001 00000100:00100000:0.0:1784189363.772474:0:93049:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9dc05edd0700 x1870854458269952/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:0.0:1784189363.772482:0:93049:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [00000000f0bc7865] to pc [ptlrpcd_rcv+-1] req@ffff9dc05edd0700 x1870854458269952/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1784189363.772495:0:93049:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000020:00000040:0.0:1784189363.772500:0:93049:0:(genops.c:1231:class_import_get()) import ffff9dc080cc8800 refcount=3 obd=lustre-OST0001-osc-MDT0001 00000100:00000040:0.0:1784189363.772505:0:93049:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID req@ffff9dc05edd1180 x1870854458270080/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:0.0:1784189363.772513:0:93049:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [00000000311cfdc7] to pc [ptlrpcd_00_02+2] req@ffff9dc05edd1180 x1870854458270080/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1784189363.772521:0:93049:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000020:00000040:0.0:1784189363.772526:0:93049:0:(genops.c:1231:class_import_get()) import ffff9dbf43690800 refcount=3 obd=lustre-MDT0000-lwp-MDT0001 00000100:00000040:0.0:1784189363.772532:0:93049:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID req@ffff9dc05edd3100 x1870854458270208/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:0.0:1784189363.772539:0:93049:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [0000000054241f3e] to pc [ptlrpcd_00_03+3] req@ffff9dc05edd3100 x1870854458270208/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1784189363.772547:0:93049:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1784189363.772550:0:93049:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1784189363.772552:0:93049:0:(import.c:65:import_set_state_nolock()) ffff9dc075655000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1784189363.772556:0:93049:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 3600 00000100:00080000:0.0:1784189363.772558:0:93049:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00000040:0.0:1784189363.772561:0:93049:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff9dc0710a1d00 refcount 50 to 0@lo 00000100:00000040:0.0:1784189363.772563:0:93049:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9dc0710a1d00 refcount 51 to 0@lo 00000020:00000040:0.0:1784189363.772571:0:93049:0:(genops.c:825:class_conn2export()) looking for export cookie 0xcc1762b626f8c629 00000020:00000040:0.0:1784189363.772573:0:93049:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9dc047a84000 refcount=4 00000100:00000040:0.0:1784189363.772576:0:93049:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff9dc0710a1d00 refcount 50 to 0@lo 00000100:00000040:0.0:1784189363.772579:0:93049:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9dc0710a1d00 refcount 51 to 0@lo 00000020:00000040:0.0:1784189363.772581:0:93049:0:(genops.c:900:class_export_put()) PUTting export ffff9dc047a84000 : new refcount 3 00000100:00080000:0.0:1784189363.772583:0:93049:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9dc075655000 using connection 192.168.203.112@tcp/0@lo 00000020:00000040:0.0:1784189363.772588:0:93049:0:(genops.c:1231:class_import_get()) import ffff9dc075655000 refcount=3 obd=lustre-OST0000-osc-MDT0000 00000100:00100000:0.0:1784189363.772597:0:93049:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9dc05edd3800 x1870854458270336/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:0.0:1784189363.772605:0:93049:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [0000000075386f9e] to pc [ptlrpcd_rcv+-1] req@ffff9dc05edd3800 x1870854458270336/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1784189363.772612:0:93049:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000020:00000040:0.0:1784189363.772617:0:93049:0:(genops.c:1231:class_import_get()) import ffff9dbf4845c000 refcount=3 obd=lustre-OST0001-osc-MDT0000 00000100:00000040:0.0:1784189363.772623:0:93049:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID req@ffff9dc05edd1880 x1870854458270464/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:0.0:1784189363.772631:0:93049:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [0000000048ea56d9] to pc [ptlrpcd_00_00+0] req@ffff9dc05edd1880 x1870854458270464/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1784189363.772639:0:93049:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000020:00000040:0.0:1784189363.772659:0:93049:0:(genops.c:1231:class_import_get()) import ffff9dbf43fcb000 refcount=3 obd=lustre-MDT0000-lwp-MDT0000 00000100:00000040:0.0:1784189363.772666:0:93049:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID req@ffff9dc05edd0000 x1870854458270592/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:0.0:1784189363.772676:0:93049:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [00000000f9dfd875] to pc [ptlrpcd_00_01+1] req@ffff9dc05edd0000 x1870854458270592/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1784189363.772684:0:93049:0:(pinger.c:304:ptlrpc_pinger_main()) next wakeup in 5 (3610) 00000100:00000040:0.0:1784189363.772701:0:3640:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff9dc05edd0e00 x1870854458269696/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784189363.772721:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc05edd0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3640:1870854458269696:0@lo:400:kworker.0 00000100:00000040:0.0:1784189363.772738:0:3640:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff9dc05edd0e00 x1870854458269696/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784189379 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1784189363.772745:0:3640:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1784189363.772762:0:3640:0:(events.c:337:request_in_callback()) incoming req@ffff9dc05edd2d80 x1870854458269696 msgsize 224 00000100:00100000:0.0:1784189363.772766:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:0.0:1784189363.772786:0:3640:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff9dc05edd0e00 x1870854458269696/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784189379 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1784189363.772798:0:3640:0:(niobuf.c:635:kick_cpu_latency()) lustre-MDT0000-lwp-OST0001: using a timeout of 7613 usecs (8 jiffies) 00000100:00000040:1.0:1784189363.772910:0:3643:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff9dc07ab9b800 x1870854458269568/t0(0) o400->MGC192.168.203.112@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1784189379 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1784189363.772942:0:3643:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff9dc05edd3100 x1870854458270208/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784189363.772951:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc05edd3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3643:1870854458270208:0@lo:400:kworker.0 00000100:00000040:1.0:1784189363.772964:0:3643:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff9dc05edd3100 x1870854458270208/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784189379 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1784189363.772972:0:3643:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:1.0:1784189363.772985:0:3643:0:(events.c:337:request_in_callback()) incoming req@ffff9dbf46436680 x1870854458270208 msgsize 224 00000100:00100000:1.0:1784189363.772989:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:1.0:1784189363.773003:0:3643:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff9dc05edd3100 x1870854458270208/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784189379 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1784189363.773012:0:3643:0:(niobuf.c:635:kick_cpu_latency()) lustre-MDT0000-lwp-MDT0001: using a timeout of 73132 usecs (74 jiffies) 00000100:00100000:1.0:1784189363.773019:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00000040:1.0:1784189363.773029:0:3643:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff9dc05edd1180 x1870854458270080/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784189363.773037:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc05edd1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1870854458270080:0@lo:400:kworker.0 00000100:00000040:1.0:1784189363.773049:0:3643:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff9dc05edd1180 x1870854458270080/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784189379 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1784189363.773055:0:3643:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:1.0:1784189363.773080:0:3643:0:(events.c:337:request_in_callback()) incoming req@ffff9dbf46437800 x1870854458270080 msgsize 224 00000100:00100000:1.0:1784189363.773089:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:1.0:1784189363.773104:0:3643:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff9dc05edd1180 x1870854458270080/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784189379 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1784189363.773113:0:3643:0:(niobuf.c:635:kick_cpu_latency()) lustre-OST0001-osc-MDT0001: using a timeout of 5085 usecs (6 jiffies) 00000100:00100000:1.0:1784189363.773133:0:66171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458269696 00000100:00100000:1.0:1784189363.773139:0:66171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458269696 00000020:00000040:1.0:1784189363.773141:0:66171:0:(genops.c:825:class_conn2export()) looking for export cookie 0xcc1762b626f8c780 00000020:00000040:1.0:1784189363.773144:0:66171:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9dbf46b0a800 refcount=5 00000020:00000040:1.0:1784189363.773155:0:66171:0:(obd_config.c:994:class_incref()) incref lustre-MDT0000 (ffff9dc075478000) now 14 - evictor 00000100:00000040:1.0:1784189363.773178:0:66171:0:(service.c:1432:ptlrpc_at_set_timer()) armed mdt at +6s 00000100:00100000:1.0:1784189363.773199:0:66171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458270208 00000100:00100000:1.0:1784189363.773202:0:66171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458270208 00000020:00000040:1.0:1784189363.773203:0:66171:0:(genops.c:825:class_conn2export()) looking for export cookie 0xcc1762b626f8c787 00000020:00000040:1.0:1784189363.773206:0:66171:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9dbf46b0e000 refcount=5 00000100:00100000:1.0:1784189363.773224:0:66171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1378 00000100:00000040:1.0:1784189363.773228:0:66171:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9dbf46b0a800 : new rpc_count 1 00000100:00000040:1.0:1784189363.773233:0:66171:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9dc05edd2d80 x1870854458269696/t0(0) o400->lustre-MDT0000-lwp-OST0001_UUID@0@lo:554/0 lens 224/0 e 0 to 0 dl 1784189374 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784189363.773244:0:66171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc05edd2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3640:x1870854458269696:12345-0@lo:400:kworker.0 00010000:00000040:1.0:1784189363.773263:0:66171:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 0, transno 0, xid 1870854458269696 00000100:00000040:1.0:1784189363.773271:0:66171:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9dc0710a1d00 refcount 52 to 0@lo 00000100:00000040:1.0:1784189363.773275:0:66171:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:1.0:1784189363.773291:0:66171:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff9dc05edd0e00 x1870854458269696/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784189379 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1784189363.773305:0:66171:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff9dc0710a1d00 refcount 51 to 0@lo 00000100:00000040:1.0:1784189363.773309:0:66171:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9dc05edd2d80 x1870854458269696/t0(0) o400->lustre-MDT0000-lwp-OST0001_UUID@0@lo:554/0 lens 224/224 e 0 to 0 dl 1784189374 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784189363.773334:0:66171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc05edd2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3640:x1870854458269696:12345-0@lo:400:kworker.0 Request processed in 75us (553us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189363.773351:0:66171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1378 00000100:00000040:1.0:1784189363.773353:0:66171:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9dbf46b0a800 : new rpc_count 0 00000020:00000040:1.0:1784189363.773364:0:66171:0:(genops.c:900:class_export_put()) PUTting export ffff9dbf46b0a800 : new refcount 4 00000100:00100000:1.0:1784189363.773373:0:66171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1379 00000100:00000040:1.0:1784189363.773376:0:66171:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9dbf46b0e000 : new rpc_count 1 00000100:00000040:1.0:1784189363.773380:0:66171:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9dbf46436680 x1870854458270208/t0(0) o400->lustre-MDT0000-lwp-MDT0001_UUID@0@lo:554/0 lens 224/0 e 0 to 0 dl 1784189374 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784189363.773390:0:66171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf46436680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1870854458270208:12345-0@lo:400:kworker.0 00010000:00000040:1.0:1784189363.773401:0:66171:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 0, transno 0, xid 1870854458270208 00000100:00000040:1.0:1784189363.773406:0:66171:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9dc0710a1d00 refcount 52 to 0@lo 00000100:00000040:1.0:1784189363.773409:0:66171:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:1.0:1784189363.773424:0:66171:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff9dc05edd3100 x1870854458270208/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784189379 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1784189363.773440:0:66171:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff9dc0710a1d00 refcount 51 to 0@lo 00000100:00000040:1.0:1784189363.773443:0:66171:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9dbf46436680 x1870854458270208/t0(0) o400->lustre-MDT0000-lwp-MDT0001_UUID@0@lo:554/0 lens 224/224 e 0 to 0 dl 1784189374 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784189363.773451:0:66171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf46436680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1870854458270208:12345-0@lo:400:kworker.0 Request processed in 62us (464us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189363.773457:0:66171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1379 00000100:00000040:1.0:1784189363.773460:0:66171:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9dbf46b0e000 : new rpc_count 0 00000020:00000040:1.0:1784189363.773465:0:66171:0:(genops.c:900:class_export_put()) PUTting export ffff9dbf46b0e000 : new refcount 4 00000100:00080000:1.0:1784189363.773476:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000020:00000040:1.0:1784189363.773481:0:6509:0:(obd_config.c:1022:class_decref()) Decref lustre-MDT0000 (ffff9dc075478000) now 14 - evictor 00000100:00000040:1.0:1784189363.773512:0:3643:0:(client.c:3108:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: skip recheck: last_committed 0 00000100:00000040:1.0:1784189363.773518:0:3643:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff9dc05edd3100 x1870854458270208/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784189379 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1784189363.773539:0:3643:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9dc05edd3100 x1870854458270208/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784189379 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784189363.773546:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc05edd3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3643:1870854458270208:0@lo:400:kworker.0 00000100:00000040:1.0:1784189363.773552:0:3643:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff9dc05edd3100 x1870854458270208/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784189379 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:1.0:1784189363.773561:0:3643:0:(genops.c:1244:class_import_put()) import ffff9dbf43690800 refcount=2 obd=lustre-MDT0000-lwp-MDT0001 00000100:00000040:1.0:1784189363.774912:0:3639:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff9dc05edd0700 x1870854458269952/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784189363.774929:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc05edd0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3639:1870854458269952:0@lo:8:kworker.0 00000100:00000040:1.0:1784189363.774955:0:3639:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff9dc05edd0700 x1870854458269952/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 1784189388 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1784189363.774962:0:3639:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:1.0:1784189363.774993:0:3639:0:(events.c:337:request_in_callback()) incoming req@ffff9dbf46434700 x1870854458269952 msgsize 520 00000100:00100000:1.0:1784189363.774997:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:1.0:1784189363.775018:0:3639:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff9dc05edd0700 x1870854458269952/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 1784189388 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1784189363.775028:0:3639:0:(niobuf.c:635:kick_cpu_latency()) lustre-OST0000-osc-MDT0001: using a timeout of 4967 usecs (5 jiffies) 00000100:00000040:1.0:1784189363.775036:0:3639:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff9dc05edd3800 x1870854458270336/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784189363.775044:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc05edd3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3639:1870854458270336:0@lo:8:kworker.0 00000100:00000040:1.0:1784189363.775058:0:3639:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff9dc05edd3800 x1870854458270336/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 1784189388 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1784189363.775064:0:3639:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:1.0:1784189363.775074:0:3639:0:(events.c:337:request_in_callback()) incoming req@ffff9dbf46437480 x1870854458270336 msgsize 520 00000100:00100000:1.0:1784189363.775077:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:1.0:1784189363.775095:0:3639:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff9dc05edd3800 x1870854458270336/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 1784189388 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1784189363.775103:0:3639:0:(niobuf.c:635:kick_cpu_latency()) lustre-OST0000-osc-MDT0000: using a timeout of 7978 usecs (8 jiffies) 00000100:00000040:1.0:1784189363.775128:0:3641:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff9dc05edd3480 x1870854458269824/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784189363.775138:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc05edd3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3641:1870854458269824:0@lo:400:kworker.0 00000100:00000040:1.0:1784189363.775151:0:3641:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff9dc05edd3480 x1870854458269824/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784189379 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1784189363.775158:0:3641:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:1.0:1784189363.775171:0:3641:0:(events.c:337:request_in_callback()) incoming req@ffff9dbf46435c00 x1870854458269824 msgsize 224 00000100:00100000:1.0:1784189363.775175:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:1.0:1784189363.775188:0:3641:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff9dc05edd3480 x1870854458269824/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784189379 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1784189363.775197:0:3641:0:(niobuf.c:635:kick_cpu_latency()) lustre-MDT0001-lwp-OST0001: using a timeout of 7116 usecs (8 jiffies) 00000100:00000040:1.0:1784189363.775203:0:3641:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff9dc05edd0000 x1870854458270592/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784189363.775212:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc05edd0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3641:1870854458270592:0@lo:400:kworker.0 00000100:00000040:1.0:1784189363.775224:0:3641:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff9dc05edd0000 x1870854458270592/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784189379 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1784189363.775231:0:3641:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:1.0:1784189363.775241:0:3641:0:(events.c:337:request_in_callback()) incoming req@ffff9dbf46434a80 x1870854458270592 msgsize 224 00000100:00100000:1.0:1784189363.775244:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:1.0:1784189363.775255:0:3641:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff9dc05edd0000 x1870854458270592/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784189379 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1784189363.775265:0:3641:0:(niobuf.c:635:kick_cpu_latency()) lustre-MDT0000-lwp-MDT0000: using a timeout of 8380 usecs (9 jiffies) 00000100:00100000:1.0:1784189363.775285:0:66945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458269824 00000100:00100000:1.0:1784189363.775290:0:66945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458269824 00000020:00000040:1.0:1784189363.775301:0:66945:0:(genops.c:825:class_conn2export()) looking for export cookie 0xcc1762b626f86541 00000020:00000040:1.0:1784189363.775305:0:66945:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9dbf43d8f800 refcount=5 00000020:00000040:1.0:1784189363.775335:0:66945:0:(obd_config.c:994:class_incref()) incref lustre-MDT0001 (ffff9dc071094d40) now 10 - evictor 00000100:00000040:1.0:1784189363.775356:0:66945:0:(service.c:1432:ptlrpc_at_set_timer()) armed mdt at +6s 00000100:00100000:1.0:1784189363.775375:0:66945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458270592 00000100:00100000:1.0:1784189363.775378:0:66945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458270592 00000020:00000040:1.0:1784189363.775380:0:66945:0:(genops.c:825:class_conn2export()) looking for export cookie 0xcc1762b626f8c78e 00000020:00000040:1.0:1784189363.775383:0:66945:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9dc06b8e5800 refcount=5 00000100:00100000:1.0:1784189363.775403:0:66945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1380 00000100:00000040:1.0:1784189363.775407:0:66945:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9dbf43d8f800 : new rpc_count 1 00000100:00000040:1.0:1784189363.775411:0:66945:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9dbf46435c00 x1870854458269824/t0(0) o400->lustre-MDT0001-lwp-OST0001_UUID@0@lo:554/0 lens 224/0 e 0 to 0 dl 1784189374 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784189363.775422:0:66945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf46435c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1870854458269824:12345-0@lo:400:kworker.0 00010000:00000040:1.0:1784189363.775438:0:66945:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 0, transno 0, xid 1870854458269824 00000100:00000040:1.0:1784189363.775447:0:66945:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9dc0710a1d00 refcount 52 to 0@lo 00000100:00000040:1.0:1784189363.775451:0:66945:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:1.0:1784189363.775467:0:66945:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff9dc05edd3480 x1870854458269824/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784189379 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1784189363.775485:0:66945:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff9dc0710a1d00 refcount 51 to 0@lo 00000100:00000040:1.0:1784189363.775489:0:66945:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9dbf46435c00 x1870854458269824/t0(0) o400->lustre-MDT0001-lwp-OST0001_UUID@0@lo:554/0 lens 224/224 e 0 to 0 dl 1784189374 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784189363.775497:0:66945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf46435c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1870854458269824:12345-0@lo:400:kworker.0 Request processed in 76us (323us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189363.775503:0:66945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1380 00000100:00000040:1.0:1784189363.775506:0:66945:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9dbf43d8f800 : new rpc_count 0 00000020:00000040:1.0:1784189363.775518:0:66945:0:(genops.c:900:class_export_put()) PUTting export ffff9dbf43d8f800 : new refcount 4 00000100:00100000:1.0:1784189363.775527:0:66945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1381 00000100:00000040:1.0:1784189363.775529:0:66945:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9dc06b8e5800 : new rpc_count 1 00000100:00000040:1.0:1784189363.775533:0:66945:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9dbf46434a80 x1870854458270592/t0(0) o400->lustre-MDT0000-lwp-MDT0000_UUID@0@lo:554/0 lens 224/0 e 0 to 0 dl 1784189374 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784189363.775549:0:66945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf46434a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1870854458270592:12345-0@lo:400:kworker.0 00010000:00000040:1.0:1784189363.775561:0:66945:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 0, transno 0, xid 1870854458270592 00000100:00000040:1.0:1784189363.775566:0:66945:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9dc0710a1d00 refcount 52 to 0@lo 00000100:00000040:1.0:1784189363.775569:0:66945:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:1.0:1784189363.775584:0:66945:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff9dc05edd0000 x1870854458270592/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784189379 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1784189363.775595:0:66945:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff9dc0710a1d00 refcount 51 to 0@lo 00000100:00000040:1.0:1784189363.775599:0:66945:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9dbf46434a80 x1870854458270592/t0(0) o400->lustre-MDT0000-lwp-MDT0000_UUID@0@lo:554/0 lens 224/224 e 0 to 0 dl 1784189374 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784189363.775606:0:66945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf46434a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1870854458270592:12345-0@lo:400:kworker.0 Request processed in 59us (364us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189363.775612:0:66945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1381 00000100:00000040:1.0:1784189363.775614:0:66945:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9dc06b8e5800 : new rpc_count 0 00000020:00000040:1.0:1784189363.775620:0:66945:0:(genops.c:900:class_export_put()) PUTting export ffff9dc06b8e5800 : new refcount 4 00000100:00080000:1.0:1784189363.775638:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000020:00000040:1.0:1784189363.775641:0:6509:0:(obd_config.c:1022:class_decref()) Decref lustre-MDT0001 (ffff9dc071094d40) now 10 - evictor 00000100:00000040:1.0:1784189363.775676:0:3641:0:(client.c:3108:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: skip recheck: last_committed 0 00000100:00000040:1.0:1784189363.775682:0:3641:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff9dc05edd3480 x1870854458269824/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784189379 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1784189363.775690:0:3641:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9dc05edd3480 x1870854458269824/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784189379 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784189363.775697:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc05edd3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3641:1870854458269824:0@lo:400:kworker.0 00000100:00000040:1.0:1784189363.775707:0:3641:0:(client.c:3108:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: skip recheck: last_committed 0 00000100:00000040:1.0:1784189363.775710:0:3641:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff9dc05edd0000 x1870854458270592/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784189379 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1784189363.775730:0:3641:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9dc05edd0000 x1870854458270592/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784189379 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784189363.775736:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc05edd0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3641:1870854458270592:0@lo:400:kworker.0 00000100:00000040:1.0:1784189363.775741:0:3641:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff9dc05edd3480 x1870854458269824/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784189379 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:1.0:1784189363.775750:0:3641:0:(genops.c:1244:class_import_put()) import ffff9dbf43115800 refcount=2 obd=lustre-MDT0001-lwp-OST0001 00000100:00000040:1.0:1784189363.775757:0:3641:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff9dc05edd0000 x1870854458270592/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784189379 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:1.0:1784189363.775763:0:3641:0:(genops.c:1244:class_import_put()) import ffff9dbf43fcb000 refcount=2 obd=lustre-MDT0000-lwp-MDT0000 00000100:00000040:0.0:1784189363.776843:0:3640:0:(client.c:3108:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: skip recheck: last_committed 0 00000100:00000040:0.0:1784189363.776851:0:3640:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff9dc05edd0e00 x1870854458269696/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784189379 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1784189363.776861:0:3640:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9dc05edd0e00 x1870854458269696/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784189379 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784189363.776869:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc05edd0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3640:1870854458269696:0@lo:400:kworker.0 00000100:00000040:0.0:1784189363.776875:0:3640:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff9dc05edd1880 x1870854458270464/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784189363.776885:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc05edd1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1870854458270464:0@lo:400:kworker.0 00000100:00000040:0.0:1784189363.776901:0:3640:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff9dc05edd1880 x1870854458270464/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784189379 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1784189363.776909:0:3640:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1784189363.776932:0:3640:0:(events.c:337:request_in_callback()) incoming req@ffff9dc05edd1c00 x1870854458270464 msgsize 224 00000100:00100000:0.0:1784189363.776936:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:0.0:1784189363.776956:0:3640:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff9dc05edd1880 x1870854458270464/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784189379 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1784189363.776978:0:3640:0:(niobuf.c:635:kick_cpu_latency()) lustre-OST0001-osc-MDT0000: using a timeout of 6938 usecs (7 jiffies) 00000100:00000040:0.0:1784189363.776984:0:3640:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff9dc05edd0e00 x1870854458269696/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784189379 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:0.0:1784189363.776992:0:3640:0:(genops.c:1244:class_import_put()) import ffff9dbf425f4800 refcount=2 obd=lustre-MDT0000-lwp-OST0001 00000100:00100000:0.0:1784189363.777025:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458270080 00000100:00100000:0.0:1784189363.777030:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458270080 00000020:00000040:0.0:1784189363.777033:0:8428:0:(genops.c:825:class_conn2export()) looking for export cookie 0xcc1762b626f864bc 00000020:00000040:0.0:1784189363.777036:0:8428:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9dbf42277000 refcount=5 00000020:00000040:0.0:1784189363.777046:0:8428:0:(obd_config.c:994:class_incref()) incref lustre-OST0001 (ffff9dbf4312b380) now 10 - evictor 00000100:00000040:0.0:1784189363.777063:0:8428:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost at +6s 00000100:00100000:0.0:1784189363.777079:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458269952 00000100:00100000:0.0:1784189363.777082:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458269952 00000020:00000040:0.0:1784189363.777084:0:8428:0:(genops.c:825:class_conn2export()) looking for export cookie 0xcc1762b626f864ae 00000100:00100000:0.0:1784189363.777096:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458270336 00000100:00100000:0.0:1784189363.777098:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458270336 00000020:00000040:0.0:1784189363.777099:0:8428:0:(genops.c:825:class_conn2export()) looking for export cookie 0xcc1762b626f8c63e 00000100:00100000:0.0:1784189363.777110:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458270464 00000100:00100000:0.0:1784189363.777112:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458270464 00000020:00000040:0.0:1784189363.777113:0:8428:0:(genops.c:825:class_conn2export()) looking for export cookie 0xcc1762b626f8c64c 00000020:00000040:0.0:1784189363.777115:0:8428:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9dbf47452800 refcount=5 00000100:00100000:0.0:1784189363.777137:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2610 00000100:00000040:0.0:1784189363.777141:0:8428:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9dbf42277000 : new rpc_count 1 00000100:00000040:0.0:1784189363.777146:0:8428:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9dbf46437800 x1870854458270080/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:554/0 lens 224/0 e 0 to 0 dl 1784189374 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784189363.777157:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf46437800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1870854458270080:12345-0@lo:400:kworker.0 00010000:00000040:0.0:1784189363.777173:0:8428:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 4294968945, transno 0, xid 1870854458270080 00000100:00000040:0.0:1784189363.777179:0:8428:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9dc0710a1d00 refcount 52 to 0@lo 00000100:00000040:0.0:1784189363.777182:0:8428:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1784189363.777199:0:8428:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff9dc05edd1180 x1870854458270080/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784189379 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1784189363.777225:0:8428:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff9dc0710a1d00 refcount 51 to 0@lo 00000100:00000040:0.0:1784189363.777229:0:8428:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9dbf46437800 x1870854458270080/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:554/0 lens 224/224 e 0 to 0 dl 1784189374 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784189363.777237:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf46437800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1870854458270080:12345-0@lo:400:kworker.0 Request processed in 82us (4156us total) trans 0 rc 0/0 00000100:00100000:0.0:1784189363.777244:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2610 00000100:00000040:0.0:1784189363.777247:0:8428:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9dbf42277000 : new rpc_count 0 00000020:00000040:0.0:1784189363.777254:0:8428:0:(genops.c:900:class_export_put()) PUTting export ffff9dbf42277000 : new refcount 4 00000100:00100000:0.0:1784189363.777262:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2611 00000100:00000040:0.0:1784189363.777265:0:8428:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9dbf47452800 : new rpc_count 1 00000100:00000040:0.0:1784189363.777268:0:8428:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9dc05edd1c00 x1870854458270464/t0(0) o400->lustre-MDT0000-mdtlov_UUID@0@lo:554/0 lens 224/0 e 0 to 0 dl 1784189374 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784189363.777278:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc05edd1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1870854458270464:12345-0@lo:400:kworker.0 00010000:00000040:0.0:1784189363.777286:0:8428:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 4294968960, transno 0, xid 1870854458270464 00000100:00000040:0.0:1784189363.777291:0:8428:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9dc0710a1d00 refcount 52 to 0@lo 00000100:00000040:0.0:1784189363.777294:0:8428:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1784189363.777308:0:8428:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff9dc05edd1880 x1870854458270464/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784189379 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1784189363.777339:0:8428:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff9dc0710a1d00 refcount 51 to 0@lo 00000100:00000040:0.0:1784189363.777344:0:8428:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9dc05edd1c00 x1870854458270464/t0(0) o400->lustre-MDT0000-mdtlov_UUID@0@lo:554/0 lens 224/224 e 0 to 0 dl 1784189374 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784189363.777351:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc05edd1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1870854458270464:12345-0@lo:400:kworker.0 Request processed in 75us (418us total) trans 0 rc 0/0 00000100:00100000:0.0:1784189363.777357:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2611 00000100:00000040:0.0:1784189363.777359:0:8428:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9dbf47452800 : new rpc_count 0 00000020:00000040:0.0:1784189363.777369:0:8428:0:(genops.c:900:class_export_put()) PUTting export ffff9dbf47452800 : new refcount 4 00000100:00100000:0.0:1784189363.777379:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5073 00000100:00000040:0.0:1784189363.777383:0:8428:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9dbf46434700 x1870854458269952/t0(0) o8->@:0/0 lens 520/0 e 0 to 0 dl 1784189383 ref 1 fl New:/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784189363.777391:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf46434700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3639:x1870854458269952:12345-0@lo:8:kworker.0 00010000:00020000:0.0:1784189363.777410:0:8428:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-OST0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00000040:0.0:1784189363.777420:0:8428:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9dc0710a1d00 refcount 52 to 0@lo 00000100:00000040:0.0:1784189363.777423:0:8428:0:(connection.c:149:ptlrpc_connection_get()) conn=ffff9dc0710a1d00 refcount 52 to 0@lo 00000100:00000040:0.0:1784189363.777426:0:8428:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1784189363.777442:0:8428:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=0 replen=544 req@ffff9dc05edd0700 x1870854458269952/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 1784189388 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1784189363.777458:0:8428:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff9dc0710a1d00 refcount 51 to 0@lo 00000100:00000040:0.0:1784189363.777462:0:8428:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9dbf46434700 x1870854458269952/t0(0) o8->@:0/0 lens 520/224 e 0 to 0 dl 1784189383 ref 1 fl Interpret:/200/0 rc -19/-19 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784189363.777470:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf46434700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3639:x1870854458269952:12345-0@lo:8:kworker.0 Request processed in 78us (2476us total) trans 0 rc -19/-19 00000100:00100000:0.0:1784189363.777475:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5073 00000100:00100000:0.0:1784189363.777486:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5074 00000100:00000040:0.0:1784189363.777490:0:8428:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9dbf46437480 x1870854458270336/t0(0) o8->@:0/0 lens 520/0 e 0 to 0 dl 1784189383 ref 1 fl New:/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784189363.777498:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf46437480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3639:x1870854458270336:12345-0@lo:8:kworker.0 00010000:00020000:0.0:1784189363.777508:0:8428:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-OST0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00000040:0.0:1784189363.777515:0:8428:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9dc0710a1d00 refcount 52 to 0@lo 00000100:00000040:0.0:1784189363.777518:0:8428:0:(connection.c:149:ptlrpc_connection_get()) conn=ffff9dc0710a1d00 refcount 52 to 0@lo 00000100:00000040:0.0:1784189363.777521:0:8428:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1784189363.777534:0:8428:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=0 replen=544 req@ffff9dc05edd3800 x1870854458270336/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 1784189388 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1784189363.777557:0:8428:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff9dc0710a1d00 refcount 51 to 0@lo 00000100:00000040:0.0:1784189363.777561:0:8428:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9dbf46437480 x1870854458270336/t0(0) o8->@:0/0 lens 520/224 e 0 to 0 dl 1784189383 ref 1 fl Interpret:/200/0 rc -19/-19 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784189363.777568:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf46437480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3639:x1870854458270336:12345-0@lo:8:kworker.0 Request processed in 69us (2492us total) trans 0 rc -19/-19 00000100:00100000:0.0:1784189363.777573:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5074 00000100:00080000:0.0:1784189363.777608:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000020:00000040:0.0:1784189363.777612:0:6509:0:(obd_config.c:1022:class_decref()) Decref lustre-OST0001 (ffff9dbf4312b380) now 10 - evictor 00000100:00000040:0.0:1784189363.777636:0:3643:0:(client.c:3108:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: skip recheck: last_committed 4294968945 00000100:00000040:0.0:1784189363.777642:0:3643:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff9dc05edd1180 x1870854458270080/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784189379 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1784189363.777664:0:3643:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9dc05edd1180 x1870854458270080/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784189379 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784189363.777671:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc05edd1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1870854458270080:0@lo:400:kworker.0 00000100:00000040:0.0:1784189363.777677:0:3643:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff9dc05edd1180 x1870854458270080/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784189379 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:0.0:1784189363.777686:0:3643:0:(genops.c:1244:class_import_put()) import ffff9dc080cc8800 refcount=2 obd=lustre-OST0001-osc-MDT0001 00000100:00000040:0.0:1784189363.777706:0:3640:0:(client.c:3108:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: skip recheck: last_committed 4294968960 00000100:00000040:0.0:1784189363.777711:0:3640:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff9dc05edd1880 x1870854458270464/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784189379 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1784189363.777719:0:3640:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9dc05edd1880 x1870854458270464/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784189379 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784189363.777725:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc05edd1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1870854458270464:0@lo:400:kworker.0 00000100:00000040:0.0:1784189363.777731:0:3640:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff9dc05edd1880 x1870854458270464/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784189379 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:0.0:1784189363.777743:0:3640:0:(genops.c:1244:class_import_put()) import ffff9dbf4845c000 refcount=2 obd=lustre-OST0001-osc-MDT0000 00000100:00000040:1.0:1784189363.778128:0:3639:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff9dc05edd0700 x1870854458269952/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/224 e 0 to 0 dl 1784189388 ref 1 fl Rpc:RNQU/200/0 rc -19/-19 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1784189363.778137:0:3639:0:(import.c:65:import_set_state_nolock()) ffff9dbf43114800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1784189363.778141:0:3639:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-19) 00000100:00000040:1.0:1784189363.778145:0:3639:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9dc05edd0700 x1870854458269952/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/224 e 0 to 0 dl 1784189388 ref 1 fl Interpret:RNQU/200/0 rc -19/-19 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784189363.778151:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc05edd0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3639:1870854458269952:0@lo:8:kworker.0 00000100:00000040:1.0:1784189363.778162:0:3639:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff9dc05edd3800 x1870854458270336/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/224 e 0 to 0 dl 1784189388 ref 1 fl Rpc:RNQU/200/0 rc -19/-19 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1784189363.778168:0:3639:0:(import.c:65:import_set_state_nolock()) ffff9dc075655000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1784189363.778171:0:3639:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-19) 00000100:00000040:1.0:1784189363.778175:0:3639:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9dc05edd3800 x1870854458270336/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/224 e 0 to 0 dl 1784189388 ref 1 fl Interpret:RNQU/200/0 rc -19/-19 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784189363.778182:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc05edd3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3639:1870854458270336:0@lo:8:kworker.0 00000100:00000040:1.0:1784189363.778193:0:3639:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff9dc05edd0700 x1870854458269952/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/224 e 0 to 0 dl 1784189388 ref 1 fl Complete:RNQU/200/0 rc -19/-19 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:1.0:1784189363.778202:0:3639:0:(genops.c:1244:class_import_put()) import ffff9dbf43114800 refcount=2 obd=lustre-OST0000-osc-MDT0001 00000100:00000040:1.0:1784189363.778207:0:3639:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff9dc05edd3800 x1870854458270336/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/224 e 0 to 0 dl 1784189388 ref 1 fl Complete:RNQU/200/0 rc -19/-19 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:1.0:1784189363.778213:0:3639:0:(genops.c:1244:class_import_put()) import ffff9dc075655000 refcount=2 obd=lustre-OST0000-osc-MDT0000 00000100:00100000:2.0:1784189363.779936:0:94314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458269568 00000100:00100000:2.0:1784189363.779947:0:94314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458269568 00000020:00000040:2.0:1784189363.779950:0:94314:0:(genops.c:825:class_conn2export()) looking for export cookie 0xcc1762b626f8c573 00000020:00000040:2.0:1784189363.779969:0:94314:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9dc050ae5000 refcount=21 00000100:00000040:2.0:1784189363.779995:0:94314:0:(service.c:1432:ptlrpc_at_set_timer()) armed mgs at +6s 00000100:00100000:2.0:1784189363.781074:0:94314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00000040:2.0:1784189363.781079:0:94314:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9dc050ae5000 : new rpc_count 1 00000100:00000040:2.0:1784189363.781088:0:94314:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9dc080e3b450 x1870854458269568/t0(0) o400->bd553d0d-03e2-4233-b06b-b55bbfa2b954@0@lo:554/0 lens 224/0 e 0 to 0 dl 1784189374 ref 1 fl New:/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784189363.781104:0:94314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc080e3b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:bd553d0d-03e2-4233-b06b-b55bbfa2b954+21:3643:x1870854458269568:12345-0@lo:400:kworker.0 00010000:00000040:2.0:1784189363.781124:0:94314:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 0, transno 0, xid 1870854458269568 00000100:00000040:2.0:1784189363.781135:0:94314:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9dc0710a1d00 refcount 52 to 0@lo 00000100:00000040:2.0:1784189363.781140:0:94314:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1784189363.781183:0:94314:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff9dc07ab9b800 x1870854458269568/t0(0) o400->MGC192.168.203.112@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1784189379 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1784189363.781216:0:94314:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff9dc0710a1d00 refcount 51 to 0@lo 00000100:00000040:2.0:1784189363.781221:0:94314:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9dc080e3b450 x1870854458269568/t0(0) o400->bd553d0d-03e2-4233-b06b-b55bbfa2b954@0@lo:554/0 lens 224/224 e 0 to 0 dl 1784189374 ref 1 fl Interpret:/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784189363.781230:0:94314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc080e3b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:bd553d0d-03e2-4233-b06b-b55bbfa2b954+21:3643:x1870854458269568:12345-0@lo:400:kworker.0 Request processed in 131us (8982us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189363.781237:0:94314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00000040:2.0:1784189363.781241:0:94314:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9dc050ae5000 : new rpc_count 0 00000020:00000040:2.0:1784189363.781252:0:94314:0:(genops.c:900:class_export_put()) PUTting export ffff9dc050ae5000 : new refcount 20 00000100:00000040:1.0:1784189363.781360:0:3643:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff9dc07ab9b800 x1870854458269568/t0(0) o400->MGC192.168.203.112@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1784189379 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1784189363.781371:0:3643:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9dc07ab9b800 x1870854458269568/t0(0) o400->MGC192.168.203.112@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1784189379 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784189363.781379:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc07ab9b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:bd553d0d-03e2-4233-b06b-b55bbfa2b954:3643:1870854458269568:0@lo:400:kworker.0 00000100:00000040:1.0:1784189363.781386:0:3643:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff9dc07ab9b800 x1870854458269568/t0(0) o400->MGC192.168.203.112@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1784189379 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:1.0:1784189363.781396:0:3643:0:(genops.c:1244:class_import_put()) import ffff9dc07110c800 refcount=3 obd=MGC192.168.203.112@tcp 00010000:00010000:2.0:1784189363.956746:0:26173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000040:3.0:1784189364.272278:0:94324:0:(genops.c:1231:class_import_get()) import ffff9dbf4845c000 refcount=3 obd=lustre-OST0001-osc-MDT0000 00000100:00000040:3.0:1784189364.272362:0:94324:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [00000000e4188db4] to pc [ptlrpcd_00_02+2] req@ffff9dc071536680 x1870854458270720/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/200/ffffffff rc 0/-1 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784189364.272399:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00000040:3.0:1784189364.272417:0:3643:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff9dc071536680 x1870854458270720/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/200/ffffffff rc 0/-1 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784189364.272431:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc071536680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1870854458270720:0@lo:13:osp-pre-1-0.0 00000100:00000040:3.0:1784189364.272460:0:3643:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff9dc071536680 x1870854458270720/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784189380 ref 2 fl Rpc:r/200/ffffffff rc 0/-1 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1784189364.272468:0:3643:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:3.0:1784189364.272507:0:3643:0:(events.c:337:request_in_callback()) incoming req@ffff9dc071537100 x1870854458270720 msgsize 224 00000100:00100000:3.0:1784189364.272512:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:3.0:1784189364.272532:0:3643:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff9dc071536680 x1870854458270720/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784189380 ref 2 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1784189364.272544:0:3643:0:(niobuf.c:635:kick_cpu_latency()) lustre-OST0001-osc-MDT0000: using a timeout of 6916 usecs (7 jiffies) 00000100:00100000:3.0:1784189364.272569:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458270720 00000100:00100000:3.0:1784189364.272578:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458270720 00000020:00000040:3.0:1784189364.272580:0:8432:0:(genops.c:825:class_conn2export()) looking for export cookie 0xcc1762b626f8c64c 00000020:00000040:3.0:1784189364.272584:0:8432:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9dbf47452800 refcount=5 00000100:00000040:3.0:1784189364.272607:0:8432:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_create at +6s 00000100:00100000:3.0:1784189364.272632:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2092 00000100:00000040:3.0:1784189364.272636:0:8432:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9dbf47452800 : new rpc_count 1 00000100:00000040:3.0:1784189364.272942:0:8432:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9dc071537100 x1870854458270720/t0(0) o13->lustre-MDT0000-mdtlov_UUID@0@lo:555/0 lens 224/0 e 0 to 0 dl 1784189375 ref 1 fl New:/200/ffffffff rc 0/-1 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784189364.272958:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc071537100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1870854458270720:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1784189364.272991:0:8432:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8646976 pending 0 free 3923529728 avail 3692007424 00010000:00000040:3.0:1784189364.273017:0:8432:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 4294968960, transno 0, xid 1870854458270720 00000100:00000040:3.0:1784189364.273027:0:8432:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9dc0710a1d00 refcount 52 to 0@lo 00000100:00000040:3.0:1784189364.273032:0:8432:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:3.0:1784189364.273053:0:8432:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=368 offset=224 replen=368 req@ffff9dc071536680 x1870854458270720/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784189380 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1784189364.273120:0:8432:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff9dc0710a1d00 refcount 51 to 0@lo 00000100:00000040:3.0:1784189364.273125:0:8432:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9dc071537100 x1870854458270720/t0(0) o13->lustre-MDT0000-mdtlov_UUID@0@lo:555/0 lens 224/368 e 0 to 0 dl 1784189375 ref 1 fl Interpret:/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784189364.273133:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc071537100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1870854458270720:12345-0@lo:13:osp-pre-1-0.0 Request processed in 180us (624us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189364.273139:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2092 00000100:00000040:3.0:1784189364.273143:0:8432:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9dbf47452800 : new rpc_count 0 00000020:00000040:3.0:1784189364.273153:0:8432:0:(genops.c:900:class_export_put()) PUTting export ffff9dbf47452800 : new refcount 4 00000100:00000040:0.0:1784189364.274483:0:3643:0:(client.c:3108:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: skip recheck: last_committed 4294968960 00000100:00000040:0.0:1784189364.274495:0:3643:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff9dc071536680 x1870854458270720/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784189380 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000004:00000040:0.0:1784189364.274507:0:3643:0:(osp_precreate.c:87:osp_pre_update_status_msfs()) lustre-OST0001-osc-MDT0000: Updating status = 0 00000004:00000040:0.0:1784189364.274510:0:3643:0:(osp_precreate.c:1081:osp_pre_update_msfs()) lustre-OST0001-osc-MDT0000: blocks=958279 free=957893 avail=901318 avail_mb=3520 hwm_mb=7 files=262144 ffree=261731 state=0: rc = 0 00000100:00000040:0.0:1784189364.274518:0:3643:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9dc071536680 x1870854458270720/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784189380 ref 1 fl Interpret:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784189364.274525:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc071536680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1870854458270720:0@lo:13:osp-pre-1-0.0 00000100:00000040:0.0:1784189364.274532:0:3643:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff9dc071536680 x1870854458270720/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784189380 ref 1 fl Complete:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000020:00000040:0.0:1784189364.274542:0:3643:0:(genops.c:1244:class_import_put()) import ffff9dbf4845c000 refcount=2 obd=lustre-OST0001-osc-MDT0000 00000100:00000040:1.0:1784189364.519687:0:3635:0:(events.c:337:request_in_callback()) incoming req@ffff9dbf46434380 x1870854436388352 msgsize 224 00000100:00100000:1.0:1784189364.519704:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00000040:1.0:1784189364.519748:0:3635:0:(events.c:337:request_in_callback()) incoming req@ffff9dbf46435500 x1870854436388736 msgsize 224 00000100:00100000:1.0:1784189364.519754:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00000040:1.0:1784189364.519784:0:3635:0:(events.c:337:request_in_callback()) incoming req@ffff9dc080e38450 x1870854436388224 msgsize 224 00000100:00100000:1.0:1784189364.519789:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00000040:1.0:1784189364.519791:0:3635:0:(events.c:349:request_in_callback()) Buffer complete: 63 buffers still posted 00000100:00000040:1.0:1784189364.519807:0:3635:0:(events.c:337:request_in_callback()) incoming req@ffff9dc07ab9b800 x1870854436388480 msgsize 224 00000100:00100000:1.0:1784189364.519811:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00000040:1.0:1784189364.519829:0:3635:0:(events.c:337:request_in_callback()) incoming req@ffff9dc080f69c00 x1870854436388608 msgsize 520 00000100:00100000:1.0:1784189364.519833:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1784189364.519859:0:26167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436388736 00000100:00100000:1.0:1784189364.519877:0:26167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436388736 00000020:00000040:1.0:1784189364.519881:0:26167:0:(genops.c:825:class_conn2export()) looking for export cookie 0xcc1762b626f8c994 00000020:00000040:1.0:1784189364.519885:0:26167:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9dc047a82800 refcount=7 00000020:00000040:1.0:1784189364.519899:0:26167:0:(obd_config.c:994:class_incref()) incref lustre-OST0001 (ffff9dbf4312b380) now 10 - evictor 00000100:00000040:1.0:1784189364.519920:0:26167:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost at +6s 00000100:00100000:1.0:1784189364.519942:0:26167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436388608 00000100:00100000:1.0:1784189364.519945:0:26167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436388608 00000020:00000040:1.0:1784189364.519946:0:26167:0:(genops.c:825:class_conn2export()) looking for export cookie 0xcc1762b626f8c98d 00000100:00100000:1.0:1784189364.519963:0:26167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 2612 00000100:00000040:1.0:1784189364.519968:0:26167:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9dc047a82800 : new rpc_count 1 00000100:00000040:1.0:1784189364.519974:0:26167:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9dbf46435500 x1870854436388736/t0(0) o400->debedd94-805c-42a0-a5e5-41758b2012e9@192.168.203.12@tcp:555/0 lens 224/0 e 0 to 0 dl 1784189375 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784189364.519988:0:26167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf46435500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:debedd94-805c-42a0-a5e5-41758b2012e9+7:2398:x1870854436388736:12345-192.168.203.12@tcp:400:kworker.0 00010000:00000040:1.0:1784189364.520006:0:26167:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 0, transno 0, xid 1870854436388736 00000100:00000040:1.0:1784189364.520016:0:26167:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9dbf4274f140 refcount 9 to 192.168.203.12@tcp 00000100:00000040:1.0:1784189364.520021:0:26167:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.203.12@tcp 00000100:00000040:1.0:1784189364.520055:0:26167:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff9dbf4274f140 refcount 8 to 192.168.203.12@tcp 00000100:00000040:1.0:1784189364.520060:0:26167:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9dbf46435500 x1870854436388736/t0(0) o400->debedd94-805c-42a0-a5e5-41758b2012e9@192.168.203.12@tcp:555/0 lens 224/224 e 0 to 0 dl 1784189375 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784189364.520069:0:26167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf46435500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:debedd94-805c-42a0-a5e5-41758b2012e9+7:2398:x1870854436388736:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 84us (318us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189364.520076:0:26167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 2612 00000100:00000040:1.0:1784189364.520079:0:26167:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9dc047a82800 : new rpc_count 0 00000020:00000040:1.0:1784189364.520089:0:26167:0:(genops.c:900:class_export_put()) PUTting export ffff9dc047a82800 : new refcount 6 00000100:00100000:1.0:1784189364.520098:0:26167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 5075 00000100:00000040:1.0:1784189364.520101:0:26167:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9dc080f69c00 x1870854436388608/t0(0) o8->@:0/0 lens 520/0 e 0 to 0 dl 1784189384 ref 1 fl New:/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784189364.520110:0:26167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc080f69c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:0+-99:2395:x1870854436388608:12345-192.168.203.12@tcp:8:kworker.0 00010000:00020000:1.0:1784189364.520135:0:26167:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-OST0000: not available for connect from 192.168.203.12@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00000040:1.0:1784189364.520147:0:26167:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9dbf4274f140 refcount 9 to 192.168.203.12@tcp 00000100:00000040:1.0:1784189364.520150:0:26167:0:(connection.c:149:ptlrpc_connection_get()) conn=ffff9dbf4274f140 refcount 9 to 192.168.203.12@tcp 00000100:00000040:1.0:1784189364.520154:0:26167:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.203.12@tcp 00000100:00000040:1.0:1784189364.520165:0:26167:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff9dbf4274f140 refcount 8 to 192.168.203.12@tcp 00000100:00000040:1.0:1784189364.520169:0:26167:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9dc080f69c00 x1870854436388608/t0(0) o8->@:0/0 lens 520/224 e 0 to 0 dl 1784189384 ref 1 fl Interpret:/200/0 rc -19/-19 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784189364.520177:0:26167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc080f69c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:0+-99:2395:x1870854436388608:12345-192.168.203.12@tcp:8:kworker.0 Request processed in 67us (346us total) trans 0 rc -19/-19 00000100:00100000:1.0:1784189364.520195:0:26167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 5075 00000100:00100000:1.0:1784189364.520214:0:94310:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436388224 00000100:00100000:1.0:1784189364.520218:0:94310:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436388224 00000020:00000040:1.0:1784189364.520220:0:94310:0:(genops.c:825:class_conn2export()) looking for export cookie 0xcc1762b626f8c756 00000020:00000040:1.0:1784189364.520222:0:94310:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9dc0756a3800 refcount=10 00000100:00000040:1.0:1784189364.520232:0:94310:0:(service.c:1432:ptlrpc_at_set_timer()) armed mgs at +6s 00000100:00100000:1.0:1784189364.520248:0:94310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 185 00000100:00000040:1.0:1784189364.520250:0:94310:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9dc0756a3800 : new rpc_count 1 00000100:00000040:1.0:1784189364.520255:0:94310:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9dc080e38450 x1870854436388224/t0(0) o400->60f345e3-c70e-4f53-b5e7-c9671463c9a5@192.168.203.12@tcp:555/0 lens 224/0 e 0 to 0 dl 1784189375 ref 1 fl New:/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784189364.520265:0:94310:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc080e38450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:60f345e3-c70e-4f53-b5e7-c9671463c9a5+10:2398:x1870854436388224:12345-192.168.203.12@tcp:400:kworker.0 00010000:00000040:1.0:1784189364.520274:0:94310:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 0, transno 0, xid 1870854436388224 00000100:00000040:1.0:1784189364.520278:0:94310:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9dbf4274f140 refcount 9 to 192.168.203.12@tcp 00000100:00000040:1.0:1784189364.520282:0:94310:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.203.12@tcp 00000100:00000040:1.0:1784189364.520293:0:94310:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff9dbf4274f140 refcount 8 to 192.168.203.12@tcp 00000100:00000040:1.0:1784189364.520298:0:94310:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9dc080e38450 x1870854436388224/t0(0) o400->60f345e3-c70e-4f53-b5e7-c9671463c9a5@192.168.203.12@tcp:555/0 lens 224/224 e 0 to 0 dl 1784189375 ref 1 fl Interpret:/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784189364.520338:0:94310:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc080e38450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:60f345e3-c70e-4f53-b5e7-c9671463c9a5+10:2398:x1870854436388224:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 53us (530us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189364.520345:0:94310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 185 00000100:00000040:1.0:1784189364.520347:0:94310:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9dc0756a3800 : new rpc_count 0 00000020:00000040:1.0:1784189364.520354:0:94310:0:(genops.c:900:class_export_put()) PUTting export ffff9dc0756a3800 : new refcount 9 00000100:00100000:1.0:1784189364.520377:0:66169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436388352 00000100:00100000:1.0:1784189364.520380:0:66169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436388352 00000020:00000040:1.0:1784189364.520382:0:66169:0:(genops.c:825:class_conn2export()) looking for export cookie 0xcc1762b626f8c5e3 00000020:00000040:1.0:1784189364.520384:0:66169:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9dbf47a3b800 refcount=51 00000020:00000040:1.0:1784189364.520391:0:66169:0:(obd_config.c:994:class_incref()) incref lustre-MDT0000 (ffff9dc075478000) now 14 - evictor 00000100:00000040:1.0:1784189364.520399:0:66169:0:(service.c:1432:ptlrpc_at_set_timer()) armed mdt at +6s 00000100:00100000:1.0:1784189364.520414:0:66169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436388480 00000100:00100000:1.0:1784189364.520416:0:66169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436388480 00000020:00000040:1.0:1784189364.520418:0:66169:0:(genops.c:825:class_conn2export()) looking for export cookie 0xcc1762b626f8bbf6 00000020:00000040:1.0:1784189364.520420:0:66169:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9dc04ffb2000 refcount=11 00000020:00000040:1.0:1784189364.520426:0:66169:0:(obd_config.c:994:class_incref()) incref lustre-MDT0001 (ffff9dc071094d40) now 10 - evictor 00000100:00100000:1.0:1784189364.520442:0:66169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1382 00000100:00000040:1.0:1784189364.520445:0:66169:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9dbf47a3b800 : new rpc_count 1 00000100:00000040:1.0:1784189364.520450:0:66169:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9dbf46434380 x1870854436388352/t0(0) o400->debedd94-805c-42a0-a5e5-41758b2012e9@192.168.203.12@tcp:555/0 lens 224/0 e 0 to 0 dl 1784189375 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784189364.520460:0:66169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf46434380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:debedd94-805c-42a0-a5e5-41758b2012e9+51:2398:x1870854436388352:12345-192.168.203.12@tcp:400:kworker.0 00010000:00000040:1.0:1784189364.520472:0:66169:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 120259084438, transno 0, xid 1870854436388352 00000100:00000040:1.0:1784189364.520476:0:66169:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9dbf4274f140 refcount 9 to 192.168.203.12@tcp 00000100:00000040:1.0:1784189364.520480:0:66169:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.203.12@tcp 00000100:00000040:1.0:1784189364.520492:0:66169:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff9dbf4274f140 refcount 8 to 192.168.203.12@tcp 00000100:00000040:1.0:1784189364.520496:0:66169:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9dbf46434380 x1870854436388352/t0(0) o400->debedd94-805c-42a0-a5e5-41758b2012e9@192.168.203.12@tcp:555/0 lens 224/224 e 0 to 0 dl 1784189375 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784189364.520514:0:66169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf46434380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:debedd94-805c-42a0-a5e5-41758b2012e9+51:2398:x1870854436388352:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 55us (828us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189364.520521:0:66169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1382 00000100:00000040:1.0:1784189364.520523:0:66169:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9dbf47a3b800 : new rpc_count 0 00000020:00000040:1.0:1784189364.520529:0:66169:0:(genops.c:900:class_export_put()) PUTting export ffff9dbf47a3b800 : new refcount 50 00000100:00100000:1.0:1784189364.520538:0:66169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1383 00000100:00000040:1.0:1784189364.520540:0:66169:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9dc04ffb2000 : new rpc_count 1 00000100:00000040:1.0:1784189364.520544:0:66169:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9dc07ab9b800 x1870854436388480/t0(0) o400->debedd94-805c-42a0-a5e5-41758b2012e9@192.168.203.12@tcp:555/0 lens 224/0 e 0 to 0 dl 1784189375 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784189364.520554:0:66169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc07ab9b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:debedd94-805c-42a0-a5e5-41758b2012e9+11:2398:x1870854436388480:12345-192.168.203.12@tcp:400:kworker.0 00010000:00000040:1.0:1784189364.520565:0:66169:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 81604378768, transno 0, xid 1870854436388480 00000100:00000040:1.0:1784189364.520569:0:66169:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9dbf4274f140 refcount 9 to 192.168.203.12@tcp 00000100:00000040:1.0:1784189364.520573:0:66169:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.203.12@tcp 00000100:00000040:1.0:1784189364.520585:0:66169:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff9dbf4274f140 refcount 8 to 192.168.203.12@tcp 00000100:00000040:1.0:1784189364.520589:0:66169:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9dc07ab9b800 x1870854436388480/t0(0) o400->debedd94-805c-42a0-a5e5-41758b2012e9@192.168.203.12@tcp:555/0 lens 224/224 e 0 to 0 dl 1784189375 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784189364.520598:0:66169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc07ab9b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:debedd94-805c-42a0-a5e5-41758b2012e9+11:2398:x1870854436388480:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 45us (789us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189364.520604:0:66169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1383 00000100:00000040:1.0:1784189364.520606:0:66169:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9dc04ffb2000 : new rpc_count 0 00000020:00000040:1.0:1784189364.520611:0:66169:0:(genops.c:900:class_export_put()) PUTting export ffff9dc04ffb2000 : new refcount 10 00000100:00080000:1.0:1784189364.520626:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000020:00000040:1.0:1784189364.520629:0:6509:0:(obd_config.c:1022:class_decref()) Decref lustre-MDT0001 (ffff9dc071094d40) now 10 - evictor 00000100:00080000:1.0:1784189364.520632:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000020:00000040:1.0:1784189364.520634:0:6509:0:(obd_config.c:1022:class_decref()) Decref lustre-MDT0000 (ffff9dc075478000) now 14 - evictor 00000100:00080000:1.0:1784189364.520656:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000020:00000040:1.0:1784189364.520658:0:6509:0:(obd_config.c:1022:class_decref()) Decref lustre-OST0001 (ffff9dbf4312b380) now 10 - evictor 00000020:01000004:3.0:1784189364.766416:0:96879:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1784189364.766421:0:96879:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost1_flakey 00000020:01000004:3.0:1784189364.766422:0:96879:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:3.0:1784189364.766529:0:96879:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff9dc0762e7000 00000020:01000004:3.0:1784189364.766543:0:96879:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0000, type=osd-ldiskfs, lsifl=200002, mountfl=0 00000020:01000004:3.0:1784189364.766558:0:96879:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-ldiskfs) 00000020:00000080:3.0:1784189364.766573:0:96879:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff9dc0719699c0) 00000020:00000040:3.0:1784189364.766581:0:96879:0:(lustre_handles.c:93:class_handle_hash()) added object ffff9dc045665000 with handle 0xcc1762b626f8d533 to hash 00000020:00000040:3.0:1784189364.766587:0:96879:0:(genops.c:900:class_export_put()) PUTting export ffff9dc045665000 : new refcount 1 00000020:00000040:3.0:1784189364.766595:0:96879:0:(obd_config.c:994:class_incref()) incref lustre-OST0000-osd (ffff9dc0719699c0) now 2 - obd_device_list 00000020:00000080:3.0:1784189364.766599:0:96879:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type osd-ldiskfs with refcount 2 00010000:00010000:1.0:1784189364.976301:0:7454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00000040:1.0:1784189365.435563:0:96879:0:(osd_compat.c:233:osd_last_rcvd_subdir_count()) read last_rcvd header, uuid = lustre-OST0000_UUID, subdir count = 32 00100000:10000000:1.0:1784189365.444156:0:96879:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:1.0:1784189365.444375:0:96879:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:1.0:1784189365.444399:0:96879:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:1.0:1784189365.444418:0:96879:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:1.0:1784189365.444438:0:96879:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:1.0:1784189365.444461:0:96879:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:1.0:1784189365.444479:0:96879:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/32) registered 00080000:01000000:1.0:1784189365.446994:0:96879:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0000: register osd-ldiskfs tunable parameters 00000020:00000040:1.0:1784189365.447264:0:96879:0:(obd_config.c:994:class_incref()) incref lustre-OST0000-osd (ffff9dc0719699c0) now 3 - setup 00000020:00000080:1.0:1784189365.447270:0:96879:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:1.0:1784189365.447283:0:96879:0:(osd_handler.c:8929:osd_obd_connect()) connect #0 00000020:00000040:1.0:1784189365.447289:0:96879:0:(lustre_handles.c:93:class_handle_hash()) added object ffff9dbf4726d800 with handle 0xcc1762b626f8d53a to hash 00000020:00000040:1.0:1784189365.447297:0:96879:0:(obd_config.c:994:class_incref()) incref lustre-OST0000-osd (ffff9dc0719699c0) now 4 - export 00000020:00000040:1.0:1784189365.447300:0:96879:0:(genops.c:900:class_export_put()) PUTting export ffff9dbf4726d800 : new refcount 1 00000020:00000080:1.0:1784189365.447302:0:96879:0:(genops.c:1406:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xcc1762b626f8d53a 00000020:00000040:1.0:1784189365.447305:0:96879:0:(genops.c:825:class_conn2export()) looking for export cookie 0xcc1762b626f8d53a 00000020:00000040:1.0:1784189365.447307:0:96879:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9dbf4726d800 refcount=2 00000020:01000004:1.0:1784189365.447312:0:96879:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0000 on device /dev/mapper/ost1_flakey 00000020:01000004:1.0:1784189365.447476:0:96879:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.112@tcp:Set MGC reconnect 1 10000000:01000000:1.0:1784189365.447479:0:96879:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.112@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:1.0:1784189365.447485:0:96879:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0000 00000020:01000004:1.0:1784189365.447511:0:96879:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost1_flakey 10000000:01000000:1.0:1784189365.447514:0:96879:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.112@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000020:00000040:1.0:1784189365.448388:0:96879:0:(genops.c:889:class_export_get()) GET export ffff9dc045665000 refcount=2 00000040:00000040:1.0:1784189365.448393:0:96879:0:(lustre_log.h:387:llog_ctxt_get()) GETting ctxt ffff9dc076067780 : new refcount 2 00000040:00000040:1.0:1784189365.450001:0:96879:0:(lustre_log.h:402:llog_ctxt_put()) PUTting ctxt ffff9dc076067780 : new refcount 1 00000040:01000000:1.0:1784189365.450016:0:96879:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.112@tcp ctxt 0 is initialized 10000000:00000040:1.0:1784189365.450020:0:96879:0:(lustre_log.h:387:llog_ctxt_get()) GETting ctxt ffff9dc076067780 : new refcount 2 10000000:00000040:1.0:1784189365.450022:0:96879:0:(lustre_log.h:402:llog_ctxt_put()) PUTting ctxt ffff9dc076067780 : new refcount 1 00000020:00000040:1.0:1784189365.450025:0:96879:0:(obd_config.c:994:class_incref()) incref MGC192.168.203.112@tcp (ffff9dc06bb30000) now 6 - mgc_fs 00000020:01000004:1.0:1784189365.450054:0:96879:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.203.112@tcp, index=0000, flags=0x20002 00000020:01000004:1.0:1784189365.450059:0:96879:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1784189365.450060:0:96879:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1784189365.450062:0:96879:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1784189365.450063:0:96879:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1784189365.450064:0:96879:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1784189365.450065:0:96879:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1784189365.450067:0:96879:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1784189365.450069:0:96879:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1784189365.450070:0:96879:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1784189365.450074:0:96879:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020002 00000020:01000004:1.0:1784189365.450077:0:96879:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1784189365.450078:0:96879:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1784189365.450079:0:96879:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1784189365.450080:0:96879:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1784189365.450081:0:96879:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1784189365.450082:0:96879:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1784189365.450083:0:96879:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1784189365.450084:0:96879:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1784189365.450085:0:96879:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:00000040:1.0:1784189365.450092:0:96879:0:(genops.c:1231:class_import_get()) import ffff9dc07110c800 refcount=4 obd=MGC192.168.203.112@tcp 10000000:01000000:1.0:1784189365.450112:0:96879:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00000040:1.0:1784189365.450129:0:96879:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff9dc080e7f480 x1870854458270848/t0(0) o253->MGC192.168.203.112@tcp@0@lo:26/25 lens 4848/4768 e 0 to 0 dl 0 ref 2 fl New:QU/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784189365.450142:0:96879:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc080e7f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd553d0d-03e2-4233-b06b-b55bbfa2b954:96879:1870854458270848:0@lo:253:mount.lustre.0 00000100:00000040:1.0:1784189365.450168:0:96879:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff9dc080e7f480 x1870854458270848/t0(0) o253->MGC192.168.203.112@tcp@0@lo:26/25 lens 4848/4768 e 0 to 0 dl 1784189381 ref 3 fl Rpc:r/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1784189365.450176:0:96879:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:1.0:1784189365.450226:0:96879:0:(events.c:337:request_in_callback()) incoming req@ffff9dc080e3bc50 x1870854458270848 msgsize 4848 00000100:00100000:1.0:1784189365.450231:0:96879:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:1.0:1784189365.450238:0:96879:0:(events.c:349:request_in_callback()) Buffer complete: 63 buffers still posted 00000100:00000040:1.0:1784189365.450299:0:96879:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 2 req@ffff9dc080e7f480 x1870854458270848/t0(0) o253->MGC192.168.203.112@tcp@0@lo:26/25 lens 4848/4768 e 0 to 0 dl 1784189381 ref 3 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784189365.450338:0:96879:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dc076067d80 going to sleep for 11 seconds 00000100:00100000:0.0:1784189365.450534:0:94309:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458270848 00000100:00100000:0.0:1784189365.450542:0:94309:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458270848 00000020:00000040:0.0:1784189365.450544:0:94309:0:(genops.c:825:class_conn2export()) looking for export cookie 0xcc1762b626f8c573 00000020:00000040:0.0:1784189365.450549:0:94309:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9dc050ae5000 refcount=21 00000100:00000040:0.0:1784189365.450569:0:94309:0:(service.c:1432:ptlrpc_at_set_timer()) armed mgs at +6s 00000100:00100000:0.0:1784189365.450601:0:94309:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00000040:0.0:1784189365.450606:0:94309:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9dc050ae5000 : new rpc_count 1 00000100:00000040:0.0:1784189365.450612:0:94309:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9dc080e3bc50 x1870854458270848/t0(0) o253->bd553d0d-03e2-4233-b06b-b55bbfa2b954@0@lo:556/0 lens 4848/0 e 0 to 0 dl 1784189376 ref 1 fl New:/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784189365.450623:0:94309:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc080e3bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd553d0d-03e2-4233-b06b-b55bbfa2b954+21:96879:x1870854458270848:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1784189365.450661:0:94309:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:0.0:1784189365.450664:0:94309:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0000 is running on 0@lo 20000000:01000000:0.0:1784189365.450668:0:94309:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00010000:00000040:3.0:1784189365.451127:0:94309:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 0, transno 0, xid 1870854458270848 00000100:00000040:3.0:1784189365.451137:0:94309:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9dc0710a1d00 refcount 52 to 0@lo 00000100:00000040:3.0:1784189365.451141:0:94309:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:3.0:1784189365.451165:0:94309:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=4768 offset=224 replen=4768 req@ffff9dc080e7f480 x1870854458270848/t0(0) o253->MGC192.168.203.112@tcp@0@lo:26/25 lens 4848/4768 e 0 to 0 dl 1784189381 ref 2 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1784189365.451270:0:94309:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff9dc0710a1d00 refcount 51 to 0@lo 00000100:00000040:3.0:1784189365.451282:0:94309:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9dc080e3bc50 x1870854458270848/t0(0) o253->bd553d0d-03e2-4233-b06b-b55bbfa2b954@0@lo:556/0 lens 4848/4768 e 0 to 0 dl 1784189376 ref 1 fl Interpret:/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784189365.451293:0:94309:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc080e3bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd553d0d-03e2-4233-b06b-b55bbfa2b954+21:96879:x1870854458270848:12345-0@lo:253:mount.lustre.0 Request processed in 671us (1065us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189365.451300:0:94309:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00000100:00000040:3.0:1784189365.451303:0:94309:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9dc050ae5000 : new rpc_count 0 00000020:00000040:3.0:1784189365.451312:0:94309:0:(genops.c:900:class_export_put()) PUTting export ffff9dc050ae5000 : new refcount 20 00000100:00000040:1.0:1784189365.451587:0:96879:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff9dc080e7f480 x1870854458270848/t0(0) o253->MGC192.168.203.112@tcp@0@lo:26/25 lens 4848/4768 e 0 to 0 dl 1784189381 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1784189365.451597:0:96879:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9dc080e7f480 x1870854458270848/t0(0) o253->MGC192.168.203.112@tcp@0@lo:26/25 lens 4848/4768 e 0 to 0 dl 1784189381 ref 2 fl Interpret:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784189365.451605:0:96879:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc080e7f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd553d0d-03e2-4233-b06b-b55bbfa2b954:96879:1870854458270848:0@lo:253:mount.lustre.0 00000100:00000040:1.0:1784189365.451613:0:96879:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff9dc080e7f480 x1870854458270848/t0(0) o253->MGC192.168.203.112@tcp@0@lo:26/25 lens 4848/4768 e 0 to 0 dl 1784189381 ref 2 fl Complete:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 10000000:01000000:1.0:1784189365.451624:0:96879:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:1.0:1784189365.451626:0:96879:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1784189365.451627:0:96879:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1784189365.451628:0:96879:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1784189365.451639:0:96879:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1784189365.451640:0:96879:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1784189365.451641:0:96879:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1784189365.451642:0:96879:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1784189365.451644:0:96879:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1784189365.451645:0:96879:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000100:00000040:1.0:1784189365.451648:0:96879:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff9dc080e7f480 x1870854458270848/t0(0) o253->MGC192.168.203.112@tcp@0@lo:26/25 lens 4848/4768 e 0 to 0 dl 1784189381 ref 1 fl Complete:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000020:00000040:1.0:1784189365.451659:0:96879:0:(genops.c:1244:class_import_put()) import ffff9dc07110c800 refcount=3 obd=MGC192.168.203.112@tcp 00000020:01000004:3.0:1784189365.451776:0:96879:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9dc0762e7000 from lustre-OST0000 10000000:01000000:3.0:1784189365.451805:0:96879:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:3.0:1784189365.451808:0:96879:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:00000040:3.0:1784189365.451815:0:96879:0:(mgc_request.c:108:config_log_get()) log lustre-sptlrpc (ffff9dc07154ba00) refs 5 10000000:01000000:3.0:1784189365.451818:0:96879:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9dc06bb30000 local copy 00000020:00000040:3.0:1784189365.451823:0:96879:0:(lustre_handles.c:147:class_handle2object()) GET ldlm ffff9dc0565e6800 refcount=2 00010000:00010000:3.0:1784189365.451830:0:96879:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff9dc0565e6800/0xcc1762b626f8cb5b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc1762b626f8cb62 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00000040:3.0:1784189365.451854:0:96879:0:(lustre_log.h:387:llog_ctxt_get()) GETting ctxt ffff9dc074ac7e40 : new refcount 2 10000000:00000040:3.0:1784189365.451857:0:96879:0:(lustre_log.h:387:llog_ctxt_get()) GETting ctxt ffff9dc076067780 : new refcount 2 10000000:00000040:3.0:1784189365.451860:0:96879:0:(mgc_request_server.c:802:mgc_process_server_cfg_log()) MGC192.168.203.112@tcp: copy local log lustre-sptlrpc 00000020:00000040:3.0:1784189365.451892:0:96879:0:(genops.c:1231:class_import_get()) import ffff9dc07110c800 refcount=4 obd=MGC192.168.203.112@tcp 00000020:00000040:3.0:1784189365.451897:0:96879:0:(genops.c:1231:class_import_get()) import ffff9dc07110c800 refcount=5 obd=MGC192.168.203.112@tcp 00000100:00000040:3.0:1784189365.451916:0:96879:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff9dc071534e00 x1870854458270976/t0(0) o501->MGC192.168.203.112@tcp@0@lo:26/25 lens 512/272 e 0 to 0 dl 0 ref 2 fl New:QU/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784189365.451927:0:96879:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc071534e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd553d0d-03e2-4233-b06b-b55bbfa2b954:96879:1870854458270976:0@lo:501:mount.lustre.0 00000100:00000040:3.0:1784189365.451939:0:96879:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff9dc071534e00 x1870854458270976/t0(0) o501->MGC192.168.203.112@tcp@0@lo:26/25 lens 512/272 e 0 to 0 dl 1784189381 ref 3 fl Rpc:r/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1784189365.451947:0:96879:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:3.0:1784189365.451967:0:96879:0:(events.c:337:request_in_callback()) incoming req@ffff9dc080e38c50 x1870854458270976 msgsize 512 00000100:00100000:3.0:1784189365.451979:0:96879:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:3.0:1784189365.451981:0:96879:0:(events.c:349:request_in_callback()) Buffer complete: 63 buffers still posted 00000100:00000040:3.0:1784189365.452029:0:96879:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 2 req@ffff9dc071534e00 x1870854458270976/t0(0) o501->MGC192.168.203.112@tcp@0@lo:26/25 lens 512/272 e 0 to 0 dl 1784189381 ref 3 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784189365.452049:0:96879:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dc081c57a80 going to sleep for 11 seconds 00000100:00100000:1.0:1784189365.452098:0:94310:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458270976 00000100:00100000:1.0:1784189365.452104:0:94310:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458270976 00000020:00000040:1.0:1784189365.452107:0:94310:0:(genops.c:825:class_conn2export()) looking for export cookie 0xcc1762b626f8c573 00000020:00000040:1.0:1784189365.452110:0:94310:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9dc050ae5000 refcount=21 00000100:00000040:3.0:1784189365.452244:0:94310:0:(service.c:1432:ptlrpc_at_set_timer()) armed mgs at +6s 00000100:00100000:3.0:1784189365.452296:0:94310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 187 00000100:00000040:3.0:1784189365.452300:0:94310:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9dc050ae5000 : new rpc_count 1 00000100:00000040:3.0:1784189365.452306:0:94310:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9dc080e38c50 x1870854458270976/t0(0) o501->bd553d0d-03e2-4233-b06b-b55bbfa2b954@0@lo:556/0 lens 512/0 e 0 to 0 dl 1784189376 ref 1 fl New:/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784189365.452333:0:94310:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc080e38c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd553d0d-03e2-4233-b06b-b55bbfa2b954+21:96879:x1870854458270976:12345-0@lo:501:mount.lustre.0 00000040:00000040:3.0:1784189365.452349:0:94310:0:(llog_server.c:62:llog_origin_handle_open()) MGS: opening log lustre-sptlrpc 00000040:00000040:3.0:1784189365.452352:0:94310:0:(lustre_log.h:387:llog_ctxt_get()) GETting ctxt ffff9dc04811d3c0 : new refcount 2 00000040:00000040:3.0:1784189365.452372:0:94310:0:(lustre_log.h:402:llog_ctxt_put()) PUTting ctxt ffff9dc04811d3c0 : new refcount 1 00010000:00000040:3.0:1784189365.452375:0:94310:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 0, transno 0, xid 1870854458270976 00000100:00000040:3.0:1784189365.452381:0:94310:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9dc0710a1d00 refcount 52 to 0@lo 00000100:00000040:3.0:1784189365.452384:0:94310:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:3.0:1784189365.452410:0:94310:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=272 offset=224 replen=272 req@ffff9dc071534e00 x1870854458270976/t0(0) o501->MGC192.168.203.112@tcp@0@lo:26/25 lens 512/272 e 0 to 0 dl 1784189381 ref 2 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1784189365.452432:0:94310:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff9dc0710a1d00 refcount 51 to 0@lo 00000100:00000040:3.0:1784189365.452437:0:94310:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9dc080e38c50 x1870854458270976/t0(0) o501->bd553d0d-03e2-4233-b06b-b55bbfa2b954@0@lo:556/0 lens 512/272 e 0 to 0 dl 1784189376 ref 1 fl Interpret:/200/0 rc -2/-2 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784189365.452445:0:94310:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc080e38c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd553d0d-03e2-4233-b06b-b55bbfa2b954+21:96879:x1870854458270976:12345-0@lo:501:mount.lustre.0 Request processed in 130us (476us total) trans 0 rc -2/-2 00000100:00100000:3.0:1784189365.452452:0:94310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 187 00000100:00000040:3.0:1784189365.452454:0:94310:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9dc050ae5000 : new rpc_count 0 00000020:00000040:3.0:1784189365.452460:0:94310:0:(genops.c:900:class_export_put()) PUTting export ffff9dc050ae5000 : new refcount 20 00000100:00000040:0.0:1784189365.452521:0:96879:0:(client.c:1497:ptlrpc_check_status()) @@@ check status: rc = -2 req@ffff9dc071534e00 x1870854458270976/t0(0) o501->MGC192.168.203.112@tcp@0@lo:26/25 lens 512/272 e 0 to 0 dl 1784189381 ref 2 fl Rpc:RQU/200/0 rc 0/-2 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1784189365.452530:0:96879:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff9dc071534e00 x1870854458270976/t0(0) o501->MGC192.168.203.112@tcp@0@lo:26/25 lens 512/272 e 0 to 0 dl 1784189381 ref 2 fl Rpc:RQU/200/0 rc -2/-2 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1784189365.452539:0:96879:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9dc071534e00 x1870854458270976/t0(0) o501->MGC192.168.203.112@tcp@0@lo:26/25 lens 512/272 e 0 to 0 dl 1784189381 ref 2 fl Interpret:RQU/200/0 rc -2/-2 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784189365.452547:0:96879:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc071534e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd553d0d-03e2-4233-b06b-b55bbfa2b954:96879:1870854458270976:0@lo:501:mount.lustre.0 00000100:00000040:0.0:1784189365.452552:0:96879:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff9dc071534e00 x1870854458270976/t0(0) o501->MGC192.168.203.112@tcp@0@lo:26/25 lens 512/272 e 0 to 0 dl 1784189381 ref 2 fl Complete:RQU/200/0 rc -2/-2 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000020:00000040:0.0:1784189365.452561:0:96879:0:(genops.c:1244:class_import_put()) import ffff9dc07110c800 refcount=4 obd=MGC192.168.203.112@tcp 00000100:00000040:0.0:1784189365.452564:0:96879:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff9dc071534e00 x1870854458270976/t0(0) o501->MGC192.168.203.112@tcp@0@lo:26/25 lens 512/272 e 0 to 0 dl 1784189381 ref 1 fl Complete:RQU/200/0 rc -2/-2 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000020:00000040:0.0:1784189365.452572:0:96879:0:(genops.c:1244:class_import_put()) import ffff9dc07110c800 refcount=3 obd=MGC192.168.203.112@tcp 10000000:01000000:0.0:1784189365.452579:0:96879:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.112@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:0.0:1784189365.452596:0:96879:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.112@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00000020:00000040:0.0:1784189365.452599:0:96879:0:(lustre_handles.c:147:class_handle2object()) GET ldlm ffff9dc0565e6800 refcount=3 00010000:00010000:0.0:1784189365.452604:0:96879:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff9dc0565e6800/0xcc1762b626f8cb5b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc1762b626f8cb62 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189365.452612:0:96879:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: ffff9dc0565e6800/0xcc1762b626f8cb5b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc1762b626f8cb62 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784189365.452645:0:96879:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9dc0762e7000 10000000:01000000:0.0:1784189365.452650:0:96879:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00000020:00000040:0.0:1784189365.452654:0:96879:0:(genops.c:889:class_export_get()) GET export ffff9dc071108800 refcount=18 10000000:00000040:0.0:1784189365.452657:0:96879:0:(mgc_request.c:108:config_log_get()) log nodemap (ffff9dc07a8c2a00) refs 4 10000000:01000000:0.0:1784189365.452659:0:96879:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:0.0:1784189365.452668:0:96879:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 00000020:00000040:0.0:1784189365.452670:0:96879:0:(genops.c:889:class_export_get()) GET export ffff9dc071108800 refcount=19 10000000:01000000:0.0:1784189365.452674:0:96879:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:0.0:1784189365.452676:0:96879:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00000020:00000040:0.0:1784189365.452681:0:96879:0:(genops.c:1231:class_import_get()) import ffff9dc07110c800 refcount=4 obd=MGC192.168.203.112@tcp 00010000:00000040:0.0:1784189365.452694:0:96879:0:(ldlm_resource.c:1656:ldlm_resource_getref()) getref res: ffff9dc07fab4800 count: 8 00000020:00000040:0.0:1784189365.452702:0:96879:0:(lustre_handles.c:93:class_handle_hash()) added object ffff9dc070146800 with handle 0xcc1762b626f8d541 to hash 00010000:00010000:0.0:1784189365.452709:0:96879:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff9dc070146800/0xcc1762b626f8d541 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 96879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189365.452715:0:96879:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: ffff9dc070146800/0xcc1762b626f8d541 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 96879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189365.452737:0:96879:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: ffff9dc070146800/0xcc1762b626f8d541 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 96879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00000040:0.0:1784189365.452751:0:96879:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff9dc05edd1880 x1870854458271104/t0(0) o101->MGC192.168.203.112@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 0 ref 2 fl New:QU/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784189365.452759:0:96879:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc05edd1880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd553d0d-03e2-4233-b06b-b55bbfa2b954:96879:1870854458271104:0@lo:101:mount.lustre.0 00000100:00000040:0.0:1784189365.452784:0:96879:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff9dc05edd1880 x1870854458271104/t0(0) o101->MGC192.168.203.112@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1784189381 ref 3 fl Rpc:r/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1784189365.452790:0:96879:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1784189365.452808:0:96879:0:(events.c:337:request_in_callback()) incoming req@ffff9dc080e3b850 x1870854458271104 msgsize 328 00000100:00100000:0.0:1784189365.452812:0:96879:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:0.0:1784189365.452814:0:96879:0:(events.c:349:request_in_callback()) Buffer complete: 63 buffers still posted 00000100:00000040:0.0:1784189365.453126:0:96879:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 2 req@ffff9dc05edd1880 x1870854458271104/t0(0) o101->MGC192.168.203.112@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1784189381 ref 3 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784189365.453145:0:96879:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dbf45865b40 going to sleep for 11 seconds 00000100:00100000:1.0:1784189365.453228:0:94308:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458271104 00000100:00100000:1.0:1784189365.453234:0:94308:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458271104 00000020:00000040:1.0:1784189365.453237:0:94308:0:(genops.c:825:class_conn2export()) looking for export cookie 0xcc1762b626f8c573 00000020:00000040:1.0:1784189365.453247:0:94308:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9dc050ae5000 refcount=21 00000100:00000040:1.0:1784189365.453260:0:94308:0:(service.c:1432:ptlrpc_at_set_timer()) armed mgs at +6s 00000100:00100000:1.0:1784189365.453337:0:94308:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 188 00000100:00000040:1.0:1784189365.453341:0:94308:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9dc050ae5000 : new rpc_count 1 00000100:00000040:1.0:1784189365.453345:0:94308:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9dc080e3b850 x1870854458271104/t0(0) o101->bd553d0d-03e2-4233-b06b-b55bbfa2b954@0@lo:556/0 lens 328/0 e 0 to 0 dl 1784189376 ref 1 fl New:/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784189365.453356:0:94308:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc080e3b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd553d0d-03e2-4233-b06b-b55bbfa2b954+21:96879:x1870854458271104:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1784189365.453365:0:94308:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00000040:1.0:1784189365.453372:0:94308:0:(ldlm_resource.c:1656:ldlm_resource_getref()) getref res: ffff9dc049188100 count: 10 00000020:00000040:1.0:1784189365.453376:0:94308:0:(lustre_handles.c:93:class_handle_hash()) added object ffff9dc07116e400 with handle 0xcc1762b626f8d548 to hash 00010000:00010000:1.0:1784189365.453381:0:94308:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dc07116e400/0xcc1762b626f8d548 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xcc1762b626f8d541 expref: -99 pid: 94308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:1.0:1784189365.453388:0:94308:0:(ldlm_lockd.c:1373:ldlm_handle_enqueue()) lock GETting export ffff9dc050ae5000 : new locks_count 16 00000020:00000040:1.0:1784189365.453390:0:94308:0:(genops.c:889:class_export_get()) GET export ffff9dc050ae5000 refcount=22 00010000:00000040:1.0:1784189365.453682:0:94308:0:(ldlm_resource.c:1876:ldlm_resource_dump()) --- Resource: [0x65727473756c:0x0:0x0].0x0 (ffff9dc049188100) refcount = 10 00010000:00000040:1.0:1784189365.453686:0:94308:0:(ldlm_resource.c:1879:ldlm_resource_dump()) Granted locks (in reverse order): 00010000:00000040:1.0:1784189365.453692:0:94308:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGS lock: ffff9dc081b16600/0xcc1762b626f8cb70 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c4112 expref: 9 pid: 94309 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:1.0:1784189365.453699:0:94308:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGS lock: ffff9dc042d66e00/0xcc1762b626f8cb69 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c410b expref: 9 pid: 94310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:1.0:1784189365.453706:0:94308:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGS lock: ffff9dc0565e7800/0xcc1762b626f8cb62 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcc1762b626f8cb5b expref: 22 pid: 94308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:1.0:1784189365.453713:0:94308:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGS lock: ffff9dc0565e6600/0xcc1762b626f8cb38 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcc1762b626f8cb31 expref: 22 pid: 94314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:1.0:1784189365.453728:0:94308:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGS lock: ffff9dc058f66600/0xcc1762b626f8cb2a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcc1762b626f8cb23 expref: 22 pid: 94308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:1.0:1784189365.453742:0:94308:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGS lock: ffff9dc058f66c00/0xcc1762b626f8cb1c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcc1762b626f8cb15 expref: 22 pid: 94308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:1.0:1784189365.453749:0:94308:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGS lock: ffff9dc081b16a00/0xcc1762b626f8cb0e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcc1762b626f8cb07 expref: 22 pid: 94308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:1.0:1784189365.453755:0:94308:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGS lock: ffff9dc058f67e00/0xcc1762b626f8cb00 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcc1762b626f8caf9 expref: 22 pid: 94309 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:1.0:1784189365.453762:0:94308:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGS lock: ffff9dc042d67400/0xcc1762b626f8caf2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcc1762b626f8caeb expref: 22 pid: 94314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189365.453768:0:94308:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dc07116e400/0xcc1762b626f8d548 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcc1762b626f8d541 expref: 22 pid: 94308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189365.453779:0:94308:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dc07116e400/0xcc1762b626f8d548 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcc1762b626f8d541 expref: 22 pid: 94308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189365.453787:0:94308:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc07116e400, rc 0) 00010000:00000040:1.0:1784189365.453789:0:94308:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 0, transno 0, xid 1870854458271104 00000100:00000040:1.0:1784189365.453795:0:94308:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9dc0710a1d00 refcount 52 to 0@lo 00000100:00000040:1.0:1784189365.453799:0:94308:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:1.0:1784189365.453822:0:94308:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=344 offset=224 replen=344 req@ffff9dc05edd1880 x1870854458271104/t0(0) o101->MGC192.168.203.112@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1784189381 ref 2 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1784189365.453842:0:94308:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff9dc0710a1d00 refcount 51 to 0@lo 00000100:00000040:1.0:1784189365.453846:0:94308:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9dc080e3b850 x1870854458271104/t0(0) o101->bd553d0d-03e2-4233-b06b-b55bbfa2b954@0@lo:556/0 lens 328/344 e 0 to 0 dl 1784189376 ref 1 fl Interpret:/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784189365.453855:0:94308:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc080e3b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd553d0d-03e2-4233-b06b-b55bbfa2b954+22:96879:x1870854458271104:12345-0@lo:101:mount.lustre.0 Request processed in 500us (1045us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189365.453870:0:94308:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 188 00000100:00000040:1.0:1784189365.453872:0:94308:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9dc050ae5000 : new rpc_count 0 00000020:00000040:1.0:1784189365.453882:0:94308:0:(genops.c:900:class_export_put()) PUTting export ffff9dc050ae5000 : new refcount 21 00000100:00000040:0.0:1784189365.454068:0:96879:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff9dc05edd1880 x1870854458271104/t0(0) o101->MGC192.168.203.112@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1784189381 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1784189365.454089:0:96879:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9dc05edd1880 x1870854458271104/t0(0) o101->MGC192.168.203.112@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1784189381 ref 2 fl Interpret:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784189365.454097:0:96879:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc05edd1880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd553d0d-03e2-4233-b06b-b55bbfa2b954:96879:1870854458271104:0@lo:101:mount.lustre.0 00000100:00000040:0.0:1784189365.454103:0:96879:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff9dc05edd1880 x1870854458271104/t0(0) o101->MGC192.168.203.112@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1784189381 ref 2 fl Complete:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000020:00000040:0.0:1784189365.454113:0:96879:0:(lustre_handles.c:147:class_handle2object()) GET ldlm ffff9dc070146800 refcount=4 00010000:00000040:0.0:1784189365.454117:0:96879:0:(ldlm_request.c:746:ldlm_cli_enqueue_fini()) local: ffff9dc070146800, remote cookie: 0xcc1762b626f8d548, flags: 0x0 00010000:00000040:0.0:1784189365.454122:0:96879:0:(ldlm_resource.c:1876:ldlm_resource_dump()) --- Resource: [0x65727473756c:0x0:0x0].0x0 (ffff9dc07fab4800) refcount = 8 00010000:00000040:0.0:1784189365.454124:0:96879:0:(ldlm_resource.c:1879:ldlm_resource_dump()) Granted locks (in reverse order): 00010000:00000040:0.0:1784189365.454127:0:96879:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGC192.168.203.112@tcp lock: ffff9dc0565e6800/0xcc1762b626f8cb5b lrc: 1/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0xcc1762b626f8cb62 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:0.0:1784189365.454135:0:96879:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGC192.168.203.112@tcp lock: ffff9dc0565e7c00/0xcc1762b626f8cb31 lrc: 1/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0xcc1762b626f8cb38 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:0.0:1784189365.454141:0:96879:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGC192.168.203.112@tcp lock: ffff9dc0565e7600/0xcc1762b626f8cb23 lrc: 1/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0xcc1762b626f8cb2a expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:0.0:1784189365.454147:0:96879:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGC192.168.203.112@tcp lock: ffff9dc081b16200/0xcc1762b626f8cb15 lrc: 1/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0xcc1762b626f8cb1c expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:0.0:1784189365.454153:0:96879:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGC192.168.203.112@tcp lock: ffff9dc0565e7e00/0xcc1762b626f8cb07 lrc: 1/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0xcc1762b626f8cb0e expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:0.0:1784189365.454159:0:96879:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGC192.168.203.112@tcp lock: ffff9dc081b17600/0xcc1762b626f8caf9 lrc: 1/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0xcc1762b626f8cb00 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:0.0:1784189365.454165:0:96879:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGC192.168.203.112@tcp lock: ffff9dc081b16c00/0xcc1762b626f8caeb lrc: 1/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0xcc1762b626f8caf2 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189365.454175:0:96879:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: ffff9dc070146800/0xcc1762b626f8d541 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc1762b626f8d548 expref: -99 pid: 96879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189365.454194:0:96879:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: ffff9dc070146800/0xcc1762b626f8d541 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0xcc1762b626f8d548 expref: -99 pid: 96879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00000040:0.0:1784189365.454203:0:96879:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff9dc05edd1880 x1870854458271104/t0(0) o101->MGC192.168.203.112@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1784189381 ref 1 fl Complete:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000020:00000040:0.0:1784189365.454212:0:96879:0:(genops.c:1244:class_import_put()) import ffff9dc07110c800 refcount=3 obd=MGC192.168.203.112@tcp 10000000:00000040:0.0:1784189365.454218:0:96879:0:(mgc_request.c:108:config_log_get()) log lustre-OST0000 (ffff9dc076341200) refs 2 00000020:00000040:0.0:1784189365.454221:0:96879:0:(lustre_handles.c:147:class_handle2object()) GET ldlm ffff9dc070146800 refcount=3 10000000:00000040:0.0:1784189365.454243:0:96879:0:(lustre_log.h:387:llog_ctxt_get()) GETting ctxt ffff9dc074ac7e40 : new refcount 2 10000000:00000040:0.0:1784189365.454247:0:96879:0:(lustre_log.h:387:llog_ctxt_get()) GETting ctxt ffff9dc076067780 : new refcount 2 10000000:00000040:0.0:1784189365.454250:0:96879:0:(mgc_request_server.c:802:mgc_process_server_cfg_log()) MGC192.168.203.112@tcp: copy local log lustre-OST0000 00000040:00080000:0.0:1784189365.454421:0:96879:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:0.0:1784189365.454706:0:96879:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1784189365.456622:0:96879:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:0.0:1784189365.456682:0:96879:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:0.0:1784189365.456698:0:96879:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:0.0:1784189365.456710:0:96879:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:0.0:1784189365.456894:0:96879:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:0.0:1784189365.456915:0:96879:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:0.0:1784189365.456936:0:96879:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:0.0:1784189365.456941:0:96879:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000020:00000040:0.0:1784189365.457002:0:96879:0:(genops.c:1231:class_import_get()) import ffff9dc07110c800 refcount=4 obd=MGC192.168.203.112@tcp 00000020:00000040:0.0:1784189365.457009:0:96879:0:(genops.c:1231:class_import_get()) import ffff9dc07110c800 refcount=5 obd=MGC192.168.203.112@tcp 00000100:00000040:0.0:1784189365.457045:0:96879:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff9dc05edd1880 x1870854458271232/t0(0) o501->MGC192.168.203.112@tcp@0@lo:26/25 lens 512/272 e 0 to 0 dl 0 ref 2 fl New:QU/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784189365.457057:0:96879:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc05edd1880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd553d0d-03e2-4233-b06b-b55bbfa2b954:96879:1870854458271232:0@lo:501:mount.lustre.0 00000100:00000040:0.0:1784189365.457089:0:96879:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff9dc05edd1880 x1870854458271232/t0(0) o501->MGC192.168.203.112@tcp@0@lo:26/25 lens 512/272 e 0 to 0 dl 1784189381 ref 3 fl Rpc:r/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1784189365.457097:0:96879:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1784189365.457132:0:96879:0:(events.c:337:request_in_callback()) incoming req@ffff9dc07fa60050 x1870854458271232 msgsize 512 00000100:00100000:0.0:1784189365.457136:0:96879:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:0.0:1784189365.457138:0:96879:0:(events.c:349:request_in_callback()) Buffer complete: 63 buffers still posted 00000100:00000040:0.0:1784189365.457160:0:96879:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 2 req@ffff9dc05edd1880 x1870854458271232/t0(0) o501->MGC192.168.203.112@tcp@0@lo:26/25 lens 512/272 e 0 to 0 dl 1784189381 ref 3 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784189365.457201:0:94309:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458271232 00000100:00100000:0.0:1784189365.457208:0:94309:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458271232 00000020:00000040:0.0:1784189365.457210:0:94309:0:(genops.c:825:class_conn2export()) looking for export cookie 0xcc1762b626f8c573 00000020:00000040:0.0:1784189365.457214:0:94309:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9dc050ae5000 refcount=22 00000100:00000040:0.0:1784189365.457232:0:94309:0:(service.c:1432:ptlrpc_at_set_timer()) armed mgs at +6s 00000100:00100000:0.0:1784189365.457252:0:94309:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 189 00000100:00000040:0.0:1784189365.457256:0:94309:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9dc050ae5000 : new rpc_count 1 00000100:00000040:0.0:1784189365.457262:0:94309:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9dc07fa60050 x1870854458271232/t0(0) o501->bd553d0d-03e2-4233-b06b-b55bbfa2b954@0@lo:556/0 lens 512/0 e 0 to 0 dl 1784189376 ref 1 fl New:/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784189365.457274:0:94309:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc07fa60050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd553d0d-03e2-4233-b06b-b55bbfa2b954+22:96879:x1870854458271232:12345-0@lo:501:mount.lustre.0 00000040:00000040:0.0:1784189365.457292:0:94309:0:(llog_server.c:62:llog_origin_handle_open()) MGS: opening log lustre-OST0000 00000040:00000040:0.0:1784189365.457296:0:94309:0:(lustre_log.h:387:llog_ctxt_get()) GETting ctxt ffff9dc04811d3c0 : new refcount 2 00000040:00000040:0.0:1784189365.457365:0:94309:0:(lustre_log.h:402:llog_ctxt_put()) PUTting ctxt ffff9dc04811d3c0 : new refcount 1 00000020:00000040:0.0:1784189365.457374:0:94309:0:(genops.c:889:class_export_get()) GET export ffff9dc050ae5000 refcount=23 00000020:00000040:0.0:1784189365.457377:0:94309:0:(genops.c:900:class_export_put()) PUTting export ffff9dc050ae5000 : new refcount 22 00010000:00000040:0.0:1784189365.457382:0:94309:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 0, transno 0, xid 1870854458271232 00000100:00000040:0.0:1784189365.457390:0:94309:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9dc0710a1d00 refcount 52 to 0@lo 00000100:00000040:0.0:1784189365.457483:0:94309:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1784189365.457500:0:94309:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=272 offset=224 replen=272 req@ffff9dc05edd1880 x1870854458271232/t0(0) o501->MGC192.168.203.112@tcp@0@lo:26/25 lens 512/272 e 0 to 0 dl 1784189381 ref 2 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1784189365.457513:0:94309:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff9dc0710a1d00 refcount 51 to 0@lo 00000100:00000040:0.0:1784189365.457523:0:94309:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9dc07fa60050 x1870854458271232/t0(0) o501->bd553d0d-03e2-4233-b06b-b55bbfa2b954@0@lo:556/0 lens 512/272 e 0 to 0 dl 1784189376 ref 1 fl Interpret:/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784189365.457532:0:94309:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc07fa60050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd553d0d-03e2-4233-b06b-b55bbfa2b954+22:96879:x1870854458271232:12345-0@lo:501:mount.lustre.0 Request processed in 260us (399us total) trans 0 rc 0/0 00000100:00100000:0.0:1784189365.457539:0:94309:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 189 00000100:00000040:0.0:1784189365.457542:0:94309:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9dc050ae5000 : new rpc_count 0 00000020:00000040:0.0:1784189365.457549:0:94309:0:(genops.c:900:class_export_put()) PUTting export ffff9dc050ae5000 : new refcount 21 00000100:00100000:0.0:1784189365.457580:0:96879:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dbf45865900 going to sleep for 11 seconds 00000100:00000040:0.0:1784189365.457599:0:96879:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff9dc05edd1880 x1870854458271232/t0(0) o501->MGC192.168.203.112@tcp@0@lo:26/25 lens 512/272 e 0 to 0 dl 1784189381 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1784189365.457609:0:96879:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9dc05edd1880 x1870854458271232/t0(0) o501->MGC192.168.203.112@tcp@0@lo:26/25 lens 512/272 e 0 to 0 dl 1784189381 ref 2 fl Interpret:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784189365.457617:0:96879:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc05edd1880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd553d0d-03e2-4233-b06b-b55bbfa2b954:96879:1870854458271232:0@lo:501:mount.lustre.0 00000100:00000040:0.0:1784189365.457624:0:96879:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff9dc05edd1880 x1870854458271232/t0(0) o501->MGC192.168.203.112@tcp@0@lo:26/25 lens 512/272 e 0 to 0 dl 1784189381 ref 2 fl Complete:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000020:00000040:0.0:1784189365.457641:0:96879:0:(genops.c:1244:class_import_put()) import ffff9dc07110c800 refcount=4 obd=MGC192.168.203.112@tcp 00000100:00000040:0.0:1784189365.457645:0:96879:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff9dc05edd1880 x1870854458271232/t0(0) o501->MGC192.168.203.112@tcp@0@lo:26/25 lens 512/272 e 0 to 0 dl 1784189381 ref 1 fl Complete:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000020:00000040:0.0:1784189365.457653:0:96879:0:(genops.c:1244:class_import_put()) import ffff9dc07110c800 refcount=3 obd=MGC192.168.203.112@tcp 00000020:00000040:0.0:1784189365.457662:0:96879:0:(genops.c:1231:class_import_get()) import ffff9dc07110c800 refcount=4 obd=MGC192.168.203.112@tcp 00000020:00000040:0.0:1784189365.457665:0:96879:0:(genops.c:1231:class_import_get()) import ffff9dc07110c800 refcount=5 obd=MGC192.168.203.112@tcp 00000100:00000040:0.0:1784189365.457676:0:96879:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff9dc05edd1880 x1870854458271360/t0(0) o503->MGC192.168.203.112@tcp@0@lo:26/25 lens 272/8416 e 0 to 0 dl 0 ref 2 fl New:QU/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784189365.457685:0:96879:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc05edd1880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd553d0d-03e2-4233-b06b-b55bbfa2b954:96879:1870854458271360:0@lo:503:mount.lustre.0 00000100:00000040:0.0:1784189365.457706:0:96879:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff9dc05edd1880 x1870854458271360/t0(0) o503->MGC192.168.203.112@tcp@0@lo:26/25 lens 272/8416 e 0 to 0 dl 1784189381 ref 3 fl Rpc:r/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1784189365.457789:0:96879:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1784189365.457806:0:96879:0:(events.c:337:request_in_callback()) incoming req@ffff9dc07fa61050 x1870854458271360 msgsize 272 00000100:00100000:0.0:1784189365.457810:0:96879:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:0.0:1784189365.457812:0:96879:0:(events.c:349:request_in_callback()) Buffer complete: 63 buffers still posted 00000100:00000040:0.0:1784189365.457824:0:96879:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 2 req@ffff9dc05edd1880 x1870854458271360/t0(0) o503->MGC192.168.203.112@tcp@0@lo:26/25 lens 272/8416 e 0 to 0 dl 1784189381 ref 3 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784189365.457840:0:94309:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458271360 00000100:00100000:0.0:1784189365.457843:0:94309:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458271360 00000020:00000040:0.0:1784189365.457845:0:94309:0:(genops.c:825:class_conn2export()) looking for export cookie 0xcc1762b626f8c573 00000020:00000040:0.0:1784189365.457847:0:94309:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9dc050ae5000 refcount=22 00000100:00000040:0.0:1784189365.457856:0:94309:0:(service.c:1432:ptlrpc_at_set_timer()) armed mgs at +6s 00000100:00100000:0.0:1784189365.457865:0:94309:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 190 00000100:00000040:0.0:1784189365.457868:0:94309:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9dc050ae5000 : new rpc_count 1 00000100:00000040:0.0:1784189365.457872:0:94309:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9dc07fa61050 x1870854458271360/t0(0) o503->bd553d0d-03e2-4233-b06b-b55bbfa2b954@0@lo:556/0 lens 272/0 e 0 to 0 dl 1784189376 ref 1 fl New:/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784189365.457882:0:94309:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc07fa61050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd553d0d-03e2-4233-b06b-b55bbfa2b954+22:96879:x1870854458271360:12345-0@lo:503:mount.lustre.0 00000040:00000040:0.0:1784189365.457901:0:94309:0:(lustre_log.h:387:llog_ctxt_get()) GETting ctxt ffff9dc04811d3c0 : new refcount 2 00000040:00000040:0.0:1784189365.457927:0:94309:0:(lustre_log.h:402:llog_ctxt_put()) PUTting ctxt ffff9dc04811d3c0 : new refcount 1 00010000:00000040:0.0:1784189365.457930:0:94309:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 0, transno 0, xid 1870854458271360 00000100:00000040:0.0:1784189365.457935:0:94309:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9dc0710a1d00 refcount 52 to 0@lo 00000100:00000040:0.0:1784189365.457938:0:94309:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1784189365.457954:0:94309:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=8416 offset=224 replen=8416 req@ffff9dc05edd1880 x1870854458271360/t0(0) o503->MGC192.168.203.112@tcp@0@lo:26/25 lens 272/8416 e 0 to 0 dl 1784189381 ref 2 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1784189365.457965:0:94309:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff9dc0710a1d00 refcount 51 to 0@lo 00000100:00000040:0.0:1784189365.457969:0:94309:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9dc07fa61050 x1870854458271360/t0(0) o503->bd553d0d-03e2-4233-b06b-b55bbfa2b954@0@lo:556/0 lens 272/8416 e 0 to 0 dl 1784189376 ref 1 fl Interpret:/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784189365.457976:0:94309:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc07fa61050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd553d0d-03e2-4233-b06b-b55bbfa2b954+22:96879:x1870854458271360:12345-0@lo:503:mount.lustre.0 Request processed in 95us (168us total) trans 0 rc 0/0 00000100:00100000:0.0:1784189365.457991:0:94309:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 190 00000100:00000040:0.0:1784189365.457994:0:94309:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9dc050ae5000 : new rpc_count 0 00000020:00000040:0.0:1784189365.458000:0:94309:0:(genops.c:900:class_export_put()) PUTting export ffff9dc050ae5000 : new refcount 21 00000100:00100000:0.0:1784189365.458025:0:96879:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dbf45865900 going to sleep for 11 seconds 00000100:00000040:0.0:1784189365.458038:0:96879:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff9dc05edd1880 x1870854458271360/t0(0) o503->MGC192.168.203.112@tcp@0@lo:26/25 lens 272/8416 e 0 to 0 dl 1784189381 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1784189365.458046:0:96879:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9dc05edd1880 x1870854458271360/t0(0) o503->MGC192.168.203.112@tcp@0@lo:26/25 lens 272/8416 e 0 to 0 dl 1784189381 ref 2 fl Interpret:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784189365.458052:0:96879:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc05edd1880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd553d0d-03e2-4233-b06b-b55bbfa2b954:96879:1870854458271360:0@lo:503:mount.lustre.0 00000100:00000040:0.0:1784189365.458058:0:96879:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff9dc05edd1880 x1870854458271360/t0(0) o503->MGC192.168.203.112@tcp@0@lo:26/25 lens 272/8416 e 0 to 0 dl 1784189381 ref 2 fl Complete:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1784189365.458068:0:96879:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff9dc05edd1880 x1870854458271360/t0(0) o503->MGC192.168.203.112@tcp@0@lo:26/25 lens 272/8416 e 0 to 0 dl 1784189381 ref 1 fl Complete:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000020:00000040:0.0:1784189365.458082:0:96879:0:(genops.c:1244:class_import_put()) import ffff9dc07110c800 refcount=4 obd=MGC192.168.203.112@tcp 00000020:00000040:0.0:1784189365.458087:0:96879:0:(genops.c:1244:class_import_put()) import ffff9dc07110c800 refcount=3 obd=MGC192.168.203.112@tcp 00000040:00080000:0.0:1784189365.458693:0:96879:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000020:00000040:0.0:1784189365.458799:0:96879:0:(genops.c:1231:class_import_get()) import ffff9dc07110c800 refcount=4 obd=MGC192.168.203.112@tcp 00000020:00000040:0.0:1784189365.458804:0:96879:0:(genops.c:1231:class_import_get()) import ffff9dc07110c800 refcount=5 obd=MGC192.168.203.112@tcp 00000100:00000040:0.0:1784189365.458822:0:96879:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff9dc05edd1880 x1870854458271488/t0(0) o502->MGC192.168.203.112@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 0 ref 2 fl New:QU/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784189365.458830:0:96879:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc05edd1880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd553d0d-03e2-4233-b06b-b55bbfa2b954:96879:1870854458271488:0@lo:502:mount.lustre.0 00000100:00000040:0.0:1784189365.458854:0:96879:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff9dc05edd1880 x1870854458271488/t0(0) o502->MGC192.168.203.112@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1784189381 ref 3 fl Rpc:r/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1784189365.458861:0:96879:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1784189365.458881:0:96879:0:(events.c:337:request_in_callback()) incoming req@ffff9dc07fa63c50 x1870854458271488 msgsize 272 00000100:00100000:0.0:1784189365.458890:0:96879:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:0.0:1784189365.458891:0:96879:0:(events.c:349:request_in_callback()) Buffer complete: 63 buffers still posted 00000100:00000040:0.0:1784189365.458949:0:96879:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 2 req@ffff9dc05edd1880 x1870854458271488/t0(0) o502->MGC192.168.203.112@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1784189381 ref 3 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784189365.458967:0:96879:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dbf45865b40 going to sleep for 11 seconds 00000100:00100000:3.0:1784189365.459048:0:94310:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458271488 00000100:00100000:3.0:1784189365.459059:0:94310:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458271488 00000020:00000040:3.0:1784189365.459061:0:94310:0:(genops.c:825:class_conn2export()) looking for export cookie 0xcc1762b626f8c573 00000020:00000040:3.0:1784189365.459065:0:94310:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9dc050ae5000 refcount=22 00000100:00000040:3.0:1784189365.459079:0:94310:0:(service.c:1432:ptlrpc_at_set_timer()) armed mgs at +6s 00000100:00100000:3.0:1784189365.459100:0:94310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 191 00000100:00000040:3.0:1784189365.459103:0:94310:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9dc050ae5000 : new rpc_count 1 00000100:00000040:3.0:1784189365.459108:0:94310:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9dc07fa63c50 x1870854458271488/t0(0) o502->bd553d0d-03e2-4233-b06b-b55bbfa2b954@0@lo:556/0 lens 272/0 e 0 to 0 dl 1784189376 ref 1 fl New:/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784189365.459117:0:94310:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc07fa63c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd553d0d-03e2-4233-b06b-b55bbfa2b954+22:96879:x1870854458271488:12345-0@lo:502:mount.lustre.0 00000040:00000040:3.0:1784189365.459140:0:94310:0:(lustre_log.h:387:llog_ctxt_get()) GETting ctxt ffff9dc04811d3c0 : new refcount 2 00000040:00000040:3.0:1784189365.459590:0:94310:0:(lustre_log.h:402:llog_ctxt_put()) PUTting ctxt ffff9dc04811d3c0 : new refcount 1 00010000:00000040:3.0:1784189365.459595:0:94310:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 0, transno 0, xid 1870854458271488 00000100:00000040:3.0:1784189365.459602:0:94310:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9dc0710a1d00 refcount 52 to 0@lo 00000100:00000040:3.0:1784189365.459607:0:94310:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:3.0:1784189365.459641:0:94310:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=8472 offset=224 replen=8472 req@ffff9dc05edd1880 x1870854458271488/t0(0) o502->MGC192.168.203.112@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1784189381 ref 2 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1784189365.459659:0:94310:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff9dc0710a1d00 refcount 51 to 0@lo 00000100:00000040:3.0:1784189365.459664:0:94310:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9dc07fa63c50 x1870854458271488/t0(0) o502->bd553d0d-03e2-4233-b06b-b55bbfa2b954@0@lo:556/0 lens 272/8472 e 0 to 0 dl 1784189376 ref 1 fl Interpret:/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784189365.459672:0:94310:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc07fa63c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd553d0d-03e2-4233-b06b-b55bbfa2b954+22:96879:x1870854458271488:12345-0@lo:502:mount.lustre.0 Request processed in 556us (789us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189365.459679:0:94310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 191 00000100:00000040:3.0:1784189365.459682:0:94310:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9dc050ae5000 : new rpc_count 0 00000020:00000040:3.0:1784189365.459689:0:94310:0:(genops.c:900:class_export_put()) PUTting export ffff9dc050ae5000 : new refcount 21 00000100:00000040:0.0:1784189365.459922:0:96879:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff9dc05edd1880 x1870854458271488/t0(0) o502->MGC192.168.203.112@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1784189381 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1784189365.459932:0:96879:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9dc05edd1880 x1870854458271488/t0(0) o502->MGC192.168.203.112@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1784189381 ref 2 fl Interpret:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784189365.459939:0:96879:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc05edd1880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd553d0d-03e2-4233-b06b-b55bbfa2b954:96879:1870854458271488:0@lo:502:mount.lustre.0 00000100:00000040:0.0:1784189365.459947:0:96879:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff9dc05edd1880 x1870854458271488/t0(0) o502->MGC192.168.203.112@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1784189381 ref 2 fl Complete:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1784189365.459958:0:96879:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff9dc05edd1880 x1870854458271488/t0(0) o502->MGC192.168.203.112@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1784189381 ref 1 fl Complete:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000020:00000040:0.0:1784189365.459971:0:96879:0:(genops.c:1244:class_import_put()) import ffff9dc07110c800 refcount=4 obd=MGC192.168.203.112@tcp 00000020:00000040:0.0:1784189365.459977:0:96879:0:(genops.c:1244:class_import_put()) import ffff9dc07110c800 refcount=3 obd=MGC192.168.203.112@tcp 00000040:00080000:0.0:1784189365.460157:0:96879:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:0.0:1784189365.460198:0:96879:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:0.0:1784189365.460217:0:96879:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:0.0:1784189365.460231:0:96879:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:0.0:1784189365.460245:0:96879:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:0.0:1784189365.460257:0:96879:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:0.0:1784189365.460271:0:96879:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:0.0:1784189365.460285:0:96879:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:0.0:1784189365.460299:0:96879:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 80 off9712 00000040:00080000:0.0:1784189365.460312:0:96879:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9936 00000040:00080000:0.0:1784189365.460344:0:96879:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].11, 224 off10160 00000040:00080000:0.0:1784189365.460359:0:96879:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].12, 120 off10280 00000020:00000040:0.0:1784189365.460365:0:96879:0:(genops.c:1231:class_import_get()) import ffff9dc07110c800 refcount=4 obd=MGC192.168.203.112@tcp 00000020:00000040:0.0:1784189365.460375:0:96879:0:(genops.c:1231:class_import_get()) import ffff9dc07110c800 refcount=5 obd=MGC192.168.203.112@tcp 00000100:00000040:0.0:1784189365.460395:0:96879:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff9dc05edd1880 x1870854458271616/t0(0) o502->MGC192.168.203.112@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 0 ref 2 fl New:QU/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784189365.460515:0:96879:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc05edd1880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd553d0d-03e2-4233-b06b-b55bbfa2b954:96879:1870854458271616:0@lo:502:mount.lustre.0 00000100:00000040:0.0:1784189365.460538:0:96879:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff9dc05edd1880 x1870854458271616/t0(0) o502->MGC192.168.203.112@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1784189381 ref 3 fl Rpc:r/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1784189365.460545:0:96879:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1784189365.460565:0:96879:0:(events.c:337:request_in_callback()) incoming req@ffff9dc044984c50 x1870854458271616 msgsize 272 00000100:00100000:0.0:1784189365.460569:0:96879:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:0.0:1784189365.460571:0:96879:0:(events.c:349:request_in_callback()) Buffer complete: 63 buffers still posted 00000100:00000040:0.0:1784189365.460582:0:96879:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 2 req@ffff9dc05edd1880 x1870854458271616/t0(0) o502->MGC192.168.203.112@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1784189381 ref 3 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784189365.460602:0:96879:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dbf45865b40 going to sleep for 11 seconds 00000100:00100000:2.0:1784189365.460667:0:94314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458271616 00000100:00100000:2.0:1784189365.460673:0:94314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458271616 00000020:00000040:2.0:1784189365.460676:0:94314:0:(genops.c:825:class_conn2export()) looking for export cookie 0xcc1762b626f8c573 00000020:00000040:2.0:1784189365.460680:0:94314:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9dc050ae5000 refcount=22 00000100:00000040:2.0:1784189365.460696:0:94314:0:(service.c:1432:ptlrpc_at_set_timer()) armed mgs at +6s 00000100:00100000:2.0:1784189365.460712:0:94314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 192 00000100:00000040:2.0:1784189365.460715:0:94314:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9dc050ae5000 : new rpc_count 1 00000100:00000040:2.0:1784189365.460786:0:94314:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9dc044984c50 x1870854458271616/t0(0) o502->bd553d0d-03e2-4233-b06b-b55bbfa2b954@0@lo:556/0 lens 272/0 e 0 to 0 dl 1784189376 ref 1 fl New:/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784189365.460804:0:94314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc044984c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:bd553d0d-03e2-4233-b06b-b55bbfa2b954+22:96879:x1870854458271616:12345-0@lo:502:mount.lustre.0 00000040:00000040:2.0:1784189365.460823:0:94314:0:(lustre_log.h:387:llog_ctxt_get()) GETting ctxt ffff9dc04811d3c0 : new refcount 2 00000040:00000040:2.0:1784189365.460863:0:94314:0:(lustre_log.h:402:llog_ctxt_put()) PUTting ctxt ffff9dc04811d3c0 : new refcount 1 00010000:00000040:2.0:1784189365.460867:0:94314:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 0, transno 0, xid 1870854458271616 00000100:00000040:2.0:1784189365.460874:0:94314:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9dc0710a1d00 refcount 52 to 0@lo 00000100:00000040:2.0:1784189365.460878:0:94314:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1784189365.460897:0:94314:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=8472 offset=224 replen=8472 req@ffff9dc05edd1880 x1870854458271616/t0(0) o502->MGC192.168.203.112@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1784189381 ref 2 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1784189365.460924:0:94314:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff9dc0710a1d00 refcount 51 to 0@lo 00000100:00000040:2.0:1784189365.460928:0:94314:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9dc044984c50 x1870854458271616/t0(0) o502->bd553d0d-03e2-4233-b06b-b55bbfa2b954@0@lo:556/0 lens 272/8472 e 0 to 0 dl 1784189376 ref 1 fl Interpret:/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784189365.460935:0:94314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc044984c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:bd553d0d-03e2-4233-b06b-b55bbfa2b954+22:96879:x1870854458271616:12345-0@lo:502:mount.lustre.0 Request processed in 134us (369us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189365.460941:0:94314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 192 00000100:00000040:2.0:1784189365.460943:0:94314:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9dc050ae5000 : new rpc_count 0 00000020:00000040:2.0:1784189365.460951:0:94314:0:(genops.c:900:class_export_put()) PUTting export ffff9dc050ae5000 : new refcount 21 00000100:00000040:0.0:1784189365.461082:0:96879:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff9dc05edd1880 x1870854458271616/t0(0) o502->MGC192.168.203.112@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1784189381 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1784189365.461091:0:96879:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9dc05edd1880 x1870854458271616/t0(0) o502->MGC192.168.203.112@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1784189381 ref 2 fl Interpret:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784189365.461098:0:96879:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc05edd1880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd553d0d-03e2-4233-b06b-b55bbfa2b954:96879:1870854458271616:0@lo:502:mount.lustre.0 00000100:00000040:0.0:1784189365.461104:0:96879:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff9dc05edd1880 x1870854458271616/t0(0) o502->MGC192.168.203.112@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1784189381 ref 2 fl Complete:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1784189365.461114:0:96879:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff9dc05edd1880 x1870854458271616/t0(0) o502->MGC192.168.203.112@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1784189381 ref 1 fl Complete:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000020:00000040:0.0:1784189365.461126:0:96879:0:(genops.c:1244:class_import_put()) import ffff9dc07110c800 refcount=4 obd=MGC192.168.203.112@tcp 00000020:00000040:0.0:1784189365.461131:0:96879:0:(genops.c:1244:class_import_put()) import ffff9dc07110c800 refcount=3 obd=MGC192.168.203.112@tcp 00000040:00080000:0.0:1784189365.461157:0:96879:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].13, 224 off10504 00000040:00080000:0.0:1784189365.461165:0:96879:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 13 count 14 10000000:00000040:0.0:1784189365.461570:0:96879:0:(lustre_log.h:402:llog_ctxt_put()) PUTting ctxt ffff9dc074ac7e40 : new refcount 1 00000020:00000040:0.0:1784189365.461580:0:96879:0:(obd_config.c:2122:class_config_parse_llog()) looking up llog lustre-OST0000 00000020:01000000:2.0:1784189365.462022:0:96883:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1784189365.462029:0:96883:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/ost1_flakey 00000020:00000080:2.0:1784189365.462035:0:96883:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784189365.462037:0:96883:0:(obd_config.c:1561:class_process_config()) marker 21 (0x1) lustre-OST0000 add ost 00000020:00000080:2.0:1784189365.462042:0:96883:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1784189365.462056:0:96883:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff9dc07a7a0000) 00000020:00000040:2.0:1784189365.462062:0:96883:0:(lustre_handles.c:93:class_handle_hash()) added object ffff9dbf44673000 with handle 0xcc1762b626f8d54f to hash 00000020:00000040:2.0:1784189365.462069:0:96883:0:(genops.c:900:class_export_put()) PUTting export ffff9dbf44673000 : new refcount 1 00000020:00000040:2.0:1784189365.462084:0:96883:0:(obd_config.c:994:class_incref()) incref lustre-OST0000 (ffff9dc07a7a0000) now 2 - obd_device_list 00000020:00000080:2.0:1784189365.462090:0:96883:0:(obd_config.c:720:class_attach_name()) OBD: dev 18 attached type obdfilter with refcount 2 00000020:00000040:2.0:1784189365.462094:0:96883:0:(obd_config.c:1948:class_config_llog_handler()) For 1.8 interoperability, set this index to '0' 00000020:00000080:2.0:1784189365.462103:0:96883:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1784189365.462168:0:96883:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9dc0762e7000 from lustre-OST0000, refs=2 00080000:01000000:2.0:1784189365.462176:0:96883:0:(osd_handler.c:8929:osd_obd_connect()) connect #1 00000020:00000040:2.0:1784189365.462180:0:96883:0:(lustre_handles.c:93:class_handle_hash()) added object ffff9dbf46b0c000 with handle 0xcc1762b626f8d556 to hash 00000020:00000040:2.0:1784189365.462249:0:96883:0:(obd_config.c:994:class_incref()) incref lustre-OST0000-osd (ffff9dc0719699c0) now 5 - export 00000020:00000040:2.0:1784189365.462252:0:96883:0:(genops.c:900:class_export_put()) PUTting export ffff9dbf46b0c000 : new refcount 1 00000020:00000080:2.0:1784189365.462254:0:96883:0:(genops.c:1406:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xcc1762b626f8d556 00000020:00000040:2.0:1784189365.462256:0:96883:0:(genops.c:825:class_conn2export()) looking for export cookie 0xcc1762b626f8d556 00000020:00000040:2.0:1784189365.462259:0:96883:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9dbf46b0c000 refcount=2 00010000:00010000:2.0:1784189365.468104:0:96883:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-4 is initialized 00000001:00000040:2.0:1784189365.468115:0:96883:0:(obd_cksum.c:33:obd_cksum_types_supported_server()) lustre-OST0000: checksum speed: crc 573, crc32c 3390, adler 553, t10ip512 2519, t10ip4k 3047, t10crc512 551, t10crc4k 629 00002000:00000040:2.0:1784189365.468159:0:96883:0:(ofd_dev.c:430:ofd_object_init()) object init, fid = [0x200000001:0xb:0x0] 00000001:00000040:2.0:1784189365.470574:0:96883:0:(tgt_lastrcvd.c:685:tgt_server_data_read()) lustre-OST0000: read last_rcvd server data for UUID = lustre-OST0000_UUID, last_transno = 4294968955: rc = 0 00000001:00000040:2.0:1784189365.470585:0:96883:0:(tgt_lastrcvd.c:1991:tgt_server_data_init()) lustre-OST0000: restored maximum client count: 0 00000001:00000040:2.0:1784189365.470594:0:96883:0:(tgt_lastrcvd.c:525:tgt_client_data_read()) lustre-OST0000: read lcd @8320 uuid = lustre-MDT0001-mdtlov_UUID, last_transno = 4294968955, last_xid = 1870854458179456, last_result = 0, last_data = 0, last_close_transno = 0, last_close_xid = 0, last_close_result = 0, rc = 0 00000001:00080000:2.0:1784189365.470598:0:96883:0:(tgt_lastrcvd.c:1748:tgt_clients_data_init()) RCVRNG CLIENT uuid: lustre-MDT0001-mdtlov_UUID idx: 0 lr: 4294968955 srv lr: 4294968955 lx: 1870854458179456 gen 0 00000020:00000040:2.0:1784189365.470608:0:96883:0:(lustre_handles.c:93:class_handle_hash()) added object ffff9dbf46d3b800 with handle 0xcc1762b626f8d55d to hash 00000020:00000040:2.0:1784189365.470639:0:96883:0:(genops.c:889:class_export_get()) GET export ffff9dbf46d3b800 refcount=3 00000020:00000040:2.0:1784189365.470644:0:96883:0:(obd_config.c:994:class_incref()) incref lustre-OST0000 (ffff9dc07a7a0000) now 3 - export 00000001:00000040:2.0:1784189365.470648:0:96883:0:(tgt_lastrcvd.c:1172:tgt_client_add()) lustre-OST0000: client at idx 0 with UUID 'lustre-MDT0001-mdtlov_UUID' added, generation 0 00000020:00000040:2.0:1784189365.470651:0:96883:0:(genops.c:900:class_export_put()) PUTting export ffff9dbf46d3b800 : new refcount 2 00000001:00000040:2.0:1784189365.470657:0:96883:0:(tgt_lastrcvd.c:525:tgt_client_data_read()) lustre-OST0000: read lcd @8448 uuid = lustre-MDT0000-mdtlov_UUID, last_transno = 4294968973, last_xid = 1870854458258048, last_result = 0, last_data = 0, last_close_transno = 0, last_close_xid = 0, last_close_result = 0, rc = 0 00000001:00080000:2.0:1784189365.470661:0:96883:0:(tgt_lastrcvd.c:1748:tgt_clients_data_init()) RCVRNG CLIENT uuid: lustre-MDT0000-mdtlov_UUID idx: 1 lr: 4294968973 srv lr: 4294968955 lx: 1870854458258048 gen 0 00000020:00000040:2.0:1784189365.470666:0:96883:0:(lustre_handles.c:93:class_handle_hash()) added object ffff9dbf46d39800 with handle 0xcc1762b626f8d564 to hash 00000020:00000040:2.0:1784189365.470678:0:96883:0:(genops.c:889:class_export_get()) GET export ffff9dbf46d39800 refcount=3 00000020:00000040:2.0:1784189365.470681:0:96883:0:(obd_config.c:994:class_incref()) incref lustre-OST0000 (ffff9dc07a7a0000) now 4 - export 00000001:00000040:2.0:1784189365.470696:0:96883:0:(tgt_lastrcvd.c:1172:tgt_client_add()) lustre-OST0000: client at idx 1 with UUID 'lustre-MDT0000-mdtlov_UUID' added, generation 0 00000020:00000040:2.0:1784189365.470699:0:96883:0:(genops.c:900:class_export_put()) PUTting export ffff9dbf46d39800 : new refcount 2 00000001:00000040:2.0:1784189365.470704:0:96883:0:(tgt_lastrcvd.c:525:tgt_client_data_read()) lustre-OST0000: read lcd @8576 uuid = debedd94-805c-42a0-a5e5-41758b2012e9, last_transno = 4294968977, last_xid = 1870854436354816, last_result = 0, last_data = 0, last_close_transno = 0, last_close_xid = 0, last_close_result = 0, rc = 0 00000001:00080000:2.0:1784189365.470708:0:96883:0:(tgt_lastrcvd.c:1748:tgt_clients_data_init()) RCVRNG CLIENT uuid: debedd94-805c-42a0-a5e5-41758b2012e9 idx: 2 lr: 4294968977 srv lr: 4294968955 lx: 1870854436354816 gen 0 00000020:00000040:2.0:1784189365.470713:0:96883:0:(lustre_handles.c:93:class_handle_hash()) added object ffff9dbf4512b000 with handle 0xcc1762b626f8d56b to hash 00000020:00000040:2.0:1784189365.470794:0:96883:0:(genops.c:889:class_export_get()) GET export ffff9dbf4512b000 refcount=3 00000020:00000040:2.0:1784189365.470797:0:96883:0:(obd_config.c:994:class_incref()) incref lustre-OST0000 (ffff9dc07a7a0000) now 5 - export 00000001:00000040:2.0:1784189365.470800:0:96883:0:(tgt_lastrcvd.c:1172:tgt_client_add()) lustre-OST0000: client at idx 2 with UUID 'debedd94-805c-42a0-a5e5-41758b2012e9' added, generation 0 00000020:00000040:2.0:1784189365.470802:0:96883:0:(genops.c:900:class_export_put()) PUTting export ffff9dbf4512b000 : new refcount 2 00000001:00000040:2.0:1784189365.470807:0:96883:0:(tgt_lastrcvd.c:525:tgt_client_data_read()) lustre-OST0000: read lcd @8704 uuid = , last_transno = 0, last_xid = 0, last_result = 0, last_data = 0, last_close_transno = 0, last_close_xid = 0, last_close_result = 0, rc = 0 00000001:00000040:2.0:1784189365.470810:0:96883:0:(tgt_lastrcvd.c:1736:tgt_clients_data_init()) skipping zeroed client at offset 3 00000001:00000004:2.0:1784189365.470814:0:96883:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 4294968977 00000001:00000040:2.0:1784189365.470856:0:96883:0:(tgt_lastrcvd.c:707:tgt_server_data_write()) lustre-OST0000: write last_rcvd server data for UUID = lustre-OST0000_UUID, last_transno = 4294968977: rc = 0 00000001:00000040:2.0:1784189365.470870:0:96883:0:(tgt_lastrcvd.c:761:tgt_server_data_update()) lustre-OST0000: update last_rcvd server data for UUID = lustre-OST0000_UUID, last_transno = 4294968977: rc = 0 00002000:00000040:2.0:1784189365.470888:0:96883:0:(ofd_dev.c:430:ofd_object_init()) object init, fid = [0x200000001:0x5:0x0] 40000000:00000040:2.0:1784189365.470935:0:96883:0:(fid_store.c:167:seq_store_read()) srv-lustre-OST0000: Space - [0x0000000280000402-0x00000002c0000400]:0:ost 40000000:00000040:2.0:1784189365.470997:0:96883:0:(fid_handler.c:58:seq_server_set_cli()) srv-lustre-OST0000: Attached sequence controller cli-lustre-OST0000-super 80000000:00000040:2.0:1784189365.471005:0:96883:0:(fld_cache.c:66:fld_cache_init()) srv-lustre-OST0000: FLD cache - Size: 74898, Threshold: 7489 00002000:00000040:2.0:1784189365.471011:0:96883:0:(ofd_dev.c:430:ofd_object_init()) object init, fid = [0x200000001:0x3:0x0] 80000000:00000040:2.0:1784189365.471054:0:96883:0:(fld_cache.c:417:fld_cache_insert_nolock()) insert range [0x0000000280000400-0x00000002c0000400]:0:ost 80000000:00000040:2.0:1784189365.471062:0:96883:0:(fld_handler.c:101:fld_name_to_index()) get index from srv-lustre-OST0000 00002000:00000040:2.0:1784189365.471103:0:96883:0:(ofd_dev.c:430:ofd_object_init()) object init, fid = [0x200000001:0x1018:0x0] 00002000:00000040:2.0:1784189365.471121:0:96883:0:(ofd_dev.c:430:ofd_object_init()) object init, fid = [0x200000001:0x101e:0x0] 00002000:00000040:2.0:1784189365.471161:0:96883:0:(ofd_dev.c:430:ofd_object_init()) object init, fid = [0x200000001:0xd:0x0] 00000001:00000040:2.0:1784189365.471842:0:96883:0:(nodemap_storage.c:303:nodemap_cache_find_create()) removing old index, creating new one 00002000:00000040:2.0:1784189365.471874:0:96883:0:(ofd_dev.c:430:ofd_object_init()) object init, fid = [0x200000003:0x2:0x0] 00002000:00000040:2.0:1784189365.472088:0:96883:0:(ofd_dev.c:466:ofd_object_free()) object free, fid = [0x200000003:0x2:0x0] 00080000:10000000:2.0:1784189365.472569:0:96883:0:(osd_handler.c:5579:osd_index_try()) lustre-OST0000: index object [0x200000003:0xa:0x0] (8/32) registered 00000020:00000040:2.0:1784189365.473847:0:96883:0:(obd_config.c:994:class_incref()) incref lustre-OST0000 (ffff9dc07a7a0000) now 6 - setup 00000020:00000080:2.0:1784189365.473852:0:96883:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:2.0:1784189365.473862:0:96883:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1784189365.473868:0:96883:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784189365.473870:0:96883:0:(obd_config.c:1561:class_process_config()) marker 21 (0x2) lustre-OST0000 add ost 00000020:01000000:2.0:1784189365.473873:0:96883:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1784189365.473875:0:96883:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #28 00000020:01000000:2.0:1784189365.473877:0:96883:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1784189365.473878:0:96883:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1784189365.473879:0:96883:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1784189365.473881:0:96883:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784189365.473882:0:96883:0:(obd_config.c:1561:class_process_config()) marker 28 (0x6) lustre sys.timeout 00000020:01000000:2.0:1784189365.473885:0:96883:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1784189365.473887:0:96883:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784189365.473889:0:96883:0:(obd_config.c:1561:class_process_config()) marker 37 (0x1) lustre sys.timeout 00000020:00000080:2.0:1784189365.473892:0:96883:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1784189365.473893:0:96883:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1784189365.473895:0:96883:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1784189365.473898:0:96883:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784189365.473899:0:96883:0:(obd_config.c:1561:class_process_config()) marker 37 (0x2) lustre sys.timeout 00000020:01000000:2.0:1784189365.473901:0:96883:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1784189365.473903:0:96883:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784189365.473904:0:96883:0:(obd_config.c:1561:class_process_config()) marker 42 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1784189365.473907:0:96883:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000020:01000000:2.0:1784189365.473935:0:96883:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1784189365.473938:0:96883:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784189365.473940:0:96883:0:(obd_config.c:1561:class_process_config()) marker 42 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1784189365.473943:0:96883:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 14 count 14 00000020:01000000:0.0:1784189365.476516:0:96879:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-13 (rc=0) 10000000:01000000:0.0:1784189365.476639:0:96879:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00000020:00000040:0.0:1784189365.476660:0:96879:0:(lustre_handles.c:147:class_handle2object()) GET ldlm ffff9dc070146800 refcount=3 00010000:00010000:0.0:1784189365.476668:0:96879:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff9dc070146800/0xcc1762b626f8d541 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc1762b626f8d548 expref: -99 pid: 96879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189365.476679:0:96879:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: ffff9dc070146800/0xcc1762b626f8d541 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc1762b626f8d548 expref: -99 pid: 96879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784189365.476688:0:96879:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9dc0762e7000 from 1 10000000:01000000:0.0:1784189365.476691:0:96879:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00000020:00000040:0.0:1784189365.476762:0:96879:0:(genops.c:1231:class_import_get()) import ffff9dc07110c800 refcount=4 obd=MGC192.168.203.112@tcp 00010000:00000040:0.0:1784189365.476783:0:96879:0:(ldlm_resource.c:1656:ldlm_resource_getref()) getref res: ffff9dc041408000 count: 4 00000020:00000040:0.0:1784189365.476791:0:96879:0:(lustre_handles.c:93:class_handle_hash()) added object ffff9dc070147200 with handle 0xcc1762b626f8d572 to hash 00010000:00010000:0.0:1784189365.476798:0:96879:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff9dc070147200/0xcc1762b626f8d572 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 96879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189365.476807:0:96879:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: ffff9dc070147200/0xcc1762b626f8d572 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 96879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189365.476818:0:96879:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: ffff9dc070147200/0xcc1762b626f8d572 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 96879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00000040:0.0:1784189365.476839:0:96879:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff9dc05edd1880 x1870854458271744/t0(0) o101->MGC192.168.203.112@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 0 ref 2 fl New:QU/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784189365.476853:0:96879:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc05edd1880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd553d0d-03e2-4233-b06b-b55bbfa2b954:96879:1870854458271744:0@lo:101:mount.lustre.0 00000100:00000040:0.0:1784189365.476879:0:96879:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff9dc05edd1880 x1870854458271744/t0(0) o101->MGC192.168.203.112@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1784189381 ref 3 fl Rpc:r/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1784189365.476887:0:96879:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1784189365.476930:0:96879:0:(events.c:337:request_in_callback()) incoming req@ffff9dc044986450 x1870854458271744 msgsize 328 00000100:00100000:0.0:1784189365.476935:0:96879:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:0.0:1784189365.476937:0:96879:0:(events.c:349:request_in_callback()) Buffer complete: 63 buffers still posted 00000100:00000040:0.0:1784189365.476954:0:96879:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 2 req@ffff9dc05edd1880 x1870854458271744/t0(0) o101->MGC192.168.203.112@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1784189381 ref 3 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784189365.476981:0:96879:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dbf45865b40 going to sleep for 11 seconds 00000100:00100000:3.0:1784189365.478213:0:94314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458271744 00000100:00100000:3.0:1784189365.478223:0:94314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458271744 00000020:00000040:3.0:1784189365.478227:0:94314:0:(genops.c:825:class_conn2export()) looking for export cookie 0xcc1762b626f8c573 00000020:00000040:3.0:1784189365.478232:0:94314:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9dc050ae5000 refcount=22 00000100:00000040:3.0:1784189365.478257:0:94314:0:(service.c:1432:ptlrpc_at_set_timer()) armed mgs at +6s 00000100:00100000:3.0:1784189365.478296:0:94314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 193 00000100:00000040:3.0:1784189365.478301:0:94314:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9dc050ae5000 : new rpc_count 1 00000100:00000040:3.0:1784189365.478308:0:94314:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9dc044986450 x1870854458271744/t0(0) o101->bd553d0d-03e2-4233-b06b-b55bbfa2b954@0@lo:556/0 lens 328/0 e 0 to 0 dl 1784189376 ref 1 fl New:/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784189365.478342:0:94314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc044986450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:bd553d0d-03e2-4233-b06b-b55bbfa2b954+22:96879:x1870854458271744:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1784189365.478359:0:94314:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00000040:3.0:1784189365.478370:0:94314:0:(ldlm_resource.c:1656:ldlm_resource_getref()) getref res: ffff9dc07b032b00 count: 5 00000020:00000040:3.0:1784189365.478377:0:94314:0:(lustre_handles.c:93:class_handle_hash()) added object ffff9dc0755a5a00 with handle 0xcc1762b626f8d579 to hash 00010000:00010000:3.0:1784189365.478381:0:94314:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dc0755a5a00/0xcc1762b626f8d579 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xcc1762b626f8d572 expref: -99 pid: 94314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:3.0:1784189365.478389:0:94314:0:(ldlm_lockd.c:1373:ldlm_handle_enqueue()) lock GETting export ffff9dc050ae5000 : new locks_count 17 00000020:00000040:3.0:1784189365.478391:0:94314:0:(genops.c:889:class_export_get()) GET export ffff9dc050ae5000 refcount=23 00010000:00000040:3.0:1784189365.478555:0:94314:0:(ldlm_resource.c:1876:ldlm_resource_dump()) --- Resource: [0x736d61726170:0x3:0x0].0x0 (ffff9dc07b032b00) refcount = 5 00010000:00000040:3.0:1784189365.478560:0:94314:0:(ldlm_resource.c:1879:ldlm_resource_dump()) Granted locks (in reverse order): 00010000:00000040:3.0:1784189365.478566:0:94314:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGS lock: ffff9dc058f66400/0xcc1762b626f8c76b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c40a9 expref: 9 pid: 94308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:3.0:1784189365.478577:0:94314:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGS lock: ffff9dc058f66e00/0xcc1762b626f8c709 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcc1762b626f8c702 expref: 23 pid: 94308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:3.0:1784189365.478585:0:94314:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGS lock: ffff9dc04a20be00/0xcc1762b626f8c6df lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcc1762b626f8c6d8 expref: 23 pid: 94309 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:3.0:1784189365.478592:0:94314:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGS lock: ffff9dc04a20b600/0xcc1762b626f8c668 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcc1762b626f8c661 expref: 23 pid: 94309 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189365.478600:0:94314:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dc0755a5a00/0xcc1762b626f8d579 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcc1762b626f8d572 expref: 23 pid: 94314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189365.478611:0:94314:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dc0755a5a00/0xcc1762b626f8d579 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcc1762b626f8d572 expref: 23 pid: 94314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189365.478626:0:94314:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc0755a5a00, rc 0) 00010000:00000040:3.0:1784189365.478637:0:94314:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 0, transno 0, xid 1870854458271744 00000100:00000040:3.0:1784189365.478646:0:94314:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9dc0710a1d00 refcount 52 to 0@lo 00000100:00000040:3.0:1784189365.478652:0:94314:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:3.0:1784189365.478687:0:94314:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=344 offset=224 replen=344 req@ffff9dc05edd1880 x1870854458271744/t0(0) o101->MGC192.168.203.112@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1784189381 ref 2 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1784189365.478717:0:94314:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff9dc0710a1d00 refcount 51 to 0@lo 00000100:00000040:3.0:1784189365.478827:0:94314:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9dc044986450 x1870854458271744/t0(0) o101->bd553d0d-03e2-4233-b06b-b55bbfa2b954@0@lo:556/0 lens 328/344 e 0 to 0 dl 1784189376 ref 1 fl Interpret:/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784189365.478836:0:94314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc044986450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:bd553d0d-03e2-4233-b06b-b55bbfa2b954+23:96879:x1870854458271744:12345-0@lo:101:mount.lustre.0 Request processed in 517us (1904us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189365.478842:0:94314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 193 00000100:00000040:3.0:1784189365.478846:0:94314:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9dc050ae5000 : new rpc_count 0 00000020:00000040:3.0:1784189365.478856:0:94314:0:(genops.c:900:class_export_put()) PUTting export ffff9dc050ae5000 : new refcount 22 00000100:00000040:2.0:1784189365.478951:0:96879:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff9dc05edd1880 x1870854458271744/t0(0) o101->MGC192.168.203.112@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1784189381 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1784189365.478962:0:96879:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9dc05edd1880 x1870854458271744/t0(0) o101->MGC192.168.203.112@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1784189381 ref 2 fl Interpret:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784189365.478980:0:96879:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc05edd1880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd553d0d-03e2-4233-b06b-b55bbfa2b954:96879:1870854458271744:0@lo:101:mount.lustre.0 00000100:00000040:2.0:1784189365.478988:0:96879:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff9dc05edd1880 x1870854458271744/t0(0) o101->MGC192.168.203.112@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1784189381 ref 2 fl Complete:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000020:00000040:2.0:1784189365.478998:0:96879:0:(lustre_handles.c:147:class_handle2object()) GET ldlm ffff9dc070147200 refcount=4 00010000:00000040:2.0:1784189365.479004:0:96879:0:(ldlm_request.c:746:ldlm_cli_enqueue_fini()) local: ffff9dc070147200, remote cookie: 0xcc1762b626f8d579, flags: 0x0 00010000:00000040:2.0:1784189365.479010:0:96879:0:(ldlm_resource.c:1876:ldlm_resource_dump()) --- Resource: [0x736d61726170:0x3:0x0].0x0 (ffff9dc041408000) refcount = 4 00010000:00000040:2.0:1784189365.479012:0:96879:0:(ldlm_resource.c:1879:ldlm_resource_dump()) Granted locks (in reverse order): 00010000:00000040:2.0:1784189365.479015:0:96879:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGC192.168.203.112@tcp lock: ffff9dbf4710fa00/0xcc1762b626f8c702 lrc: 1/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xcc1762b626f8c709 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:2.0:1784189365.479022:0:96879:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGC192.168.203.112@tcp lock: ffff9dc058f67800/0xcc1762b626f8c6d8 lrc: 1/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xcc1762b626f8c6df expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:2.0:1784189365.479028:0:96879:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGC192.168.203.112@tcp lock: ffff9dc058f67000/0xcc1762b626f8c661 lrc: 1/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xcc1762b626f8c668 expref: -99 pid: 94303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189365.479034:0:96879:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: ffff9dc070147200/0xcc1762b626f8d572 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc1762b626f8d579 expref: -99 pid: 96879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189365.479041:0:96879:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: ffff9dc070147200/0xcc1762b626f8d572 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xcc1762b626f8d579 expref: -99 pid: 96879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00000040:2.0:1784189365.479049:0:96879:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff9dc05edd1880 x1870854458271744/t0(0) o101->MGC192.168.203.112@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1784189381 ref 1 fl Complete:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000020:00000040:2.0:1784189365.479059:0:96879:0:(genops.c:1244:class_import_put()) import ffff9dc07110c800 refcount=3 obd=MGC192.168.203.112@tcp 10000000:00000040:2.0:1784189365.479068:0:96879:0:(mgc_request.c:108:config_log_get()) log params (ffff9dc076340e00) refs 2 00000020:00000040:2.0:1784189365.479070:0:96879:0:(lustre_handles.c:147:class_handle2object()) GET ldlm ffff9dc070147200 refcount=3 10000000:00000040:2.0:1784189365.479100:0:96879:0:(lustre_log.h:387:llog_ctxt_get()) GETting ctxt ffff9dc074ac7e40 : new refcount 2 10000000:00000040:2.0:1784189365.479108:0:96879:0:(lustre_log.h:387:llog_ctxt_get()) GETting ctxt ffff9dc076067780 : new refcount 2 10000000:00000040:2.0:1784189365.479111:0:96879:0:(mgc_request_server.c:802:mgc_process_server_cfg_log()) MGC192.168.203.112@tcp: copy local log params 00000040:00080000:2.0:1784189365.479277:0:96879:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:2.0:1784189365.479656:0:96879:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1784189365.479935:0:96879:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:2.0:1784189365.479959:0:96879:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:2.0:1784189365.479975:0:96879:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:2.0:1784189365.479979:0:96879:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000020:00000040:2.0:1784189365.480013:0:96879:0:(genops.c:1231:class_import_get()) import ffff9dc07110c800 refcount=4 obd=MGC192.168.203.112@tcp 00000020:00000040:2.0:1784189365.480018:0:96879:0:(genops.c:1231:class_import_get()) import ffff9dc07110c800 refcount=5 obd=MGC192.168.203.112@tcp 00000100:00000040:2.0:1784189365.480046:0:96879:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff9dc07130d880 x1870854458271872/t0(0) o501->MGC192.168.203.112@tcp@0@lo:26/25 lens 504/272 e 0 to 0 dl 0 ref 2 fl New:QU/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784189365.480056:0:96879:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc07130d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd553d0d-03e2-4233-b06b-b55bbfa2b954:96879:1870854458271872:0@lo:501:mount.lustre.0 00000100:00000040:2.0:1784189365.480076:0:96879:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff9dc07130d880 x1870854458271872/t0(0) o501->MGC192.168.203.112@tcp@0@lo:26/25 lens 504/272 e 0 to 0 dl 1784189381 ref 3 fl Rpc:r/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1784189365.480083:0:96879:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1784189365.480110:0:96879:0:(events.c:337:request_in_callback()) incoming req@ffff9dc044985c50 x1870854458271872 msgsize 504 00000100:00100000:2.0:1784189365.480114:0:96879:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:2.0:1784189365.480116:0:96879:0:(events.c:349:request_in_callback()) Buffer complete: 63 buffers still posted 00000100:00000040:2.0:1784189365.480143:0:96879:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 2 req@ffff9dc07130d880 x1870854458271872/t0(0) o501->MGC192.168.203.112@tcp@0@lo:26/25 lens 504/272 e 0 to 0 dl 1784189381 ref 3 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784189365.480166:0:96879:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dc080ea93c0 going to sleep for 11 seconds 00000100:00100000:2.0:1784189365.480706:0:94308:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458271872 00000100:00100000:2.0:1784189365.480713:0:94308:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458271872 00000020:00000040:2.0:1784189365.480715:0:94308:0:(genops.c:825:class_conn2export()) looking for export cookie 0xcc1762b626f8c573 00000020:00000040:2.0:1784189365.480815:0:94308:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9dc050ae5000 refcount=23 00000100:00000040:2.0:1784189365.480836:0:94308:0:(service.c:1432:ptlrpc_at_set_timer()) armed mgs at +6s 00000100:00100000:2.0:1784189365.480889:0:94308:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 194 00000100:00000040:2.0:1784189365.480893:0:94308:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9dc050ae5000 : new rpc_count 1 00000100:00000040:2.0:1784189365.480897:0:94308:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9dc044985c50 x1870854458271872/t0(0) o501->bd553d0d-03e2-4233-b06b-b55bbfa2b954@0@lo:556/0 lens 504/0 e 0 to 0 dl 1784189376 ref 1 fl New:/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784189365.480918:0:94308:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc044985c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd553d0d-03e2-4233-b06b-b55bbfa2b954+23:96879:x1870854458271872:12345-0@lo:501:mount.lustre.0 00000040:00000040:2.0:1784189365.480935:0:94308:0:(llog_server.c:62:llog_origin_handle_open()) MGS: opening log params 00000040:00000040:2.0:1784189365.480939:0:94308:0:(lustre_log.h:387:llog_ctxt_get()) GETting ctxt ffff9dc04811d3c0 : new refcount 2 00000040:00000040:2.0:1784189365.480982:0:94308:0:(lustre_log.h:402:llog_ctxt_put()) PUTting ctxt ffff9dc04811d3c0 : new refcount 1 00010000:00000040:2.0:1784189365.480987:0:94308:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 0, transno 0, xid 1870854458271872 00000100:00000040:2.0:1784189365.480995:0:94308:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9dc0710a1d00 refcount 52 to 0@lo 00000100:00000040:2.0:1784189365.480999:0:94308:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1784189365.481022:0:94308:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=272 offset=224 replen=272 req@ffff9dc07130d880 x1870854458271872/t0(0) o501->MGC192.168.203.112@tcp@0@lo:26/25 lens 504/272 e 0 to 0 dl 1784189381 ref 2 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1784189365.481048:0:94308:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff9dc0710a1d00 refcount 51 to 0@lo 00000100:00000040:2.0:1784189365.481053:0:94308:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9dc044985c50 x1870854458271872/t0(0) o501->bd553d0d-03e2-4233-b06b-b55bbfa2b954@0@lo:556/0 lens 504/272 e 0 to 0 dl 1784189376 ref 1 fl Interpret:/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784189365.481061:0:94308:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc044985c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd553d0d-03e2-4233-b06b-b55bbfa2b954+23:96879:x1870854458271872:12345-0@lo:501:mount.lustre.0 Request processed in 146us (949us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189365.481068:0:94308:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 194 00000100:00000040:2.0:1784189365.481072:0:94308:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9dc050ae5000 : new rpc_count 0 00000020:00000040:2.0:1784189365.481082:0:94308:0:(genops.c:900:class_export_put()) PUTting export ffff9dc050ae5000 : new refcount 22 00000100:00000040:3.0:1784189365.481160:0:96879:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff9dc07130d880 x1870854458271872/t0(0) o501->MGC192.168.203.112@tcp@0@lo:26/25 lens 504/272 e 0 to 0 dl 1784189381 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1784189365.481171:0:96879:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9dc07130d880 x1870854458271872/t0(0) o501->MGC192.168.203.112@tcp@0@lo:26/25 lens 504/272 e 0 to 0 dl 1784189381 ref 2 fl Interpret:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784189365.481179:0:96879:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc07130d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd553d0d-03e2-4233-b06b-b55bbfa2b954:96879:1870854458271872:0@lo:501:mount.lustre.0 00000100:00000040:3.0:1784189365.481272:0:96879:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff9dc07130d880 x1870854458271872/t0(0) o501->MGC192.168.203.112@tcp@0@lo:26/25 lens 504/272 e 0 to 0 dl 1784189381 ref 2 fl Complete:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000020:00000040:3.0:1784189365.481284:0:96879:0:(genops.c:1244:class_import_put()) import ffff9dc07110c800 refcount=4 obd=MGC192.168.203.112@tcp 00000100:00000040:3.0:1784189365.481289:0:96879:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff9dc07130d880 x1870854458271872/t0(0) o501->MGC192.168.203.112@tcp@0@lo:26/25 lens 504/272 e 0 to 0 dl 1784189381 ref 1 fl Complete:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000020:00000040:3.0:1784189365.481298:0:96879:0:(genops.c:1244:class_import_put()) import ffff9dc07110c800 refcount=3 obd=MGC192.168.203.112@tcp 00000020:00000040:3.0:1784189365.481315:0:96879:0:(genops.c:1231:class_import_get()) import ffff9dc07110c800 refcount=4 obd=MGC192.168.203.112@tcp 00000020:00000040:3.0:1784189365.481381:0:96879:0:(genops.c:1231:class_import_get()) import ffff9dc07110c800 refcount=5 obd=MGC192.168.203.112@tcp 00000100:00000040:3.0:1784189365.481459:0:96879:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff9dc071534e00 x1870854458272000/t0(0) o503->MGC192.168.203.112@tcp@0@lo:26/25 lens 272/8416 e 0 to 0 dl 0 ref 2 fl New:QU/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784189365.481470:0:96879:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc071534e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd553d0d-03e2-4233-b06b-b55bbfa2b954:96879:1870854458272000:0@lo:503:mount.lustre.0 00000100:00000040:3.0:1784189365.481496:0:96879:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff9dc071534e00 x1870854458272000/t0(0) o503->MGC192.168.203.112@tcp@0@lo:26/25 lens 272/8416 e 0 to 0 dl 1784189381 ref 3 fl Rpc:r/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1784189365.481503:0:96879:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:3.0:1784189365.481520:0:96879:0:(events.c:337:request_in_callback()) incoming req@ffff9dc044987450 x1870854458272000 msgsize 272 00000100:00100000:3.0:1784189365.481524:0:96879:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:3.0:1784189365.481526:0:96879:0:(events.c:349:request_in_callback()) Buffer complete: 63 buffers still posted 00000100:00000040:3.0:1784189365.481538:0:96879:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 2 req@ffff9dc071534e00 x1870854458272000/t0(0) o503->MGC192.168.203.112@tcp@0@lo:26/25 lens 272/8416 e 0 to 0 dl 1784189381 ref 3 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784189365.481559:0:96879:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dc080ea93c0 going to sleep for 11 seconds 00000100:00100000:3.0:1784189365.481573:0:94314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458272000 00000100:00100000:3.0:1784189365.481577:0:94314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458272000 00000020:00000040:3.0:1784189365.481578:0:94314:0:(genops.c:825:class_conn2export()) looking for export cookie 0xcc1762b626f8c573 00000020:00000040:3.0:1784189365.481581:0:94314:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9dc050ae5000 refcount=23 00000100:00000040:3.0:1784189365.481594:0:94314:0:(service.c:1432:ptlrpc_at_set_timer()) armed mgs at +6s 00000100:00100000:3.0:1784189365.481609:0:94314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 195 00000100:00000040:3.0:1784189365.481612:0:94314:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9dc050ae5000 : new rpc_count 1 00000100:00000040:3.0:1784189365.481617:0:94314:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9dc044987450 x1870854458272000/t0(0) o503->bd553d0d-03e2-4233-b06b-b55bbfa2b954@0@lo:556/0 lens 272/0 e 0 to 0 dl 1784189376 ref 1 fl New:/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784189365.481628:0:94314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc044987450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:bd553d0d-03e2-4233-b06b-b55bbfa2b954+23:96879:x1870854458272000:12345-0@lo:503:mount.lustre.0 00000040:00000040:3.0:1784189365.481674:0:94314:0:(lustre_log.h:387:llog_ctxt_get()) GETting ctxt ffff9dc04811d3c0 : new refcount 2 00000040:00000040:3.0:1784189365.481709:0:94314:0:(lustre_log.h:402:llog_ctxt_put()) PUTting ctxt ffff9dc04811d3c0 : new refcount 1 00010000:00000040:3.0:1784189365.481713:0:94314:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 0, transno 0, xid 1870854458272000 00000100:00000040:3.0:1784189365.482156:0:94314:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9dc0710a1d00 refcount 52 to 0@lo 00000100:00000040:3.0:1784189365.482171:0:94314:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:3.0:1784189365.482206:0:94314:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=8416 offset=224 replen=8416 req@ffff9dc071534e00 x1870854458272000/t0(0) o503->MGC192.168.203.112@tcp@0@lo:26/25 lens 272/8416 e 0 to 0 dl 1784189381 ref 2 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1784189365.482229:0:94314:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff9dc0710a1d00 refcount 51 to 0@lo 00000100:00000040:3.0:1784189365.482234:0:94314:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9dc044987450 x1870854458272000/t0(0) o503->bd553d0d-03e2-4233-b06b-b55bbfa2b954@0@lo:556/0 lens 272/8416 e 0 to 0 dl 1784189376 ref 1 fl Interpret:/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784189365.482242:0:94314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc044987450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:bd553d0d-03e2-4233-b06b-b55bbfa2b954+23:96879:x1870854458272000:12345-0@lo:503:mount.lustre.0 Request processed in 617us (720us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189365.482249:0:94314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 195 00000100:00000040:3.0:1784189365.482252:0:94314:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9dc050ae5000 : new rpc_count 0 00000020:00000040:3.0:1784189365.482259:0:94314:0:(genops.c:900:class_export_put()) PUTting export ffff9dc050ae5000 : new refcount 22 00000100:00000040:2.0:1784189365.484678:0:96879:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff9dc071534e00 x1870854458272000/t0(0) o503->MGC192.168.203.112@tcp@0@lo:26/25 lens 272/8416 e 0 to 0 dl 1784189381 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1784189365.484695:0:96879:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9dc071534e00 x1870854458272000/t0(0) o503->MGC192.168.203.112@tcp@0@lo:26/25 lens 272/8416 e 0 to 0 dl 1784189381 ref 2 fl Interpret:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784189365.484703:0:96879:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc071534e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd553d0d-03e2-4233-b06b-b55bbfa2b954:96879:1870854458272000:0@lo:503:mount.lustre.0 00000100:00000040:2.0:1784189365.484711:0:96879:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff9dc071534e00 x1870854458272000/t0(0) o503->MGC192.168.203.112@tcp@0@lo:26/25 lens 272/8416 e 0 to 0 dl 1784189381 ref 2 fl Complete:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1784189365.484726:0:96879:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff9dc071534e00 x1870854458272000/t0(0) o503->MGC192.168.203.112@tcp@0@lo:26/25 lens 272/8416 e 0 to 0 dl 1784189381 ref 1 fl Complete:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000020:00000040:2.0:1784189365.484754:0:96879:0:(genops.c:1244:class_import_put()) import ffff9dc07110c800 refcount=4 obd=MGC192.168.203.112@tcp 00000020:00000040:2.0:1784189365.484764:0:96879:0:(genops.c:1244:class_import_put()) import ffff9dc07110c800 refcount=3 obd=MGC192.168.203.112@tcp 00000040:00080000:2.0:1784189365.485168:0:96879:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000020:00000040:2.0:1784189365.485236:0:96879:0:(genops.c:1231:class_import_get()) import ffff9dc07110c800 refcount=4 obd=MGC192.168.203.112@tcp 00000020:00000040:2.0:1784189365.485242:0:96879:0:(genops.c:1231:class_import_get()) import ffff9dc07110c800 refcount=5 obd=MGC192.168.203.112@tcp 00000100:00000040:2.0:1784189365.485268:0:96879:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff9dc07130c700 x1870854458272128/t0(0) o502->MGC192.168.203.112@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 0 ref 2 fl New:QU/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784189365.485280:0:96879:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc07130c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd553d0d-03e2-4233-b06b-b55bbfa2b954:96879:1870854458272128:0@lo:502:mount.lustre.0 00000100:00000040:2.0:1784189365.485311:0:96879:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff9dc07130c700 x1870854458272128/t0(0) o502->MGC192.168.203.112@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1784189381 ref 3 fl Rpc:r/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1784189365.485337:0:96879:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1784189365.485372:0:96879:0:(events.c:337:request_in_callback()) incoming req@ffff9dc044987c50 x1870854458272128 msgsize 272 00000100:00100000:2.0:1784189365.485377:0:96879:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:2.0:1784189365.485378:0:96879:0:(events.c:349:request_in_callback()) Buffer complete: 63 buffers still posted 00000100:00000040:2.0:1784189365.485407:0:96879:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 2 req@ffff9dc07130c700 x1870854458272128/t0(0) o502->MGC192.168.203.112@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1784189381 ref 3 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784189365.485428:0:96879:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dc0754c8000 going to sleep for 11 seconds 00000100:00100000:1.0:1784189365.486423:0:94309:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458272128 00000100:00100000:1.0:1784189365.486433:0:94309:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458272128 00000020:00000040:1.0:1784189365.486436:0:94309:0:(genops.c:825:class_conn2export()) looking for export cookie 0xcc1762b626f8c573 00000020:00000040:1.0:1784189365.486442:0:94309:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9dc050ae5000 refcount=23 00000100:00000040:1.0:1784189365.486464:0:94309:0:(service.c:1432:ptlrpc_at_set_timer()) armed mgs at +6s 00000100:00100000:1.0:1784189365.486493:0:94309:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 196 00000100:00000040:1.0:1784189365.486497:0:94309:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9dc050ae5000 : new rpc_count 1 00000100:00000040:1.0:1784189365.486503:0:94309:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9dc044987c50 x1870854458272128/t0(0) o502->bd553d0d-03e2-4233-b06b-b55bbfa2b954@0@lo:556/0 lens 272/0 e 0 to 0 dl 1784189376 ref 1 fl New:/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784189365.486516:0:94309:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc044987c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd553d0d-03e2-4233-b06b-b55bbfa2b954+23:96879:x1870854458272128:12345-0@lo:502:mount.lustre.0 00000040:00000040:1.0:1784189365.486746:0:94309:0:(lustre_log.h:387:llog_ctxt_get()) GETting ctxt ffff9dc04811d3c0 : new refcount 2 00000040:00000040:1.0:1784189365.486800:0:94309:0:(lustre_log.h:402:llog_ctxt_put()) PUTting ctxt ffff9dc04811d3c0 : new refcount 1 00010000:00000040:1.0:1784189365.486806:0:94309:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 0, transno 0, xid 1870854458272128 00000100:00000040:1.0:1784189365.486814:0:94309:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9dc0710a1d00 refcount 52 to 0@lo 00000100:00000040:1.0:1784189365.486820:0:94309:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:1.0:1784189365.486855:0:94309:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=8472 offset=224 replen=8472 req@ffff9dc07130c700 x1870854458272128/t0(0) o502->MGC192.168.203.112@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1784189381 ref 2 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1784189365.486941:0:94309:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff9dc0710a1d00 refcount 51 to 0@lo 00000100:00000040:1.0:1784189365.486947:0:94309:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9dc044987c50 x1870854458272128/t0(0) o502->bd553d0d-03e2-4233-b06b-b55bbfa2b954@0@lo:556/0 lens 272/8472 e 0 to 0 dl 1784189376 ref 1 fl Interpret:/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784189365.486956:0:94309:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc044987c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd553d0d-03e2-4233-b06b-b55bbfa2b954+23:96879:x1870854458272128:12345-0@lo:502:mount.lustre.0 Request processed in 442us (1582us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189365.486964:0:94309:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 196 00000100:00000040:1.0:1784189365.486967:0:94309:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9dc050ae5000 : new rpc_count 0 00000020:00000040:1.0:1784189365.486986:0:94309:0:(genops.c:900:class_export_put()) PUTting export ffff9dc050ae5000 : new refcount 22 00000100:00000040:3.0:1784189365.487059:0:96879:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff9dc07130c700 x1870854458272128/t0(0) o502->MGC192.168.203.112@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1784189381 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1784189365.487070:0:96879:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9dc07130c700 x1870854458272128/t0(0) o502->MGC192.168.203.112@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1784189381 ref 2 fl Interpret:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784189365.487078:0:96879:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc07130c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd553d0d-03e2-4233-b06b-b55bbfa2b954:96879:1870854458272128:0@lo:502:mount.lustre.0 00000100:00000040:3.0:1784189365.487086:0:96879:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff9dc07130c700 x1870854458272128/t0(0) o502->MGC192.168.203.112@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1784189381 ref 2 fl Complete:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1784189365.487097:0:96879:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff9dc07130c700 x1870854458272128/t0(0) o502->MGC192.168.203.112@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1784189381 ref 1 fl Complete:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000020:00000040:3.0:1784189365.487111:0:96879:0:(genops.c:1244:class_import_put()) import ffff9dc07110c800 refcount=4 obd=MGC192.168.203.112@tcp 00000020:00000040:3.0:1784189365.487118:0:96879:0:(genops.c:1244:class_import_put()) import ffff9dc07110c800 refcount=3 obd=MGC192.168.203.112@tcp 00000040:00080000:3.0:1784189365.492021:0:96879:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:3.0:1784189365.492086:0:96879:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:3.0:1784189365.492104:0:96879:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:3.0:1784189365.492119:0:96879:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:3.0:1784189365.492133:0:96879:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000020:00000040:3.0:1784189365.492159:0:96879:0:(genops.c:1231:class_import_get()) import ffff9dc07110c800 refcount=4 obd=MGC192.168.203.112@tcp 00000020:00000040:3.0:1784189365.492167:0:96879:0:(genops.c:1231:class_import_get()) import ffff9dc07110c800 refcount=5 obd=MGC192.168.203.112@tcp 00000100:00000040:3.0:1784189365.492204:0:96879:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff9dc071536680 x1870854458272256/t0(0) o502->MGC192.168.203.112@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 0 ref 2 fl New:QU/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784189365.492217:0:96879:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc071536680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd553d0d-03e2-4233-b06b-b55bbfa2b954:96879:1870854458272256:0@lo:502:mount.lustre.0 00000100:00000040:3.0:1784189365.492483:0:96879:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff9dc071536680 x1870854458272256/t0(0) o502->MGC192.168.203.112@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1784189381 ref 3 fl Rpc:r/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1784189365.492492:0:96879:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:3.0:1784189365.492533:0:96879:0:(events.c:337:request_in_callback()) incoming req@ffff9dc044984050 x1870854458272256 msgsize 272 00000100:00100000:3.0:1784189365.492538:0:96879:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:3.0:1784189365.492540:0:96879:0:(events.c:349:request_in_callback()) Buffer complete: 63 buffers still posted 00000100:00000040:3.0:1784189365.492570:0:96879:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 2 req@ffff9dc071536680 x1870854458272256/t0(0) o502->MGC192.168.203.112@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1784189381 ref 3 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784189365.492598:0:96879:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dc041658840 going to sleep for 11 seconds 00000100:00100000:2.0:1784189365.492617:0:94314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458272256 00000100:00100000:2.0:1784189365.492626:0:94314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458272256 00000020:00000040:2.0:1784189365.492637:0:94314:0:(genops.c:825:class_conn2export()) looking for export cookie 0xcc1762b626f8c573 00000020:00000040:2.0:1784189365.492642:0:94314:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9dc050ae5000 refcount=23 00000100:00000040:2.0:1784189365.492663:0:94314:0:(service.c:1432:ptlrpc_at_set_timer()) armed mgs at +6s 00000100:00100000:2.0:1784189365.492696:0:94314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 197 00000100:00000040:2.0:1784189365.492701:0:94314:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9dc050ae5000 : new rpc_count 1 00000100:00000040:2.0:1784189365.492706:0:94314:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9dc044984050 x1870854458272256/t0(0) o502->bd553d0d-03e2-4233-b06b-b55bbfa2b954@0@lo:556/0 lens 272/0 e 0 to 0 dl 1784189376 ref 1 fl New:/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784189365.492729:0:94314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc044984050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:bd553d0d-03e2-4233-b06b-b55bbfa2b954+23:96879:x1870854458272256:12345-0@lo:502:mount.lustre.0 00000040:00000040:2.0:1784189365.492774:0:94314:0:(lustre_log.h:387:llog_ctxt_get()) GETting ctxt ffff9dc04811d3c0 : new refcount 2 00000040:00000040:2.0:1784189365.492825:0:94314:0:(lustre_log.h:402:llog_ctxt_put()) PUTting ctxt ffff9dc04811d3c0 : new refcount 1 00010000:00000040:2.0:1784189365.492829:0:94314:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 0, transno 0, xid 1870854458272256 00000100:00000040:2.0:1784189365.492839:0:94314:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9dc0710a1d00 refcount 52 to 0@lo 00000100:00000040:2.0:1784189365.492843:0:94314:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1784189365.492864:0:94314:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=8472 offset=224 replen=8472 req@ffff9dc071536680 x1870854458272256/t0(0) o502->MGC192.168.203.112@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1784189381 ref 2 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1784189365.492891:0:94314:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff9dc0710a1d00 refcount 51 to 0@lo 00000100:00000040:2.0:1784189365.492896:0:94314:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9dc044984050 x1870854458272256/t0(0) o502->bd553d0d-03e2-4233-b06b-b55bbfa2b954@0@lo:556/0 lens 272/8472 e 0 to 0 dl 1784189376 ref 1 fl Interpret:/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784189365.492906:0:94314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc044984050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:bd553d0d-03e2-4233-b06b-b55bbfa2b954+23:96879:x1870854458272256:12345-0@lo:502:mount.lustre.0 Request processed in 189us (370us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189365.492913:0:94314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 197 00000100:00000040:2.0:1784189365.492916:0:94314:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9dc050ae5000 : new rpc_count 0 00000020:00000040:2.0:1784189365.492924:0:94314:0:(genops.c:900:class_export_put()) PUTting export ffff9dc050ae5000 : new refcount 22 00000100:00000040:0.0:1784189365.493015:0:96879:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff9dc071536680 x1870854458272256/t0(0) o502->MGC192.168.203.112@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1784189381 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1784189365.493026:0:96879:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9dc071536680 x1870854458272256/t0(0) o502->MGC192.168.203.112@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1784189381 ref 2 fl Interpret:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784189365.493034:0:96879:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc071536680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd553d0d-03e2-4233-b06b-b55bbfa2b954:96879:1870854458272256:0@lo:502:mount.lustre.0 00000100:00000040:0.0:1784189365.493041:0:96879:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff9dc071536680 x1870854458272256/t0(0) o502->MGC192.168.203.112@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1784189381 ref 2 fl Complete:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1784189365.493052:0:96879:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff9dc071536680 x1870854458272256/t0(0) o502->MGC192.168.203.112@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1784189381 ref 1 fl Complete:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000020:00000040:0.0:1784189365.493066:0:96879:0:(genops.c:1244:class_import_put()) import ffff9dc07110c800 refcount=4 obd=MGC192.168.203.112@tcp 00000020:00000040:0.0:1784189365.493073:0:96879:0:(genops.c:1244:class_import_put()) import ffff9dc07110c800 refcount=3 obd=MGC192.168.203.112@tcp 00000040:00080000:0.0:1784189365.493108:0:96879:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:0.0:1784189365.493115:0:96879:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 6 count 7 10000000:00000040:0.0:1784189365.493419:0:96879:0:(lustre_log.h:402:llog_ctxt_put()) PUTting ctxt ffff9dc074ac7e40 : new refcount 1 00000020:00000040:0.0:1784189365.493424:0:96879:0:(obd_config.c:2122:class_config_parse_llog()) looking up llog params 00000020:01000000:0.0:1784189365.498095:0:96887:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1784189365.498107:0:96887:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784189365.498110:0:96887:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1784189365.498117:0:96887:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9dc0762e7000 00000020:00000080:0.0:1784189365.498120:0:96887:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1784189365.498127:0:96887:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1784189365.498130:0:96887:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784189365.498131:0:96887:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:0.0:1784189365.498148:0:96887:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1784189365.498151:0:96887:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784189365.498152:0:96887:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1784189365.498155:0:96887:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9dc0762e7000 00000020:00000080:0.0:1784189365.498157:0:96887:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1784189365.500039:0:96887:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1784189365.500047:0:96887:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784189365.500050:0:96887:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:0.0:1784189365.500053:0:96887:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 7 count 7 00000020:01000000:3.0:1784189365.501108:0:96879:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-6 (rc=0) 10000000:01000000:3.0:1784189365.501144:0:96879:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'params' succeeded (0). 00000020:00000040:3.0:1784189365.501196:0:96879:0:(lustre_handles.c:147:class_handle2object()) GET ldlm ffff9dc070147200 refcount=3 00010000:00010000:3.0:1784189365.501204:0:96879:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff9dc070147200/0xcc1762b626f8d572 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc1762b626f8d579 expref: -99 pid: 96879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189365.501217:0:96879:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: ffff9dc070147200/0xcc1762b626f8d572 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc1762b626f8d579 expref: -99 pid: 96879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784189365.501280:0:96879:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1784189365.501283:0:96879:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9dc0762e7000 10000000:01000000:3.0:1784189365.501286:0:96879:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9dc0762e7000 10000000:01000000:3.0:1784189365.501290:0:96879:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 00000020:00000040:3.0:1784189365.501294:0:96879:0:(genops.c:889:class_export_get()) GET export ffff9dc071108800 refcount=20 10000000:01000000:3.0:1784189365.501298:0:96879:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9dc0762e7000 from 1 10000000:01000000:3.0:1784189365.501307:0:96879:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00000020:00000040:3.0:1784189365.501314:0:96879:0:(genops.c:1231:class_import_get()) import ffff9dc07110c800 refcount=4 obd=MGC192.168.203.112@tcp 00010000:00000040:3.0:1784189365.502548:0:96879:0:(ldlm_resource.c:1656:ldlm_resource_getref()) getref res: ffff9dc07fab4800 count: 9 00000020:00000040:3.0:1784189365.502560:0:96879:0:(lustre_handles.c:93:class_handle_hash()) added object ffff9dc0755a5200 with handle 0xcc1762b626f8d580 to hash 00010000:00010000:3.0:1784189365.502569:0:96879:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff9dc0755a5200/0xcc1762b626f8d580 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 96879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189365.502580:0:96879:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: ffff9dc0755a5200/0xcc1762b626f8d580 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 96879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189365.502592:0:96879:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: ffff9dc0755a5200/0xcc1762b626f8d580 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 96879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00000040:3.0:1784189365.502615:0:96879:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff9dc071535880 x1870854458272384/t0(0) o101->MGC192.168.203.112@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 0 ref 2 fl New:QU/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784189365.502628:0:96879:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc071535880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd553d0d-03e2-4233-b06b-b55bbfa2b954:96879:1870854458272384:0@lo:101:mount.lustre.0 00000100:00000040:3.0:1784189365.502665:0:96879:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff9dc071535880 x1870854458272384/t0(0) o101->MGC192.168.203.112@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1784189381 ref 3 fl Rpc:r/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1784189365.502674:0:96879:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:3.0:1784189365.502712:0:96879:0:(events.c:337:request_in_callback()) incoming req@ffff9dc044986c50 x1870854458272384 msgsize 328 00000100:00100000:3.0:1784189365.502727:0:96879:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:3.0:1784189365.502729:0:96879:0:(events.c:349:request_in_callback()) Buffer complete: 63 buffers still posted 00000100:00000040:3.0:1784189365.502756:0:96879:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 2 req@ffff9dc071535880 x1870854458272384/t0(0) o101->MGC192.168.203.112@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1784189381 ref 3 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784189365.502782:0:96879:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dc041658240 going to sleep for 11 seconds 00000100:00100000:0.0:1784189365.502883:0:94309:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458272384 00000100:00100000:0.0:1784189365.502890:0:94309:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458272384 00000020:00000040:0.0:1784189365.502893:0:94309:0:(genops.c:825:class_conn2export()) looking for export cookie 0xcc1762b626f8c573 00000020:00000040:0.0:1784189365.502896:0:94309:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9dc050ae5000 refcount=23 00000100:00000040:0.0:1784189365.502914:0:94309:0:(service.c:1432:ptlrpc_at_set_timer()) armed mgs at +6s 00000100:00100000:0.0:1784189365.502944:0:94309:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 198 00000100:00000040:0.0:1784189365.502949:0:94309:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9dc050ae5000 : new rpc_count 1 00000100:00000040:0.0:1784189365.502954:0:94309:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9dc044986c50 x1870854458272384/t0(0) o101->bd553d0d-03e2-4233-b06b-b55bbfa2b954@0@lo:556/0 lens 328/0 e 0 to 0 dl 1784189376 ref 1 fl New:/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784189365.502965:0:94309:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc044986c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd553d0d-03e2-4233-b06b-b55bbfa2b954+23:96879:x1870854458272384:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1784189365.502978:0:94309:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00000040:0.0:1784189365.502985:0:94309:0:(ldlm_resource.c:1656:ldlm_resource_getref()) getref res: ffff9dc049188100 count: 11 00000020:00000040:0.0:1784189365.502990:0:94309:0:(lustre_handles.c:93:class_handle_hash()) added object ffff9dc070146600 with handle 0xcc1762b626f8d587 to hash 00010000:00010000:0.0:1784189365.502995:0:94309:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dc070146600/0xcc1762b626f8d587 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0xcc1762b626f8d580 expref: -99 pid: 94309 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:0.0:1784189365.503002:0:94309:0:(ldlm_lockd.c:1373:ldlm_handle_enqueue()) lock GETting export ffff9dc050ae5000 : new locks_count 18 00000020:00000040:0.0:1784189365.503005:0:94309:0:(genops.c:889:class_export_get()) GET export ffff9dc050ae5000 refcount=24 00010000:00000040:0.0:1784189365.503019:0:94309:0:(ldlm_resource.c:1876:ldlm_resource_dump()) --- Resource: [0x65727473756c:0x0:0x0].0x0 (ffff9dc049188100) refcount = 11 00010000:00000040:0.0:1784189365.503023:0:94309:0:(ldlm_resource.c:1879:ldlm_resource_dump()) Granted locks (in reverse order): 00010000:00000040:0.0:1784189365.503026:0:94309:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGS lock: ffff9dc07116e400/0xcc1762b626f8d548 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcc1762b626f8d541 expref: 24 pid: 94308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:0.0:1784189365.503042:0:94309:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGS lock: ffff9dc081b16600/0xcc1762b626f8cb70 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c4112 expref: 9 pid: 94309 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:0.0:1784189365.503049:0:94309:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGS lock: ffff9dc042d66e00/0xcc1762b626f8cb69 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c410b expref: 9 pid: 94310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:0.0:1784189365.503055:0:94309:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGS lock: ffff9dc0565e7800/0xcc1762b626f8cb62 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcc1762b626f8cb5b expref: 24 pid: 94308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:0.0:1784189365.503062:0:94309:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGS lock: ffff9dc0565e6600/0xcc1762b626f8cb38 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcc1762b626f8cb31 expref: 24 pid: 94314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:0.0:1784189365.503069:0:94309:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGS lock: ffff9dc058f66600/0xcc1762b626f8cb2a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcc1762b626f8cb23 expref: 24 pid: 94308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:0.0:1784189365.503075:0:94309:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGS lock: ffff9dc058f66c00/0xcc1762b626f8cb1c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcc1762b626f8cb15 expref: 24 pid: 94308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:0.0:1784189365.503082:0:94309:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGS lock: ffff9dc081b16a00/0xcc1762b626f8cb0e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcc1762b626f8cb07 expref: 24 pid: 94308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:0.0:1784189365.503089:0:94309:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGS lock: ffff9dc058f67e00/0xcc1762b626f8cb00 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcc1762b626f8caf9 expref: 24 pid: 94309 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:0.0:1784189365.503096:0:94309:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGS lock: ffff9dc042d67400/0xcc1762b626f8caf2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcc1762b626f8caeb expref: 24 pid: 94314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189365.503103:0:94309:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dc070146600/0xcc1762b626f8d587 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcc1762b626f8d580 expref: 24 pid: 94309 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189365.503114:0:94309:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dc070146600/0xcc1762b626f8d587 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcc1762b626f8d580 expref: 24 pid: 94309 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189365.503132:0:94309:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc070146600, rc 0) 00010000:00000040:0.0:1784189365.503136:0:94309:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 0, transno 0, xid 1870854458272384 00000100:00000040:0.0:1784189365.503144:0:94309:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9dc0710a1d00 refcount 52 to 0@lo 00000100:00000040:0.0:1784189365.503149:0:94309:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1784189365.503166:0:94309:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=344 offset=224 replen=344 req@ffff9dc071535880 x1870854458272384/t0(0) o101->MGC192.168.203.112@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1784189381 ref 2 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1784189365.503198:0:94309:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff9dc0710a1d00 refcount 51 to 0@lo 00000100:00000040:0.0:1784189365.503203:0:94309:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9dc044986c50 x1870854458272384/t0(0) o101->bd553d0d-03e2-4233-b06b-b55bbfa2b954@0@lo:556/0 lens 328/344 e 0 to 0 dl 1784189376 ref 1 fl Interpret:/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784189365.503213:0:94309:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc044986c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd553d0d-03e2-4233-b06b-b55bbfa2b954+24:96879:x1870854458272384:12345-0@lo:101:mount.lustre.0 Request processed in 249us (498us total) trans 0 rc 0/0 00000100:00100000:0.0:1784189365.503219:0:94309:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 198 00000100:00000040:0.0:1784189365.503222:0:94309:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9dc050ae5000 : new rpc_count 0 00000020:00000040:0.0:1784189365.503230:0:94309:0:(genops.c:900:class_export_put()) PUTting export ffff9dc050ae5000 : new refcount 23 00000100:00000040:3.0:1784189365.503415:0:96879:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff9dc071535880 x1870854458272384/t0(0) o101->MGC192.168.203.112@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1784189381 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1784189365.503424:0:96879:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9dc071535880 x1870854458272384/t0(0) o101->MGC192.168.203.112@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1784189381 ref 2 fl Interpret:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784189365.503444:0:96879:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc071535880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd553d0d-03e2-4233-b06b-b55bbfa2b954:96879:1870854458272384:0@lo:101:mount.lustre.0 00000100:00000040:3.0:1784189365.503452:0:96879:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff9dc071535880 x1870854458272384/t0(0) o101->MGC192.168.203.112@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1784189381 ref 2 fl Complete:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000020:00000040:3.0:1784189365.503463:0:96879:0:(lustre_handles.c:147:class_handle2object()) GET ldlm ffff9dc0755a5200 refcount=4 00010000:00000040:3.0:1784189365.503467:0:96879:0:(ldlm_request.c:746:ldlm_cli_enqueue_fini()) local: ffff9dc0755a5200, remote cookie: 0xcc1762b626f8d587, flags: 0x0 00010000:00000040:3.0:1784189365.503472:0:96879:0:(ldlm_resource.c:1876:ldlm_resource_dump()) --- Resource: [0x65727473756c:0x0:0x0].0x0 (ffff9dc07fab4800) refcount = 9 00010000:00000040:3.0:1784189365.503475:0:96879:0:(ldlm_resource.c:1879:ldlm_resource_dump()) Granted locks (in reverse order): 00010000:00000040:3.0:1784189365.503478:0:96879:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGC192.168.203.112@tcp lock: ffff9dc070146800/0xcc1762b626f8d541 lrc: 1/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0xcc1762b626f8d548 expref: -99 pid: 96879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:3.0:1784189365.503486:0:96879:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGC192.168.203.112@tcp lock: ffff9dc0565e6800/0xcc1762b626f8cb5b lrc: 1/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0xcc1762b626f8cb62 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:3.0:1784189365.503493:0:96879:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGC192.168.203.112@tcp lock: ffff9dc0565e7c00/0xcc1762b626f8cb31 lrc: 1/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0xcc1762b626f8cb38 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:3.0:1784189365.503499:0:96879:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGC192.168.203.112@tcp lock: ffff9dc0565e7600/0xcc1762b626f8cb23 lrc: 1/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0xcc1762b626f8cb2a expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:3.0:1784189365.503505:0:96879:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGC192.168.203.112@tcp lock: ffff9dc081b16200/0xcc1762b626f8cb15 lrc: 1/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0xcc1762b626f8cb1c expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:3.0:1784189365.503512:0:96879:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGC192.168.203.112@tcp lock: ffff9dc0565e7e00/0xcc1762b626f8cb07 lrc: 1/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0xcc1762b626f8cb0e expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:3.0:1784189365.503519:0:96879:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGC192.168.203.112@tcp lock: ffff9dc081b17600/0xcc1762b626f8caf9 lrc: 1/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0xcc1762b626f8cb00 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:3.0:1784189365.503525:0:96879:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGC192.168.203.112@tcp lock: ffff9dc081b16c00/0xcc1762b626f8caeb lrc: 1/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0xcc1762b626f8caf2 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189365.503536:0:96879:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: ffff9dc0755a5200/0xcc1762b626f8d580 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc1762b626f8d587 expref: -99 pid: 96879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189365.503545:0:96879:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: ffff9dc0755a5200/0xcc1762b626f8d580 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0xcc1762b626f8d587 expref: -99 pid: 96879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00000040:3.0:1784189365.503553:0:96879:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff9dc071535880 x1870854458272384/t0(0) o101->MGC192.168.203.112@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1784189381 ref 1 fl Complete:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000020:00000040:3.0:1784189365.503563:0:96879:0:(genops.c:1244:class_import_put()) import ffff9dc07110c800 refcount=3 obd=MGC192.168.203.112@tcp 10000000:00000040:3.0:1784189365.503571:0:96879:0:(mgc_request.c:108:config_log_get()) log lustre-client (ffff9dc07601c400) refs 2 00000020:00000040:3.0:1784189365.503574:0:96879:0:(lustre_handles.c:147:class_handle2object()) GET ldlm ffff9dc0755a5200 refcount=3 10000000:00000040:3.0:1784189365.503600:0:96879:0:(lustre_log.h:387:llog_ctxt_get()) GETting ctxt ffff9dc074ac7e40 : new refcount 2 10000000:00000040:3.0:1784189365.503603:0:96879:0:(lustre_log.h:387:llog_ctxt_get()) GETting ctxt ffff9dc076067780 : new refcount 2 10000000:00000040:3.0:1784189365.503606:0:96879:0:(mgc_request_server.c:802:mgc_process_server_cfg_log()) MGC192.168.203.112@tcp: copy local log lustre-client 00000040:00080000:3.0:1784189365.503787:0:96879:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000040:00080000:3.0:1784189365.504025:0:96879:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1784189365.504174:0:96879:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:3.0:1784189365.504313:0:96879:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:3.0:1784189365.504367:0:96879:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:3.0:1784189365.504380:0:96879:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:3.0:1784189365.504391:0:96879:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:3.0:1784189365.504402:0:96879:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:3.0:1784189365.504415:0:96879:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:3.0:1784189365.504426:0:96879:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:3.0:1784189365.504437:0:96879:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:3.0:1784189365.504448:0:96879:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:3.0:1784189365.504458:0:96879:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:3.0:1784189365.504469:0:96879:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:3.0:1784189365.504480:0:96879:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:3.0:1784189365.504492:0:96879:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:3.0:1784189365.504512:0:96879:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:3.0:1784189365.504523:0:96879:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:3.0:1784189365.504534:0:96879:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:3.0:1784189365.504545:0:96879:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:3.0:1784189365.504556:0:96879:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:3.0:1784189365.504568:0:96879:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:3.0:1784189365.504580:0:96879:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:3.0:1784189365.504592:0:96879:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:3.0:1784189365.504603:0:96879:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:3.0:1784189365.504617:0:96879:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:3.0:1784189365.504637:0:96879:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 160 off12472 00000040:00080000:3.0:1784189365.504652:0:96879:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12696 00000040:00080000:3.0:1784189365.504663:0:96879:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12920 00000040:00080000:3.0:1784189365.504675:0:96879:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off13000 00000040:00080000:3.0:1784189365.504688:0:96879:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13224 00000040:00080000:3.0:1784189365.504700:0:96879:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13448 00000040:00080000:3.0:1784189365.504712:0:96879:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 88 off13536 00000040:00080000:3.0:1784189365.504946:0:96879:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 128 off13664 00000040:00080000:3.0:1784189365.504963:0:96879:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 144 off13808 00000040:00080000:3.0:1784189365.504979:0:96879:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 128 off13936 00000040:00080000:3.0:1784189365.504992:0:96879:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 224 off14160 00000040:00080000:3.0:1784189365.505004:0:96879:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 224 off14384 00000040:00080000:3.0:1784189365.505017:0:96879:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 80 off14464 00000040:00080000:3.0:1784189365.505035:0:96879:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 224 off14688 00000040:00080000:3.0:1784189365.505042:0:96879:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 38 count 39 00000020:00000040:3.0:1784189365.505092:0:96879:0:(genops.c:1231:class_import_get()) import ffff9dc07110c800 refcount=4 obd=MGC192.168.203.112@tcp 00000020:00000040:3.0:1784189365.505097:0:96879:0:(genops.c:1231:class_import_get()) import ffff9dc07110c800 refcount=5 obd=MGC192.168.203.112@tcp 00000100:00000040:3.0:1784189365.505125:0:96879:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff9dc071535880 x1870854458272512/t0(0) o501->MGC192.168.203.112@tcp@0@lo:26/25 lens 512/272 e 0 to 0 dl 0 ref 2 fl New:QU/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784189365.505136:0:96879:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc071535880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd553d0d-03e2-4233-b06b-b55bbfa2b954:96879:1870854458272512:0@lo:501:mount.lustre.0 00000100:00000040:3.0:1784189365.505156:0:96879:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff9dc071535880 x1870854458272512/t0(0) o501->MGC192.168.203.112@tcp@0@lo:26/25 lens 512/272 e 0 to 0 dl 1784189381 ref 3 fl Rpc:r/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1784189365.505170:0:96879:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:3.0:1784189365.506821:0:96879:0:(events.c:337:request_in_callback()) incoming req@ffff9dc044985050 x1870854458272512 msgsize 512 00000100:00100000:3.0:1784189365.506832:0:96879:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:3.0:1784189365.506834:0:96879:0:(events.c:349:request_in_callback()) Buffer complete: 63 buffers still posted 00000100:00000040:3.0:1784189365.506861:0:96879:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 2 req@ffff9dc071535880 x1870854458272512/t0(0) o501->MGC192.168.203.112@tcp@0@lo:26/25 lens 512/272 e 0 to 0 dl 1784189381 ref 3 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784189365.506888:0:96879:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dc081c57180 going to sleep for 11 seconds 00000100:00100000:2.0:1784189365.507401:0:94314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458272512 00000100:00100000:2.0:1784189365.507409:0:94314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458272512 00000020:00000040:2.0:1784189365.507412:0:94314:0:(genops.c:825:class_conn2export()) looking for export cookie 0xcc1762b626f8c573 00000020:00000040:2.0:1784189365.507418:0:94314:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9dc050ae5000 refcount=24 00000100:00000040:2.0:1784189365.507439:0:94314:0:(service.c:1432:ptlrpc_at_set_timer()) armed mgs at +6s 00000100:00100000:2.0:1784189365.507462:0:94314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 199 00000100:00000040:2.0:1784189365.507466:0:94314:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9dc050ae5000 : new rpc_count 1 00000100:00000040:2.0:1784189365.507472:0:94314:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9dc044985050 x1870854458272512/t0(0) o501->bd553d0d-03e2-4233-b06b-b55bbfa2b954@0@lo:556/0 lens 512/0 e 0 to 0 dl 1784189376 ref 1 fl New:/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784189365.507485:0:94314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc044985050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:bd553d0d-03e2-4233-b06b-b55bbfa2b954+24:96879:x1870854458272512:12345-0@lo:501:mount.lustre.0 00000040:00000040:2.0:1784189365.507506:0:94314:0:(llog_server.c:62:llog_origin_handle_open()) MGS: opening log lustre-client 00000040:00000040:2.0:1784189365.507509:0:94314:0:(lustre_log.h:387:llog_ctxt_get()) GETting ctxt ffff9dc04811d3c0 : new refcount 2 00000040:00000040:2.0:1784189365.507575:0:94314:0:(lustre_log.h:402:llog_ctxt_put()) PUTting ctxt ffff9dc04811d3c0 : new refcount 1 00000020:00000040:2.0:1784189365.507583:0:94314:0:(genops.c:889:class_export_get()) GET export ffff9dc050ae5000 refcount=25 00000020:00000040:2.0:1784189365.507587:0:94314:0:(genops.c:900:class_export_put()) PUTting export ffff9dc050ae5000 : new refcount 24 00010000:00000040:2.0:1784189365.507591:0:94314:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 0, transno 0, xid 1870854458272512 00000100:00000040:2.0:1784189365.507601:0:94314:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9dc0710a1d00 refcount 52 to 0@lo 00000100:00000040:2.0:1784189365.507606:0:94314:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1784189365.507645:0:94314:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=272 offset=224 replen=272 req@ffff9dc071535880 x1870854458272512/t0(0) o501->MGC192.168.203.112@tcp@0@lo:26/25 lens 512/272 e 0 to 0 dl 1784189381 ref 2 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1784189365.507665:0:94314:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff9dc0710a1d00 refcount 51 to 0@lo 00000100:00000040:2.0:1784189365.507669:0:94314:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9dc044985050 x1870854458272512/t0(0) o501->bd553d0d-03e2-4233-b06b-b55bbfa2b954@0@lo:556/0 lens 512/272 e 0 to 0 dl 1784189376 ref 1 fl Interpret:/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784189365.507678:0:94314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc044985050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:bd553d0d-03e2-4233-b06b-b55bbfa2b954+24:96879:x1870854458272512:12345-0@lo:501:mount.lustre.0 Request processed in 195us (857us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189365.507687:0:94314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 199 00000100:00000040:2.0:1784189365.507690:0:94314:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9dc050ae5000 : new rpc_count 0 00000020:00000040:2.0:1784189365.507698:0:94314:0:(genops.c:900:class_export_put()) PUTting export ffff9dc050ae5000 : new refcount 23 00000100:00000040:3.0:1784189365.507877:0:96879:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff9dc071535880 x1870854458272512/t0(0) o501->MGC192.168.203.112@tcp@0@lo:26/25 lens 512/272 e 0 to 0 dl 1784189381 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1784189365.507889:0:96879:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9dc071535880 x1870854458272512/t0(0) o501->MGC192.168.203.112@tcp@0@lo:26/25 lens 512/272 e 0 to 0 dl 1784189381 ref 2 fl Interpret:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784189365.507898:0:96879:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc071535880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd553d0d-03e2-4233-b06b-b55bbfa2b954:96879:1870854458272512:0@lo:501:mount.lustre.0 00000100:00000040:3.0:1784189365.507905:0:96879:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff9dc071535880 x1870854458272512/t0(0) o501->MGC192.168.203.112@tcp@0@lo:26/25 lens 512/272 e 0 to 0 dl 1784189381 ref 2 fl Complete:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000020:00000040:3.0:1784189365.507916:0:96879:0:(genops.c:1244:class_import_put()) import ffff9dc07110c800 refcount=4 obd=MGC192.168.203.112@tcp 00000100:00000040:3.0:1784189365.507920:0:96879:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff9dc071535880 x1870854458272512/t0(0) o501->MGC192.168.203.112@tcp@0@lo:26/25 lens 512/272 e 0 to 0 dl 1784189381 ref 1 fl Complete:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000020:00000040:3.0:1784189365.507928:0:96879:0:(genops.c:1244:class_import_put()) import ffff9dc07110c800 refcount=3 obd=MGC192.168.203.112@tcp 00000020:00000040:3.0:1784189365.507939:0:96879:0:(genops.c:1231:class_import_get()) import ffff9dc07110c800 refcount=4 obd=MGC192.168.203.112@tcp 00000020:00000040:3.0:1784189365.507943:0:96879:0:(genops.c:1231:class_import_get()) import ffff9dc07110c800 refcount=5 obd=MGC192.168.203.112@tcp 00000100:00000040:3.0:1784189365.507960:0:96879:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff9dc071535880 x1870854458272640/t0(0) o503->MGC192.168.203.112@tcp@0@lo:26/25 lens 272/8416 e 0 to 0 dl 0 ref 2 fl New:QU/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784189365.507970:0:96879:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc071535880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd553d0d-03e2-4233-b06b-b55bbfa2b954:96879:1870854458272640:0@lo:503:mount.lustre.0 00000100:00000040:3.0:1784189365.507995:0:96879:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff9dc071535880 x1870854458272640/t0(0) o503->MGC192.168.203.112@tcp@0@lo:26/25 lens 272/8416 e 0 to 0 dl 1784189381 ref 3 fl Rpc:r/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1784189365.508012:0:96879:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:3.0:1784189365.508030:0:96879:0:(events.c:337:request_in_callback()) incoming req@ffff9dc044985450 x1870854458272640 msgsize 272 00000100:00100000:3.0:1784189365.508034:0:96879:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:3.0:1784189365.508035:0:96879:0:(events.c:349:request_in_callback()) Buffer complete: 63 buffers still posted 00000100:00000040:3.0:1784189365.508057:0:96879:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 2 req@ffff9dc071535880 x1870854458272640/t0(0) o503->MGC192.168.203.112@tcp@0@lo:26/25 lens 272/8416 e 0 to 0 dl 1784189381 ref 3 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784189365.508075:0:96879:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dc081c57180 going to sleep for 11 seconds 00000100:00100000:2.0:1784189365.508605:0:94309:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458272640 00000100:00100000:2.0:1784189365.508612:0:94309:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458272640 00000020:00000040:2.0:1784189365.508614:0:94309:0:(genops.c:825:class_conn2export()) looking for export cookie 0xcc1762b626f8c573 00000020:00000040:2.0:1784189365.508618:0:94309:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9dc050ae5000 refcount=24 00000100:00000040:2.0:1784189365.508641:0:94309:0:(service.c:1432:ptlrpc_at_set_timer()) armed mgs at +6s 00000100:00100000:2.0:1784189365.508658:0:94309:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 200 00000100:00000040:2.0:1784189365.508662:0:94309:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9dc050ae5000 : new rpc_count 1 00000100:00000040:2.0:1784189365.508667:0:94309:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9dc044985450 x1870854458272640/t0(0) o503->bd553d0d-03e2-4233-b06b-b55bbfa2b954@0@lo:556/0 lens 272/0 e 0 to 0 dl 1784189376 ref 1 fl New:/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784189365.508679:0:94309:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc044985450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd553d0d-03e2-4233-b06b-b55bbfa2b954+24:96879:x1870854458272640:12345-0@lo:503:mount.lustre.0 00000040:00000040:2.0:1784189365.508701:0:94309:0:(lustre_log.h:387:llog_ctxt_get()) GETting ctxt ffff9dc04811d3c0 : new refcount 2 00000040:00000040:2.0:1784189365.508747:0:94309:0:(lustre_log.h:402:llog_ctxt_put()) PUTting ctxt ffff9dc04811d3c0 : new refcount 1 00010000:00000040:2.0:1784189365.508751:0:94309:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 0, transno 0, xid 1870854458272640 00000100:00000040:2.0:1784189365.508762:0:94309:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9dc0710a1d00 refcount 52 to 0@lo 00000100:00000040:2.0:1784189365.508766:0:94309:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1784189365.508790:0:94309:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=8416 offset=224 replen=8416 req@ffff9dc071535880 x1870854458272640/t0(0) o503->MGC192.168.203.112@tcp@0@lo:26/25 lens 272/8416 e 0 to 0 dl 1784189381 ref 2 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1784189365.508815:0:94309:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff9dc0710a1d00 refcount 51 to 0@lo 00000100:00000040:2.0:1784189365.508820:0:94309:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9dc044985450 x1870854458272640/t0(0) o503->bd553d0d-03e2-4233-b06b-b55bbfa2b954@0@lo:556/0 lens 272/8416 e 0 to 0 dl 1784189376 ref 1 fl Interpret:/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784189365.508827:0:94309:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc044985450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd553d0d-03e2-4233-b06b-b55bbfa2b954+24:96879:x1870854458272640:12345-0@lo:503:mount.lustre.0 Request processed in 151us (796us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189365.508835:0:94309:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 200 00000100:00000040:2.0:1784189365.508837:0:94309:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9dc050ae5000 : new rpc_count 0 00000020:00000040:2.0:1784189365.508844:0:94309:0:(genops.c:900:class_export_put()) PUTting export ffff9dc050ae5000 : new refcount 23 00000100:00000040:0.0:1784189365.508972:0:96879:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff9dc071535880 x1870854458272640/t0(0) o503->MGC192.168.203.112@tcp@0@lo:26/25 lens 272/8416 e 0 to 0 dl 1784189381 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1784189365.508982:0:96879:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9dc071535880 x1870854458272640/t0(0) o503->MGC192.168.203.112@tcp@0@lo:26/25 lens 272/8416 e 0 to 0 dl 1784189381 ref 2 fl Interpret:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784189365.508989:0:96879:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc071535880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd553d0d-03e2-4233-b06b-b55bbfa2b954:96879:1870854458272640:0@lo:503:mount.lustre.0 00000100:00000040:0.0:1784189365.508996:0:96879:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff9dc071535880 x1870854458272640/t0(0) o503->MGC192.168.203.112@tcp@0@lo:26/25 lens 272/8416 e 0 to 0 dl 1784189381 ref 2 fl Complete:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1784189365.509007:0:96879:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff9dc071535880 x1870854458272640/t0(0) o503->MGC192.168.203.112@tcp@0@lo:26/25 lens 272/8416 e 0 to 0 dl 1784189381 ref 1 fl Complete:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000020:00000040:0.0:1784189365.509021:0:96879:0:(genops.c:1244:class_import_put()) import ffff9dc07110c800 refcount=4 obd=MGC192.168.203.112@tcp 00000020:00000040:0.0:1784189365.509032:0:96879:0:(genops.c:1244:class_import_put()) import ffff9dc07110c800 refcount=3 obd=MGC192.168.203.112@tcp 00000040:00080000:0.0:1784189365.509480:0:96879:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000020:00000040:0.0:1784189365.509534:0:96879:0:(genops.c:1231:class_import_get()) import ffff9dc07110c800 refcount=4 obd=MGC192.168.203.112@tcp 00000020:00000040:0.0:1784189365.509539:0:96879:0:(genops.c:1231:class_import_get()) import ffff9dc07110c800 refcount=5 obd=MGC192.168.203.112@tcp 00000100:00000040:0.0:1784189365.509559:0:96879:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff9dc05edd1180 x1870854458272768/t0(0) o502->MGC192.168.203.112@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 0 ref 2 fl New:QU/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784189365.509569:0:96879:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc05edd1180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd553d0d-03e2-4233-b06b-b55bbfa2b954:96879:1870854458272768:0@lo:502:mount.lustre.0 00000100:00000040:0.0:1784189365.509592:0:96879:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff9dc05edd1180 x1870854458272768/t0(0) o502->MGC192.168.203.112@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1784189381 ref 3 fl Rpc:r/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1784189365.509600:0:96879:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1784189365.509619:0:96879:0:(events.c:337:request_in_callback()) incoming req@ffff9dc044985850 x1870854458272768 msgsize 272 00000100:00100000:0.0:1784189365.509623:0:96879:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:0.0:1784189365.509625:0:96879:0:(events.c:349:request_in_callback()) Buffer complete: 63 buffers still posted 00000100:00000040:0.0:1784189365.509644:0:96879:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 2 req@ffff9dc05edd1180 x1870854458272768/t0(0) o502->MGC192.168.203.112@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1784189381 ref 3 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784189365.509664:0:96879:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dbf45865900 going to sleep for 11 seconds 00000100:00100000:2.0:1784189365.509725:0:94314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458272768 00000100:00100000:2.0:1784189365.509730:0:94314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458272768 00000020:00000040:2.0:1784189365.509733:0:94314:0:(genops.c:825:class_conn2export()) looking for export cookie 0xcc1762b626f8c573 00000020:00000040:2.0:1784189365.509736:0:94314:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9dc050ae5000 refcount=24 00000100:00000040:2.0:1784189365.509748:0:94314:0:(service.c:1432:ptlrpc_at_set_timer()) armed mgs at +6s 00000100:00100000:2.0:1784189365.509774:0:94314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 201 00000100:00000040:2.0:1784189365.509778:0:94314:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9dc050ae5000 : new rpc_count 1 00000100:00000040:2.0:1784189365.509783:0:94314:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9dc044985850 x1870854458272768/t0(0) o502->bd553d0d-03e2-4233-b06b-b55bbfa2b954@0@lo:556/0 lens 272/0 e 0 to 0 dl 1784189376 ref 1 fl New:/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784189365.509794:0:94314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc044985850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:bd553d0d-03e2-4233-b06b-b55bbfa2b954+24:96879:x1870854458272768:12345-0@lo:502:mount.lustre.0 00000040:00000040:2.0:1784189365.509812:0:94314:0:(lustre_log.h:387:llog_ctxt_get()) GETting ctxt ffff9dc04811d3c0 : new refcount 2 00000040:00000040:2.0:1784189365.509851:0:94314:0:(lustre_log.h:402:llog_ctxt_put()) PUTting ctxt ffff9dc04811d3c0 : new refcount 1 00010000:00000040:2.0:1784189365.509854:0:94314:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 0, transno 0, xid 1870854458272768 00000100:00000040:2.0:1784189365.509859:0:94314:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9dc0710a1d00 refcount 52 to 0@lo 00000100:00000040:2.0:1784189365.509863:0:94314:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1784189365.509881:0:94314:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=8472 offset=224 replen=8472 req@ffff9dc05edd1180 x1870854458272768/t0(0) o502->MGC192.168.203.112@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1784189381 ref 2 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1784189365.509907:0:94314:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff9dc0710a1d00 refcount 51 to 0@lo 00000100:00000040:2.0:1784189365.509912:0:94314:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9dc044985850 x1870854458272768/t0(0) o502->bd553d0d-03e2-4233-b06b-b55bbfa2b954@0@lo:556/0 lens 272/8472 e 0 to 0 dl 1784189376 ref 1 fl Interpret:/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784189365.509920:0:94314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc044985850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:bd553d0d-03e2-4233-b06b-b55bbfa2b954+24:96879:x1870854458272768:12345-0@lo:502:mount.lustre.0 Request processed in 127us (299us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189365.509927:0:94314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 201 00000100:00000040:2.0:1784189365.509929:0:94314:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9dc050ae5000 : new rpc_count 0 00000020:00000040:2.0:1784189365.509936:0:94314:0:(genops.c:900:class_export_put()) PUTting export ffff9dc050ae5000 : new refcount 23 00000100:00000040:0.0:1784189365.510194:0:96879:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff9dc05edd1180 x1870854458272768/t0(0) o502->MGC192.168.203.112@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1784189381 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1784189365.510204:0:96879:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9dc05edd1180 x1870854458272768/t0(0) o502->MGC192.168.203.112@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1784189381 ref 2 fl Interpret:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784189365.510212:0:96879:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc05edd1180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd553d0d-03e2-4233-b06b-b55bbfa2b954:96879:1870854458272768:0@lo:502:mount.lustre.0 00000100:00000040:0.0:1784189365.510219:0:96879:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff9dc05edd1180 x1870854458272768/t0(0) o502->MGC192.168.203.112@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1784189381 ref 2 fl Complete:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1784189365.510230:0:96879:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff9dc05edd1180 x1870854458272768/t0(0) o502->MGC192.168.203.112@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1784189381 ref 1 fl Complete:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000020:00000040:0.0:1784189365.510244:0:96879:0:(genops.c:1244:class_import_put()) import ffff9dc07110c800 refcount=4 obd=MGC192.168.203.112@tcp 00000020:00000040:0.0:1784189365.510249:0:96879:0:(genops.c:1244:class_import_put()) import ffff9dc07110c800 refcount=3 obd=MGC192.168.203.112@tcp 00000040:00080000:0.0:1784189365.510423:0:96879:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:0.0:1784189365.510447:0:96879:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:0.0:1784189365.510460:0:96879:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:0.0:1784189365.510473:0:96879:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:0.0:1784189365.510485:0:96879:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:0.0:1784189365.510495:0:96879:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:0.0:1784189365.510506:0:96879:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:0.0:1784189365.510519:0:96879:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:0.0:1784189365.510531:0:96879:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:0.0:1784189365.510543:0:96879:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:0.0:1784189365.510555:0:96879:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:0.0:1784189365.510566:0:96879:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:0.0:1784189365.510577:0:96879:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:0.0:1784189365.510588:0:96879:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:0.0:1784189365.510601:0:96879:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:0.0:1784189365.510614:0:96879:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:0.0:1784189365.510627:0:96879:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:0.0:1784189365.510655:0:96879:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:0.0:1784189365.510669:0:96879:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:0.0:1784189365.510871:0:96879:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:0.0:1784189365.510888:0:96879:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:0.0:1784189365.510900:0:96879:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:0.0:1784189365.510912:0:96879:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:0.0:1784189365.510926:0:96879:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:0.0:1784189365.510938:0:96879:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 160 off12472 00000040:00080000:0.0:1784189365.510954:0:96879:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12696 00000040:00080000:0.0:1784189365.510969:0:96879:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12920 00000040:00080000:0.0:1784189365.510985:0:96879:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off13000 00000040:00080000:0.0:1784189365.511003:0:96879:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13224 00000040:00080000:0.0:1784189365.511020:0:96879:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13448 00000040:00080000:0.0:1784189365.511040:0:96879:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13536 00000040:00080000:0.0:1784189365.511058:0:96879:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13664 00000040:00080000:0.0:1784189365.511075:0:96879:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13808 00000040:00080000:0.0:1784189365.511103:0:96879:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13936 00000040:00080000:0.0:1784189365.511121:0:96879:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14160 00000040:00080000:0.0:1784189365.511140:0:96879:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14384 00000040:00080000:0.0:1784189365.511157:0:96879:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14464 00000040:00080000:0.0:1784189365.511174:0:96879:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14688 00000040:00080000:0.0:1784189365.511193:0:96879:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14912 00000040:00080000:0.0:1784189365.511212:0:96879:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 88 off15000 00000040:00080000:0.0:1784189365.511232:0:96879:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 128 off15128 00000040:00080000:0.0:1784189365.511247:0:96879:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].42, 144 off15272 00000040:00080000:0.0:1784189365.511259:0:96879:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].43, 128 off15400 00000040:00080000:0.0:1784189365.511273:0:96879:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].44, 224 off15624 00000040:00080000:0.0:1784189365.511286:0:96879:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].45, 224 off15848 00000040:00080000:0.0:1784189365.511299:0:96879:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].46, 80 off15928 00000040:00080000:0.0:1784189365.511314:0:96879:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].47, 224 off16152 00000040:00080000:0.0:1784189365.511350:0:96879:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].48, 232 off16384 00000020:00000040:0.0:1784189365.511365:0:96879:0:(genops.c:1231:class_import_get()) import ffff9dc07110c800 refcount=4 obd=MGC192.168.203.112@tcp 00000020:00000040:0.0:1784189365.511370:0:96879:0:(genops.c:1231:class_import_get()) import ffff9dc07110c800 refcount=5 obd=MGC192.168.203.112@tcp 00000100:00000040:0.0:1784189365.511393:0:96879:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff9dc05edd1180 x1870854458272896/t0(0) o502->MGC192.168.203.112@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 0 ref 2 fl New:QU/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784189365.511403:0:96879:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc05edd1180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd553d0d-03e2-4233-b06b-b55bbfa2b954:96879:1870854458272896:0@lo:502:mount.lustre.0 00000100:00000040:0.0:1784189365.511434:0:96879:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff9dc05edd1180 x1870854458272896/t0(0) o502->MGC192.168.203.112@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1784189381 ref 3 fl Rpc:r/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1784189365.511442:0:96879:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1784189365.511471:0:96879:0:(events.c:337:request_in_callback()) incoming req@ffff9dc044984450 x1870854458272896 msgsize 272 00000100:00100000:0.0:1784189365.511478:0:96879:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:0.0:1784189365.511480:0:96879:0:(events.c:349:request_in_callback()) Buffer complete: 63 buffers still posted 00000100:00000040:0.0:1784189365.511495:0:96879:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 2 req@ffff9dc05edd1180 x1870854458272896/t0(0) o502->MGC192.168.203.112@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1784189381 ref 3 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784189365.511523:0:96879:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dc041658240 going to sleep for 11 seconds 00000100:00100000:2.0:1784189365.511832:0:94309:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458272896 00000100:00100000:2.0:1784189365.511838:0:94309:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458272896 00000020:00000040:2.0:1784189365.511841:0:94309:0:(genops.c:825:class_conn2export()) looking for export cookie 0xcc1762b626f8c573 00000020:00000040:2.0:1784189365.511845:0:94309:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9dc050ae5000 refcount=24 00000100:00000040:2.0:1784189365.511862:0:94309:0:(service.c:1432:ptlrpc_at_set_timer()) armed mgs at +6s 00000100:00100000:2.0:1784189365.511894:0:94309:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 202 00000100:00000040:2.0:1784189365.511898:0:94309:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9dc050ae5000 : new rpc_count 1 00000100:00000040:2.0:1784189365.511904:0:94309:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9dc044984450 x1870854458272896/t0(0) o502->bd553d0d-03e2-4233-b06b-b55bbfa2b954@0@lo:556/0 lens 272/0 e 0 to 0 dl 1784189376 ref 1 fl New:/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784189365.511915:0:94309:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc044984450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd553d0d-03e2-4233-b06b-b55bbfa2b954+24:96879:x1870854458272896:12345-0@lo:502:mount.lustre.0 00000040:00000040:2.0:1784189365.511937:0:94309:0:(lustre_log.h:387:llog_ctxt_get()) GETting ctxt ffff9dc04811d3c0 : new refcount 2 00000040:00000040:2.0:1784189365.511979:0:94309:0:(lustre_log.h:402:llog_ctxt_put()) PUTting ctxt ffff9dc04811d3c0 : new refcount 1 00010000:00000040:2.0:1784189365.511984:0:94309:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 0, transno 0, xid 1870854458272896 00000100:00000040:2.0:1784189365.511992:0:94309:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9dc0710a1d00 refcount 52 to 0@lo 00000100:00000040:2.0:1784189365.511996:0:94309:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1784189365.512019:0:94309:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=8472 offset=224 replen=8472 req@ffff9dc05edd1180 x1870854458272896/t0(0) o502->MGC192.168.203.112@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1784189381 ref 2 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1784189365.512039:0:94309:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff9dc0710a1d00 refcount 51 to 0@lo 00000100:00000040:2.0:1784189365.512044:0:94309:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9dc044984450 x1870854458272896/t0(0) o502->bd553d0d-03e2-4233-b06b-b55bbfa2b954@0@lo:556/0 lens 272/8472 e 0 to 0 dl 1784189376 ref 1 fl Interpret:/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784189365.512058:0:94309:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc044984450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd553d0d-03e2-4233-b06b-b55bbfa2b954+24:96879:x1870854458272896:12345-0@lo:502:mount.lustre.0 Request processed in 144us (585us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189365.512065:0:94309:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 202 00000100:00000040:2.0:1784189365.512068:0:94309:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9dc050ae5000 : new rpc_count 0 00000020:00000040:2.0:1784189365.512076:0:94309:0:(genops.c:900:class_export_put()) PUTting export ffff9dc050ae5000 : new refcount 23 00000100:00000040:0.0:1784189365.512245:0:96879:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff9dc05edd1180 x1870854458272896/t0(0) o502->MGC192.168.203.112@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1784189381 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1784189365.512261:0:96879:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9dc05edd1180 x1870854458272896/t0(0) o502->MGC192.168.203.112@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1784189381 ref 2 fl Interpret:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784189365.512267:0:96879:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc05edd1180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd553d0d-03e2-4233-b06b-b55bbfa2b954:96879:1870854458272896:0@lo:502:mount.lustre.0 00000100:00000040:0.0:1784189365.512274:0:96879:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff9dc05edd1180 x1870854458272896/t0(0) o502->MGC192.168.203.112@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1784189381 ref 2 fl Complete:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1784189365.512285:0:96879:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff9dc05edd1180 x1870854458272896/t0(0) o502->MGC192.168.203.112@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1784189381 ref 1 fl Complete:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000020:00000040:0.0:1784189365.512299:0:96879:0:(genops.c:1244:class_import_put()) import ffff9dc07110c800 refcount=4 obd=MGC192.168.203.112@tcp 00000020:00000040:0.0:1784189365.512306:0:96879:0:(genops.c:1244:class_import_put()) import ffff9dc07110c800 refcount=3 obd=MGC192.168.203.112@tcp 00000040:00080000:0.0:1784189365.512459:0:96879:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].49, 224 off16608 00000040:00080000:0.0:1784189365.512482:0:96879:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].50, 120 off16728 00000040:00080000:0.0:1784189365.512495:0:96879:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].51, 224 off16952 00000040:00080000:0.0:1784189365.512509:0:96879:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].52, 224 off17176 00000040:00080000:0.0:1784189365.512521:0:96879:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].53, 112 off17288 00000040:00080000:0.0:1784189365.512535:0:96879:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].54, 224 off17512 00000040:00080000:0.0:1784189365.512549:0:96879:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].55, 224 off17736 00000040:00080000:0.0:1784189365.512561:0:96879:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].56, 136 off17872 00000040:00080000:0.0:1784189365.512572:0:96879:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].57, 224 off18096 00000040:00080000:0.0:1784189365.512583:0:96879:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].58, 224 off18320 00000040:00080000:0.0:1784189365.512595:0:96879:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].59, 136 off18456 00000040:00080000:0.0:1784189365.512606:0:96879:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].60, 224 off18680 00000040:00080000:0.0:1784189365.512619:0:96879:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].61, 224 off18904 00000040:00080000:0.0:1784189365.512648:0:96879:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].62, 112 off19016 00000020:00000040:0.0:1784189365.512657:0:96879:0:(genops.c:1231:class_import_get()) import ffff9dc07110c800 refcount=4 obd=MGC192.168.203.112@tcp 00000020:00000040:0.0:1784189365.512661:0:96879:0:(genops.c:1231:class_import_get()) import ffff9dc07110c800 refcount=5 obd=MGC192.168.203.112@tcp 00000100:00000040:0.0:1784189365.512681:0:96879:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff9dc05edd1180 x1870854458273024/t0(0) o502->MGC192.168.203.112@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 0 ref 2 fl New:QU/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784189365.512691:0:96879:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc05edd1180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd553d0d-03e2-4233-b06b-b55bbfa2b954:96879:1870854458273024:0@lo:502:mount.lustre.0 00000100:00000040:0.0:1784189365.512715:0:96879:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff9dc05edd1180 x1870854458273024/t0(0) o502->MGC192.168.203.112@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1784189381 ref 3 fl Rpc:r/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1784189365.513932:0:96879:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1784189365.513979:0:96879:0:(events.c:337:request_in_callback()) incoming req@ffff9dc044984850 x1870854458273024 msgsize 272 00000100:00100000:0.0:1784189365.513985:0:96879:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:0.0:1784189365.513987:0:96879:0:(events.c:349:request_in_callback()) Buffer complete: 63 buffers still posted 00000100:00000040:0.0:1784189365.514082:0:96879:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 2 req@ffff9dc05edd1180 x1870854458273024/t0(0) o502->MGC192.168.203.112@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1784189381 ref 3 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784189365.514109:0:96879:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dbf45865900 going to sleep for 11 seconds 00000100:00100000:3.0:1784189365.532197:0:94308:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458273024 00000100:00100000:3.0:1784189365.532216:0:94308:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458273024 00000020:00000040:3.0:1784189365.532220:0:94308:0:(genops.c:825:class_conn2export()) looking for export cookie 0xcc1762b626f8c573 00000020:00000040:3.0:1784189365.532225:0:94308:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9dc050ae5000 refcount=24 00000100:00000040:3.0:1784189365.532247:0:94308:0:(service.c:1432:ptlrpc_at_set_timer()) armed mgs at +6s 00000100:00100000:3.0:1784189365.532276:0:94308:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 203 00000100:00000040:3.0:1784189365.532281:0:94308:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9dc050ae5000 : new rpc_count 1 00000100:00000040:3.0:1784189365.532288:0:94308:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9dc044984850 x1870854458273024/t0(0) o502->bd553d0d-03e2-4233-b06b-b55bbfa2b954@0@lo:556/0 lens 272/0 e 0 to 0 dl 1784189376 ref 1 fl New:/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784189365.532300:0:94308:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc044984850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd553d0d-03e2-4233-b06b-b55bbfa2b954+24:96879:x1870854458273024:12345-0@lo:502:mount.lustre.0 00000040:00000040:3.0:1784189365.532345:0:94308:0:(lustre_log.h:387:llog_ctxt_get()) GETting ctxt ffff9dc04811d3c0 : new refcount 2 00000040:00000040:3.0:1784189365.532399:0:94308:0:(lustre_log.h:402:llog_ctxt_put()) PUTting ctxt ffff9dc04811d3c0 : new refcount 1 00010000:00000040:3.0:1784189365.532404:0:94308:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 0, transno 0, xid 1870854458273024 00000100:00000040:3.0:1784189365.532415:0:94308:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9dc0710a1d00 refcount 52 to 0@lo 00000100:00000040:3.0:1784189365.532420:0:94308:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:3.0:1784189365.532467:0:94308:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=8472 offset=224 replen=8472 req@ffff9dc05edd1180 x1870854458273024/t0(0) o502->MGC192.168.203.112@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1784189381 ref 2 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1784189365.532489:0:94308:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff9dc0710a1d00 refcount 51 to 0@lo 00000100:00000040:3.0:1784189365.532494:0:94308:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9dc044984850 x1870854458273024/t0(0) o502->bd553d0d-03e2-4233-b06b-b55bbfa2b954@0@lo:556/0 lens 272/8472 e 0 to 0 dl 1784189376 ref 1 fl Interpret:/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784189365.532502:0:94308:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc044984850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd553d0d-03e2-4233-b06b-b55bbfa2b954+24:96879:x1870854458273024:12345-0@lo:502:mount.lustre.0 Request processed in 203us (18521us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189365.532515:0:94308:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 203 00000100:00000040:3.0:1784189365.532518:0:94308:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9dc050ae5000 : new rpc_count 0 00000020:00000040:3.0:1784189365.532526:0:94308:0:(genops.c:900:class_export_put()) PUTting export ffff9dc050ae5000 : new refcount 23 00000100:00000040:0.0:1784189365.533090:0:96879:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff9dc05edd1180 x1870854458273024/t0(0) o502->MGC192.168.203.112@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1784189381 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1784189365.533102:0:96879:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9dc05edd1180 x1870854458273024/t0(0) o502->MGC192.168.203.112@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1784189381 ref 2 fl Interpret:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784189365.533110:0:96879:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc05edd1180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd553d0d-03e2-4233-b06b-b55bbfa2b954:96879:1870854458273024:0@lo:502:mount.lustre.0 00000100:00000040:0.0:1784189365.533118:0:96879:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff9dc05edd1180 x1870854458273024/t0(0) o502->MGC192.168.203.112@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1784189381 ref 2 fl Complete:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1784189365.533132:0:96879:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff9dc05edd1180 x1870854458273024/t0(0) o502->MGC192.168.203.112@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1784189381 ref 1 fl Complete:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000020:00000040:0.0:1784189365.533148:0:96879:0:(genops.c:1244:class_import_put()) import ffff9dc07110c800 refcount=4 obd=MGC192.168.203.112@tcp 00000020:00000040:0.0:1784189365.533156:0:96879:0:(genops.c:1244:class_import_put()) import ffff9dc07110c800 refcount=3 obd=MGC192.168.203.112@tcp 00000040:00080000:0.0:1784189365.533220:0:96879:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].63, 224 off19240 00000040:00080000:0.0:1784189365.533232:0:96879:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 63 count 63 10000000:00000040:0.0:1784189365.533511:0:96879:0:(lustre_log.h:402:llog_ctxt_put()) PUTting ctxt ffff9dc074ac7e40 : new refcount 1 00000020:00000040:0.0:1784189365.533516:0:96879:0:(obd_config.c:2122:class_config_parse_llog()) looking up llog lustre-client 00000100:00000040:3.0:1784189365.534717:0:96890:0:(lustre_peer.c:130:class_add_uuid()) found uuid 192.168.203.112@tcp 192.168.203.112@tcp cnt=1 00000020:01000004:3.0:1784189365.534751:0:96890:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:3.0:1784189365.534764:0:96890:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff9dc07196b380) 00000020:00000040:3.0:1784189365.534777:0:96890:0:(lustre_handles.c:93:class_handle_hash()) added object ffff9dc06bb5f800 with handle 0xcc1762b626f8d58e to hash 00000020:00000040:3.0:1784189365.534782:0:96890:0:(genops.c:900:class_export_put()) PUTting export ffff9dc06bb5f800 : new refcount 1 00000020:00000040:3.0:1784189365.534797:0:96890:0:(obd_config.c:994:class_incref()) incref lustre-MDT0000-lwp-OST0000 (ffff9dc07196b380) now 2 - obd_device_list 00000020:00000080:3.0:1784189365.534803:0:96890:0:(obd_config.c:720:class_attach_name()) OBD: dev 19 attached type lwp with refcount 2 00000020:01000004:3.0:1784189365.534961:0:96890:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9dc0762e7000 from lustre-OST0000, refs=3 00000020:01000004:3.0:1784189365.534965:0:96890:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9dc0762e7000 from lustre-OST0000, refs=3 00000020:01000004:3.0:1784189365.534968:0:96890:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9dc0762e7000 3 00000020:00000040:3.0:1784189365.534983:0:96890:0:(obd_config.c:994:class_incref()) incref lustre-MDT0000-lwp-OST0000 (ffff9dc07196b380) now 3 - import 00000020:00000040:3.0:1784189365.534988:0:96890:0:(genops.c:1244:class_import_put()) import ffff9dbf43d8c000 refcount=1 obd=lustre-MDT0000-lwp-OST0000 00000100:00000040:3.0:1784189365.535000:0:96890:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9dc0710a1d00 refcount 52 to 0@lo 00000100:00000040:3.0:1784189365.535003:0:96890:0:(connection.c:149:ptlrpc_connection_get()) conn=ffff9dc0710a1d00 refcount 52 to 0@lo 00000100:00000040:3.0:1784189365.535005:0:96890:0:(client.c:137:ptlrpc_uuid_to_connection()) 192.168.203.112@tcp -> ffff9dc0710a1d00 00010000:00080000:3.0:1784189365.535009:0:96890:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9dbf43d8c000@lustre-MDT0000-lwp-OST0000: add connection 192.168.203.112@tcp at head 00010000:00010000:3.0:1784189365.536657:0:96890:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-11 is initialized 00000020:00000040:3.0:1784189365.536755:0:96890:0:(obd_config.c:994:class_incref()) incref lustre-MDT0000-lwp-OST0000 (ffff9dc07196b380) now 4 - setup 00000020:00000080:3.0:1784189365.536760:0:96890:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:3.0:1784189365.536797:0:96890:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000040:3.0:1784189365.536805:0:96890:0:(lustre_handles.c:93:class_handle_hash()) added object ffff9dc04ffb5800 with handle 0xcc1762b626f8d595 to hash 00000020:00000040:3.0:1784189365.536811:0:96890:0:(genops.c:889:class_export_get()) GET export ffff9dc04ffb5800 refcount=3 00000020:00000040:3.0:1784189365.536815:0:96890:0:(obd_config.c:994:class_incref()) incref lustre-MDT0000-lwp-OST0000 (ffff9dc07196b380) now 5 - export 00000020:00000040:3.0:1784189365.536818:0:96890:0:(genops.c:900:class_export_put()) PUTting export ffff9dc04ffb5800 : new refcount 2 00000020:00000080:3.0:1784189365.536820:0:96890:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0xcc1762b626f8d595 00000020:00000040:3.0:1784189365.536822:0:96890:0:(genops.c:825:class_conn2export()) looking for export cookie 0xcc1762b626f8d595 00000020:00000040:3.0:1784189365.536830:0:96890:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9dc04ffb5800 refcount=3 00000100:00080000:3.0:1784189365.536837:0:96890:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00000040:3.0:1784189365.536842:0:96890:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9dc0710a1d00 refcount 53 to 0@lo 00000020:00000040:3.0:1784189365.536845:0:96890:0:(genops.c:825:class_conn2export()) looking for export cookie 0xcc1762b626f8d595 00000020:00000040:3.0:1784189365.536846:0:96890:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9dc04ffb5800 refcount=4 00000100:00000040:3.0:1784189365.536848:0:96890:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9dc0710a1d00 refcount 54 to 0@lo 00000020:00000040:3.0:1784189365.536850:0:96890:0:(genops.c:900:class_export_put()) PUTting export ffff9dc04ffb5800 : new refcount 3 00000100:00080000:3.0:1784189365.536853:0:96890:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9dbf43d8c000 using connection 192.168.203.112@tcp/0@lo 00000020:00000040:3.0:1784189365.536867:0:96890:0:(genops.c:1231:class_import_get()) import ffff9dbf43d8c000 refcount=2 obd=lustre-MDT0000-lwp-OST0000 00000100:00100000:3.0:1784189365.536890:0:96890:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9dc071537b80 x1870854458273152/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:3.0:1784189365.536905:0:96890:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [0000000089a0722f] to pc [ptlrpcd_rcv+-1] req@ffff9dc071537b80 x1870854458273152/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1784189365.536930:0:96890:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000020:00000040:3.0:1784189365.536934:0:96890:0:(genops.c:1231:class_import_get()) import ffff9dbf43d8c000 refcount=3 obd=lustre-MDT0000-lwp-OST0000 00000100:00000040:1.0:1784189365.539907:0:3639:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff9dc071537b80 x1870854458273152/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784189365.539926:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc071537b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3639:1870854458273152:0@lo:38:llog_process_th.0 00000100:00000040:1.0:1784189365.539965:0:3639:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff9dc071537b80 x1870854458273152/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1784189375 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1784189365.539974:0:3639:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:1.0:1784189365.540014:0:3639:0:(events.c:337:request_in_callback()) incoming req@ffff9dc080e7f480 x1870854458273152 msgsize 520 00000100:00100000:1.0:1784189365.540020:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:1.0:1784189365.540038:0:3639:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff9dc071537b80 x1870854458273152/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1784189375 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1784189365.540050:0:3639:0:(niobuf.c:635:kick_cpu_latency()) lustre-MDT0000-lwp-OST0000: using a timeout of 0 usecs (0 jiffies) 00000100:00000040:1.0:1784189365.540092:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000020:00000040:1.0:1784189365.540101:0:36:0:(genops.c:1231:class_import_get()) import ffff9dbf425f4800 refcount=3 obd=lustre-MDT0000-lwp-OST0001 00000100:00000040:1.0:1784189365.540117:0:36:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID req@ffff9dc080e7d880 x1870854458273280/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:1.0:1784189365.540131:0:36:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [00000000d7139c41] to pc [ptlrpcd_00_03+3] req@ffff9dc080e7d880 x1870854458273280/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1784189365.540166:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000020:00000040:1.0:1784189365.540173:0:36:0:(genops.c:1231:class_import_get()) import ffff9dbf43115800 refcount=3 obd=lustre-MDT0001-lwp-OST0001 00000100:00000040:1.0:1784189365.540181:0:36:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID req@ffff9dc080e7ea00 x1870854458273408/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:1.0:1784189365.540190:0:36:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [000000000d13032f] to pc [ptlrpcd_00_00+0] req@ffff9dc080e7ea00 x1870854458273408/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1784189365.540206:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000020:00000040:1.0:1784189365.540221:0:36:0:(genops.c:1231:class_import_get()) import ffff9dbf436c4000 refcount=3 obd=lustre-MDT0000-osp-MDT0001 00000100:00000040:1.0:1784189365.540230:0:36:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID req@ffff9dc080e7f100 x1870854458273536/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1784189365.540232:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00000040:1.0:1784189365.540245:0:36:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [00000000e1b7dcc6] to pc [ptlrpcd_00_01+1] req@ffff9dc080e7f100 x1870854458273536/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1784189365.540249:0:3642:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff9dc080e7d880 x1870854458273280/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1784189365.540262:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1784189365.540267:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00100000:2.0:1784189365.540269:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc080e7d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3642:1870854458273280:0@lo:400:kworker.0 00000100:00080000:1.0:1784189365.540271:0:36:0:(import.c:65:import_set_state_nolock()) ffff9dbf43114800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1784189365.540279:0:36:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 3605 00000100:00080000:1.0:1784189365.540284:0:36:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 20s 00000100:00000040:1.0:1784189365.540286:0:36:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff9dc0710a1d00 refcount 53 to 0@lo 00000100:00000040:1.0:1784189365.540290:0:36:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9dc0710a1d00 refcount 54 to 0@lo 00000100:00000040:2.0:1784189365.540293:0:3642:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff9dc080e7d880 x1870854458273280/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784189381 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:1.0:1784189365.540294:0:36:0:(genops.c:825:class_conn2export()) looking for export cookie 0xcc1762b626f86499 00000020:00000040:1.0:1784189365.540300:0:36:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9dc0477d0000 refcount=4 00000100:00000040:1.0:1784189365.540306:0:36:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff9dc0710a1d00 refcount 53 to 0@lo 00000100:00000040:2.0:1784189365.540311:0:3642:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:1.0:1784189365.540312:0:36:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9dc0710a1d00 refcount 54 to 0@lo 00000020:00000040:1.0:1784189365.540316:0:36:0:(genops.c:900:class_export_put()) PUTting export ffff9dc0477d0000 : new refcount 3 00000100:00000040:2.0:1784189365.540352:0:3642:0:(events.c:337:request_in_callback()) incoming req@ffff9dc07130d180 x1870854458273280 msgsize 224 00000100:00100000:2.0:1784189365.540359:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:2.0:1784189365.540374:0:3642:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff9dc080e7d880 x1870854458273280/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784189381 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1784189365.540385:0:3642:0:(niobuf.c:635:kick_cpu_latency()) lustre-MDT0000-lwp-OST0001: using a timeout of 7610 usecs (8 jiffies) 00000100:00080000:1.0:1784189365.540484:0:36:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff9dbf43114800 using connection 192.168.203.112@tcp/0@lo 00000020:00000040:1.0:1784189365.540495:0:36:0:(genops.c:1231:class_import_get()) import ffff9dbf43114800 refcount=3 obd=lustre-OST0000-osc-MDT0001 00000100:00100000:1.0:1784189365.540508:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9dc080e7df80 x1870854458273664/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:1.0:1784189365.540519:0:36:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [000000004bf53187] to pc [ptlrpcd_rcv+-1] req@ffff9dc080e7df80 x1870854458273664/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784189365.540536:0:66170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458273152 00000100:00000040:1.0:1784189365.540540:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00100000:0.0:1784189365.540544:0:66170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458273152 00000020:00000040:1.0:1784189365.540547:0:36:0:(genops.c:1231:class_import_get()) import ffff9dc080cc8800 refcount=3 obd=lustre-OST0001-osc-MDT0001 00000020:00000040:0.0:1784189365.540548:0:66170:0:(genops.c:825:class_conn2export()) looking for export cookie 0x0 00000100:00000040:1.0:1784189365.540560:0:36:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID req@ffff9dc080e7e300 x1870854458273792/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:1.0:1784189365.540576:0:36:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [00000000c1976ed2] to pc [ptlrpcd_00_02+2] req@ffff9dc080e7e300 x1870854458273792/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1784189365.540602:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00000040:2.0:1784189365.540608:0:3639:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff9dc080e7df80 x1870854458273664/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:1.0:1784189365.540612:0:36:0:(genops.c:1231:class_import_get()) import ffff9dbf43690800 refcount=3 obd=lustre-MDT0000-lwp-MDT0001 00000100:00000040:1.0:1784189365.540625:0:36:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID req@ffff9dbf43e10e00 x1870854458273920/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1784189365.540626:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc080e7df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3639:1870854458273664:0@lo:8:kworker.0 00000100:00000040:1.0:1784189365.540650:0:36:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [000000006b951afb] to pc [ptlrpcd_00_03+3] req@ffff9dbf43e10e00 x1870854458273920/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1784189365.540656:0:3639:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff9dc080e7df80 x1870854458273664/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 1784189390 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1784189365.540663:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00000040:2.0:1784189365.540669:0:3639:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000020:00000040:1.0:1784189365.540672:0:36:0:(genops.c:1231:class_import_get()) import ffff9dbf436c1800 refcount=3 obd=lustre-MDT0001-osp-MDT0000 00000100:00000040:1.0:1784189365.540683:0:36:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID req@ffff9dbf43e10000 x1870854458274048/t0(0) o400->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:2.0:1784189365.540689:0:3639:0:(events.c:337:request_in_callback()) incoming req@ffff9dc07130f480 x1870854458273664 msgsize 520 00000100:00100000:2.0:1784189365.540696:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:1.0:1784189365.540704:0:36:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [000000008995f157] to pc [ptlrpcd_00_00+0] req@ffff9dbf43e10000 x1870854458274048/t0(0) o400->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1784189365.540712:0:3639:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff9dc080e7df80 x1870854458273664/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 1784189390 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1784189365.540717:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1784189365.540722:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1784189365.540724:0:36:0:(import.c:65:import_set_state_nolock()) ffff9dc075655000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1784189365.540728:0:36:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 3605 00000100:00080000:1.0:1784189365.540731:0:36:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 20s 00000100:00000040:1.0:1784189365.540735:0:36:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff9dc0710a1d00 refcount 53 to 0@lo 00000100:00000040:1.0:1784189365.540742:0:36:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9dc0710a1d00 refcount 54 to 0@lo 00000020:00000040:1.0:1784189365.540746:0:36:0:(genops.c:825:class_conn2export()) looking for export cookie 0xcc1762b626f8c629 00000020:00000040:1.0:1784189365.540748:0:36:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9dc047a84000 refcount=4 00000100:00000040:2.0:1784189365.540751:0:3639:0:(niobuf.c:635:kick_cpu_latency()) lustre-OST0000-osc-MDT0001: using a timeout of 4973 usecs (5 jiffies) 00000100:00000040:1.0:1784189365.540752:0:36:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff9dc0710a1d00 refcount 53 to 0@lo 00000100:00000040:1.0:1784189365.540763:0:36:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9dc0710a1d00 refcount 54 to 0@lo 00000020:00000040:1.0:1784189365.540766:0:36:0:(genops.c:900:class_export_put()) PUTting export ffff9dc047a84000 : new refcount 3 00000100:00080000:1.0:1784189365.540769:0:36:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9dc075655000 using connection 192.168.203.112@tcp/0@lo 00000020:00000040:1.0:1784189365.540775:0:36:0:(genops.c:1231:class_import_get()) import ffff9dc075655000 refcount=3 obd=lustre-OST0000-osc-MDT0000 00000100:00100000:1.0:1784189365.540785:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9dbf43e13480 x1870854458274176/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:1.0:1784189365.540794:0:36:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [00000000e5c1c904] to pc [ptlrpcd_rcv+-1] req@ffff9dbf43e13480 x1870854458274176/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784189365.540900:0:66170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458273280 00000100:00100000:0.0:1784189365.540909:0:66170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458273280 00000020:00000040:0.0:1784189365.540911:0:66170:0:(genops.c:825:class_conn2export()) looking for export cookie 0xcc1762b626f8c780 00000020:00000040:0.0:1784189365.540914:0:66170:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9dbf46b0a800 refcount=5 00000020:00000040:0.0:1784189365.540926:0:66170:0:(obd_config.c:994:class_incref()) incref lustre-MDT0000 (ffff9dc075478000) now 14 - evictor 00000100:00000040:0.0:1784189365.540986:0:66170:0:(service.c:1432:ptlrpc_at_set_timer()) armed mdt at +6s 00000100:00100000:0.0:1784189365.541007:0:66170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1384 00000100:00000040:0.0:1784189365.541011:0:66170:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9dbf46b0a800 : new rpc_count 1 00000100:00000040:0.0:1784189365.541016:0:66170:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9dc07130d180 x1870854458273280/t0(0) o400->lustre-MDT0000-lwp-OST0001_UUID@0@lo:556/0 lens 224/0 e 0 to 0 dl 1784189376 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784189365.541028:0:66170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc07130d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3642:x1870854458273280:12345-0@lo:400:kworker.0 00010000:00000040:0.0:1784189365.541045:0:66170:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 0, transno 0, xid 1870854458273280 00000100:00000040:0.0:1784189365.541053:0:66170:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9dc0710a1d00 refcount 55 to 0@lo 00000100:00000040:0.0:1784189365.541058:0:66170:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1784189365.541077:0:66170:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff9dc080e7d880 x1870854458273280/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784189381 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1784189365.541090:0:66170:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff9dc0710a1d00 refcount 54 to 0@lo 00000100:00000040:0.0:1784189365.541094:0:66170:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9dc07130d180 x1870854458273280/t0(0) o400->lustre-MDT0000-lwp-OST0001_UUID@0@lo:556/0 lens 224/224 e 0 to 0 dl 1784189376 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784189365.541102:0:66170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc07130d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3642:x1870854458273280:12345-0@lo:400:kworker.0 Request processed in 76us (748us total) trans 0 rc 0/0 00000100:00100000:0.0:1784189365.541109:0:66170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1384 00000100:00000040:0.0:1784189365.541112:0:66170:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9dbf46b0a800 : new rpc_count 0 00000020:00000040:0.0:1784189365.541120:0:66170:0:(genops.c:900:class_export_put()) PUTting export ffff9dbf46b0a800 : new refcount 4 00000100:00100000:0.0:1784189365.541129:0:66170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1578 00000100:00000040:0.0:1784189365.541133:0:66170:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9dc080e7f480 x1870854458273152/t0(0) o38->@:0/0 lens 520/0 e 0 to 0 dl 1784189385 ref 1 fl New:/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784189365.541141:0:66170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc080e7f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3639:x1870854458273152:12345-0@lo:38:llog_process_th.0 00000020:00000040:0.0:1784189365.541154:0:66170:0:(obd_config.c:994:class_incref()) incref lustre-MDT0000 (ffff9dc075478000) now 15 - find 00010000:00000040:0.0:1784189365.541168:0:66170:0:(ldlm_lib.c:1264:target_handle_connect()) lustre-MDT0000: ocd_connect_flags: 0x2041401043000022 tmp_exp_old_falloc: 0 00010000:00080000:0.0:1784189365.541175:0:66170:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 3607 last 0 00000020:00000040:0.0:1784189365.541186:0:66170:0:(lustre_handles.c:93:class_handle_hash()) added object ffff9dc07118b800 with handle 0xcc1762b626f8d59c to hash 00000100:00000040:1.0:1784189365.541187:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000020:00000040:1.0:1784189365.541196:0:36:0:(genops.c:1231:class_import_get()) import ffff9dbf4845c000 refcount=3 obd=lustre-OST0001-osc-MDT0000 00000100:00000040:1.0:1784189365.541207:0:36:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID req@ffff9dbf43e10700 x1870854458274304/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000020:00000040:0.0:1784189365.541213:0:66170:0:(genops.c:889:class_export_get()) GET export ffff9dc07118b800 refcount=3 00000100:00000040:1.0:1784189365.541220:0:36:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [0000000020f97acd] to pc [ptlrpcd_00_01+1] req@ffff9dbf43e10700 x1870854458274304/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:0.0:1784189365.541220:0:66170:0:(obd_config.c:994:class_incref()) incref lustre-MDT0000 (ffff9dc075478000) now 16 - export 00000020:00000040:0.0:1784189365.541226:0:66170:0:(genops.c:900:class_export_put()) PUTting export ffff9dc07118b800 : new refcount 2 00000020:00000080:0.0:1784189365.541232:0:66170:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0xcc1762b626f8d59c 00000100:00000040:1.0:1784189365.541234:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000020:00000040:0.0:1784189365.541236:0:66170:0:(genops.c:825:class_conn2export()) looking for export cookie 0xcc1762b626f8d59c 00000020:00000040:0.0:1784189365.541239:0:66170:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9dc07118b800 refcount=3 00000020:00000040:1.0:1784189365.541244:0:36:0:(genops.c:1231:class_import_get()) import ffff9dbf43fcb000 refcount=3 obd=lustre-MDT0000-lwp-MDT0000 00000001:00000040:0.0:1784189365.541250:0:66170:0:(nodemap_handler.c:533:nodemap_classify_nid()) found nid 192.168.203.112@tcp 00000100:00000040:1.0:1784189365.541254:0:36:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID req@ffff9dbf43e13100 x1870854458274432/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000001:00000040:0.0:1784189365.541257:0:66170:0:(nodemap_handler.c:99:nodemap_getref()) GETting nodemap default(p=ffff9dc07fa60400) : new refcount 17 00000020:00000040:0.0:1784189365.541263:0:66170:0:(genops.c:889:class_export_get()) GET export ffff9dc07118b800 refcount=4 00000001:00000040:0.0:1784189365.541266:0:66170:0:(nodemap_handler.c:99:nodemap_getref()) GETting nodemap default(p=ffff9dc07fa60400) : new refcount 18 00000100:00000040:1.0:1784189365.541271:0:36:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [000000000ac29d99] to pc [ptlrpcd_00_02+2] req@ffff9dbf43e13100 x1870854458274432/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000001:00000040:0.0:1784189365.541272:0:66170:0:(nodemap_handler.c:115:nodemap_putref()) PUTting nodemap default(p=ffff9dc07fa60400) : new refcount 17 00000004:00100000:0.0:1784189365.541280:0:66170:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00000040:1.0:1784189365.541287:0:36:0:(pinger.c:304:ptlrpc_pinger_main()) next wakeup in 5 (3612) 00000020:00000040:0.0:1784189365.541291:0:66170:0:(lprocfs_status_server.c:693:lprocfs_exp_setup()) Found stats ffff9dbf451b7180 for nid 0@lo - ref 6 00000020:00000040:0.0:1784189365.541299:0:66170:0:(obd_config.c:994:class_incref()) incref lustre-MDT0000 (ffff9dc075478000) now 17 - import 00000020:00000040:0.0:1784189365.541305:0:66170:0:(genops.c:1244:class_import_put()) import ffff9dc071188800 refcount=1 obd=lustre-MDT0000 00000020:00000040:0.0:1784189365.541311:0:66170:0:(genops.c:889:class_export_get()) GET export ffff9dc07118b800 refcount=5 00000100:00000040:0.0:1784189365.541313:0:66170:0:(service.c:1082:ptlrpc_request_change_export()) RPC GETting export ffff9dc07118b800 : new rpc_count 1 00000100:00000040:1.0:1784189365.541340:0:3641:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff9dc080e7f100 x1870854458273536/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1784189365.541342:0:66170:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9dc0710a1d00 refcount 55 to 0@lo 00000100:00000040:0.0:1784189365.541349:0:66170:0:(connection.c:149:ptlrpc_connection_get()) conn=ffff9dc0710a1d00 refcount 55 to 0@lo 00000020:00000040:0.0:1784189365.541355:0:66170:0:(genops.c:889:class_export_get()) GET export ffff9dc07118b800 refcount=6 00000100:00100000:1.0:1784189365.541359:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc080e7f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1870854458273536:0@lo:400:kworker.0 00000100:00000040:0.0:1784189365.541365:0:66170:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9dc0710a1d00 refcount 56 to 0@lo 00000100:00080000:0.0:1784189365.541373:0:66170:0:(import.c:65:import_set_state_nolock()) ffff9dc071188800 : changing import state from RECOVER to FULL 00000020:00000040:0.0:1784189365.541379:0:66170:0:(genops.c:900:class_export_put()) PUTting export ffff9dc07118b800 : new refcount 5 00000100:00000040:1.0:1784189365.541380:0:3641:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff9dc080e7f100 x1870854458273536/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1784189381 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:0.0:1784189365.541383:0:66170:0:(obd_config.c:1022:class_decref()) Decref lustre-MDT0000 (ffff9dc075478000) now 17 - find 00010000:00000040:0.0:1784189365.541392:0:66170:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 0, transno 0, xid 1870854458273152 00000100:00000040:1.0:1784189365.541397:0:3641:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1784189365.541401:0:66170:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9dc0710a1d00 refcount 57 to 0@lo 00000100:00000040:0.0:1784189365.541407:0:66170:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:1.0:1784189365.541418:0:3641:0:(events.c:337:request_in_callback()) incoming req@ffff9dbf43e12d80 x1870854458273536 msgsize 224 00000100:00100000:1.0:1784189365.541424:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:1.0:1784189365.541439:0:3641:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff9dc080e7f100 x1870854458273536/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1784189381 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1784189365.541450:0:3641:0:(niobuf.c:635:kick_cpu_latency()) lustre-MDT0000-osp-MDT0001: using a timeout of 1808775 usecs (1809 jiffies) 00000100:00000040:0.0:1784189365.541450:0:66170:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=416 offset=0 replen=544 req@ffff9dc071537b80 x1870854458273152/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1784189375 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1784189365.541461:0:3641:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff9dbf43e10700 x1870854458274304/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784189365.541471:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf43e10700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1870854458274304:0@lo:400:kworker.0 00000100:00000040:0.0:1784189365.541475:0:66170:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff9dc0710a1d00 refcount 56 to 0@lo 00000100:00000040:0.0:1784189365.541482:0:66170:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9dc080e7f480 x1870854458273152/t0(0) o38->lustre-MDT0000-lwp-OST0000_UUID@0@lo:0/0 lens 520/416 e 0 to 0 dl 1784189385 ref 1 fl Interpret:/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1784189365.541488:0:3641:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff9dbf43e10700 x1870854458274304/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784189381 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784189365.541496:0:66170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc080e7f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1870854458273152:12345-0@lo:38:llog_process_th.0 Request processed in 351us (1478us total) trans 0 rc 0/0 00000100:00000040:1.0:1784189365.541503:0:3641:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00100000:0.0:1784189365.541510:0:66170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1578 00000100:00000040:0.0:1784189365.541513:0:66170:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9dc07118b800 : new rpc_count 0 00000020:00000040:0.0:1784189365.541520:0:66170:0:(genops.c:900:class_export_put()) PUTting export ffff9dc07118b800 : new refcount 4 00000100:00000040:0.0:1784189365.541536:0:3640:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff9dc080e7ea00 x1870854458273408/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784189365.541544:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc080e7ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3640:1870854458273408:0@lo:400:kworker.0 00000100:00000040:0.0:1784189365.541557:0:3640:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff9dc080e7ea00 x1870854458273408/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784189381 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1784189365.541564:0:3640:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1784189365.541578:0:3640:0:(events.c:337:request_in_callback()) incoming req@ffff9dc05edd1180 x1870854458273408 msgsize 224 00000100:00100000:0.0:1784189365.541582:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:0.0:1784189365.541595:0:3640:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff9dc080e7ea00 x1870854458273408/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784189381 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1784189365.541604:0:3640:0:(niobuf.c:635:kick_cpu_latency()) lustre-MDT0001-lwp-OST0001: using a timeout of 7111 usecs (8 jiffies) 00000100:00000040:0.0:1784189365.541610:0:3640:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff9dbf43e10000 x1870854458274048/t0(0) o400->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784189365.541617:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf43e10000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1870854458274048:0@lo:400:kworker.0 00000100:00000040:1.0:1784189365.541626:0:3641:0:(events.c:337:request_in_callback()) incoming req@ffff9dbf43e12a00 x1870854458274304 msgsize 224 00000100:00000040:0.0:1784189365.541639:0:3640:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff9dbf43e10000 x1870854458274048/t0(0) o400->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1784189381 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784189365.541646:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:0.0:1784189365.541666:0:3640:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:1.0:1784189365.541668:0:3641:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff9dbf43e10700 x1870854458274304/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784189381 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1784189365.541681:0:3641:0:(niobuf.c:635:kick_cpu_latency()) lustre-OST0001-osc-MDT0000: using a timeout of 6762 usecs (7 jiffies) 00000100:00000040:0.0:1784189365.541685:0:3640:0:(events.c:337:request_in_callback()) incoming req@ffff9dc05edd0e00 x1870854458274048 msgsize 224 00000100:00100000:0.0:1784189365.541693:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:0.0:1784189365.541708:0:3640:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff9dbf43e10000 x1870854458274048/t0(0) o400->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1784189381 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784189365.541715:0:66169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458273408 00000100:00100000:1.0:1784189365.541720:0:66169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458273408 00000020:00000040:1.0:1784189365.541722:0:66169:0:(genops.c:825:class_conn2export()) looking for export cookie 0xcc1762b626f86541 00000020:00000040:1.0:1784189365.541725:0:66169:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9dbf43d8f800 refcount=5 00000100:00000040:0.0:1784189365.541729:0:3640:0:(niobuf.c:635:kick_cpu_latency()) lustre-MDT0001-osp-MDT0000: using a timeout of 7645 usecs (8 jiffies) 00000020:00000040:1.0:1784189365.541736:0:66169:0:(obd_config.c:994:class_incref()) incref lustre-MDT0001 (ffff9dc071094d40) now 10 - evictor 00000100:00100000:0.0:1784189365.542220:0:26169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458273664 00000100:00100000:0.0:1784189365.542225:0:26169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458273664 00000020:00000040:0.0:1784189365.542227:0:26169:0:(genops.c:825:class_conn2export()) looking for export cookie 0xcc1762b626f864ae 00000100:00100000:0.0:1784189365.542254:0:26169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458274304 00000100:00100000:0.0:1784189365.542256:0:26169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458274304 00000020:00000040:0.0:1784189365.542258:0:26169:0:(genops.c:825:class_conn2export()) looking for export cookie 0xcc1762b626f8c64c 00000020:00000040:0.0:1784189365.542260:0:26169:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9dbf47452800 refcount=5 00000020:00000040:0.0:1784189365.542268:0:26169:0:(obd_config.c:994:class_incref()) incref lustre-OST0001 (ffff9dbf4312b380) now 10 - evictor 00000100:00080000:2.0:1784189365.542637:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000020:00000040:2.0:1784189365.542641:0:6509:0:(obd_config.c:1022:class_decref()) Decref lustre-OST0001 (ffff9dbf4312b380) now 10 - evictor 00000100:00080000:2.0:1784189365.542645:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000020:00000040:2.0:1784189365.542647:0:6509:0:(obd_config.c:1022:class_decref()) Decref lustre-MDT0001 (ffff9dc071094d40) now 10 - evictor 00000100:00080000:2.0:1784189365.542649:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000020:00000040:2.0:1784189365.542651:0:6509:0:(obd_config.c:1022:class_decref()) Decref lustre-MDT0000 (ffff9dc075478000) now 16 - evictor 00000100:00000040:1.0:1784189365.545853:0:66169:0:(service.c:1432:ptlrpc_at_set_timer()) armed mdt at +6s 00000100:00000040:0.0:1784189365.546703:0:26169:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost at +6s 00000100:00100000:0.0:1784189365.546799:0:26169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2613 00000100:00000040:0.0:1784189365.546804:0:26169:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9dbf47452800 : new rpc_count 1 00000100:00000040:0.0:1784189365.546813:0:26169:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9dbf43e12a00 x1870854458274304/t0(0) o400->lustre-MDT0000-mdtlov_UUID@0@lo:556/0 lens 224/0 e 0 to 0 dl 1784189376 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784189365.546829:0:26169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf43e12a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+5:3641:x1870854458274304:12345-0@lo:400:kworker.0 00010000:00000040:0.0:1784189365.546850:0:26169:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 4294968960, transno 0, xid 1870854458274304 00000100:00000040:0.0:1784189365.546859:0:26169:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9dc0710a1d00 refcount 57 to 0@lo 00000100:00000040:0.0:1784189365.546864:0:26169:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1784189365.546907:0:26169:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff9dbf43e10700 x1870854458274304/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784189381 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1784189365.546933:0:26169:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff9dc0710a1d00 refcount 56 to 0@lo 00000100:00000040:0.0:1784189365.546938:0:26169:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9dbf43e12a00 x1870854458274304/t0(0) o400->lustre-MDT0000-mdtlov_UUID@0@lo:556/0 lens 224/224 e 0 to 0 dl 1784189376 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784189365.546961:0:26169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf43e12a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+5:3641:x1870854458274304:12345-0@lo:400:kworker.0 Request processed in 136us (5333us total) trans 0 rc 0/0 00000100:00100000:0.0:1784189365.546969:0:26169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2613 00000100:00000040:0.0:1784189365.546972:0:26169:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9dbf47452800 : new rpc_count 0 00000020:00000040:0.0:1784189365.546981:0:26169:0:(genops.c:900:class_export_put()) PUTting export ffff9dbf47452800 : new refcount 4 00000100:00100000:0.0:1784189365.546990:0:26169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5076 00000100:00000040:0.0:1784189365.546995:0:26169:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9dc07130f480 x1870854458273664/t0(0) o8->@:0/0 lens 520/0 e 0 to 0 dl 1784189385 ref 1 fl New:/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784189365.547004:0:26169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc07130f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:0+-99:3639:x1870854458273664:12345-0@lo:8:kworker.0 00000020:00000040:0.0:1784189365.547021:0:26169:0:(obd_config.c:994:class_incref()) incref lustre-OST0000 (ffff9dc07a7a0000) now 7 - find 00010000:00000040:0.0:1784189365.547025:0:26169:0:(ldlm_lib.c:1213:target_handle_connect()) lustre-OST0000: Temporarily refusing client connection from 0@lo 00000020:00000040:0.0:1784189365.547028:0:26169:0:(obd_config.c:1022:class_decref()) Decref lustre-OST0000 (ffff9dc07a7a0000) now 7 - find 00000100:00000040:0.0:1784189365.547036:0:26169:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9dc0710a1d00 refcount 57 to 0@lo 00000100:00000040:0.0:1784189365.547038:0:26169:0:(connection.c:149:ptlrpc_connection_get()) conn=ffff9dc0710a1d00 refcount 57 to 0@lo 00000100:00000040:0.0:1784189365.547041:0:26169:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1784189365.547057:0:26169:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=0 replen=544 req@ffff9dc080e7df80 x1870854458273664/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 1784189390 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1784189365.547070:0:26169:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff9dc0710a1d00 refcount 56 to 0@lo 00000100:00000040:0.0:1784189365.547073:0:26169:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9dc07130f480 x1870854458273664/t0(0) o8->@:0/0 lens 520/224 e 0 to 0 dl 1784189385 ref 1 fl Interpret:/200/0 rc -11/-11 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784189365.547082:0:26169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc07130f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:0+-99:3639:x1870854458273664:12345-0@lo:8:kworker.0 Request processed in 77us (6391us total) trans 0 rc -11/-11 00000100:00100000:0.0:1784189365.547087:0:26169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5076 00000100:00100000:0.0:1784189365.547754:0:23826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458273536 00000100:00100000:0.0:1784189365.547763:0:23826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458273536 00000020:00000040:0.0:1784189365.547766:0:23826:0:(genops.c:825:class_conn2export()) looking for export cookie 0xcc1762b626f8c5dc 00000020:00000040:0.0:1784189365.547770:0:23826:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9dbf47a3f000 refcount=7 00000100:00000040:0.0:1784189365.547793:0:23826:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_out at +6s 00000100:00100000:0.0:1784189365.548028:0:23826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458274048 00000100:00100000:0.0:1784189365.548033:0:23826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458274048 00000020:00000040:0.0:1784189365.548035:0:23826:0:(genops.c:825:class_conn2export()) looking for export cookie 0xcc1762b626f8c622 00000020:00000040:0.0:1784189365.548038:0:23826:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9dc047a80000 refcount=5 00000100:00100000:2.0:1784189365.548708:0:26492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3969 00000100:00000040:2.0:1784189365.548713:0:26492:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9dbf47a3f000 : new rpc_count 1 00000100:00000040:2.0:1784189365.548719:0:26492:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9dbf43e12d80 x1870854458273536/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:556/0 lens 224/0 e 0 to 0 dl 1784189376 ref 1 fl New:/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784189365.548733:0:26492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf43e12d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3641:x1870854458273536:12345-0@lo:400:kworker.0 00010000:00000040:2.0:1784189365.548752:0:26492:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 120259084290, transno 0, xid 1870854458273536 00000100:00000040:2.0:1784189365.548758:0:26492:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9dc0710a1d00 refcount 57 to 0@lo 00000100:00000040:2.0:1784189365.548763:0:26492:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1784189365.548805:0:26492:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff9dc080e7f100 x1870854458273536/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1784189381 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1784189365.548822:0:26492:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff9dc0710a1d00 refcount 56 to 0@lo 00000100:00000040:2.0:1784189365.548827:0:26492:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9dbf43e12d80 x1870854458273536/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:556/0 lens 224/224 e 0 to 0 dl 1784189376 ref 1 fl Interpret:/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784189365.548836:0:26492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf43e12d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3641:x1870854458273536:12345-0@lo:400:kworker.0 Request processed in 107us (7416us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189365.548842:0:26492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3969 00000100:00000040:2.0:1784189365.548845:0:26492:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9dbf47a3f000 : new rpc_count 0 00000020:00000040:2.0:1784189365.548852:0:26492:0:(genops.c:900:class_export_put()) PUTting export ffff9dbf47a3f000 : new refcount 6 00000100:00100000:2.0:1784189365.548862:0:26492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3970 00000100:00000040:2.0:1784189365.548865:0:26492:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9dc047a80000 : new rpc_count 1 00000100:00000040:2.0:1784189365.548877:0:26492:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9dc05edd0e00 x1870854458274048/t0(0) o400->lustre-MDT0000-mdtlov_UUID@0@lo:556/0 lens 224/0 e 0 to 0 dl 1784189376 ref 1 fl New:/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784189365.548887:0:26492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc05edd0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3640:x1870854458274048:12345-0@lo:400:kworker.0 00010000:00000040:2.0:1784189365.548896:0:26492:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 0, transno 0, xid 1870854458274048 00000100:00000040:2.0:1784189365.548900:0:26492:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9dc0710a1d00 refcount 57 to 0@lo 00000100:00000040:2.0:1784189365.548903:0:26492:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1784189365.548916:0:26492:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff9dbf43e10000 x1870854458274048/t0(0) o400->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1784189381 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1784189365.548935:0:26492:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff9dc0710a1d00 refcount 56 to 0@lo 00000100:00000040:2.0:1784189365.548939:0:26492:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9dc05edd0e00 x1870854458274048/t0(0) o400->lustre-MDT0000-mdtlov_UUID@0@lo:556/0 lens 224/224 e 0 to 0 dl 1784189376 ref 1 fl Interpret:/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784189365.548948:0:26492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc05edd0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3640:x1870854458274048:12345-0@lo:400:kworker.0 Request processed in 62us (7262us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189365.548954:0:26492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3970 00000100:00000040:2.0:1784189365.548956:0:26492:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9dc047a80000 : new rpc_count 0 00000020:00000040:2.0:1784189365.548961:0:26492:0:(genops.c:900:class_export_put()) PUTting export ffff9dc047a80000 : new refcount 4 00000100:00000040:0.0:1784189365.549594:0:3641:0:(client.c:3108:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: skip recheck: last_committed 120259084290 00000100:00000040:0.0:1784189365.549603:0:3641:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff9dc080e7f100 x1870854458273536/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1784189381 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1784189365.549615:0:3641:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9dc080e7f100 x1870854458273536/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1784189381 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784189365.549623:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc080e7f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1870854458273536:0@lo:400:kworker.0 00000100:00000040:0.0:1784189365.549643:0:3641:0:(client.c:3108:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: skip recheck: last_committed 4294968960 00000100:00000040:0.0:1784189365.549647:0:3641:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff9dbf43e10700 x1870854458274304/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784189381 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1784189365.549655:0:3641:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9dbf43e10700 x1870854458274304/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784189381 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784189365.549663:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf43e10700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1870854458274304:0@lo:400:kworker.0 00000100:00000040:0.0:1784189365.549668:0:3641:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff9dc080e7f100 x1870854458273536/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1784189381 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:0.0:1784189365.549677:0:3641:0:(genops.c:1244:class_import_put()) import ffff9dbf436c4000 refcount=2 obd=lustre-MDT0000-osp-MDT0001 00000100:00000040:0.0:1784189365.549687:0:3641:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff9dbf43e10700 x1870854458274304/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784189381 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:0.0:1784189365.549694:0:3641:0:(genops.c:1244:class_import_put()) import ffff9dbf4845c000 refcount=2 obd=lustre-OST0001-osc-MDT0000 00000100:00000040:0.0:1784189365.549714:0:3640:0:(client.c:3108:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: skip recheck: last_committed 0 00000100:00000040:0.0:1784189365.549718:0:3640:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff9dbf43e10000 x1870854458274048/t0(0) o400->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1784189381 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1784189365.549742:0:3640:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9dbf43e10000 x1870854458274048/t0(0) o400->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1784189381 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784189365.549749:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf43e10000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1870854458274048:0@lo:400:kworker.0 00000100:00000040:0.0:1784189365.549754:0:3640:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff9dbf43e10000 x1870854458274048/t0(0) o400->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1784189381 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:0.0:1784189365.549762:0:3640:0:(genops.c:1244:class_import_put()) import ffff9dbf436c1800 refcount=2 obd=lustre-MDT0001-osp-MDT0000 00000020:00000040:0.0:1784189365.549823:0:96890:0:(genops.c:889:class_export_get()) GET export ffff9dc04ffb5800 refcount=4 00000020:00000040:0.0:1784189365.549863:0:96890:0:(genops.c:889:class_export_get()) GET export ffff9dc04ffb5800 refcount=5 00000100:00000040:0.0:1784189365.549932:0:96890:0:(lustre_peer.c:130:class_add_uuid()) found uuid 192.168.203.112@tcp 192.168.203.112@tcp cnt=1 00000020:01000004:0.0:1784189365.549952:0:96890:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0000 (typ=lwp) 00000020:00000080:0.0:1784189365.549966:0:96890:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0000 (ffff9dbf44d799c0) 00000020:00000040:0.0:1784189365.549973:0:96890:0:(lustre_handles.c:93:class_handle_hash()) added object ffff9dc07118f000 with handle 0xcc1762b626f8d5a3 to hash 00000020:00000040:0.0:1784189365.549978:0:96890:0:(genops.c:900:class_export_put()) PUTting export ffff9dc07118f000 : new refcount 1 00000020:00000040:0.0:1784189365.549993:0:96890:0:(obd_config.c:994:class_incref()) incref lustre-MDT0001-lwp-OST0000 (ffff9dbf44d799c0) now 2 - obd_device_list 00000020:00000080:0.0:1784189365.549998:0:96890:0:(obd_config.c:720:class_attach_name()) OBD: dev 20 attached type lwp with refcount 2 00000020:01000004:0.0:1784189365.551741:0:96890:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9dc0762e7000 from lustre-OST0000, refs=3 00000020:01000004:0.0:1784189365.551749:0:96890:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9dc0762e7000 from lustre-OST0000, refs=3 00000020:01000004:0.0:1784189365.551752:0:96890:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9dc0762e7000 3 00000020:00000040:0.0:1784189365.551771:0:96890:0:(obd_config.c:994:class_incref()) incref lustre-MDT0001-lwp-OST0000 (ffff9dbf44d799c0) now 3 - import 00000020:00000040:0.0:1784189365.551778:0:96890:0:(genops.c:1244:class_import_put()) import ffff9dbf44677800 refcount=1 obd=lustre-MDT0001-lwp-OST0000 00000100:00000040:0.0:1784189365.551789:0:96890:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9dc0710a1d00 refcount 57 to 0@lo 00000100:00000040:0.0:1784189365.551792:0:96890:0:(connection.c:149:ptlrpc_connection_get()) conn=ffff9dc0710a1d00 refcount 57 to 0@lo 00000100:00000040:0.0:1784189365.551795:0:96890:0:(client.c:137:ptlrpc_uuid_to_connection()) 192.168.203.112@tcp -> ffff9dc0710a1d00 00010000:00080000:0.0:1784189365.551799:0:96890:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9dbf44677800@lustre-MDT0001-lwp-OST0000: add connection 192.168.203.112@tcp at head 00000020:00000040:2.0:1784189365.553360:0:96891:0:(genops.c:889:class_export_get()) GET export ffff9dc04ffb5800 refcount=6 00000020:00000040:2.0:1784189365.553368:0:96891:0:(genops.c:889:class_export_get()) GET export ffff9dc04ffb5800 refcount=7 00000020:00000040:2.0:1784189365.553373:0:96891:0:(genops.c:900:class_export_put()) PUTting export ffff9dc04ffb5800 : new refcount 6 00000100:00100000:1.0:1784189365.554049:0:66169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1385 00000100:00000040:1.0:1784189365.554055:0:66169:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9dbf43d8f800 : new rpc_count 1 00000100:00000040:1.0:1784189365.554064:0:66169:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9dc05edd1180 x1870854458273408/t0(0) o400->lustre-MDT0001-lwp-OST0001_UUID@0@lo:556/0 lens 224/0 e 0 to 0 dl 1784189376 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00010000:00010000:0.0:1784189365.554166:0:96890:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0000-12 is initialized 00000100:00100000:1.0:1784189365.554193:0:66169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc05edd1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1870854458273408:12345-0@lo:400:kworker.0 00010000:00000040:1.0:1784189365.554222:0:66169:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 0, transno 0, xid 1870854458273408 00000100:00000040:1.0:1784189365.554232:0:66169:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9dc0710a1d00 refcount 58 to 0@lo 00000100:00000040:1.0:1784189365.554304:0:66169:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000020:00000040:0.0:1784189365.554434:0:96890:0:(obd_config.c:994:class_incref()) incref lustre-MDT0001-lwp-OST0000 (ffff9dbf44d799c0) now 4 - setup 00000020:00000080:0.0:1784189365.554438:0:96890:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000010:01000000:0.0:1784189365.554502:0:96890:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000100:00000040:1.0:1784189365.554503:0:66169:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff9dc080e7ea00 x1870854458273408/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784189381 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:0.0:1784189365.554510:0:96890:0:(lustre_handles.c:93:class_handle_hash()) added object ffff9dc07118c800 with handle 0xcc1762b626f8d5aa to hash 00000020:00000040:0.0:1784189365.554518:0:96890:0:(genops.c:889:class_export_get()) GET export ffff9dc07118c800 refcount=3 00000020:00000040:0.0:1784189365.554523:0:96890:0:(obd_config.c:994:class_incref()) incref lustre-MDT0001-lwp-OST0000 (ffff9dbf44d799c0) now 5 - export 00000020:00000040:0.0:1784189365.554526:0:96890:0:(genops.c:900:class_export_put()) PUTting export ffff9dc07118c800 : new refcount 2 00000020:00000080:0.0:1784189365.554528:0:96890:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-lwp-OST0000, cookie 0xcc1762b626f8d5aa 00000020:00000040:0.0:1784189365.554530:0:96890:0:(genops.c:825:class_conn2export()) looking for export cookie 0xcc1762b626f8d5aa 00000020:00000040:0.0:1784189365.554533:0:96890:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9dc07118c800 refcount=3 00000100:00080000:0.0:1784189365.554539:0:96890:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00000040:0.0:1784189365.554543:0:96890:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9dc0710a1d00 refcount 59 to 0@lo 00000020:00000040:0.0:1784189365.554545:0:96890:0:(genops.c:825:class_conn2export()) looking for export cookie 0xcc1762b626f8d5aa 00000020:00000040:0.0:1784189365.554547:0:96890:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9dc07118c800 refcount=4 00000100:00000040:0.0:1784189365.554549:0:96890:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9dc0710a1d00 refcount 60 to 0@lo 00000020:00000040:0.0:1784189365.554551:0:96890:0:(genops.c:900:class_export_put()) PUTting export ffff9dc07118c800 : new refcount 3 00000100:00080000:0.0:1784189365.554554:0:96890:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0000: import ffff9dbf44677800 using connection 192.168.203.112@tcp/0@lo 00000020:00000040:0.0:1784189365.554566:0:96890:0:(genops.c:1231:class_import_get()) import ffff9dbf44677800 refcount=2 obd=lustre-MDT0001-lwp-OST0000 00000100:00100000:0.0:1784189365.554582:0:96890:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9dc05edd2300 x1870854458274560/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:0.0:1784189365.554595:0:96890:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [00000000358024b5] to pc [ptlrpcd_rcv+-1] req@ffff9dc05edd2300 x1870854458274560/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1784189365.554605:0:96890:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000020:00000040:0.0:1784189365.554609:0:96890:0:(genops.c:1231:class_import_get()) import ffff9dbf44677800 refcount=3 obd=lustre-MDT0001-lwp-OST0000 00000020:00000040:0.0:1784189365.554759:0:96890:0:(genops.c:889:class_export_get()) GET export ffff9dc07118c800 refcount=4 00000020:00000040:0.0:1784189365.554763:0:96890:0:(genops.c:889:class_export_get()) GET export ffff9dc07118c800 refcount=5 00000040:00080000:0.0:1784189365.554827:0:96890:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 64 count 63 00000020:01000000:0.0:1784189365.554879:0:96879:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-63 (rc=0) 10000000:01000000:0.0:1784189365.554913:0:96879:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'lustre-client' succeeded (0). 00000020:00000040:0.0:1784189365.554925:0:96879:0:(lustre_handles.c:147:class_handle2object()) GET ldlm ffff9dc0755a5200 refcount=3 00010000:00010000:0.0:1784189365.554931:0:96879:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff9dc0755a5200/0xcc1762b626f8d580 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc1762b626f8d587 expref: -99 pid: 96879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189365.554947:0:96879:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: ffff9dc0755a5200/0xcc1762b626f8d580 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc1762b626f8d587 expref: -99 pid: 96879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1784189365.554998:0:96879:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1784189365.555000:0:96879:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1784189365.555001:0:96879:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1784189365.555002:0:96879:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1784189365.555003:0:96879:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1784189365.555004:0:96879:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1784189365.555006:0:96879:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1784189365.555008:0:96879:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1784189365.555009:0:96879:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1784189365.555013:0:96879:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020002 00000020:01000004:0.0:1784189365.555016:0:96879:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1784189365.555017:0:96879:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1784189365.555018:0:96879:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1784189365.555019:0:96879:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1784189365.555020:0:96879:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1784189365.555021:0:96879:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1784189365.555022:0:96879:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1784189365.555023:0:96879:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1784189365.555024:0:96879:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:00000040:0.0:1784189365.555029:0:96879:0:(genops.c:1231:class_import_get()) import ffff9dc07110c800 refcount=4 obd=MGC192.168.203.112@tcp 10000000:01000000:0.0:1784189365.555042:0:96879:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00000040:0.0:1784189365.555053:0:96879:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff9dc05edd3b80 x1870854458274688/t0(0) o253->MGC192.168.203.112@tcp@0@lo:26/25 lens 4848/4768 e 0 to 0 dl 0 ref 2 fl New:QU/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784189365.555064:0:96879:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc05edd3b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd553d0d-03e2-4233-b06b-b55bbfa2b954:96879:1870854458274688:0@lo:253:mount.lustre.0 00000100:00000040:0.0:1784189365.555085:0:96879:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff9dc05edd3b80 x1870854458274688/t0(0) o253->MGC192.168.203.112@tcp@0@lo:26/25 lens 4848/4768 e 0 to 0 dl 1784189381 ref 3 fl Rpc:r/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1784189365.555093:0:96879:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1784189365.555117:0:96879:0:(events.c:337:request_in_callback()) incoming req@ffff9dc044986850 x1870854458274688 msgsize 4848 00000100:00100000:0.0:1784189365.555122:0:96879:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:0.0:1784189365.555129:0:96879:0:(events.c:349:request_in_callback()) Buffer complete: 63 buffers still posted 00000100:00000040:0.0:1784189365.555146:0:96879:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 2 req@ffff9dc05edd3b80 x1870854458274688/t0(0) o253->MGC192.168.203.112@tcp@0@lo:26/25 lens 4848/4768 e 0 to 0 dl 1784189381 ref 3 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784189365.555169:0:96879:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dc062186c00 going to sleep for 11 seconds 00000020:00000040:0.0:1784189365.555246:0:96894:0:(genops.c:900:class_export_put()) PUTting export ffff9dc07118c800 : new refcount 4 00000100:00000040:0.0:1784189365.555398:0:3643:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff9dbf43e10e00 x1870854458273920/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784189365.555408:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf43e10e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3643:1870854458273920:0@lo:400:kworker.0 00000100:00000040:0.0:1784189365.555422:0:3643:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff9dbf43e10e00 x1870854458273920/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784189381 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1784189365.555430:0:3643:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1784189365.555443:0:3643:0:(events.c:337:request_in_callback()) incoming req@ffff9dc05edd0380 x1870854458273920 msgsize 224 00000100:00100000:0.0:1784189365.555447:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:2.0:1784189365.555490:0:36:0:(pinger.c:304:ptlrpc_pinger_main()) next wakeup in 5 (3612) 00000100:00100000:2.0:1784189365.555505:0:94309:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458274688 00000100:00100000:2.0:1784189365.555511:0:94309:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458274688 00000020:00000040:2.0:1784189365.555513:0:94309:0:(genops.c:825:class_conn2export()) looking for export cookie 0xcc1762b626f8c573 00000020:00000040:2.0:1784189365.555516:0:94309:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9dc050ae5000 refcount=24 00000100:00000040:2.0:1784189365.555530:0:94309:0:(service.c:1432:ptlrpc_at_set_timer()) armed mgs at +6s 00000100:00100000:2.0:1784189365.555550:0:94309:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 204 00000100:00000040:2.0:1784189365.555554:0:94309:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9dc050ae5000 : new rpc_count 1 00000100:00000040:2.0:1784189365.555559:0:94309:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9dc044986850 x1870854458274688/t0(0) o253->bd553d0d-03e2-4233-b06b-b55bbfa2b954@0@lo:556/0 lens 4848/0 e 0 to 0 dl 1784189376 ref 1 fl New:/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784189365.555582:0:94309:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc044986850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd553d0d-03e2-4233-b06b-b55bbfa2b954+24:96879:x1870854458274688:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1784189365.555605:0:94309:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:2.0:1784189365.555615:0:94309:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00000040:1.0:1784189365.556473:0:66169:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff9dc0710a1d00 refcount 59 to 0@lo 00000100:00000040:1.0:1784189365.556483:0:66169:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9dc05edd1180 x1870854458273408/t0(0) o400->lustre-MDT0001-lwp-OST0001_UUID@0@lo:556/0 lens 224/224 e 0 to 0 dl 1784189376 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784189365.556493:0:66169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc05edd1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1870854458273408:12345-0@lo:400:kworker.0 Request processed in 2417us (14912us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189365.556503:0:66169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1385 00000100:00000040:2.0:1784189365.556504:0:3640:0:(client.c:3108:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: skip recheck: last_committed 0 00000100:00000040:1.0:1784189365.556506:0:66169:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9dbf43d8f800 : new rpc_count 0 00000100:00000040:2.0:1784189365.556512:0:3640:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff9dc080e7ea00 x1870854458273408/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784189381 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1784189365.556524:0:3640:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9dc080e7ea00 x1870854458273408/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784189381 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784189365.556532:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc080e7ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3640:1870854458273408:0@lo:400:kworker.0 00000100:00000040:2.0:1784189365.556539:0:3640:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff9dc080e7ea00 x1870854458273408/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784189381 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:2.0:1784189365.556548:0:3640:0:(genops.c:1244:class_import_put()) import ffff9dbf43115800 refcount=2 obd=lustre-MDT0001-lwp-OST0001 00000020:00000040:1.0:1784189365.556661:0:66169:0:(genops.c:900:class_export_put()) PUTting export ffff9dbf43d8f800 : new refcount 4 00000100:00000040:0.0:1784189365.557011:0:3643:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff9dbf43e10e00 x1870854458273920/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784189381 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784189365.557013:0:66169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458273920 00000100:00100000:1.0:1784189365.557020:0:66169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458273920 00000020:00000040:1.0:1784189365.557024:0:66169:0:(genops.c:825:class_conn2export()) looking for export cookie 0xcc1762b626f8c787 00000100:00000040:0.0:1784189365.557027:0:3643:0:(niobuf.c:635:kick_cpu_latency()) lustre-MDT0000-lwp-MDT0001: using a timeout of 72761 usecs (73 jiffies) 00000020:00000040:1.0:1784189365.557028:0:66169:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9dbf46b0e000 refcount=5 00000100:00100000:0.0:1784189365.557045:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00000040:1.0:1784189365.557048:0:66169:0:(service.c:1432:ptlrpc_at_set_timer()) armed mdt at +6s 00000100:00000040:0.0:1784189365.557054:0:3643:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff9dc080e7e300 x1870854458273792/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784189365.557067:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc080e7e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1870854458273792:0@lo:400:kworker.0 00000100:00000040:0.0:1784189365.557085:0:3643:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff9dc080e7e300 x1870854458273792/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784189381 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1784189365.557092:0:3643:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1784189365.557114:0:3643:0:(events.c:337:request_in_callback()) incoming req@ffff9dc05edd1500 x1870854458273792 msgsize 224 00000100:00100000:0.0:1784189365.557118:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:0.0:1784189365.557132:0:3643:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff9dc080e7e300 x1870854458273792/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784189381 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1784189365.557142:0:3643:0:(niobuf.c:635:kick_cpu_latency()) lustre-OST0001-osc-MDT0001: using a timeout of 5088 usecs (6 jiffies) 00000100:00000040:0.0:1784189365.557157:0:3643:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff9dbf43e13100 x1870854458274432/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784189365.557166:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf43e13100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3643:1870854458274432:0@lo:400:kworker.0 00000100:00000040:0.0:1784189365.557178:0:3643:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff9dbf43e13100 x1870854458274432/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784189381 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1784189365.557186:0:3643:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1784189365.557197:0:3643:0:(events.c:337:request_in_callback()) incoming req@ffff9dc05edd2680 x1870854458274432 msgsize 224 00000100:00100000:0.0:1784189365.557201:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:0.0:1784189365.557314:0:3643:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff9dbf43e13100 x1870854458274432/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784189381 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1784189365.557338:0:3643:0:(niobuf.c:635:kick_cpu_latency()) lustre-MDT0000-lwp-MDT0000: using a timeout of 8026 usecs (9 jiffies) 00000100:00100000:2.0:1784189365.557375:0:68287:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458274432 00000100:00100000:2.0:1784189365.557379:0:68287:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458274432 00000020:00000040:2.0:1784189365.557382:0:68287:0:(genops.c:825:class_conn2export()) looking for export cookie 0xcc1762b626f8c78e 00000020:00000040:2.0:1784189365.557385:0:68287:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9dc06b8e5800 refcount=5 00000100:00100000:2.0:1784189365.557405:0:68287:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1386 00000100:00000040:2.0:1784189365.557409:0:68287:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9dbf46b0e000 : new rpc_count 1 00000100:00000040:2.0:1784189365.557414:0:68287:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9dc05edd0380 x1870854458273920/t0(0) o400->lustre-MDT0000-lwp-MDT0001_UUID@0@lo:556/0 lens 224/0 e 0 to 0 dl 1784189376 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784189365.557424:0:68287:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc05edd0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1870854458273920:12345-0@lo:400:kworker.0 00010000:00000040:2.0:1784189365.557445:0:68287:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 0, transno 0, xid 1870854458273920 00000100:00000040:2.0:1784189365.557452:0:68287:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9dc0710a1d00 refcount 60 to 0@lo 00000100:00000040:2.0:1784189365.557459:0:68287:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00100000:1.0:1784189365.557459:0:66169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1387 00000100:00000040:1.0:1784189365.557466:0:66169:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9dc06b8e5800 : new rpc_count 1 00000100:00000040:1.0:1784189365.557472:0:66169:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9dc05edd2680 x1870854458274432/t0(0) o400->lustre-MDT0000-lwp-MDT0000_UUID@0@lo:556/0 lens 224/0 e 0 to 0 dl 1784189376 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1784189365.557481:0:68287:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff9dbf43e10e00 x1870854458273920/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784189381 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784189365.557487:0:66169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc05edd2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1870854458274432:12345-0@lo:400:kworker.0 00010000:00000040:1.0:1784189365.557504:0:66169:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 0, transno 0, xid 1870854458274432 00000100:00000040:1.0:1784189365.557511:0:66169:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9dc0710a1d00 refcount 61 to 0@lo 00000100:00000040:2.0:1784189365.557514:0:68287:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff9dc0710a1d00 refcount 60 to 0@lo 00000100:00000040:2.0:1784189365.557522:0:68287:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9dc05edd0380 x1870854458273920/t0(0) o400->lustre-MDT0000-lwp-MDT0001_UUID@0@lo:556/0 lens 224/224 e 0 to 0 dl 1784189376 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784189365.557531:0:68287:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc05edd0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1870854458273920:12345-0@lo:400:kworker.0 Request processed in 108us (2086us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189365.557538:0:68287:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1386 00000100:00000040:2.0:1784189365.557541:0:68287:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9dbf46b0e000 : new rpc_count 0 00000020:00000040:2.0:1784189365.557548:0:68287:0:(genops.c:900:class_export_put()) PUTting export ffff9dbf46b0e000 : new refcount 4 00000100:00000040:1.0:1784189365.557665:0:66169:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:1.0:1784189365.557688:0:66169:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff9dbf43e13100 x1870854458274432/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784189381 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1784189365.557691:0:3642:0:(client.c:3108:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: skip recheck: last_committed 0 00000100:00000040:0.0:1784189365.557700:0:3642:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff9dc080e7d880 x1870854458273280/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784189381 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1784189365.557721:0:3642:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9dc080e7d880 x1870854458273280/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784189381 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784189365.557730:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc080e7d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3642:1870854458273280:0@lo:400:kworker.0 00000100:00000040:1.0:1784189365.557735:0:66169:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff9dc0710a1d00 refcount 59 to 0@lo 00000100:00000040:0.0:1784189365.557739:0:3642:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff9dc080e7d880 x1870854458273280/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784189381 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1784189365.557744:0:66169:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9dc05edd2680 x1870854458274432/t0(0) o400->lustre-MDT0000-lwp-MDT0000_UUID@0@lo:556/0 lens 224/224 e 0 to 0 dl 1784189376 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:0.0:1784189365.557758:0:3642:0:(genops.c:1244:class_import_put()) import ffff9dbf425f4800 refcount=2 obd=lustre-MDT0000-lwp-OST0001 00000100:00100000:1.0:1784189365.557760:0:66169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc05edd2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1870854458274432:12345-0@lo:400:kworker.0 Request processed in 276us (560us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189365.557770:0:66169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1387 00000100:00000040:1.0:1784189365.557773:0:66169:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9dc06b8e5800 : new rpc_count 0 00000020:00000040:1.0:1784189365.557783:0:66169:0:(genops.c:900:class_export_put()) PUTting export ffff9dc06b8e5800 : new refcount 4 00000100:00000040:0.0:1784189365.557786:0:3643:0:(client.c:3108:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: skip recheck: last_committed 0 00000100:00000040:0.0:1784189365.557794:0:3643:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff9dbf43e13100 x1870854458274432/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784189381 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1784189365.557804:0:3643:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9dbf43e13100 x1870854458274432/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784189381 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784189365.557812:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf43e13100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3643:1870854458274432:0@lo:400:kworker.0 00000100:00100000:1.0:1784189365.557818:0:26170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458273792 00000100:00100000:1.0:1784189365.557825:0:26170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458273792 00000020:00000040:1.0:1784189365.557828:0:26170:0:(genops.c:825:class_conn2export()) looking for export cookie 0xcc1762b626f864bc 00000020:00000040:1.0:1784189365.557831:0:26170:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9dbf42277000 refcount=5 00000100:00000040:0.0:1784189365.557837:0:3643:0:(client.c:3108:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: skip recheck: last_committed 0 00000020:00000040:1.0:1784189365.557843:0:26170:0:(obd_config.c:994:class_incref()) incref lustre-OST0001 (ffff9dbf4312b380) now 10 - evictor 00000100:00000040:0.0:1784189365.557844:0:3643:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff9dbf43e10e00 x1870854458273920/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784189381 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1784189365.557856:0:3643:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9dbf43e10e00 x1870854458273920/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784189381 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784189365.557863:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf43e10e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3643:1870854458273920:0@lo:400:kworker.0 00000100:00000040:0.0:1784189365.557868:0:3643:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff9dbf43e13100 x1870854458274432/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784189381 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:0.0:1784189365.557882:0:3643:0:(genops.c:1244:class_import_put()) import ffff9dbf43fcb000 refcount=2 obd=lustre-MDT0000-lwp-MDT0000 00000100:00000040:0.0:1784189365.557890:0:3643:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff9dbf43e10e00 x1870854458273920/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784189381 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:0.0:1784189365.557897:0:3643:0:(genops.c:1244:class_import_put()) import ffff9dbf43690800 refcount=2 obd=lustre-MDT0000-lwp-MDT0001 00000100:00000040:1.0:1784189365.557970:0:26170:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost at +6s 00000100:00100000:1.0:1784189365.557992:0:26170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2614 00000100:00000040:1.0:1784189365.557995:0:26170:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9dbf42277000 : new rpc_count 1 00000100:00000040:1.0:1784189365.557999:0:26170:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9dc05edd1500 x1870854458273792/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:556/0 lens 224/0 e 0 to 0 dl 1784189376 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784189365.558010:0:26170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc05edd1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0001-mdtlov_UUID+5:3643:x1870854458273792:12345-0@lo:400:kworker.0 00010000:00000040:1.0:1784189365.558021:0:26170:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 4294968945, transno 0, xid 1870854458273792 00000100:00000040:1.0:1784189365.558027:0:26170:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9dc0710a1d00 refcount 60 to 0@lo 00000100:00000040:1.0:1784189365.558030:0:26170:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:1.0:1784189365.558048:0:26170:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff9dc080e7e300 x1870854458273792/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784189381 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1784189365.559855:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000020:00000040:2.0:1784189365.559862:0:6509:0:(obd_config.c:1022:class_decref()) Decref lustre-OST0001 (ffff9dbf4312b380) now 10 - evictor 00000100:00000040:1.0:1784189365.560065:0:26170:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff9dc0710a1d00 refcount 59 to 0@lo 00000100:00000040:1.0:1784189365.560085:0:26170:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9dc05edd1500 x1870854458273792/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:556/0 lens 224/224 e 0 to 0 dl 1784189376 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784189365.560111:0:26170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc05edd1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0001-mdtlov_UUID+5:3643:x1870854458273792:12345-0@lo:400:kworker.0 Request processed in 2100us (2993us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189365.560121:0:26170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2614 00000100:00000040:1.0:1784189365.560125:0:26170:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9dbf42277000 : new rpc_count 0 00000020:00000040:1.0:1784189365.560138:0:26170:0:(genops.c:900:class_export_put()) PUTting export ffff9dbf42277000 : new refcount 4 00000100:00000040:1.0:1784189365.560171:0:3639:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff9dbf43e13480 x1870854458274176/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784189365.560185:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf43e13480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3639:1870854458274176:0@lo:8:kworker.0 00000100:00000040:1.0:1784189365.560212:0:3639:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff9dbf43e13480 x1870854458274176/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 1784189390 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1784189365.560221:0:3639:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:1.0:1784189365.560260:0:3639:0:(events.c:337:request_in_callback()) incoming req@ffff9dbf43e10a80 x1870854458274176 msgsize 520 00000100:00100000:1.0:1784189365.560265:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:1.0:1784189365.560281:0:3639:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff9dbf43e13480 x1870854458274176/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 1784189390 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1784189365.560292:0:3639:0:(niobuf.c:635:kick_cpu_latency()) lustre-OST0000-osc-MDT0000: using a timeout of 7938 usecs (8 jiffies) 00000100:00000040:1.0:1784189365.560302:0:3639:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff9dc05edd2300 x1870854458274560/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784189365.560339:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc05edd2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3639:1870854458274560:0@lo:38:llog_process_th.0 00000100:00000040:1.0:1784189365.560362:0:3639:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff9dc05edd2300 x1870854458274560/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1784189375 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1784189365.560369:0:3639:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:1.0:1784189365.560396:0:3639:0:(events.c:337:request_in_callback()) incoming req@ffff9dbf43e13800 x1870854458274560 msgsize 520 00000100:00100000:1.0:1784189365.560402:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:1.0:1784189365.560418:0:3639:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff9dc05edd2300 x1870854458274560/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1784189375 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1784189365.560442:0:3639:0:(niobuf.c:635:kick_cpu_latency()) lustre-MDT0001-lwp-OST0000: using a timeout of 0 usecs (0 jiffies) 00000100:00000040:1.0:1784189365.560481:0:3639:0:(client.c:3108:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: skip recheck: last_committed 4294968955 00000100:00000040:1.0:1784189365.560488:0:3639:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff9dc080e7df80 x1870854458273664/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/224 e 0 to 0 dl 1784189390 ref 1 fl Rpc:RNQU/200/0 rc -11/-11 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1784189365.560498:0:3639:0:(import.c:65:import_set_state_nolock()) ffff9dbf43114800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1784189365.560503:0:3639:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-11) 00000100:00000040:1.0:1784189365.560508:0:3639:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9dc080e7df80 x1870854458273664/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/224 e 0 to 0 dl 1784189390 ref 1 fl Interpret:RNQU/200/0 rc -11/-11 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784189365.560516:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc080e7df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3639:1870854458273664:0@lo:8:kworker.0 00000100:00100000:1.0:1784189365.560546:0:3639:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00000040:1.0:1784189365.560549:0:3639:0:(client.c:3222:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: normal: skip=0 replay=0/0 committed=0/0 00000100:00000040:1.0:1784189365.560554:0:3639:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff9dc071537b80 x1870854458273152/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1784189375 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1784189365.560566:0:3639:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 28 00000020:00000040:1.0:1784189365.560568:0:3639:0:(genops.c:825:class_conn2export()) looking for export cookie 0xcc1762b626f8d595 00000020:00000040:1.0:1784189365.560572:0:3639:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9dc04ffb5800 refcount=7 00000100:00080000:1.0:1784189365.560579:0:3639:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000020:00000040:1.0:1784189365.560582:0:3639:0:(genops.c:900:class_export_put()) PUTting export ffff9dc04ffb5800 : new refcount 6 00000100:00080000:1.0:1784189365.560587:0:3639:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1784189365.560590:0:3639:0:(import.c:65:import_set_state_nolock()) ffff9dbf43d8c000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00000040:1.0:1784189365.560599:0:3639:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9dc071537b80 x1870854458273152/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1784189375 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784189365.560607:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc071537b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3639:1870854458273152:0@lo:38:llog_process_th.0 00000100:00000040:1.0:1784189365.560615:0:3639:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff9dc080e7df80 x1870854458273664/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/224 e 0 to 0 dl 1784189390 ref 1 fl Complete:RNQU/200/0 rc -11/-11 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:1.0:1784189365.560640:0:3639:0:(genops.c:1244:class_import_put()) import ffff9dbf43114800 refcount=2 obd=lustre-OST0000-osc-MDT0001 00000100:00000040:1.0:1784189365.560650:0:3639:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff9dc071537b80 x1870854458273152/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1784189375 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000020:00000040:1.0:1784189365.560658:0:3639:0:(genops.c:1244:class_import_put()) import ffff9dbf43d8c000 refcount=2 obd=lustre-MDT0000-lwp-OST0000 00000100:00100000:1.0:1784189365.560681:0:26159:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458274176 00000100:00100000:1.0:1784189365.560687:0:26159:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458274176 00000020:00000040:1.0:1784189365.560689:0:26159:0:(genops.c:825:class_conn2export()) looking for export cookie 0xcc1762b626f8c63e 00000100:00100000:1.0:1784189365.560713:0:26159:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5077 00000100:00000040:1.0:1784189365.560719:0:26159:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9dbf43e10a80 x1870854458274176/t0(0) o8->@:0/0 lens 520/0 e 0 to 0 dl 1784189385 ref 1 fl New:/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784189365.560729:0:26159:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf43e10a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0+-99:3639:x1870854458274176:12345-0@lo:8:kworker.0 00000020:00000040:1.0:1784189365.560743:0:26159:0:(obd_config.c:994:class_incref()) incref lustre-OST0000 (ffff9dc07a7a0000) now 7 - find 00010000:00000040:1.0:1784189365.560748:0:26159:0:(ldlm_lib.c:1213:target_handle_connect()) lustre-OST0000: Temporarily refusing client connection from 0@lo 00000020:00000040:1.0:1784189365.560751:0:26159:0:(obd_config.c:1022:class_decref()) Decref lustre-OST0000 (ffff9dc07a7a0000) now 7 - find 00000100:00000040:1.0:1784189365.560763:0:26159:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9dc0710a1d00 refcount 60 to 0@lo 00000100:00000040:1.0:1784189365.560766:0:26159:0:(connection.c:149:ptlrpc_connection_get()) conn=ffff9dc0710a1d00 refcount 60 to 0@lo 00000100:00000040:1.0:1784189365.560770:0:26159:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:1.0:1784189365.560787:0:26159:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=0 replen=544 req@ffff9dbf43e13480 x1870854458274176/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 1784189390 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1784189365.560804:0:26159:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff9dc0710a1d00 refcount 59 to 0@lo 00000100:00000040:1.0:1784189365.560808:0:26159:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9dbf43e10a80 x1870854458274176/t0(0) o8->@:0/0 lens 520/224 e 0 to 0 dl 1784189385 ref 1 fl Interpret:/200/0 rc -11/-11 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784189365.560817:0:26159:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf43e10a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0+-99:3639:x1870854458274176:12345-0@lo:8:kworker.0 Request processed in 88us (555us total) trans 0 rc -11/-11 00000100:00100000:1.0:1784189365.560823:0:26159:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5077 00000100:00100000:1.0:1784189365.560842:0:68287:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458274560 00000100:00100000:1.0:1784189365.560845:0:68287:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458274560 00000020:00000040:1.0:1784189365.560852:0:68287:0:(genops.c:825:class_conn2export()) looking for export cookie 0x0 00000100:00100000:1.0:1784189365.560874:0:68287:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1579 00000100:00000040:1.0:1784189365.560878:0:68287:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9dbf43e13800 x1870854458274560/t0(0) o38->@:0/0 lens 520/0 e 0 to 0 dl 1784189385 ref 1 fl New:/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784189365.560887:0:68287:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf43e13800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3639:x1870854458274560:12345-0@lo:38:llog_process_th.0 00000020:00000040:1.0:1784189365.560908:0:68287:0:(obd_config.c:994:class_incref()) incref lustre-MDT0001 (ffff9dc071094d40) now 10 - find 00010000:00000040:1.0:1784189365.560916:0:68287:0:(ldlm_lib.c:1264:target_handle_connect()) lustre-MDT0001: ocd_connect_flags: 0x2041401043000022 tmp_exp_old_falloc: 0 00010000:00080000:1.0:1784189365.560923:0:68287:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 3607 last 0 00000020:00000040:1.0:1784189365.560931:0:68287:0:(lustre_handles.c:93:class_handle_hash()) added object ffff9dc045661000 with handle 0xcc1762b626f8d5b1 to hash 00000020:00000040:1.0:1784189365.560957:0:68287:0:(genops.c:889:class_export_get()) GET export ffff9dc045661000 refcount=3 00000020:00000040:1.0:1784189365.560961:0:68287:0:(obd_config.c:994:class_incref()) incref lustre-MDT0001 (ffff9dc071094d40) now 11 - export 00000020:00000040:1.0:1784189365.560964:0:68287:0:(genops.c:900:class_export_put()) PUTting export ffff9dc045661000 : new refcount 2 00000020:00000080:1.0:1784189365.560966:0:68287:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-lwp-OST0000_UUID, cookie 0xcc1762b626f8d5b1 00000020:00000040:1.0:1784189365.560968:0:68287:0:(genops.c:825:class_conn2export()) looking for export cookie 0xcc1762b626f8d5b1 00000020:00000040:1.0:1784189365.560970:0:68287:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9dc045661000 refcount=3 00000001:00000040:1.0:1784189365.560978:0:68287:0:(nodemap_handler.c:533:nodemap_classify_nid()) found nid 192.168.203.112@tcp 00000001:00000040:1.0:1784189365.560982:0:68287:0:(nodemap_handler.c:99:nodemap_getref()) GETting nodemap default(p=ffff9dc07fa60400) : new refcount 18 00000020:00000040:1.0:1784189365.560985:0:68287:0:(genops.c:889:class_export_get()) GET export ffff9dc045661000 refcount=4 00000001:00000040:1.0:1784189365.560987:0:68287:0:(nodemap_handler.c:99:nodemap_getref()) GETting nodemap default(p=ffff9dc07fa60400) : new refcount 19 00000001:00000040:1.0:1784189365.560990:0:68287:0:(nodemap_handler.c:115:nodemap_putref()) PUTting nodemap default(p=ffff9dc07fa60400) : new refcount 18 00000004:00100000:1.0:1784189365.560995:0:68287:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000020:00000040:1.0:1784189365.561002:0:68287:0:(lprocfs_status_server.c:693:lprocfs_exp_setup()) Found stats ffff9dc0493705a0 for nid 0@lo - ref 4 00000020:00000040:1.0:1784189365.561011:0:68287:0:(obd_config.c:994:class_incref()) incref lustre-MDT0001 (ffff9dc071094d40) now 12 - import 00000020:00000040:1.0:1784189365.561015:0:68287:0:(genops.c:1244:class_import_put()) import ffff9dbf43697000 refcount=1 obd=lustre-MDT0001 00000020:00000040:1.0:1784189365.561020:0:68287:0:(genops.c:889:class_export_get()) GET export ffff9dc045661000 refcount=5 00000100:00000040:1.0:1784189365.561022:0:68287:0:(service.c:1082:ptlrpc_request_change_export()) RPC GETting export ffff9dc045661000 : new rpc_count 1 00000100:00000040:1.0:1784189365.561025:0:68287:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9dc0710a1d00 refcount 60 to 0@lo 00000100:00000040:1.0:1784189365.561027:0:68287:0:(connection.c:149:ptlrpc_connection_get()) conn=ffff9dc0710a1d00 refcount 60 to 0@lo 00000020:00000040:1.0:1784189365.561029:0:68287:0:(genops.c:889:class_export_get()) GET export ffff9dc045661000 refcount=6 00000100:00000040:1.0:1784189365.561041:0:68287:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9dc0710a1d00 refcount 61 to 0@lo 00000100:00080000:1.0:1784189365.561048:0:68287:0:(import.c:65:import_set_state_nolock()) ffff9dbf43697000 : changing import state from RECOVER to FULL 00000020:00000040:1.0:1784189365.561051:0:68287:0:(genops.c:900:class_export_put()) PUTting export ffff9dc045661000 : new refcount 5 00000020:00000040:1.0:1784189365.561053:0:68287:0:(obd_config.c:1022:class_decref()) Decref lustre-MDT0001 (ffff9dc071094d40) now 12 - find 00010000:00000040:1.0:1784189365.561065:0:68287:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 0, transno 0, xid 1870854458274560 00000100:00000040:1.0:1784189365.561071:0:68287:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9dc0710a1d00 refcount 62 to 0@lo 00000100:00000040:1.0:1784189365.561074:0:68287:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:1.0:1784189365.561090:0:68287:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=416 offset=0 replen=544 req@ffff9dc05edd2300 x1870854458274560/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1784189375 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1784189365.561103:0:68287:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff9dc0710a1d00 refcount 61 to 0@lo 00000100:00000040:1.0:1784189365.561107:0:68287:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9dbf43e13800 x1870854458274560/t0(0) o38->lustre-MDT0001-lwp-OST0000_UUID@0@lo:0/0 lens 520/416 e 0 to 0 dl 1784189385 ref 1 fl Interpret:/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784189365.561115:0:68287:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf43e13800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1870854458274560:12345-0@lo:38:llog_process_th.0 Request processed in 227us (717us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189365.561121:0:68287:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1579 00000100:00000040:1.0:1784189365.561123:0:68287:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9dc045661000 : new rpc_count 0 00000020:00000040:1.0:1784189365.561129:0:68287:0:(genops.c:900:class_export_put()) PUTting export ffff9dc045661000 : new refcount 4 00000100:00000040:1.0:1784189365.561154:0:3639:0:(client.c:3108:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: skip recheck: last_committed 4294968973 00000100:00000040:1.0:1784189365.561159:0:3639:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff9dbf43e13480 x1870854458274176/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/224 e 0 to 0 dl 1784189390 ref 1 fl Rpc:RNQU/200/0 rc -11/-11 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1784189365.561166:0:3639:0:(import.c:65:import_set_state_nolock()) ffff9dc075655000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1784189365.561169:0:3639:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-11) 00000100:00000040:1.0:1784189365.561173:0:3639:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9dbf43e13480 x1870854458274176/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/224 e 0 to 0 dl 1784189390 ref 1 fl Interpret:RNQU/200/0 rc -11/-11 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784189365.561180:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf43e13480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3639:1870854458274176:0@lo:8:kworker.0 00000100:00100000:1.0:1784189365.561191:0:3639:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00000040:1.0:1784189365.561193:0:3639:0:(client.c:3222:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: normal: skip=0 replay=0/0 committed=0/0 00000100:00000040:1.0:1784189365.561204:0:3639:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff9dc05edd2300 x1870854458274560/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1784189375 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1784189365.561212:0:3639:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0000: connect to target with instance 19 00000020:00000040:1.0:1784189365.561215:0:3639:0:(genops.c:825:class_conn2export()) looking for export cookie 0xcc1762b626f8d5aa 00000020:00000040:1.0:1784189365.561217:0:3639:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9dc07118c800 refcount=5 00000100:00080000:1.0:1784189365.561221:0:3639:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000020:00000040:1.0:1784189365.561224:0:3639:0:(genops.c:900:class_export_put()) PUTting export ffff9dc07118c800 : new refcount 4 00000100:00080000:1.0:1784189365.561226:0:3639:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:1.0:1784189365.561228:0:3639:0:(import.c:65:import_set_state_nolock()) ffff9dbf44677800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00000040:1.0:1784189365.561233:0:3639:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9dc05edd2300 x1870854458274560/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1784189375 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784189365.561240:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc05edd2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3639:1870854458274560:0@lo:38:llog_process_th.0 00000100:00000040:1.0:1784189365.561246:0:3639:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff9dbf43e13480 x1870854458274176/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/224 e 0 to 0 dl 1784189390 ref 1 fl Complete:RNQU/200/0 rc -11/-11 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:1.0:1784189365.561255:0:3639:0:(genops.c:1244:class_import_put()) import ffff9dc075655000 refcount=2 obd=lustre-OST0000-osc-MDT0000 00000100:00000040:1.0:1784189365.561261:0:3639:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff9dc05edd2300 x1870854458274560/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1784189375 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000020:00000040:1.0:1784189365.561268:0:3639:0:(genops.c:1244:class_import_put()) import ffff9dbf44677800 refcount=2 obd=lustre-MDT0001-lwp-OST0000 00000100:00000040:2.0:1784189365.561885:0:3643:0:(client.c:3108:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: skip recheck: last_committed 4294968945 00000100:00000040:2.0:1784189365.563517:0:3643:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff9dc080e7e300 x1870854458273792/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784189381 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1784189365.563588:0:3643:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9dc080e7e300 x1870854458273792/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784189381 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784189365.563596:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc080e7e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1870854458273792:0@lo:400:kworker.0 00000100:00000040:2.0:1784189365.563604:0:3643:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff9dc080e7e300 x1870854458273792/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784189381 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:2.0:1784189365.563615:0:3643:0:(genops.c:1244:class_import_put()) import ffff9dc080cc8800 refcount=2 obd=lustre-OST0001-osc-MDT0001 20000000:01000000:2.0:1784189365.564998:0:94309:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1784189365.565095:0:94309:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:1.0:1784189365.566480:0:94312:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1784189365.566486:0:94312:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00000040:1.0:1784189365.566496:0:94312:0:(ldlm_resource.c:1656:ldlm_resource_getref()) getref res: ffff9dc07fa37900 count: 4 00000020:00000040:0.0:1784189365.566573:0:94312:0:(lustre_handles.c:93:class_handle_hash()) added object ffff9dc070146c00 with handle 0xcc1762b626f8d5b8 to hash 00010000:00010000:0.0:1784189365.566580:0:94312:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9dc070146c00/0xcc1762b626f8d5b8 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 94312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189365.566656:0:94312:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9dc05ec0e600/0xcc1762b626f8c699 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcc1762b626f8c692 expref: 24 pid: 94308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189365.566665:0:94312:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9dc05ec0e800/0xcc1762b626f8c6b5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcc1762b626f8c6ae expref: 24 pid: 94314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189365.566673:0:94312:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9dc058f67c00/0xcc1762b626f8c75d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c409b expref: 9 pid: 94310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189365.566681:0:94312:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9dc070146c00/0xcc1762b626f8d5b8 lrc: 6/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 94312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:0.0:1784189365.566698:0:94312:0:(ldlm_resource.c:1876:ldlm_resource_dump()) --- Resource: [0x65727473756c:0x2:0x0].0x0 (ffff9dc07fa37900) refcount = 4 00010000:00000040:0.0:1784189365.566701:0:94312:0:(ldlm_resource.c:1879:ldlm_resource_dump()) Granted locks (in reverse order): 00010000:00000040:0.0:1784189365.566704:0:94312:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGS lock: ffff9dc058f67c00/0xcc1762b626f8c75d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000020 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c409b expref: 9 pid: 94310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:0.0:1784189365.566710:0:94312:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGS lock: ffff9dc05ec0e800/0xcc1762b626f8c6b5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000020 nid: 0@lo remote: 0xcc1762b626f8c6ae expref: 24 pid: 94314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:0.0:1784189365.566716:0:94312:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGS lock: ffff9dc05ec0e600/0xcc1762b626f8c699 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000020 nid: 0@lo remote: 0xcc1762b626f8c692 expref: 24 pid: 94308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:0.0:1784189365.566721:0:94312:0:(ldlm_resource.c:1894:ldlm_resource_dump()) Waiting locks: 00010000:00000040:0.0:1784189365.566723:0:94312:0:(ldlm_resource.c:1896:ldlm_resource_dump()) ### ### ns: MGS lock: ffff9dc070146c00/0xcc1762b626f8d5b8 lrc: 6/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 94312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000040:0.0:1784189365.566743:0:94312:0:(genops.c:1231:class_import_get()) import ffff9dbf42275000 refcount=2 obd=MGS 00010000:00010000:0.0:1784189365.566761:0:94312:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9dc058f67c00/0xcc1762b626f8c75d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c409b expref: 9 pid: 94310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189365.566774:0:94312:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9dc058f67c00/0xcc1762b626f8c75d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c409b expref: 9 pid: 94310 timeout: 3707 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00000040:0.0:1784189365.566788:0:94312:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff9dc05edd2a00 x1870854458274816/t0(0) o104->MGS@192.168.203.12@tcp:15/16 lens 328/224 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1784189365.566800:0:94312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc05edd2a00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:94312:1870854458274816:192.168.203.12@tcp:104: 00000100:00000040:0.0:1784189365.566824:0:94312:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=0 req@ffff9dc05edd2a00 x1870854458274816/t0(0) o104->MGS@192.168.203.12@tcp:15/16 lens 328/224 e 0 to 0 dl 1784189381 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:0.0:1784189365.566833:0:94312:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.203.12@tcp 00000020:00000040:0.0:1784189365.566923:0:94312:0:(genops.c:1231:class_import_get()) import ffff9dc050ae6800 refcount=2 obd=MGS 00010000:00010000:0.0:1784189365.566939:0:94312:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9dc05ec0e800/0xcc1762b626f8c6b5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcc1762b626f8c6ae expref: 24 pid: 94314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189365.566948:0:94312:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9dc05ec0e800/0xcc1762b626f8c6b5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcc1762b626f8c6ae expref: 24 pid: 94314 timeout: 3707 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00000040:0.0:1784189365.566958:0:94312:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff9dc05edd0a80 x1870854458274944/t0(0) o104->MGS@0@lo:15/16 lens 328/224 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1784189365.566965:0:94312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc05edd0a80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:94312:1870854458274944:0@lo:104: 00000100:00000040:0.0:1784189365.566977:0:94312:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=0 req@ffff9dc05edd0a80 x1870854458274944/t0(0) o104->MGS@0@lo:15/16 lens 328/224 e 0 to 0 dl 1784189381 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:0.0:1784189365.566984:0:94312:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1784189365.567011:0:94312:0:(events.c:337:request_in_callback()) incoming req@ffff9dc05edd2300 x1870854458274944 msgsize 328 00000100:00100000:0.0:1784189365.567015:0:94312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:0.0:1784189365.567039:0:94312:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff9dc05edd0a80 x1870854458274944/t0(0) o104->MGS@0@lo:15/16 lens 328/224 e 0 to 0 dl 1784189381 ref 2 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000020:00000040:0.0:1784189365.567055:0:94312:0:(genops.c:1231:class_import_get()) import ffff9dc050ae6800 refcount=3 obd=MGS 00010000:00010000:0.0:1784189365.567064:0:94312:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9dc05ec0e600/0xcc1762b626f8c699 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcc1762b626f8c692 expref: 24 pid: 94308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189365.567071:0:94312:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9dc05ec0e600/0xcc1762b626f8c699 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcc1762b626f8c692 expref: 24 pid: 94308 timeout: 3707 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00000040:0.0:1784189365.567080:0:94312:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff9dc05edd1880 x1870854458275072/t0(0) o104->MGS@0@lo:15/16 lens 328/224 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1784189365.567087:0:94312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc05edd1880 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:94312:1870854458275072:0@lo:104: 00000100:00000040:0.0:1784189365.567099:0:94312:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=0 req@ffff9dc05edd1880 x1870854458275072/t0(0) o104->MGS@0@lo:15/16 lens 328/224 e 0 to 0 dl 1784189381 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:0.0:1784189365.567105:0:94312:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00100000:2.0:1784189365.567120:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458274944 00000100:00000040:0.0:1784189365.567126:0:94312:0:(events.c:337:request_in_callback()) incoming req@ffff9dc07a761450 x1870854458275072 msgsize 328 00000100:00100000:2.0:1784189365.567127:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458274944 00000020:00000040:2.0:1784189365.567129:0:6496:0:(genops.c:825:class_conn2export()) looking for export cookie 0xcc1762b626f46415 00000100:00100000:0.0:1784189365.567130:0:94312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:0.0:1784189365.567132:0:94312:0:(events.c:349:request_in_callback()) Buffer complete: 0 buffers still posted 00000020:00000040:2.0:1784189365.567133:0:6496:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9dc043b6e000 refcount=3 00000100:00000040:0.0:1784189365.567143:0:94312:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff9dc05edd1880 x1870854458275072/t0(0) o104->MGS@0@lo:15/16 lens 328/224 e 0 to 0 dl 1784189381 ref 2 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:2.0:1784189365.567152:0:6496:0:(service.c:1432:ptlrpc_at_set_timer()) armed ldlm_cbd at +6s 00000100:00100000:0.0:1784189365.567154:0:94312:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dbf44443900 going to sleep for 11 seconds 00000100:00100000:0.0:1784189365.567174:0:6497:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1784189365.567183:0:6496:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (1/3 left), rc = 0 00000100:00100000:0.0:1784189365.567183:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458275072 00000100:00100000:0.0:1784189365.567186:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458275072 00000020:00000040:0.0:1784189365.567188:0:6497:0:(genops.c:825:class_conn2export()) looking for export cookie 0xcc1762b626f46415 00000020:00000040:0.0:1784189365.567190:0:6497:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9dc043b6e000 refcount=4 00000100:00100000:2.0:1784189365.567192:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 355 00000100:00000040:2.0:1784189365.567197:0:6496:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9dc043b6e000 : new rpc_count 1 00000100:00000040:2.0:1784189365.567201:0:6496:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9dc05edd2300 x1870854458274944/t0(0) o104->bd553d0d-03e2-4233-b06b-b55bbfa2b954@0@lo:556/0 lens 328/0 e 0 to 0 dl 1784189376 ref 1 fl New:/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1784189365.567205:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 356 00000100:00000040:0.0:1784189365.567207:0:6497:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9dc043b6e000 : new rpc_count 2 00000100:00000040:0.0:1784189365.567211:0:6497:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9dc07a761450 x1870854458275072/t0(0) o104->bd553d0d-03e2-4233-b06b-b55bbfa2b954@0@lo:556/0 lens 328/0 e 0 to 0 dl 1784189376 ref 1 fl New:/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1784189365.567213:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc05edd2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:bd553d0d-03e2-4233-b06b-b55bbfa2b954+4:94312:x1870854458274944:12345-0@lo:104: 00000020:00000040:2.0:1784189365.567220:0:6496:0:(lustre_handles.c:147:class_handle2object()) GET ldlm ffff9dc04a20a600 refcount=2 00000100:00100000:0.0:1784189365.567221:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc07a761450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:bd553d0d-03e2-4233-b06b-b55bbfa2b954+4:94312:x1870854458275072:12345-0@lo:104: 00000020:00000040:0.0:1784189365.567225:0:6497:0:(lustre_handles.c:147:class_handle2object()) GET ldlm ffff9dc04a20ae00 refcount=2 00010000:00010000:2.0:1784189365.567226:0:6496:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.112@tcp lock: ffff9dc04a20a600/0xcc1762b626f8c6ae lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xcc1762b626f8c6b5 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189365.567229:0:6497:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.112@tcp lock: ffff9dc04a20ae00/0xcc1762b626f8c692 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xcc1762b626f8c699 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00000040:2.0:1784189365.567242:0:6496:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9dc0710a1d00 refcount 63 to 0@lo 00000100:00000040:0.0:1784189365.567242:0:6497:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9dc0710a1d00 refcount 63 to 0@lo 00000100:00000040:2.0:1784189365.567247:0:6496:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1784189365.567247:0:6497:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1784189365.567261:0:6496:0:(events.c:149:reply_in_callback()) @@@ reply in flags=0 mlen=224 offset=224 replen=224 req@ffff9dc05edd0a80 x1870854458274944/t0(0) o104->MGS@0@lo:15/16 lens 328/224 e 0 to 0 dl 1784189381 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:0.0:1784189365.567261:0:6497:0:(events.c:149:reply_in_callback()) @@@ reply in flags=0 mlen=224 offset=224 replen=224 req@ffff9dc05edd1880 x1870854458275072/t0(0) o104->MGS@0@lo:15/16 lens 328/224 e 0 to 0 dl 1784189381 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:0.0:1784189365.567644:0:6497:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff9dc0710a1d00 refcount 62 to 0@lo 00010000:00010000:0.0:1784189365.567661:0:6497:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00000040:0.0:1784189365.567667:0:6497:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9dc07a761450 x1870854458275072/t0(0) o104->bd553d0d-03e2-4233-b06b-b55bbfa2b954@0@lo:556/0 lens 328/224 e 0 to 0 dl 1784189376 ref 1 fl Interpret:/0/0 rc 0/0 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1784189365.567676:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc07a761450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:bd553d0d-03e2-4233-b06b-b55bbfa2b954+4:94312:x1870854458275072:12345-0@lo:104: Request processed in 455us (548us total) trans 0 rc 0/0 00000100:00100000:0.0:1784189365.567689:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 356 00000100:00000040:0.0:1784189365.567691:0:6497:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9dc043b6e000 : new rpc_count 1 00000020:00000040:0.0:1784189365.567701:0:6497:0:(genops.c:900:class_export_put()) PUTting export ffff9dc043b6e000 : new refcount 3 00010000:00010000:3.0:1784189365.567739:0:6502:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784189365.567746:0:6502:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.112@tcp lock: ffff9dc04a20ae00/0xcc1762b626f8c692 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xcc1762b626f8c699 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189365.567754:0:6502:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc04a20ae00 already unused, calling callback (ffffffffc114ac20) 10000000:00010000:3.0:1784189365.567759:0:6502:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.112@tcp lock: ffff9dc04a20ae00/0xcc1762b626f8c692 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xcc1762b626f8c699 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000040:3.0:1784189365.567766:0:6502:0:(lustre_handles.c:147:class_handle2object()) GET ldlm ffff9dc04a20ae00 refcount=3 00010000:00010000:3.0:1784189365.567770:0:6502:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.112@tcp lock: ffff9dc04a20ae00/0xcc1762b626f8c692 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xcc1762b626f8c699 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1784189365.567778:0:6502:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.112@tcp lock: ffff9dc04a20ae00/0xcc1762b626f8c692 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xcc1762b626f8c699 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784189365.567794:0:6502:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:00000040:3.0:1784189365.567797:0:6502:0:(mgc_request.c:723:mgc_requeue_add()) log lustre-mdtir: requeue (r=2 sp=0 st=1) 10000000:00000040:3.0:1784189365.567799:0:6502:0:(mgc_request.c:726:mgc_requeue_add()) lockh 0x0 10000000:00000040:3.0:1784189365.567806:0:6502:0:(mgc_request.c:123:config_log_put()) log lustre-mdtir(ffff9dc0565a5800) refs 2 00000020:00000040:3.0:1784189365.567811:0:6502:0:(lustre_handles.c:107:class_handle_unhash_nolock()) removing object ffff9dc04a20ae00 with handle 0xcc1762b626f8c692 from hash 00000020:00000040:3.0:1784189365.567819:0:6502:0:(genops.c:1231:class_import_get()) import ffff9dc07110c800 refcount=5 obd=MGC192.168.203.112@tcp 00010000:00010000:3.0:1784189365.567830:0:6502:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.112@tcp lock: ffff9dc04a20ae00/0xcc1762b626f8c692 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcc1762b626f8c699 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189365.567836:0:6502:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00000040:3.0:1784189365.567846:0:6502:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [0000000077630a29] to pc [ptlrpcd_00_03+3] req@ffff9dc071535c00 x1870854458275200/t0(0) o103->MGC192.168.203.112@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 0 ref 1 fl New:QU/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00010000:00010000:3.0:1784189365.567866:0:6502:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.112@tcp lock: ffff9dc04a20ae00/0xcc1762b626f8c692 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcc1762b626f8c699 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189365.567874:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.112@tcp lock: ffff9dc04a20ae00/0xcc1762b626f8c692 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcc1762b626f8c699 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189365.567885:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784189365.567887:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784189365.567888:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00000040:3.0:1784189365.567896:0:3643:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff9dc071535c00 x1870854458275200/t0(0) o103->MGC192.168.203.112@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 0 ref 1 fl New:QU/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784189365.567906:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc071535c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:bd553d0d-03e2-4233-b06b-b55bbfa2b954:3643:1870854458275200:0@lo:103:ldlm_bl.0 00000100:00000040:3.0:1784189365.567920:0:3643:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff9dc071535c00 x1870854458275200/t0(0) o103->MGC192.168.203.112@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1784189381 ref 2 fl Rpc:r/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1784189365.567928:0:3643:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:3.0:1784189365.567947:0:3643:0:(events.c:337:request_in_callback()) incoming req@ffff9dc07113a450 x1870854458275200 msgsize 328 00000100:00100000:3.0:1784189365.567955:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:3.0:1784189365.567958:0:3643:0:(events.c:349:request_in_callback()) Buffer complete: 63 buffers still posted 00000100:00000040:3.0:1784189365.567973:0:3643:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff9dc071535c00 x1870854458275200/t0(0) o103->MGC192.168.203.112@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1784189381 ref 2 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1784189365.568176:0:3633:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff9dc05edd2a00 x1870854458274816/t0(0) o104->MGS@192.168.203.12@tcp:15/16 lens 328/224 e 0 to 0 dl 1784189381 ref 2 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1784189365.568197:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458275200 00000100:00100000:1.0:1784189365.568201:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458275200 00000020:00000040:1.0:1784189365.568203:0:6499:0:(genops.c:825:class_conn2export()) looking for export cookie 0xcc1762b626f8c573 00000020:00000040:1.0:1784189365.568205:0:6499:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9dc050ae5000 refcount=25 00000100:00000040:1.0:1784189365.568223:0:6499:0:(service.c:1432:ptlrpc_at_set_timer()) armed ldlm_canceld at +6s 00000020:00000040:1.0:1784189365.568228:0:6499:0:(lustre_handles.c:147:class_handle2object()) GET ldlm ffff9dc05ec0e600 refcount=5 00010000:00010000:1.0:1784189365.568233:0:6499:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9dc05ec0e600/0xcc1762b626f8c699 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcc1762b626f8c692 expref: 25 pid: 94308 timeout: 3707 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784189365.568255:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2602 00000100:00000040:1.0:1784189365.568258:0:6499:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9dc050ae5000 : new rpc_count 2 00000100:00000040:1.0:1784189365.568262:0:6499:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9dc07113a450 x1870854458275200/t0(0) o103->bd553d0d-03e2-4233-b06b-b55bbfa2b954@0@lo:556/0 lens 328/0 e 0 to 0 dl 1784189376 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784189365.568272:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc07113a450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bd553d0d-03e2-4233-b06b-b55bbfa2b954+25:3643:x1870854458275200:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1784189365.568281:0:6499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000020:00000040:1.0:1784189365.568283:0:6499:0:(lustre_handles.c:147:class_handle2object()) GET ldlm ffff9dc05ec0e600 refcount=5 00010000:00000040:1.0:1784189365.568285:0:6499:0:(ldlm_resource.c:1656:ldlm_resource_getref()) getref res: ffff9dc07fa37900 count: 5 00010000:00010000:1.0:1784189365.568290:0:6499:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9dc05ec0e600/0xcc1762b626f8c699 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcc1762b626f8c692 expref: 25 pid: 94308 timeout: 3707 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189365.568300:0:6499:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9dc05ec0e600/0xcc1762b626f8c699 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcc1762b626f8c692 expref: 25 pid: 94308 timeout: 3707 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000040:1.0:1784189365.568311:0:6499:0:(lustre_handles.c:107:class_handle_unhash_nolock()) removing object ffff9dc05ec0e600 with handle 0xcc1762b626f8c699 from hash 00010000:00000040:1.0:1784189365.568315:0:6499:0:(ldlm_lock.c:1987:ldlm_reprocess_queue()) Reprocessing lock ffff9dc070146c00 00010000:00010000:1.0:1784189365.568337:0:6499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00000040:1.0:1784189365.568342:0:6499:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9dc0710a1d00 refcount 63 to 0@lo 00000100:00000040:1.0:1784189365.568345:0:6499:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:1.0:1784189365.568363:0:6499:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff9dc071535c00 x1870854458275200/t0(0) o103->MGC192.168.203.112@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1784189381 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1784189365.568379:0:6499:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff9dc0710a1d00 refcount 62 to 0@lo 00000100:00000040:1.0:1784189365.568383:0:6499:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9dc07113a450 x1870854458275200/t0(0) o103->bd553d0d-03e2-4233-b06b-b55bbfa2b954@0@lo:556/0 lens 328/224 e 0 to 0 dl 1784189376 ref 1 fl Interpret:H/200/0 rc 0/0 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784189365.568402:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc07113a450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bd553d0d-03e2-4233-b06b-b55bbfa2b954+25:3643:x1870854458275200:12345-0@lo:103:ldlm_bl.0 Request processed in 131us (453us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189365.568409:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2602 00000100:00000040:1.0:1784189365.568411:0:6499:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9dc050ae5000 : new rpc_count 1 00000020:00000040:1.0:1784189365.568418:0:6499:0:(genops.c:900:class_export_put()) PUTting export ffff9dc050ae5000 : new refcount 24 00000100:00000040:1.0:1784189365.568473:0:3643:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff9dc071535c00 x1870854458275200/t0(0) o103->MGC192.168.203.112@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1784189381 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1784189365.568483:0:3643:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9dc071535c00 x1870854458275200/t0(0) o103->MGC192.168.203.112@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1784189381 ref 1 fl Interpret:RQU/200/0 rc 0/0 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784189365.568489:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc071535c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:bd553d0d-03e2-4233-b06b-b55bbfa2b954:3643:1870854458275200:0@lo:103:ldlm_bl.0 00000100:00000040:1.0:1784189365.568494:0:3643:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff9dc071535c00 x1870854458275200/t0(0) o103->MGC192.168.203.112@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1784189381 ref 1 fl Complete:RQU/200/0 rc 0/0 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000020:00000040:1.0:1784189365.568502:0:3643:0:(genops.c:1244:class_import_put()) import ffff9dc07110c800 refcount=4 obd=MGC192.168.203.112@tcp 00010000:00000040:3.0:1784189365.569848:0:94309:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 0, transno 0, xid 1870854458274688 00000100:00000040:3.0:1784189365.569860:0:94309:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9dc0710a1d00 refcount 63 to 0@lo 00000100:00000040:3.0:1784189365.569866:0:94309:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:3.0:1784189365.569896:0:94309:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=4768 offset=224 replen=4768 req@ffff9dc05edd3b80 x1870854458274688/t0(0) o253->MGC192.168.203.112@tcp@0@lo:26/25 lens 4848/4768 e 0 to 0 dl 1784189381 ref 2 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1784189365.569968:0:94309:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff9dc0710a1d00 refcount 62 to 0@lo 00000100:00000040:3.0:1784189365.569975:0:94309:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9dc044986850 x1870854458274688/t0(0) o253->bd553d0d-03e2-4233-b06b-b55bbfa2b954@0@lo:556/0 lens 4848/4768 e 0 to 0 dl 1784189376 ref 1 fl Interpret:/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784189365.569985:0:94309:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc044986850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd553d0d-03e2-4233-b06b-b55bbfa2b954+24:96879:x1870854458274688:12345-0@lo:253:mount.lustre.0 Request processed in 14404us (14866us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189365.569994:0:94309:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 204 00000100:00000040:3.0:1784189365.569997:0:94309:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9dc050ae5000 : new rpc_count 0 00000020:00000040:3.0:1784189365.570007:0:94309:0:(genops.c:900:class_export_put()) PUTting export ffff9dc050ae5000 : new refcount 23 00000100:00000040:2.0:1784189365.570067:0:6496:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff9dc0710a1d00 refcount 61 to 0@lo 00010000:00010000:2.0:1784189365.570085:0:6496:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00000040:2.0:1784189365.570091:0:6496:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9dc05edd2300 x1870854458274944/t0(0) o104->bd553d0d-03e2-4233-b06b-b55bbfa2b954@0@lo:556/0 lens 328/224 e 0 to 0 dl 1784189376 ref 1 fl Interpret:/0/0 rc 0/0 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1784189365.570099:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc05edd2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:bd553d0d-03e2-4233-b06b-b55bbfa2b954+3:94312:x1870854458274944:12345-0@lo:104: Request processed in 2888us (3087us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189365.570107:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 355 00000100:00000040:2.0:1784189365.570109:0:6496:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9dc043b6e000 : new rpc_count 0 00000020:00000040:2.0:1784189365.570116:0:6496:0:(genops.c:900:class_export_put()) PUTting export ffff9dc043b6e000 : new refcount 2 00010000:00010000:3.0:1784189365.570193:0:6501:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784189365.570200:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.112@tcp lock: ffff9dc04a20a600/0xcc1762b626f8c6ae lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xcc1762b626f8c6b5 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189365.570209:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc04a20a600 already unused, calling callback (ffffffffc114ac20) 10000000:00010000:3.0:1784189365.570213:0:6501:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.112@tcp lock: ffff9dc04a20a600/0xcc1762b626f8c6ae lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xcc1762b626f8c6b5 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000040:3.0:1784189365.570222:0:6501:0:(lustre_handles.c:147:class_handle2object()) GET ldlm ffff9dc04a20a600 refcount=3 00010000:00010000:3.0:1784189365.570226:0:6501:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.112@tcp lock: ffff9dc04a20a600/0xcc1762b626f8c6ae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xcc1762b626f8c6b5 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1784189365.570245:0:6501:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.112@tcp lock: ffff9dc04a20a600/0xcc1762b626f8c6ae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xcc1762b626f8c6b5 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784189365.570251:0:6501:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:00000040:3.0:1784189365.570254:0:6501:0:(mgc_request.c:723:mgc_requeue_add()) log lustre-mdtir: requeue (r=2 sp=0 st=1) 10000000:00000040:3.0:1784189365.570256:0:6501:0:(mgc_request.c:726:mgc_requeue_add()) lockh 0x0 10000000:00000040:3.0:1784189365.570262:0:6501:0:(mgc_request.c:123:config_log_put()) log lustre-mdtir(ffff9dc049794000) refs 2 00000020:00000040:3.0:1784189365.570268:0:6501:0:(lustre_handles.c:107:class_handle_unhash_nolock()) removing object ffff9dc04a20a600 with handle 0xcc1762b626f8c6ae from hash 00000020:00000040:3.0:1784189365.570277:0:6501:0:(genops.c:1231:class_import_get()) import ffff9dc07110c800 refcount=5 obd=MGC192.168.203.112@tcp 00010000:00010000:3.0:1784189365.570290:0:6501:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.112@tcp lock: ffff9dc04a20a600/0xcc1762b626f8c6ae lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcc1762b626f8c6b5 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189365.570296:0:6501:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00000040:3.0:1784189365.570305:0:6501:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [000000007a62c396] to pc [ptlrpcd_00_00+0] req@ffff9dc071535500 x1870854458275328/t0(0) o103->MGC192.168.203.112@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 0 ref 1 fl New:QU/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00010000:00010000:3.0:1784189365.570343:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.112@tcp lock: ffff9dc04a20a600/0xcc1762b626f8c6ae lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcc1762b626f8c6b5 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189365.570351:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.112@tcp lock: ffff9dc04a20a600/0xcc1762b626f8c6ae lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcc1762b626f8c6b5 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:3.0:1784189365.570358:0:6501:0:(ldlm_resource.c:1704:ldlm_resource_putref()) putref res: ffff9dc07b032c00 count: 0 00010000:00010000:3.0:1784189365.570368:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784189365.570369:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784189365.570371:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00000040:3.0:1784189365.570379:0:3640:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff9dc071535500 x1870854458275328/t0(0) o103->MGC192.168.203.112@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 0 ref 1 fl New:QU/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784189365.570390:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc071535500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bd553d0d-03e2-4233-b06b-b55bbfa2b954:3640:1870854458275328:0@lo:103:ldlm_bl.0 00000100:00000040:3.0:1784189365.570413:0:3640:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff9dc071535500 x1870854458275328/t0(0) o103->MGC192.168.203.112@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1784189381 ref 2 fl Rpc:r/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1784189365.570420:0:3640:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:3.0:1784189365.570435:0:3640:0:(events.c:337:request_in_callback()) incoming req@ffff9dc071535c00 x1870854458275328 msgsize 328 00000100:00100000:3.0:1784189365.570439:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:3.0:1784189365.570452:0:3640:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff9dc071535500 x1870854458275328/t0(0) o103->MGC192.168.203.112@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1784189381 ref 2 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784189365.570483:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458275328 00000100:00100000:3.0:1784189365.570488:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458275328 00000020:00000040:3.0:1784189365.570490:0:6498:0:(genops.c:825:class_conn2export()) looking for export cookie 0xcc1762b626f8c573 00000020:00000040:3.0:1784189365.570493:0:6498:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9dc050ae5000 refcount=24 00000100:00000040:3.0:1784189365.570506:0:6498:0:(service.c:1432:ptlrpc_at_set_timer()) armed ldlm_canceld at +6s 00000020:00000040:3.0:1784189365.570511:0:6498:0:(lustre_handles.c:147:class_handle2object()) GET ldlm ffff9dc05ec0e800 refcount=5 00010000:00010000:3.0:1784189365.570515:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9dc05ec0e800/0xcc1762b626f8c6b5 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcc1762b626f8c6ae expref: 24 pid: 94314 timeout: 3707 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784189365.570534:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2603 00000100:00000040:3.0:1784189365.570537:0:6498:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9dc050ae5000 : new rpc_count 1 00000100:00000040:3.0:1784189365.570541:0:6498:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9dc071535c00 x1870854458275328/t0(0) o103->bd553d0d-03e2-4233-b06b-b55bbfa2b954@0@lo:556/0 lens 328/0 e 0 to 0 dl 1784189376 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784189365.570552:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc071535c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bd553d0d-03e2-4233-b06b-b55bbfa2b954+24:3640:x1870854458275328:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1784189365.570562:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000020:00000040:3.0:1784189365.570564:0:6498:0:(lustre_handles.c:147:class_handle2object()) GET ldlm ffff9dc05ec0e800 refcount=5 00010000:00000040:3.0:1784189365.570566:0:6498:0:(ldlm_resource.c:1656:ldlm_resource_getref()) getref res: ffff9dc07fa37900 count: 5 00010000:00010000:3.0:1784189365.570570:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9dc05ec0e800/0xcc1762b626f8c6b5 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcc1762b626f8c6ae expref: 24 pid: 94314 timeout: 3707 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189365.570579:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9dc05ec0e800/0xcc1762b626f8c6b5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcc1762b626f8c6ae expref: 24 pid: 94314 timeout: 3707 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000040:3.0:1784189365.570614:0:6498:0:(lustre_handles.c:107:class_handle_unhash_nolock()) removing object ffff9dc05ec0e800 with handle 0xcc1762b626f8c6b5 from hash 00010000:00000040:3.0:1784189365.570618:0:6498:0:(ldlm_lock.c:1987:ldlm_reprocess_queue()) Reprocessing lock ffff9dc070146c00 00010000:00010000:3.0:1784189365.570622:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00000040:3.0:1784189365.570627:0:6498:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9dc0710a1d00 refcount 62 to 0@lo 00000100:00000040:3.0:1784189365.570640:0:6498:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:3.0:1784189365.570658:0:6498:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff9dc071535500 x1870854458275328/t0(0) o103->MGC192.168.203.112@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1784189381 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1784189365.570675:0:6498:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff9dc0710a1d00 refcount 61 to 0@lo 00000100:00000040:3.0:1784189365.570679:0:6498:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9dc071535c00 x1870854458275328/t0(0) o103->bd553d0d-03e2-4233-b06b-b55bbfa2b954@0@lo:556/0 lens 328/224 e 0 to 0 dl 1784189376 ref 1 fl Interpret:H/200/0 rc 0/0 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784189365.570687:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc071535c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bd553d0d-03e2-4233-b06b-b55bbfa2b954+24:3640:x1870854458275328:12345-0@lo:103:ldlm_bl.0 Request processed in 137us (250us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189365.570693:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2603 00000100:00000040:3.0:1784189365.570696:0:6498:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9dc050ae5000 : new rpc_count 0 00000020:00000040:3.0:1784189365.570702:0:6498:0:(genops.c:900:class_export_put()) PUTting export ffff9dc050ae5000 : new refcount 23 00000100:00000040:3.0:1784189365.570729:0:3640:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff9dc071535500 x1870854458275328/t0(0) o103->MGC192.168.203.112@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1784189381 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1784189365.570738:0:3640:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9dc071535500 x1870854458275328/t0(0) o103->MGC192.168.203.112@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1784189381 ref 1 fl Interpret:RQU/200/0 rc 0/0 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784189365.570745:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc071535500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bd553d0d-03e2-4233-b06b-b55bbfa2b954:3640:1870854458275328:0@lo:103:ldlm_bl.0 00000100:00000040:3.0:1784189365.570750:0:3640:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff9dc071535500 x1870854458275328/t0(0) o103->MGC192.168.203.112@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1784189381 ref 1 fl Complete:RQU/200/0 rc 0/0 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000020:00000040:3.0:1784189365.570759:0:3640:0:(genops.c:1244:class_import_put()) import ffff9dc07110c800 refcount=4 obd=MGC192.168.203.112@tcp 00000100:00000040:1.0:1784189365.571007:0:94312:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff9dc05edd0a80 x1870854458274944/t0(0) o104->MGS@0@lo:15/16 lens 328/224 e 0 to 0 dl 1784189381 ref 1 fl Rpc:RQU/0/0 rc 0/0 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00010000:00010000:1.0:1784189365.571017:0:94312:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dc05ec0e800/0xcc1762b626f8c6b5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcc1762b626f8c6ae expref: 23 pid: 94314 timeout: 3707 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:1.0:1784189365.571024:0:94312:0:(ldlm_lock.c:204:ldlm_lock_put()) lock PUTting export ffff9dc050ae5000 : new locks_count 17 00000020:00000040:1.0:1784189365.571026:0:94312:0:(genops.c:900:class_export_put()) PUTting export ffff9dc050ae5000 : new refcount 22 00000100:00000040:1.0:1784189365.571032:0:94312:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9dc05edd0a80 x1870854458274944/t0(0) o104->MGS@0@lo:15/16 lens 328/224 e 0 to 0 dl 1784189381 ref 1 fl Interpret:RQU/0/0 rc 0/0 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1784189365.571042:0:94312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc05edd0a80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:94312:1870854458274944:0@lo:104: 00000100:00000040:1.0:1784189365.571054:0:94312:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff9dc05edd1880 x1870854458275072/t0(0) o104->MGS@0@lo:15/16 lens 328/224 e 0 to 0 dl 1784189381 ref 1 fl Rpc:RQU/0/0 rc 0/0 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00010000:00010000:1.0:1784189365.571073:0:94312:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dc05ec0e600/0xcc1762b626f8c699 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcc1762b626f8c692 expref: 22 pid: 94308 timeout: 3707 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:1.0:1784189365.571079:0:94312:0:(ldlm_lock.c:204:ldlm_lock_put()) lock PUTting export ffff9dc050ae5000 : new locks_count 16 00000020:00000040:1.0:1784189365.571081:0:94312:0:(genops.c:900:class_export_put()) PUTting export ffff9dc050ae5000 : new refcount 21 00000100:00000040:1.0:1784189365.571086:0:94312:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9dc05edd1880 x1870854458275072/t0(0) o104->MGS@0@lo:15/16 lens 328/224 e 0 to 0 dl 1784189381 ref 1 fl Interpret:RQU/0/0 rc 0/0 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1784189365.571092:0:94312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc05edd1880 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:94312:1870854458275072:0@lo:104: 00000100:00000040:0.0:1784189365.571157:0:96879:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff9dc05edd3b80 x1870854458274688/t0(0) o253->MGC192.168.203.112@tcp@0@lo:26/25 lens 4848/4768 e 0 to 0 dl 1784189381 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1784189365.571166:0:96879:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9dc05edd3b80 x1870854458274688/t0(0) o253->MGC192.168.203.112@tcp@0@lo:26/25 lens 4848/4768 e 0 to 0 dl 1784189381 ref 2 fl Interpret:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784189365.571174:0:96879:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc05edd3b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd553d0d-03e2-4233-b06b-b55bbfa2b954:96879:1870854458274688:0@lo:253:mount.lustre.0 00000100:00000040:0.0:1784189365.571180:0:96879:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff9dc05edd3b80 x1870854458274688/t0(0) o253->MGC192.168.203.112@tcp@0@lo:26/25 lens 4848/4768 e 0 to 0 dl 1784189381 ref 2 fl Complete:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 10000000:01000000:0.0:1784189365.571191:0:96879:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:0.0:1784189365.571194:0:96879:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1784189365.571195:0:96879:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1784189365.571197:0:96879:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1784189365.571198:0:96879:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1784189365.571200:0:96879:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1784189365.571201:0:96879:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1784189365.571202:0:96879:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1784189365.571204:0:96879:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1784189365.571205:0:96879:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000100:00000040:0.0:1784189365.571208:0:96879:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff9dc05edd3b80 x1870854458274688/t0(0) o253->MGC192.168.203.112@tcp@0@lo:26/25 lens 4848/4768 e 0 to 0 dl 1784189381 ref 1 fl Complete:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000020:00000040:0.0:1784189365.571216:0:96879:0:(genops.c:1244:class_import_put()) import ffff9dc07110c800 refcount=3 obd=MGC192.168.203.112@tcp 00000020:02000000:0.0:1784189365.571226:0:96879:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00002000:00000040:0.0:1784189365.571368:0:96879:0:(ofd_dev.c:430:ofd_object_init()) object init, fid = [0x200000003:0x3:0x0] 00002000:00000040:0.0:1784189365.571382:0:96879:0:(ofd_dev.c:430:ofd_object_init()) object init, fid = [0x200000001:0xf:0x0] 00002000:00000040:0.0:1784189365.571421:0:96879:0:(ofd_dev.c:430:ofd_object_init()) object init, fid = [0x200000003:0x4:0x0] 00002000:00000040:0.0:1784189365.571455:0:96879:0:(ofd_dev.c:430:ofd_object_init()) object init, fid = [0x200000005:0x1:0x0] 00002000:00000040:0.0:1784189365.571485:0:96879:0:(ofd_dev.c:430:ofd_object_init()) object init, fid = [0x200000001:0x10:0x0] 00002000:00000040:0.0:1784189365.571528:0:96879:0:(ofd_dev.c:430:ofd_object_init()) object init, fid = [0x200000003:0x5:0x0] 00002000:00000040:0.0:1784189365.571552:0:96879:0:(ofd_dev.c:430:ofd_object_init()) object init, fid = [0x200000005:0x2:0x0] 00002000:00000040:0.0:1784189365.571574:0:96879:0:(ofd_dev.c:430:ofd_object_init()) object init, fid = [0x200000001:0x16:0x0] 00002000:00000040:0.0:1784189365.571608:0:96879:0:(ofd_dev.c:430:ofd_object_init()) object init, fid = [0x200000003:0x6:0x0] 00002000:00000040:0.0:1784189365.571660:0:96879:0:(ofd_dev.c:430:ofd_object_init()) object init, fid = [0x200000005:0x3:0x0] 00002000:00000040:1.0:1784189365.572153:0:96879:0:(ofd_dev.c:430:ofd_object_init()) object init, fid = [0x200000001:0x12:0x0] 00010000:00080000:1.0:1784189365.572241:0:96879:0:(ldlm_lib.c:3053:target_recovery_init()) RECOVERY: service lustre-OST0000, 3 recoverable clients, last_transno 4294968977 00010000:00080000:1.0:1784189365.572836:0:96896:0:(ldlm_lib.c:2853:target_recovery_thread()) lustre-OST0000: started recovery thread pid 96896 00010000:02000000:1.0:1784189365.572849:0:96896:0:(ldlm_lib.c:2335:target_recovery_overseer()) lustre-OST0000: in recovery but waiting for the first client to connect 00010000:00080000:1.0:1784189365.572853:0:96896:0:(ldlm_lib.c:2545:check_for_recovery_ready()) connected 0 stale 0 max_recoverable_clients 3 abort 0 expired 0 00010000:00080000:1.0:1784189365.572856:0:96896:0:(ldlm_lib.c:2545:check_for_recovery_ready()) connected 0 stale 0 max_recoverable_clients 3 abort 0 expired 0 00000020:01000004:0.0:1784189365.572921:0:96879:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:00000040:0.0:1784189365.572927:0:96879:0:(lustre_log.h:387:llog_ctxt_get()) GETting ctxt ffff9dc076067780 : new refcount 2 00000040:00000040:0.0:1784189365.572931:0:96879:0:(lustre_log.h:402:llog_ctxt_put()) PUTting ctxt ffff9dc076067780 : new refcount 1 00000020:00000040:0.0:1784189365.572952:0:96879:0:(genops.c:900:class_export_put()) PUTting export ffff9dc045665000 : new refcount 1 00000020:00000040:0.0:1784189365.572962:0:96879:0:(obd_config.c:1022:class_decref()) Decref MGC192.168.203.112@tcp (ffff9dc06bb30000) now 6 - mgc_fs 10000000:01000000:0.0:1784189365.572965:0:96879:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.112@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1784189365.572982:0:96879:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=49 00000080:00000004:0.0:1784189365.573005:0:96879:0:(super25.c:181:lustre_fill_super()) /dev/mapper/ost1_flakey: Mount complete 00000020:00000004:0.0:1784189365.573838:0:96879:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1784189365.574052:0:96879:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00000040:0.0:1784189365.594846:0:3635:0:(events.c:149:reply_in_callback()) @@@ reply in flags=0 mlen=224 offset=224 replen=224 req@ffff9dc05edd2a00 x1870854458274816/t0(0) o104->MGS@192.168.203.12@tcp:15/16 lens 328/224 e 0 to 0 dl 1784189381 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:0.0:1784189365.594892:0:3635:0:(events.c:337:request_in_callback()) incoming req@ffff9dc05edd3b80 x1870854436388864 msgsize 328 00000100:00100000:0.0:1784189365.594898:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00000040:0.0:1784189365.594940:0:94312:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff9dc05edd2a00 x1870854458274816/t0(0) o104->MGS@192.168.203.12@tcp:15/16 lens 328/224 e 0 to 0 dl 1784189381 ref 1 fl Rpc:RQU/0/0 rc 0/0 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:0.0:1784189365.594952:0:94312:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9dc05edd2a00 x1870854458274816/t0(0) o104->MGS@192.168.203.12@tcp:15/16 lens 328/224 e 0 to 0 dl 1784189381 ref 1 fl Interpret:RQU/0/0 rc 0/0 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1784189365.594959:0:94312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc05edd2a00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:94312:1870854458274816:192.168.203.12@tcp:104: 00000100:00000040:0.0:1784189365.594971:0:94312:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff9dc05edd0a80 x1870854458274944/t0(0) o104->MGS@0@lo:15/16 lens 328/224 e 0 to 0 dl 1784189381 ref 1 fl Complete:RQU/0/0 rc 0/0 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000020:00000040:0.0:1784189365.594982:0:94312:0:(genops.c:1244:class_import_put()) import ffff9dc050ae6800 refcount=2 obd=MGS 00000100:00000040:0.0:1784189365.594992:0:94312:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff9dc05edd1880 x1870854458275072/t0(0) o104->MGS@0@lo:15/16 lens 328/224 e 0 to 0 dl 1784189381 ref 1 fl Complete:RQU/0/0 rc 0/0 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000020:00000040:0.0:1784189365.594999:0:94312:0:(genops.c:1244:class_import_put()) import ffff9dc050ae6800 refcount=1 obd=MGS 00000100:00000040:0.0:1784189365.595012:0:94312:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff9dc05edd2a00 x1870854458274816/t0(0) o104->MGS@192.168.203.12@tcp:15/16 lens 328/224 e 0 to 0 dl 1784189381 ref 1 fl Complete:RQU/0/0 rc 0/0 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000020:00000040:0.0:1784189365.595018:0:94312:0:(genops.c:1244:class_import_put()) import ffff9dbf42275000 refcount=1 obd=MGS 00010000:00010000:0.0:1784189365.595030:0:94312:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9dc070146c00/0xcc1762b626f8d5b8 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 94312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784189365.595057:0:26172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436388864 00000100:00100000:0.0:1784189365.595063:0:26172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436388864 00000020:00000040:0.0:1784189365.595065:0:26172:0:(genops.c:825:class_conn2export()) looking for export cookie 0xcc1762b626f8c756 00000020:00000040:0.0:1784189365.595069:0:26172:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9dc0756a3800 refcount=10 00000100:00000040:0.0:1784189365.595090:0:26172:0:(service.c:1432:ptlrpc_at_set_timer()) armed ldlm_canceld at +6s 00000020:00000040:0.0:1784189365.595099:0:26172:0:(lustre_handles.c:147:class_handle2object()) GET ldlm ffff9dc058f67c00 refcount=4 00010000:00010000:0.0:1784189365.595104:0:26172:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9dc058f67c00/0xcc1762b626f8c75d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c409b expref: 10 pid: 94310 timeout: 3707 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784189365.595132:0:26172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 2604 00000100:00000040:0.0:1784189365.595136:0:26172:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9dc0756a3800 : new rpc_count 1 00000100:00000040:0.0:1784189365.595140:0:26172:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9dc05edd3b80 x1870854436388864/t0(0) o103->60f345e3-c70e-4f53-b5e7-c9671463c9a5@192.168.203.12@tcp:556/0 lens 328/0 e 0 to 0 dl 1784189376 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784189365.595150:0:26172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc05edd3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:60f345e3-c70e-4f53-b5e7-c9671463c9a5+10:2397:x1870854436388864:12345-192.168.203.12@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1784189365.595164:0:26172:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000020:00000040:0.0:1784189365.595166:0:26172:0:(lustre_handles.c:147:class_handle2object()) GET ldlm ffff9dc058f67c00 refcount=4 00010000:00000040:0.0:1784189365.595169:0:26172:0:(ldlm_resource.c:1656:ldlm_resource_getref()) getref res: ffff9dc07fa37900 count: 3 00010000:00010000:0.0:1784189365.595173:0:26172:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9dc058f67c00/0xcc1762b626f8c75d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c409b expref: 10 pid: 94310 timeout: 3707 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189365.595575:0:26172:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9dc058f67c00/0xcc1762b626f8c75d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c409b expref: 10 pid: 94310 timeout: 3707 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000040:0.0:1784189365.595590:0:26172:0:(lustre_handles.c:107:class_handle_unhash_nolock()) removing object ffff9dc058f67c00 with handle 0xcc1762b626f8c75d from hash 00010000:00010000:0.0:1784189365.595603:0:26172:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dc058f67c00/0xcc1762b626f8c75d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c409b expref: 10 pid: 94310 timeout: 3707 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:0.0:1784189365.595609:0:26172:0:(ldlm_lock.c:204:ldlm_lock_put()) lock PUTting export ffff9dc0756a3800 : new locks_count 3 00000020:00000040:0.0:1784189365.595611:0:26172:0:(genops.c:900:class_export_put()) PUTting export ffff9dc0756a3800 : new refcount 9 00010000:00000040:0.0:1784189365.595617:0:26172:0:(ldlm_lock.c:1987:ldlm_reprocess_queue()) Reprocessing lock ffff9dc070146c00 00010000:00010000:0.0:1784189365.595622:0:26172:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9dc070146c00/0xcc1762b626f8d5b8 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 94312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:0.0:1784189365.595640:0:26172:0:(ldlm_resource.c:1876:ldlm_resource_dump()) --- Resource: [0x65727473756c:0x2:0x0].0x0 (ffff9dc07fa37900) refcount = 2 00010000:00010000:0.0:1784189365.595645:0:26172:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dc070146c00/0xcc1762b626f8d5b8 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 94312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1784189365.595661:0:26172:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.029175980s 00000020:00000040:0.0:1784189365.595665:0:26172:0:(lustre_handles.c:147:class_handle2object()) GET ldlm ffff9dc070146c00 refcount=5 00010000:00010000:0.0:1784189365.595667:0:26172:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9dc070146c00/0xcc1762b626f8d5b8 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 94312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189365.595674:0:26172:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9dc070146c00/0xcc1762b626f8d5b8 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 94312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189365.595680:0:26172:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9dc070146c00/0xcc1762b626f8d5b8 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 94312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189365.595686:0:26172:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9dc070146c00/0xcc1762b626f8d5b8 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 94312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189365.595692:0:26172:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc070146c00 already unused, calling callback (ffffffffc0b2e230) 00010000:00010000:0.0:1784189365.595695:0:26172:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9dc070146c00/0xcc1762b626f8d5b8 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 94312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000040:0.0:1784189365.595700:0:26172:0:(lustre_handles.c:147:class_handle2object()) GET ldlm ffff9dc070146c00 refcount=6 00010000:00010000:0.0:1784189365.595710:0:26172:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9dc070146c00/0xcc1762b626f8d5b8 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 94312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000040:0.0:1784189365.595787:0:26172:0:(lustre_handles.c:107:class_handle_unhash_nolock()) removing object ffff9dc070146c00 with handle 0xcc1762b626f8d5b8 from hash 00010000:00010000:1.0:1784189365.595803:0:94312:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9dc070146c00/0xcc1762b626f8d5b8 lrc: 5/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 94312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189365.595811:0:94312:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9dc070146c00/0xcc1762b626f8d5b8 lrc: 5/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 94312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189365.595841:0:26172:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9dc070146c00/0xcc1762b626f8d5b8 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 94312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189365.595849:0:26172:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dc070146c00/0xcc1762b626f8d5b8 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 94312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:0.0:1784189365.595859:0:26172:0:(ldlm_resource.c:1704:ldlm_resource_putref()) putref res: ffff9dc07fa37900 count: 0 00010000:00010000:0.0:1784189365.595866:0:26172:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00000040:0.0:1784189365.595875:0:26172:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9dbf4274f140 refcount 9 to 192.168.203.12@tcp 00000100:00000040:0.0:1784189365.595881:0:26172:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.203.12@tcp 00000100:00000040:0.0:1784189365.595946:0:26172:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff9dbf4274f140 refcount 8 to 192.168.203.12@tcp 00000100:00000040:0.0:1784189365.595951:0:26172:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9dc05edd3b80 x1870854436388864/t0(0) o103->60f345e3-c70e-4f53-b5e7-c9671463c9a5@192.168.203.12@tcp:556/0 lens 328/224 e 0 to 0 dl 1784189376 ref 1 fl Interpret:H/200/0 rc 0/0 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784189365.595960:0:26172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc05edd3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:60f345e3-c70e-4f53-b5e7-c9671463c9a5+9:2397:x1870854436388864:12345-192.168.203.12@tcp:103:ldlm_bl.0 Request processed in 811us (1066us total) trans 0 rc 0/0 00000100:00100000:0.0:1784189365.595967:0:26172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 2604 00000100:00000040:0.0:1784189365.595970:0:26172:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9dc0756a3800 : new rpc_count 0 00000020:00000040:0.0:1784189365.595980:0:26172:0:(genops.c:900:class_export_put()) PUTting export ffff9dc0756a3800 : new refcount 8 00010000:00010000:1.0:1784189365.999517:0:26173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000040:0.0:1784189366.321606:0:75599:0:(genops.c:1231:class_import_get()) import ffff9dc080cc8800 refcount=3 obd=lustre-OST0001-osc-MDT0001 00000100:00000040:0.0:1784189366.321661:0:75599:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [000000007c38233e] to pc [ptlrpcd_00_01+1] req@ffff9dc05edd2a00 x1870854458275456/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/200/ffffffff rc 0/-1 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1784189366.321700:0:3641:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff9dc05edd2a00 x1870854458275456/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/200/ffffffff rc 0/-1 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784189366.321712:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc05edd2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1870854458275456:0@lo:13:osp-pre-1-1.0 00000100:00000040:0.0:1784189366.321753:0:3641:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff9dc05edd2a00 x1870854458275456/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784189382 ref 2 fl Rpc:r/200/ffffffff rc 0/-1 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1784189366.321762:0:3641:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1784189366.321797:0:3641:0:(events.c:337:request_in_callback()) incoming req@ffff9dc05edd1880 x1870854458275456 msgsize 224 00000100:00100000:0.0:1784189366.321801:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:0.0:1784189366.321831:0:3641:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff9dc05edd2a00 x1870854458275456/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784189382 ref 2 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1784189366.321844:0:3641:0:(niobuf.c:635:kick_cpu_latency()) lustre-OST0001-osc-MDT0001: using a timeout of 5152 usecs (6 jiffies) 00000100:00100000:3.0:1784189366.321889:0:9466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458275456 00000100:00100000:3.0:1784189366.321897:0:9466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458275456 00000020:00000040:3.0:1784189366.321907:0:9466:0:(genops.c:825:class_conn2export()) looking for export cookie 0xcc1762b626f864bc 00000020:00000040:3.0:1784189366.321911:0:9466:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9dbf42277000 refcount=5 00000100:00000040:3.0:1784189366.321933:0:9466:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_create at +6s 00000100:00100000:3.0:1784189366.321963:0:9466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2093 00000100:00000040:3.0:1784189366.321968:0:9466:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9dbf42277000 : new rpc_count 1 00000100:00000040:3.0:1784189366.321973:0:9466:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9dc05edd1880 x1870854458275456/t0(0) o13->lustre-MDT0001-mdtlov_UUID@0@lo:557/0 lens 224/0 e 0 to 0 dl 1784189377 ref 1 fl New:/200/ffffffff rc 0/-1 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784189366.321986:0:9466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc05edd1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1870854458275456:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1784189366.322013:0:9466:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8646976 pending 0 free 3923529728 avail 3692007424 00010000:00000040:3.0:1784189366.322022:0:9466:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 4294968945, transno 0, xid 1870854458275456 00000100:00000040:3.0:1784189366.322032:0:9466:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9dc0710a1d00 refcount 62 to 0@lo 00000100:00000040:3.0:1784189366.322037:0:9466:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:3.0:1784189366.322058:0:9466:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=368 offset=224 replen=368 req@ffff9dc05edd2a00 x1870854458275456/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784189382 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1784189366.322082:0:9466:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff9dc0710a1d00 refcount 61 to 0@lo 00000100:00000040:3.0:1784189366.322086:0:9466:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9dc05edd1880 x1870854458275456/t0(0) o13->lustre-MDT0001-mdtlov_UUID@0@lo:557/0 lens 224/368 e 0 to 0 dl 1784189377 ref 1 fl Interpret:/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784189366.322094:0:9466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc05edd1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1870854458275456:12345-0@lo:13:osp-pre-1-1.0 Request processed in 110us (295us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189366.322100:0:9466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2093 00000100:00000040:3.0:1784189366.322102:0:9466:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9dbf42277000 : new rpc_count 0 00000020:00000040:3.0:1784189366.322111:0:9466:0:(genops.c:900:class_export_put()) PUTting export ffff9dbf42277000 : new refcount 4 00000100:00000040:3.0:1784189366.322139:0:3641:0:(client.c:3108:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: skip recheck: last_committed 4294968945 00000100:00000040:3.0:1784189366.322144:0:3641:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff9dc05edd2a00 x1870854458275456/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784189382 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000004:00000040:3.0:1784189366.322153:0:3641:0:(osp_precreate.c:87:osp_pre_update_status_msfs()) lustre-OST0001-osc-MDT0001: Updating status = 0 00000004:00000040:3.0:1784189366.322155:0:3641:0:(osp_precreate.c:1081:osp_pre_update_msfs()) lustre-OST0001-osc-MDT0001: blocks=958279 free=957893 avail=901318 avail_mb=3520 hwm_mb=7 files=262144 ffree=261731 state=0: rc = 0 00000100:00000040:3.0:1784189366.322169:0:3641:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9dc05edd2a00 x1870854458275456/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784189382 ref 1 fl Interpret:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784189366.322176:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc05edd2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1870854458275456:0@lo:13:osp-pre-1-1.0 00000100:00000040:3.0:1784189366.322182:0:3641:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff9dc05edd2a00 x1870854458275456/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784189382 ref 1 fl Complete:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000020:00000040:3.0:1784189366.322190:0:3641:0:(genops.c:1244:class_import_put()) import ffff9dc080cc8800 refcount=2 obd=lustre-OST0001-osc-MDT0001 00000020:00000004:0.0:1784189366.428994:0:96945:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1784189366.429218:0:96945:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1784189367.023995:0:7454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 40000000:00000040:1.0:1784189367.312939:0:96994:0:(lproc_fid.c:547:ldebugfs_client_fid_width_seq_write()) cli-lustre-OST0000-super: Sequence size: 65536 10000000:00000040:2.0:1784189367.410792:0:6510:0:(mgc_request.c:108:config_log_get()) log lustre-mdtir (ffff9dc0565a5800) refs 2 10000000:01000000:2.0:1784189367.410801:0:6510:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1784189367.410804:0:6510:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff9dc07a8f1800 from 125 10000000:01000000:2.0:1784189367.410807:0:6510:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00000020:00000040:2.0:1784189367.410815:0:6510:0:(genops.c:1231:class_import_get()) import ffff9dc07110c800 refcount=4 obd=MGC192.168.203.112@tcp 00000020:00000040:2.0:1784189367.410848:0:6510:0:(lustre_handles.c:93:class_handle_hash()) added object ffff9dc080f04a00 with handle 0xcc1762b626f8d5bf to hash 00010000:00010000:2.0:1784189367.410870:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff9dc080f04a00/0xcc1762b626f8d5bf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189367.410880:0:6510:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: ffff9dc080f04a00/0xcc1762b626f8d5bf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189367.410892:0:6510:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: ffff9dc080f04a00/0xcc1762b626f8d5bf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00000040:2.0:1784189367.410916:0:6510:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff9dc07130ed80 x1870854458275584/t0(0) o101->MGC192.168.203.112@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 0 ref 2 fl New:QU/200/ffffffff rc 0/-1 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784189367.410928:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc07130ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458275584:0@lo:101:ll_cfg_requeue.0 00000100:00000040:2.0:1784189367.410954:0:6510:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff9dc07130ed80 x1870854458275584/t0(0) o101->MGC192.168.203.112@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1784189383 ref 3 fl Rpc:r/200/ffffffff rc 0/-1 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1784189367.410963:0:6510:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1784189367.414840:0:6510:0:(events.c:337:request_in_callback()) incoming req@ffff9dc044987050 x1870854458275584 msgsize 328 00000100:00100000:2.0:1784189367.414854:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:2.0:1784189367.414856:0:6510:0:(events.c:349:request_in_callback()) Buffer complete: 63 buffers still posted 00000100:00000040:2.0:1784189367.414899:0:6510:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 2 req@ffff9dc07130ed80 x1870854458275584/t0(0) o101->MGC192.168.203.112@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1784189383 ref 3 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784189367.414930:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dc048b0f240 going to sleep for 11 seconds 00000100:00100000:0.0:1784189367.415026:0:94308:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458275584 00000100:00100000:0.0:1784189367.415035:0:94308:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458275584 00000020:00000040:0.0:1784189367.415038:0:94308:0:(genops.c:825:class_conn2export()) looking for export cookie 0xcc1762b626f8c573 00000020:00000040:0.0:1784189367.415043:0:94308:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9dc050ae5000 refcount=22 00000100:00000040:0.0:1784189367.415063:0:94308:0:(service.c:1432:ptlrpc_at_set_timer()) armed mgs at +6s 00000100:00100000:0.0:1784189367.415159:0:94308:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 205 00000100:00000040:0.0:1784189367.415163:0:94308:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9dc050ae5000 : new rpc_count 1 00000100:00000040:0.0:1784189367.415169:0:94308:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9dc044987050 x1870854458275584/t0(0) o101->bd553d0d-03e2-4233-b06b-b55bbfa2b954@0@lo:558/0 lens 328/0 e 0 to 0 dl 1784189378 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784189367.415182:0:94308:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc044987050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd553d0d-03e2-4233-b06b-b55bbfa2b954+22:6510:x1870854458275584:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784189367.415198:0:94308:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000020:00000040:0.0:1784189367.415214:0:94308:0:(lustre_handles.c:93:class_handle_hash()) added object ffff9dc070147e00 with handle 0xcc1762b626f8d5c6 to hash 00010000:00010000:0.0:1784189367.415220:0:94308:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dc070147e00/0xcc1762b626f8d5c6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xcc1762b626f8d5bf expref: -99 pid: 94308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:0.0:1784189367.415237:0:94308:0:(ldlm_lockd.c:1373:ldlm_handle_enqueue()) lock GETting export ffff9dc050ae5000 : new locks_count 17 00000020:00000040:0.0:1784189367.415240:0:94308:0:(genops.c:889:class_export_get()) GET export ffff9dc050ae5000 refcount=23 00010000:00000040:0.0:1784189367.415256:0:94308:0:(ldlm_resource.c:1876:ldlm_resource_dump()) --- Resource: [0x65727473756c:0x2:0x0].0x0 (ffff9dc0755c1b00) refcount = 1 00010000:00010000:0.0:1784189367.415262:0:94308:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dc070147e00/0xcc1762b626f8d5c6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcc1762b626f8d5bf expref: 23 pid: 94308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189367.415280:0:94308:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dc070147e00/0xcc1762b626f8d5c6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcc1762b626f8d5bf expref: 23 pid: 94308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784189367.415290:0:94308:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc070147e00, rc 0) 00010000:00000040:0.0:1784189367.415293:0:94308:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 0, transno 0, xid 1870854458275584 00000100:00000040:0.0:1784189367.415302:0:94308:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9dc0710a1d00 refcount 62 to 0@lo 00000100:00000040:0.0:1784189367.415307:0:94308:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1784189367.415362:0:94308:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=344 offset=224 replen=344 req@ffff9dc07130ed80 x1870854458275584/t0(0) o101->MGC192.168.203.112@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1784189383 ref 2 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1784189367.415380:0:94308:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff9dc0710a1d00 refcount 61 to 0@lo 00000100:00000040:0.0:1784189367.415385:0:94308:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9dc044987050 x1870854458275584/t0(0) o101->bd553d0d-03e2-4233-b06b-b55bbfa2b954@0@lo:558/0 lens 328/344 e 0 to 0 dl 1784189378 ref 1 fl Interpret:/200/0 rc 0/0 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784189367.415393:0:94308:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc044987050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd553d0d-03e2-4233-b06b-b55bbfa2b954+23:6510:x1870854458275584:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 213us (554us total) trans 0 rc 0/0 00000100:00100000:0.0:1784189367.415399:0:94308:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 205 00000100:00000040:0.0:1784189367.415402:0:94308:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9dc050ae5000 : new rpc_count 0 00000020:00000040:0.0:1784189367.415411:0:94308:0:(genops.c:900:class_export_put()) PUTting export ffff9dc050ae5000 : new refcount 22 00000100:00000040:2.0:1784189367.415480:0:6510:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff9dc07130ed80 x1870854458275584/t0(0) o101->MGC192.168.203.112@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1784189383 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1784189367.415490:0:6510:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9dc07130ed80 x1870854458275584/t0(0) o101->MGC192.168.203.112@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1784189383 ref 2 fl Interpret:RQU/200/0 rc 0/0 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784189367.415498:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc07130ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458275584:0@lo:101:ll_cfg_requeue.0 00000100:00000040:2.0:1784189367.415505:0:6510:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff9dc07130ed80 x1870854458275584/t0(0) o101->MGC192.168.203.112@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1784189383 ref 2 fl Complete:RQU/200/0 rc 0/0 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000020:00000040:2.0:1784189367.415521:0:6510:0:(lustre_handles.c:147:class_handle2object()) GET ldlm ffff9dc080f04a00 refcount=4 00010000:00000040:2.0:1784189367.415526:0:6510:0:(ldlm_request.c:746:ldlm_cli_enqueue_fini()) local: ffff9dc080f04a00, remote cookie: 0xcc1762b626f8d5c6, flags: 0x0 00010000:00000040:2.0:1784189367.415531:0:6510:0:(ldlm_resource.c:1876:ldlm_resource_dump()) --- Resource: [0x65727473756c:0x2:0x0].0x0 (ffff9dc07b032400) refcount = 1 00010000:00010000:2.0:1784189367.415534:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: ffff9dc080f04a00/0xcc1762b626f8d5bf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc1762b626f8d5c6 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189367.415543:0:6510:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: ffff9dc080f04a00/0xcc1762b626f8d5bf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcc1762b626f8d5c6 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00000040:2.0:1784189367.415551:0:6510:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff9dc07130ed80 x1870854458275584/t0(0) o101->MGC192.168.203.112@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1784189383 ref 1 fl Complete:RQU/200/0 rc 0/0 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000020:00000040:2.0:1784189367.415560:0:6510:0:(genops.c:1244:class_import_put()) import ffff9dc07110c800 refcount=3 obd=MGC192.168.203.112@tcp 10000000:00000040:2.0:1784189367.415569:0:6510:0:(mgc_request.c:108:config_log_get()) log lustre-mdtir (ffff9dc0565a5800) refs 3 00000020:00000040:2.0:1784189367.415571:0:6510:0:(lustre_handles.c:147:class_handle2object()) GET ldlm ffff9dc080f04a00 refcount=3 00000020:00000040:2.0:1784189367.416766:0:6510:0:(genops.c:1231:class_import_get()) import ffff9dc07110c800 refcount=4 obd=MGC192.168.203.112@tcp 00000020:00000040:2.0:1784189367.416787:0:6510:0:(genops.c:1231:class_import_get()) import ffff9dc07110c800 refcount=5 obd=MGC192.168.203.112@tcp 00000100:00000040:2.0:1784189367.416803:0:6510:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff9dc07130ed80 x1870854458275712/t0(0) o256->MGC192.168.203.112@tcp@0@lo:26/25 lens 304/240 e 0 to 0 dl 0 ref 2 fl New:QU/200/ffffffff rc 0/-1 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784189367.416816:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc07130ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458275712:0@lo:256:ll_cfg_requeue.0 00000100:00000040:2.0:1784189367.416841:0:6510:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff9dc07130ed80 x1870854458275712/t0(0) o256->MGC192.168.203.112@tcp@0@lo:26/25 lens 304/240 e 0 to 0 dl 1784189383 ref 3 fl Rpc:r/200/ffffffff rc 0/-1 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1784189367.416849:0:6510:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1784189367.416875:0:6510:0:(events.c:337:request_in_callback()) incoming req@ffff9dc044941450 x1870854458275712 msgsize 304 00000100:00100000:2.0:1784189367.416879:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:2.0:1784189367.416881:0:6510:0:(events.c:349:request_in_callback()) Buffer complete: 63 buffers still posted 00000100:00000040:2.0:1784189367.416904:0:6510:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 2 req@ffff9dc07130ed80 x1870854458275712/t0(0) o256->MGC192.168.203.112@tcp@0@lo:26/25 lens 304/240 e 0 to 0 dl 1784189383 ref 3 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784189367.416927:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dc048b0f240 going to sleep for 11 seconds 00000100:00100000:1.0:1784189367.416972:0:94314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458275712 00000100:00100000:1.0:1784189367.416978:0:94314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458275712 00000020:00000040:1.0:1784189367.416981:0:94314:0:(genops.c:825:class_conn2export()) looking for export cookie 0xcc1762b626f8c573 00000020:00000040:1.0:1784189367.416985:0:94314:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9dc050ae5000 refcount=23 00000100:00000040:1.0:1784189367.417009:0:94314:0:(service.c:1432:ptlrpc_at_set_timer()) armed mgs at +6s 00000100:00100000:1.0:1784189367.417038:0:94314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 206 00000100:00000040:1.0:1784189367.417042:0:94314:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9dc050ae5000 : new rpc_count 1 00000100:00000040:1.0:1784189367.417046:0:94314:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9dc044941450 x1870854458275712/t0(0) o256->bd553d0d-03e2-4233-b06b-b55bbfa2b954@0@lo:558/0 lens 304/0 e 0 to 0 dl 1784189378 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784189367.417056:0:94314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc044941450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:bd553d0d-03e2-4233-b06b-b55bbfa2b954+23:6510:x1870854458275712:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1784189367.417073:0:94314:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:00000040:1.0:1784189367.417082:0:94314:0:(mgs_nids.c:144:nidtbl_fill_entry()) IR: 1 NIDs from NET #0 20000000:01000000:1.0:1784189367.417088:0:94314:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1784189367.417091:0:94314:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 125 00000020:00000040:1.0:1784189367.417096:0:94314:0:(genops.c:889:class_export_get()) GET export ffff9dc050ae5000 refcount=24 00000020:00000040:1.0:1784189367.417138:0:94314:0:(genops.c:900:class_export_put()) PUTting export ffff9dc050ae5000 : new refcount 23 00010000:00000040:1.0:1784189367.417150:0:94314:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 0, transno 0, xid 1870854458275712 00000100:00000040:1.0:1784189367.417157:0:94314:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9dc0710a1d00 refcount 62 to 0@lo 00000100:00000040:1.0:1784189367.417161:0:94314:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:1.0:1784189367.417172:0:94314:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=240 offset=224 replen=240 req@ffff9dc07130ed80 x1870854458275712/t0(0) o256->MGC192.168.203.112@tcp@0@lo:26/25 lens 304/240 e 0 to 0 dl 1784189383 ref 2 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1784189367.417184:0:94314:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff9dc0710a1d00 refcount 61 to 0@lo 00000100:00000040:1.0:1784189367.417189:0:94314:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9dc044941450 x1870854458275712/t0(0) o256->bd553d0d-03e2-4233-b06b-b55bbfa2b954@0@lo:558/0 lens 304/240 e 0 to 0 dl 1784189378 ref 1 fl Interpret:/200/0 rc 0/0 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784189367.417196:0:94314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc044941450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:bd553d0d-03e2-4233-b06b-b55bbfa2b954+23:6510:x1870854458275712:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 141us (320us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189367.417203:0:94314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 206 00000100:00000040:1.0:1784189367.417206:0:94314:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9dc050ae5000 : new rpc_count 0 00000020:00000040:1.0:1784189367.417214:0:94314:0:(genops.c:900:class_export_put()) PUTting export ffff9dc050ae5000 : new refcount 22 00000100:00000040:2.0:1784189367.417351:0:6510:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Bulk req@ffff9dc07130ed80 x1870854458275712/t0(0) o256->MGC192.168.203.112@tcp@0@lo:26/25 lens 304/240 e 0 to 0 dl 1784189383 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1784189367.417360:0:6510:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Bulk to Interpret req@ffff9dc07130ed80 x1870854458275712/t0(0) o256->MGC192.168.203.112@tcp@0@lo:26/25 lens 304/240 e 0 to 0 dl 1784189383 ref 2 fl Bulk:RQU/200/0 rc 0/0 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1784189367.417368:0:6510:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9dc07130ed80 x1870854458275712/t0(0) o256->MGC192.168.203.112@tcp@0@lo:26/25 lens 304/240 e 0 to 0 dl 1784189383 ref 2 fl Interpret:RQU/200/0 rc 0/0 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784189367.417375:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc07130ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458275712:0@lo:256:ll_cfg_requeue.0 00000100:00000040:2.0:1784189367.417382:0:6510:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff9dc07130ed80 x1870854458275712/t0(0) o256->MGC192.168.203.112@tcp@0@lo:26/25 lens 304/240 e 0 to 0 dl 1784189383 ref 2 fl Complete:RQU/200/0 rc 0/0 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 10000000:00000040:2.0:1784189367.417391:0:6510:0:(mgc_request.c:1599:mgc_process_recover_log()) Latest version 125, more 0. 10000000:00000040:2.0:1784189367.417401:0:6510:0:(mgc_request.c:1440:mgc_apply_recover_logs()) Looking for OBD lustre-OST0000-osc-MDT0000 00000100:00000040:2.0:1784189367.417414:0:6510:0:(lustre_peer.c:232:class_check_uuid()) check if uuid 192.168.203.112@tcp has 192.168.203.112@tcp. 10000000:00000040:2.0:1784189367.417427:0:6510:0:(mgc_request.c:1469:mgc_apply_recover_logs()) IR: lustre-OST0000-osc-MDT0000 target is obsoleted(1/2), reconnect 00000100:00080000:2.0:1784189367.417430:0:6510:0:(import.c:214:ptlrpc_set_import_discon()) osp: import ffff9dc075655000 already not connected (conn 6, was 0): DISCONN 00000100:00000040:2.0:1784189367.417440:0:6510:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9dc0710a1d00 refcount 62 to 0@lo 00000100:00000040:2.0:1784189367.417442:0:6510:0:(connection.c:149:ptlrpc_connection_get()) conn=ffff9dc0710a1d00 refcount 62 to 0@lo 00000100:00000040:2.0:1784189367.417444:0:6510:0:(client.c:137:ptlrpc_uuid_to_connection()) 192.168.203.112@tcp -> ffff9dc0710a1d00 00010000:00080000:2.0:1784189367.417448:0:6510:0:(ldlm_lib.c:85:import_set_conn()) imp ffff9dc075655000@lustre-OST0000-osc-MDT0000: found existing conn 192.168.203.112@tcp, moved to head 00010000:00000040:2.0:1784189367.417451:0:6510:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff9dc0710a1d00 refcount 61 to 0@lo 00000100:00080000:2.0:1784189367.417455:0:6510:0:(import.c:65:import_set_state_nolock()) ffff9dc075655000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00000040:2.0:1784189367.417458:0:6510:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff9dc0710a1d00 refcount 60 to 0@lo 00000100:00000040:2.0:1784189367.417460:0:6510:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9dc0710a1d00 refcount 61 to 0@lo 00000020:00000040:2.0:1784189367.417462:0:6510:0:(genops.c:825:class_conn2export()) looking for export cookie 0xcc1762b626f8c629 00000020:00000040:2.0:1784189367.417464:0:6510:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9dc047a84000 refcount=4 00000100:00000040:2.0:1784189367.417467:0:6510:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff9dc0710a1d00 refcount 60 to 0@lo 00000100:00000040:2.0:1784189367.417469:0:6510:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9dc0710a1d00 refcount 61 to 0@lo 00000020:00000040:2.0:1784189367.417471:0:6510:0:(genops.c:900:class_export_put()) PUTting export ffff9dc047a84000 : new refcount 3 00000100:00080000:2.0:1784189367.417478:0:6510:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9dc075655000 using connection 192.168.203.112@tcp/0@lo 00000020:00000040:2.0:1784189367.417488:0:6510:0:(genops.c:1231:class_import_get()) import ffff9dc075655000 refcount=3 obd=lustre-OST0000-osc-MDT0000 00000100:00100000:2.0:1784189367.417498:0:6510:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9dc07130f100 x1870854458275840/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:2.0:1784189367.417509:0:6510:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [0000000016b64e3b] to pc [ptlrpcd_rcv+-1] req@ffff9dc07130f100 x1870854458275840/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 10000000:00000040:2.0:1784189367.417524:0:6510:0:(mgc_request.c:1486:mgc_apply_recover_logs()) ir apply logs 125/125 for lustre-OST0000-osc-MDT0000 00000100:00000040:2.0:1784189367.417530:0:6510:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff9dc07130ed80 x1870854458275712/t0(0) o256->MGC192.168.203.112@tcp@0@lo:26/25 lens 304/240 e 0 to 0 dl 1784189383 ref 1 fl Complete:RQU/200/0 rc 0/0 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000020:00000040:2.0:1784189367.417538:0:6510:0:(genops.c:1244:class_import_put()) import ffff9dc07110c800 refcount=4 obd=MGC192.168.203.112@tcp 00000020:00000040:2.0:1784189367.417541:0:6510:0:(genops.c:1244:class_import_put()) import ffff9dc07110c800 refcount=3 obd=MGC192.168.203.112@tcp 10000000:01000000:2.0:1784189367.417560:0:6510:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00000020:00000040:2.0:1784189367.417565:0:6510:0:(lustre_handles.c:147:class_handle2object()) GET ldlm ffff9dc080f04a00 refcount=3 00010000:00010000:2.0:1784189367.417570:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff9dc080f04a00/0xcc1762b626f8d5bf lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc1762b626f8d5c6 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189367.417579:0:6510:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: ffff9dc080f04a00/0xcc1762b626f8d5bf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc1762b626f8d5c6 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00000040:2.0:1784189367.417587:0:6510:0:(mgc_request.c:108:config_log_get()) log lustre-mdtir (ffff9dc049794000) refs 2 10000000:00000040:2.0:1784189367.417590:0:6510:0:(mgc_request.c:123:config_log_put()) log lustre-mdtir(ffff9dc0565a5800) refs 3 10000000:01000000:2.0:1784189367.417592:0:6510:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1784189367.417595:0:6510:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff9dbf44675800 from 125 10000000:01000000:2.0:1784189367.417598:0:6510:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00000020:00000040:2.0:1784189367.417601:0:6510:0:(genops.c:1231:class_import_get()) import ffff9dc07110c800 refcount=4 obd=MGC192.168.203.112@tcp 00010000:00000040:2.0:1784189367.417611:0:6510:0:(ldlm_resource.c:1656:ldlm_resource_getref()) getref res: ffff9dc07b032400 count: 2 00000020:00000040:2.0:1784189367.417626:0:6510:0:(lustre_handles.c:93:class_handle_hash()) added object ffff9dc080f04000 with handle 0xcc1762b626f8d5cd to hash 00010000:00010000:2.0:1784189367.417633:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff9dc080f04000/0xcc1762b626f8d5cd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189367.417650:0:6510:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: ffff9dc080f04000/0xcc1762b626f8d5cd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784189367.417659:0:6510:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: ffff9dc080f04000/0xcc1762b626f8d5cd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00000040:2.0:1784189367.417672:0:6510:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff9dc07130ed80 x1870854458275968/t0(0) o101->MGC192.168.203.112@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 0 ref 2 fl New:QU/200/ffffffff rc 0/-1 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784189367.417681:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc07130ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458275968:0@lo:101:ll_cfg_requeue.0 00000100:00000040:2.0:1784189367.417694:0:6510:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff9dc07130ed80 x1870854458275968/t0(0) o101->MGC192.168.203.112@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1784189383 ref 3 fl Rpc:r/200/ffffffff rc 0/-1 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1784189367.417702:0:6510:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1784189367.417720:0:6510:0:(events.c:337:request_in_callback()) incoming req@ffff9dc044943c50 x1870854458275968 msgsize 328 00000100:00100000:2.0:1784189367.417725:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:2.0:1784189367.417726:0:6510:0:(events.c:349:request_in_callback()) Buffer complete: 63 buffers still posted 00000100:00000040:2.0:1784189367.417738:0:6510:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 2 req@ffff9dc07130ed80 x1870854458275968/t0(0) o101->MGC192.168.203.112@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1784189383 ref 3 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784189367.417747:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dc080ea9c00 going to sleep for 11 seconds 00000100:00000040:1.0:1784189367.417804:0:3639:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff9dc07130f100 x1870854458275840/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784189367.417812:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc07130f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3639:1870854458275840:0@lo:8:ll_cfg_requeue.0 00000100:00000040:1.0:1784189367.417832:0:3639:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff9dc07130f100 x1870854458275840/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 1784189392 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1784189367.417838:0:3639:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:1.0:1784189367.417854:0:3639:0:(events.c:337:request_in_callback()) incoming req@ffff9dbf43e13480 x1870854458275840 msgsize 520 00000100:00100000:1.0:1784189367.417857:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:1.0:1784189367.417878:0:3639:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff9dc07130f100 x1870854458275840/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 1784189392 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1784189367.417886:0:3639:0:(niobuf.c:635:kick_cpu_latency()) lustre-OST0000-osc-MDT0000: using a timeout of 8586 usecs (9 jiffies) 00000100:00100000:1.0:1784189367.417906:0:94310:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458275968 00000100:00100000:1.0:1784189367.417910:0:94310:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458275968 00000020:00000040:1.0:1784189367.417912:0:94310:0:(genops.c:825:class_conn2export()) looking for export cookie 0xcc1762b626f8c573 00000020:00000040:1.0:1784189367.417914:0:94310:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9dc050ae5000 refcount=23 00000100:00000040:1.0:1784189367.417924:0:94310:0:(service.c:1432:ptlrpc_at_set_timer()) armed mgs at +6s 00000100:00100000:1.0:1784189367.417940:0:94310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 207 00000100:00000040:1.0:1784189367.417943:0:94310:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9dc050ae5000 : new rpc_count 1 00000100:00000040:1.0:1784189367.417948:0:94310:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9dc044943c50 x1870854458275968/t0(0) o101->bd553d0d-03e2-4233-b06b-b55bbfa2b954@0@lo:558/0 lens 328/0 e 0 to 0 dl 1784189378 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784189367.417959:0:94310:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc044943c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd553d0d-03e2-4233-b06b-b55bbfa2b954+23:6510:x1870854458275968:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784189367.417967:0:94310:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00000040:1.0:1784189367.417974:0:94310:0:(ldlm_resource.c:1656:ldlm_resource_getref()) getref res: ffff9dc0755c1b00 count: 2 00000020:00000040:1.0:1784189367.417979:0:94310:0:(lustre_handles.c:93:class_handle_hash()) added object ffff9dc07116f800 with handle 0xcc1762b626f8d5d4 to hash 00010000:00010000:1.0:1784189367.417984:0:94310:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dc07116f800/0xcc1762b626f8d5d4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xcc1762b626f8d5cd expref: -99 pid: 94310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:1.0:1784189367.417990:0:94310:0:(ldlm_lockd.c:1373:ldlm_handle_enqueue()) lock GETting export ffff9dc050ae5000 : new locks_count 18 00000020:00000040:1.0:1784189367.417992:0:94310:0:(genops.c:889:class_export_get()) GET export ffff9dc050ae5000 refcount=24 00010000:00000040:1.0:1784189367.418014:0:94310:0:(ldlm_resource.c:1876:ldlm_resource_dump()) --- Resource: [0x65727473756c:0x2:0x0].0x0 (ffff9dc0755c1b00) refcount = 2 00010000:00000040:1.0:1784189367.418018:0:94310:0:(ldlm_resource.c:1879:ldlm_resource_dump()) Granted locks (in reverse order): 00010000:00000040:1.0:1784189367.418026:0:94310:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGS lock: ffff9dc070147e00/0xcc1762b626f8d5c6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcc1762b626f8d5bf expref: 24 pid: 94308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189367.418032:0:94310:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dc07116f800/0xcc1762b626f8d5d4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcc1762b626f8d5cd expref: 24 pid: 94310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189367.418042:0:94310:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dc07116f800/0xcc1762b626f8d5d4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcc1762b626f8d5cd expref: 24 pid: 94310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189367.418050:0:94310:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc07116f800, rc 0) 00010000:00000040:1.0:1784189367.418053:0:94310:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 0, transno 0, xid 1870854458275968 00000100:00000040:1.0:1784189367.418058:0:94310:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9dc0710a1d00 refcount 62 to 0@lo 00000100:00000040:1.0:1784189367.418061:0:94310:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:1.0:1784189367.418078:0:94310:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=344 offset=224 replen=344 req@ffff9dc07130ed80 x1870854458275968/t0(0) o101->MGC192.168.203.112@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1784189383 ref 2 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1784189367.418093:0:94310:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff9dc0710a1d00 refcount 61 to 0@lo 00000100:00000040:1.0:1784189367.418097:0:94310:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9dc044943c50 x1870854458275968/t0(0) o101->bd553d0d-03e2-4233-b06b-b55bbfa2b954@0@lo:558/0 lens 328/344 e 0 to 0 dl 1784189378 ref 1 fl Interpret:/200/0 rc 0/0 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784189367.418104:0:94310:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc044943c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd553d0d-03e2-4233-b06b-b55bbfa2b954+24:6510:x1870854458275968:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 147us (381us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189367.418109:0:94310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 207 00000100:00000040:1.0:1784189367.418111:0:94310:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9dc050ae5000 : new rpc_count 0 00000020:00000040:1.0:1784189367.418117:0:94310:0:(genops.c:900:class_export_put()) PUTting export ffff9dc050ae5000 : new refcount 23 00000100:00100000:2.0:1784189367.418221:0:26161:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458275840 00000100:00100000:2.0:1784189367.418226:0:26161:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458275840 00000020:00000040:2.0:1784189367.418228:0:26161:0:(genops.c:825:class_conn2export()) looking for export cookie 0xcc1762b626f8c63e 00000100:00100000:2.0:1784189367.418259:0:26161:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5078 00000100:00000040:2.0:1784189367.418264:0:26161:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9dbf43e13480 x1870854458275840/t0(0) o8->@:0/0 lens 520/0 e 0 to 0 dl 1784189387 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784189367.418271:0:26161:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf43e13480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:0+-99:3639:x1870854458275840:12345-0@lo:8:ll_cfg_requeue.0 00000020:00000040:2.0:1784189367.418284:0:26161:0:(obd_config.c:994:class_incref()) incref lustre-OST0000 (ffff9dc07a7a0000) now 7 - find 00010000:00000040:2.0:1784189367.418290:0:26161:0:(ldlm_lib.c:1264:target_handle_connect()) lustre-OST0000: ocd_connect_flags: 0xa044401443000026 tmp_exp_old_falloc: 0 00010000:00080000:2.0:1784189367.418305:0:26161:0:(ldlm_lib.c:938:target_handle_reconnect()) connect export for UUID 'lustre-MDT0000-mdtlov_UUID' at ffff9dbf46d39800, cookie 0xcc1762b626f8d564 00010000:00080000:2.0:1784189367.418308:0:26161:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo recovering/t0 exp ffff9dbf46d39800 cur 3609 last 1784189365 00010000:02000400:2.0:1784189367.418339:0:26161:0:(ldlm_lib.c:2036:target_start_recovery_timer()) lustre-OST0000: Will be in recovery for at least 1:00, or until 3 clients reconnect 00000100:00000040:3.0:1784189367.425465:0:6510:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff9dc07130ed80 x1870854458275968/t0(0) o101->MGC192.168.203.112@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1784189383 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1784189367.425481:0:6510:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9dc07130ed80 x1870854458275968/t0(0) o101->MGC192.168.203.112@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1784189383 ref 2 fl Interpret:RQU/200/0 rc 0/0 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784189367.425489:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc07130ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458275968:0@lo:101:ll_cfg_requeue.0 00000100:00000040:3.0:1784189367.425498:0:6510:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff9dc07130ed80 x1870854458275968/t0(0) o101->MGC192.168.203.112@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1784189383 ref 2 fl Complete:RQU/200/0 rc 0/0 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000020:00000040:3.0:1784189367.425511:0:6510:0:(lustre_handles.c:147:class_handle2object()) GET ldlm ffff9dc080f04000 refcount=4 00010000:00000040:3.0:1784189367.425517:0:6510:0:(ldlm_request.c:746:ldlm_cli_enqueue_fini()) local: ffff9dc080f04000, remote cookie: 0xcc1762b626f8d5d4, flags: 0x0 00010000:00000040:3.0:1784189367.425525:0:6510:0:(ldlm_resource.c:1876:ldlm_resource_dump()) --- Resource: [0x65727473756c:0x2:0x0].0x0 (ffff9dc07b032400) refcount = 2 00010000:00000040:3.0:1784189367.425528:0:6510:0:(ldlm_resource.c:1879:ldlm_resource_dump()) Granted locks (in reverse order): 00010000:00000040:3.0:1784189367.425533:0:6510:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGC192.168.203.112@tcp lock: ffff9dc080f04a00/0xcc1762b626f8d5bf lrc: 1/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xcc1762b626f8d5c6 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189367.425541:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: ffff9dc080f04000/0xcc1762b626f8d5cd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc1762b626f8d5d4 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189367.425550:0:6510:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: ffff9dc080f04000/0xcc1762b626f8d5cd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xcc1762b626f8d5d4 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00000040:3.0:1784189367.425577:0:6510:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff9dc07130ed80 x1870854458275968/t0(0) o101->MGC192.168.203.112@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1784189383 ref 1 fl Complete:RQU/200/0 rc 0/0 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000020:00000040:3.0:1784189367.425587:0:6510:0:(genops.c:1244:class_import_put()) import ffff9dc07110c800 refcount=3 obd=MGC192.168.203.112@tcp 10000000:00000040:3.0:1784189367.425596:0:6510:0:(mgc_request.c:108:config_log_get()) log lustre-mdtir (ffff9dc049794000) refs 3 00000020:00000040:3.0:1784189367.425598:0:6510:0:(lustre_handles.c:147:class_handle2object()) GET ldlm ffff9dc080f04000 refcount=3 00000020:00000040:3.0:1784189367.425626:0:6510:0:(genops.c:1231:class_import_get()) import ffff9dc07110c800 refcount=4 obd=MGC192.168.203.112@tcp 00000020:00000040:3.0:1784189367.425644:0:6510:0:(genops.c:1231:class_import_get()) import ffff9dc07110c800 refcount=5 obd=MGC192.168.203.112@tcp 00000100:00000040:3.0:1784189367.425659:0:6510:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff9dc071535500 x1870854458276096/t0(0) o256->MGC192.168.203.112@tcp@0@lo:26/25 lens 304/240 e 0 to 0 dl 0 ref 2 fl New:QU/200/ffffffff rc 0/-1 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784189367.425669:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc071535500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458276096:0@lo:256:ll_cfg_requeue.0 00000100:00000040:3.0:1784189367.425694:0:6510:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff9dc071535500 x1870854458276096/t0(0) o256->MGC192.168.203.112@tcp@0@lo:26/25 lens 304/240 e 0 to 0 dl 1784189383 ref 3 fl Rpc:r/200/ffffffff rc 0/-1 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1784189367.425703:0:6510:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:3.0:1784189367.425736:0:6510:0:(events.c:337:request_in_callback()) incoming req@ffff9dc044940850 x1870854458276096 msgsize 304 00000100:00100000:3.0:1784189367.425740:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:3.0:1784189367.425743:0:6510:0:(events.c:349:request_in_callback()) Buffer complete: 63 buffers still posted 00000100:00000040:3.0:1784189367.425769:0:6510:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 2 req@ffff9dc071535500 x1870854458276096/t0(0) o256->MGC192.168.203.112@tcp@0@lo:26/25 lens 304/240 e 0 to 0 dl 1784189383 ref 3 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784189367.425793:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dc06bb82cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1784189367.425834:0:94309:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458276096 00000100:00100000:1.0:1784189367.425841:0:94309:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458276096 00000020:00000040:1.0:1784189367.425843:0:94309:0:(genops.c:825:class_conn2export()) looking for export cookie 0xcc1762b626f8c573 00000020:00000040:1.0:1784189367.425846:0:94309:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9dc050ae5000 refcount=24 00000100:00000040:1.0:1784189367.425866:0:94309:0:(service.c:1432:ptlrpc_at_set_timer()) armed mgs at +6s 00000100:00100000:1.0:1784189367.425895:0:94309:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 208 00000100:00000040:1.0:1784189367.425899:0:94309:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9dc050ae5000 : new rpc_count 1 00000100:00000040:1.0:1784189367.425910:0:94309:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9dc044940850 x1870854458276096/t0(0) o256->bd553d0d-03e2-4233-b06b-b55bbfa2b954@0@lo:558/0 lens 304/0 e 0 to 0 dl 1784189378 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784189367.425922:0:94309:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc044940850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd553d0d-03e2-4233-b06b-b55bbfa2b954+24:6510:x1870854458276096:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1784189367.425940:0:94309:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:00000040:1.0:1784189367.425950:0:94309:0:(mgs_nids.c:144:nidtbl_fill_entry()) IR: 1 NIDs from NET #0 20000000:01000000:1.0:1784189367.425957:0:94309:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1784189367.425960:0:94309:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 125 00000020:00000040:1.0:1784189367.425966:0:94309:0:(genops.c:889:class_export_get()) GET export ffff9dc050ae5000 refcount=25 00000020:00000040:1.0:1784189367.426012:0:94309:0:(genops.c:900:class_export_put()) PUTting export ffff9dc050ae5000 : new refcount 24 00010000:00000040:1.0:1784189367.426028:0:94309:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 0, transno 0, xid 1870854458276096 00000100:00000040:1.0:1784189367.426036:0:94309:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9dc0710a1d00 refcount 62 to 0@lo 00000100:00000040:1.0:1784189367.426040:0:94309:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:1.0:1784189367.426052:0:94309:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=240 offset=224 replen=240 req@ffff9dc071535500 x1870854458276096/t0(0) o256->MGC192.168.203.112@tcp@0@lo:26/25 lens 304/240 e 0 to 0 dl 1784189383 ref 2 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1784189367.426063:0:94309:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff9dc0710a1d00 refcount 61 to 0@lo 00000100:00000040:1.0:1784189367.426067:0:94309:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9dc044940850 x1870854458276096/t0(0) o256->bd553d0d-03e2-4233-b06b-b55bbfa2b954@0@lo:558/0 lens 304/240 e 0 to 0 dl 1784189378 ref 1 fl Interpret:/200/0 rc 0/0 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784189367.426077:0:94309:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc044940850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd553d0d-03e2-4233-b06b-b55bbfa2b954+24:6510:x1870854458276096:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 156us (339us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189367.426083:0:94309:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 208 00000100:00000040:1.0:1784189367.426086:0:94309:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9dc050ae5000 : new rpc_count 0 00000020:00000040:1.0:1784189367.426094:0:94309:0:(genops.c:900:class_export_put()) PUTting export ffff9dc050ae5000 : new refcount 23 00000100:00000040:3.0:1784189367.426384:0:6510:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Bulk req@ffff9dc071535500 x1870854458276096/t0(0) o256->MGC192.168.203.112@tcp@0@lo:26/25 lens 304/240 e 0 to 0 dl 1784189383 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1784189367.426393:0:6510:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Bulk to Interpret req@ffff9dc071535500 x1870854458276096/t0(0) o256->MGC192.168.203.112@tcp@0@lo:26/25 lens 304/240 e 0 to 0 dl 1784189383 ref 2 fl Bulk:RQU/200/0 rc 0/0 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1784189367.426401:0:6510:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9dc071535500 x1870854458276096/t0(0) o256->MGC192.168.203.112@tcp@0@lo:26/25 lens 304/240 e 0 to 0 dl 1784189383 ref 2 fl Interpret:RQU/200/0 rc 0/0 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784189367.426408:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc071535500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd553d0d-03e2-4233-b06b-b55bbfa2b954:6510:1870854458276096:0@lo:256:ll_cfg_requeue.0 00000100:00000040:3.0:1784189367.426419:0:6510:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff9dc071535500 x1870854458276096/t0(0) o256->MGC192.168.203.112@tcp@0@lo:26/25 lens 304/240 e 0 to 0 dl 1784189383 ref 2 fl Complete:RQU/200/0 rc 0/0 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 10000000:00000040:3.0:1784189367.426427:0:6510:0:(mgc_request.c:1599:mgc_process_recover_log()) Latest version 125, more 0. 10000000:00000040:3.0:1784189367.426438:0:6510:0:(mgc_request.c:1440:mgc_apply_recover_logs()) Looking for OBD lustre-OST0000-osc-MDT0001 00000100:00000040:3.0:1784189367.426447:0:6510:0:(lustre_peer.c:232:class_check_uuid()) check if uuid 192.168.203.112@tcp has 192.168.203.112@tcp. 10000000:00000040:3.0:1784189367.426459:0:6510:0:(mgc_request.c:1469:mgc_apply_recover_logs()) IR: lustre-OST0000-osc-MDT0001 target is obsoleted(1/2), reconnect 00000100:00080000:3.0:1784189367.426463:0:6510:0:(import.c:214:ptlrpc_set_import_discon()) osp: import ffff9dbf43114800 already not connected (conn 6, was 0): DISCONN 00000100:00000040:3.0:1784189367.426472:0:6510:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9dc0710a1d00 refcount 62 to 0@lo 00000100:00000040:3.0:1784189367.426475:0:6510:0:(connection.c:149:ptlrpc_connection_get()) conn=ffff9dc0710a1d00 refcount 62 to 0@lo 00000100:00000040:3.0:1784189367.426477:0:6510:0:(client.c:137:ptlrpc_uuid_to_connection()) 192.168.203.112@tcp -> ffff9dc0710a1d00 00010000:00080000:3.0:1784189367.426480:0:6510:0:(ldlm_lib.c:85:import_set_conn()) imp ffff9dbf43114800@lustre-OST0000-osc-MDT0001: found existing conn 192.168.203.112@tcp, moved to head 00010000:00000040:3.0:1784189367.426484:0:6510:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff9dc0710a1d00 refcount 61 to 0@lo 00000100:00080000:3.0:1784189367.426488:0:6510:0:(import.c:65:import_set_state_nolock()) ffff9dbf43114800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00000040:3.0:1784189367.426491:0:6510:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff9dc0710a1d00 refcount 60 to 0@lo 00000100:00000040:3.0:1784189367.426493:0:6510:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9dc0710a1d00 refcount 61 to 0@lo 00000020:00000040:3.0:1784189367.426495:0:6510:0:(genops.c:825:class_conn2export()) looking for export cookie 0xcc1762b626f86499 00000020:00000040:3.0:1784189367.426497:0:6510:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9dc0477d0000 refcount=4 00000100:00000040:3.0:1784189367.426500:0:6510:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff9dc0710a1d00 refcount 60 to 0@lo 00000100:00000040:3.0:1784189367.426502:0:6510:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9dc0710a1d00 refcount 61 to 0@lo 00000020:00000040:3.0:1784189367.426504:0:6510:0:(genops.c:900:class_export_put()) PUTting export ffff9dc0477d0000 : new refcount 3 00000100:00080000:3.0:1784189367.426506:0:6510:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff9dbf43114800 using connection 192.168.203.112@tcp/0@lo 00000020:00000040:3.0:1784189367.426515:0:6510:0:(genops.c:1231:class_import_get()) import ffff9dbf43114800 refcount=3 obd=lustre-OST0000-osc-MDT0001 00000100:00100000:3.0:1784189367.426527:0:6510:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9dc071537b80 x1870854458276224/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:3.0:1784189367.426537:0:6510:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [0000000089a0722f] to pc [ptlrpcd_rcv+-1] req@ffff9dc071537b80 x1870854458276224/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 10000000:00000040:3.0:1784189367.426552:0:6510:0:(mgc_request.c:1486:mgc_apply_recover_logs()) ir apply logs 125/125 for lustre-OST0000-osc-MDT0001 00000100:00000040:3.0:1784189367.426563:0:6510:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff9dc071535500 x1870854458276096/t0(0) o256->MGC192.168.203.112@tcp@0@lo:26/25 lens 304/240 e 0 to 0 dl 1784189383 ref 1 fl Complete:RQU/200/0 rc 0/0 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000020:00000040:3.0:1784189367.426571:0:6510:0:(genops.c:1244:class_import_put()) import ffff9dc07110c800 refcount=4 obd=MGC192.168.203.112@tcp 00000020:00000040:3.0:1784189367.426573:0:6510:0:(genops.c:1244:class_import_put()) import ffff9dc07110c800 refcount=3 obd=MGC192.168.203.112@tcp 10000000:01000000:3.0:1784189367.426589:0:6510:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00000020:00000040:3.0:1784189367.426593:0:6510:0:(lustre_handles.c:147:class_handle2object()) GET ldlm ffff9dc080f04000 refcount=3 00010000:00010000:3.0:1784189367.426598:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff9dc080f04000/0xcc1762b626f8d5cd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc1762b626f8d5d4 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784189367.426607:0:6510:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: ffff9dc080f04000/0xcc1762b626f8d5cd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc1762b626f8d5d4 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00000040:3.0:1784189367.426626:0:6510:0:(mgc_request.c:123:config_log_put()) log lustre-mdtir(ffff9dc049794000) refs 3 00000100:00000040:1.0:1784189367.426684:0:3639:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff9dc071537b80 x1870854458276224/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784189367.426693:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc071537b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3639:1870854458276224:0@lo:8:ll_cfg_requeue.0 00000100:00000040:1.0:1784189367.426707:0:3639:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff9dc071537b80 x1870854458276224/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 1784189392 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1784189367.426723:0:3639:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:1.0:1784189367.426742:0:3639:0:(events.c:337:request_in_callback()) incoming req@ffff9dbf43e10e00 x1870854458276224 msgsize 520 00000100:00100000:1.0:1784189367.426746:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:1.0:1784189367.426770:0:3639:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff9dc071537b80 x1870854458276224/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 1784189392 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1784189367.426780:0:3639:0:(niobuf.c:635:kick_cpu_latency()) lustre-OST0000-osc-MDT0001: using a timeout of 5032 usecs (6 jiffies) 00000100:00100000:3.0:1784189367.426829:0:26160:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458276224 00000100:00100000:3.0:1784189367.426834:0:26160:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458276224 00000020:00000040:3.0:1784189367.426836:0:26160:0:(genops.c:825:class_conn2export()) looking for export cookie 0xcc1762b626f864ae 00000100:00100000:3.0:1784189367.426868:0:26160:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5079 00000100:00000040:3.0:1784189367.426873:0:26160:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9dbf43e10e00 x1870854458276224/t0(0) o8->@:0/0 lens 520/0 e 0 to 0 dl 1784189387 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784189367.426881:0:26160:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf43e10e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:0+-99:3639:x1870854458276224:12345-0@lo:8:ll_cfg_requeue.0 00000020:00000040:3.0:1784189367.426896:0:26160:0:(obd_config.c:994:class_incref()) incref lustre-OST0000 (ffff9dc07a7a0000) now 8 - find 00010000:00000040:3.0:1784189367.426904:0:26160:0:(ldlm_lib.c:1264:target_handle_connect()) lustre-OST0000: ocd_connect_flags: 0xa044401443000026 tmp_exp_old_falloc: 0 00010000:00080000:3.0:1784189367.426910:0:26160:0:(ldlm_lib.c:938:target_handle_reconnect()) connect export for UUID 'lustre-MDT0001-mdtlov_UUID' at ffff9dbf46d3b800, cookie 0xcc1762b626f8d55d 00010000:00080000:3.0:1784189367.426914:0:26160:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo recovering/t0 exp ffff9dbf46d3b800 cur 3609 last 1784189365 00010000:00080000:3.0:1784189367.426924:0:26160:0:(ldlm_lib.c:2100:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 70 seconds 00000001:00000040:3.0:1784189367.426932:0:26160:0:(nodemap_handler.c:533:nodemap_classify_nid()) found nid 192.168.203.112@tcp 00000001:00000040:3.0:1784189367.426937:0:26160:0:(nodemap_handler.c:99:nodemap_getref()) GETting nodemap default(p=ffff9dc07fa60400) : new refcount 19 00000020:00000040:3.0:1784189367.426940:0:26160:0:(genops.c:889:class_export_get()) GET export ffff9dbf46d3b800 refcount=4 00000001:00000040:3.0:1784189367.426947:0:26160:0:(nodemap_handler.c:99:nodemap_getref()) GETting nodemap default(p=ffff9dc07fa60400) : new refcount 20 00000001:00000040:3.0:1784189367.426951:0:26160:0:(nodemap_handler.c:115:nodemap_putref()) PUTting nodemap default(p=ffff9dc07fa60400) : new refcount 19 00002000:00100000:3.0:1784189367.426954:0:26160:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0001-mdtlov_UUID/ffff9dbf46d3b800 ocd_connect_flags: 0xa044401443000026 ocd_version: 21136a2 ocd_grant: 0 ocd_index: 0 ocd_group 1 00002000:00080000:3.0:1784189367.426957:0:26160:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 1 00002000:00100000:3.0:1784189367.426960:0:26160:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00000020:00000040:3.0:1784189367.426970:0:26160:0:(lprocfs_status_server.c:693:lprocfs_exp_setup()) Found stats ffff9dbf451b7000 for nid 0@lo - ref 2 00000020:00000040:3.0:1784189367.427073:0:26160:0:(obd_config.c:994:class_incref()) incref lustre-OST0000 (ffff9dc07a7a0000) now 9 - import 00000020:00000040:3.0:1784189367.427079:0:26160:0:(genops.c:1244:class_import_put()) import ffff9dc0477b0000 refcount=1 obd=lustre-OST0000 00000020:00000040:3.0:1784189367.427084:0:26160:0:(genops.c:889:class_export_get()) GET export ffff9dbf46d3b800 refcount=5 00000100:00000040:3.0:1784189367.427086:0:26160:0:(service.c:1082:ptlrpc_request_change_export()) RPC GETting export ffff9dbf46d3b800 : new rpc_count 1 00000100:00000040:3.0:1784189367.427089:0:26160:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9dc0710a1d00 refcount 62 to 0@lo 00000100:00000040:3.0:1784189367.427092:0:26160:0:(connection.c:149:ptlrpc_connection_get()) conn=ffff9dc0710a1d00 refcount 62 to 0@lo 00000020:00000040:3.0:1784189367.427094:0:26160:0:(genops.c:889:class_export_get()) GET export ffff9dbf46d3b800 refcount=6 00000100:00000040:3.0:1784189367.427099:0:26160:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9dc0710a1d00 refcount 63 to 0@lo 00000100:00080000:3.0:1784189367.427107:0:26160:0:(import.c:65:import_set_state_nolock()) ffff9dc0477b0000 : changing import state from RECOVER to FULL 00000020:00000040:3.0:1784189367.427112:0:26160:0:(genops.c:900:class_export_put()) PUTting export ffff9dbf46d3b800 : new refcount 5 00000020:00000040:3.0:1784189367.427114:0:26160:0:(obd_config.c:1022:class_decref()) Decref lustre-OST0000 (ffff9dc07a7a0000) now 9 - find 00010000:00000040:3.0:1784189367.427124:0:26160:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 4294968955, transno 0, xid 1870854458276224 00000100:00000040:3.0:1784189367.427129:0:26160:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9dc0710a1d00 refcount 64 to 0@lo 00000100:00000040:3.0:1784189367.427133:0:26160:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:3.0:1784189367.427151:0:26160:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=416 offset=0 replen=544 req@ffff9dc071537b80 x1870854458276224/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 1784189392 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1784189367.427166:0:26160:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff9dc0710a1d00 refcount 63 to 0@lo 00000100:00000040:3.0:1784189367.427170:0:26160:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9dbf43e10e00 x1870854458276224/t0(0) o8->lustre-MDT0001-mdtlov_UUID@0@lo:0/0 lens 520/416 e 0 to 0 dl 1784189387 ref 1 fl Interpret:/200/0 rc 0/0 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784189367.427176:0:26160:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf43e10e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:3639:x1870854458276224:12345-0@lo:8:ll_cfg_requeue.0 Request processed in 295us (433us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189367.427183:0:26160:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5079 00000100:00000040:3.0:1784189367.427191:0:26160:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9dbf46d3b800 : new rpc_count 0 00000020:00000040:3.0:1784189367.427199:0:26160:0:(genops.c:900:class_export_put()) PUTting export ffff9dbf46d3b800 : new refcount 4 00010000:00080000:1.0:1784189367.427345:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dc071537b80 x1870854458276224/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1784189392 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1784189367.427353:0:3639:0:(client.c:3108:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: skip recheck: last_committed 4294968955 00000100:00000040:1.0:1784189367.427357:0:3639:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff9dc071537b80 x1870854458276224/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1784189392 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1784189367.427365:0:3639:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0001: connect to target with instance 2 00000020:00000040:1.0:1784189367.427367:0:3639:0:(genops.c:825:class_conn2export()) looking for export cookie 0xcc1762b626f86499 00000020:00000040:1.0:1784189367.427370:0:3639:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9dc0477d0000 refcount=4 00000020:00000040:1.0:1784189367.427376:0:3639:0:(genops.c:900:class_export_put()) PUTting export ffff9dc0477d0000 : new refcount 3 00000100:00080000:1.0:1784189367.427380:0:3639:0:(import.c:65:import_set_state_nolock()) ffff9dbf43114800 lustre-OST0000_UUID: changing import state from CONNECTING to REPLAY 00000100:00080000:1.0:1784189367.427384:0:3639:0:(import.c:1700:ptlrpc_import_recovery_state_machine()) replay requested by lustre-OST0000_UUID 00000100:00100000:1.0:1784189367.427386:0:3639:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294968955 gen 2 00000100:00000040:1.0:1784189367.427389:0:3639:0:(client.c:3222:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: normal: skip=0 replay=0/0 committed=0/0 00000100:00080000:1.0:1784189367.427391:0:3639:0:(recover.c:53:ptlrpc_replay_next()) import ffff9dbf43114800 from lustre-OST0000_UUID committed 4294968955 last 0 00000100:00080000:1.0:1784189367.427393:0:3639:0:(import.c:65:import_set_state_nolock()) ffff9dbf43114800 lustre-OST0000_UUID: changing import state from REPLAY to REPLAY_LOCKS 00000020:00000040:1.0:1784189367.427396:0:3639:0:(genops.c:1231:class_import_get()) import ffff9dbf43114800 refcount=4 obd=lustre-OST0000-osc-MDT0001 00000100:00000040:3.0:1784189367.429104:0:3639:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9dc071537b80 x1870854458276224/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1784189392 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784189367.429118:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc071537b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3639:1870854458276224:0@lo:8:ll_cfg_requeue.0 00000100:00000040:3.0:1784189367.429126:0:3639:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff9dc071537b80 x1870854458276224/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1784189392 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000020:00000040:3.0:1784189367.429138:0:3639:0:(genops.c:1244:class_import_put()) import ffff9dbf43114800 refcount=3 obd=lustre-OST0000-osc-MDT0001 00010000:00080000:1.0:1784189367.429189:0:97001:0:(ldlm_request.c:2972:ldlm_lock_replay_thread()) lock replay thread lustre-OST0000-osc-MDT0001 to lustre-OST0000_UUID@0@lo 00010000:00010000:1.0:1784189367.429194:0:97001:0:(ldlm_request.c:2888:ldlm_cancel_unused_locks_for_replay()) Dropping as many unused locks as possible before replay for namespace lustre-OST0000-osc-MDT0001 (0) 00010000:00010000:1.0:1784189367.429200:0:97001:0:(ldlm_request.c:2901:ldlm_cancel_unused_locks_for_replay()) Canceled 0 unused locks from namespace lustre-OST0000-osc-MDT0001 00000100:00080000:1.0:1784189367.429237:0:97001:0:(import.c:65:import_set_state_nolock()) ffff9dbf43114800 lustre-OST0000_UUID: changing import state from REPLAY_LOCKS to REPLAY_WAIT 00000020:00000040:1.0:1784189367.429256:0:97001:0:(genops.c:1231:class_import_get()) import ffff9dbf43114800 refcount=4 obd=lustre-OST0000-osc-MDT0001 00000100:00000040:1.0:1784189367.429279:0:97001:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [000000000ac29d99] to pc [ptlrpcd_rcv+-1] req@ffff9dbf43e13100 x1870854458276352/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:QU/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000020:00000040:1.0:1784189367.429300:0:97001:0:(genops.c:1244:class_import_put()) import ffff9dbf43114800 refcount=3 obd=lustre-OST0000-osc-MDT0001 00000100:00000040:3.0:1784189367.429784:0:3639:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff9dbf43e13100 x1870854458276352/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:QU/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784189367.429797:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf43e13100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3639:1870854458276352:0@lo:400:ldlm_lock_repla.0 00000100:00000040:3.0:1784189367.429825:0:3639:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=2c0 req@ffff9dbf43e13100 x1870854458276352/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784189383 ref 2 fl Rpc:r/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1784189367.429833:0:3639:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:3.0:1784189367.429869:0:3639:0:(events.c:337:request_in_callback()) incoming req@ffff9dc071537b80 x1870854458276352 msgsize 224 00000100:00100000:3.0:1784189367.429875:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:3.0:1784189367.429901:0:3639:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff9dbf43e13100 x1870854458276352/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784189383 ref 2 fl Rpc:Qr/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1784189367.429912:0:3639:0:(niobuf.c:635:kick_cpu_latency()) lustre-OST0000-osc-MDT0001: using a timeout of 5020 usecs (6 jiffies) 00000100:00100000:1.0:1784189367.429966:0:26223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458276352 00000100:00100000:1.0:1784189367.429974:0:26223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458276352 00000020:00000040:1.0:1784189367.429977:0:26223:0:(genops.c:825:class_conn2export()) looking for export cookie 0xcc1762b626f8d55d 00000020:00000040:1.0:1784189367.429981:0:26223:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9dbf46d3b800 refcount=5 00000100:00000040:1.0:1784189367.430014:0:26223:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost at +6s 00000100:00100000:1.0:1784189367.430044:0:26223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2615 00000100:00000040:1.0:1784189367.430048:0:26223:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9dbf46d3b800 : new rpc_count 1 00000100:00000040:1.0:1784189367.430053:0:26223:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9dc071537b80 x1870854458276352/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:558/0 lens 224/0 e 0 to 0 dl 1784189378 ref 1 fl New:H/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784189367.430065:0:26223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc071537b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0001-mdtlov_UUID+5:3639:x1870854458276352:12345-0@lo:400:ldlm_lock_repla.0 00000020:00000040:1.0:1784189367.430076:0:26223:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff9dc071537b80 x1870854458276352/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:558/0 lens 224/0 e 0 to 0 dl 1784189378 ref 1 fl Interpret:H/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00000040:1.0:1784189367.430085:0:26223:0:(ldlm_lib.c:1774:target_request_copy_get()) RPC GETting export ffff9dbf46d3b800 : new rpc_count 2 00010000:00080000:1.0:1784189367.430088:0:26223:0:(ldlm_lib.c:3137:target_queue_recovery_request()) @@@ queue final req req@ffff9dc071537b80 x1870854458276352/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:558/0 lens 224/0 e 0 to 0 dl 1784189378 ref 2 fl Interpret:H/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1784189367.430102:0:26223:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9dc071537b80 x1870854458276352/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:558/0 lens 224/0 e 0 to 0 dl 1784189378 ref 2 fl Interpret:H/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784189367.430110:0:26223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc071537b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0001-mdtlov_UUID+5:3639:x1870854458276352:12345-0@lo:400:ldlm_lock_repla.0 Request processed in 48us (239us total) trans 0 rc 0/-999 00000100:00100000:1.0:1784189367.430116:0:26223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2615 00000100:00000040:1.0:1784189367.430119:0:26223:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9dbf46d3b800 : new rpc_count 1 00010000:00080000:1.0:1784189367.430132:0:96896:0:(ldlm_lib.c:2545:check_for_recovery_ready()) connected 1 stale 0 max_recoverable_clients 3 abort 0 expired 0 00000001:00000040:2.0:1784189367.431643:0:26161:0:(nodemap_handler.c:533:nodemap_classify_nid()) found nid 192.168.203.112@tcp 00000001:00000040:2.0:1784189367.431650:0:26161:0:(nodemap_handler.c:99:nodemap_getref()) GETting nodemap default(p=ffff9dc07fa60400) : new refcount 20 00000020:00000040:2.0:1784189367.431656:0:26161:0:(genops.c:889:class_export_get()) GET export ffff9dbf46d39800 refcount=4 00000001:00000040:2.0:1784189367.431659:0:26161:0:(nodemap_handler.c:99:nodemap_getref()) GETting nodemap default(p=ffff9dc07fa60400) : new refcount 21 00000001:00000040:2.0:1784189367.431662:0:26161:0:(nodemap_handler.c:115:nodemap_putref()) PUTting nodemap default(p=ffff9dc07fa60400) : new refcount 20 00002000:00100000:2.0:1784189367.431666:0:26161:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff9dbf46d39800 ocd_connect_flags: 0xa044401443000026 ocd_version: 21136a2 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:2.0:1784189367.431670:0:26161:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:2.0:1784189367.431673:0:26161:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00000020:00000040:2.0:1784189367.431683:0:26161:0:(lprocfs_status_server.c:693:lprocfs_exp_setup()) Found stats ffff9dbf451b7000 for nid 0@lo - ref 3 00000020:00000040:2.0:1784189367.431693:0:26161:0:(obd_config.c:994:class_incref()) incref lustre-OST0000 (ffff9dc07a7a0000) now 9 - import 00000020:00000040:2.0:1784189367.431699:0:26161:0:(genops.c:1244:class_import_put()) import ffff9dbf424ce000 refcount=1 obd=lustre-OST0000 00000020:00000040:2.0:1784189367.431720:0:26161:0:(genops.c:889:class_export_get()) GET export ffff9dbf46d39800 refcount=5 00000100:00000040:2.0:1784189367.431722:0:26161:0:(service.c:1082:ptlrpc_request_change_export()) RPC GETting export ffff9dbf46d39800 : new rpc_count 1 00000100:00000040:2.0:1784189367.431726:0:26161:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9dc0710a1d00 refcount 64 to 0@lo 00000100:00000040:2.0:1784189367.431729:0:26161:0:(connection.c:149:ptlrpc_connection_get()) conn=ffff9dc0710a1d00 refcount 64 to 0@lo 00000020:00000040:2.0:1784189367.431732:0:26161:0:(genops.c:889:class_export_get()) GET export ffff9dbf46d39800 refcount=6 00000100:00000040:2.0:1784189367.431738:0:26161:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9dc0710a1d00 refcount 65 to 0@lo 00000100:00080000:2.0:1784189367.431748:0:26161:0:(import.c:65:import_set_state_nolock()) ffff9dbf424ce000 : changing import state from RECOVER to FULL 00000020:00000040:2.0:1784189367.431753:0:26161:0:(genops.c:900:class_export_put()) PUTting export ffff9dbf46d39800 : new refcount 5 00000020:00000040:2.0:1784189367.431756:0:26161:0:(obd_config.c:1022:class_decref()) Decref lustre-OST0000 (ffff9dc07a7a0000) now 9 - find 00010000:00000040:2.0:1784189367.431769:0:26161:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 4294968973, transno 0, xid 1870854458275840 00000100:00000040:2.0:1784189367.431778:0:26161:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9dc0710a1d00 refcount 66 to 0@lo 00000100:00000040:2.0:1784189367.431784:0:26161:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1784189367.431826:0:26161:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=416 offset=0 replen=544 req@ffff9dc07130f100 x1870854458275840/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 1784189392 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1784189367.431872:0:26161:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff9dc0710a1d00 refcount 65 to 0@lo 00000100:00000040:2.0:1784189367.431878:0:26161:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9dbf43e13480 x1870854458275840/t0(0) o8->lustre-MDT0000-mdtlov_UUID@0@lo:0/0 lens 520/416 e 0 to 0 dl 1784189387 ref 1 fl Interpret:/200/0 rc 0/0 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784189367.431887:0:26161:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf43e13480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+5:3639:x1870854458275840:12345-0@lo:8:ll_cfg_requeue.0 Request processed in 13615us (14030us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189367.431897:0:26161:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5078 00000100:00000040:2.0:1784189367.431900:0:26161:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9dbf46d39800 : new rpc_count 0 00000020:00000040:2.0:1784189367.431911:0:26161:0:(genops.c:900:class_export_put()) PUTting export ffff9dbf46d39800 : new refcount 4 00010000:00080000:1.0:1784189367.432035:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dc07130f100 x1870854458275840/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1784189392 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1784189367.432046:0:3639:0:(client.c:3108:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: skip recheck: last_committed 4294968973 00000100:00000040:1.0:1784189367.432051:0:3639:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff9dc07130f100 x1870854458275840/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1784189392 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1784189367.432063:0:3639:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 2 00000020:00000040:1.0:1784189367.432066:0:3639:0:(genops.c:825:class_conn2export()) looking for export cookie 0xcc1762b626f8c629 00000020:00000040:1.0:1784189367.432069:0:3639:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9dc047a84000 refcount=4 00000020:00000040:1.0:1784189367.432076:0:3639:0:(genops.c:900:class_export_put()) PUTting export ffff9dc047a84000 : new refcount 3 00000100:00080000:1.0:1784189367.432081:0:3639:0:(import.c:65:import_set_state_nolock()) ffff9dc075655000 lustre-OST0000_UUID: changing import state from CONNECTING to REPLAY 00000100:00080000:1.0:1784189367.432085:0:3639:0:(import.c:1700:ptlrpc_import_recovery_state_machine()) replay requested by lustre-OST0000_UUID 00000100:00100000:1.0:1784189367.432088:0:3639:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294968973 gen 2 00000100:00000040:1.0:1784189367.432091:0:3639:0:(client.c:3222:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: normal: skip=0 replay=0/0 committed=0/0 00000100:00080000:1.0:1784189367.432094:0:3639:0:(recover.c:53:ptlrpc_replay_next()) import ffff9dc075655000 from lustre-OST0000_UUID committed 4294968973 last 0 00000100:00080000:1.0:1784189367.432097:0:3639:0:(import.c:65:import_set_state_nolock()) ffff9dc075655000 lustre-OST0000_UUID: changing import state from REPLAY to REPLAY_LOCKS 00000020:00000040:1.0:1784189367.432100:0:3639:0:(genops.c:1231:class_import_get()) import ffff9dc075655000 refcount=4 obd=lustre-OST0000-osc-MDT0000 00000100:00000040:1.0:1784189367.437599:0:3639:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9dc07130f100 x1870854458275840/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1784189392 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784189367.437625:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc07130f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3639:1870854458275840:0@lo:8:ll_cfg_requeue.0 00000100:00000040:1.0:1784189367.437635:0:3639:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff9dc07130f100 x1870854458275840/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1784189392 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000020:00000040:1.0:1784189367.437647:0:3639:0:(genops.c:1244:class_import_put()) import ffff9dc075655000 refcount=3 obd=lustre-OST0000-osc-MDT0000 00010000:00080000:2.0:1784189367.437662:0:97002:0:(ldlm_request.c:2972:ldlm_lock_replay_thread()) lock replay thread lustre-OST0000-osc-MDT0000 to lustre-OST0000_UUID@0@lo 00010000:00010000:2.0:1784189367.437667:0:97002:0:(ldlm_request.c:2888:ldlm_cancel_unused_locks_for_replay()) Dropping as many unused locks as possible before replay for namespace lustre-OST0000-osc-MDT0000 (0) 00010000:00010000:2.0:1784189367.437672:0:97002:0:(ldlm_request.c:2901:ldlm_cancel_unused_locks_for_replay()) Canceled 0 unused locks from namespace lustre-OST0000-osc-MDT0000 00000100:00080000:2.0:1784189367.437719:0:97002:0:(import.c:65:import_set_state_nolock()) ffff9dc075655000 lustre-OST0000_UUID: changing import state from REPLAY_LOCKS to REPLAY_WAIT 00000020:00000040:2.0:1784189367.437734:0:97002:0:(genops.c:1231:class_import_get()) import ffff9dc075655000 refcount=4 obd=lustre-OST0000-osc-MDT0000 00000100:00000040:2.0:1784189367.437758:0:97002:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [0000000084bd775d] to pc [ptlrpcd_rcv+-1] req@ffff9dc07130ea00 x1870854458276480/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:QU/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000020:00000040:2.0:1784189367.437780:0:97002:0:(genops.c:1244:class_import_put()) import ffff9dc075655000 refcount=3 obd=lustre-OST0000-osc-MDT0000 00000100:00000040:1.0:1784189367.437953:0:3639:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff9dc07130ea00 x1870854458276480/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:QU/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784189367.437966:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc07130ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3639:1870854458276480:0@lo:400:ldlm_lock_repla.0 00000100:00000040:1.0:1784189367.438012:0:3639:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=2c0 req@ffff9dc07130ea00 x1870854458276480/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784189383 ref 2 fl Rpc:r/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1784189367.438024:0:3639:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:1.0:1784189367.438063:0:3639:0:(events.c:337:request_in_callback()) incoming req@ffff9dbf43e10000 x1870854458276480 msgsize 224 00000100:00100000:1.0:1784189367.438068:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:1.0:1784189367.438094:0:3639:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff9dc07130ea00 x1870854458276480/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784189383 ref 2 fl Rpc:Qr/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1784189367.438105:0:3639:0:(niobuf.c:635:kick_cpu_latency()) lustre-OST0000-osc-MDT0000: using a timeout of 8927 usecs (9 jiffies) 00000100:00100000:2.0:1784189367.438210:0:9982:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458276480 00000100:00100000:2.0:1784189367.438218:0:9982:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458276480 00000020:00000040:2.0:1784189367.438221:0:9982:0:(genops.c:825:class_conn2export()) looking for export cookie 0xcc1762b626f8d564 00000020:00000040:2.0:1784189367.438225:0:9982:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9dbf46d39800 refcount=5 00000100:00100000:2.0:1784189367.438273:0:9982:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2616 00000100:00000040:2.0:1784189367.438277:0:9982:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9dbf46d39800 : new rpc_count 1 00000100:00000040:2.0:1784189367.438282:0:9982:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9dbf43e10000 x1870854458276480/t0(0) o400->lustre-MDT0000-mdtlov_UUID@0@lo:558/0 lens 224/0 e 0 to 0 dl 1784189378 ref 1 fl New:H/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784189367.438293:0:9982:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf43e10000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3639:x1870854458276480:12345-0@lo:400:ldlm_lock_repla.0 00000020:00000040:2.0:1784189367.438314:0:9982:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff9dbf43e10000 x1870854458276480/t0(0) o400->lustre-MDT0000-mdtlov_UUID@0@lo:558/0 lens 224/0 e 0 to 0 dl 1784189378 ref 1 fl Interpret:H/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00000040:2.0:1784189367.438474:0:9982:0:(ldlm_lib.c:1774:target_request_copy_get()) RPC GETting export ffff9dbf46d39800 : new rpc_count 2 00010000:00080000:2.0:1784189367.438479:0:9982:0:(ldlm_lib.c:3137:target_queue_recovery_request()) @@@ queue final req req@ffff9dbf43e10000 x1870854458276480/t0(0) o400->lustre-MDT0000-mdtlov_UUID@0@lo:558/0 lens 224/0 e 0 to 0 dl 1784189378 ref 2 fl Interpret:H/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1784189367.438503:0:9982:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9dbf43e10000 x1870854458276480/t0(0) o400->lustre-MDT0000-mdtlov_UUID@0@lo:558/0 lens 224/0 e 0 to 0 dl 1784189378 ref 2 fl Interpret:H/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784189367.438512:0:9982:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf43e10000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3639:x1870854458276480:12345-0@lo:400:ldlm_lock_repla.0 Request processed in 220us (447us total) trans 0 rc 0/-999 00000100:00100000:2.0:1784189367.438519:0:9982:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2616 00000100:00000040:2.0:1784189367.438522:0:9982:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9dbf46d39800 : new rpc_count 1 00010000:00080000:0.0:1784189367.438709:0:96896:0:(ldlm_lib.c:2545:check_for_recovery_ready()) connected 2 stale 0 max_recoverable_clients 3 abort 0 expired 0 00000100:00000040:3.0:1784189367.596161:0:3633:0:(events.c:337:request_in_callback()) incoming req@ffff9dc044943050 x1870854436388992 msgsize 328 00000100:00100000:3.0:1784189367.596180:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00000040:3.0:1784189367.596182:0:3633:0:(events.c:349:request_in_callback()) Buffer complete: 63 buffers still posted 00000100:00100000:0.0:1784189367.596361:0:94314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436388992 00000100:00100000:0.0:1784189367.596371:0:94314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436388992 00000020:00000040:0.0:1784189367.596375:0:94314:0:(genops.c:825:class_conn2export()) looking for export cookie 0xcc1762b626f8c756 00000020:00000040:0.0:1784189367.596380:0:94314:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9dc0756a3800 refcount=9 00000100:00000040:0.0:1784189367.596472:0:94314:0:(service.c:1432:ptlrpc_at_set_timer()) armed mgs at +6s 00000100:00100000:1.0:1784189367.597089:0:94314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 209 00000100:00000040:1.0:1784189367.597095:0:94314:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9dc0756a3800 : new rpc_count 1 00000100:00000040:1.0:1784189367.597104:0:94314:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9dc044943050 x1870854436388992/t0(0) o101->60f345e3-c70e-4f53-b5e7-c9671463c9a5@192.168.203.12@tcp:558/0 lens 328/0 e 0 to 0 dl 1784189378 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784189367.597120:0:94314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc044943050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:60f345e3-c70e-4f53-b5e7-c9671463c9a5+9:70943:x1870854436388992:12345-192.168.203.12@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784189367.597137:0:94314:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00000040:1.0:1784189367.597147:0:94314:0:(ldlm_resource.c:1656:ldlm_resource_getref()) getref res: ffff9dc0755c1b00 count: 3 00000020:00000040:1.0:1784189367.597155:0:94314:0:(lustre_handles.c:93:class_handle_hash()) added object ffff9dc07116fe00 with handle 0xcc1762b626f8d5db to hash 00010000:00010000:1.0:1784189367.597160:0:94314:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dc07116fe00/0xcc1762b626f8d5db lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xcbfc5de7fe6c4414 expref: -99 pid: 94314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:1.0:1784189367.597169:0:94314:0:(ldlm_lockd.c:1373:ldlm_handle_enqueue()) lock GETting export ffff9dc0756a3800 : new locks_count 4 00000020:00000040:1.0:1784189367.597172:0:94314:0:(genops.c:889:class_export_get()) GET export ffff9dc0756a3800 refcount=10 00010000:00000040:1.0:1784189367.597240:0:94314:0:(ldlm_resource.c:1876:ldlm_resource_dump()) --- Resource: [0x65727473756c:0x2:0x0].0x0 (ffff9dc0755c1b00) refcount = 3 00010000:00000040:1.0:1784189367.597245:0:94314:0:(ldlm_resource.c:1879:ldlm_resource_dump()) Granted locks (in reverse order): 00010000:00000040:1.0:1784189367.597250:0:94314:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGS lock: ffff9dc07116f800/0xcc1762b626f8d5d4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcc1762b626f8d5cd expref: 23 pid: 94310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:1.0:1784189367.597258:0:94314:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGS lock: ffff9dc070147e00/0xcc1762b626f8d5c6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcc1762b626f8d5bf expref: 23 pid: 94308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189367.597283:0:94314:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dc07116fe00/0xcc1762b626f8d5db lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c4414 expref: 10 pid: 94314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189367.597294:0:94314:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dc07116fe00/0xcc1762b626f8d5db lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0xcbfc5de7fe6c4414 expref: 10 pid: 94314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784189367.597304:0:94314:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc07116fe00, rc 0) 00010000:00000040:1.0:1784189367.597308:0:94314:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 0, transno 0, xid 1870854436388992 00000100:00000040:1.0:1784189367.597339:0:94314:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9dbf4274f140 refcount 9 to 192.168.203.12@tcp 00000100:00000040:1.0:1784189367.597346:0:94314:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.203.12@tcp 00000100:00000040:1.0:1784189367.597397:0:94314:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff9dbf4274f140 refcount 8 to 192.168.203.12@tcp 00000100:00000040:1.0:1784189367.597405:0:94314:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9dc044943050 x1870854436388992/t0(0) o101->60f345e3-c70e-4f53-b5e7-c9671463c9a5@192.168.203.12@tcp:558/0 lens 328/344 e 0 to 0 dl 1784189378 ref 1 fl Interpret:/200/0 rc 0/0 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784189367.597414:0:94314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc044943050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:60f345e3-c70e-4f53-b5e7-c9671463c9a5+10:70943:x1870854436388992:12345-192.168.203.12@tcp:101:ll_cfg_requeue.0 Request processed in 298us (1253us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189367.597421:0:94314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 209 00000100:00000040:1.0:1784189367.597425:0:94314:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9dc0756a3800 : new rpc_count 0 00000020:00000040:1.0:1784189367.597437:0:94314:0:(genops.c:900:class_export_put()) PUTting export ffff9dc0756a3800 : new refcount 9 00000100:00000040:0.0:1784189367.603855:0:3634:0:(events.c:337:request_in_callback()) incoming req@ffff9dc044941850 x1870854436389120 msgsize 304 00000100:00100000:0.0:1784189367.603870:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00000040:0.0:1784189367.603872:0:3634:0:(events.c:349:request_in_callback()) Buffer complete: 63 buffers still posted 00000100:00100000:1.0:1784189367.604364:0:94314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436389120 00000100:00100000:1.0:1784189367.604374:0:94314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436389120 00000020:00000040:1.0:1784189367.604376:0:94314:0:(genops.c:825:class_conn2export()) looking for export cookie 0xcc1762b626f8c756 00000020:00000040:1.0:1784189367.604381:0:94314:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9dc0756a3800 refcount=10 00000100:00000040:1.0:1784189367.604407:0:94314:0:(service.c:1432:ptlrpc_at_set_timer()) armed mgs at +6s 00000100:00100000:2.0:1784189367.604445:0:94309:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 210 00000100:00000040:2.0:1784189367.604451:0:94309:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9dc0756a3800 : new rpc_count 1 00000100:00000040:2.0:1784189367.604459:0:94309:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9dc044941850 x1870854436389120/t0(0) o256->60f345e3-c70e-4f53-b5e7-c9671463c9a5@192.168.203.12@tcp:558/0 lens 304/0 e 0 to 0 dl 1784189378 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784189367.604476:0:94309:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc044941850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:60f345e3-c70e-4f53-b5e7-c9671463c9a5+10:70943:x1870854436389120:12345-192.168.203.12@tcp:256:ll_cfg_requeue.0 20000000:01000000:2.0:1784189367.604503:0:94309:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 16384. 20000000:00000040:2.0:1784189367.604522:0:94309:0:(mgs_nids.c:144:nidtbl_fill_entry()) IR: 1 NIDs from NET #0 20000000:01000000:2.0:1784189367.604529:0:94309:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1784189367.604531:0:94309:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 125 00000020:00000040:2.0:1784189367.604538:0:94309:0:(genops.c:889:class_export_get()) GET export ffff9dc0756a3800 refcount=11 00000020:00000040:1.0:1784189367.607088:0:94309:0:(genops.c:900:class_export_put()) PUTting export ffff9dc0756a3800 : new refcount 10 00010000:00000040:1.0:1784189367.607112:0:94309:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 0, transno 0, xid 1870854436389120 00000100:00000040:1.0:1784189367.607126:0:94309:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9dbf4274f140 refcount 9 to 192.168.203.12@tcp 00000100:00000040:1.0:1784189367.607133:0:94309:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.203.12@tcp 00000100:00000040:1.0:1784189367.607172:0:94309:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff9dbf4274f140 refcount 8 to 192.168.203.12@tcp 00000100:00000040:1.0:1784189367.608090:0:94309:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9dc044941850 x1870854436389120/t0(0) o256->60f345e3-c70e-4f53-b5e7-c9671463c9a5@192.168.203.12@tcp:558/0 lens 304/240 e 0 to 0 dl 1784189378 ref 1 fl Interpret:/200/0 rc 0/0 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784189367.608106:0:94309:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc044941850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:60f345e3-c70e-4f53-b5e7-c9671463c9a5+10:70943:x1870854436389120:12345-192.168.203.12@tcp:256:ll_cfg_requeue.0 Request processed in 3634us (4250us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189367.608116:0:94309:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 210 00000100:00000040:1.0:1784189367.608120:0:94309:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9dc0756a3800 : new rpc_count 0 00000020:00000040:1.0:1784189367.608134:0:94309:0:(genops.c:900:class_export_put()) PUTting export ffff9dc0756a3800 : new refcount 9 00000100:00000040:0.0:1784189367.609725:0:3635:0:(events.c:337:request_in_callback()) incoming req@ffff9dc05edd0a80 x1870854436389248 msgsize 520 00000100:00100000:0.0:1784189367.609798:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1784189367.609897:0:26164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436389248 00000100:00100000:2.0:1784189367.609907:0:26164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436389248 00000020:00000040:2.0:1784189367.609911:0:26164:0:(genops.c:825:class_conn2export()) looking for export cookie 0xcc1762b626f8c98d 00000100:00100000:2.0:1784189367.609959:0:26164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 5080 00000100:00000040:2.0:1784189367.609967:0:26164:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9dc05edd0a80 x1870854436389248/t0(0) o8->@:0/0 lens 520/0 e 0 to 0 dl 1784189387 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784189367.609988:0:26164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc05edd0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:0+-99:2395:x1870854436389248:12345-192.168.203.12@tcp:8:ll_cfg_requeue.0 00000020:00000040:2.0:1784189367.610007:0:26164:0:(obd_config.c:994:class_incref()) incref lustre-OST0000 (ffff9dc07a7a0000) now 9 - find 00010000:00000040:2.0:1784189367.610019:0:26164:0:(ldlm_lib.c:1264:target_handle_connect()) lustre-OST0000: ocd_connect_flags: 0xa0467af2e3640038 tmp_exp_old_falloc: 0 00010000:00080000:2.0:1784189367.610025:0:26164:0:(ldlm_lib.c:938:target_handle_reconnect()) connect export for UUID 'debedd94-805c-42a0-a5e5-41758b2012e9' at ffff9dbf4512b000, cookie 0xcc1762b626f8d56b 00010000:00080000:2.0:1784189367.610031:0:26164:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0000: connection from debedd94-805c-42a0-a5e5-41758b2012e9@192.168.203.12@tcp recovering/t4294968978 exp ffff9dbf4512b000 cur 3609 last 1784189365 00000001:00000040:2.0:1784189367.610043:0:26164:0:(nodemap_handler.c:99:nodemap_getref()) GETting nodemap default(p=ffff9dc07fa60400) : new refcount 21 00000020:00000040:2.0:1784189367.610047:0:26164:0:(genops.c:889:class_export_get()) GET export ffff9dbf4512b000 refcount=4 00000001:00000040:2.0:1784189367.610050:0:26164:0:(nodemap_handler.c:99:nodemap_getref()) GETting nodemap default(p=ffff9dc07fa60400) : new refcount 22 00000001:00000040:2.0:1784189367.610053:0:26164:0:(nodemap_handler.c:115:nodemap_putref()) PUTting nodemap default(p=ffff9dc07fa60400) : new refcount 21 00002000:00100000:2.0:1784189367.610057:0:26164:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli debedd94-805c-42a0-a5e5-41758b2012e9/ffff9dbf4512b000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 21136a2 ocd_grant: 8388608 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1784189367.610073:0:26164:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00000020:00000040:2.0:1784189367.610082:0:26164:0:(lprocfs_status_server.c:693:lprocfs_exp_setup()) Found stats ffff9dc0710cb7e0 for nid 192.168.203.12@tcp - ref 2 00000020:00000040:2.0:1784189367.610186:0:26164:0:(obd_config.c:994:class_incref()) incref lustre-OST0000 (ffff9dc07a7a0000) now 10 - import 00000020:00000040:2.0:1784189367.610193:0:26164:0:(genops.c:1244:class_import_put()) import ffff9dbf424cc000 refcount=1 obd=lustre-OST0000 00000020:00000040:2.0:1784189367.610200:0:26164:0:(genops.c:889:class_export_get()) GET export ffff9dbf4512b000 refcount=5 00000100:00000040:2.0:1784189367.610203:0:26164:0:(service.c:1082:ptlrpc_request_change_export()) RPC GETting export ffff9dbf4512b000 : new rpc_count 1 00000100:00000040:2.0:1784189367.610211:0:26164:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9dbf4274f140 refcount 9 to 192.168.203.12@tcp 00000100:00000040:2.0:1784189367.610214:0:26164:0:(connection.c:149:ptlrpc_connection_get()) conn=ffff9dbf4274f140 refcount 9 to 192.168.203.12@tcp 00000020:00000040:2.0:1784189367.610217:0:26164:0:(genops.c:889:class_export_get()) GET export ffff9dbf4512b000 refcount=6 00000100:00000040:2.0:1784189367.610222:0:26164:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9dbf4274f140 refcount 10 to 192.168.203.12@tcp 00000100:00080000:2.0:1784189367.610231:0:26164:0:(import.c:65:import_set_state_nolock()) ffff9dbf424cc000 : changing import state from RECOVER to FULL 00000020:00000040:2.0:1784189367.610248:0:26164:0:(genops.c:900:class_export_put()) PUTting export ffff9dbf4512b000 : new refcount 5 00000020:00000040:2.0:1784189367.610251:0:26164:0:(obd_config.c:1022:class_decref()) Decref lustre-OST0000 (ffff9dc07a7a0000) now 10 - find 00010000:00000040:2.0:1784189367.610263:0:26164:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 4294968977, transno 0, xid 1870854436389248 00000100:00000040:2.0:1784189367.610270:0:26164:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9dbf4274f140 refcount 11 to 192.168.203.12@tcp 00000100:00000040:2.0:1784189367.610284:0:26164:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.203.12@tcp 00010000:00080000:0.0:1784189367.610289:0:96896:0:(ldlm_lib.c:2545:check_for_recovery_ready()) connected 3 stale 0 max_recoverable_clients 3 abort 0 expired 0 00010000:00000040:0.0:1784189367.610296:0:96896:0:(ldlm_lib.c:2874:target_recovery_thread()) 1: request replay stage - 1 clients from t4294968978 00010000:00080000:0.0:1784189367.610298:0:96896:0:(ldlm_lib.c:2683:replay_request_or_update()) Waiting for transno 4294968978 00010000:00080000:0.0:1784189367.610303:0:96896:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294968978 00010000:00080000:0.0:1784189367.610307:0:96896:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294968978 00000100:00000040:2.0:1784189367.610354:0:26164:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff9dbf4274f140 refcount 10 to 192.168.203.12@tcp 00000100:00000040:2.0:1784189367.610361:0:26164:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9dc05edd0a80 x1870854436389248/t0(0) o8->debedd94-805c-42a0-a5e5-41758b2012e9@192.168.203.12@tcp:0/0 lens 520/416 e 0 to 0 dl 1784189387 ref 1 fl Interpret:/200/0 rc 0/0 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784189367.610369:0:26164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc05edd0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:debedd94-805c-42a0-a5e5-41758b2012e9+5:2395:x1870854436389248:12345-192.168.203.12@tcp:8:ll_cfg_requeue.0 Request processed in 383us (644us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189367.610376:0:26164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 5080 00000100:00000040:2.0:1784189367.610380:0:26164:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9dbf4512b000 : new rpc_count 0 00000020:00000040:2.0:1784189367.610390:0:26164:0:(genops.c:900:class_export_put()) PUTting export ffff9dbf4512b000 : new refcount 4 00000100:00000040:2.0:1784189367.616985:0:3633:0:(events.c:337:request_in_callback()) incoming req@ffff9dc07130ca80 x1870854436359424 msgsize 440 00000100:00100000:2.0:1784189367.617000:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1784189367.617353:0:24843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436359424 00000100:00100000:3.0:1784189367.617363:0:24843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436359424 00000020:00000040:3.0:1784189367.617367:0:24843:0:(genops.c:825:class_conn2export()) looking for export cookie 0xcc1762b626f8d56b 00000020:00000040:3.0:1784189367.617373:0:24843:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9dbf4512b000 refcount=5 00000100:00000040:3.0:1784189367.617406:0:24843:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_io at +6s 00000100:00100000:3.0:1784189367.617466:0:24843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1048 00000100:00000040:3.0:1784189367.617471:0:24843:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9dbf4512b000 : new rpc_count 1 00000100:00000040:3.0:1784189367.617480:0:24843:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9dc07130ca80 x1870854436359424/t0(4294968978) o10->debedd94-805c-42a0-a5e5-41758b2012e9@192.168.203.12@tcp:558/0 lens 440/0 e 0 to 0 dl 1784189378 ref 1 fl New:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1784189367.617498:0:24843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc07130ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:debedd94-805c-42a0-a5e5-41758b2012e9+5:2395:x1870854436359424:12345-192.168.203.12@tcp:10:dd.0 00000020:00000040:3.0:1784189367.617511:0:24843:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff9dc07130ca80 x1870854436359424/t0(4294968978) o10->debedd94-805c-42a0-a5e5-41758b2012e9@192.168.203.12@tcp:558/0 lens 440/0 e 0 to 0 dl 1784189378 ref 1 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:3.0:1784189367.617520:0:24843:0:(ldlm_lib.c:3228:target_queue_recovery_request()) Next recovery transno: 4294968978, current: 4294968978, replaying 00010000:00000040:3.0:1784189367.617525:0:24843:0:(ldlm_lib.c:1774:target_request_copy_get()) RPC GETting export ffff9dbf4512b000 : new rpc_count 2 00000100:00000040:3.0:1784189367.617541:0:24843:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9dc07130ca80 x1870854436359424/t0(4294968978) o10->debedd94-805c-42a0-a5e5-41758b2012e9@192.168.203.12@tcp:558/0 lens 440/0 e 0 to 0 dl 1784189378 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1784189367.617553:0:24843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc07130ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:debedd94-805c-42a0-a5e5-41758b2012e9+5:2395:x1870854436359424:12345-192.168.203.12@tcp:10:dd.0 Request processed in 58us (566us total) trans 0 rc 0/-999 00000100:00100000:3.0:1784189367.617560:0:24843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1048 00000100:00000040:3.0:1784189367.617564:0:24843:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9dbf4512b000 : new rpc_count 1 00010000:00080000:0.0:1784189367.620039:0:96896:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 4294968978, next_transno: 4294968978 00010000:00080000:0.0:1784189367.620047:0:96896:0:(ldlm_lib.c:2246:check_for_next_transno()) waking for next (4294968978) 00010000:00080000:0.0:1784189367.620063:0:96896:0:(ldlm_lib.c:2747:replay_request_or_update()) @@@ processing x1870854436359424 t4294968978 from 192.168.203.12@tcp req@ffff9dc07130ca80 x1870854436359424/t0(4294968978) o10->debedd94-805c-42a0-a5e5-41758b2012e9@192.168.203.12@tcp:558/0 lens 440/0 e 0 to 0 dl 1784189378 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:0.0:1784189367.620087:0:96896:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff9dc07130ca80 x1870854436359424/t0(4294968978) o10->debedd94-805c-42a0-a5e5-41758b2012e9@192.168.203.12@tcp:558/0 lens 440/0 e 0 to 0 dl 1784189378 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00000040:0.0:1784189367.620121:0:96896:0:(ofd_dev.c:430:ofd_object_init()) object init, fid = [0x280000401:0x763:0x0] 00000001:00000040:0.0:1784189367.621537:0:96896:0:(tgt_lastrcvd.c:1006:tgt_last_commit_cb_add()) callback GETting export ffff9dbf4512b000 : new cb_count 1 00000020:00000040:0.0:1784189367.621544:0:96896:0:(genops.c:889:class_export_get()) GET export ffff9dbf4512b000 refcount=6 00010000:00000040:0.0:1784189367.621601:0:96896:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 4294968977, transno 4294968978, xid 1870854436359424 00000100:00000040:0.0:1784189367.621894:0:96896:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9dbf4274f140 refcount 11 to 192.168.203.12@tcp 00000100:00000040:0.0:1784189367.621904:0:96896:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.203.12@tcp 00000100:00000040:0.0:1784189367.621958:0:96896:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff9dbf4274f140 refcount 10 to 192.168.203.12@tcp 00010000:00080000:0.0:1784189367.621974:0:96896:0:(ldlm_lib.c:2100:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 101 seconds 00010000:00000040:0.0:1784189367.621983:0:96896:0:(ldlm_lib.c:1790:target_request_copy_put()) RPC PUTting export ffff9dbf4512b000 : new rpc_count 0 00000020:00000040:0.0:1784189367.621994:0:96896:0:(genops.c:900:class_export_put()) PUTting export ffff9dbf4512b000 : new refcount 5 00010000:00080000:0.0:1784189367.622000:0:96896:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294968979 00010000:00080000:0.0:1784189367.622005:0:96896:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294968979 00000100:00000040:0.0:1784189367.626528:0:3634:0:(events.c:337:request_in_callback()) incoming req@ffff9dc05edd3800 x1870854436361216 msgsize 440 00000100:00100000:0.0:1784189367.626545:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1784189367.626629:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436361216 00000100:00100000:1.0:1784189367.626639:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436361216 00000020:00000040:1.0:1784189367.626642:0:8433:0:(genops.c:825:class_conn2export()) looking for export cookie 0xcc1762b626f8d56b 00000020:00000040:1.0:1784189367.626648:0:8433:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9dbf4512b000 refcount=6 00000100:00000040:1.0:1784189367.626674:0:8433:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_io at +6s 00000100:00100000:1.0:1784189367.626723:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1049 00000100:00000040:1.0:1784189367.626728:0:8433:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9dbf4512b000 : new rpc_count 1 00000100:00000040:1.0:1784189367.626735:0:8433:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9dc05edd3800 x1870854436361216/t0(4294968979) o10->debedd94-805c-42a0-a5e5-41758b2012e9@192.168.203.12@tcp:558/0 lens 440/0 e 0 to 0 dl 1784189378 ref 1 fl New:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1784189367.626749:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc05edd3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:debedd94-805c-42a0-a5e5-41758b2012e9+6:2395:x1870854436361216:12345-192.168.203.12@tcp:10:dd.0 00000020:00000040:1.0:1784189367.626762:0:8433:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff9dc05edd3800 x1870854436361216/t0(4294968979) o10->debedd94-805c-42a0-a5e5-41758b2012e9@192.168.203.12@tcp:558/0 lens 440/0 e 0 to 0 dl 1784189378 ref 1 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:1.0:1784189367.626772:0:8433:0:(ldlm_lib.c:3228:target_queue_recovery_request()) Next recovery transno: 4294968979, current: 4294968979, replaying 00010000:00000040:1.0:1784189367.626775:0:8433:0:(ldlm_lib.c:1774:target_request_copy_get()) RPC GETting export ffff9dbf4512b000 : new rpc_count 2 00000100:00000040:1.0:1784189367.626798:0:8433:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9dc05edd3800 x1870854436361216/t0(4294968979) o10->debedd94-805c-42a0-a5e5-41758b2012e9@192.168.203.12@tcp:558/0 lens 440/0 e 0 to 0 dl 1784189378 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1784189367.626808:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc05edd3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:debedd94-805c-42a0-a5e5-41758b2012e9+6:2395:x1870854436361216:12345-192.168.203.12@tcp:10:dd.0 Request processed in 61us (280us total) trans 0 rc 0/-999 00000100:00100000:1.0:1784189367.626815:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1049 00000100:00000040:1.0:1784189367.626826:0:8433:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9dbf4512b000 : new rpc_count 1 00010000:00080000:2.0:1784189367.626948:0:96896:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 4294968979, next_transno: 4294968979 00010000:00080000:2.0:1784189367.626954:0:96896:0:(ldlm_lib.c:2246:check_for_next_transno()) waking for next (4294968979) 00010000:00080000:2.0:1784189367.626964:0:96896:0:(ldlm_lib.c:2747:replay_request_or_update()) @@@ processing x1870854436361216 t4294968979 from 192.168.203.12@tcp req@ffff9dc05edd3800 x1870854436361216/t0(4294968979) o10->debedd94-805c-42a0-a5e5-41758b2012e9@192.168.203.12@tcp:558/0 lens 440/0 e 0 to 0 dl 1784189378 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:2.0:1784189367.626983:0:96896:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff9dc05edd3800 x1870854436361216/t0(4294968979) o10->debedd94-805c-42a0-a5e5-41758b2012e9@192.168.203.12@tcp:558/0 lens 440/0 e 0 to 0 dl 1784189378 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00000040:2.0:1784189367.627013:0:96896:0:(ofd_dev.c:430:ofd_object_init()) object init, fid = [0x280000401:0x762:0x0] 00000001:00000040:2.0:1784189367.627197:0:96896:0:(tgt_lastrcvd.c:1006:tgt_last_commit_cb_add()) callback GETting export ffff9dbf4512b000 : new cb_count 2 00000020:00000040:2.0:1784189367.627201:0:96896:0:(genops.c:889:class_export_get()) GET export ffff9dbf4512b000 refcount=7 00010000:00000040:2.0:1784189367.627242:0:96896:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 4294968977, transno 4294968979, xid 1870854436361216 00000100:00000040:2.0:1784189367.627253:0:96896:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9dbf4274f140 refcount 11 to 192.168.203.12@tcp 00000100:00000040:2.0:1784189367.627259:0:96896:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.203.12@tcp 00000100:00000040:2.0:1784189367.627311:0:96896:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff9dbf4274f140 refcount 10 to 192.168.203.12@tcp 00010000:00080000:2.0:1784189367.627343:0:96896:0:(ldlm_lib.c:2100:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00000040:2.0:1784189367.627352:0:96896:0:(ldlm_lib.c:1790:target_request_copy_put()) RPC PUTting export ffff9dbf4512b000 : new rpc_count 0 00000020:00000040:2.0:1784189367.627363:0:96896:0:(genops.c:900:class_export_put()) PUTting export ffff9dbf4512b000 : new refcount 6 00010000:00080000:2.0:1784189367.627375:0:96896:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294968980 00010000:00080000:2.0:1784189367.627379:0:96896:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294968980 00000100:00000040:2.0:1784189367.631063:0:3635:0:(events.c:337:request_in_callback()) incoming req@ffff9dc07130f100 x1870854436362624 msgsize 440 00000100:00100000:2.0:1784189367.631078:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1784189367.631161:0:25599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436362624 00000100:00100000:0.0:1784189367.631170:0:25599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436362624 00000020:00000040:0.0:1784189367.631185:0:25599:0:(genops.c:825:class_conn2export()) looking for export cookie 0xcc1762b626f8d56b 00000020:00000040:0.0:1784189367.631190:0:25599:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9dbf4512b000 refcount=7 00000100:00000040:0.0:1784189367.631212:0:25599:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_io at +6s 00000100:00100000:0.0:1784189367.631251:0:25599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1050 00000100:00000040:0.0:1784189367.631255:0:25599:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9dbf4512b000 : new rpc_count 1 00000100:00000040:0.0:1784189367.631263:0:25599:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9dc07130f100 x1870854436362624/t0(4294968980) o10->debedd94-805c-42a0-a5e5-41758b2012e9@192.168.203.12@tcp:558/0 lens 440/0 e 0 to 0 dl 1784189378 ref 1 fl New:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1784189367.631276:0:25599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc07130f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:debedd94-805c-42a0-a5e5-41758b2012e9+7:2395:x1870854436362624:12345-192.168.203.12@tcp:10:dd.0 00000020:00000040:0.0:1784189367.631287:0:25599:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff9dc07130f100 x1870854436362624/t0(4294968980) o10->debedd94-805c-42a0-a5e5-41758b2012e9@192.168.203.12@tcp:558/0 lens 440/0 e 0 to 0 dl 1784189378 ref 1 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:0.0:1784189367.631297:0:25599:0:(ldlm_lib.c:3228:target_queue_recovery_request()) Next recovery transno: 4294968980, current: 4294968980, replaying 00010000:00000040:0.0:1784189367.631300:0:25599:0:(ldlm_lib.c:1774:target_request_copy_get()) RPC GETting export ffff9dbf4512b000 : new rpc_count 2 00000100:00000040:0.0:1784189367.631315:0:25599:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9dc07130f100 x1870854436362624/t0(4294968980) o10->debedd94-805c-42a0-a5e5-41758b2012e9@192.168.203.12@tcp:558/0 lens 440/0 e 0 to 0 dl 1784189378 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1784189367.634667:0:25599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc07130f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:debedd94-805c-42a0-a5e5-41758b2012e9+7:2395:x1870854436362624:12345-192.168.203.12@tcp:10:dd.0 Request processed in 3385us (3597us total) trans 0 rc 0/-999 00000100:00100000:0.0:1784189367.634680:0:25599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1050 00000100:00000040:0.0:1784189367.634684:0:25599:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9dbf4512b000 : new rpc_count 1 00010000:00080000:2.0:1784189367.634834:0:96896:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 4294968980, next_transno: 4294968980 00010000:00080000:2.0:1784189367.634838:0:96896:0:(ldlm_lib.c:2246:check_for_next_transno()) waking for next (4294968980) 00010000:00080000:2.0:1784189367.634850:0:96896:0:(ldlm_lib.c:2747:replay_request_or_update()) @@@ processing x1870854436362624 t4294968980 from 192.168.203.12@tcp req@ffff9dc07130f100 x1870854436362624/t0(4294968980) o10->debedd94-805c-42a0-a5e5-41758b2012e9@192.168.203.12@tcp:558/0 lens 440/0 e 0 to 0 dl 1784189378 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:2.0:1784189367.634875:0:96896:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff9dc07130f100 x1870854436362624/t0(4294968980) o10->debedd94-805c-42a0-a5e5-41758b2012e9@192.168.203.12@tcp:558/0 lens 440/0 e 0 to 0 dl 1784189378 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00000040:2.0:1784189367.634910:0:96896:0:(ofd_dev.c:430:ofd_object_init()) object init, fid = [0x280000401:0x765:0x0] 00000001:00000040:2.0:1784189367.635073:0:96896:0:(tgt_lastrcvd.c:1006:tgt_last_commit_cb_add()) callback GETting export ffff9dbf4512b000 : new cb_count 3 00000020:00000040:2.0:1784189367.635078:0:96896:0:(genops.c:889:class_export_get()) GET export ffff9dbf4512b000 refcount=8 00010000:00000040:2.0:1784189367.635107:0:96896:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 4294968977, transno 4294968980, xid 1870854436362624 00000100:00000040:2.0:1784189367.635117:0:96896:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9dbf4274f140 refcount 11 to 192.168.203.12@tcp 00000100:00000040:2.0:1784189367.635122:0:96896:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.203.12@tcp 00000100:00000040:2.0:1784189367.635188:0:96896:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff9dbf4274f140 refcount 10 to 192.168.203.12@tcp 00010000:00080000:2.0:1784189367.635197:0:96896:0:(ldlm_lib.c:2100:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00000040:2.0:1784189367.635204:0:96896:0:(ldlm_lib.c:1790:target_request_copy_put()) RPC PUTting export ffff9dbf4512b000 : new rpc_count 0 00000020:00000040:2.0:1784189367.635214:0:96896:0:(genops.c:900:class_export_put()) PUTting export ffff9dbf4512b000 : new refcount 7 00010000:00080000:2.0:1784189367.635218:0:96896:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294968981 00010000:00080000:2.0:1784189367.635222:0:96896:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294968981 00000100:00000040:1.0:1784189367.644006:0:3633:0:(events.c:337:request_in_callback()) incoming req@ffff9dbf43e10700 x1870854436362496 msgsize 440 00000100:00100000:1.0:1784189367.644022:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1784189367.644095:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436362496 00000100:00100000:3.0:1784189367.644104:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436362496 00000020:00000040:3.0:1784189367.644107:0:8434:0:(genops.c:825:class_conn2export()) looking for export cookie 0xcc1762b626f8d56b 00000020:00000040:3.0:1784189367.644112:0:8434:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9dbf4512b000 refcount=8 00000100:00000040:3.0:1784189367.644135:0:8434:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_io at +6s 00000100:00100000:3.0:1784189367.644199:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1051 00000100:00000040:3.0:1784189367.644204:0:8434:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9dbf4512b000 : new rpc_count 1 00000100:00000040:3.0:1784189367.644211:0:8434:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9dbf43e10700 x1870854436362496/t0(4294968981) o10->debedd94-805c-42a0-a5e5-41758b2012e9@192.168.203.12@tcp:558/0 lens 440/0 e 0 to 0 dl 1784189378 ref 1 fl New:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1784189367.644225:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf43e10700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:debedd94-805c-42a0-a5e5-41758b2012e9+8:2395:x1870854436362496:12345-192.168.203.12@tcp:10:dd.0 00000020:00000040:3.0:1784189367.644236:0:8434:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff9dbf43e10700 x1870854436362496/t0(4294968981) o10->debedd94-805c-42a0-a5e5-41758b2012e9@192.168.203.12@tcp:558/0 lens 440/0 e 0 to 0 dl 1784189378 ref 1 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:3.0:1784189367.644256:0:8434:0:(ldlm_lib.c:3228:target_queue_recovery_request()) Next recovery transno: 4294968981, current: 4294968981, replaying 00010000:00000040:3.0:1784189367.644259:0:8434:0:(ldlm_lib.c:1774:target_request_copy_get()) RPC GETting export ffff9dbf4512b000 : new rpc_count 2 00000100:00000040:3.0:1784189367.644281:0:8434:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9dbf43e10700 x1870854436362496/t0(4294968981) o10->debedd94-805c-42a0-a5e5-41758b2012e9@192.168.203.12@tcp:558/0 lens 440/0 e 0 to 0 dl 1784189378 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1784189367.644290:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf43e10700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:debedd94-805c-42a0-a5e5-41758b2012e9+8:2395:x1870854436362496:12345-192.168.203.12@tcp:10:dd.0 Request processed in 67us (284us total) trans 0 rc 0/-999 00000100:00100000:3.0:1784189367.644297:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1051 00000100:00000040:3.0:1784189367.644301:0:8434:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9dbf4512b000 : new rpc_count 1 00010000:00080000:0.0:1784189367.644512:0:96896:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 4294968981, next_transno: 4294968981 00010000:00080000:0.0:1784189367.644517:0:96896:0:(ldlm_lib.c:2246:check_for_next_transno()) waking for next (4294968981) 00010000:00080000:0.0:1784189367.644526:0:96896:0:(ldlm_lib.c:2747:replay_request_or_update()) @@@ processing x1870854436362496 t4294968981 from 192.168.203.12@tcp req@ffff9dbf43e10700 x1870854436362496/t0(4294968981) o10->debedd94-805c-42a0-a5e5-41758b2012e9@192.168.203.12@tcp:558/0 lens 440/0 e 0 to 0 dl 1784189378 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:0.0:1784189367.644542:0:96896:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff9dbf43e10700 x1870854436362496/t0(4294968981) o10->debedd94-805c-42a0-a5e5-41758b2012e9@192.168.203.12@tcp:558/0 lens 440/0 e 0 to 0 dl 1784189378 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00000040:0.0:1784189367.644571:0:96896:0:(ofd_dev.c:430:ofd_object_init()) object init, fid = [0x280000401:0x764:0x0] 00000001:00000040:0.0:1784189367.644747:0:96896:0:(tgt_lastrcvd.c:1006:tgt_last_commit_cb_add()) callback GETting export ffff9dbf4512b000 : new cb_count 4 00000020:00000040:0.0:1784189367.644751:0:96896:0:(genops.c:889:class_export_get()) GET export ffff9dbf4512b000 refcount=9 00010000:00000040:0.0:1784189367.644780:0:96896:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 4294968977, transno 4294968981, xid 1870854436362496 00000100:00000040:0.0:1784189367.644790:0:96896:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9dbf4274f140 refcount 11 to 192.168.203.12@tcp 00000100:00000040:0.0:1784189367.644795:0:96896:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.203.12@tcp 00000100:00000040:0.0:1784189367.644847:0:96896:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff9dbf4274f140 refcount 10 to 192.168.203.12@tcp 00010000:00080000:0.0:1784189367.644855:0:96896:0:(ldlm_lib.c:2100:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00000040:0.0:1784189367.644861:0:96896:0:(ldlm_lib.c:1790:target_request_copy_put()) RPC PUTting export ffff9dbf4512b000 : new rpc_count 0 00000020:00000040:0.0:1784189367.644870:0:96896:0:(genops.c:900:class_export_put()) PUTting export ffff9dbf4512b000 : new refcount 8 00010000:00080000:0.0:1784189367.644874:0:96896:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294968982 00010000:00080000:0.0:1784189367.644877:0:96896:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294968982 00000100:00000040:3.0:1784189367.652182:0:3634:0:(events.c:337:request_in_callback()) incoming req@ffff9dc071535500 x1870854436364672 msgsize 440 00000100:00100000:3.0:1784189367.652199:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1784189367.652343:0:24846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436364672 00000100:00100000:1.0:1784189367.652353:0:24846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436364672 00000020:00000040:1.0:1784189367.652357:0:24846:0:(genops.c:825:class_conn2export()) looking for export cookie 0xcc1762b626f8d56b 00000020:00000040:1.0:1784189367.652362:0:24846:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9dbf4512b000 refcount=9 00000100:00000040:1.0:1784189367.652388:0:24846:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_io at +6s 00000100:00100000:1.0:1784189367.652477:0:24846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1052 00000100:00000040:1.0:1784189367.652482:0:24846:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9dbf4512b000 : new rpc_count 1 00000100:00000040:1.0:1784189367.652490:0:24846:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9dc071535500 x1870854436364672/t0(4294968982) o10->debedd94-805c-42a0-a5e5-41758b2012e9@192.168.203.12@tcp:558/0 lens 440/0 e 0 to 0 dl 1784189378 ref 1 fl New:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1784189367.652505:0:24846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc071535500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:debedd94-805c-42a0-a5e5-41758b2012e9+9:2395:x1870854436364672:12345-192.168.203.12@tcp:10:dd.0 00000020:00000040:1.0:1784189367.652518:0:24846:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff9dc071535500 x1870854436364672/t0(4294968982) o10->debedd94-805c-42a0-a5e5-41758b2012e9@192.168.203.12@tcp:558/0 lens 440/0 e 0 to 0 dl 1784189378 ref 1 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:1.0:1784189367.652527:0:24846:0:(ldlm_lib.c:3228:target_queue_recovery_request()) Next recovery transno: 4294968982, current: 4294968982, replaying 00010000:00000040:1.0:1784189367.652530:0:24846:0:(ldlm_lib.c:1774:target_request_copy_get()) RPC GETting export ffff9dbf4512b000 : new rpc_count 2 00000100:00000040:1.0:1784189367.652551:0:24846:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9dc071535500 x1870854436364672/t0(4294968982) o10->debedd94-805c-42a0-a5e5-41758b2012e9@192.168.203.12@tcp:558/0 lens 440/0 e 0 to 0 dl 1784189378 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1784189367.652561:0:24846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc071535500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:debedd94-805c-42a0-a5e5-41758b2012e9+9:2395:x1870854436364672:12345-192.168.203.12@tcp:10:dd.0 Request processed in 59us (380us total) trans 0 rc 0/-999 00000100:00100000:1.0:1784189367.652568:0:24846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1052 00000100:00000040:1.0:1784189367.652571:0:24846:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9dbf4512b000 : new rpc_count 1 00010000:00080000:0.0:1784189367.652629:0:96896:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 4294968982, next_transno: 4294968982 00010000:00080000:0.0:1784189367.652634:0:96896:0:(ldlm_lib.c:2246:check_for_next_transno()) waking for next (4294968982) 00010000:00080000:0.0:1784189367.652642:0:96896:0:(ldlm_lib.c:2747:replay_request_or_update()) @@@ processing x1870854436364672 t4294968982 from 192.168.203.12@tcp req@ffff9dc071535500 x1870854436364672/t0(4294968982) o10->debedd94-805c-42a0-a5e5-41758b2012e9@192.168.203.12@tcp:558/0 lens 440/0 e 0 to 0 dl 1784189378 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:0.0:1784189367.652658:0:96896:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff9dc071535500 x1870854436364672/t0(4294968982) o10->debedd94-805c-42a0-a5e5-41758b2012e9@192.168.203.12@tcp:558/0 lens 440/0 e 0 to 0 dl 1784189378 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00000040:0.0:1784189367.652686:0:96896:0:(ofd_dev.c:430:ofd_object_init()) object init, fid = [0x280000401:0x766:0x0] 00000001:00000040:0.0:1784189367.652880:0:96896:0:(tgt_lastrcvd.c:1006:tgt_last_commit_cb_add()) callback GETting export ffff9dbf4512b000 : new cb_count 5 00000020:00000040:0.0:1784189367.652883:0:96896:0:(genops.c:889:class_export_get()) GET export ffff9dbf4512b000 refcount=10 00010000:00000040:0.0:1784189367.652916:0:96896:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 4294968977, transno 4294968982, xid 1870854436364672 00000100:00000040:0.0:1784189367.652926:0:96896:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9dbf4274f140 refcount 11 to 192.168.203.12@tcp 00000100:00000040:0.0:1784189367.652932:0:96896:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.203.12@tcp 00000100:00000040:0.0:1784189367.652975:0:96896:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff9dbf4274f140 refcount 10 to 192.168.203.12@tcp 00010000:00080000:0.0:1784189367.652983:0:96896:0:(ldlm_lib.c:2100:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00000040:0.0:1784189367.652989:0:96896:0:(ldlm_lib.c:1790:target_request_copy_put()) RPC PUTting export ffff9dbf4512b000 : new rpc_count 0 00000020:00000040:0.0:1784189367.652998:0:96896:0:(genops.c:900:class_export_put()) PUTting export ffff9dbf4512b000 : new refcount 9 00010000:00080000:0.0:1784189367.653002:0:96896:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294968983 00010000:00080000:0.0:1784189367.653012:0:96896:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294968983 00000100:00000040:3.0:1784189367.655629:0:3635:0:(events.c:337:request_in_callback()) incoming req@ffff9dc071535880 x1870854436365568 msgsize 440 00000100:00100000:3.0:1784189367.655647:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1784189367.655909:0:24845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436365568 00000100:00100000:0.0:1784189367.655919:0:24845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436365568 00000020:00000040:0.0:1784189367.655922:0:24845:0:(genops.c:825:class_conn2export()) looking for export cookie 0xcc1762b626f8d56b 00000020:00000040:0.0:1784189367.655928:0:24845:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9dbf4512b000 refcount=10 00000100:00000040:0.0:1784189367.655952:0:24845:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_io at +6s 00000100:00100000:0.0:1784189367.656000:0:24845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1053 00000100:00000040:0.0:1784189367.656004:0:24845:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9dbf4512b000 : new rpc_count 1 00000100:00000040:0.0:1784189367.656010:0:24845:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9dc071535880 x1870854436365568/t0(4294968983) o10->debedd94-805c-42a0-a5e5-41758b2012e9@192.168.203.12@tcp:558/0 lens 440/0 e 0 to 0 dl 1784189378 ref 1 fl New:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1784189367.656024:0:24845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc071535880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:debedd94-805c-42a0-a5e5-41758b2012e9+10:2395:x1870854436365568:12345-192.168.203.12@tcp:10:dd.0 00000020:00000040:0.0:1784189367.656035:0:24845:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff9dc071535880 x1870854436365568/t0(4294968983) o10->debedd94-805c-42a0-a5e5-41758b2012e9@192.168.203.12@tcp:558/0 lens 440/0 e 0 to 0 dl 1784189378 ref 1 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:0.0:1784189367.656045:0:24845:0:(ldlm_lib.c:3228:target_queue_recovery_request()) Next recovery transno: 4294968983, current: 4294968983, replaying 00010000:00000040:0.0:1784189367.656048:0:24845:0:(ldlm_lib.c:1774:target_request_copy_get()) RPC GETting export ffff9dbf4512b000 : new rpc_count 2 00000100:00000040:0.0:1784189367.656061:0:24845:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9dc071535880 x1870854436365568/t0(4294968983) o10->debedd94-805c-42a0-a5e5-41758b2012e9@192.168.203.12@tcp:558/0 lens 440/0 e 0 to 0 dl 1784189378 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1784189367.656070:0:24845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc071535880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:debedd94-805c-42a0-a5e5-41758b2012e9+10:2395:x1870854436365568:12345-192.168.203.12@tcp:10:dd.0 Request processed in 48us (442us total) trans 0 rc 0/-999 00000100:00100000:0.0:1784189367.656077:0:24845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1053 00000100:00000040:0.0:1784189367.656080:0:24845:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9dbf4512b000 : new rpc_count 1 00010000:00080000:0.0:1784189367.656097:0:96896:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 4294968983, next_transno: 4294968983 00010000:00080000:0.0:1784189367.656101:0:96896:0:(ldlm_lib.c:2246:check_for_next_transno()) waking for next (4294968983) 00010000:00080000:0.0:1784189367.656109:0:96896:0:(ldlm_lib.c:2747:replay_request_or_update()) @@@ processing x1870854436365568 t4294968983 from 192.168.203.12@tcp req@ffff9dc071535880 x1870854436365568/t0(4294968983) o10->debedd94-805c-42a0-a5e5-41758b2012e9@192.168.203.12@tcp:558/0 lens 440/0 e 0 to 0 dl 1784189378 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:0.0:1784189367.656123:0:96896:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff9dc071535880 x1870854436365568/t0(4294968983) o10->debedd94-805c-42a0-a5e5-41758b2012e9@192.168.203.12@tcp:558/0 lens 440/0 e 0 to 0 dl 1784189378 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00000040:0.0:1784189367.656161:0:96896:0:(ofd_dev.c:430:ofd_object_init()) object init, fid = [0x280000401:0x767:0x0] 00000001:00000040:0.0:1784189367.656350:0:96896:0:(tgt_lastrcvd.c:1006:tgt_last_commit_cb_add()) callback GETting export ffff9dbf4512b000 : new cb_count 6 00000020:00000040:0.0:1784189367.656354:0:96896:0:(genops.c:889:class_export_get()) GET export ffff9dbf4512b000 refcount=11 00010000:00000040:0.0:1784189367.656382:0:96896:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 4294968977, transno 4294968983, xid 1870854436365568 00000100:00000040:0.0:1784189367.656390:0:96896:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9dbf4274f140 refcount 11 to 192.168.203.12@tcp 00000100:00000040:0.0:1784189367.656395:0:96896:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.203.12@tcp 00000100:00000040:0.0:1784189367.656443:0:96896:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff9dbf4274f140 refcount 10 to 192.168.203.12@tcp 00010000:00080000:0.0:1784189367.656451:0:96896:0:(ldlm_lib.c:2100:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00000040:0.0:1784189367.656456:0:96896:0:(ldlm_lib.c:1790:target_request_copy_put()) RPC PUTting export ffff9dbf4512b000 : new rpc_count 0 00000020:00000040:0.0:1784189367.656465:0:96896:0:(genops.c:900:class_export_put()) PUTting export ffff9dbf4512b000 : new refcount 10 00010000:00080000:0.0:1784189367.656468:0:96896:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294968984 00010000:00080000:0.0:1784189367.656472:0:96896:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294968984 00000100:00000040:0.0:1784189367.659018:0:3633:0:(events.c:337:request_in_callback()) incoming req@ffff9dc05edd0700 x1870854436366976 msgsize 440 00000100:00100000:0.0:1784189367.659032:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1784189367.659563:0:24831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436366976 00000100:00100000:2.0:1784189367.659572:0:24831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436366976 00000020:00000040:2.0:1784189367.659575:0:24831:0:(genops.c:825:class_conn2export()) looking for export cookie 0xcc1762b626f8d56b 00000020:00000040:2.0:1784189367.659580:0:24831:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9dbf4512b000 refcount=11 00000100:00000040:2.0:1784189367.659603:0:24831:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_io at +6s 00000100:00100000:2.0:1784189367.659657:0:24831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1054 00000100:00000040:2.0:1784189367.659672:0:24831:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9dbf4512b000 : new rpc_count 1 00000100:00000040:2.0:1784189367.659681:0:24831:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9dc05edd0700 x1870854436366976/t0(4294968984) o10->debedd94-805c-42a0-a5e5-41758b2012e9@192.168.203.12@tcp:558/0 lens 440/0 e 0 to 0 dl 1784189378 ref 1 fl New:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1784189367.659696:0:24831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc05edd0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:debedd94-805c-42a0-a5e5-41758b2012e9+11:2395:x1870854436366976:12345-192.168.203.12@tcp:10:dd.0 00000020:00000040:2.0:1784189367.659707:0:24831:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff9dc05edd0700 x1870854436366976/t0(4294968984) o10->debedd94-805c-42a0-a5e5-41758b2012e9@192.168.203.12@tcp:558/0 lens 440/0 e 0 to 0 dl 1784189378 ref 1 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:2.0:1784189367.659716:0:24831:0:(ldlm_lib.c:3228:target_queue_recovery_request()) Next recovery transno: 4294968984, current: 4294968984, replaying 00010000:00000040:2.0:1784189367.659719:0:24831:0:(ldlm_lib.c:1774:target_request_copy_get()) RPC GETting export ffff9dbf4512b000 : new rpc_count 2 00000100:00000040:2.0:1784189367.659730:0:24831:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9dc05edd0700 x1870854436366976/t0(4294968984) o10->debedd94-805c-42a0-a5e5-41758b2012e9@192.168.203.12@tcp:558/0 lens 440/0 e 0 to 0 dl 1784189378 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1784189367.659739:0:24831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc05edd0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:debedd94-805c-42a0-a5e5-41758b2012e9+11:2395:x1870854436366976:12345-192.168.203.12@tcp:10:dd.0 Request processed in 46us (722us total) trans 0 rc 0/-999 00000100:00100000:2.0:1784189367.659745:0:24831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1054 00000100:00000040:2.0:1784189367.659748:0:24831:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9dbf4512b000 : new rpc_count 1 00010000:00080000:0.0:1784189367.659847:0:96896:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 4294968984, next_transno: 4294968984 00010000:00080000:0.0:1784189367.659856:0:96896:0:(ldlm_lib.c:2246:check_for_next_transno()) waking for next (4294968984) 00010000:00080000:0.0:1784189367.659865:0:96896:0:(ldlm_lib.c:2747:replay_request_or_update()) @@@ processing x1870854436366976 t4294968984 from 192.168.203.12@tcp req@ffff9dc05edd0700 x1870854436366976/t0(4294968984) o10->debedd94-805c-42a0-a5e5-41758b2012e9@192.168.203.12@tcp:558/0 lens 440/0 e 0 to 0 dl 1784189378 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:0.0:1784189367.659881:0:96896:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff9dc05edd0700 x1870854436366976/t0(4294968984) o10->debedd94-805c-42a0-a5e5-41758b2012e9@192.168.203.12@tcp:558/0 lens 440/0 e 0 to 0 dl 1784189378 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00000040:0.0:1784189367.660040:0:96896:0:(ofd_dev.c:430:ofd_object_init()) object init, fid = [0x280000401:0x775:0x0] 00000001:00000040:0.0:1784189367.660344:0:96896:0:(tgt_lastrcvd.c:1006:tgt_last_commit_cb_add()) callback GETting export ffff9dbf4512b000 : new cb_count 7 00000020:00000040:0.0:1784189367.660348:0:96896:0:(genops.c:889:class_export_get()) GET export ffff9dbf4512b000 refcount=12 00010000:00000040:0.0:1784189367.660381:0:96896:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 4294968977, transno 4294968984, xid 1870854436366976 00000100:00000040:0.0:1784189367.660391:0:96896:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9dbf4274f140 refcount 11 to 192.168.203.12@tcp 00000100:00000040:0.0:1784189367.660397:0:96896:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.203.12@tcp 00000100:00000040:0.0:1784189367.660499:0:96896:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff9dbf4274f140 refcount 10 to 192.168.203.12@tcp 00010000:00080000:0.0:1784189367.660516:0:96896:0:(ldlm_lib.c:2100:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00000040:0.0:1784189367.660522:0:96896:0:(ldlm_lib.c:1790:target_request_copy_put()) RPC PUTting export ffff9dbf4512b000 : new rpc_count 0 00000020:00000040:0.0:1784189367.660531:0:96896:0:(genops.c:900:class_export_put()) PUTting export ffff9dbf4512b000 : new refcount 11 00010000:00080000:0.0:1784189367.660535:0:96896:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294968985 00010000:00080000:0.0:1784189367.660539:0:96896:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294968985 00000100:00000040:3.0:1784189367.663300:0:3634:0:(events.c:337:request_in_callback()) incoming req@ffff9dc071536680 x1870854436367488 msgsize 440 00000100:00100000:3.0:1784189367.663315:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1784189367.663457:0:24844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436367488 00000100:00100000:0.0:1784189367.663467:0:24844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436367488 00000020:00000040:0.0:1784189367.663470:0:24844:0:(genops.c:825:class_conn2export()) looking for export cookie 0xcc1762b626f8d56b 00000020:00000040:0.0:1784189367.663476:0:24844:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9dbf4512b000 refcount=12 00000100:00000040:0.0:1784189367.663500:0:24844:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_io at +6s 00000100:00100000:0.0:1784189367.663536:0:24844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1055 00000100:00000040:0.0:1784189367.663540:0:24844:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9dbf4512b000 : new rpc_count 1 00000100:00000040:0.0:1784189367.663548:0:24844:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9dc071536680 x1870854436367488/t0(4294968985) o10->debedd94-805c-42a0-a5e5-41758b2012e9@192.168.203.12@tcp:558/0 lens 440/0 e 0 to 0 dl 1784189378 ref 1 fl New:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1784189367.663562:0:24844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc071536680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:debedd94-805c-42a0-a5e5-41758b2012e9+12:2395:x1870854436367488:12345-192.168.203.12@tcp:10:dd.0 00000020:00000040:0.0:1784189367.663574:0:24844:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff9dc071536680 x1870854436367488/t0(4294968985) o10->debedd94-805c-42a0-a5e5-41758b2012e9@192.168.203.12@tcp:558/0 lens 440/0 e 0 to 0 dl 1784189378 ref 1 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:0.0:1784189367.663584:0:24844:0:(ldlm_lib.c:3228:target_queue_recovery_request()) Next recovery transno: 4294968985, current: 4294968985, replaying 00010000:00000040:0.0:1784189367.663587:0:24844:0:(ldlm_lib.c:1774:target_request_copy_get()) RPC GETting export ffff9dbf4512b000 : new rpc_count 2 00000100:00000040:0.0:1784189367.663603:0:24844:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9dc071536680 x1870854436367488/t0(4294968985) o10->debedd94-805c-42a0-a5e5-41758b2012e9@192.168.203.12@tcp:558/0 lens 440/0 e 0 to 0 dl 1784189378 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1784189367.663622:0:24844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc071536680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:debedd94-805c-42a0-a5e5-41758b2012e9+12:2395:x1870854436367488:12345-192.168.203.12@tcp:10:dd.0 Request processed in 53us (312us total) trans 0 rc 0/-999 00000100:00100000:0.0:1784189367.663630:0:24844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1055 00000100:00000040:0.0:1784189367.663633:0:24844:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9dbf4512b000 : new rpc_count 1 00010000:00080000:1.0:1784189367.663684:0:96896:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 4294968985, next_transno: 4294968985 00010000:00080000:1.0:1784189367.663689:0:96896:0:(ldlm_lib.c:2246:check_for_next_transno()) waking for next (4294968985) 00010000:00080000:1.0:1784189367.663700:0:96896:0:(ldlm_lib.c:2747:replay_request_or_update()) @@@ processing x1870854436367488 t4294968985 from 192.168.203.12@tcp req@ffff9dc071536680 x1870854436367488/t0(4294968985) o10->debedd94-805c-42a0-a5e5-41758b2012e9@192.168.203.12@tcp:558/0 lens 440/0 e 0 to 0 dl 1784189378 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:1.0:1784189367.663731:0:96896:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff9dc071536680 x1870854436367488/t0(4294968985) o10->debedd94-805c-42a0-a5e5-41758b2012e9@192.168.203.12@tcp:558/0 lens 440/0 e 0 to 0 dl 1784189378 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00000040:1.0:1784189367.663760:0:96896:0:(ofd_dev.c:430:ofd_object_init()) object init, fid = [0x280000401:0x768:0x0] 00000001:00000040:1.0:1784189367.663945:0:96896:0:(tgt_lastrcvd.c:1006:tgt_last_commit_cb_add()) callback GETting export ffff9dbf4512b000 : new cb_count 8 00000020:00000040:1.0:1784189367.663949:0:96896:0:(genops.c:889:class_export_get()) GET export ffff9dbf4512b000 refcount=13 00010000:00000040:1.0:1784189367.663987:0:96896:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 4294968977, transno 4294968985, xid 1870854436367488 00000100:00000040:1.0:1784189367.663997:0:96896:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9dbf4274f140 refcount 11 to 192.168.203.12@tcp 00000100:00000040:1.0:1784189367.664003:0:96896:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.203.12@tcp 00000100:00000040:1.0:1784189367.664051:0:96896:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff9dbf4274f140 refcount 10 to 192.168.203.12@tcp 00010000:00080000:1.0:1784189367.664059:0:96896:0:(ldlm_lib.c:2100:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00000040:1.0:1784189367.664064:0:96896:0:(ldlm_lib.c:1790:target_request_copy_put()) RPC PUTting export ffff9dbf4512b000 : new rpc_count 0 00000020:00000040:1.0:1784189367.664074:0:96896:0:(genops.c:900:class_export_put()) PUTting export ffff9dbf4512b000 : new refcount 12 00010000:00080000:1.0:1784189367.664078:0:96896:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294968986 00010000:00080000:1.0:1784189367.664092:0:96896:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294968986 00000100:00000040:3.0:1784189367.667157:0:3635:0:(events.c:337:request_in_callback()) incoming req@ffff9dc071534e00 x1870854436369536 msgsize 440 00000100:00100000:3.0:1784189367.667172:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1784189367.668462:0:25599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436369536 00000100:00100000:2.0:1784189367.668474:0:25599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436369536 00000020:00000040:2.0:1784189367.668477:0:25599:0:(genops.c:825:class_conn2export()) looking for export cookie 0xcc1762b626f8d56b 00000020:00000040:2.0:1784189367.668481:0:25599:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9dbf4512b000 refcount=13 00000100:00000040:2.0:1784189367.668505:0:25599:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_io at +6s 00000100:00100000:2.0:1784189367.668937:0:25599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1056 00000100:00000040:2.0:1784189367.668943:0:25599:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9dbf4512b000 : new rpc_count 1 00000100:00000040:2.0:1784189367.668952:0:25599:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9dc071534e00 x1870854436369536/t0(4294968986) o10->debedd94-805c-42a0-a5e5-41758b2012e9@192.168.203.12@tcp:558/0 lens 440/0 e 0 to 0 dl 1784189378 ref 1 fl New:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1784189367.668967:0:25599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc071534e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:debedd94-805c-42a0-a5e5-41758b2012e9+13:2395:x1870854436369536:12345-192.168.203.12@tcp:10:dd.0 00000020:00000040:2.0:1784189367.668979:0:25599:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff9dc071534e00 x1870854436369536/t0(4294968986) o10->debedd94-805c-42a0-a5e5-41758b2012e9@192.168.203.12@tcp:558/0 lens 440/0 e 0 to 0 dl 1784189378 ref 1 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:2.0:1784189367.669002:0:25599:0:(ldlm_lib.c:3228:target_queue_recovery_request()) Next recovery transno: 4294968986, current: 4294968986, replaying 00010000:00000040:2.0:1784189367.669006:0:25599:0:(ldlm_lib.c:1774:target_request_copy_get()) RPC GETting export ffff9dbf4512b000 : new rpc_count 2 00000100:00000040:2.0:1784189367.669025:0:25599:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9dc071534e00 x1870854436369536/t0(4294968986) o10->debedd94-805c-42a0-a5e5-41758b2012e9@192.168.203.12@tcp:558/0 lens 440/0 e 0 to 0 dl 1784189378 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1784189367.669035:0:25599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc071534e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:debedd94-805c-42a0-a5e5-41758b2012e9+13:2395:x1870854436369536:12345-192.168.203.12@tcp:10:dd.0 Request processed in 71us (1878us total) trans 0 rc 0/-999 00010000:00080000:3.0:1784189367.669229:0:96896:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 4294968986, next_transno: 4294968986 00010000:00080000:3.0:1784189367.669235:0:96896:0:(ldlm_lib.c:2246:check_for_next_transno()) waking for next (4294968986) 00010000:00080000:3.0:1784189367.669246:0:96896:0:(ldlm_lib.c:2747:replay_request_or_update()) @@@ processing x1870854436369536 t4294968986 from 192.168.203.12@tcp req@ffff9dc071534e00 x1870854436369536/t0(4294968986) o10->debedd94-805c-42a0-a5e5-41758b2012e9@192.168.203.12@tcp:558/0 lens 440/0 e 0 to 0 dl 1784189378 ref 2 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:3.0:1784189367.669264:0:96896:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff9dc071534e00 x1870854436369536/t0(4294968986) o10->debedd94-805c-42a0-a5e5-41758b2012e9@192.168.203.12@tcp:558/0 lens 440/0 e 0 to 0 dl 1784189378 ref 2 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00000040:3.0:1784189367.669292:0:96896:0:(ofd_dev.c:430:ofd_object_init()) object init, fid = [0x280000401:0x769:0x0] 00000001:00000040:3.0:1784189367.669469:0:96896:0:(tgt_lastrcvd.c:1006:tgt_last_commit_cb_add()) callback GETting export ffff9dbf4512b000 : new cb_count 9 00000020:00000040:3.0:1784189367.669473:0:96896:0:(genops.c:889:class_export_get()) GET export ffff9dbf4512b000 refcount=14 00010000:00000040:3.0:1784189367.669519:0:96896:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 4294968977, transno 4294968986, xid 1870854436369536 00000100:00000040:3.0:1784189367.669529:0:96896:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9dbf4274f140 refcount 11 to 192.168.203.12@tcp 00000100:00000040:3.0:1784189367.669535:0:96896:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.203.12@tcp 00000100:00000040:3.0:1784189367.669579:0:96896:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff9dbf4274f140 refcount 10 to 192.168.203.12@tcp 00010000:00080000:3.0:1784189367.669588:0:96896:0:(ldlm_lib.c:2100:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00000100:00100000:2.0:1784189367.670086:0:25599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1056 00000100:00000040:2.0:1784189367.670091:0:25599:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9dbf4512b000 : new rpc_count 1 00010000:00000040:3.0:1784189367.672054:0:96896:0:(ldlm_lib.c:1790:target_request_copy_put()) RPC PUTting export ffff9dbf4512b000 : new rpc_count 0 00000020:00000040:3.0:1784189367.672076:0:96896:0:(genops.c:900:class_export_put()) PUTting export ffff9dbf4512b000 : new refcount 13 00010000:00080000:3.0:1784189367.672083:0:96896:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294968987 00010000:00080000:3.0:1784189367.672088:0:96896:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294968987 00000100:00000040:0.0:1784189367.675205:0:3633:0:(events.c:337:request_in_callback()) incoming req@ffff9dc05edd0000 x1870854436370176 msgsize 440 00000100:00100000:0.0:1784189367.675233:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1784189367.675573:0:24833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436370176 00000100:00100000:2.0:1784189367.675583:0:24833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436370176 00000020:00000040:2.0:1784189367.675586:0:24833:0:(genops.c:825:class_conn2export()) looking for export cookie 0xcc1762b626f8d56b 00000020:00000040:2.0:1784189367.675591:0:24833:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9dbf4512b000 refcount=14 00000100:00000040:2.0:1784189367.675625:0:24833:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_io at +6s 00000100:00100000:2.0:1784189367.676001:0:24833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1057 00000100:00000040:2.0:1784189367.676007:0:24833:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9dbf4512b000 : new rpc_count 1 00000100:00000040:2.0:1784189367.676016:0:24833:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9dc05edd0000 x1870854436370176/t0(4294968987) o10->debedd94-805c-42a0-a5e5-41758b2012e9@192.168.203.12@tcp:558/0 lens 440/0 e 0 to 0 dl 1784189378 ref 1 fl New:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1784189367.676032:0:24833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc05edd0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:debedd94-805c-42a0-a5e5-41758b2012e9+14:2395:x1870854436370176:12345-192.168.203.12@tcp:10:dd.0 00000020:00000040:2.0:1784189367.676045:0:24833:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff9dc05edd0000 x1870854436370176/t0(4294968987) o10->debedd94-805c-42a0-a5e5-41758b2012e9@192.168.203.12@tcp:558/0 lens 440/0 e 0 to 0 dl 1784189378 ref 1 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:2.0:1784189367.676055:0:24833:0:(ldlm_lib.c:3228:target_queue_recovery_request()) Next recovery transno: 4294968987, current: 4294968987, replaying 00010000:00000040:2.0:1784189367.676059:0:24833:0:(ldlm_lib.c:1774:target_request_copy_get()) RPC GETting export ffff9dbf4512b000 : new rpc_count 2 00000100:00000040:2.0:1784189367.676073:0:24833:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9dc05edd0000 x1870854436370176/t0(4294968987) o10->debedd94-805c-42a0-a5e5-41758b2012e9@192.168.203.12@tcp:558/0 lens 440/0 e 0 to 0 dl 1784189378 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1784189367.676084:0:24833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc05edd0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:debedd94-805c-42a0-a5e5-41758b2012e9+14:2395:x1870854436370176:12345-192.168.203.12@tcp:10:dd.0 Request processed in 56us (879us total) trans 0 rc 0/-999 00000100:00100000:2.0:1784189367.678465:0:24833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1057 00000100:00000040:2.0:1784189367.678473:0:24833:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9dbf4512b000 : new rpc_count 1 00010000:00080000:2.0:1784189367.678499:0:96896:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 4294968987, next_transno: 4294968987 00010000:00080000:2.0:1784189367.678503:0:96896:0:(ldlm_lib.c:2246:check_for_next_transno()) waking for next (4294968987) 00010000:00080000:2.0:1784189367.678513:0:96896:0:(ldlm_lib.c:2747:replay_request_or_update()) @@@ processing x1870854436370176 t4294968987 from 192.168.203.12@tcp req@ffff9dc05edd0000 x1870854436370176/t0(4294968987) o10->debedd94-805c-42a0-a5e5-41758b2012e9@192.168.203.12@tcp:558/0 lens 440/0 e 0 to 0 dl 1784189378 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:2.0:1784189367.678538:0:96896:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff9dc05edd0000 x1870854436370176/t0(4294968987) o10->debedd94-805c-42a0-a5e5-41758b2012e9@192.168.203.12@tcp:558/0 lens 440/0 e 0 to 0 dl 1784189378 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00000040:2.0:1784189367.678571:0:96896:0:(ofd_dev.c:430:ofd_object_init()) object init, fid = [0x280000401:0x76a:0x0] 00000001:00000040:2.0:1784189367.678763:0:96896:0:(tgt_lastrcvd.c:1006:tgt_last_commit_cb_add()) callback GETting export ffff9dbf4512b000 : new cb_count 10 00000020:00000040:2.0:1784189367.678768:0:96896:0:(genops.c:889:class_export_get()) GET export ffff9dbf4512b000 refcount=15 00010000:00000040:2.0:1784189367.678799:0:96896:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 4294968977, transno 4294968987, xid 1870854436370176 00000100:00000040:2.0:1784189367.678808:0:96896:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9dbf4274f140 refcount 11 to 192.168.203.12@tcp 00000100:00000040:2.0:1784189367.678815:0:96896:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.203.12@tcp 00000100:00000040:2.0:1784189367.678871:0:96896:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff9dbf4274f140 refcount 10 to 192.168.203.12@tcp 00010000:00080000:2.0:1784189367.678881:0:96896:0:(ldlm_lib.c:2100:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00000040:2.0:1784189367.678886:0:96896:0:(ldlm_lib.c:1790:target_request_copy_put()) RPC PUTting export ffff9dbf4512b000 : new rpc_count 0 00000020:00000040:2.0:1784189367.678896:0:96896:0:(genops.c:900:class_export_put()) PUTting export ffff9dbf4512b000 : new refcount 14 00010000:00080000:2.0:1784189367.678900:0:96896:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294968988 00010000:00080000:2.0:1784189367.678904:0:96896:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294968988 00000100:00000040:0.0:1784189367.690498:0:3634:0:(events.c:337:request_in_callback()) incoming req@ffff9dc05edd3480 x1870854436371328 msgsize 440 00000100:00100000:0.0:1784189367.690512:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1784189367.691968:0:24845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436371328 00000100:00100000:3.0:1784189367.691980:0:24845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436371328 00000020:00000040:3.0:1784189367.691983:0:24845:0:(genops.c:825:class_conn2export()) looking for export cookie 0xcc1762b626f8d56b 00000020:00000040:3.0:1784189367.691988:0:24845:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9dbf4512b000 refcount=15 00000100:00000040:3.0:1784189367.692012:0:24845:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_io at +6s 00000100:00100000:3.0:1784189367.692058:0:24845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1058 00000100:00000040:3.0:1784189367.692063:0:24845:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9dbf4512b000 : new rpc_count 1 00000100:00000040:3.0:1784189367.692070:0:24845:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9dc05edd3480 x1870854436371328/t0(4294968988) o10->debedd94-805c-42a0-a5e5-41758b2012e9@192.168.203.12@tcp:558/0 lens 440/0 e 0 to 0 dl 1784189378 ref 1 fl New:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1784189367.692084:0:24845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc05edd3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:debedd94-805c-42a0-a5e5-41758b2012e9+15:2395:x1870854436371328:12345-192.168.203.12@tcp:10:dd.0 00000020:00000040:3.0:1784189367.692095:0:24845:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff9dc05edd3480 x1870854436371328/t0(4294968988) o10->debedd94-805c-42a0-a5e5-41758b2012e9@192.168.203.12@tcp:558/0 lens 440/0 e 0 to 0 dl 1784189378 ref 1 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:3.0:1784189367.692104:0:24845:0:(ldlm_lib.c:3228:target_queue_recovery_request()) Next recovery transno: 4294968988, current: 4294968988, replaying 00010000:00000040:3.0:1784189367.692108:0:24845:0:(ldlm_lib.c:1774:target_request_copy_get()) RPC GETting export ffff9dbf4512b000 : new rpc_count 2 00000100:00000040:3.0:1784189367.692120:0:24845:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9dc05edd3480 x1870854436371328/t0(4294968988) o10->debedd94-805c-42a0-a5e5-41758b2012e9@192.168.203.12@tcp:558/0 lens 440/0 e 0 to 0 dl 1784189378 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1784189367.692129:0:24845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc05edd3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:debedd94-805c-42a0-a5e5-41758b2012e9+15:2395:x1870854436371328:12345-192.168.203.12@tcp:10:dd.0 Request processed in 47us (1631us total) trans 0 rc 0/-999 00000100:00100000:3.0:1784189367.692150:0:24845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1058 00000100:00000040:3.0:1784189367.692154:0:24845:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9dbf4512b000 : new rpc_count 1 00010000:00080000:0.0:1784189367.692239:0:96896:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 4294968988, next_transno: 4294968988 00010000:00080000:0.0:1784189367.692244:0:96896:0:(ldlm_lib.c:2246:check_for_next_transno()) waking for next (4294968988) 00010000:00080000:0.0:1784189367.692252:0:96896:0:(ldlm_lib.c:2747:replay_request_or_update()) @@@ processing x1870854436371328 t4294968988 from 192.168.203.12@tcp req@ffff9dc05edd3480 x1870854436371328/t0(4294968988) o10->debedd94-805c-42a0-a5e5-41758b2012e9@192.168.203.12@tcp:558/0 lens 440/0 e 0 to 0 dl 1784189378 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:0.0:1784189367.692267:0:96896:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff9dc05edd3480 x1870854436371328/t0(4294968988) o10->debedd94-805c-42a0-a5e5-41758b2012e9@192.168.203.12@tcp:558/0 lens 440/0 e 0 to 0 dl 1784189378 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00000040:0.0:1784189367.692299:0:96896:0:(ofd_dev.c:430:ofd_object_init()) object init, fid = [0x280000401:0x76c:0x0] 00000001:00000040:0.0:1784189367.692480:0:96896:0:(tgt_lastrcvd.c:1006:tgt_last_commit_cb_add()) callback GETting export ffff9dbf4512b000 : new cb_count 11 00000020:00000040:0.0:1784189367.692484:0:96896:0:(genops.c:889:class_export_get()) GET export ffff9dbf4512b000 refcount=16 00010000:00000040:0.0:1784189367.692514:0:96896:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 4294968977, transno 4294968988, xid 1870854436371328 00000100:00000040:0.0:1784189367.692524:0:96896:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9dbf4274f140 refcount 11 to 192.168.203.12@tcp 00000100:00000040:0.0:1784189367.692530:0:96896:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.203.12@tcp 00000100:00000040:0.0:1784189367.692578:0:96896:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff9dbf4274f140 refcount 10 to 192.168.203.12@tcp 00010000:00080000:0.0:1784189367.692586:0:96896:0:(ldlm_lib.c:2100:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00000040:0.0:1784189367.692590:0:96896:0:(ldlm_lib.c:1790:target_request_copy_put()) RPC PUTting export ffff9dbf4512b000 : new rpc_count 0 00000020:00000040:0.0:1784189367.692600:0:96896:0:(genops.c:900:class_export_put()) PUTting export ffff9dbf4512b000 : new refcount 15 00010000:00080000:0.0:1784189367.692604:0:96896:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294968989 00010000:00080000:0.0:1784189367.692608:0:96896:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294968989 00000100:00000040:0.0:1784189367.694784:0:3635:0:(events.c:337:request_in_callback()) incoming req@ffff9dc05edd3100 x1870854436372992 msgsize 440 00000100:00100000:0.0:1784189367.694799:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1784189367.694972:0:24843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436372992 00000100:00100000:3.0:1784189367.694983:0:24843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436372992 00000020:00000040:3.0:1784189367.694987:0:24843:0:(genops.c:825:class_conn2export()) looking for export cookie 0xcc1762b626f8d56b 00000020:00000040:3.0:1784189367.694992:0:24843:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9dbf4512b000 refcount=16 00000100:00000040:3.0:1784189367.695018:0:24843:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_io at +6s 00000100:00100000:3.0:1784189367.695065:0:24843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1059 00000100:00000040:3.0:1784189367.695069:0:24843:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9dbf4512b000 : new rpc_count 1 00000100:00000040:3.0:1784189367.695076:0:24843:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9dc05edd3100 x1870854436372992/t0(4294968989) o10->debedd94-805c-42a0-a5e5-41758b2012e9@192.168.203.12@tcp:558/0 lens 440/0 e 0 to 0 dl 1784189378 ref 1 fl New:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1784189367.695089:0:24843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc05edd3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:debedd94-805c-42a0-a5e5-41758b2012e9+16:2395:x1870854436372992:12345-192.168.203.12@tcp:10:dd.0 00000020:00000040:3.0:1784189367.695100:0:24843:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff9dc05edd3100 x1870854436372992/t0(4294968989) o10->debedd94-805c-42a0-a5e5-41758b2012e9@192.168.203.12@tcp:558/0 lens 440/0 e 0 to 0 dl 1784189378 ref 1 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:3.0:1784189367.695108:0:24843:0:(ldlm_lib.c:3228:target_queue_recovery_request()) Next recovery transno: 4294968989, current: 4294968989, replaying 00010000:00000040:3.0:1784189367.695111:0:24843:0:(ldlm_lib.c:1774:target_request_copy_get()) RPC GETting export ffff9dbf4512b000 : new rpc_count 2 00000100:00000040:3.0:1784189367.695127:0:24843:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9dc05edd3100 x1870854436372992/t0(4294968989) o10->debedd94-805c-42a0-a5e5-41758b2012e9@192.168.203.12@tcp:558/0 lens 440/0 e 0 to 0 dl 1784189378 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1784189367.695139:0:24843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc05edd3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:debedd94-805c-42a0-a5e5-41758b2012e9+16:2395:x1870854436372992:12345-192.168.203.12@tcp:10:dd.0 Request processed in 52us (355us total) trans 0 rc 0/-999 00000100:00100000:3.0:1784189367.695146:0:24843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1059 00000100:00000040:3.0:1784189367.695149:0:24843:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9dbf4512b000 : new rpc_count 1 00010000:00080000:0.0:1784189367.695222:0:96896:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 4294968989, next_transno: 4294968989 00010000:00080000:0.0:1784189367.695227:0:96896:0:(ldlm_lib.c:2246:check_for_next_transno()) waking for next (4294968989) 00010000:00080000:0.0:1784189367.695235:0:96896:0:(ldlm_lib.c:2747:replay_request_or_update()) @@@ processing x1870854436372992 t4294968989 from 192.168.203.12@tcp req@ffff9dc05edd3100 x1870854436372992/t0(4294968989) o10->debedd94-805c-42a0-a5e5-41758b2012e9@192.168.203.12@tcp:558/0 lens 440/0 e 0 to 0 dl 1784189378 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:0.0:1784189367.695268:0:96896:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff9dc05edd3100 x1870854436372992/t0(4294968989) o10->debedd94-805c-42a0-a5e5-41758b2012e9@192.168.203.12@tcp:558/0 lens 440/0 e 0 to 0 dl 1784189378 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00000040:0.0:1784189367.695296:0:96896:0:(ofd_dev.c:430:ofd_object_init()) object init, fid = [0x280000401:0x76b:0x0] 00000001:00000040:0.0:1784189367.695507:0:96896:0:(tgt_lastrcvd.c:1006:tgt_last_commit_cb_add()) callback GETting export ffff9dbf4512b000 : new cb_count 12 00000020:00000040:0.0:1784189367.695512:0:96896:0:(genops.c:889:class_export_get()) GET export ffff9dbf4512b000 refcount=17 00010000:00000040:0.0:1784189367.695543:0:96896:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 4294968977, transno 4294968989, xid 1870854436372992 00000100:00000040:0.0:1784189367.695552:0:96896:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9dbf4274f140 refcount 11 to 192.168.203.12@tcp 00000100:00000040:0.0:1784189367.695558:0:96896:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.203.12@tcp 00000100:00000040:0.0:1784189367.695600:0:96896:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff9dbf4274f140 refcount 10 to 192.168.203.12@tcp 00010000:00080000:0.0:1784189367.695609:0:96896:0:(ldlm_lib.c:2100:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00000040:0.0:1784189367.695625:0:96896:0:(ldlm_lib.c:1790:target_request_copy_put()) RPC PUTting export ffff9dbf4512b000 : new rpc_count 0 00000020:00000040:0.0:1784189367.695634:0:96896:0:(genops.c:900:class_export_put()) PUTting export ffff9dbf4512b000 : new refcount 16 00010000:00080000:0.0:1784189367.695638:0:96896:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294968990 00010000:00080000:0.0:1784189367.695641:0:96896:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294968990 00000100:00000040:1.0:1784189367.703091:0:3633:0:(events.c:337:request_in_callback()) incoming req@ffff9dc07fb34a80 x1870854436374016 msgsize 440 00000100:00100000:1.0:1784189367.703107:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1784189367.703178:0:24831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436374016 00000100:00100000:2.0:1784189367.703196:0:24831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436374016 00000020:00000040:2.0:1784189367.703200:0:24831:0:(genops.c:825:class_conn2export()) looking for export cookie 0xcc1762b626f8d56b 00000020:00000040:2.0:1784189367.703205:0:24831:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9dbf4512b000 refcount=17 00000100:00000040:2.0:1784189367.703229:0:24831:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_io at +6s 00000100:00100000:2.0:1784189367.703277:0:24831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1060 00000100:00000040:2.0:1784189367.703281:0:24831:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9dbf4512b000 : new rpc_count 1 00000100:00000040:2.0:1784189367.703302:0:24831:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9dc07fb34a80 x1870854436374016/t0(4294968990) o10->debedd94-805c-42a0-a5e5-41758b2012e9@192.168.203.12@tcp:558/0 lens 440/0 e 0 to 0 dl 1784189378 ref 1 fl New:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1784189367.703316:0:24831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc07fb34a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:debedd94-805c-42a0-a5e5-41758b2012e9+17:2395:x1870854436374016:12345-192.168.203.12@tcp:10:dd.0 00000020:00000040:2.0:1784189367.703361:0:24831:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff9dc07fb34a80 x1870854436374016/t0(4294968990) o10->debedd94-805c-42a0-a5e5-41758b2012e9@192.168.203.12@tcp:558/0 lens 440/0 e 0 to 0 dl 1784189378 ref 1 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:2.0:1784189367.703371:0:24831:0:(ldlm_lib.c:3228:target_queue_recovery_request()) Next recovery transno: 4294968990, current: 4294968990, replaying 00010000:00000040:2.0:1784189367.703374:0:24831:0:(ldlm_lib.c:1774:target_request_copy_get()) RPC GETting export ffff9dbf4512b000 : new rpc_count 2 00000100:00000040:2.0:1784189367.703390:0:24831:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9dc07fb34a80 x1870854436374016/t0(4294968990) o10->debedd94-805c-42a0-a5e5-41758b2012e9@192.168.203.12@tcp:558/0 lens 440/0 e 0 to 0 dl 1784189378 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1784189367.703398:0:24831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc07fb34a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:debedd94-805c-42a0-a5e5-41758b2012e9+17:2395:x1870854436374016:12345-192.168.203.12@tcp:10:dd.0 Request processed in 86us (308us total) trans 0 rc 0/-999 00000100:00100000:2.0:1784189367.703405:0:24831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1060 00000100:00000040:2.0:1784189367.703408:0:24831:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9dbf4512b000 : new rpc_count 1 00010000:00080000:3.0:1784189367.703522:0:96896:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 4294968990, next_transno: 4294968990 00010000:00080000:3.0:1784189367.703526:0:96896:0:(ldlm_lib.c:2246:check_for_next_transno()) waking for next (4294968990) 00010000:00080000:3.0:1784189367.703534:0:96896:0:(ldlm_lib.c:2747:replay_request_or_update()) @@@ processing x1870854436374016 t4294968990 from 192.168.203.12@tcp req@ffff9dc07fb34a80 x1870854436374016/t0(4294968990) o10->debedd94-805c-42a0-a5e5-41758b2012e9@192.168.203.12@tcp:558/0 lens 440/0 e 0 to 0 dl 1784189378 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:3.0:1784189367.703555:0:96896:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff9dc07fb34a80 x1870854436374016/t0(4294968990) o10->debedd94-805c-42a0-a5e5-41758b2012e9@192.168.203.12@tcp:558/0 lens 440/0 e 0 to 0 dl 1784189378 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00000040:3.0:1784189367.703582:0:96896:0:(ofd_dev.c:430:ofd_object_init()) object init, fid = [0x280000401:0x76d:0x0] 00000001:00000040:3.0:1784189367.703759:0:96896:0:(tgt_lastrcvd.c:1006:tgt_last_commit_cb_add()) callback GETting export ffff9dbf4512b000 : new cb_count 13 00000020:00000040:3.0:1784189367.703763:0:96896:0:(genops.c:889:class_export_get()) GET export ffff9dbf4512b000 refcount=18 00010000:00000040:3.0:1784189367.703791:0:96896:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 4294968977, transno 4294968990, xid 1870854436374016 00000100:00000040:3.0:1784189367.703801:0:96896:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9dbf4274f140 refcount 11 to 192.168.203.12@tcp 00000100:00000040:3.0:1784189367.703806:0:96896:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.203.12@tcp 00000100:00000040:3.0:1784189367.703851:0:96896:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff9dbf4274f140 refcount 10 to 192.168.203.12@tcp 00010000:00080000:3.0:1784189367.703859:0:96896:0:(ldlm_lib.c:2100:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00000040:3.0:1784189367.703863:0:96896:0:(ldlm_lib.c:1790:target_request_copy_put()) RPC PUTting export ffff9dbf4512b000 : new rpc_count 0 00000020:00000040:3.0:1784189367.703872:0:96896:0:(genops.c:900:class_export_put()) PUTting export ffff9dbf4512b000 : new refcount 17 00010000:00080000:3.0:1784189367.703875:0:96896:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294968991 00010000:00080000:3.0:1784189367.703878:0:96896:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294968991 00000100:00000040:3.0:1784189367.709139:0:3634:0:(events.c:337:request_in_callback()) incoming req@ffff9dbf469b6680 x1870854436374144 msgsize 440 00000100:00100000:3.0:1784189367.709155:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1784189367.709279:0:24834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436374144 00000100:00100000:0.0:1784189367.709289:0:24834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436374144 00000020:00000040:0.0:1784189367.709293:0:24834:0:(genops.c:825:class_conn2export()) looking for export cookie 0xcc1762b626f8d56b 00000020:00000040:0.0:1784189367.709297:0:24834:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9dbf4512b000 refcount=18 00000100:00000040:0.0:1784189367.709472:0:24834:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_io at +6s 00000100:00100000:0.0:1784189367.709546:0:24834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1061 00000100:00000040:0.0:1784189367.709551:0:24834:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9dbf4512b000 : new rpc_count 1 00000100:00000040:0.0:1784189367.709558:0:24834:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9dbf469b6680 x1870854436374144/t0(4294968991) o10->debedd94-805c-42a0-a5e5-41758b2012e9@192.168.203.12@tcp:558/0 lens 440/0 e 0 to 0 dl 1784189378 ref 1 fl New:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1784189367.709572:0:24834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf469b6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:debedd94-805c-42a0-a5e5-41758b2012e9+18:2395:x1870854436374144:12345-192.168.203.12@tcp:10:dd.0 00000020:00000040:0.0:1784189367.709584:0:24834:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff9dbf469b6680 x1870854436374144/t0(4294968991) o10->debedd94-805c-42a0-a5e5-41758b2012e9@192.168.203.12@tcp:558/0 lens 440/0 e 0 to 0 dl 1784189378 ref 1 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:0.0:1784189367.709610:0:24834:0:(ldlm_lib.c:3228:target_queue_recovery_request()) Next recovery transno: 4294968991, current: 4294968991, replaying 00010000:00000040:0.0:1784189367.709622:0:24834:0:(ldlm_lib.c:1774:target_request_copy_get()) RPC GETting export ffff9dbf4512b000 : new rpc_count 2 00000100:00000040:0.0:1784189367.709639:0:24834:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9dbf469b6680 x1870854436374144/t0(4294968991) o10->debedd94-805c-42a0-a5e5-41758b2012e9@192.168.203.12@tcp:558/0 lens 440/0 e 0 to 0 dl 1784189378 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1784189367.709649:0:24834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf469b6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:debedd94-805c-42a0-a5e5-41758b2012e9+18:2395:x1870854436374144:12345-192.168.203.12@tcp:10:dd.0 Request processed in 80us (511us total) trans 0 rc 0/-999 00000100:00100000:0.0:1784189367.709656:0:24834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1061 00000100:00000040:0.0:1784189367.709659:0:24834:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9dbf4512b000 : new rpc_count 1 00010000:00080000:3.0:1784189367.709701:0:96896:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 4294968991, next_transno: 4294968991 00010000:00080000:3.0:1784189367.709713:0:96896:0:(ldlm_lib.c:2246:check_for_next_transno()) waking for next (4294968991) 00010000:00080000:3.0:1784189367.709721:0:96896:0:(ldlm_lib.c:2747:replay_request_or_update()) @@@ processing x1870854436374144 t4294968991 from 192.168.203.12@tcp req@ffff9dbf469b6680 x1870854436374144/t0(4294968991) o10->debedd94-805c-42a0-a5e5-41758b2012e9@192.168.203.12@tcp:558/0 lens 440/0 e 0 to 0 dl 1784189378 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:3.0:1784189367.709736:0:96896:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff9dbf469b6680 x1870854436374144/t0(4294968991) o10->debedd94-805c-42a0-a5e5-41758b2012e9@192.168.203.12@tcp:558/0 lens 440/0 e 0 to 0 dl 1784189378 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00000040:3.0:1784189367.709765:0:96896:0:(ofd_dev.c:430:ofd_object_init()) object init, fid = [0x280000401:0x76e:0x0] 00000001:00000040:3.0:1784189367.709931:0:96896:0:(tgt_lastrcvd.c:1006:tgt_last_commit_cb_add()) callback GETting export ffff9dbf4512b000 : new cb_count 14 00000020:00000040:3.0:1784189367.709935:0:96896:0:(genops.c:889:class_export_get()) GET export ffff9dbf4512b000 refcount=19 00010000:00000040:3.0:1784189367.709969:0:96896:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 4294968977, transno 4294968991, xid 1870854436374144 00000100:00000040:3.0:1784189367.709985:0:96896:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9dbf4274f140 refcount 11 to 192.168.203.12@tcp 00000100:00000040:3.0:1784189367.709991:0:96896:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.203.12@tcp 00000100:00000040:3.0:1784189367.710047:0:96896:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff9dbf4274f140 refcount 10 to 192.168.203.12@tcp 00010000:00080000:3.0:1784189367.710056:0:96896:0:(ldlm_lib.c:2100:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00000040:3.0:1784189367.710061:0:96896:0:(ldlm_lib.c:1790:target_request_copy_put()) RPC PUTting export ffff9dbf4512b000 : new rpc_count 0 00000020:00000040:3.0:1784189367.710069:0:96896:0:(genops.c:900:class_export_put()) PUTting export ffff9dbf4512b000 : new refcount 18 00010000:00080000:3.0:1784189367.710073:0:96896:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294968992 00010000:00080000:3.0:1784189367.710076:0:96896:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294968992 00000100:00000040:1.0:1784189367.714281:0:3635:0:(events.c:337:request_in_callback()) incoming req@ffff9dc06b98d180 x1870854436375040 msgsize 440 00000100:00100000:1.0:1784189367.714298:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1784189367.714811:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436375040 00000100:00100000:0.0:1784189367.714821:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436375040 00000020:00000040:0.0:1784189367.714825:0:8434:0:(genops.c:825:class_conn2export()) looking for export cookie 0xcc1762b626f8d56b 00000020:00000040:0.0:1784189367.714830:0:8434:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9dbf4512b000 refcount=19 00000100:00000040:0.0:1784189367.714854:0:8434:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_io at +6s 00000100:00100000:0.0:1784189367.714905:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1062 00000100:00000040:0.0:1784189367.714909:0:8434:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9dbf4512b000 : new rpc_count 1 00000100:00000040:0.0:1784189367.714917:0:8434:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9dc06b98d180 x1870854436375040/t0(4294968992) o10->debedd94-805c-42a0-a5e5-41758b2012e9@192.168.203.12@tcp:558/0 lens 440/0 e 0 to 0 dl 1784189378 ref 1 fl New:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1784189367.714932:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc06b98d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:debedd94-805c-42a0-a5e5-41758b2012e9+19:2395:x1870854436375040:12345-192.168.203.12@tcp:10:dd.0 00000020:00000040:0.0:1784189367.714943:0:8434:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff9dc06b98d180 x1870854436375040/t0(4294968992) o10->debedd94-805c-42a0-a5e5-41758b2012e9@192.168.203.12@tcp:558/0 lens 440/0 e 0 to 0 dl 1784189378 ref 1 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:0.0:1784189367.714953:0:8434:0:(ldlm_lib.c:3228:target_queue_recovery_request()) Next recovery transno: 4294968992, current: 4294968992, replaying 00010000:00000040:0.0:1784189367.714956:0:8434:0:(ldlm_lib.c:1774:target_request_copy_get()) RPC GETting export ffff9dbf4512b000 : new rpc_count 2 00000100:00000040:0.0:1784189367.714978:0:8434:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9dc06b98d180 x1870854436375040/t0(4294968992) o10->debedd94-805c-42a0-a5e5-41758b2012e9@192.168.203.12@tcp:558/0 lens 440/0 e 0 to 0 dl 1784189378 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1784189367.714988:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc06b98d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:debedd94-805c-42a0-a5e5-41758b2012e9+19:2395:x1870854436375040:12345-192.168.203.12@tcp:10:dd.0 Request processed in 59us (707us total) trans 0 rc 0/-999 00000100:00100000:0.0:1784189367.715007:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1062 00000100:00000040:0.0:1784189367.715010:0:8434:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9dbf4512b000 : new rpc_count 1 00010000:00080000:1.0:1784189367.715225:0:96896:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 4294968992, next_transno: 4294968992 00010000:00080000:1.0:1784189367.715229:0:96896:0:(ldlm_lib.c:2246:check_for_next_transno()) waking for next (4294968992) 00010000:00080000:1.0:1784189367.715237:0:96896:0:(ldlm_lib.c:2747:replay_request_or_update()) @@@ processing x1870854436375040 t4294968992 from 192.168.203.12@tcp req@ffff9dc06b98d180 x1870854436375040/t0(4294968992) o10->debedd94-805c-42a0-a5e5-41758b2012e9@192.168.203.12@tcp:558/0 lens 440/0 e 0 to 0 dl 1784189378 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:1.0:1784189367.715252:0:96896:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff9dc06b98d180 x1870854436375040/t0(4294968992) o10->debedd94-805c-42a0-a5e5-41758b2012e9@192.168.203.12@tcp:558/0 lens 440/0 e 0 to 0 dl 1784189378 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00000040:1.0:1784189367.715279:0:96896:0:(ofd_dev.c:430:ofd_object_init()) object init, fid = [0x280000401:0x76f:0x0] 00000001:00000040:1.0:1784189367.715469:0:96896:0:(tgt_lastrcvd.c:1006:tgt_last_commit_cb_add()) callback GETting export ffff9dbf4512b000 : new cb_count 15 00000020:00000040:1.0:1784189367.715478:0:96896:0:(genops.c:889:class_export_get()) GET export ffff9dbf4512b000 refcount=20 00010000:00000040:1.0:1784189367.715513:0:96896:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 4294968977, transno 4294968992, xid 1870854436375040 00000100:00000040:1.0:1784189367.715523:0:96896:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9dbf4274f140 refcount 11 to 192.168.203.12@tcp 00000100:00000040:1.0:1784189367.715529:0:96896:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.203.12@tcp 00000100:00000040:1.0:1784189367.715630:0:96896:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff9dbf4274f140 refcount 10 to 192.168.203.12@tcp 00010000:00080000:1.0:1784189367.715639:0:96896:0:(ldlm_lib.c:2100:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00000040:1.0:1784189367.715644:0:96896:0:(ldlm_lib.c:1790:target_request_copy_put()) RPC PUTting export ffff9dbf4512b000 : new rpc_count 0 00000020:00000040:1.0:1784189367.715654:0:96896:0:(genops.c:900:class_export_put()) PUTting export ffff9dbf4512b000 : new refcount 19 00010000:00080000:1.0:1784189367.715658:0:96896:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294968993 00010000:00080000:1.0:1784189367.715661:0:96896:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294968993 00000100:00000040:1.0:1784189367.718493:0:3633:0:(events.c:337:request_in_callback()) incoming req@ffff9dc05eddf480 x1870854436377472 msgsize 440 00000100:00100000:1.0:1784189367.718508:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1784189367.718592:0:24833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436377472 00000100:00100000:2.0:1784189367.718602:0:24833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436377472 00000020:00000040:2.0:1784189367.718605:0:24833:0:(genops.c:825:class_conn2export()) looking for export cookie 0xcc1762b626f8d56b 00000020:00000040:2.0:1784189367.718610:0:24833:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9dbf4512b000 refcount=20 00000100:00000040:2.0:1784189367.718643:0:24833:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_io at +6s 00000100:00100000:2.0:1784189367.718743:0:24833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1063 00000100:00000040:2.0:1784189367.718748:0:24833:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9dbf4512b000 : new rpc_count 1 00000100:00000040:2.0:1784189367.718755:0:24833:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9dc05eddf480 x1870854436377472/t0(4294968993) o10->debedd94-805c-42a0-a5e5-41758b2012e9@192.168.203.12@tcp:558/0 lens 440/0 e 0 to 0 dl 1784189378 ref 1 fl New:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1784189367.718769:0:24833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc05eddf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:debedd94-805c-42a0-a5e5-41758b2012e9+20:2395:x1870854436377472:12345-192.168.203.12@tcp:10:dd.0 00000020:00000040:2.0:1784189367.718781:0:24833:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff9dc05eddf480 x1870854436377472/t0(4294968993) o10->debedd94-805c-42a0-a5e5-41758b2012e9@192.168.203.12@tcp:558/0 lens 440/0 e 0 to 0 dl 1784189378 ref 1 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:2.0:1784189367.718807:0:24833:0:(ldlm_lib.c:3228:target_queue_recovery_request()) Next recovery transno: 4294968993, current: 4294968993, replaying 00010000:00000040:2.0:1784189367.718810:0:24833:0:(ldlm_lib.c:1774:target_request_copy_get()) RPC GETting export ffff9dbf4512b000 : new rpc_count 2 00000100:00000040:2.0:1784189367.718830:0:24833:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9dc05eddf480 x1870854436377472/t0(4294968993) o10->debedd94-805c-42a0-a5e5-41758b2012e9@192.168.203.12@tcp:558/0 lens 440/0 e 0 to 0 dl 1784189378 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1784189367.718839:0:24833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc05eddf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:debedd94-805c-42a0-a5e5-41758b2012e9+20:2395:x1870854436377472:12345-192.168.203.12@tcp:10:dd.0 Request processed in 73us (346us total) trans 0 rc 0/-999 00000100:00100000:2.0:1784189367.718846:0:24833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1063 00000100:00000040:2.0:1784189367.718849:0:24833:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9dbf4512b000 : new rpc_count 1 00010000:00080000:1.0:1784189367.718892:0:96896:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 4294968993, next_transno: 4294968993 00010000:00080000:1.0:1784189367.718896:0:96896:0:(ldlm_lib.c:2246:check_for_next_transno()) waking for next (4294968993) 00010000:00080000:1.0:1784189367.718905:0:96896:0:(ldlm_lib.c:2747:replay_request_or_update()) @@@ processing x1870854436377472 t4294968993 from 192.168.203.12@tcp req@ffff9dc05eddf480 x1870854436377472/t0(4294968993) o10->debedd94-805c-42a0-a5e5-41758b2012e9@192.168.203.12@tcp:558/0 lens 440/0 e 0 to 0 dl 1784189378 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:1.0:1784189367.718922:0:96896:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff9dc05eddf480 x1870854436377472/t0(4294968993) o10->debedd94-805c-42a0-a5e5-41758b2012e9@192.168.203.12@tcp:558/0 lens 440/0 e 0 to 0 dl 1784189378 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00000040:1.0:1784189367.718954:0:96896:0:(ofd_dev.c:430:ofd_object_init()) object init, fid = [0x280000401:0x771:0x0] 00000001:00000040:1.0:1784189367.719143:0:96896:0:(tgt_lastrcvd.c:1006:tgt_last_commit_cb_add()) callback GETting export ffff9dbf4512b000 : new cb_count 16 00000020:00000040:1.0:1784189367.719148:0:96896:0:(genops.c:889:class_export_get()) GET export ffff9dbf4512b000 refcount=21 00010000:00000040:1.0:1784189367.719181:0:96896:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 4294968977, transno 4294968993, xid 1870854436377472 00000100:00000040:1.0:1784189367.719192:0:96896:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9dbf4274f140 refcount 11 to 192.168.203.12@tcp 00000100:00000040:1.0:1784189367.719198:0:96896:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.203.12@tcp 00000100:00000040:1.0:1784189367.719244:0:96896:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff9dbf4274f140 refcount 10 to 192.168.203.12@tcp 00010000:00080000:1.0:1784189367.719253:0:96896:0:(ldlm_lib.c:2100:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00000040:1.0:1784189367.719258:0:96896:0:(ldlm_lib.c:1790:target_request_copy_put()) RPC PUTting export ffff9dbf4512b000 : new rpc_count 0 00000020:00000040:1.0:1784189367.719266:0:96896:0:(genops.c:900:class_export_put()) PUTting export ffff9dbf4512b000 : new refcount 20 00010000:00080000:1.0:1784189367.719277:0:96896:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294968994 00010000:00080000:1.0:1784189367.719281:0:96896:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294968994 00000100:00000040:3.0:1784189367.722009:0:3634:0:(events.c:337:request_in_callback()) incoming req@ffff9dbf469b5180 x1870854436378496 msgsize 440 00000100:00100000:3.0:1784189367.722025:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1784189367.722181:0:24846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436378496 00000100:00100000:1.0:1784189367.722191:0:24846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436378496 00000020:00000040:1.0:1784189367.722195:0:24846:0:(genops.c:825:class_conn2export()) looking for export cookie 0xcc1762b626f8d56b 00000020:00000040:1.0:1784189367.722201:0:24846:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9dbf4512b000 refcount=21 00000100:00000040:1.0:1784189367.722226:0:24846:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_io at +6s 00000100:00100000:1.0:1784189367.722269:0:24846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1064 00000100:00000040:1.0:1784189367.722273:0:24846:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9dbf4512b000 : new rpc_count 1 00000100:00000040:1.0:1784189367.722281:0:24846:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9dbf469b5180 x1870854436378496/t0(4294968994) o10->debedd94-805c-42a0-a5e5-41758b2012e9@192.168.203.12@tcp:558/0 lens 440/0 e 0 to 0 dl 1784189378 ref 1 fl New:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1784189367.722295:0:24846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf469b5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:debedd94-805c-42a0-a5e5-41758b2012e9+21:2395:x1870854436378496:12345-192.168.203.12@tcp:10:dd.0 00000020:00000040:1.0:1784189367.722306:0:24846:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff9dbf469b5180 x1870854436378496/t0(4294968994) o10->debedd94-805c-42a0-a5e5-41758b2012e9@192.168.203.12@tcp:558/0 lens 440/0 e 0 to 0 dl 1784189378 ref 1 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:1.0:1784189367.722315:0:24846:0:(ldlm_lib.c:3228:target_queue_recovery_request()) Next recovery transno: 4294968994, current: 4294968994, replaying 00010000:00000040:1.0:1784189367.722340:0:24846:0:(ldlm_lib.c:1774:target_request_copy_get()) RPC GETting export ffff9dbf4512b000 : new rpc_count 2 00000100:00000040:1.0:1784189367.722362:0:24846:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9dbf469b5180 x1870854436378496/t0(4294968994) o10->debedd94-805c-42a0-a5e5-41758b2012e9@192.168.203.12@tcp:558/0 lens 440/0 e 0 to 0 dl 1784189378 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1784189367.722371:0:24846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf469b5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:debedd94-805c-42a0-a5e5-41758b2012e9+21:2395:x1870854436378496:12345-192.168.203.12@tcp:10:dd.0 Request processed in 79us (363us total) trans 0 rc 0/-999 00000100:00100000:1.0:1784189367.722378:0:24846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1064 00000100:00000040:1.0:1784189367.722381:0:24846:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9dbf4512b000 : new rpc_count 1 00010000:00080000:0.0:1784189367.722453:0:96896:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 4294968994, next_transno: 4294968994 00010000:00080000:0.0:1784189367.722457:0:96896:0:(ldlm_lib.c:2246:check_for_next_transno()) waking for next (4294968994) 00010000:00080000:0.0:1784189367.722465:0:96896:0:(ldlm_lib.c:2747:replay_request_or_update()) @@@ processing x1870854436378496 t4294968994 from 192.168.203.12@tcp req@ffff9dbf469b5180 x1870854436378496/t0(4294968994) o10->debedd94-805c-42a0-a5e5-41758b2012e9@192.168.203.12@tcp:558/0 lens 440/0 e 0 to 0 dl 1784189378 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:0.0:1784189367.722482:0:96896:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff9dbf469b5180 x1870854436378496/t0(4294968994) o10->debedd94-805c-42a0-a5e5-41758b2012e9@192.168.203.12@tcp:558/0 lens 440/0 e 0 to 0 dl 1784189378 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00000040:0.0:1784189367.722512:0:96896:0:(ofd_dev.c:430:ofd_object_init()) object init, fid = [0x280000401:0x770:0x0] 00000001:00000040:0.0:1784189367.722691:0:96896:0:(tgt_lastrcvd.c:1006:tgt_last_commit_cb_add()) callback GETting export ffff9dbf4512b000 : new cb_count 17 00000020:00000040:0.0:1784189367.722695:0:96896:0:(genops.c:889:class_export_get()) GET export ffff9dbf4512b000 refcount=22 00010000:00000040:0.0:1784189367.722856:0:96896:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 4294968977, transno 4294968994, xid 1870854436378496 00000100:00000040:0.0:1784189367.722867:0:96896:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9dbf4274f140 refcount 11 to 192.168.203.12@tcp 00000100:00000040:0.0:1784189367.722872:0:96896:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.203.12@tcp 00000100:00000040:0.0:1784189367.722919:0:96896:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff9dbf4274f140 refcount 10 to 192.168.203.12@tcp 00010000:00080000:0.0:1784189367.722929:0:96896:0:(ldlm_lib.c:2100:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00000040:0.0:1784189367.722934:0:96896:0:(ldlm_lib.c:1790:target_request_copy_put()) RPC PUTting export ffff9dbf4512b000 : new rpc_count 0 00000020:00000040:0.0:1784189367.722944:0:96896:0:(genops.c:900:class_export_put()) PUTting export ffff9dbf4512b000 : new refcount 21 00010000:00080000:0.0:1784189367.722948:0:96896:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294968995 00010000:00080000:0.0:1784189367.722952:0:96896:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294968995 00000100:00000040:0.0:1784189367.725891:0:3635:0:(events.c:337:request_in_callback()) incoming req@ffff9dc05edd2a00 x1870854436379520 msgsize 440 00000100:00100000:0.0:1784189367.725905:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1784189367.726017:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436379520 00000100:00100000:1.0:1784189367.726034:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436379520 00000020:00000040:1.0:1784189367.726037:0:8433:0:(genops.c:825:class_conn2export()) looking for export cookie 0xcc1762b626f8d56b 00000020:00000040:1.0:1784189367.726042:0:8433:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9dbf4512b000 refcount=22 00000100:00000040:1.0:1784189367.726063:0:8433:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_io at +6s 00000100:00100000:1.0:1784189367.726114:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1065 00000100:00000040:1.0:1784189367.726118:0:8433:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9dbf4512b000 : new rpc_count 1 00000100:00000040:1.0:1784189367.726125:0:8433:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9dc05edd2a00 x1870854436379520/t0(4294968995) o10->debedd94-805c-42a0-a5e5-41758b2012e9@192.168.203.12@tcp:558/0 lens 440/0 e 0 to 0 dl 1784189378 ref 1 fl New:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1784189367.726137:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc05edd2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:debedd94-805c-42a0-a5e5-41758b2012e9+22:2395:x1870854436379520:12345-192.168.203.12@tcp:10:dd.0 00000020:00000040:1.0:1784189367.726147:0:8433:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff9dc05edd2a00 x1870854436379520/t0(4294968995) o10->debedd94-805c-42a0-a5e5-41758b2012e9@192.168.203.12@tcp:558/0 lens 440/0 e 0 to 0 dl 1784189378 ref 1 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:1.0:1784189367.726156:0:8433:0:(ldlm_lib.c:3228:target_queue_recovery_request()) Next recovery transno: 4294968995, current: 4294968995, replaying 00010000:00000040:1.0:1784189367.726159:0:8433:0:(ldlm_lib.c:1774:target_request_copy_get()) RPC GETting export ffff9dbf4512b000 : new rpc_count 2 00000100:00000040:1.0:1784189367.726172:0:8433:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9dc05edd2a00 x1870854436379520/t0(4294968995) o10->debedd94-805c-42a0-a5e5-41758b2012e9@192.168.203.12@tcp:558/0 lens 440/0 e 0 to 0 dl 1784189378 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1784189367.726181:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc05edd2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:debedd94-805c-42a0-a5e5-41758b2012e9+22:2395:x1870854436379520:12345-192.168.203.12@tcp:10:dd.0 Request processed in 45us (290us total) trans 0 rc 0/-999 00000100:00100000:1.0:1784189367.726187:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1065 00000100:00000040:1.0:1784189367.726190:0:8433:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9dbf4512b000 : new rpc_count 1 00010000:00080000:0.0:1784189367.726294:0:96896:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 4294968995, next_transno: 4294968995 00010000:00080000:0.0:1784189367.726298:0:96896:0:(ldlm_lib.c:2246:check_for_next_transno()) waking for next (4294968995) 00010000:00080000:0.0:1784189367.726305:0:96896:0:(ldlm_lib.c:2747:replay_request_or_update()) @@@ processing x1870854436379520 t4294968995 from 192.168.203.12@tcp req@ffff9dc05edd2a00 x1870854436379520/t0(4294968995) o10->debedd94-805c-42a0-a5e5-41758b2012e9@192.168.203.12@tcp:558/0 lens 440/0 e 0 to 0 dl 1784189378 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:0.0:1784189367.726366:0:96896:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff9dc05edd2a00 x1870854436379520/t0(4294968995) o10->debedd94-805c-42a0-a5e5-41758b2012e9@192.168.203.12@tcp:558/0 lens 440/0 e 0 to 0 dl 1784189378 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00000040:0.0:1784189367.726392:0:96896:0:(ofd_dev.c:430:ofd_object_init()) object init, fid = [0x280000401:0x772:0x0] 00000001:00000040:0.0:1784189367.726534:0:96896:0:(tgt_lastrcvd.c:1006:tgt_last_commit_cb_add()) callback GETting export ffff9dbf4512b000 : new cb_count 18 00000020:00000040:0.0:1784189367.726537:0:96896:0:(genops.c:889:class_export_get()) GET export ffff9dbf4512b000 refcount=23 00010000:00000040:0.0:1784189367.726566:0:96896:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 4294968977, transno 4294968995, xid 1870854436379520 00000100:00000040:0.0:1784189367.726575:0:96896:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9dbf4274f140 refcount 11 to 192.168.203.12@tcp 00000100:00000040:0.0:1784189367.726580:0:96896:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.203.12@tcp 00000100:00000040:0.0:1784189367.726630:0:96896:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff9dbf4274f140 refcount 10 to 192.168.203.12@tcp 00010000:00080000:0.0:1784189367.726637:0:96896:0:(ldlm_lib.c:2100:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00000040:0.0:1784189367.726642:0:96896:0:(ldlm_lib.c:1790:target_request_copy_put()) RPC PUTting export ffff9dbf4512b000 : new rpc_count 0 00000020:00000040:0.0:1784189367.726651:0:96896:0:(genops.c:900:class_export_put()) PUTting export ffff9dbf4512b000 : new refcount 22 00010000:00080000:0.0:1784189367.726655:0:96896:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294968996 00010000:00080000:0.0:1784189367.726658:0:96896:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294968996 00000100:00000040:1.0:1784189367.729598:0:3633:0:(events.c:337:request_in_callback()) incoming req@ffff9dc05ed3bb80 x1870854436379648 msgsize 440 00000100:00100000:1.0:1784189367.729625:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1784189367.729722:0:24844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436379648 00000100:00100000:0.0:1784189367.729739:0:24844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436379648 00000020:00000040:0.0:1784189367.729742:0:24844:0:(genops.c:825:class_conn2export()) looking for export cookie 0xcc1762b626f8d56b 00000020:00000040:0.0:1784189367.729748:0:24844:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9dbf4512b000 refcount=23 00000100:00000040:0.0:1784189367.729771:0:24844:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_io at +6s 00000100:00100000:0.0:1784189367.729819:0:24844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1066 00000100:00000040:0.0:1784189367.729824:0:24844:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9dbf4512b000 : new rpc_count 1 00000100:00000040:0.0:1784189367.729831:0:24844:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9dc05ed3bb80 x1870854436379648/t0(4294968996) o10->debedd94-805c-42a0-a5e5-41758b2012e9@192.168.203.12@tcp:558/0 lens 440/0 e 0 to 0 dl 1784189378 ref 1 fl New:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1784189367.729845:0:24844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc05ed3bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:debedd94-805c-42a0-a5e5-41758b2012e9+23:2395:x1870854436379648:12345-192.168.203.12@tcp:10:dd.0 00000020:00000040:0.0:1784189367.729857:0:24844:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff9dc05ed3bb80 x1870854436379648/t0(4294968996) o10->debedd94-805c-42a0-a5e5-41758b2012e9@192.168.203.12@tcp:558/0 lens 440/0 e 0 to 0 dl 1784189378 ref 1 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:0.0:1784189367.729884:0:24844:0:(ldlm_lib.c:3228:target_queue_recovery_request()) Next recovery transno: 4294968996, current: 4294968996, replaying 00010000:00000040:0.0:1784189367.729888:0:24844:0:(ldlm_lib.c:1774:target_request_copy_get()) RPC GETting export ffff9dbf4512b000 : new rpc_count 2 00000100:00000040:0.0:1784189367.729908:0:24844:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9dc05ed3bb80 x1870854436379648/t0(4294968996) o10->debedd94-805c-42a0-a5e5-41758b2012e9@192.168.203.12@tcp:558/0 lens 440/0 e 0 to 0 dl 1784189378 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1784189367.729918:0:24844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc05ed3bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:debedd94-805c-42a0-a5e5-41758b2012e9+23:2395:x1870854436379648:12345-192.168.203.12@tcp:10:dd.0 Request processed in 76us (321us total) trans 0 rc 0/-999 00000100:00100000:0.0:1784189367.729926:0:24844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1066 00000100:00000040:0.0:1784189367.729929:0:24844:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9dbf4512b000 : new rpc_count 1 00010000:00080000:1.0:1784189367.729990:0:96896:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 4294968996, next_transno: 4294968996 00010000:00080000:1.0:1784189367.729995:0:96896:0:(ldlm_lib.c:2246:check_for_next_transno()) waking for next (4294968996) 00010000:00080000:1.0:1784189367.730003:0:96896:0:(ldlm_lib.c:2747:replay_request_or_update()) @@@ processing x1870854436379648 t4294968996 from 192.168.203.12@tcp req@ffff9dc05ed3bb80 x1870854436379648/t0(4294968996) o10->debedd94-805c-42a0-a5e5-41758b2012e9@192.168.203.12@tcp:558/0 lens 440/0 e 0 to 0 dl 1784189378 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:1.0:1784189367.730020:0:96896:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff9dc05ed3bb80 x1870854436379648/t0(4294968996) o10->debedd94-805c-42a0-a5e5-41758b2012e9@192.168.203.12@tcp:558/0 lens 440/0 e 0 to 0 dl 1784189378 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00000040:1.0:1784189367.730062:0:96896:0:(ofd_dev.c:430:ofd_object_init()) object init, fid = [0x280000401:0x773:0x0] 00000001:00000040:1.0:1784189367.730224:0:96896:0:(tgt_lastrcvd.c:1006:tgt_last_commit_cb_add()) callback GETting export ffff9dbf4512b000 : new cb_count 19 00000020:00000040:1.0:1784189367.730233:0:96896:0:(genops.c:889:class_export_get()) GET export ffff9dbf4512b000 refcount=24 00010000:00000040:1.0:1784189367.730269:0:96896:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 4294968977, transno 4294968996, xid 1870854436379648 00000100:00000040:1.0:1784189367.730279:0:96896:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9dbf4274f140 refcount 11 to 192.168.203.12@tcp 00000100:00000040:1.0:1784189367.730284:0:96896:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.203.12@tcp 00000100:00000040:1.0:1784189367.730365:0:96896:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff9dbf4274f140 refcount 10 to 192.168.203.12@tcp 00010000:00080000:1.0:1784189367.730373:0:96896:0:(ldlm_lib.c:2100:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00000040:1.0:1784189367.730379:0:96896:0:(ldlm_lib.c:1790:target_request_copy_put()) RPC PUTting export ffff9dbf4512b000 : new rpc_count 0 00000020:00000040:1.0:1784189367.730387:0:96896:0:(genops.c:900:class_export_put()) PUTting export ffff9dbf4512b000 : new refcount 23 00010000:00080000:1.0:1784189367.730390:0:96896:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294968997 00010000:00080000:1.0:1784189367.730394:0:96896:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294968997 00000100:00000040:3.0:1784189367.733176:0:3634:0:(events.c:337:request_in_callback()) incoming req@ffff9dbf469b4700 x1870854436380672 msgsize 440 00000100:00100000:3.0:1784189367.733191:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1784189367.733347:0:24834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436380672 00000100:00100000:0.0:1784189367.733356:0:24834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436380672 00000020:00000040:0.0:1784189367.733359:0:24834:0:(genops.c:825:class_conn2export()) looking for export cookie 0xcc1762b626f8d56b 00000020:00000040:0.0:1784189367.733364:0:24834:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9dbf4512b000 refcount=24 00000100:00000040:0.0:1784189367.733387:0:24834:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_io at +6s 00000100:00100000:0.0:1784189367.733433:0:24834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1067 00000100:00000040:0.0:1784189367.733437:0:24834:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9dbf4512b000 : new rpc_count 1 00000100:00000040:0.0:1784189367.733444:0:24834:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9dbf469b4700 x1870854436380672/t0(4294968997) o10->debedd94-805c-42a0-a5e5-41758b2012e9@192.168.203.12@tcp:558/0 lens 440/0 e 0 to 0 dl 1784189378 ref 1 fl New:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1784189367.733457:0:24834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf469b4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:debedd94-805c-42a0-a5e5-41758b2012e9+24:2395:x1870854436380672:12345-192.168.203.12@tcp:10:dd.0 00000020:00000040:0.0:1784189367.733468:0:24834:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff9dbf469b4700 x1870854436380672/t0(4294968997) o10->debedd94-805c-42a0-a5e5-41758b2012e9@192.168.203.12@tcp:558/0 lens 440/0 e 0 to 0 dl 1784189378 ref 1 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:0.0:1784189367.733477:0:24834:0:(ldlm_lib.c:3228:target_queue_recovery_request()) Next recovery transno: 4294968997, current: 4294968997, replaying 00010000:00000040:0.0:1784189367.733480:0:24834:0:(ldlm_lib.c:1774:target_request_copy_get()) RPC GETting export ffff9dbf4512b000 : new rpc_count 2 00000100:00000040:0.0:1784189367.733499:0:24834:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9dbf469b4700 x1870854436380672/t0(4294968997) o10->debedd94-805c-42a0-a5e5-41758b2012e9@192.168.203.12@tcp:558/0 lens 440/0 e 0 to 0 dl 1784189378 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1784189367.733509:0:24834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf469b4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:debedd94-805c-42a0-a5e5-41758b2012e9+24:2395:x1870854436380672:12345-192.168.203.12@tcp:10:dd.0 Request processed in 54us (333us total) trans 0 rc 0/-999 00000100:00100000:0.0:1784189367.733525:0:24834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1067 00000100:00000040:0.0:1784189367.733528:0:24834:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9dbf4512b000 : new rpc_count 1 00010000:00080000:1.0:1784189367.733596:0:96896:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 4294968997, next_transno: 4294968997 00010000:00080000:1.0:1784189367.733600:0:96896:0:(ldlm_lib.c:2246:check_for_next_transno()) waking for next (4294968997) 00010000:00080000:1.0:1784189367.733609:0:96896:0:(ldlm_lib.c:2747:replay_request_or_update()) @@@ processing x1870854436380672 t4294968997 from 192.168.203.12@tcp req@ffff9dbf469b4700 x1870854436380672/t0(4294968997) o10->debedd94-805c-42a0-a5e5-41758b2012e9@192.168.203.12@tcp:558/0 lens 440/0 e 0 to 0 dl 1784189378 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:1.0:1784189367.733636:0:96896:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff9dbf469b4700 x1870854436380672/t0(4294968997) o10->debedd94-805c-42a0-a5e5-41758b2012e9@192.168.203.12@tcp:558/0 lens 440/0 e 0 to 0 dl 1784189378 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00000040:1.0:1784189367.733665:0:96896:0:(ofd_dev.c:430:ofd_object_init()) object init, fid = [0x280000401:0x774:0x0] 00000001:00000040:1.0:1784189367.733838:0:96896:0:(tgt_lastrcvd.c:1006:tgt_last_commit_cb_add()) callback GETting export ffff9dbf4512b000 : new cb_count 20 00000020:00000040:1.0:1784189367.733842:0:96896:0:(genops.c:889:class_export_get()) GET export ffff9dbf4512b000 refcount=25 00010000:00000040:1.0:1784189367.733874:0:96896:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 4294968977, transno 4294968997, xid 1870854436380672 00000100:00000040:1.0:1784189367.733882:0:96896:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9dbf4274f140 refcount 11 to 192.168.203.12@tcp 00000100:00000040:1.0:1784189367.733888:0:96896:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.203.12@tcp 00000100:00000040:1.0:1784189367.733933:0:96896:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff9dbf4274f140 refcount 10 to 192.168.203.12@tcp 00010000:00080000:1.0:1784189367.733942:0:96896:0:(ldlm_lib.c:2100:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00000040:1.0:1784189367.733947:0:96896:0:(ldlm_lib.c:1790:target_request_copy_put()) RPC PUTting export ffff9dbf4512b000 : new rpc_count 0 00000020:00000040:1.0:1784189367.733955:0:96896:0:(genops.c:900:class_export_put()) PUTting export ffff9dbf4512b000 : new refcount 24 00010000:00080000:1.0:1784189367.733960:0:96896:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294968998 00010000:00080000:1.0:1784189367.733963:0:96896:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294968998 00000100:00000040:0.0:1784189367.737542:0:3635:0:(events.c:337:request_in_callback()) incoming req@ffff9dc05edd2300 x1870854436381056 msgsize 1512 00000100:00100000:0.0:1784189367.737558:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1784189367.737650:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436381056 00000100:00100000:3.0:1784189367.737660:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436381056 00000020:00000040:3.0:1784189367.737663:0:8435:0:(genops.c:825:class_conn2export()) looking for export cookie 0xcc1762b626f8d56b 00000020:00000040:3.0:1784189367.737667:0:8435:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9dbf4512b000 refcount=25 00000100:00000040:3.0:1784189367.737692:0:8435:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_io at +6s 00000100:00100000:3.0:1784189367.737753:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1068 00000100:00000040:3.0:1784189367.737757:0:8435:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9dbf4512b000 : new rpc_count 1 00000100:00000040:3.0:1784189367.737764:0:8435:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9dc05edd2300 x1870854436381056/t0(4294968998) o4->debedd94-805c-42a0-a5e5-41758b2012e9@192.168.203.12@tcp:558/0 lens 1512/0 e 0 to 0 dl 1784189378 ref 1 fl New:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1784189367.737777:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc05edd2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:debedd94-805c-42a0-a5e5-41758b2012e9+25:2395:x1870854436381056:12345-192.168.203.12@tcp:4:dd.0 00000020:00000040:3.0:1784189367.737787:0:8435:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff9dc05edd2300 x1870854436381056/t0(4294968998) o4->debedd94-805c-42a0-a5e5-41758b2012e9@192.168.203.12@tcp:558/0 lens 1512/0 e 0 to 0 dl 1784189378 ref 1 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:3.0:1784189367.737797:0:8435:0:(ldlm_lib.c:3228:target_queue_recovery_request()) Next recovery transno: 4294968998, current: 4294968998, replaying 00010000:00000040:3.0:1784189367.737800:0:8435:0:(ldlm_lib.c:1774:target_request_copy_get()) RPC GETting export ffff9dbf4512b000 : new rpc_count 2 00000100:00000040:3.0:1784189367.737817:0:8435:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9dc05edd2300 x1870854436381056/t0(4294968998) o4->debedd94-805c-42a0-a5e5-41758b2012e9@192.168.203.12@tcp:558/0 lens 1512/0 e 0 to 0 dl 1784189378 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1784189367.737838:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc05edd2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:debedd94-805c-42a0-a5e5-41758b2012e9+25:2395:x1870854436381056:12345-192.168.203.12@tcp:4:dd.0 Request processed in 63us (296us total) trans 0 rc 0/-999 00000100:00100000:3.0:1784189367.737845:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1068 00000100:00000040:3.0:1784189367.737848:0:8435:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9dbf4512b000 : new rpc_count 1 00010000:00080000:1.0:1784189367.738003:0:96896:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 4294968998, next_transno: 4294968998 00010000:00080000:1.0:1784189367.738008:0:96896:0:(ldlm_lib.c:2246:check_for_next_transno()) waking for next (4294968998) 00010000:00080000:1.0:1784189367.738016:0:96896:0:(ldlm_lib.c:2747:replay_request_or_update()) @@@ processing x1870854436381056 t4294968998 from 192.168.203.12@tcp req@ffff9dc05edd2300 x1870854436381056/t0(4294968998) o4->debedd94-805c-42a0-a5e5-41758b2012e9@192.168.203.12@tcp:558/0 lens 1512/0 e 0 to 0 dl 1784189378 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:1.0:1784189367.738098:0:96896:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff9dc05edd2300 x1870854436381056/t0(4294968998) o4->debedd94-805c-42a0-a5e5-41758b2012e9@192.168.203.12@tcp:558/0 lens 1512/0 e 0 to 0 dl 1784189378 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00000040:1.0:1784189367.738139:0:96896:0:(ofd_dev.c:430:ofd_object_init()) object init, fid = [0x280000401:0x0:0x0] 00002000:00080000:1.0:1784189367.738266:0:96896:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000401 00000020:00000040:1.0:1784189367.738370:0:96896:0:(tgt_handler.c:2891:tgt_brw_write()) Client use short io for data transfer, size = 1024 00000001:00000040:1.0:1784189367.738397:0:96896:0:(lnet-crypto.c:95:cfs_crypto_hash_alloc()) Using crypto hash: crc32c (crc32c-intel) speed 3390 MB/s 00000020:00000040:1.0:1784189367.738401:0:96896:0:(tgt_handler.c:1914:tgt_checksum_niobuf()) Checksum for algo crc32c 00000001:00000040:1.0:1784189367.738656:0:96896:0:(tgt_lastrcvd.c:1006:tgt_last_commit_cb_add()) callback GETting export ffff9dbf4512b000 : new cb_count 21 00000020:00000040:1.0:1784189367.738661:0:96896:0:(genops.c:889:class_export_get()) GET export ffff9dbf4512b000 refcount=26 00010000:00000040:1.0:1784189367.739180:0:96896:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 4294968977, transno 4294968998, xid 1870854436381056 00000100:00000040:1.0:1784189367.739192:0:96896:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9dbf4274f140 refcount 11 to 192.168.203.12@tcp 00000100:00000040:1.0:1784189367.739199:0:96896:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.203.12@tcp 00000100:00000040:1.0:1784189367.739243:0:96896:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff9dbf4274f140 refcount 10 to 192.168.203.12@tcp 00010000:00080000:1.0:1784189367.739252:0:96896:0:(ldlm_lib.c:2100:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00000040:1.0:1784189367.739259:0:96896:0:(ldlm_lib.c:1790:target_request_copy_put()) RPC PUTting export ffff9dbf4512b000 : new rpc_count 0 00000020:00000040:1.0:1784189367.739268:0:96896:0:(genops.c:900:class_export_put()) PUTting export ffff9dbf4512b000 : new refcount 25 00010000:00080000:1.0:1784189367.739272:0:96896:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294968999 00010000:00080000:1.0:1784189367.739276:0:96896:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294968999 00000100:00000040:0.0:1784189367.742420:0:3633:0:(events.c:337:request_in_callback()) incoming req@ffff9dc080e7e300 x1870854436381312 msgsize 1512 00000100:00100000:0.0:1784189367.742435:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1784189367.742520:0:24846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436381312 00000100:00100000:2.0:1784189367.742530:0:24846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436381312 00000020:00000040:2.0:1784189367.742534:0:24846:0:(genops.c:825:class_conn2export()) looking for export cookie 0xcc1762b626f8d56b 00000020:00000040:2.0:1784189367.742538:0:24846:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9dbf4512b000 refcount=26 00000100:00000040:2.0:1784189367.742559:0:24846:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_io at +6s 00000100:00100000:2.0:1784189367.742600:0:24846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1069 00000100:00000040:2.0:1784189367.742604:0:24846:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9dbf4512b000 : new rpc_count 1 00000100:00000040:2.0:1784189367.742620:0:24846:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9dc080e7e300 x1870854436381312/t0(4294968999) o4->debedd94-805c-42a0-a5e5-41758b2012e9@192.168.203.12@tcp:558/0 lens 1512/0 e 0 to 0 dl 1784189378 ref 1 fl New:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1784189367.742635:0:24846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc080e7e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:debedd94-805c-42a0-a5e5-41758b2012e9+26:2395:x1870854436381312:12345-192.168.203.12@tcp:4:dd.0 00000020:00000040:2.0:1784189367.742646:0:24846:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff9dc080e7e300 x1870854436381312/t0(4294968999) o4->debedd94-805c-42a0-a5e5-41758b2012e9@192.168.203.12@tcp:558/0 lens 1512/0 e 0 to 0 dl 1784189378 ref 1 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:2.0:1784189367.742655:0:24846:0:(ldlm_lib.c:3228:target_queue_recovery_request()) Next recovery transno: 4294968999, current: 4294968999, replaying 00010000:00000040:2.0:1784189367.742658:0:24846:0:(ldlm_lib.c:1774:target_request_copy_get()) RPC GETting export ffff9dbf4512b000 : new rpc_count 2 00000100:00000040:2.0:1784189367.742676:0:24846:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9dc080e7e300 x1870854436381312/t0(4294968999) o4->debedd94-805c-42a0-a5e5-41758b2012e9@192.168.203.12@tcp:558/0 lens 1512/0 e 0 to 0 dl 1784189378 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1784189367.742684:0:24846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc080e7e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:debedd94-805c-42a0-a5e5-41758b2012e9+26:2395:x1870854436381312:12345-192.168.203.12@tcp:4:dd.0 Request processed in 53us (265us total) trans 0 rc 0/-999 00000100:00100000:2.0:1784189367.742704:0:24846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1069 00000100:00000040:2.0:1784189367.742707:0:24846:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9dbf4512b000 : new rpc_count 1 00010000:00080000:0.0:1784189367.742799:0:96896:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 4294968999, next_transno: 4294968999 00010000:00080000:0.0:1784189367.742803:0:96896:0:(ldlm_lib.c:2246:check_for_next_transno()) waking for next (4294968999) 00010000:00080000:0.0:1784189367.742811:0:96896:0:(ldlm_lib.c:2747:replay_request_or_update()) @@@ processing x1870854436381312 t4294968999 from 192.168.203.12@tcp req@ffff9dc080e7e300 x1870854436381312/t0(4294968999) o4->debedd94-805c-42a0-a5e5-41758b2012e9@192.168.203.12@tcp:558/0 lens 1512/0 e 0 to 0 dl 1784189378 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:0.0:1784189367.742826:0:96896:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff9dc080e7e300 x1870854436381312/t0(4294968999) o4->debedd94-805c-42a0-a5e5-41758b2012e9@192.168.203.12@tcp:558/0 lens 1512/0 e 0 to 0 dl 1784189378 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:0.0:1784189367.742919:0:96896:0:(tgt_handler.c:2891:tgt_brw_write()) Client use short io for data transfer, size = 1024 00000001:00000040:0.0:1784189367.742943:0:96896:0:(lnet-crypto.c:95:cfs_crypto_hash_alloc()) Using crypto hash: crc32c (crc32c-intel) speed 3390 MB/s 00000020:00000040:0.0:1784189367.742945:0:96896:0:(tgt_handler.c:1914:tgt_checksum_niobuf()) Checksum for algo crc32c 00000020:00000040:0.0:1784189367.742957:0:96896:0:(tgt_handler.c:2952:tgt_brw_write()) Checksum 1024 from 12345-192.168.203.12@tcp OK: b9e19e76 00000001:00000040:0.0:1784189367.743183:0:96896:0:(tgt_lastrcvd.c:1006:tgt_last_commit_cb_add()) callback GETting export ffff9dbf4512b000 : new cb_count 22 00000020:00000040:0.0:1784189367.743187:0:96896:0:(genops.c:889:class_export_get()) GET export ffff9dbf4512b000 refcount=27 00010000:00000040:0.0:1784189367.744471:0:96896:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 4294968977, transno 4294968999, xid 1870854436381312 00000100:00000040:0.0:1784189367.744486:0:96896:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9dbf4274f140 refcount 11 to 192.168.203.12@tcp 00000100:00000040:0.0:1784189367.744495:0:96896:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.203.12@tcp 00000100:00000040:0.0:1784189367.744539:0:96896:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff9dbf4274f140 refcount 10 to 192.168.203.12@tcp 00010000:00080000:0.0:1784189367.744549:0:96896:0:(ldlm_lib.c:2100:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00000040:0.0:1784189367.744557:0:96896:0:(ldlm_lib.c:1790:target_request_copy_put()) RPC PUTting export ffff9dbf4512b000 : new rpc_count 0 00000020:00000040:0.0:1784189367.744566:0:96896:0:(genops.c:900:class_export_put()) PUTting export ffff9dbf4512b000 : new refcount 26 00010000:00080000:0.0:1784189367.744572:0:96896:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969000 00010000:00080000:0.0:1784189367.744576:0:96896:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969000 00000100:00000040:3.0:1784189367.751181:0:3634:0:(events.c:337:request_in_callback()) incoming req@ffff9dbf469b5500 x1870854436381568 msgsize 1512 00000100:00100000:3.0:1784189367.751194:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1784189367.751304:0:24833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436381568 00000100:00100000:1.0:1784189367.751314:0:24833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436381568 00000020:00000040:1.0:1784189367.751345:0:24833:0:(genops.c:825:class_conn2export()) looking for export cookie 0xcc1762b626f8d56b 00000020:00000040:1.0:1784189367.751351:0:24833:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9dbf4512b000 refcount=27 00000100:00000040:1.0:1784189367.751374:0:24833:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_io at +6s 00000100:00100000:1.0:1784189367.751515:0:24833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1070 00000100:00000040:1.0:1784189367.751521:0:24833:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9dbf4512b000 : new rpc_count 1 00000100:00000040:1.0:1784189367.751535:0:24833:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9dbf469b5500 x1870854436381568/t0(4294969000) o4->debedd94-805c-42a0-a5e5-41758b2012e9@192.168.203.12@tcp:558/0 lens 1512/0 e 0 to 0 dl 1784189378 ref 1 fl New:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1784189367.751549:0:24833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf469b5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:debedd94-805c-42a0-a5e5-41758b2012e9+27:2395:x1870854436381568:12345-192.168.203.12@tcp:4:dd.0 00000020:00000040:1.0:1784189367.751562:0:24833:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff9dbf469b5500 x1870854436381568/t0(4294969000) o4->debedd94-805c-42a0-a5e5-41758b2012e9@192.168.203.12@tcp:558/0 lens 1512/0 e 0 to 0 dl 1784189378 ref 1 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:1.0:1784189367.751572:0:24833:0:(ldlm_lib.c:3228:target_queue_recovery_request()) Next recovery transno: 4294969000, current: 4294969000, replaying 00010000:00000040:1.0:1784189367.751575:0:24833:0:(ldlm_lib.c:1774:target_request_copy_get()) RPC GETting export ffff9dbf4512b000 : new rpc_count 2 00000100:00000040:1.0:1784189367.751591:0:24833:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9dbf469b5500 x1870854436381568/t0(4294969000) o4->debedd94-805c-42a0-a5e5-41758b2012e9@192.168.203.12@tcp:558/0 lens 1512/0 e 0 to 0 dl 1784189378 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1784189367.751599:0:24833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf469b5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:debedd94-805c-42a0-a5e5-41758b2012e9+27:2395:x1870854436381568:12345-192.168.203.12@tcp:4:dd.0 Request processed in 53us (420us total) trans 0 rc 0/-999 00000100:00100000:1.0:1784189367.751607:0:24833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1070 00000100:00000040:1.0:1784189367.751620:0:24833:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9dbf4512b000 : new rpc_count 1 00010000:00080000:0.0:1784189367.751665:0:96896:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 4294969000, next_transno: 4294969000 00010000:00080000:0.0:1784189367.751670:0:96896:0:(ldlm_lib.c:2246:check_for_next_transno()) waking for next (4294969000) 00010000:00080000:0.0:1784189367.751678:0:96896:0:(ldlm_lib.c:2747:replay_request_or_update()) @@@ processing x1870854436381568 t4294969000 from 192.168.203.12@tcp req@ffff9dbf469b5500 x1870854436381568/t0(4294969000) o4->debedd94-805c-42a0-a5e5-41758b2012e9@192.168.203.12@tcp:558/0 lens 1512/0 e 0 to 0 dl 1784189378 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:0.0:1784189367.751693:0:96896:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff9dbf469b5500 x1870854436381568/t0(4294969000) o4->debedd94-805c-42a0-a5e5-41758b2012e9@192.168.203.12@tcp:558/0 lens 1512/0 e 0 to 0 dl 1784189378 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:0.0:1784189367.751778:0:96896:0:(tgt_handler.c:2891:tgt_brw_write()) Client use short io for data transfer, size = 1024 00000001:00000040:0.0:1784189367.751805:0:96896:0:(lnet-crypto.c:95:cfs_crypto_hash_alloc()) Using crypto hash: crc32c (crc32c-intel) speed 3390 MB/s 00000020:00000040:0.0:1784189367.751809:0:96896:0:(tgt_handler.c:1914:tgt_checksum_niobuf()) Checksum for algo crc32c 00000001:00000040:0.0:1784189367.752040:0:96896:0:(tgt_lastrcvd.c:1006:tgt_last_commit_cb_add()) callback GETting export ffff9dbf4512b000 : new cb_count 23 00000020:00000040:0.0:1784189367.752044:0:96896:0:(genops.c:889:class_export_get()) GET export ffff9dbf4512b000 refcount=28 00010000:00000040:2.0:1784189367.754623:0:96896:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 4294968977, transno 4294969000, xid 1870854436381568 00000100:00000040:2.0:1784189367.754641:0:96896:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9dbf4274f140 refcount 11 to 192.168.203.12@tcp 00000100:00000040:2.0:1784189367.754650:0:96896:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.203.12@tcp 00000100:00000040:2.0:1784189367.754737:0:96896:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff9dbf4274f140 refcount 10 to 192.168.203.12@tcp 00010000:00080000:2.0:1784189367.754750:0:96896:0:(ldlm_lib.c:2100:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00000040:2.0:1784189367.754758:0:96896:0:(ldlm_lib.c:1790:target_request_copy_put()) RPC PUTting export ffff9dbf4512b000 : new rpc_count 0 00000020:00000040:2.0:1784189367.754769:0:96896:0:(genops.c:900:class_export_put()) PUTting export ffff9dbf4512b000 : new refcount 27 00010000:00080000:2.0:1784189367.754774:0:96896:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969001 00010000:00080000:2.0:1784189367.754778:0:96896:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969001 00000100:00000040:2.0:1784189367.759061:0:3635:0:(events.c:337:request_in_callback()) incoming req@ffff9dc07130ed80 x1870854436381824 msgsize 1512 00000100:00100000:2.0:1784189367.759076:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1784189367.759737:0:24831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436381824 00000100:00100000:0.0:1784189367.759747:0:24831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436381824 00000020:00000040:0.0:1784189367.759750:0:24831:0:(genops.c:825:class_conn2export()) looking for export cookie 0xcc1762b626f8d56b 00000020:00000040:0.0:1784189367.759755:0:24831:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9dbf4512b000 refcount=28 00000100:00000040:0.0:1784189367.759776:0:24831:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_io at +6s 00000100:00100000:0.0:1784189367.759874:0:24831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1071 00000100:00000040:0.0:1784189367.759879:0:24831:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9dbf4512b000 : new rpc_count 1 00000100:00000040:0.0:1784189367.759887:0:24831:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9dc07130ed80 x1870854436381824/t0(4294969001) o4->debedd94-805c-42a0-a5e5-41758b2012e9@192.168.203.12@tcp:558/0 lens 1512/0 e 0 to 0 dl 1784189378 ref 1 fl New:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1784189367.759902:0:24831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc07130ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:debedd94-805c-42a0-a5e5-41758b2012e9+28:2395:x1870854436381824:12345-192.168.203.12@tcp:4:dd.0 00000020:00000040:0.0:1784189367.759913:0:24831:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff9dc07130ed80 x1870854436381824/t0(4294969001) o4->debedd94-805c-42a0-a5e5-41758b2012e9@192.168.203.12@tcp:558/0 lens 1512/0 e 0 to 0 dl 1784189378 ref 1 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:0.0:1784189367.759922:0:24831:0:(ldlm_lib.c:3228:target_queue_recovery_request()) Next recovery transno: 4294969001, current: 4294969001, replaying 00010000:00000040:0.0:1784189367.759925:0:24831:0:(ldlm_lib.c:1774:target_request_copy_get()) RPC GETting export ffff9dbf4512b000 : new rpc_count 2 00000100:00000040:0.0:1784189367.759947:0:24831:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9dc07130ed80 x1870854436381824/t0(4294969001) o4->debedd94-805c-42a0-a5e5-41758b2012e9@192.168.203.12@tcp:558/0 lens 1512/0 e 0 to 0 dl 1784189378 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1784189367.759969:0:24831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc07130ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:debedd94-805c-42a0-a5e5-41758b2012e9+28:2395:x1870854436381824:12345-192.168.203.12@tcp:4:dd.0 Request processed in 69us (907us total) trans 0 rc 0/-999 00000100:00100000:0.0:1784189367.759976:0:24831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1071 00000100:00000040:0.0:1784189367.759979:0:24831:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9dbf4512b000 : new rpc_count 1 00010000:00080000:1.0:1784189367.760016:0:96896:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 4294969001, next_transno: 4294969001 00010000:00080000:1.0:1784189367.760021:0:96896:0:(ldlm_lib.c:2246:check_for_next_transno()) waking for next (4294969001) 00010000:00080000:1.0:1784189367.760029:0:96896:0:(ldlm_lib.c:2747:replay_request_or_update()) @@@ processing x1870854436381824 t4294969001 from 192.168.203.12@tcp req@ffff9dc07130ed80 x1870854436381824/t0(4294969001) o4->debedd94-805c-42a0-a5e5-41758b2012e9@192.168.203.12@tcp:558/0 lens 1512/0 e 0 to 0 dl 1784189378 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:1.0:1784189367.760046:0:96896:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff9dc07130ed80 x1870854436381824/t0(4294969001) o4->debedd94-805c-42a0-a5e5-41758b2012e9@192.168.203.12@tcp:558/0 lens 1512/0 e 0 to 0 dl 1784189378 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:1.0:1784189367.760132:0:96896:0:(tgt_handler.c:2891:tgt_brw_write()) Client use short io for data transfer, size = 1024 00000001:00000040:1.0:1784189367.760158:0:96896:0:(lnet-crypto.c:95:cfs_crypto_hash_alloc()) Using crypto hash: crc32c (crc32c-intel) speed 3390 MB/s 00000020:00000040:1.0:1784189367.760162:0:96896:0:(tgt_handler.c:1914:tgt_checksum_niobuf()) Checksum for algo crc32c 00000001:00000040:1.0:1784189367.760633:0:96896:0:(tgt_lastrcvd.c:1006:tgt_last_commit_cb_add()) callback GETting export ffff9dbf4512b000 : new cb_count 24 00000020:00000040:1.0:1784189367.760637:0:96896:0:(genops.c:889:class_export_get()) GET export ffff9dbf4512b000 refcount=29 00010000:00000040:1.0:1784189367.765161:0:96896:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 4294968977, transno 4294969001, xid 1870854436381824 00000100:00000040:1.0:1784189367.765187:0:96896:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9dbf4274f140 refcount 11 to 192.168.203.12@tcp 00000100:00000040:1.0:1784189367.765194:0:96896:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.203.12@tcp 00000100:00000040:1.0:1784189367.765248:0:96896:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff9dbf4274f140 refcount 10 to 192.168.203.12@tcp 00010000:00080000:1.0:1784189367.765261:0:96896:0:(ldlm_lib.c:2100:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00000040:1.0:1784189367.765271:0:96896:0:(ldlm_lib.c:1790:target_request_copy_put()) RPC PUTting export ffff9dbf4512b000 : new rpc_count 0 00000020:00000040:1.0:1784189367.765283:0:96896:0:(genops.c:900:class_export_put()) PUTting export ffff9dbf4512b000 : new refcount 28 00010000:00080000:1.0:1784189367.765289:0:96896:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969002 00010000:00080000:1.0:1784189367.765294:0:96896:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969002 00000100:00000040:3.0:1784189367.769996:0:3633:0:(events.c:337:request_in_callback()) incoming req@ffff9dbf469b4e00 x1870854436382080 msgsize 1512 00000100:00100000:3.0:1784189367.770011:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1784189367.770093:0:25599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436382080 00000100:00100000:2.0:1784189367.770104:0:25599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436382080 00000020:00000040:2.0:1784189367.770107:0:25599:0:(genops.c:825:class_conn2export()) looking for export cookie 0xcc1762b626f8d56b 00000020:00000040:2.0:1784189367.770113:0:25599:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9dbf4512b000 refcount=29 00000100:00000040:2.0:1784189367.770138:0:25599:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_io at +6s 00000100:00100000:2.0:1784189367.770185:0:25599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1072 00000100:00000040:2.0:1784189367.770189:0:25599:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9dbf4512b000 : new rpc_count 1 00000100:00000040:2.0:1784189367.770197:0:25599:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9dbf469b4e00 x1870854436382080/t0(4294969002) o4->debedd94-805c-42a0-a5e5-41758b2012e9@192.168.203.12@tcp:558/0 lens 1512/0 e 0 to 0 dl 1784189378 ref 1 fl New:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1784189367.770208:0:25599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf469b4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:debedd94-805c-42a0-a5e5-41758b2012e9+29:2395:x1870854436382080:12345-192.168.203.12@tcp:4:dd.0 00000020:00000040:2.0:1784189367.770220:0:25599:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff9dbf469b4e00 x1870854436382080/t0(4294969002) o4->debedd94-805c-42a0-a5e5-41758b2012e9@192.168.203.12@tcp:558/0 lens 1512/0 e 0 to 0 dl 1784189378 ref 1 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:2.0:1784189367.770229:0:25599:0:(ldlm_lib.c:3228:target_queue_recovery_request()) Next recovery transno: 4294969002, current: 4294969002, replaying 00010000:00000040:2.0:1784189367.770236:0:25599:0:(ldlm_lib.c:1774:target_request_copy_get()) RPC GETting export ffff9dbf4512b000 : new rpc_count 2 00000100:00000040:2.0:1784189367.770255:0:25599:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9dbf469b4e00 x1870854436382080/t0(4294969002) o4->debedd94-805c-42a0-a5e5-41758b2012e9@192.168.203.12@tcp:558/0 lens 1512/0 e 0 to 0 dl 1784189378 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1784189367.770264:0:25599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf469b4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:debedd94-805c-42a0-a5e5-41758b2012e9+29:2395:x1870854436382080:12345-192.168.203.12@tcp:4:dd.0 Request processed in 57us (268us total) trans 0 rc 0/-999 00000100:00100000:2.0:1784189367.770271:0:25599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1072 00000100:00000040:2.0:1784189367.770274:0:25599:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9dbf4512b000 : new rpc_count 1 00010000:00080000:1.0:1784189367.770377:0:96896:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 4294969002, next_transno: 4294969002 00010000:00080000:1.0:1784189367.770382:0:96896:0:(ldlm_lib.c:2246:check_for_next_transno()) waking for next (4294969002) 00010000:00080000:1.0:1784189367.770393:0:96896:0:(ldlm_lib.c:2747:replay_request_or_update()) @@@ processing x1870854436382080 t4294969002 from 192.168.203.12@tcp req@ffff9dbf469b4e00 x1870854436382080/t0(4294969002) o4->debedd94-805c-42a0-a5e5-41758b2012e9@192.168.203.12@tcp:558/0 lens 1512/0 e 0 to 0 dl 1784189378 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:1.0:1784189367.770410:0:96896:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff9dbf469b4e00 x1870854436382080/t0(4294969002) o4->debedd94-805c-42a0-a5e5-41758b2012e9@192.168.203.12@tcp:558/0 lens 1512/0 e 0 to 0 dl 1784189378 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:1.0:1784189367.770496:0:96896:0:(tgt_handler.c:2891:tgt_brw_write()) Client use short io for data transfer, size = 1024 00000001:00000040:1.0:1784189367.770521:0:96896:0:(lnet-crypto.c:95:cfs_crypto_hash_alloc()) Using crypto hash: crc32c (crc32c-intel) speed 3390 MB/s 00000020:00000040:1.0:1784189367.770525:0:96896:0:(tgt_handler.c:1914:tgt_checksum_niobuf()) Checksum for algo crc32c 00000001:00000040:1.0:1784189367.770777:0:96896:0:(tgt_lastrcvd.c:1006:tgt_last_commit_cb_add()) callback GETting export ffff9dbf4512b000 : new cb_count 25 00000020:00000040:1.0:1784189367.770781:0:96896:0:(genops.c:889:class_export_get()) GET export ffff9dbf4512b000 refcount=30 00010000:00000040:1.0:1784189367.771288:0:96896:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 4294968977, transno 4294969002, xid 1870854436382080 00000100:00000040:1.0:1784189367.771300:0:96896:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9dbf4274f140 refcount 11 to 192.168.203.12@tcp 00000100:00000040:1.0:1784189367.771306:0:96896:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.203.12@tcp 00000100:00000040:1.0:1784189367.771376:0:96896:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff9dbf4274f140 refcount 10 to 192.168.203.12@tcp 00010000:00080000:1.0:1784189367.771385:0:96896:0:(ldlm_lib.c:2100:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00000040:1.0:1784189367.771391:0:96896:0:(ldlm_lib.c:1790:target_request_copy_put()) RPC PUTting export ffff9dbf4512b000 : new rpc_count 0 00000020:00000040:1.0:1784189367.771401:0:96896:0:(genops.c:900:class_export_put()) PUTting export ffff9dbf4512b000 : new refcount 29 00010000:00080000:1.0:1784189367.771405:0:96896:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969003 00010000:00080000:1.0:1784189367.771409:0:96896:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969003 00000100:00000040:0.0:1784189367.777591:0:3634:0:(events.c:337:request_in_callback()) incoming req@ffff9dc080e7df80 x1870854436382336 msgsize 1512 00000100:00100000:0.0:1784189367.777607:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1784189367.777706:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436382336 00000100:00100000:3.0:1784189367.777716:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436382336 00000020:00000040:3.0:1784189367.777720:0:8434:0:(genops.c:825:class_conn2export()) looking for export cookie 0xcc1762b626f8d56b 00000020:00000040:3.0:1784189367.777725:0:8434:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9dbf4512b000 refcount=30 00000100:00000040:3.0:1784189367.778129:0:8434:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_io at +6s 00000100:00100000:3.0:1784189367.778216:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1073 00000100:00000040:3.0:1784189367.778221:0:8434:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9dbf4512b000 : new rpc_count 1 00000100:00000040:3.0:1784189367.778230:0:8434:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9dc080e7df80 x1870854436382336/t0(4294969003) o4->debedd94-805c-42a0-a5e5-41758b2012e9@192.168.203.12@tcp:558/0 lens 1512/0 e 0 to 0 dl 1784189378 ref 1 fl New:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1784189367.778245:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc080e7df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:debedd94-805c-42a0-a5e5-41758b2012e9+30:2395:x1870854436382336:12345-192.168.203.12@tcp:4:dd.0 00000020:00000040:3.0:1784189367.778257:0:8434:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff9dc080e7df80 x1870854436382336/t0(4294969003) o4->debedd94-805c-42a0-a5e5-41758b2012e9@192.168.203.12@tcp:558/0 lens 1512/0 e 0 to 0 dl 1784189378 ref 1 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:3.0:1784189367.778265:0:8434:0:(ldlm_lib.c:3228:target_queue_recovery_request()) Next recovery transno: 4294969003, current: 4294969003, replaying 00010000:00000040:3.0:1784189367.778268:0:8434:0:(ldlm_lib.c:1774:target_request_copy_get()) RPC GETting export ffff9dbf4512b000 : new rpc_count 2 00000100:00000040:3.0:1784189367.778282:0:8434:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9dc080e7df80 x1870854436382336/t0(4294969003) o4->debedd94-805c-42a0-a5e5-41758b2012e9@192.168.203.12@tcp:558/0 lens 1512/0 e 0 to 0 dl 1784189378 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1784189367.778291:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc080e7df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:debedd94-805c-42a0-a5e5-41758b2012e9+30:2395:x1870854436382336:12345-192.168.203.12@tcp:4:dd.0 Request processed in 49us (700us total) trans 0 rc 0/-999 00000100:00100000:3.0:1784189367.778313:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1073 00000100:00000040:3.0:1784189367.778316:0:8434:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9dbf4512b000 : new rpc_count 1 00010000:00080000:1.0:1784189367.778899:0:96896:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 4294969003, next_transno: 4294969003 00010000:00080000:1.0:1784189367.778904:0:96896:0:(ldlm_lib.c:2246:check_for_next_transno()) waking for next (4294969003) 00010000:00080000:1.0:1784189367.778915:0:96896:0:(ldlm_lib.c:2747:replay_request_or_update()) @@@ processing x1870854436382336 t4294969003 from 192.168.203.12@tcp req@ffff9dc080e7df80 x1870854436382336/t0(4294969003) o4->debedd94-805c-42a0-a5e5-41758b2012e9@192.168.203.12@tcp:558/0 lens 1512/0 e 0 to 0 dl 1784189378 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:1.0:1784189367.778934:0:96896:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff9dc080e7df80 x1870854436382336/t0(4294969003) o4->debedd94-805c-42a0-a5e5-41758b2012e9@192.168.203.12@tcp:558/0 lens 1512/0 e 0 to 0 dl 1784189378 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:1.0:1784189367.779028:0:96896:0:(tgt_handler.c:2891:tgt_brw_write()) Client use short io for data transfer, size = 1024 00000001:00000040:1.0:1784189367.779055:0:96896:0:(lnet-crypto.c:95:cfs_crypto_hash_alloc()) Using crypto hash: crc32c (crc32c-intel) speed 3390 MB/s 00000020:00000040:1.0:1784189367.779059:0:96896:0:(tgt_handler.c:1914:tgt_checksum_niobuf()) Checksum for algo crc32c 00000001:00000040:1.0:1784189367.779291:0:96896:0:(tgt_lastrcvd.c:1006:tgt_last_commit_cb_add()) callback GETting export ffff9dbf4512b000 : new cb_count 26 00000020:00000040:1.0:1784189367.779295:0:96896:0:(genops.c:889:class_export_get()) GET export ffff9dbf4512b000 refcount=31 00010000:00000040:1.0:1784189367.781076:0:96896:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 4294968977, transno 4294969003, xid 1870854436382336 00000100:00000040:1.0:1784189367.781102:0:96896:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9dbf4274f140 refcount 11 to 192.168.203.12@tcp 00000100:00000040:1.0:1784189367.781110:0:96896:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.203.12@tcp 00000100:00000040:1.0:1784189367.781179:0:96896:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff9dbf4274f140 refcount 10 to 192.168.203.12@tcp 00010000:00080000:1.0:1784189367.781196:0:96896:0:(ldlm_lib.c:2100:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00000040:1.0:1784189367.781204:0:96896:0:(ldlm_lib.c:1790:target_request_copy_put()) RPC PUTting export ffff9dbf4512b000 : new rpc_count 0 00000020:00000040:1.0:1784189367.781218:0:96896:0:(genops.c:900:class_export_put()) PUTting export ffff9dbf4512b000 : new refcount 30 00010000:00080000:1.0:1784189367.781224:0:96896:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969004 00010000:00080000:1.0:1784189367.781228:0:96896:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969004 00000100:00000040:2.0:1784189367.785745:0:3635:0:(events.c:337:request_in_callback()) incoming req@ffff9dc07130c700 x1870854436382592 msgsize 1512 00000100:00100000:2.0:1784189367.785764:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1784189367.787590:0:24845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436382592 00000100:00100000:1.0:1784189367.787604:0:24845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436382592 00000020:00000040:1.0:1784189367.787608:0:24845:0:(genops.c:825:class_conn2export()) looking for export cookie 0xcc1762b626f8d56b 00000020:00000040:1.0:1784189367.787626:0:24845:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9dbf4512b000 refcount=31 00000100:00000040:1.0:1784189367.787653:0:24845:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_io at +6s 00000100:00100000:1.0:1784189367.787703:0:24845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1074 00000100:00000040:1.0:1784189367.787708:0:24845:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9dbf4512b000 : new rpc_count 1 00000100:00000040:1.0:1784189367.787717:0:24845:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9dc07130c700 x1870854436382592/t0(4294969004) o4->debedd94-805c-42a0-a5e5-41758b2012e9@192.168.203.12@tcp:558/0 lens 1512/0 e 0 to 0 dl 1784189378 ref 1 fl New:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1784189367.787739:0:24845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc07130c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:debedd94-805c-42a0-a5e5-41758b2012e9+31:2395:x1870854436382592:12345-192.168.203.12@tcp:4:dd.0 00000020:00000040:1.0:1784189367.787752:0:24845:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff9dc07130c700 x1870854436382592/t0(4294969004) o4->debedd94-805c-42a0-a5e5-41758b2012e9@192.168.203.12@tcp:558/0 lens 1512/0 e 0 to 0 dl 1784189378 ref 1 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:1.0:1784189367.787761:0:24845:0:(ldlm_lib.c:3228:target_queue_recovery_request()) Next recovery transno: 4294969004, current: 4294969004, replaying 00010000:00000040:1.0:1784189367.787766:0:24845:0:(ldlm_lib.c:1774:target_request_copy_get()) RPC GETting export ffff9dbf4512b000 : new rpc_count 2 00000100:00000040:1.0:1784189367.787791:0:24845:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9dc07130c700 x1870854436382592/t0(4294969004) o4->debedd94-805c-42a0-a5e5-41758b2012e9@192.168.203.12@tcp:558/0 lens 1512/0 e 0 to 0 dl 1784189378 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1784189367.787801:0:24845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc07130c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:debedd94-805c-42a0-a5e5-41758b2012e9+31:2395:x1870854436382592:12345-192.168.203.12@tcp:4:dd.0 Request processed in 65us (2057us total) trans 0 rc 0/-999 00000100:00100000:1.0:1784189367.787809:0:24845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1074 00000100:00000040:1.0:1784189367.787812:0:24845:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9dbf4512b000 : new rpc_count 1 00010000:00080000:0.0:1784189367.790269:0:96896:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 4294969004, next_transno: 4294969004 00010000:00080000:0.0:1784189367.790280:0:96896:0:(ldlm_lib.c:2246:check_for_next_transno()) waking for next (4294969004) 00010000:00080000:0.0:1784189367.790296:0:96896:0:(ldlm_lib.c:2747:replay_request_or_update()) @@@ processing x1870854436382592 t4294969004 from 192.168.203.12@tcp req@ffff9dc07130c700 x1870854436382592/t0(4294969004) o4->debedd94-805c-42a0-a5e5-41758b2012e9@192.168.203.12@tcp:558/0 lens 1512/0 e 0 to 0 dl 1784189378 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:0.0:1784189367.790349:0:96896:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff9dc07130c700 x1870854436382592/t0(4294969004) o4->debedd94-805c-42a0-a5e5-41758b2012e9@192.168.203.12@tcp:558/0 lens 1512/0 e 0 to 0 dl 1784189378 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:0.0:1784189367.790446:0:96896:0:(tgt_handler.c:2891:tgt_brw_write()) Client use short io for data transfer, size = 1024 00000001:00000040:0.0:1784189367.790472:0:96896:0:(lnet-crypto.c:95:cfs_crypto_hash_alloc()) Using crypto hash: crc32c (crc32c-intel) speed 3390 MB/s 00000020:00000040:0.0:1784189367.790476:0:96896:0:(tgt_handler.c:1914:tgt_checksum_niobuf()) Checksum for algo crc32c 00000001:00000040:0.0:1784189367.790723:0:96896:0:(tgt_lastrcvd.c:1006:tgt_last_commit_cb_add()) callback GETting export ffff9dbf4512b000 : new cb_count 27 00000020:00000040:0.0:1784189367.790727:0:96896:0:(genops.c:889:class_export_get()) GET export ffff9dbf4512b000 refcount=32 00010000:00000040:1.0:1784189367.791454:0:96896:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 4294968977, transno 4294969004, xid 1870854436382592 00000100:00000040:1.0:1784189367.791467:0:96896:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9dbf4274f140 refcount 11 to 192.168.203.12@tcp 00000100:00000040:1.0:1784189367.791474:0:96896:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.203.12@tcp 00000100:00000040:1.0:1784189367.791520:0:96896:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff9dbf4274f140 refcount 10 to 192.168.203.12@tcp 00010000:00080000:1.0:1784189367.791531:0:96896:0:(ldlm_lib.c:2100:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00000040:1.0:1784189367.791538:0:96896:0:(ldlm_lib.c:1790:target_request_copy_put()) RPC PUTting export ffff9dbf4512b000 : new rpc_count 0 00000020:00000040:1.0:1784189367.791548:0:96896:0:(genops.c:900:class_export_put()) PUTting export ffff9dbf4512b000 : new refcount 31 00010000:00080000:1.0:1784189367.791553:0:96896:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969005 00010000:00080000:1.0:1784189367.791556:0:96896:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969005 00000100:00000040:1.0:1784189367.799554:0:3633:0:(events.c:337:request_in_callback()) incoming req@ffff9dc05ed38380 x1870854436382848 msgsize 1512 00000100:00100000:1.0:1784189367.799570:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1784189367.799866:0:24843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436382848 00000100:00100000:2.0:1784189367.799875:0:24843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436382848 00000020:00000040:2.0:1784189367.799879:0:24843:0:(genops.c:825:class_conn2export()) looking for export cookie 0xcc1762b626f8d56b 00000020:00000040:2.0:1784189367.799884:0:24843:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9dbf4512b000 refcount=32 00000100:00000040:2.0:1784189367.799907:0:24843:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_io at +6s 00000100:00100000:2.0:1784189367.799959:0:24843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1075 00000100:00000040:2.0:1784189367.799964:0:24843:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9dbf4512b000 : new rpc_count 1 00000100:00000040:2.0:1784189367.799973:0:24843:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9dc05ed38380 x1870854436382848/t0(4294969005) o4->debedd94-805c-42a0-a5e5-41758b2012e9@192.168.203.12@tcp:558/0 lens 1512/0 e 0 to 0 dl 1784189378 ref 1 fl New:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1784189367.799991:0:24843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc05ed38380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:debedd94-805c-42a0-a5e5-41758b2012e9+32:2395:x1870854436382848:12345-192.168.203.12@tcp:4:dd.0 00000020:00000040:2.0:1784189367.800005:0:24843:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff9dc05ed38380 x1870854436382848/t0(4294969005) o4->debedd94-805c-42a0-a5e5-41758b2012e9@192.168.203.12@tcp:558/0 lens 1512/0 e 0 to 0 dl 1784189378 ref 1 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:2.0:1784189367.800016:0:24843:0:(ldlm_lib.c:3228:target_queue_recovery_request()) Next recovery transno: 4294969005, current: 4294969005, replaying 00010000:00000040:2.0:1784189367.800020:0:24843:0:(ldlm_lib.c:1774:target_request_copy_get()) RPC GETting export ffff9dbf4512b000 : new rpc_count 2 00000100:00000040:2.0:1784189367.800042:0:24843:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9dc05ed38380 x1870854436382848/t0(4294969005) o4->debedd94-805c-42a0-a5e5-41758b2012e9@192.168.203.12@tcp:558/0 lens 1512/0 e 0 to 0 dl 1784189378 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1784189367.800053:0:24843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc05ed38380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:debedd94-805c-42a0-a5e5-41758b2012e9+32:2395:x1870854436382848:12345-192.168.203.12@tcp:4:dd.0 Request processed in 67us (498us total) trans 0 rc 0/-999 00000100:00100000:2.0:1784189367.800072:0:24843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1075 00000100:00000040:2.0:1784189367.800076:0:24843:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9dbf4512b000 : new rpc_count 1 00010000:00080000:0.0:1784189367.800177:0:96896:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 4294969005, next_transno: 4294969005 00010000:00080000:0.0:1784189367.800183:0:96896:0:(ldlm_lib.c:2246:check_for_next_transno()) waking for next (4294969005) 00010000:00080000:0.0:1784189367.800194:0:96896:0:(ldlm_lib.c:2747:replay_request_or_update()) @@@ processing x1870854436382848 t4294969005 from 192.168.203.12@tcp req@ffff9dc05ed38380 x1870854436382848/t0(4294969005) o4->debedd94-805c-42a0-a5e5-41758b2012e9@192.168.203.12@tcp:558/0 lens 1512/0 e 0 to 0 dl 1784189378 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:0.0:1784189367.800214:0:96896:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff9dc05ed38380 x1870854436382848/t0(4294969005) o4->debedd94-805c-42a0-a5e5-41758b2012e9@192.168.203.12@tcp:558/0 lens 1512/0 e 0 to 0 dl 1784189378 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:0.0:1784189367.800308:0:96896:0:(tgt_handler.c:2891:tgt_brw_write()) Client use short io for data transfer, size = 1024 00000001:00000040:0.0:1784189367.800366:0:96896:0:(lnet-crypto.c:95:cfs_crypto_hash_alloc()) Using crypto hash: crc32c (crc32c-intel) speed 3390 MB/s 00000020:00000040:0.0:1784189367.800376:0:96896:0:(tgt_handler.c:1914:tgt_checksum_niobuf()) Checksum for algo crc32c 00000001:00000040:0.0:1784189367.800639:0:96896:0:(tgt_lastrcvd.c:1006:tgt_last_commit_cb_add()) callback GETting export ffff9dbf4512b000 : new cb_count 28 00000020:00000040:0.0:1784189367.800643:0:96896:0:(genops.c:889:class_export_get()) GET export ffff9dbf4512b000 refcount=33 00010000:00000040:0.0:1784189367.802929:0:96896:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 4294968977, transno 4294969005, xid 1870854436382848 00000100:00000040:0.0:1784189367.802949:0:96896:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9dbf4274f140 refcount 11 to 192.168.203.12@tcp 00000100:00000040:0.0:1784189367.802958:0:96896:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.203.12@tcp 00000100:00000040:0.0:1784189367.803021:0:96896:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff9dbf4274f140 refcount 10 to 192.168.203.12@tcp 00010000:00080000:0.0:1784189367.803034:0:96896:0:(ldlm_lib.c:2100:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00000040:0.0:1784189367.803044:0:96896:0:(ldlm_lib.c:1790:target_request_copy_put()) RPC PUTting export ffff9dbf4512b000 : new rpc_count 0 00000020:00000040:0.0:1784189367.803054:0:96896:0:(genops.c:900:class_export_put()) PUTting export ffff9dbf4512b000 : new refcount 32 00010000:00080000:0.0:1784189367.803060:0:96896:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969006 00010000:00080000:0.0:1784189367.803065:0:96896:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969006 00000100:00000040:0.0:1784189367.810341:0:3634:0:(events.c:337:request_in_callback()) incoming req@ffff9dc080e7d880 x1870854436383104 msgsize 1512 00000100:00100000:0.0:1784189367.810358:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1784189367.810636:0:24833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436383104 00000100:00100000:2.0:1784189367.810645:0:24833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436383104 00000020:00000040:2.0:1784189367.810649:0:24833:0:(genops.c:825:class_conn2export()) looking for export cookie 0xcc1762b626f8d56b 00000020:00000040:2.0:1784189367.810653:0:24833:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9dbf4512b000 refcount=33 00000100:00000040:2.0:1784189367.810680:0:24833:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_io at +6s 00000100:00100000:2.0:1784189367.810736:0:24833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1076 00000100:00000040:2.0:1784189367.810741:0:24833:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9dbf4512b000 : new rpc_count 1 00000100:00000040:2.0:1784189367.810750:0:24833:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9dc080e7d880 x1870854436383104/t0(4294969006) o4->debedd94-805c-42a0-a5e5-41758b2012e9@192.168.203.12@tcp:558/0 lens 1512/0 e 0 to 0 dl 1784189378 ref 1 fl New:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1784189367.810765:0:24833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc080e7d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:debedd94-805c-42a0-a5e5-41758b2012e9+33:2395:x1870854436383104:12345-192.168.203.12@tcp:4:dd.0 00000020:00000040:2.0:1784189367.810777:0:24833:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff9dc080e7d880 x1870854436383104/t0(4294969006) o4->debedd94-805c-42a0-a5e5-41758b2012e9@192.168.203.12@tcp:558/0 lens 1512/0 e 0 to 0 dl 1784189378 ref 1 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:2.0:1784189367.810786:0:24833:0:(ldlm_lib.c:3228:target_queue_recovery_request()) Next recovery transno: 4294969006, current: 4294969006, replaying 00010000:00000040:2.0:1784189367.810790:0:24833:0:(ldlm_lib.c:1774:target_request_copy_get()) RPC GETting export ffff9dbf4512b000 : new rpc_count 2 00000100:00000040:2.0:1784189367.810801:0:24833:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9dc080e7d880 x1870854436383104/t0(4294969006) o4->debedd94-805c-42a0-a5e5-41758b2012e9@192.168.203.12@tcp:558/0 lens 1512/0 e 0 to 0 dl 1784189378 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1784189367.810810:0:24833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc080e7d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:debedd94-805c-42a0-a5e5-41758b2012e9+33:2395:x1870854436383104:12345-192.168.203.12@tcp:4:dd.0 Request processed in 49us (493us total) trans 0 rc 0/-999 00000100:00100000:2.0:1784189367.810818:0:24833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1076 00000100:00000040:2.0:1784189367.810821:0:24833:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9dbf4512b000 : new rpc_count 1 00010000:00080000:0.0:1784189367.810934:0:96896:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 4294969006, next_transno: 4294969006 00010000:00080000:0.0:1784189367.810938:0:96896:0:(ldlm_lib.c:2246:check_for_next_transno()) waking for next (4294969006) 00010000:00080000:0.0:1784189367.810948:0:96896:0:(ldlm_lib.c:2747:replay_request_or_update()) @@@ processing x1870854436383104 t4294969006 from 192.168.203.12@tcp req@ffff9dc080e7d880 x1870854436383104/t0(4294969006) o4->debedd94-805c-42a0-a5e5-41758b2012e9@192.168.203.12@tcp:558/0 lens 1512/0 e 0 to 0 dl 1784189378 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:0.0:1784189367.810964:0:96896:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff9dc080e7d880 x1870854436383104/t0(4294969006) o4->debedd94-805c-42a0-a5e5-41758b2012e9@192.168.203.12@tcp:558/0 lens 1512/0 e 0 to 0 dl 1784189378 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:0.0:1784189367.811076:0:96896:0:(tgt_handler.c:2891:tgt_brw_write()) Client use short io for data transfer, size = 1024 00000001:00000040:0.0:1784189367.811104:0:96896:0:(lnet-crypto.c:95:cfs_crypto_hash_alloc()) Using crypto hash: crc32c (crc32c-intel) speed 3390 MB/s 00000020:00000040:0.0:1784189367.811108:0:96896:0:(tgt_handler.c:1914:tgt_checksum_niobuf()) Checksum for algo crc32c 00000001:00000040:0.0:1784189367.811398:0:96896:0:(tgt_lastrcvd.c:1006:tgt_last_commit_cb_add()) callback GETting export ffff9dbf4512b000 : new cb_count 29 00000020:00000040:0.0:1784189367.811402:0:96896:0:(genops.c:889:class_export_get()) GET export ffff9dbf4512b000 refcount=34 00010000:00000040:0.0:1784189367.811747:0:96896:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 4294968977, transno 4294969006, xid 1870854436383104 00000100:00000040:0.0:1784189367.811760:0:96896:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9dbf4274f140 refcount 11 to 192.168.203.12@tcp 00000100:00000040:0.0:1784189367.811766:0:96896:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.203.12@tcp 00000100:00000040:0.0:1784189367.811827:0:96896:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff9dbf4274f140 refcount 10 to 192.168.203.12@tcp 00010000:00080000:0.0:1784189367.811837:0:96896:0:(ldlm_lib.c:2100:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00000040:0.0:1784189367.811845:0:96896:0:(ldlm_lib.c:1790:target_request_copy_put()) RPC PUTting export ffff9dbf4512b000 : new rpc_count 0 00000020:00000040:0.0:1784189367.811854:0:96896:0:(genops.c:900:class_export_put()) PUTting export ffff9dbf4512b000 : new refcount 33 00010000:00080000:0.0:1784189367.811859:0:96896:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969007 00010000:00080000:0.0:1784189367.811863:0:96896:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969007 00000100:00000040:0.0:1784189367.822920:0:3635:0:(events.c:337:request_in_callback()) incoming req@ffff9dc080e7ea00 x1870854436383360 msgsize 1512 00000100:00100000:0.0:1784189367.822935:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1784189367.822975:0:24831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436383360 00000100:00100000:0.0:1784189367.822984:0:24831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436383360 00000020:00000040:0.0:1784189367.822987:0:24831:0:(genops.c:825:class_conn2export()) looking for export cookie 0xcc1762b626f8d56b 00000020:00000040:0.0:1784189367.822992:0:24831:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9dbf4512b000 refcount=34 00000100:00000040:0.0:1784189367.823015:0:24831:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_io at +6s 00000100:00100000:0.0:1784189367.823066:0:24831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1077 00000100:00000040:0.0:1784189367.823071:0:24831:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9dbf4512b000 : new rpc_count 1 00000100:00000040:0.0:1784189367.823080:0:24831:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9dc080e7ea00 x1870854436383360/t0(4294969007) o4->debedd94-805c-42a0-a5e5-41758b2012e9@192.168.203.12@tcp:558/0 lens 1512/0 e 0 to 0 dl 1784189378 ref 1 fl New:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1784189367.823094:0:24831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc080e7ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:debedd94-805c-42a0-a5e5-41758b2012e9+34:2395:x1870854436383360:12345-192.168.203.12@tcp:4:dd.0 00000020:00000040:0.0:1784189367.823106:0:24831:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff9dc080e7ea00 x1870854436383360/t0(4294969007) o4->debedd94-805c-42a0-a5e5-41758b2012e9@192.168.203.12@tcp:558/0 lens 1512/0 e 0 to 0 dl 1784189378 ref 1 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:0.0:1784189367.823117:0:24831:0:(ldlm_lib.c:3228:target_queue_recovery_request()) Next recovery transno: 4294969007, current: 4294969007, replaying 00010000:00000040:0.0:1784189367.823121:0:24831:0:(ldlm_lib.c:1774:target_request_copy_get()) RPC GETting export ffff9dbf4512b000 : new rpc_count 2 00000100:00000040:0.0:1784189367.823135:0:24831:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9dc080e7ea00 x1870854436383360/t0(4294969007) o4->debedd94-805c-42a0-a5e5-41758b2012e9@192.168.203.12@tcp:558/0 lens 1512/0 e 0 to 0 dl 1784189378 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1784189367.823145:0:24831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc080e7ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:debedd94-805c-42a0-a5e5-41758b2012e9+34:2395:x1870854436383360:12345-192.168.203.12@tcp:4:dd.0 Request processed in 53us (224us total) trans 0 rc 0/-999 00000100:00100000:0.0:1784189367.823153:0:24831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1077 00000100:00000040:0.0:1784189367.823165:0:24831:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9dbf4512b000 : new rpc_count 1 00010000:00080000:0.0:1784189367.823187:0:96896:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 4294969007, next_transno: 4294969007 00010000:00080000:0.0:1784189367.823191:0:96896:0:(ldlm_lib.c:2246:check_for_next_transno()) waking for next (4294969007) 00010000:00080000:0.0:1784189367.823200:0:96896:0:(ldlm_lib.c:2747:replay_request_or_update()) @@@ processing x1870854436383360 t4294969007 from 192.168.203.12@tcp req@ffff9dc080e7ea00 x1870854436383360/t0(4294969007) o4->debedd94-805c-42a0-a5e5-41758b2012e9@192.168.203.12@tcp:558/0 lens 1512/0 e 0 to 0 dl 1784189378 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:0.0:1784189367.823220:0:96896:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff9dc080e7ea00 x1870854436383360/t0(4294969007) o4->debedd94-805c-42a0-a5e5-41758b2012e9@192.168.203.12@tcp:558/0 lens 1512/0 e 0 to 0 dl 1784189378 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:0.0:1784189367.823308:0:96896:0:(tgt_handler.c:2891:tgt_brw_write()) Client use short io for data transfer, size = 1024 00000001:00000040:0.0:1784189367.825146:0:96896:0:(lnet-crypto.c:95:cfs_crypto_hash_alloc()) Using crypto hash: crc32c (crc32c-intel) speed 3390 MB/s 00000020:00000040:0.0:1784189367.825155:0:96896:0:(tgt_handler.c:1914:tgt_checksum_niobuf()) Checksum for algo crc32c 00000001:00000040:0.0:1784189367.825426:0:96896:0:(tgt_lastrcvd.c:1006:tgt_last_commit_cb_add()) callback GETting export ffff9dbf4512b000 : new cb_count 30 00000020:00000040:0.0:1784189367.825432:0:96896:0:(genops.c:889:class_export_get()) GET export ffff9dbf4512b000 refcount=35 00010000:00000040:0.0:1784189367.826808:0:96896:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 4294968977, transno 4294969007, xid 1870854436383360 00000100:00000040:0.0:1784189367.826826:0:96896:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9dbf4274f140 refcount 11 to 192.168.203.12@tcp 00000100:00000040:0.0:1784189367.826836:0:96896:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.203.12@tcp 00000100:00000040:0.0:1784189367.826894:0:96896:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff9dbf4274f140 refcount 10 to 192.168.203.12@tcp 00010000:00080000:0.0:1784189367.826908:0:96896:0:(ldlm_lib.c:2100:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00000040:0.0:1784189367.826916:0:96896:0:(ldlm_lib.c:1790:target_request_copy_put()) RPC PUTting export ffff9dbf4512b000 : new rpc_count 0 00000020:00000040:0.0:1784189367.826929:0:96896:0:(genops.c:900:class_export_put()) PUTting export ffff9dbf4512b000 : new refcount 34 00010000:00080000:0.0:1784189367.826935:0:96896:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969008 00010000:00080000:0.0:1784189367.826939:0:96896:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969008 00000100:00000040:0.0:1784189367.830712:0:3633:0:(events.c:337:request_in_callback()) incoming req@ffff9dc080e7f100 x1870854436383616 msgsize 1512 00000100:00100000:0.0:1784189367.830726:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1784189367.830796:0:24834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436383616 00000100:00100000:3.0:1784189367.830805:0:24834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436383616 00000020:00000040:3.0:1784189367.830809:0:24834:0:(genops.c:825:class_conn2export()) looking for export cookie 0xcc1762b626f8d56b 00000020:00000040:3.0:1784189367.830814:0:24834:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9dbf4512b000 refcount=35 00000100:00000040:3.0:1784189367.830836:0:24834:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_io at +6s 00000100:00100000:3.0:1784189367.830881:0:24834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1078 00000100:00000040:3.0:1784189367.830885:0:24834:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9dbf4512b000 : new rpc_count 1 00000100:00000040:3.0:1784189367.830892:0:24834:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9dc080e7f100 x1870854436383616/t0(4294969008) o4->debedd94-805c-42a0-a5e5-41758b2012e9@192.168.203.12@tcp:558/0 lens 1512/0 e 0 to 0 dl 1784189378 ref 1 fl New:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1784189367.830906:0:24834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc080e7f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:debedd94-805c-42a0-a5e5-41758b2012e9+35:2395:x1870854436383616:12345-192.168.203.12@tcp:4:dd.0 00000020:00000040:3.0:1784189367.830918:0:24834:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff9dc080e7f100 x1870854436383616/t0(4294969008) o4->debedd94-805c-42a0-a5e5-41758b2012e9@192.168.203.12@tcp:558/0 lens 1512/0 e 0 to 0 dl 1784189378 ref 1 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:3.0:1784189367.830927:0:24834:0:(ldlm_lib.c:3228:target_queue_recovery_request()) Next recovery transno: 4294969008, current: 4294969008, replaying 00010000:00000040:3.0:1784189367.830931:0:24834:0:(ldlm_lib.c:1774:target_request_copy_get()) RPC GETting export ffff9dbf4512b000 : new rpc_count 2 00000100:00000040:3.0:1784189367.830941:0:24834:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9dc080e7f100 x1870854436383616/t0(4294969008) o4->debedd94-805c-42a0-a5e5-41758b2012e9@192.168.203.12@tcp:558/0 lens 1512/0 e 0 to 0 dl 1784189378 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1784189367.830951:0:24834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc080e7f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:debedd94-805c-42a0-a5e5-41758b2012e9+35:2395:x1870854436383616:12345-192.168.203.12@tcp:4:dd.0 Request processed in 47us (239us total) trans 0 rc 0/-999 00010000:00080000:0.0:1784189367.830958:0:96896:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 4294969008, next_transno: 4294969008 00000100:00100000:3.0:1784189367.830959:0:24834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1078 00000100:00000040:3.0:1784189367.830965:0:24834:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9dbf4512b000 : new rpc_count 1 00010000:00080000:0.0:1784189367.830966:0:96896:0:(ldlm_lib.c:2246:check_for_next_transno()) waking for next (4294969008) 00010000:00080000:0.0:1784189367.830979:0:96896:0:(ldlm_lib.c:2747:replay_request_or_update()) @@@ processing x1870854436383616 t4294969008 from 192.168.203.12@tcp req@ffff9dc080e7f100 x1870854436383616/t0(4294969008) o4->debedd94-805c-42a0-a5e5-41758b2012e9@192.168.203.12@tcp:558/0 lens 1512/0 e 0 to 0 dl 1784189378 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:0.0:1784189367.831012:0:96896:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff9dc080e7f100 x1870854436383616/t0(4294969008) o4->debedd94-805c-42a0-a5e5-41758b2012e9@192.168.203.12@tcp:558/0 lens 1512/0 e 0 to 0 dl 1784189378 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:0.0:1784189367.831124:0:96896:0:(tgt_handler.c:2891:tgt_brw_write()) Client use short io for data transfer, size = 1024 00000001:00000040:0.0:1784189367.831153:0:96896:0:(lnet-crypto.c:95:cfs_crypto_hash_alloc()) Using crypto hash: crc32c (crc32c-intel) speed 3390 MB/s 00000020:00000040:0.0:1784189367.831156:0:96896:0:(tgt_handler.c:1914:tgt_checksum_niobuf()) Checksum for algo crc32c 00000001:00000040:0.0:1784189367.831422:0:96896:0:(tgt_lastrcvd.c:1006:tgt_last_commit_cb_add()) callback GETting export ffff9dbf4512b000 : new cb_count 31 00000020:00000040:0.0:1784189367.831427:0:96896:0:(genops.c:889:class_export_get()) GET export ffff9dbf4512b000 refcount=36 00010000:00000040:0.0:1784189367.831966:0:96896:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 4294968977, transno 4294969008, xid 1870854436383616 00000100:00000040:0.0:1784189367.831978:0:96896:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9dbf4274f140 refcount 11 to 192.168.203.12@tcp 00000100:00000040:0.0:1784189367.831985:0:96896:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.203.12@tcp 00000100:00000040:0.0:1784189367.832104:0:96896:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff9dbf4274f140 refcount 10 to 192.168.203.12@tcp 00010000:00080000:0.0:1784189367.832116:0:96896:0:(ldlm_lib.c:2100:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00000040:0.0:1784189367.832123:0:96896:0:(ldlm_lib.c:1790:target_request_copy_put()) RPC PUTting export ffff9dbf4512b000 : new rpc_count 0 00000020:00000040:0.0:1784189367.832132:0:96896:0:(genops.c:900:class_export_put()) PUTting export ffff9dbf4512b000 : new refcount 35 00010000:00080000:0.0:1784189367.832137:0:96896:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969009 00010000:00080000:0.0:1784189367.832142:0:96896:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969009 00000100:00000040:3.0:1784189367.834739:0:3634:0:(events.c:337:request_in_callback()) incoming req@ffff9dbf469b5c00 x1870854436383872 msgsize 1512 00000100:00100000:3.0:1784189367.834755:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1784189367.834923:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436383872 00000100:00100000:0.0:1784189367.834934:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436383872 00000020:00000040:0.0:1784189367.834937:0:8434:0:(genops.c:825:class_conn2export()) looking for export cookie 0xcc1762b626f8d56b 00000020:00000040:0.0:1784189367.834942:0:8434:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9dbf4512b000 refcount=36 00000100:00000040:0.0:1784189367.834966:0:8434:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_io at +6s 00000100:00100000:0.0:1784189367.835017:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1079 00000100:00000040:0.0:1784189367.835022:0:8434:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9dbf4512b000 : new rpc_count 1 00000100:00000040:0.0:1784189367.835031:0:8434:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9dbf469b5c00 x1870854436383872/t0(4294969009) o4->debedd94-805c-42a0-a5e5-41758b2012e9@192.168.203.12@tcp:558/0 lens 1512/0 e 0 to 0 dl 1784189378 ref 1 fl New:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1784189367.835045:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf469b5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:debedd94-805c-42a0-a5e5-41758b2012e9+36:2395:x1870854436383872:12345-192.168.203.12@tcp:4:dd.0 00000020:00000040:0.0:1784189367.835058:0:8434:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff9dbf469b5c00 x1870854436383872/t0(4294969009) o4->debedd94-805c-42a0-a5e5-41758b2012e9@192.168.203.12@tcp:558/0 lens 1512/0 e 0 to 0 dl 1784189378 ref 1 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:0.0:1784189367.835081:0:8434:0:(ldlm_lib.c:3228:target_queue_recovery_request()) Next recovery transno: 4294969009, current: 4294969009, replaying 00010000:00000040:0.0:1784189367.835084:0:8434:0:(ldlm_lib.c:1774:target_request_copy_get()) RPC GETting export ffff9dbf4512b000 : new rpc_count 2 00000100:00000040:0.0:1784189367.835657:0:8434:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9dbf469b5c00 x1870854436383872/t0(4294969009) o4->debedd94-805c-42a0-a5e5-41758b2012e9@192.168.203.12@tcp:558/0 lens 1512/0 e 0 to 0 dl 1784189378 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1784189367.835668:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf469b5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:debedd94-805c-42a0-a5e5-41758b2012e9+36:2395:x1870854436383872:12345-192.168.203.12@tcp:4:dd.0 Request processed in 625us (929us total) trans 0 rc 0/-999 00000100:00100000:0.0:1784189367.835675:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1079 00000100:00000040:0.0:1784189367.835678:0:8434:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9dbf4512b000 : new rpc_count 1 00010000:00080000:2.0:1784189367.836703:0:96896:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 4294969009, next_transno: 4294969009 00010000:00080000:2.0:1784189367.836709:0:96896:0:(ldlm_lib.c:2246:check_for_next_transno()) waking for next (4294969009) 00010000:00080000:2.0:1784189367.836720:0:96896:0:(ldlm_lib.c:2747:replay_request_or_update()) @@@ processing x1870854436383872 t4294969009 from 192.168.203.12@tcp req@ffff9dbf469b5c00 x1870854436383872/t0(4294969009) o4->debedd94-805c-42a0-a5e5-41758b2012e9@192.168.203.12@tcp:558/0 lens 1512/0 e 0 to 0 dl 1784189378 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:2.0:1784189367.836748:0:96896:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff9dbf469b5c00 x1870854436383872/t0(4294969009) o4->debedd94-805c-42a0-a5e5-41758b2012e9@192.168.203.12@tcp:558/0 lens 1512/0 e 0 to 0 dl 1784189378 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:2.0:1784189367.836841:0:96896:0:(tgt_handler.c:2891:tgt_brw_write()) Client use short io for data transfer, size = 1024 00000001:00000040:2.0:1784189367.836867:0:96896:0:(lnet-crypto.c:95:cfs_crypto_hash_alloc()) Using crypto hash: crc32c (crc32c-intel) speed 3390 MB/s 00000020:00000040:2.0:1784189367.836870:0:96896:0:(tgt_handler.c:1914:tgt_checksum_niobuf()) Checksum for algo crc32c 00000001:00000040:2.0:1784189367.837479:0:96896:0:(tgt_lastrcvd.c:1006:tgt_last_commit_cb_add()) callback GETting export ffff9dbf4512b000 : new cb_count 32 00000020:00000040:2.0:1784189367.837484:0:96896:0:(genops.c:889:class_export_get()) GET export ffff9dbf4512b000 refcount=37 00010000:00000040:2.0:1784189367.837678:0:96896:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 4294968977, transno 4294969009, xid 1870854436383872 00000100:00000040:2.0:1784189367.837689:0:96896:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9dbf4274f140 refcount 11 to 192.168.203.12@tcp 00000100:00000040:2.0:1784189367.837696:0:96896:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.203.12@tcp 00000100:00000040:2.0:1784189367.837742:0:96896:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff9dbf4274f140 refcount 10 to 192.168.203.12@tcp 00010000:00080000:2.0:1784189367.837754:0:96896:0:(ldlm_lib.c:2100:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00000040:2.0:1784189367.837762:0:96896:0:(ldlm_lib.c:1790:target_request_copy_put()) RPC PUTting export ffff9dbf4512b000 : new rpc_count 0 00000020:00000040:2.0:1784189367.837772:0:96896:0:(genops.c:900:class_export_put()) PUTting export ffff9dbf4512b000 : new refcount 36 00010000:00080000:2.0:1784189367.837776:0:96896:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969010 00010000:00080000:2.0:1784189367.837781:0:96896:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969010 00000100:00000040:2.0:1784189367.840375:0:3635:0:(events.c:337:request_in_callback()) incoming req@ffff9dc07130d880 x1870854436384128 msgsize 1512 00000100:00100000:2.0:1784189367.840387:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1784189367.840470:0:24845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436384128 00000100:00100000:1.0:1784189367.840480:0:24845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436384128 00000020:00000040:1.0:1784189367.840483:0:24845:0:(genops.c:825:class_conn2export()) looking for export cookie 0xcc1762b626f8d56b 00000020:00000040:1.0:1784189367.840498:0:24845:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9dbf4512b000 refcount=37 00000100:00000040:1.0:1784189367.840518:0:24845:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_io at +6s 00000100:00100000:1.0:1784189367.840626:0:24845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1080 00000100:00000040:1.0:1784189367.840631:0:24845:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9dbf4512b000 : new rpc_count 1 00000100:00000040:1.0:1784189367.840638:0:24845:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9dc07130d880 x1870854436384128/t0(4294969010) o4->debedd94-805c-42a0-a5e5-41758b2012e9@192.168.203.12@tcp:558/0 lens 1512/0 e 0 to 0 dl 1784189378 ref 1 fl New:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1784189367.840651:0:24845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc07130d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:debedd94-805c-42a0-a5e5-41758b2012e9+37:2395:x1870854436384128:12345-192.168.203.12@tcp:4:dd.0 00000020:00000040:1.0:1784189367.840662:0:24845:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff9dc07130d880 x1870854436384128/t0(4294969010) o4->debedd94-805c-42a0-a5e5-41758b2012e9@192.168.203.12@tcp:558/0 lens 1512/0 e 0 to 0 dl 1784189378 ref 1 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:1.0:1784189367.840671:0:24845:0:(ldlm_lib.c:3228:target_queue_recovery_request()) Next recovery transno: 4294969010, current: 4294969010, replaying 00010000:00000040:1.0:1784189367.840673:0:24845:0:(ldlm_lib.c:1774:target_request_copy_get()) RPC GETting export ffff9dbf4512b000 : new rpc_count 2 00000100:00000040:1.0:1784189367.840690:0:24845:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9dc07130d880 x1870854436384128/t0(4294969010) o4->debedd94-805c-42a0-a5e5-41758b2012e9@192.168.203.12@tcp:558/0 lens 1512/0 e 0 to 0 dl 1784189378 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1784189367.840705:0:24845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc07130d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:debedd94-805c-42a0-a5e5-41758b2012e9+37:2395:x1870854436384128:12345-192.168.203.12@tcp:4:dd.0 Request processed in 50us (324us total) trans 0 rc 0/-999 00000100:00100000:1.0:1784189367.840712:0:24845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1080 00000100:00000040:1.0:1784189367.840716:0:24845:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9dbf4512b000 : new rpc_count 1 00010000:00080000:0.0:1784189367.840752:0:96896:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 4294969010, next_transno: 4294969010 00010000:00080000:0.0:1784189367.840757:0:96896:0:(ldlm_lib.c:2246:check_for_next_transno()) waking for next (4294969010) 00010000:00080000:0.0:1784189367.840765:0:96896:0:(ldlm_lib.c:2747:replay_request_or_update()) @@@ processing x1870854436384128 t4294969010 from 192.168.203.12@tcp req@ffff9dc07130d880 x1870854436384128/t0(4294969010) o4->debedd94-805c-42a0-a5e5-41758b2012e9@192.168.203.12@tcp:558/0 lens 1512/0 e 0 to 0 dl 1784189378 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:0.0:1784189367.840779:0:96896:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff9dc07130d880 x1870854436384128/t0(4294969010) o4->debedd94-805c-42a0-a5e5-41758b2012e9@192.168.203.12@tcp:558/0 lens 1512/0 e 0 to 0 dl 1784189378 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:0.0:1784189367.840861:0:96896:0:(tgt_handler.c:2891:tgt_brw_write()) Client use short io for data transfer, size = 1024 00000001:00000040:0.0:1784189367.840885:0:96896:0:(lnet-crypto.c:95:cfs_crypto_hash_alloc()) Using crypto hash: crc32c (crc32c-intel) speed 3390 MB/s 00000020:00000040:0.0:1784189367.840887:0:96896:0:(tgt_handler.c:1914:tgt_checksum_niobuf()) Checksum for algo crc32c 00000001:00000040:0.0:1784189367.841092:0:96896:0:(tgt_lastrcvd.c:1006:tgt_last_commit_cb_add()) callback GETting export ffff9dbf4512b000 : new cb_count 33 00000020:00000040:0.0:1784189367.841096:0:96896:0:(genops.c:889:class_export_get()) GET export ffff9dbf4512b000 refcount=38 00010000:00000040:0.0:1784189367.841508:0:96896:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 4294968977, transno 4294969010, xid 1870854436384128 00000100:00000040:0.0:1784189367.841520:0:96896:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9dbf4274f140 refcount 11 to 192.168.203.12@tcp 00000100:00000040:0.0:1784189367.841526:0:96896:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.203.12@tcp 00000100:00000040:0.0:1784189367.841569:0:96896:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff9dbf4274f140 refcount 10 to 192.168.203.12@tcp 00010000:00080000:0.0:1784189367.841579:0:96896:0:(ldlm_lib.c:2100:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00000040:0.0:1784189367.841585:0:96896:0:(ldlm_lib.c:1790:target_request_copy_put()) RPC PUTting export ffff9dbf4512b000 : new rpc_count 0 00000020:00000040:0.0:1784189367.841594:0:96896:0:(genops.c:900:class_export_put()) PUTting export ffff9dbf4512b000 : new refcount 37 00010000:00080000:0.0:1784189367.841607:0:96896:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969011 00010000:00080000:0.0:1784189367.841622:0:96896:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969011 00000100:00000040:1.0:1784189367.844385:0:3633:0:(events.c:337:request_in_callback()) incoming req@ffff9dc05ed39180 x1870854436384384 msgsize 1512 00000100:00100000:1.0:1784189367.844400:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1784189367.844516:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436384384 00000100:00100000:3.0:1784189367.844538:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436384384 00000020:00000040:3.0:1784189367.844542:0:8433:0:(genops.c:825:class_conn2export()) looking for export cookie 0xcc1762b626f8d56b 00000020:00000040:3.0:1784189367.844547:0:8433:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9dbf4512b000 refcount=38 00000100:00000040:3.0:1784189367.844570:0:8433:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_io at +6s 00000100:00100000:3.0:1784189367.844629:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1081 00000100:00000040:3.0:1784189367.844634:0:8433:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9dbf4512b000 : new rpc_count 1 00000100:00000040:3.0:1784189367.844640:0:8433:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9dc05ed39180 x1870854436384384/t0(4294969011) o4->debedd94-805c-42a0-a5e5-41758b2012e9@192.168.203.12@tcp:558/0 lens 1512/0 e 0 to 0 dl 1784189378 ref 1 fl New:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1784189367.844654:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc05ed39180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:debedd94-805c-42a0-a5e5-41758b2012e9+38:2395:x1870854436384384:12345-192.168.203.12@tcp:4:dd.0 00000020:00000040:3.0:1784189367.844665:0:8433:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff9dc05ed39180 x1870854436384384/t0(4294969011) o4->debedd94-805c-42a0-a5e5-41758b2012e9@192.168.203.12@tcp:558/0 lens 1512/0 e 0 to 0 dl 1784189378 ref 1 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:3.0:1784189367.844675:0:8433:0:(ldlm_lib.c:3228:target_queue_recovery_request()) Next recovery transno: 4294969011, current: 4294969011, replaying 00010000:00000040:3.0:1784189367.844678:0:8433:0:(ldlm_lib.c:1774:target_request_copy_get()) RPC GETting export ffff9dbf4512b000 : new rpc_count 2 00000100:00000040:3.0:1784189367.844693:0:8433:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9dc05ed39180 x1870854436384384/t0(4294969011) o4->debedd94-805c-42a0-a5e5-41758b2012e9@192.168.203.12@tcp:558/0 lens 1512/0 e 0 to 0 dl 1784189378 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1784189367.844713:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc05ed39180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:debedd94-805c-42a0-a5e5-41758b2012e9+38:2395:x1870854436384384:12345-192.168.203.12@tcp:4:dd.0 Request processed in 62us (328us total) trans 0 rc 0/-999 00000100:00100000:3.0:1784189367.844720:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1081 00000100:00000040:3.0:1784189367.844724:0:8433:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9dbf4512b000 : new rpc_count 1 00010000:00080000:3.0:1784189367.844745:0:96896:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 4294969011, next_transno: 4294969011 00010000:00080000:3.0:1784189367.844749:0:96896:0:(ldlm_lib.c:2246:check_for_next_transno()) waking for next (4294969011) 00010000:00080000:3.0:1784189367.844756:0:96896:0:(ldlm_lib.c:2747:replay_request_or_update()) @@@ processing x1870854436384384 t4294969011 from 192.168.203.12@tcp req@ffff9dc05ed39180 x1870854436384384/t0(4294969011) o4->debedd94-805c-42a0-a5e5-41758b2012e9@192.168.203.12@tcp:558/0 lens 1512/0 e 0 to 0 dl 1784189378 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:3.0:1784189367.844772:0:96896:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff9dc05ed39180 x1870854436384384/t0(4294969011) o4->debedd94-805c-42a0-a5e5-41758b2012e9@192.168.203.12@tcp:558/0 lens 1512/0 e 0 to 0 dl 1784189378 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:3.0:1784189367.844864:0:96896:0:(tgt_handler.c:2891:tgt_brw_write()) Client use short io for data transfer, size = 1024 00000001:00000040:3.0:1784189367.844894:0:96896:0:(lnet-crypto.c:95:cfs_crypto_hash_alloc()) Using crypto hash: crc32c (crc32c-intel) speed 3390 MB/s 00000020:00000040:3.0:1784189367.844898:0:96896:0:(tgt_handler.c:1914:tgt_checksum_niobuf()) Checksum for algo crc32c 00000001:00000040:3.0:1784189367.845143:0:96896:0:(tgt_lastrcvd.c:1006:tgt_last_commit_cb_add()) callback GETting export ffff9dbf4512b000 : new cb_count 34 00000020:00000040:3.0:1784189367.845147:0:96896:0:(genops.c:889:class_export_get()) GET export ffff9dbf4512b000 refcount=39 00010000:00000040:3.0:1784189367.846248:0:96896:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 4294968977, transno 4294969011, xid 1870854436384384 00000100:00000040:3.0:1784189367.846262:0:96896:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9dbf4274f140 refcount 11 to 192.168.203.12@tcp 00000100:00000040:3.0:1784189367.846269:0:96896:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.203.12@tcp 00000100:00000040:3.0:1784189367.846432:0:96896:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff9dbf4274f140 refcount 10 to 192.168.203.12@tcp 00010000:00080000:3.0:1784189367.846444:0:96896:0:(ldlm_lib.c:2100:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00000040:3.0:1784189367.846452:0:96896:0:(ldlm_lib.c:1790:target_request_copy_put()) RPC PUTting export ffff9dbf4512b000 : new rpc_count 0 00000020:00000040:3.0:1784189367.846462:0:96896:0:(genops.c:900:class_export_put()) PUTting export ffff9dbf4512b000 : new refcount 38 00010000:00080000:3.0:1784189367.846467:0:96896:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969012 00010000:00080000:3.0:1784189367.846471:0:96896:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969012 00000100:00000040:0.0:1784189367.848676:0:3634:0:(events.c:337:request_in_callback()) incoming req@ffff9dc0505bc000 x1870854436384640 msgsize 1512 00000100:00100000:0.0:1784189367.848690:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1784189367.848869:0:24844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436384640 00000100:00100000:3.0:1784189367.848878:0:24844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436384640 00000020:00000040:3.0:1784189367.848882:0:24844:0:(genops.c:825:class_conn2export()) looking for export cookie 0xcc1762b626f8d56b 00000020:00000040:3.0:1784189367.848886:0:24844:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9dbf4512b000 refcount=39 00000100:00000040:3.0:1784189367.848907:0:24844:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_io at +6s 00000100:00100000:3.0:1784189367.848953:0:24844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1082 00000100:00000040:3.0:1784189367.848958:0:24844:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9dbf4512b000 : new rpc_count 1 00000100:00000040:3.0:1784189367.848966:0:24844:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9dc0505bc000 x1870854436384640/t0(4294969012) o4->debedd94-805c-42a0-a5e5-41758b2012e9@192.168.203.12@tcp:558/0 lens 1512/0 e 0 to 0 dl 1784189378 ref 1 fl New:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1784189367.848978:0:24844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc0505bc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:debedd94-805c-42a0-a5e5-41758b2012e9+39:2395:x1870854436384640:12345-192.168.203.12@tcp:4:dd.0 00000020:00000040:3.0:1784189367.848989:0:24844:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff9dc0505bc000 x1870854436384640/t0(4294969012) o4->debedd94-805c-42a0-a5e5-41758b2012e9@192.168.203.12@tcp:558/0 lens 1512/0 e 0 to 0 dl 1784189378 ref 1 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:3.0:1784189367.848998:0:24844:0:(ldlm_lib.c:3228:target_queue_recovery_request()) Next recovery transno: 4294969012, current: 4294969012, replaying 00010000:00000040:3.0:1784189367.849002:0:24844:0:(ldlm_lib.c:1774:target_request_copy_get()) RPC GETting export ffff9dbf4512b000 : new rpc_count 2 00000100:00000040:3.0:1784189367.849016:0:24844:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9dc0505bc000 x1870854436384640/t0(4294969012) o4->debedd94-805c-42a0-a5e5-41758b2012e9@192.168.203.12@tcp:558/0 lens 1512/0 e 0 to 0 dl 1784189378 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1784189367.849030:0:24844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc0505bc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:debedd94-805c-42a0-a5e5-41758b2012e9+39:2395:x1870854436384640:12345-192.168.203.12@tcp:4:dd.0 Request processed in 54us (355us total) trans 0 rc 0/-999 00000100:00100000:3.0:1784189367.849038:0:24844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1082 00000100:00000040:3.0:1784189367.849041:0:24844:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9dbf4512b000 : new rpc_count 1 00010000:00080000:0.0:1784189367.849475:0:96896:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 4294969012, next_transno: 4294969012 00010000:00080000:0.0:1784189367.849481:0:96896:0:(ldlm_lib.c:2246:check_for_next_transno()) waking for next (4294969012) 00010000:00080000:0.0:1784189367.849491:0:96896:0:(ldlm_lib.c:2747:replay_request_or_update()) @@@ processing x1870854436384640 t4294969012 from 192.168.203.12@tcp req@ffff9dc0505bc000 x1870854436384640/t0(4294969012) o4->debedd94-805c-42a0-a5e5-41758b2012e9@192.168.203.12@tcp:558/0 lens 1512/0 e 0 to 0 dl 1784189378 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:0.0:1784189367.849511:0:96896:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff9dc0505bc000 x1870854436384640/t0(4294969012) o4->debedd94-805c-42a0-a5e5-41758b2012e9@192.168.203.12@tcp:558/0 lens 1512/0 e 0 to 0 dl 1784189378 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:0.0:1784189367.849685:0:96896:0:(tgt_handler.c:2891:tgt_brw_write()) Client use short io for data transfer, size = 1024 00000001:00000040:0.0:1784189367.849714:0:96896:0:(lnet-crypto.c:95:cfs_crypto_hash_alloc()) Using crypto hash: crc32c (crc32c-intel) speed 3390 MB/s 00000020:00000040:0.0:1784189367.849717:0:96896:0:(tgt_handler.c:1914:tgt_checksum_niobuf()) Checksum for algo crc32c 00000001:00000040:0.0:1784189367.849960:0:96896:0:(tgt_lastrcvd.c:1006:tgt_last_commit_cb_add()) callback GETting export ffff9dbf4512b000 : new cb_count 35 00000020:00000040:0.0:1784189367.849965:0:96896:0:(genops.c:889:class_export_get()) GET export ffff9dbf4512b000 refcount=40 00010000:00000040:0.0:1784189367.850271:0:96896:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 4294968977, transno 4294969012, xid 1870854436384640 00000100:00000040:0.0:1784189367.850282:0:96896:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9dbf4274f140 refcount 11 to 192.168.203.12@tcp 00000100:00000040:0.0:1784189367.850290:0:96896:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.203.12@tcp 00000100:00000040:0.0:1784189367.850364:0:96896:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff9dbf4274f140 refcount 10 to 192.168.203.12@tcp 00010000:00080000:0.0:1784189367.850374:0:96896:0:(ldlm_lib.c:2100:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00000040:0.0:1784189367.850382:0:96896:0:(ldlm_lib.c:1790:target_request_copy_put()) RPC PUTting export ffff9dbf4512b000 : new rpc_count 0 00000020:00000040:0.0:1784189367.850392:0:96896:0:(genops.c:900:class_export_put()) PUTting export ffff9dbf4512b000 : new refcount 39 00010000:00080000:0.0:1784189367.850396:0:96896:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969013 00010000:00080000:0.0:1784189367.850403:0:96896:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969013 00000100:00000040:0.0:1784189367.854558:0:3635:0:(events.c:337:request_in_callback()) incoming req@ffff9dc0505bd500 x1870854436384896 msgsize 1512 00000100:00100000:0.0:1784189367.854574:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1784189367.854623:0:25599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436384896 00000100:00100000:2.0:1784189367.854632:0:25599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436384896 00000020:00000040:2.0:1784189367.854636:0:25599:0:(genops.c:825:class_conn2export()) looking for export cookie 0xcc1762b626f8d56b 00000020:00000040:2.0:1784189367.854641:0:25599:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9dbf4512b000 refcount=40 00000100:00000040:2.0:1784189367.854665:0:25599:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_io at +6s 00000100:00100000:2.0:1784189367.854714:0:25599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1083 00000100:00000040:2.0:1784189367.854718:0:25599:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9dbf4512b000 : new rpc_count 1 00000100:00000040:2.0:1784189367.854726:0:25599:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9dc0505bd500 x1870854436384896/t0(4294969013) o4->debedd94-805c-42a0-a5e5-41758b2012e9@192.168.203.12@tcp:558/0 lens 1512/0 e 0 to 0 dl 1784189378 ref 1 fl New:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1784189367.854763:0:25599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc0505bd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:debedd94-805c-42a0-a5e5-41758b2012e9+40:2395:x1870854436384896:12345-192.168.203.12@tcp:4:dd.0 00000020:00000040:2.0:1784189367.854774:0:25599:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff9dc0505bd500 x1870854436384896/t0(4294969013) o4->debedd94-805c-42a0-a5e5-41758b2012e9@192.168.203.12@tcp:558/0 lens 1512/0 e 0 to 0 dl 1784189378 ref 1 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:2.0:1784189367.854783:0:25599:0:(ldlm_lib.c:3228:target_queue_recovery_request()) Next recovery transno: 4294969013, current: 4294969013, replaying 00010000:00000040:2.0:1784189367.854786:0:25599:0:(ldlm_lib.c:1774:target_request_copy_get()) RPC GETting export ffff9dbf4512b000 : new rpc_count 2 00000100:00000040:2.0:1784189367.854804:0:25599:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9dc0505bd500 x1870854436384896/t0(4294969013) o4->debedd94-805c-42a0-a5e5-41758b2012e9@192.168.203.12@tcp:558/0 lens 1512/0 e 0 to 0 dl 1784189378 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1784189367.854813:0:25599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc0505bd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:debedd94-805c-42a0-a5e5-41758b2012e9+40:2395:x1870854436384896:12345-192.168.203.12@tcp:4:dd.0 Request processed in 53us (256us total) trans 0 rc 0/-999 00000100:00100000:2.0:1784189367.854819:0:25599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1083 00000100:00000040:2.0:1784189367.854822:0:25599:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9dbf4512b000 : new rpc_count 1 00010000:00080000:3.0:1784189367.854880:0:96896:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 4294969013, next_transno: 4294969013 00010000:00080000:3.0:1784189367.854885:0:96896:0:(ldlm_lib.c:2246:check_for_next_transno()) waking for next (4294969013) 00010000:00080000:3.0:1784189367.854893:0:96896:0:(ldlm_lib.c:2747:replay_request_or_update()) @@@ processing x1870854436384896 t4294969013 from 192.168.203.12@tcp req@ffff9dc0505bd500 x1870854436384896/t0(4294969013) o4->debedd94-805c-42a0-a5e5-41758b2012e9@192.168.203.12@tcp:558/0 lens 1512/0 e 0 to 0 dl 1784189378 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:3.0:1784189367.854908:0:96896:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff9dc0505bd500 x1870854436384896/t0(4294969013) o4->debedd94-805c-42a0-a5e5-41758b2012e9@192.168.203.12@tcp:558/0 lens 1512/0 e 0 to 0 dl 1784189378 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:3.0:1784189367.854993:0:96896:0:(tgt_handler.c:2891:tgt_brw_write()) Client use short io for data transfer, size = 1024 00000001:00000040:3.0:1784189367.855019:0:96896:0:(lnet-crypto.c:95:cfs_crypto_hash_alloc()) Using crypto hash: crc32c (crc32c-intel) speed 3390 MB/s 00000020:00000040:3.0:1784189367.855022:0:96896:0:(tgt_handler.c:1914:tgt_checksum_niobuf()) Checksum for algo crc32c 00000001:00000040:3.0:1784189367.855415:0:96896:0:(tgt_lastrcvd.c:1006:tgt_last_commit_cb_add()) callback GETting export ffff9dbf4512b000 : new cb_count 36 00000020:00000040:3.0:1784189367.855420:0:96896:0:(genops.c:889:class_export_get()) GET export ffff9dbf4512b000 refcount=41 00010000:00000040:3.0:1784189367.856148:0:96896:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 4294968977, transno 4294969013, xid 1870854436384896 00000100:00000040:3.0:1784189367.856162:0:96896:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9dbf4274f140 refcount 11 to 192.168.203.12@tcp 00000100:00000040:3.0:1784189367.856169:0:96896:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.203.12@tcp 00000100:00000040:3.0:1784189367.856302:0:96896:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff9dbf4274f140 refcount 10 to 192.168.203.12@tcp 00010000:00080000:3.0:1784189367.856314:0:96896:0:(ldlm_lib.c:2100:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00000040:3.0:1784189367.856342:0:96896:0:(ldlm_lib.c:1790:target_request_copy_put()) RPC PUTting export ffff9dbf4512b000 : new rpc_count 0 00000020:00000040:3.0:1784189367.856354:0:96896:0:(genops.c:900:class_export_put()) PUTting export ffff9dbf4512b000 : new refcount 40 00010000:00080000:3.0:1784189367.856360:0:96896:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969014 00010000:00080000:3.0:1784189367.856365:0:96896:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969014 00000100:00000040:3.0:1784189367.859193:0:3633:0:(events.c:337:request_in_callback()) incoming req@ffff9dbf469b6d80 x1870854436385152 msgsize 1512 00000100:00100000:3.0:1784189367.859282:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1784189367.859348:0:24834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436385152 00000100:00100000:0.0:1784189367.859367:0:24834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436385152 00000020:00000040:0.0:1784189367.859371:0:24834:0:(genops.c:825:class_conn2export()) looking for export cookie 0xcc1762b626f8d56b 00000020:00000040:0.0:1784189367.859375:0:24834:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9dbf4512b000 refcount=41 00000100:00000040:0.0:1784189367.859398:0:24834:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_io at +6s 00000100:00100000:0.0:1784189367.859450:0:24834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1084 00000100:00000040:0.0:1784189367.859454:0:24834:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9dbf4512b000 : new rpc_count 1 00000100:00000040:0.0:1784189367.859461:0:24834:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9dbf469b6d80 x1870854436385152/t0(4294969014) o4->debedd94-805c-42a0-a5e5-41758b2012e9@192.168.203.12@tcp:558/0 lens 1512/0 e 0 to 0 dl 1784189378 ref 1 fl New:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1784189367.859473:0:24834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf469b6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:debedd94-805c-42a0-a5e5-41758b2012e9+41:2395:x1870854436385152:12345-192.168.203.12@tcp:4:dd.0 00000020:00000040:0.0:1784189367.859483:0:24834:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff9dbf469b6d80 x1870854436385152/t0(4294969014) o4->debedd94-805c-42a0-a5e5-41758b2012e9@192.168.203.12@tcp:558/0 lens 1512/0 e 0 to 0 dl 1784189378 ref 1 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:0.0:1784189367.859492:0:24834:0:(ldlm_lib.c:3228:target_queue_recovery_request()) Next recovery transno: 4294969014, current: 4294969014, replaying 00010000:00000040:0.0:1784189367.859496:0:24834:0:(ldlm_lib.c:1774:target_request_copy_get()) RPC GETting export ffff9dbf4512b000 : new rpc_count 2 00000100:00000040:0.0:1784189367.859511:0:24834:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9dbf469b6d80 x1870854436385152/t0(4294969014) o4->debedd94-805c-42a0-a5e5-41758b2012e9@192.168.203.12@tcp:558/0 lens 1512/0 e 0 to 0 dl 1784189378 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1784189367.859520:0:24834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf469b6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:debedd94-805c-42a0-a5e5-41758b2012e9+41:2395:x1870854436385152:12345-192.168.203.12@tcp:4:dd.0 Request processed in 50us (328us total) trans 0 rc 0/-999 00000100:00100000:0.0:1784189367.859526:0:24834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1084 00000100:00000040:0.0:1784189367.859529:0:24834:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9dbf4512b000 : new rpc_count 1 00010000:00080000:2.0:1784189367.859658:0:96896:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 4294969014, next_transno: 4294969014 00010000:00080000:2.0:1784189367.859663:0:96896:0:(ldlm_lib.c:2246:check_for_next_transno()) waking for next (4294969014) 00010000:00080000:2.0:1784189367.859672:0:96896:0:(ldlm_lib.c:2747:replay_request_or_update()) @@@ processing x1870854436385152 t4294969014 from 192.168.203.12@tcp req@ffff9dbf469b6d80 x1870854436385152/t0(4294969014) o4->debedd94-805c-42a0-a5e5-41758b2012e9@192.168.203.12@tcp:558/0 lens 1512/0 e 0 to 0 dl 1784189378 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:2.0:1784189367.859687:0:96896:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff9dbf469b6d80 x1870854436385152/t0(4294969014) o4->debedd94-805c-42a0-a5e5-41758b2012e9@192.168.203.12@tcp:558/0 lens 1512/0 e 0 to 0 dl 1784189378 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:2.0:1784189367.859772:0:96896:0:(tgt_handler.c:2891:tgt_brw_write()) Client use short io for data transfer, size = 1024 00000001:00000040:2.0:1784189367.859798:0:96896:0:(lnet-crypto.c:95:cfs_crypto_hash_alloc()) Using crypto hash: crc32c (crc32c-intel) speed 3390 MB/s 00000020:00000040:2.0:1784189367.859801:0:96896:0:(tgt_handler.c:1914:tgt_checksum_niobuf()) Checksum for algo crc32c 00000001:00000040:2.0:1784189367.860031:0:96896:0:(tgt_lastrcvd.c:1006:tgt_last_commit_cb_add()) callback GETting export ffff9dbf4512b000 : new cb_count 37 00000020:00000040:2.0:1784189367.860036:0:96896:0:(genops.c:889:class_export_get()) GET export ffff9dbf4512b000 refcount=42 00010000:00000040:2.0:1784189367.860507:0:96896:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 4294968977, transno 4294969014, xid 1870854436385152 00000100:00000040:2.0:1784189367.860518:0:96896:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9dbf4274f140 refcount 11 to 192.168.203.12@tcp 00000100:00000040:2.0:1784189367.860530:0:96896:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.203.12@tcp 00000100:00000040:2.0:1784189367.860576:0:96896:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff9dbf4274f140 refcount 10 to 192.168.203.12@tcp 00010000:00080000:2.0:1784189367.860586:0:96896:0:(ldlm_lib.c:2100:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00000040:2.0:1784189367.860593:0:96896:0:(ldlm_lib.c:1790:target_request_copy_put()) RPC PUTting export ffff9dbf4512b000 : new rpc_count 0 00000020:00000040:2.0:1784189367.860602:0:96896:0:(genops.c:900:class_export_put()) PUTting export ffff9dbf4512b000 : new refcount 41 00010000:00080000:2.0:1784189367.860607:0:96896:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969015 00010000:00080000:2.0:1784189367.860621:0:96896:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969015 00000100:00000040:3.0:1784189367.863201:0:3634:0:(events.c:337:request_in_callback()) incoming req@ffff9dbf469b5f80 x1870854436385408 msgsize 1512 00000100:00100000:3.0:1784189367.863218:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1784189367.863295:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436385408 00000100:00100000:0.0:1784189367.863306:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436385408 00000020:00000040:0.0:1784189367.863309:0:8434:0:(genops.c:825:class_conn2export()) looking for export cookie 0xcc1762b626f8d56b 00000020:00000040:0.0:1784189367.863314:0:8434:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9dbf4512b000 refcount=42 00000100:00000040:0.0:1784189367.863366:0:8434:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_io at +6s 00000100:00100000:0.0:1784189367.863407:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1085 00000100:00000040:0.0:1784189367.863412:0:8434:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9dbf4512b000 : new rpc_count 1 00000100:00000040:0.0:1784189367.863419:0:8434:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9dbf469b5f80 x1870854436385408/t0(4294969015) o4->debedd94-805c-42a0-a5e5-41758b2012e9@192.168.203.12@tcp:558/0 lens 1512/0 e 0 to 0 dl 1784189378 ref 1 fl New:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1784189367.863444:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf469b5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:debedd94-805c-42a0-a5e5-41758b2012e9+42:2395:x1870854436385408:12345-192.168.203.12@tcp:4:dd.0 00000020:00000040:0.0:1784189367.863455:0:8434:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff9dbf469b5f80 x1870854436385408/t0(4294969015) o4->debedd94-805c-42a0-a5e5-41758b2012e9@192.168.203.12@tcp:558/0 lens 1512/0 e 0 to 0 dl 1784189378 ref 1 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:0.0:1784189367.863463:0:8434:0:(ldlm_lib.c:3228:target_queue_recovery_request()) Next recovery transno: 4294969015, current: 4294969015, replaying 00010000:00000040:0.0:1784189367.863467:0:8434:0:(ldlm_lib.c:1774:target_request_copy_get()) RPC GETting export ffff9dbf4512b000 : new rpc_count 2 00000100:00000040:0.0:1784189367.863475:0:8434:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9dbf469b5f80 x1870854436385408/t0(4294969015) o4->debedd94-805c-42a0-a5e5-41758b2012e9@192.168.203.12@tcp:558/0 lens 1512/0 e 0 to 0 dl 1784189378 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1784189367.863484:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf469b5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:debedd94-805c-42a0-a5e5-41758b2012e9+42:2395:x1870854436385408:12345-192.168.203.12@tcp:4:dd.0 Request processed in 43us (284us total) trans 0 rc 0/-999 00000100:00100000:0.0:1784189367.863491:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1085 00000100:00000040:0.0:1784189367.863494:0:8434:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9dbf4512b000 : new rpc_count 1 00010000:00080000:2.0:1784189367.863557:0:96896:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 4294969015, next_transno: 4294969015 00010000:00080000:2.0:1784189367.863562:0:96896:0:(ldlm_lib.c:2246:check_for_next_transno()) waking for next (4294969015) 00010000:00080000:2.0:1784189367.863570:0:96896:0:(ldlm_lib.c:2747:replay_request_or_update()) @@@ processing x1870854436385408 t4294969015 from 192.168.203.12@tcp req@ffff9dbf469b5f80 x1870854436385408/t0(4294969015) o4->debedd94-805c-42a0-a5e5-41758b2012e9@192.168.203.12@tcp:558/0 lens 1512/0 e 0 to 0 dl 1784189378 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:2.0:1784189367.863584:0:96896:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff9dbf469b5f80 x1870854436385408/t0(4294969015) o4->debedd94-805c-42a0-a5e5-41758b2012e9@192.168.203.12@tcp:558/0 lens 1512/0 e 0 to 0 dl 1784189378 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:2.0:1784189367.863674:0:96896:0:(tgt_handler.c:2891:tgt_brw_write()) Client use short io for data transfer, size = 1024 00000001:00000040:2.0:1784189367.863698:0:96896:0:(lnet-crypto.c:95:cfs_crypto_hash_alloc()) Using crypto hash: crc32c (crc32c-intel) speed 3390 MB/s 00000020:00000040:2.0:1784189367.863702:0:96896:0:(tgt_handler.c:1914:tgt_checksum_niobuf()) Checksum for algo crc32c 00000001:00000040:2.0:1784189367.863906:0:96896:0:(tgt_lastrcvd.c:1006:tgt_last_commit_cb_add()) callback GETting export ffff9dbf4512b000 : new cb_count 38 00000020:00000040:2.0:1784189367.863911:0:96896:0:(genops.c:889:class_export_get()) GET export ffff9dbf4512b000 refcount=43 00010000:00000040:3.0:1784189367.864682:0:96896:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 4294968977, transno 4294969015, xid 1870854436385408 00000100:00000040:3.0:1784189367.864693:0:96896:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9dbf4274f140 refcount 11 to 192.168.203.12@tcp 00000100:00000040:3.0:1784189367.864700:0:96896:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.203.12@tcp 00000100:00000040:3.0:1784189367.864935:0:96896:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff9dbf4274f140 refcount 10 to 192.168.203.12@tcp 00010000:00080000:3.0:1784189367.864946:0:96896:0:(ldlm_lib.c:2100:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00000040:3.0:1784189367.864953:0:96896:0:(ldlm_lib.c:1790:target_request_copy_put()) RPC PUTting export ffff9dbf4512b000 : new rpc_count 0 00000020:00000040:3.0:1784189367.864964:0:96896:0:(genops.c:900:class_export_put()) PUTting export ffff9dbf4512b000 : new refcount 42 00010000:00080000:3.0:1784189367.864969:0:96896:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969016 00010000:00080000:3.0:1784189367.864973:0:96896:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969016 00000100:00000040:0.0:1784189367.872500:0:3635:0:(events.c:337:request_in_callback()) incoming req@ffff9dc0505bc380 x1870854436385664 msgsize 1512 00000100:00100000:0.0:1784189367.872515:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1784189367.872592:0:24845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436385664 00000100:00100000:2.0:1784189367.872601:0:24845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436385664 00000020:00000040:2.0:1784189367.872604:0:24845:0:(genops.c:825:class_conn2export()) looking for export cookie 0xcc1762b626f8d56b 00000020:00000040:2.0:1784189367.872609:0:24845:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9dbf4512b000 refcount=43 00000100:00000040:2.0:1784189367.872641:0:24845:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_io at +6s 00000100:00100000:2.0:1784189367.872689:0:24845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1086 00000100:00000040:2.0:1784189367.872694:0:24845:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9dbf4512b000 : new rpc_count 1 00000100:00000040:2.0:1784189367.872702:0:24845:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9dc0505bc380 x1870854436385664/t0(4294969016) o4->debedd94-805c-42a0-a5e5-41758b2012e9@192.168.203.12@tcp:558/0 lens 1512/0 e 0 to 0 dl 1784189378 ref 1 fl New:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1784189367.872715:0:24845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc0505bc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:debedd94-805c-42a0-a5e5-41758b2012e9+43:2395:x1870854436385664:12345-192.168.203.12@tcp:4:dd.0 00000020:00000040:2.0:1784189367.872745:0:24845:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff9dc0505bc380 x1870854436385664/t0(4294969016) o4->debedd94-805c-42a0-a5e5-41758b2012e9@192.168.203.12@tcp:558/0 lens 1512/0 e 0 to 0 dl 1784189378 ref 1 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:2.0:1784189367.872753:0:24845:0:(ldlm_lib.c:3228:target_queue_recovery_request()) Next recovery transno: 4294969016, current: 4294969016, replaying 00010000:00000040:2.0:1784189367.872756:0:24845:0:(ldlm_lib.c:1774:target_request_copy_get()) RPC GETting export ffff9dbf4512b000 : new rpc_count 2 00000100:00000040:2.0:1784189367.872775:0:24845:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9dc0505bc380 x1870854436385664/t0(4294969016) o4->debedd94-805c-42a0-a5e5-41758b2012e9@192.168.203.12@tcp:558/0 lens 1512/0 e 0 to 0 dl 1784189378 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1784189367.872783:0:24845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc0505bc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:debedd94-805c-42a0-a5e5-41758b2012e9+43:2395:x1870854436385664:12345-192.168.203.12@tcp:4:dd.0 Request processed in 71us (285us total) trans 0 rc 0/-999 00000100:00100000:2.0:1784189367.872790:0:24845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1086 00000100:00000040:2.0:1784189367.872793:0:24845:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9dbf4512b000 : new rpc_count 1 00010000:00080000:0.0:1784189367.872936:0:96896:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 4294969016, next_transno: 4294969016 00010000:00080000:0.0:1784189367.872941:0:96896:0:(ldlm_lib.c:2246:check_for_next_transno()) waking for next (4294969016) 00010000:00080000:0.0:1784189367.872949:0:96896:0:(ldlm_lib.c:2747:replay_request_or_update()) @@@ processing x1870854436385664 t4294969016 from 192.168.203.12@tcp req@ffff9dc0505bc380 x1870854436385664/t0(4294969016) o4->debedd94-805c-42a0-a5e5-41758b2012e9@192.168.203.12@tcp:558/0 lens 1512/0 e 0 to 0 dl 1784189378 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:0.0:1784189367.872966:0:96896:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff9dc0505bc380 x1870854436385664/t0(4294969016) o4->debedd94-805c-42a0-a5e5-41758b2012e9@192.168.203.12@tcp:558/0 lens 1512/0 e 0 to 0 dl 1784189378 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:0.0:1784189367.873049:0:96896:0:(tgt_handler.c:2891:tgt_brw_write()) Client use short io for data transfer, size = 1024 00000001:00000040:0.0:1784189367.873074:0:96896:0:(lnet-crypto.c:95:cfs_crypto_hash_alloc()) Using crypto hash: crc32c (crc32c-intel) speed 3390 MB/s 00000020:00000040:0.0:1784189367.873077:0:96896:0:(tgt_handler.c:1914:tgt_checksum_niobuf()) Checksum for algo crc32c 00000001:00000040:0.0:1784189367.873303:0:96896:0:(tgt_lastrcvd.c:1006:tgt_last_commit_cb_add()) callback GETting export ffff9dbf4512b000 : new cb_count 39 00000020:00000040:0.0:1784189367.873307:0:96896:0:(genops.c:889:class_export_get()) GET export ffff9dbf4512b000 refcount=44 00010000:00000040:0.0:1784189367.874860:0:96896:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 4294968977, transno 4294969016, xid 1870854436385664 00000100:00000040:0.0:1784189367.874876:0:96896:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9dbf4274f140 refcount 11 to 192.168.203.12@tcp 00000100:00000040:0.0:1784189367.874882:0:96896:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.203.12@tcp 00000100:00000040:0.0:1784189367.874935:0:96896:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff9dbf4274f140 refcount 10 to 192.168.203.12@tcp 00010000:00080000:0.0:1784189367.874946:0:96896:0:(ldlm_lib.c:2100:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00000040:0.0:1784189367.874954:0:96896:0:(ldlm_lib.c:1790:target_request_copy_put()) RPC PUTting export ffff9dbf4512b000 : new rpc_count 0 00000020:00000040:0.0:1784189367.874964:0:96896:0:(genops.c:900:class_export_put()) PUTting export ffff9dbf4512b000 : new refcount 43 00010000:00080000:0.0:1784189367.874969:0:96896:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969017 00010000:00080000:0.0:1784189367.874973:0:96896:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969017 00000100:00000040:0.0:1784189367.879489:0:3633:0:(events.c:337:request_in_callback()) incoming req@ffff9dc0505bf800 x1870854436385920 msgsize 1512 00000100:00100000:0.0:1784189367.879507:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1784189367.879593:0:24833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436385920 00000100:00100000:1.0:1784189367.879603:0:24833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436385920 00000020:00000040:1.0:1784189367.879606:0:24833:0:(genops.c:825:class_conn2export()) looking for export cookie 0xcc1762b626f8d56b 00000020:00000040:1.0:1784189367.879620:0:24833:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9dbf4512b000 refcount=44 00000100:00000040:1.0:1784189367.879645:0:24833:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_io at +6s 00000100:00100000:1.0:1784189367.879682:0:24833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1087 00000100:00000040:1.0:1784189367.879687:0:24833:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9dbf4512b000 : new rpc_count 1 00000100:00000040:1.0:1784189367.879694:0:24833:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9dc0505bf800 x1870854436385920/t0(4294969017) o4->debedd94-805c-42a0-a5e5-41758b2012e9@192.168.203.12@tcp:558/0 lens 1512/0 e 0 to 0 dl 1784189378 ref 1 fl New:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1784189367.879719:0:24833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc0505bf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:debedd94-805c-42a0-a5e5-41758b2012e9+44:2395:x1870854436385920:12345-192.168.203.12@tcp:4:dd.0 00000020:00000040:1.0:1784189367.879730:0:24833:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff9dc0505bf800 x1870854436385920/t0(4294969017) o4->debedd94-805c-42a0-a5e5-41758b2012e9@192.168.203.12@tcp:558/0 lens 1512/0 e 0 to 0 dl 1784189378 ref 1 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:1.0:1784189367.879741:0:24833:0:(ldlm_lib.c:3228:target_queue_recovery_request()) Next recovery transno: 4294969017, current: 4294969017, replaying 00010000:00000040:1.0:1784189367.879745:0:24833:0:(ldlm_lib.c:1774:target_request_copy_get()) RPC GETting export ffff9dbf4512b000 : new rpc_count 2 00000100:00000040:1.0:1784189367.879838:0:24833:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9dc0505bf800 x1870854436385920/t0(4294969017) o4->debedd94-805c-42a0-a5e5-41758b2012e9@192.168.203.12@tcp:558/0 lens 1512/0 e 0 to 0 dl 1784189378 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1784189367.879847:0:24833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc0505bf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:debedd94-805c-42a0-a5e5-41758b2012e9+44:2395:x1870854436385920:12345-192.168.203.12@tcp:4:dd.0 Request processed in 131us (360us total) trans 0 rc 0/-999 00000100:00100000:1.0:1784189367.879854:0:24833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1087 00000100:00000040:1.0:1784189367.879858:0:24833:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9dbf4512b000 : new rpc_count 1 00010000:00080000:3.0:1784189367.880176:0:96896:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 4294969017, next_transno: 4294969017 00010000:00080000:3.0:1784189367.880182:0:96896:0:(ldlm_lib.c:2246:check_for_next_transno()) waking for next (4294969017) 00010000:00080000:3.0:1784189367.880190:0:96896:0:(ldlm_lib.c:2747:replay_request_or_update()) @@@ processing x1870854436385920 t4294969017 from 192.168.203.12@tcp req@ffff9dc0505bf800 x1870854436385920/t0(4294969017) o4->debedd94-805c-42a0-a5e5-41758b2012e9@192.168.203.12@tcp:558/0 lens 1512/0 e 0 to 0 dl 1784189378 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:3.0:1784189367.880208:0:96896:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff9dc0505bf800 x1870854436385920/t0(4294969017) o4->debedd94-805c-42a0-a5e5-41758b2012e9@192.168.203.12@tcp:558/0 lens 1512/0 e 0 to 0 dl 1784189378 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:3.0:1784189367.880299:0:96896:0:(tgt_handler.c:2891:tgt_brw_write()) Client use short io for data transfer, size = 1024 00000001:00000040:2.0:1784189367.883823:0:96896:0:(lnet-crypto.c:95:cfs_crypto_hash_alloc()) Using crypto hash: crc32c (crc32c-intel) speed 3390 MB/s 00000020:00000040:2.0:1784189367.883833:0:96896:0:(tgt_handler.c:1914:tgt_checksum_niobuf()) Checksum for algo crc32c 00000001:00000040:2.0:1784189367.884096:0:96896:0:(tgt_lastrcvd.c:1006:tgt_last_commit_cb_add()) callback GETting export ffff9dbf4512b000 : new cb_count 40 00000020:00000040:2.0:1784189367.884101:0:96896:0:(genops.c:889:class_export_get()) GET export ffff9dbf4512b000 refcount=45 00010000:00000040:2.0:1784189367.884416:0:96896:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 4294968977, transno 4294969017, xid 1870854436385920 00000100:00000040:2.0:1784189367.884431:0:96896:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9dbf4274f140 refcount 11 to 192.168.203.12@tcp 00000100:00000040:2.0:1784189367.884439:0:96896:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.203.12@tcp 00000100:00000040:2.0:1784189367.884487:0:96896:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff9dbf4274f140 refcount 10 to 192.168.203.12@tcp 00010000:00080000:2.0:1784189367.884499:0:96896:0:(ldlm_lib.c:2100:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00000040:2.0:1784189367.884507:0:96896:0:(ldlm_lib.c:1790:target_request_copy_put()) RPC PUTting export ffff9dbf4512b000 : new rpc_count 0 00000020:00000040:2.0:1784189367.884518:0:96896:0:(genops.c:900:class_export_put()) PUTting export ffff9dbf4512b000 : new refcount 44 00010000:00080000:2.0:1784189367.884523:0:96896:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969018 00010000:00080000:2.0:1784189367.884527:0:96896:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969018 00000100:00000040:3.0:1784189367.892780:0:3634:0:(events.c:337:request_in_callback()) incoming req@ffff9dc080df0e00 x1870854436389376 msgsize 328 00000100:00100000:3.0:1784189367.892796:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00000040:3.0:1784189367.892832:0:3634:0:(events.c:337:request_in_callback()) incoming req@ffff9dc080df0700 x1870854436389504 msgsize 328 00000100:00100000:3.0:1784189367.892836:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00000040:3.0:1784189367.892864:0:3634:0:(events.c:337:request_in_callback()) incoming req@ffff9dc081cd2c50 x1870854436389632 msgsize 328 00000100:00100000:3.0:1784189367.892868:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00000040:3.0:1784189367.892869:0:3634:0:(events.c:349:request_in_callback()) Buffer complete: 63 buffers still posted 00000100:00000040:3.0:1784189367.892884:0:3634:0:(events.c:337:request_in_callback()) incoming req@ffff9dc080df0380 x1870854436389760 msgsize 328 00000100:00100000:3.0:1784189367.892887:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00000040:3.0:1784189367.892917:0:3634:0:(events.c:337:request_in_callback()) incoming req@ffff9dc080df2300 x1870854436389888 msgsize 328 00000100:00100000:3.0:1784189367.892922:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00000040:3.0:1784189367.892934:0:3634:0:(events.c:337:request_in_callback()) incoming req@ffff9dc080df1f80 x1870854436390016 msgsize 328 00000100:00100000:3.0:1784189367.892938:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00000040:3.0:1784189367.892959:0:3634:0:(events.c:337:request_in_callback()) incoming req@ffff9dc080df3b80 x1870854436390144 msgsize 328 00000100:00100000:3.0:1784189367.892963:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00000040:3.0:1784189367.892980:0:3634:0:(events.c:337:request_in_callback()) incoming req@ffff9dc080df1180 x1870854436390272 msgsize 328 00000100:00100000:3.0:1784189367.892984:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1784189367.893072:0:26168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436389376 00000100:00100000:0.0:1784189367.893081:0:26168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436389376 00000020:00000040:0.0:1784189367.893083:0:26168:0:(genops.c:825:class_conn2export()) looking for export cookie 0xcc1762b626f8d56b 00000020:00000040:0.0:1784189367.893088:0:26168:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9dbf4512b000 refcount=45 00000100:00100000:0.0:1784189367.893144:0:26168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436389504 00000100:00100000:0.0:1784189367.893147:0:26168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436389504 00000020:00000040:0.0:1784189367.893149:0:26168:0:(genops.c:825:class_conn2export()) looking for export cookie 0xcc1762b626f8d56b 00000020:00000040:0.0:1784189367.893151:0:26168:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9dbf4512b000 refcount=46 00000100:00100000:0.0:1784189367.893171:0:26168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436389632 00000100:00100000:0.0:1784189367.893174:0:26168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436389632 00000020:00000040:0.0:1784189367.893175:0:26168:0:(genops.c:825:class_conn2export()) looking for export cookie 0xcc1762b626f8d56b 00000020:00000040:0.0:1784189367.893177:0:26168:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9dbf4512b000 refcount=47 00000100:00100000:0.0:1784189367.893190:0:26168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436389760 00000100:00100000:0.0:1784189367.893192:0:26168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436389760 00000020:00000040:0.0:1784189367.893193:0:26168:0:(genops.c:825:class_conn2export()) looking for export cookie 0xcc1762b626f8d56b 00000020:00000040:0.0:1784189367.893195:0:26168:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9dbf4512b000 refcount=48 00000100:00100000:0.0:1784189367.893209:0:26168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436389888 00000100:00100000:0.0:1784189367.893211:0:26168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436389888 00000020:00000040:0.0:1784189367.893212:0:26168:0:(genops.c:825:class_conn2export()) looking for export cookie 0xcc1762b626f8d56b 00000020:00000040:0.0:1784189367.893214:0:26168:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9dbf4512b000 refcount=49 00000100:00100000:0.0:1784189367.893228:0:26168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436390016 00000100:00100000:0.0:1784189367.893236:0:26168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436390016 00000020:00000040:0.0:1784189367.893237:0:26168:0:(genops.c:825:class_conn2export()) looking for export cookie 0xcc1762b626f8d56b 00000020:00000040:0.0:1784189367.893239:0:26168:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9dbf4512b000 refcount=50 00000100:00100000:0.0:1784189367.893256:0:26168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436390144 00000100:00100000:0.0:1784189367.893258:0:26168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436390144 00000020:00000040:0.0:1784189367.893259:0:26168:0:(genops.c:825:class_conn2export()) looking for export cookie 0xcc1762b626f8d56b 00000020:00000040:0.0:1784189367.893261:0:26168:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9dbf4512b000 refcount=51 00000100:00100000:0.0:1784189367.893276:0:26168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436390272 00000100:00100000:0.0:1784189367.893278:0:26168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436390272 00000020:00000040:0.0:1784189367.893280:0:26168:0:(genops.c:825:class_conn2export()) looking for export cookie 0xcc1762b626f8d56b 00000020:00000040:0.0:1784189367.893281:0:26168:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9dbf4512b000 refcount=52 00000100:00100000:0.0:1784189367.893301:0:26168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 5081 00000100:00000040:0.0:1784189367.893305:0:26168:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9dbf4512b000 : new rpc_count 1 00000100:00000040:0.0:1784189367.893312:0:26168:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9dc080df0e00 x1870854436389376/t0(0) o101->debedd94-805c-42a0-a5e5-41758b2012e9@192.168.203.12@tcp:558/0 lens 328/0 e 0 to 0 dl 1784189378 ref 1 fl New:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784189367.893355:0:26168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc080df0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:debedd94-805c-42a0-a5e5-41758b2012e9+52:2395:x1870854436389376:12345-192.168.203.12@tcp:101:ldlm_lock_repla.0 00000020:00000040:0.0:1784189367.893369:0:26168:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff9dc080df0e00 x1870854436389376/t0(0) o101->debedd94-805c-42a0-a5e5-41758b2012e9@192.168.203.12@tcp:558/0 lens 328/0 e 0 to 0 dl 1784189378 ref 1 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00000040:0.0:1784189367.893378:0:26168:0:(ldlm_lib.c:1774:target_request_copy_get()) RPC GETting export ffff9dbf4512b000 : new rpc_count 2 00010000:00080000:0.0:1784189367.893382:0:26168:0:(ldlm_lib.c:3187:target_queue_recovery_request()) @@@ queue lock replay req req@ffff9dc080df0e00 x1870854436389376/t0(0) o101->debedd94-805c-42a0-a5e5-41758b2012e9@192.168.203.12@tcp:558/0 lens 328/0 e 0 to 0 dl 1784189378 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1784189367.893397:0:26168:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9dc080df0e00 x1870854436389376/t0(0) o101->debedd94-805c-42a0-a5e5-41758b2012e9@192.168.203.12@tcp:558/0 lens 328/0 e 0 to 0 dl 1784189378 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784189367.893405:0:26168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc080df0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:debedd94-805c-42a0-a5e5-41758b2012e9+52:2395:x1870854436389376:12345-192.168.203.12@tcp:101:ldlm_lock_repla.0 Request processed in 53us (627us total) trans 0 rc 0/-999 00000100:00100000:0.0:1784189367.893411:0:26168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 5081 00000100:00000040:0.0:1784189367.893414:0:26168:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9dbf4512b000 : new rpc_count 1 00000100:00100000:0.0:1784189367.893445:0:26168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 5082 00000100:00000040:0.0:1784189367.893448:0:26168:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9dbf4512b000 : new rpc_count 2 00000100:00000040:0.0:1784189367.893452:0:26168:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9dc080df0700 x1870854436389504/t0(0) o101->debedd94-805c-42a0-a5e5-41758b2012e9@192.168.203.12@tcp:558/0 lens 328/0 e 0 to 0 dl 1784189378 ref 1 fl New:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784189367.893463:0:26168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc080df0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:debedd94-805c-42a0-a5e5-41758b2012e9+52:2395:x1870854436389504:12345-192.168.203.12@tcp:101:ldlm_lock_repla.0 00000020:00000040:0.0:1784189367.893470:0:26168:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff9dc080df0700 x1870854436389504/t0(0) o101->debedd94-805c-42a0-a5e5-41758b2012e9@192.168.203.12@tcp:558/0 lens 328/0 e 0 to 0 dl 1784189378 ref 1 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00000040:0.0:1784189367.893477:0:26168:0:(ldlm_lib.c:1774:target_request_copy_get()) RPC GETting export ffff9dbf4512b000 : new rpc_count 3 00010000:00080000:0.0:1784189367.893480:0:26168:0:(ldlm_lib.c:3187:target_queue_recovery_request()) @@@ queue lock replay req req@ffff9dc080df0700 x1870854436389504/t0(0) o101->debedd94-805c-42a0-a5e5-41758b2012e9@192.168.203.12@tcp:558/0 lens 328/0 e 0 to 0 dl 1784189378 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1784189367.893488:0:26168:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9dc080df0700 x1870854436389504/t0(0) o101->debedd94-805c-42a0-a5e5-41758b2012e9@192.168.203.12@tcp:558/0 lens 328/0 e 0 to 0 dl 1784189378 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784189367.893495:0:26168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc080df0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:debedd94-805c-42a0-a5e5-41758b2012e9+52:2395:x1870854436389504:12345-192.168.203.12@tcp:101:ldlm_lock_repla.0 Request processed in 34us (661us total) trans 0 rc 0/-999 00000100:00100000:0.0:1784189367.893500:0:26168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 5082 00000100:00000040:0.0:1784189367.893502:0:26168:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9dbf4512b000 : new rpc_count 2 00000100:00100000:0.0:1784189367.893510:0:26168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 5083 00000100:00000040:0.0:1784189367.893511:0:26168:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9dbf4512b000 : new rpc_count 3 00000100:00000040:0.0:1784189367.893515:0:26168:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9dc081cd2c50 x1870854436389632/t0(0) o101->debedd94-805c-42a0-a5e5-41758b2012e9@192.168.203.12@tcp:558/0 lens 328/0 e 0 to 0 dl 1784189378 ref 1 fl New:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784189367.893524:0:26168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc081cd2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:debedd94-805c-42a0-a5e5-41758b2012e9+52:2395:x1870854436389632:12345-192.168.203.12@tcp:101:ldlm_lock_repla.0 00000020:00000040:0.0:1784189367.893530:0:26168:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff9dc081cd2c50 x1870854436389632/t0(0) o101->debedd94-805c-42a0-a5e5-41758b2012e9@192.168.203.12@tcp:558/0 lens 328/0 e 0 to 0 dl 1784189378 ref 1 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00000040:0.0:1784189367.893549:0:26168:0:(ldlm_lib.c:1774:target_request_copy_get()) RPC GETting export ffff9dbf4512b000 : new rpc_count 4 00010000:00080000:0.0:1784189367.893553:0:26168:0:(ldlm_lib.c:3187:target_queue_recovery_request()) @@@ queue lock replay req req@ffff9dc081cd2c50 x1870854436389632/t0(0) o101->debedd94-805c-42a0-a5e5-41758b2012e9@192.168.203.12@tcp:558/0 lens 328/0 e 0 to 0 dl 1784189378 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1784189367.893561:0:26168:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9dc081cd2c50 x1870854436389632/t0(0) o101->debedd94-805c-42a0-a5e5-41758b2012e9@192.168.203.12@tcp:558/0 lens 328/0 e 0 to 0 dl 1784189378 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784189367.893568:0:26168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc081cd2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:debedd94-805c-42a0-a5e5-41758b2012e9+52:2395:x1870854436389632:12345-192.168.203.12@tcp:101:ldlm_lock_repla.0 Request processed in 45us (702us total) trans 0 rc 0/-999 00000100:00100000:0.0:1784189367.893573:0:26168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 5083 00000100:00000040:0.0:1784189367.893575:0:26168:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9dbf4512b000 : new rpc_count 3 00000100:00100000:0.0:1784189367.893585:0:26168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 5084 00000100:00000040:0.0:1784189367.893587:0:26168:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9dbf4512b000 : new rpc_count 4 00000100:00000040:0.0:1784189367.893590:0:26168:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9dc080df0380 x1870854436389760/t0(0) o101->debedd94-805c-42a0-a5e5-41758b2012e9@192.168.203.12@tcp:558/0 lens 328/0 e 0 to 0 dl 1784189378 ref 1 fl New:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784189367.893599:0:26168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc080df0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:debedd94-805c-42a0-a5e5-41758b2012e9+52:2395:x1870854436389760:12345-192.168.203.12@tcp:101:ldlm_lock_repla.0 00000020:00000040:0.0:1784189367.893605:0:26168:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff9dc080df0380 x1870854436389760/t0(0) o101->debedd94-805c-42a0-a5e5-41758b2012e9@192.168.203.12@tcp:558/0 lens 328/0 e 0 to 0 dl 1784189378 ref 1 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00000040:0.0:1784189367.893622:0:26168:0:(ldlm_lib.c:1774:target_request_copy_get()) RPC GETting export ffff9dbf4512b000 : new rpc_count 5 00010000:00080000:0.0:1784189367.893626:0:26168:0:(ldlm_lib.c:3187:target_queue_recovery_request()) @@@ queue lock replay req req@ffff9dc080df0380 x1870854436389760/t0(0) o101->debedd94-805c-42a0-a5e5-41758b2012e9@192.168.203.12@tcp:558/0 lens 328/0 e 0 to 0 dl 1784189378 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1784189367.893633:0:26168:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9dc080df0380 x1870854436389760/t0(0) o101->debedd94-805c-42a0-a5e5-41758b2012e9@192.168.203.12@tcp:558/0 lens 328/0 e 0 to 0 dl 1784189378 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784189367.893639:0:26168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc080df0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:debedd94-805c-42a0-a5e5-41758b2012e9+52:2395:x1870854436389760:12345-192.168.203.12@tcp:101:ldlm_lock_repla.0 Request processed in 42us (754us total) trans 0 rc 0/-999 00000100:00100000:0.0:1784189367.893651:0:26168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 5084 00000100:00000040:0.0:1784189367.893652:0:26168:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9dbf4512b000 : new rpc_count 4 00000100:00100000:0.0:1784189367.893662:0:26168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 5085 00000100:00000040:0.0:1784189367.893664:0:26168:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9dbf4512b000 : new rpc_count 5 00000100:00000040:0.0:1784189367.893668:0:26168:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9dc080df2300 x1870854436389888/t0(0) o101->debedd94-805c-42a0-a5e5-41758b2012e9@192.168.203.12@tcp:558/0 lens 328/0 e 0 to 0 dl 1784189378 ref 1 fl New:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784189367.893678:0:26168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc080df2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:debedd94-805c-42a0-a5e5-41758b2012e9+52:2395:x1870854436389888:12345-192.168.203.12@tcp:101:ldlm_lock_repla.0 00000020:00000040:0.0:1784189367.893685:0:26168:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff9dc080df2300 x1870854436389888/t0(0) o101->debedd94-805c-42a0-a5e5-41758b2012e9@192.168.203.12@tcp:558/0 lens 328/0 e 0 to 0 dl 1784189378 ref 1 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00000040:0.0:1784189367.893691:0:26168:0:(ldlm_lib.c:1774:target_request_copy_get()) RPC GETting export ffff9dbf4512b000 : new rpc_count 6 00010000:00080000:0.0:1784189367.893693:0:26168:0:(ldlm_lib.c:3187:target_queue_recovery_request()) @@@ queue lock replay req req@ffff9dc080df2300 x1870854436389888/t0(0) o101->debedd94-805c-42a0-a5e5-41758b2012e9@192.168.203.12@tcp:558/0 lens 328/0 e 0 to 0 dl 1784189378 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1784189367.893701:0:26168:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9dc080df2300 x1870854436389888/t0(0) o101->debedd94-805c-42a0-a5e5-41758b2012e9@192.168.203.12@tcp:558/0 lens 328/0 e 0 to 0 dl 1784189378 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784189367.893709:0:26168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc080df2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:debedd94-805c-42a0-a5e5-41758b2012e9+52:2395:x1870854436389888:12345-192.168.203.12@tcp:101:ldlm_lock_repla.0 Request processed in 33us (791us total) trans 0 rc 0/-999 00000100:00100000:0.0:1784189367.893715:0:26168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 5085 00000100:00000040:0.0:1784189367.893716:0:26168:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9dbf4512b000 : new rpc_count 5 00000100:00100000:0.0:1784189367.893725:0:26168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 5086 00000100:00000040:0.0:1784189367.893727:0:26168:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9dbf4512b000 : new rpc_count 6 00000100:00000040:0.0:1784189367.893731:0:26168:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9dc080df1f80 x1870854436390016/t0(0) o101->debedd94-805c-42a0-a5e5-41758b2012e9@192.168.203.12@tcp:558/0 lens 328/0 e 0 to 0 dl 1784189378 ref 1 fl New:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784189367.893740:0:26168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc080df1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:debedd94-805c-42a0-a5e5-41758b2012e9+52:2395:x1870854436390016:12345-192.168.203.12@tcp:101:ldlm_lock_repla.0 00000020:00000040:0.0:1784189367.893754:0:26168:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff9dc080df1f80 x1870854436390016/t0(0) o101->debedd94-805c-42a0-a5e5-41758b2012e9@192.168.203.12@tcp:558/0 lens 328/0 e 0 to 0 dl 1784189378 ref 1 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00000040:0.0:1784189367.893760:0:26168:0:(ldlm_lib.c:1774:target_request_copy_get()) RPC GETting export ffff9dbf4512b000 : new rpc_count 7 00010000:00080000:0.0:1784189367.893763:0:26168:0:(ldlm_lib.c:3187:target_queue_recovery_request()) @@@ queue lock replay req req@ffff9dc080df1f80 x1870854436390016/t0(0) o101->debedd94-805c-42a0-a5e5-41758b2012e9@192.168.203.12@tcp:558/0 lens 328/0 e 0 to 0 dl 1784189378 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1784189367.893770:0:26168:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9dc080df1f80 x1870854436390016/t0(0) o101->debedd94-805c-42a0-a5e5-41758b2012e9@192.168.203.12@tcp:558/0 lens 328/0 e 0 to 0 dl 1784189378 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784189367.893779:0:26168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc080df1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:debedd94-805c-42a0-a5e5-41758b2012e9+52:2395:x1870854436390016:12345-192.168.203.12@tcp:101:ldlm_lock_repla.0 Request processed in 40us (842us total) trans 0 rc 0/-999 00000100:00100000:0.0:1784189367.893785:0:26168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 5086 00000100:00000040:0.0:1784189367.893787:0:26168:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9dbf4512b000 : new rpc_count 6 00000100:00100000:0.0:1784189367.893796:0:26168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 5087 00000100:00000040:0.0:1784189367.893798:0:26168:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9dbf4512b000 : new rpc_count 7 00000100:00000040:0.0:1784189367.893801:0:26168:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9dc080df3b80 x1870854436390144/t0(0) o101->debedd94-805c-42a0-a5e5-41758b2012e9@192.168.203.12@tcp:558/0 lens 328/0 e 0 to 0 dl 1784189378 ref 1 fl New:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784189367.893811:0:26168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc080df3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:debedd94-805c-42a0-a5e5-41758b2012e9+52:2395:x1870854436390144:12345-192.168.203.12@tcp:101:ldlm_lock_repla.0 00000020:00000040:0.0:1784189367.893817:0:26168:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff9dc080df3b80 x1870854436390144/t0(0) o101->debedd94-805c-42a0-a5e5-41758b2012e9@192.168.203.12@tcp:558/0 lens 328/0 e 0 to 0 dl 1784189378 ref 1 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00000040:0.0:1784189367.893822:0:26168:0:(ldlm_lib.c:1774:target_request_copy_get()) RPC GETting export ffff9dbf4512b000 : new rpc_count 8 00010000:00080000:0.0:1784189367.893825:0:26168:0:(ldlm_lib.c:3187:target_queue_recovery_request()) @@@ queue lock replay req req@ffff9dc080df3b80 x1870854436390144/t0(0) o101->debedd94-805c-42a0-a5e5-41758b2012e9@192.168.203.12@tcp:558/0 lens 328/0 e 0 to 0 dl 1784189378 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1784189367.893833:0:26168:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9dc080df3b80 x1870854436390144/t0(0) o101->debedd94-805c-42a0-a5e5-41758b2012e9@192.168.203.12@tcp:558/0 lens 328/0 e 0 to 0 dl 1784189378 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784189367.893849:0:26168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc080df3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:debedd94-805c-42a0-a5e5-41758b2012e9+52:2395:x1870854436390144:12345-192.168.203.12@tcp:101:ldlm_lock_repla.0 Request processed in 40us (888us total) trans 0 rc 0/-999 00000100:00100000:0.0:1784189367.893854:0:26168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 5087 00000100:00000040:0.0:1784189367.893856:0:26168:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9dbf4512b000 : new rpc_count 7 00000100:00100000:0.0:1784189367.893864:0:26168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 5088 00000100:00000040:0.0:1784189367.893867:0:26168:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9dbf4512b000 : new rpc_count 8 00000100:00000040:0.0:1784189367.893870:0:26168:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9dc080df1180 x1870854436390272/t0(0) o101->debedd94-805c-42a0-a5e5-41758b2012e9@192.168.203.12@tcp:558/0 lens 328/0 e 0 to 0 dl 1784189378 ref 1 fl New:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784189367.893880:0:26168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc080df1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:debedd94-805c-42a0-a5e5-41758b2012e9+52:2395:x1870854436390272:12345-192.168.203.12@tcp:101:ldlm_lock_repla.0 00000020:00000040:0.0:1784189367.893888:0:26168:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff9dc080df1180 x1870854436390272/t0(0) o101->debedd94-805c-42a0-a5e5-41758b2012e9@192.168.203.12@tcp:558/0 lens 328/0 e 0 to 0 dl 1784189378 ref 1 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00000040:0.0:1784189367.893894:0:26168:0:(ldlm_lib.c:1774:target_request_copy_get()) RPC GETting export ffff9dbf4512b000 : new rpc_count 9 00010000:00080000:0.0:1784189367.893898:0:26168:0:(ldlm_lib.c:3187:target_queue_recovery_request()) @@@ queue lock replay req req@ffff9dc080df1180 x1870854436390272/t0(0) o101->debedd94-805c-42a0-a5e5-41758b2012e9@192.168.203.12@tcp:558/0 lens 328/0 e 0 to 0 dl 1784189378 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1784189367.893905:0:26168:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9dc080df1180 x1870854436390272/t0(0) o101->debedd94-805c-42a0-a5e5-41758b2012e9@192.168.203.12@tcp:558/0 lens 328/0 e 0 to 0 dl 1784189378 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784189367.893913:0:26168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc080df1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:debedd94-805c-42a0-a5e5-41758b2012e9+52:2395:x1870854436390272:12345-192.168.203.12@tcp:101:ldlm_lock_repla.0 Request processed in 35us (931us total) trans 0 rc 0/-999 00000100:00100000:0.0:1784189367.893918:0:26168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 5088 00000100:00000040:0.0:1784189367.893921:0:26168:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9dbf4512b000 : new rpc_count 8 00010000:00080000:0.0:1784189367.893963:0:96896:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 3, queue_len: 0, req_transno: 0, next_transno: 4294969018 00010000:00080000:0.0:1784189367.893966:0:96896:0:(ldlm_lib.c:2262:check_for_next_transno()) waking for completed recovery 00010000:00000040:0.0:1784189367.893977:0:96896:0:(ldlm_lib.c:2881:target_recovery_thread()) 2: lock replay stage - 1 clients 00010000:00080000:0.0:1784189367.893979:0:96896:0:(ldlm_lib.c:2452:target_next_replay_lock()) Waiting for lock 00010000:00080000:0.0:1784189367.893982:0:96896:0:(ldlm_lib.c:2282:check_for_next_lock()) waking for next lock 00010000:00080000:0.0:1784189367.893987:0:96896:0:(ldlm_lib.c:2888:target_recovery_thread()) @@@ processing lock from 192.168.203.12@tcp: req@ffff9dc080df0e00 x1870854436389376/t0(0) o101->debedd94-805c-42a0-a5e5-41758b2012e9@192.168.203.12@tcp:558/0 lens 328/0 e 0 to 0 dl 1784189378 ref 1 fl Complete:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:02000000:0.0:1784189367.893994:0:96896:0:(ldlm_lib.c:2889:target_recovery_thread()) *** cfs_fail_loc=32d, val=20*** 00010000:00000040:0.0:1784189367.902420:0:96896:0:(ldlm_lib.c:1790:target_request_copy_put()) RPC PUTting export ffff9dbf4512b000 : new rpc_count 7 00000020:00000040:0.0:1784189367.902441:0:96896:0:(genops.c:900:class_export_put()) PUTting export ffff9dbf4512b000 : new refcount 51 00010000:00080000:0.0:1784189367.902446:0:96896:0:(ldlm_lib.c:2452:target_next_replay_lock()) Waiting for lock 00010000:00080000:0.0:1784189367.902450:0:96896:0:(ldlm_lib.c:2282:check_for_next_lock()) waking for next lock 00010000:00080000:0.0:1784189367.902463:0:96896:0:(ldlm_lib.c:2888:target_recovery_thread()) @@@ processing lock from 192.168.203.12@tcp: req@ffff9dc080df0700 x1870854436389504/t0(0) o101->debedd94-805c-42a0-a5e5-41758b2012e9@192.168.203.12@tcp:558/0 lens 328/0 e 0 to 0 dl 1784189378 ref 1 fl Complete:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:02000000:0.0:1784189367.902474:0:96896:0:(ldlm_lib.c:2889:target_recovery_thread()) *** cfs_fail_loc=32d, val=20*** 00010000:00000040:0.0:1784189367.902476:0:96896:0:(ldlm_lib.c:1790:target_request_copy_put()) RPC PUTting export ffff9dbf4512b000 : new rpc_count 6 00000020:00000040:0.0:1784189367.902482:0:96896:0:(genops.c:900:class_export_put()) PUTting export ffff9dbf4512b000 : new refcount 50 00010000:00080000:0.0:1784189367.902485:0:96896:0:(ldlm_lib.c:2452:target_next_replay_lock()) Waiting for lock 00010000:00080000:0.0:1784189367.902486:0:96896:0:(ldlm_lib.c:2282:check_for_next_lock()) waking for next lock 00010000:00080000:0.0:1784189367.902491:0:96896:0:(ldlm_lib.c:2888:target_recovery_thread()) @@@ processing lock from 192.168.203.12@tcp: req@ffff9dc081cd2c50 x1870854436389632/t0(0) o101->debedd94-805c-42a0-a5e5-41758b2012e9@192.168.203.12@tcp:558/0 lens 328/0 e 0 to 0 dl 1784189378 ref 1 fl Complete:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:02000000:0.0:1784189367.902498:0:96896:0:(ldlm_lib.c:2889:target_recovery_thread()) *** cfs_fail_loc=32d, val=20*** 00010000:00000040:0.0:1784189367.902500:0:96896:0:(ldlm_lib.c:1790:target_request_copy_put()) RPC PUTting export ffff9dbf4512b000 : new rpc_count 5 00000020:00000040:0.0:1784189367.902504:0:96896:0:(genops.c:900:class_export_put()) PUTting export ffff9dbf4512b000 : new refcount 49 00010000:00080000:0.0:1784189367.902506:0:96896:0:(ldlm_lib.c:2452:target_next_replay_lock()) Waiting for lock 00010000:00080000:0.0:1784189367.902508:0:96896:0:(ldlm_lib.c:2282:check_for_next_lock()) waking for next lock 00010000:00080000:0.0:1784189367.902512:0:96896:0:(ldlm_lib.c:2888:target_recovery_thread()) @@@ processing lock from 192.168.203.12@tcp: req@ffff9dc080df0380 x1870854436389760/t0(0) o101->debedd94-805c-42a0-a5e5-41758b2012e9@192.168.203.12@tcp:558/0 lens 328/0 e 0 to 0 dl 1784189378 ref 1 fl Complete:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:02000000:0.0:1784189367.902520:0:96896:0:(ldlm_lib.c:2889:target_recovery_thread()) *** cfs_fail_loc=32d, val=20*** 00010000:00000040:0.0:1784189367.902522:0:96896:0:(ldlm_lib.c:1790:target_request_copy_put()) RPC PUTting export ffff9dbf4512b000 : new rpc_count 4 00000020:00000040:0.0:1784189367.902526:0:96896:0:(genops.c:900:class_export_put()) PUTting export ffff9dbf4512b000 : new refcount 48 00010000:00080000:0.0:1784189367.902528:0:96896:0:(ldlm_lib.c:2452:target_next_replay_lock()) Waiting for lock 00010000:00080000:0.0:1784189367.902543:0:96896:0:(ldlm_lib.c:2282:check_for_next_lock()) waking for next lock 00010000:00080000:0.0:1784189367.902548:0:96896:0:(ldlm_lib.c:2888:target_recovery_thread()) @@@ processing lock from 192.168.203.12@tcp: req@ffff9dc080df2300 x1870854436389888/t0(0) o101->debedd94-805c-42a0-a5e5-41758b2012e9@192.168.203.12@tcp:558/0 lens 328/0 e 0 to 0 dl 1784189378 ref 1 fl Complete:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:02000000:0.0:1784189367.902554:0:96896:0:(ldlm_lib.c:2889:target_recovery_thread()) *** cfs_fail_loc=32d, val=20*** 00010000:00000040:0.0:1784189367.902556:0:96896:0:(ldlm_lib.c:1790:target_request_copy_put()) RPC PUTting export ffff9dbf4512b000 : new rpc_count 3 00000020:00000040:0.0:1784189367.902561:0:96896:0:(genops.c:900:class_export_put()) PUTting export ffff9dbf4512b000 : new refcount 47 00010000:00080000:0.0:1784189367.902563:0:96896:0:(ldlm_lib.c:2452:target_next_replay_lock()) Waiting for lock 00010000:00080000:0.0:1784189367.902565:0:96896:0:(ldlm_lib.c:2282:check_for_next_lock()) waking for next lock 00010000:00080000:0.0:1784189367.902569:0:96896:0:(ldlm_lib.c:2888:target_recovery_thread()) @@@ processing lock from 192.168.203.12@tcp: req@ffff9dc080df1f80 x1870854436390016/t0(0) o101->debedd94-805c-42a0-a5e5-41758b2012e9@192.168.203.12@tcp:558/0 lens 328/0 e 0 to 0 dl 1784189378 ref 1 fl Complete:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:02000000:0.0:1784189367.902575:0:96896:0:(ldlm_lib.c:2889:target_recovery_thread()) *** cfs_fail_loc=32d, val=20*** 00010000:00000040:0.0:1784189367.902576:0:96896:0:(ldlm_lib.c:1790:target_request_copy_put()) RPC PUTting export ffff9dbf4512b000 : new rpc_count 2 00000020:00000040:0.0:1784189367.902580:0:96896:0:(genops.c:900:class_export_put()) PUTting export ffff9dbf4512b000 : new refcount 46 00010000:00080000:0.0:1784189367.902582:0:96896:0:(ldlm_lib.c:2452:target_next_replay_lock()) Waiting for lock 00010000:00080000:0.0:1784189367.902583:0:96896:0:(ldlm_lib.c:2282:check_for_next_lock()) waking for next lock 00010000:00080000:0.0:1784189367.902587:0:96896:0:(ldlm_lib.c:2888:target_recovery_thread()) @@@ processing lock from 192.168.203.12@tcp: req@ffff9dc080df3b80 x1870854436390144/t0(0) o101->debedd94-805c-42a0-a5e5-41758b2012e9@192.168.203.12@tcp:558/0 lens 328/0 e 0 to 0 dl 1784189378 ref 1 fl Complete:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:02000000:0.0:1784189367.902594:0:96896:0:(ldlm_lib.c:2889:target_recovery_thread()) *** cfs_fail_loc=32d, val=20*** 00010000:00000040:0.0:1784189367.902595:0:96896:0:(ldlm_lib.c:1790:target_request_copy_put()) RPC PUTting export ffff9dbf4512b000 : new rpc_count 1 00000020:00000040:0.0:1784189367.902599:0:96896:0:(genops.c:900:class_export_put()) PUTting export ffff9dbf4512b000 : new refcount 45 00010000:00080000:0.0:1784189367.902601:0:96896:0:(ldlm_lib.c:2452:target_next_replay_lock()) Waiting for lock 00010000:00080000:0.0:1784189367.902602:0:96896:0:(ldlm_lib.c:2282:check_for_next_lock()) waking for next lock 00010000:00080000:0.0:1784189367.902607:0:96896:0:(ldlm_lib.c:2888:target_recovery_thread()) @@@ processing lock from 192.168.203.12@tcp: req@ffff9dc080df1180 x1870854436390272/t0(0) o101->debedd94-805c-42a0-a5e5-41758b2012e9@192.168.203.12@tcp:558/0 lens 328/0 e 0 to 0 dl 1784189378 ref 1 fl Complete:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:02000000:0.0:1784189367.902625:0:96896:0:(ldlm_lib.c:2889:target_recovery_thread()) *** cfs_fail_loc=32d, val=20*** 00010000:00000040:0.0:1784189367.902627:0:96896:0:(ldlm_lib.c:1790:target_request_copy_put()) RPC PUTting export ffff9dbf4512b000 : new rpc_count 0 00000020:00000040:0.0:1784189367.902632:0:96896:0:(genops.c:900:class_export_put()) PUTting export ffff9dbf4512b000 : new refcount 44 00010000:00080000:0.0:1784189367.902634:0:96896:0:(ldlm_lib.c:2452:target_next_replay_lock()) Waiting for lock 00010000:00010000:3.0:1784189368.051920:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000040:2.0:1784189368.108291:0:97044:0:(obd_config.c:994:class_incref()) incref lustre-MDT0000-osd (ffff9dc07547b380) now 12 - health_check_show 00000020:00000040:2.0:1784189368.108303:0:97044:0:(obd_config.c:1022:class_decref()) Decref lustre-MDT0000-osd (ffff9dc07547b380) now 12 - health_check_show 00000020:00000040:2.0:1784189368.108306:0:97044:0:(obd_config.c:994:class_incref()) incref lustre-MDT0001-osd (ffff9dc07a900000) now 10 - health_check_show 00000020:00000040:2.0:1784189368.108313:0:97044:0:(obd_config.c:1022:class_decref()) Decref lustre-MDT0001-osd (ffff9dc07a900000) now 10 - health_check_show 00000020:00000040:2.0:1784189368.108315:0:97044:0:(obd_config.c:994:class_incref()) incref MGC192.168.203.112@tcp (ffff9dc06bb30000) now 6 - health_check_show 00000020:00000040:2.0:1784189368.108474:0:97044:0:(obd_config.c:1022:class_decref()) Decref MGC192.168.203.112@tcp (ffff9dc06bb30000) now 6 - health_check_show 00000020:00000040:2.0:1784189368.108477:0:97044:0:(obd_config.c:994:class_incref()) incref MGS (ffff9dbf42000000) now 8 - health_check_show 00000020:00000040:2.0:1784189368.108482:0:97044:0:(obd_config.c:1022:class_decref()) Decref MGS (ffff9dbf42000000) now 8 - health_check_show 00000020:00000040:2.0:1784189368.108484:0:97044:0:(obd_config.c:994:class_incref()) incref MDS (ffff9dbf43128000) now 4 - health_check_show 00000020:00000040:2.0:1784189368.108490:0:97044:0:(obd_config.c:1022:class_decref()) Decref MDS (ffff9dbf43128000) now 4 - health_check_show 00000020:00000040:2.0:1784189368.108493:0:97044:0:(obd_config.c:994:class_incref()) incref lustre-MDT0001-mdtlov (ffff9dc049be4d40) now 5 - health_check_show 00000020:00000040:2.0:1784189368.108495:0:97044:0:(obd_config.c:1022:class_decref()) Decref lustre-MDT0001-mdtlov (ffff9dc049be4d40) now 5 - health_check_show 00000020:00000040:2.0:1784189368.108497:0:97044:0:(obd_config.c:994:class_incref()) incref lustre-MDT0001 (ffff9dc071094d40) now 12 - health_check_show 00000020:00000040:2.0:1784189368.108500:0:97044:0:(obd_config.c:1022:class_decref()) Decref lustre-MDT0001 (ffff9dc071094d40) now 12 - health_check_show 00000020:00000040:2.0:1784189368.108502:0:97044:0:(obd_config.c:994:class_incref()) incref lustre-MDD0001 (ffff9dc071090000) now 5 - health_check_show 00000020:00000040:2.0:1784189368.108504:0:97044:0:(obd_config.c:1022:class_decref()) Decref lustre-MDD0001 (ffff9dc071090000) now 5 - health_check_show 00000020:00000040:2.0:1784189368.108506:0:97044:0:(obd_config.c:994:class_incref()) incref lustre-MDT0000-osp-MDT0001 (ffff9dc071093380) now 6 - health_check_show 00000020:00000040:2.0:1784189368.108508:0:97044:0:(obd_config.c:1022:class_decref()) Decref lustre-MDT0000-osp-MDT0001 (ffff9dc071093380) now 6 - health_check_show 00000020:00000040:2.0:1784189368.108510:0:97044:0:(obd_config.c:994:class_incref()) incref lustre-OST0000-osc-MDT0001 (ffff9dc07a9019c0) now 6 - health_check_show 00000020:00000040:2.0:1784189368.108512:0:97044:0:(obd_config.c:1022:class_decref()) Decref lustre-OST0000-osc-MDT0001 (ffff9dc07a9019c0) now 6 - health_check_show 00000020:00000040:2.0:1784189368.108514:0:97044:0:(obd_config.c:994:class_incref()) incref lustre-OST0001-osc-MDT0001 (ffff9dc07a7a3380) now 6 - health_check_show 00000020:00000040:2.0:1784189368.108516:0:97044:0:(obd_config.c:1022:class_decref()) Decref lustre-OST0001-osc-MDT0001 (ffff9dc07a7a3380) now 6 - health_check_show 00000020:00000040:2.0:1784189368.108518:0:97044:0:(obd_config.c:994:class_incref()) incref lustre-MDT0000-lwp-MDT0001 (ffff9dbf449f19c0) now 6 - health_check_show 00000020:00000040:2.0:1784189368.108520:0:97044:0:(obd_config.c:1022:class_decref()) Decref lustre-MDT0000-lwp-MDT0001 (ffff9dbf449f19c0) now 6 - health_check_show 00000020:00000040:2.0:1784189368.108522:0:97044:0:(obd_config.c:994:class_incref()) incref lustre-MDT0000-mdtlov (ffff9dc07547cd40) now 5 - health_check_show 00000020:00000040:2.0:1784189368.108524:0:97044:0:(obd_config.c:1022:class_decref()) Decref lustre-MDT0000-mdtlov (ffff9dc07547cd40) now 5 - health_check_show 00000020:00000040:2.0:1784189368.108526:0:97044:0:(obd_config.c:994:class_incref()) incref lustre-MDT0000 (ffff9dc075478000) now 16 - health_check_show 00000020:00000040:2.0:1784189368.108528:0:97044:0:(obd_config.c:1022:class_decref()) Decref lustre-MDT0000 (ffff9dc075478000) now 16 - health_check_show 00000020:00000040:2.0:1784189368.108530:0:97044:0:(obd_config.c:994:class_incref()) incref lustre-MDD0000 (ffff9dc07a7a19c0) now 5 - health_check_show 00000020:00000040:2.0:1784189368.108532:0:97044:0:(obd_config.c:1022:class_decref()) Decref lustre-MDD0000 (ffff9dc07a7a19c0) now 5 - health_check_show 00000020:00000040:2.0:1784189368.108534:0:97044:0:(obd_config.c:994:class_incref()) incref lustre-QMT0000 (ffff9dc07a904d40) now 5 - health_check_show 00000020:00000040:2.0:1784189368.108542:0:97044:0:(obd_config.c:1022:class_decref()) Decref lustre-QMT0000 (ffff9dc07a904d40) now 5 - health_check_show 00000020:00000040:2.0:1784189368.108544:0:97044:0:(obd_config.c:994:class_incref()) incref lustre-OST0000-osd (ffff9dc0719699c0) now 6 - health_check_show 00000020:00000040:2.0:1784189368.108547:0:97044:0:(obd_config.c:1022:class_decref()) Decref lustre-OST0000-osd (ffff9dc0719699c0) now 6 - health_check_show 00000020:00000040:2.0:1784189368.108550:0:97044:0:(obd_config.c:994:class_incref()) incref OSS (ffff9dc076298000) now 4 - health_check_show 00000020:00000040:2.0:1784189368.108556:0:97044:0:(obd_config.c:1022:class_decref()) Decref OSS (ffff9dc076298000) now 4 - health_check_show 00000020:00000040:2.0:1784189368.108558:0:97044:0:(obd_config.c:994:class_incref()) incref lustre-OST0000 (ffff9dc07a7a0000) now 10 - health_check_show 00000020:00000040:2.0:1784189368.108922:0:97044:0:(obd_config.c:1022:class_decref()) Decref lustre-OST0000 (ffff9dc07a7a0000) now 10 - health_check_show 00000020:00000040:2.0:1784189368.108926:0:97044:0:(obd_config.c:994:class_incref()) incref lustre-MDT0000-lwp-OST0000 (ffff9dc07196b380) now 6 - health_check_show 00000020:00000040:2.0:1784189368.108928:0:97044:0:(obd_config.c:1022:class_decref()) Decref lustre-MDT0000-lwp-OST0000 (ffff9dc07196b380) now 6 - health_check_show 00000020:00000040:2.0:1784189368.108930:0:97044:0:(obd_config.c:994:class_incref()) incref lustre-MDT0001-lwp-OST0000 (ffff9dbf44d799c0) now 6 - health_check_show 00000020:00000040:2.0:1784189368.108932:0:97044:0:(obd_config.c:1022:class_decref()) Decref lustre-MDT0001-lwp-OST0000 (ffff9dbf44d799c0) now 6 - health_check_show 00000020:00000040:2.0:1784189368.108935:0:97044:0:(obd_config.c:994:class_incref()) incref lustre-MDT0001-osp-MDT0000 (ffff9dc07a903380) now 6 - health_check_show 00000020:00000040:2.0:1784189368.108936:0:97044:0:(obd_config.c:1022:class_decref()) Decref lustre-MDT0001-osp-MDT0000 (ffff9dc07a903380) now 6 - health_check_show 00000020:00000040:2.0:1784189368.108939:0:97044:0:(obd_config.c:994:class_incref()) incref lustre-OST0000-osc-MDT0000 (ffff9dbf420019c0) now 6 - health_check_show 00000020:00000040:2.0:1784189368.108941:0:97044:0:(obd_config.c:1022:class_decref()) Decref lustre-OST0000-osc-MDT0000 (ffff9dbf420019c0) now 6 - health_check_show 00000020:00000040:2.0:1784189368.108943:0:97044:0:(obd_config.c:994:class_incref()) incref lustre-OST0001-osd (ffff9dc07629b380) now 6 - health_check_show 00000020:00000040:2.0:1784189368.108946:0:97044:0:(obd_config.c:1022:class_decref()) Decref lustre-OST0001-osd (ffff9dc07629b380) now 6 - health_check_show 00000020:00000040:2.0:1784189368.108948:0:97044:0:(obd_config.c:994:class_incref()) incref lustre-OST0001 (ffff9dbf4312b380) now 10 - health_check_show 00000020:00000040:2.0:1784189368.108973:0:97044:0:(obd_config.c:1022:class_decref()) Decref lustre-OST0001 (ffff9dbf4312b380) now 10 - health_check_show 00000020:00000040:2.0:1784189368.108976:0:97044:0:(obd_config.c:994:class_incref()) incref lustre-MDT0000-lwp-OST0001 (ffff9dbf4312cd40) now 6 - health_check_show 00000020:00000040:2.0:1784189368.108978:0:97044:0:(obd_config.c:1022:class_decref()) Decref lustre-MDT0000-lwp-OST0001 (ffff9dbf4312cd40) now 6 - health_check_show 00000020:00000040:2.0:1784189368.108980:0:97044:0:(obd_config.c:994:class_incref()) incref lustre-MDT0001-lwp-OST0001 (ffff9dc0710919c0) now 6 - health_check_show 00000020:00000040:2.0:1784189368.108982:0:97044:0:(obd_config.c:1022:class_decref()) Decref lustre-MDT0001-lwp-OST0001 (ffff9dc0710919c0) now 6 - health_check_show 00000020:00000040:2.0:1784189368.108983:0:97044:0:(obd_config.c:994:class_incref()) incref lustre-OST0001-osc-MDT0000 (ffff9dbf431299c0) now 6 - health_check_show 00000020:00000040:2.0:1784189368.108985:0:97044:0:(obd_config.c:1022:class_decref()) Decref lustre-OST0001-osc-MDT0000 (ffff9dbf431299c0) now 6 - health_check_show 00000020:00000040:2.0:1784189368.108987:0:97044:0:(obd_config.c:994:class_incref()) incref lustre-MDT0000-lwp-MDT0000 (ffff9dc0762999c0) now 6 - health_check_show 00000020:00000040:2.0:1784189368.108988:0:97044:0:(obd_config.c:1022:class_decref()) Decref lustre-MDT0000-lwp-MDT0000 (ffff9dc0762999c0) now 6 - health_check_show 00000020:00000040:1.0:1784189368.879918:0:75595:0:(genops.c:1231:class_import_get()) import ffff9dbf436c4000 refcount=3 obd=lustre-MDT0000-osp-MDT0001 00000100:00000040:1.0:1784189368.879957:0:75595:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [000000006817ece8] to pc [ptlrpcd_00_02+2] req@ffff9dc05ed39f80 x1870854458276608/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/200/ffffffff rc 0/-1 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784189368.879994:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000020:00000040:3.0:1784189368.880222:0:94320:0:(genops.c:1231:class_import_get()) import ffff9dbf436c1800 refcount=3 obd=lustre-MDT0001-osp-MDT0000 00000100:00000040:3.0:1784189368.880239:0:94320:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [0000000009e275fc] to pc [ptlrpcd_00_03+3] req@ffff9dc080df3800 x1870854458276736/t0(0) o41->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/200/ffffffff rc 0/-1 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784189368.880505:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00000040:0.0:1784189368.880518:0:3642:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff9dc080df3800 x1870854458276736/t0(0) o41->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/200/ffffffff rc 0/-1 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784189368.880545:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc080df3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1870854458276736:0@lo:41:osp-pre-1-0.0 00000100:00000040:0.0:1784189368.880574:0:3642:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff9dc080df3800 x1870854458276736/t0(0) o41->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/368 e 0 to 0 dl 1784189384 ref 2 fl Rpc:r/200/ffffffff rc 0/-1 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1784189368.880582:0:3642:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1784189368.880627:0:3642:0:(events.c:337:request_in_callback()) incoming req@ffff9dc0505bea00 x1870854458276736 msgsize 224 00000100:00100000:0.0:1784189368.880632:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:0.0:1784189368.880661:0:3642:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff9dc080df3800 x1870854458276736/t0(0) o41->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/368 e 0 to 0 dl 1784189384 ref 2 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1784189368.880674:0:3642:0:(niobuf.c:635:kick_cpu_latency()) lustre-MDT0001-osp-MDT0000: using a timeout of 7783 usecs (8 jiffies) 00000100:00000040:1.0:1784189368.880788:0:3643:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff9dc05ed39f80 x1870854458276608/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/200/ffffffff rc 0/-1 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784189368.880801:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc05ed39f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1870854458276608:0@lo:41:osp-pre-0-1.0 00000100:00000040:1.0:1784189368.880817:0:3643:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff9dc05ed39f80 x1870854458276608/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/368 e 0 to 0 dl 1784189384 ref 2 fl Rpc:r/200/ffffffff rc 0/-1 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1784189368.880824:0:3643:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:1.0:1784189368.880838:0:3643:0:(events.c:337:request_in_callback()) incoming req@ffff9dc05ed3b100 x1870854458276608 msgsize 224 00000100:00100000:1.0:1784189368.880842:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:1.0:1784189368.880854:0:3643:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff9dc05ed39f80 x1870854458276608/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/368 e 0 to 0 dl 1784189384 ref 2 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1784189368.880883:0:3643:0:(niobuf.c:635:kick_cpu_latency()) lustre-MDT0000-osp-MDT0001: using a timeout of 1803105 usecs (1804 jiffies) 00000100:00100000:3.0:1784189368.881249:0:26492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458276736 00000100:00100000:3.0:1784189368.881257:0:26492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458276736 00000020:00000040:3.0:1784189368.881260:0:26492:0:(genops.c:825:class_conn2export()) looking for export cookie 0xcc1762b626f8c622 00000020:00000040:3.0:1784189368.881265:0:26492:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9dc047a80000 refcount=5 00000100:00000040:3.0:1784189368.881288:0:26492:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_out at +6s 00000100:00100000:3.0:1784189368.881341:0:26492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458276608 00000100:00100000:3.0:1784189368.881344:0:26492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458276608 00000020:00000040:3.0:1784189368.881346:0:26492:0:(genops.c:825:class_conn2export()) looking for export cookie 0xcc1762b626f8c5dc 00000020:00000040:3.0:1784189368.881349:0:26492:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9dbf47a3f000 refcount=7 00000100:00100000:3.0:1784189368.881373:0:26492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3971 00000100:00000040:3.0:1784189368.881377:0:26492:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9dc047a80000 : new rpc_count 1 00000100:00000040:3.0:1784189368.881383:0:26492:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9dc0505bea00 x1870854458276736/t0(0) o41->lustre-MDT0000-mdtlov_UUID@0@lo:559/0 lens 224/0 e 0 to 0 dl 1784189379 ref 1 fl New:/200/ffffffff rc 0/-1 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784189368.881393:0:26492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc0505bea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3642:x1870854458276736:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1784189368.881427:0:26492:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445568512 avail 1299329024 00010000:00000040:3.0:1784189368.881440:0:26492:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 0, transno 0, xid 1870854458276736 00000100:00000040:3.0:1784189368.881449:0:26492:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9dc0710a1d00 refcount 66 to 0@lo 00000100:00000040:3.0:1784189368.881461:0:26492:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:3.0:1784189368.881484:0:26492:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=368 offset=224 replen=368 req@ffff9dc080df3800 x1870854458276736/t0(0) o41->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/368 e 0 to 0 dl 1784189384 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1784189368.881501:0:26492:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff9dc0710a1d00 refcount 65 to 0@lo 00000100:00000040:3.0:1784189368.881506:0:26492:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9dc0505bea00 x1870854458276736/t0(0) o41->lustre-MDT0000-mdtlov_UUID@0@lo:559/0 lens 224/368 e 0 to 0 dl 1784189379 ref 1 fl Interpret:/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784189368.881515:0:26492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc0505bea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3642:x1870854458276736:12345-0@lo:41:osp-pre-1-0.0 Request processed in 123us (886us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189368.881521:0:26492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3971 00000100:00000040:3.0:1784189368.881524:0:26492:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9dc047a80000 : new rpc_count 0 00000020:00000040:3.0:1784189368.881533:0:26492:0:(genops.c:900:class_export_put()) PUTting export ffff9dc047a80000 : new refcount 4 00000100:00100000:3.0:1784189368.881545:0:26492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3972 00000100:00000040:3.0:1784189368.881548:0:26492:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9dbf47a3f000 : new rpc_count 1 00000100:00000040:3.0:1784189368.881552:0:26492:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9dc05ed3b100 x1870854458276608/t0(0) o41->lustre-MDT0001-mdtlov_UUID@0@lo:559/0 lens 224/0 e 0 to 0 dl 1784189379 ref 1 fl New:/200/ffffffff rc 0/-1 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784189368.881561:0:26492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc05ed3b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3643:x1870854458276608:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1784189368.881578:0:26492:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445249024 avail 1299009536 00010000:00000040:3.0:1784189368.881586:0:26492:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 120259084290, transno 0, xid 1870854458276608 00000100:00000040:3.0:1784189368.881591:0:26492:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9dc0710a1d00 refcount 66 to 0@lo 00000100:00000040:3.0:1784189368.881594:0:26492:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:3.0:1784189368.881620:0:26492:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=368 offset=224 replen=368 req@ffff9dc05ed39f80 x1870854458276608/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/368 e 0 to 0 dl 1784189384 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1784189368.881637:0:26492:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff9dc0710a1d00 refcount 65 to 0@lo 00000100:00000040:3.0:1784189368.881642:0:26492:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9dc05ed3b100 x1870854458276608/t0(0) o41->lustre-MDT0001-mdtlov_UUID@0@lo:559/0 lens 224/368 e 0 to 0 dl 1784189379 ref 1 fl Interpret:/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784189368.881650:0:26492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc05ed3b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3643:x1870854458276608:12345-0@lo:41:osp-pre-0-1.0 Request processed in 89us (809us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189368.881663:0:26492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3972 00000100:00000040:3.0:1784189368.881666:0:26492:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9dbf47a3f000 : new rpc_count 0 00000020:00000040:3.0:1784189368.881672:0:26492:0:(genops.c:900:class_export_put()) PUTting export ffff9dbf47a3f000 : new refcount 6 00000100:00000040:3.0:1784189368.881714:0:3643:0:(client.c:3108:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: skip recheck: last_committed 120259084290 00000100:00000040:3.0:1784189368.881720:0:3643:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff9dc05ed39f80 x1870854458276608/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/368 e 0 to 0 dl 1784189384 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000004:00000040:3.0:1784189368.881731:0:3643:0:(osp_precreate.c:1081:osp_pre_update_msfs()) lustre-MDT0000-osp-MDT0001: blocks=353529 free=352844 avail=317141 avail_mb=1238 hwm_mb=3 files=1024000 ffree=1023576 state=0: rc = 0 00000100:00000040:3.0:1784189368.881738:0:3643:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9dc05ed39f80 x1870854458276608/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/368 e 0 to 0 dl 1784189384 ref 1 fl Interpret:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784189368.881746:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc05ed39f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1870854458276608:0@lo:41:osp-pre-0-1.0 00000100:00000040:3.0:1784189368.881752:0:3643:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff9dc05ed39f80 x1870854458276608/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/368 e 0 to 0 dl 1784189384 ref 1 fl Complete:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000020:00000040:3.0:1784189368.881761:0:3643:0:(genops.c:1244:class_import_put()) import ffff9dbf436c4000 refcount=2 obd=lustre-MDT0000-osp-MDT0001 00000100:00000040:0.0:1784189368.883732:0:3642:0:(client.c:3108:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: skip recheck: last_committed 0 00000100:00000040:0.0:1784189368.883748:0:3642:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff9dc080df3800 x1870854458276736/t0(0) o41->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/368 e 0 to 0 dl 1784189384 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000004:00000040:0.0:1784189368.883763:0:3642:0:(osp_precreate.c:1081:osp_pre_update_msfs()) lustre-MDT0001-osp-MDT0000: blocks=353529 free=352922 avail=317219 avail_mb=1239 hwm_mb=3 files=1024000 ffree=1023682 state=0: rc = 0 00000100:00000040:0.0:1784189368.883772:0:3642:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9dc080df3800 x1870854458276736/t0(0) o41->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/368 e 0 to 0 dl 1784189384 ref 1 fl Interpret:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784189368.883779:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc080df3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1870854458276736:0@lo:41:osp-pre-1-0.0 00000100:00000040:0.0:1784189368.883786:0:3642:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff9dc080df3800 x1870854458276736/t0(0) o41->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/368 e 0 to 0 dl 1784189384 ref 1 fl Complete:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000020:00000040:0.0:1784189368.883796:0:3642:0:(genops.c:1244:class_import_put()) import ffff9dbf436c1800 refcount=2 obd=lustre-MDT0001-osp-MDT0000 00010000:00010000:3.0:1784189369.074903:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000040:0.0:1784189369.392199:0:94324:0:(genops.c:1231:class_import_get()) import ffff9dbf4845c000 refcount=3 obd=lustre-OST0001-osc-MDT0000 00000100:00000040:0.0:1784189369.392237:0:94324:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [0000000068f23c22] to pc [ptlrpcd_00_00+0] req@ffff9dc0505bc700 x1870854458276864/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/200/ffffffff rc 0/-1 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1784189369.392269:0:3640:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff9dc0505bc700 x1870854458276864/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/200/ffffffff rc 0/-1 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784189369.392293:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc0505bc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1870854458276864:0@lo:13:osp-pre-1-0.0 00000100:00000040:0.0:1784189369.392340:0:3640:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff9dc0505bc700 x1870854458276864/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784189385 ref 2 fl Rpc:r/200/ffffffff rc 0/-1 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1784189369.392348:0:3640:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1784189369.392384:0:3640:0:(events.c:337:request_in_callback()) incoming req@ffff9dc0505bca80 x1870854458276864 msgsize 224 00000100:00100000:0.0:1784189369.392388:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:0.0:1784189369.392404:0:3640:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff9dc0505bc700 x1870854458276864/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784189385 ref 2 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1784189369.392415:0:3640:0:(niobuf.c:635:kick_cpu_latency()) lustre-OST0001-osc-MDT0000: using a timeout of 6891 usecs (7 jiffies) 00000100:00100000:0.0:1784189369.392446:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458276864 00000100:00100000:0.0:1784189369.392452:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458276864 00000020:00000040:0.0:1784189369.392454:0:8431:0:(genops.c:825:class_conn2export()) looking for export cookie 0xcc1762b626f8c64c 00000020:00000040:0.0:1784189369.392458:0:8431:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9dbf47452800 refcount=5 00000020:00000040:0.0:1784189369.392468:0:8431:0:(obd_config.c:994:class_incref()) incref lustre-OST0001 (ffff9dbf4312b380) now 10 - evictor 00000100:00000040:0.0:1784189369.392486:0:8431:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_create at +6s 00000100:00100000:0.0:1784189369.392508:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2094 00000100:00000040:0.0:1784189369.392512:0:8431:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9dbf47452800 : new rpc_count 1 00000100:00000040:0.0:1784189369.392517:0:8431:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9dc0505bca80 x1870854458276864/t0(0) o13->lustre-MDT0000-mdtlov_UUID@0@lo:560/0 lens 224/0 e 0 to 0 dl 1784189380 ref 1 fl New:/200/ffffffff rc 0/-1 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784189369.392527:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc0505bca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1870854458276864:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1784189369.392554:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8646976 pending 0 free 3923529728 avail 3692007424 00010000:00000040:0.0:1784189369.392562:0:8431:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 4294968960, transno 0, xid 1870854458276864 00000100:00000040:0.0:1784189369.392571:0:8431:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9dc0710a1d00 refcount 66 to 0@lo 00000100:00000040:0.0:1784189369.392575:0:8431:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1784189369.392612:0:8431:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=368 offset=224 replen=368 req@ffff9dc0505bc700 x1870854458276864/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784189385 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1784189369.392630:0:8431:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff9dc0710a1d00 refcount 65 to 0@lo 00000100:00000040:0.0:1784189369.392641:0:8431:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9dc0505bca80 x1870854458276864/t0(0) o13->lustre-MDT0000-mdtlov_UUID@0@lo:560/0 lens 224/368 e 0 to 0 dl 1784189380 ref 1 fl Interpret:/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784189369.392648:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc0505bca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1870854458276864:12345-0@lo:13:osp-pre-1-0.0 Request processed in 123us (263us total) trans 0 rc 0/0 00000100:00100000:0.0:1784189369.392655:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2094 00000100:00000040:0.0:1784189369.392658:0:8431:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9dbf47452800 : new rpc_count 0 00000020:00000040:0.0:1784189369.392666:0:8431:0:(genops.c:900:class_export_put()) PUTting export ffff9dbf47452800 : new refcount 4 00000100:00080000:0.0:1784189369.392679:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000020:00000040:0.0:1784189369.392682:0:6509:0:(obd_config.c:1022:class_decref()) Decref lustre-OST0001 (ffff9dbf4312b380) now 10 - evictor 00000100:00000040:0.0:1784189369.392709:0:3640:0:(client.c:3108:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: skip recheck: last_committed 4294968960 00000100:00000040:0.0:1784189369.392713:0:3640:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff9dc0505bc700 x1870854458276864/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784189385 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000004:00000040:0.0:1784189369.392722:0:3640:0:(osp_precreate.c:87:osp_pre_update_status_msfs()) lustre-OST0001-osc-MDT0000: Updating status = 0 00000004:00000040:0.0:1784189369.392725:0:3640:0:(osp_precreate.c:1081:osp_pre_update_msfs()) lustre-OST0001-osc-MDT0000: blocks=958279 free=957893 avail=901318 avail_mb=3520 hwm_mb=7 files=262144 ffree=261731 state=0: rc = 0 00000100:00000040:0.0:1784189369.392732:0:3640:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9dc0505bc700 x1870854458276864/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784189385 ref 1 fl Interpret:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784189369.392738:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc0505bc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1870854458276864:0@lo:13:osp-pre-1-0.0 00000100:00000040:0.0:1784189369.392743:0:3640:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff9dc0505bc700 x1870854458276864/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784189385 ref 1 fl Complete:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000020:00000040:0.0:1784189369.392753:0:3640:0:(genops.c:1244:class_import_put()) import ffff9dbf4845c000 refcount=2 obd=lustre-OST0001-osc-MDT0000 00000100:00000040:0.0:1784189369.642827:0:3633:0:(events.c:337:request_in_callback()) incoming req@ffff9dc044941c50 x1870854436390400 msgsize 224 00000100:00100000:0.0:1784189369.642842:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00000040:0.0:1784189369.642844:0:3633:0:(events.c:349:request_in_callback()) Buffer complete: 63 buffers still posted 00000100:00000040:0.0:1784189369.642873:0:3633:0:(events.c:337:request_in_callback()) incoming req@ffff9dc0505bc700 x1870854436390656 msgsize 224 00000100:00100000:0.0:1784189369.642878:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00000040:0.0:1784189369.642894:0:3633:0:(events.c:337:request_in_callback()) incoming req@ffff9dc0505bdc00 x1870854436390528 msgsize 224 00000100:00100000:0.0:1784189369.642904:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00000040:0.0:1784189369.642933:0:3633:0:(events.c:337:request_in_callback()) incoming req@ffff9dc0505bd180 x1870854436390784 msgsize 224 00000100:00100000:0.0:1784189369.642937:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1784189369.642965:0:94308:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436390400 00000100:00100000:0.0:1784189369.642973:0:94308:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436390400 00000020:00000040:0.0:1784189369.642976:0:94308:0:(genops.c:825:class_conn2export()) looking for export cookie 0xcc1762b626f8c756 00000020:00000040:0.0:1784189369.642980:0:94308:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9dc0756a3800 refcount=10 00000100:00000040:0.0:1784189369.643004:0:94308:0:(service.c:1432:ptlrpc_at_set_timer()) armed mgs at +6s 00000100:00100000:0.0:1784189369.643043:0:94308:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 211 00000100:00000040:0.0:1784189369.643047:0:94308:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9dc0756a3800 : new rpc_count 1 00000100:00000040:0.0:1784189369.643054:0:94308:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9dc044941c50 x1870854436390400/t0(0) o400->60f345e3-c70e-4f53-b5e7-c9671463c9a5@192.168.203.12@tcp:560/0 lens 224/0 e 0 to 0 dl 1784189380 ref 1 fl New:/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784189369.643068:0:94308:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc044941c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:60f345e3-c70e-4f53-b5e7-c9671463c9a5+10:2396:x1870854436390400:12345-192.168.203.12@tcp:400:kworker.0 00010000:00000040:0.0:1784189369.643087:0:94308:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 0, transno 0, xid 1870854436390400 00000100:00000040:0.0:1784189369.643096:0:94308:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9dbf4274f140 refcount 11 to 192.168.203.12@tcp 00000100:00000040:0.0:1784189369.643101:0:94308:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.203.12@tcp 00000100:00000040:0.0:1784189369.643137:0:94308:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff9dbf4274f140 refcount 10 to 192.168.203.12@tcp 00000100:00000040:0.0:1784189369.643142:0:94308:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9dc044941c50 x1870854436390400/t0(0) o400->60f345e3-c70e-4f53-b5e7-c9671463c9a5@192.168.203.12@tcp:560/0 lens 224/224 e 0 to 0 dl 1784189380 ref 1 fl Interpret:/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784189369.643151:0:94308:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc044941c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:60f345e3-c70e-4f53-b5e7-c9671463c9a5+10:2396:x1870854436390400:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 85us (324us total) trans 0 rc 0/0 00000100:00100000:0.0:1784189369.643158:0:94308:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 211 00000100:00000040:0.0:1784189369.643161:0:94308:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9dc0756a3800 : new rpc_count 0 00000020:00000040:0.0:1784189369.643170:0:94308:0:(genops.c:900:class_export_put()) PUTting export ffff9dc0756a3800 : new refcount 9 00000100:00100000:1.0:1784189369.643197:0:26167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436390784 00000100:00100000:1.0:1784189369.643200:0:26167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436390784 00000020:00000040:1.0:1784189369.643203:0:26167:0:(genops.c:825:class_conn2export()) looking for export cookie 0xcc1762b626f8c994 00000020:00000040:1.0:1784189369.643206:0:26167:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9dc047a82800 refcount=7 00000020:00000040:1.0:1784189369.643216:0:26167:0:(obd_config.c:994:class_incref()) incref lustre-OST0001 (ffff9dbf4312b380) now 10 - evictor 00000100:00100000:1.0:1784189369.643247:0:26167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 2617 00000100:00000040:1.0:1784189369.643250:0:26167:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9dc047a82800 : new rpc_count 1 00000100:00000040:1.0:1784189369.643254:0:26167:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9dc0505bd180 x1870854436390784/t0(0) o400->debedd94-805c-42a0-a5e5-41758b2012e9@192.168.203.12@tcp:560/0 lens 224/0 e 0 to 0 dl 1784189380 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784189369.643266:0:26167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc0505bd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:debedd94-805c-42a0-a5e5-41758b2012e9+7:2396:x1870854436390784:12345-192.168.203.12@tcp:400:kworker.0 00010000:00000040:1.0:1784189369.643276:0:26167:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 0, transno 0, xid 1870854436390784 00000100:00000040:1.0:1784189369.643281:0:26167:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9dbf4274f140 refcount 11 to 192.168.203.12@tcp 00000100:00000040:1.0:1784189369.643285:0:26167:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.203.12@tcp 00000100:00080000:0.0:1784189369.643289:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000020:00000040:0.0:1784189369.643293:0:6509:0:(obd_config.c:1022:class_decref()) Decref lustre-OST0001 (ffff9dbf4312b380) now 10 - evictor 00000100:00000040:1.0:1784189369.643303:0:26167:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff9dbf4274f140 refcount 10 to 192.168.203.12@tcp 00000100:00000040:1.0:1784189369.643308:0:26167:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9dc0505bd180 x1870854436390784/t0(0) o400->debedd94-805c-42a0-a5e5-41758b2012e9@192.168.203.12@tcp:560/0 lens 224/224 e 0 to 0 dl 1784189380 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784189369.643335:0:26167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc0505bd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:debedd94-805c-42a0-a5e5-41758b2012e9+7:2396:x1870854436390784:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 52us (382us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189369.643343:0:26167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 2617 00000100:00000040:1.0:1784189369.643345:0:26167:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9dc047a82800 : new rpc_count 0 00000020:00000040:1.0:1784189369.643352:0:26167:0:(genops.c:900:class_export_put()) PUTting export ffff9dc047a82800 : new refcount 6 00000100:00100000:1.0:1784189369.643366:0:66169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436390656 00000100:00100000:1.0:1784189369.643369:0:66169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436390656 00000020:00000040:1.0:1784189369.643371:0:66169:0:(genops.c:825:class_conn2export()) looking for export cookie 0xcc1762b626f8bbf6 00000020:00000040:1.0:1784189369.643374:0:66169:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9dc04ffb2000 refcount=11 00000020:00000040:1.0:1784189369.643388:0:66169:0:(obd_config.c:994:class_incref()) incref lustre-MDT0001 (ffff9dc071094d40) now 12 - evictor 00000100:00000040:1.0:1784189369.643410:0:66169:0:(service.c:1432:ptlrpc_at_set_timer()) armed mdt at +6s 00000100:00100000:1.0:1784189369.643428:0:66169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436390528 00000100:00100000:1.0:1784189369.643431:0:66169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436390528 00000020:00000040:1.0:1784189369.643433:0:66169:0:(genops.c:825:class_conn2export()) looking for export cookie 0xcc1762b626f8c5e3 00000100:00080000:0.0:1784189369.643434:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000020:00000040:1.0:1784189369.643435:0:66169:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9dbf47a3b800 refcount=51 00000020:00000040:0.0:1784189369.643437:0:6509:0:(obd_config.c:1022:class_decref()) Decref lustre-MDT0001 (ffff9dc071094d40) now 12 - evictor 00000020:00000040:1.0:1784189369.643442:0:66169:0:(obd_config.c:994:class_incref()) incref lustre-MDT0000 (ffff9dc075478000) now 16 - evictor 00000100:00080000:0.0:1784189369.643457:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000020:00000040:0.0:1784189369.643459:0:6509:0:(obd_config.c:1022:class_decref()) Decref lustre-MDT0000 (ffff9dc075478000) now 16 - evictor 00000100:00100000:1.0:1784189369.643468:0:66169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1388 00000100:00000040:1.0:1784189369.643471:0:66169:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9dc04ffb2000 : new rpc_count 1 00000100:00000040:1.0:1784189369.643475:0:66169:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9dc0505bc700 x1870854436390656/t0(0) o400->debedd94-805c-42a0-a5e5-41758b2012e9@192.168.203.12@tcp:560/0 lens 224/0 e 0 to 0 dl 1784189380 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784189369.643487:0:66169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc0505bc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:debedd94-805c-42a0-a5e5-41758b2012e9+11:2396:x1870854436390656:12345-192.168.203.12@tcp:400:kworker.0 00010000:00000040:1.0:1784189369.643498:0:66169:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 81604378768, transno 0, xid 1870854436390656 00000100:00000040:1.0:1784189369.643503:0:66169:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9dbf4274f140 refcount 11 to 192.168.203.12@tcp 00000100:00000040:1.0:1784189369.643506:0:66169:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.203.12@tcp 00000100:00000040:1.0:1784189369.643532:0:66169:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff9dbf4274f140 refcount 10 to 192.168.203.12@tcp 00000100:00000040:1.0:1784189369.643538:0:66169:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9dc0505bc700 x1870854436390656/t0(0) o400->debedd94-805c-42a0-a5e5-41758b2012e9@192.168.203.12@tcp:560/0 lens 224/224 e 0 to 0 dl 1784189380 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784189369.643545:0:66169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc0505bc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:debedd94-805c-42a0-a5e5-41758b2012e9+11:2396:x1870854436390656:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 61us (670us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189369.643550:0:66169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1388 00000100:00000040:1.0:1784189369.643553:0:66169:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9dc04ffb2000 : new rpc_count 0 00000020:00000040:1.0:1784189369.643558:0:66169:0:(genops.c:900:class_export_put()) PUTting export ffff9dc04ffb2000 : new refcount 10 00000100:00100000:1.0:1784189369.643567:0:66169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1389 00000100:00000040:1.0:1784189369.643570:0:66169:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9dbf47a3b800 : new rpc_count 1 00000100:00000040:1.0:1784189369.643574:0:66169:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9dc0505bdc00 x1870854436390528/t0(0) o400->debedd94-805c-42a0-a5e5-41758b2012e9@192.168.203.12@tcp:560/0 lens 224/0 e 0 to 0 dl 1784189380 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784189369.643608:0:66169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc0505bdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:debedd94-805c-42a0-a5e5-41758b2012e9+51:2396:x1870854436390528:12345-192.168.203.12@tcp:400:kworker.0 00010000:00000040:1.0:1784189369.643620:0:66169:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 120259084438, transno 0, xid 1870854436390528 00000100:00000040:1.0:1784189369.643625:0:66169:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9dbf4274f140 refcount 11 to 192.168.203.12@tcp 00000100:00000040:1.0:1784189369.643628:0:66169:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.203.12@tcp 00000100:00000040:1.0:1784189369.643642:0:66169:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff9dbf4274f140 refcount 10 to 192.168.203.12@tcp 00000100:00000040:1.0:1784189369.643647:0:66169:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9dc0505bdc00 x1870854436390528/t0(0) o400->debedd94-805c-42a0-a5e5-41758b2012e9@192.168.203.12@tcp:560/0 lens 224/224 e 0 to 0 dl 1784189380 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784189369.643655:0:66169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc0505bdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:debedd94-805c-42a0-a5e5-41758b2012e9+51:2396:x1870854436390528:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 62us (759us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189369.643661:0:66169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1389 00000100:00000040:1.0:1784189369.643664:0:66169:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9dbf47a3b800 : new rpc_count 0 00000020:00000040:1.0:1784189369.643669:0:66169:0:(genops.c:900:class_export_put()) PUTting export ffff9dbf47a3b800 : new refcount 50 00010000:00010000:2.0:1784189370.095572:0:26173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00000040:3.0:1784189370.927891:0:93049:0:(pinger.c:229:ptlrpc_pinger_process_import()) bd553d0d-03e2-4233-b06b-b55bbfa2b954->MGS: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000020:00000040:3.0:1784189370.927905:0:93049:0:(genops.c:1231:class_import_get()) import ffff9dc07110c800 refcount=4 obd=MGC192.168.203.112@tcp 00000100:00000040:2.0:1784189370.929834:0:93049:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging bd553d0d-03e2-4233-b06b-b55bbfa2b954->MGS req@ffff9dc080df0000 x1870854458276992/t0(0) o400->MGC192.168.203.112@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:2.0:1784189370.929856:0:93049:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [00000000f95a8fa1] to pc [ptlrpcd_00_01+1] req@ffff9dc080df0000 x1870854458276992/t0(0) o400->MGC192.168.203.112@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1784189370.929885:0:93049:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000020:00000040:2.0:1784189370.929893:0:93049:0:(genops.c:1231:class_import_get()) import ffff9dbf425f4800 refcount=3 obd=lustre-MDT0000-lwp-OST0001 00000100:00000040:2.0:1784189370.929904:0:93049:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID req@ffff9dc07130fb80 x1870854458277120/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:2.0:1784189370.929914:0:93049:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [00000000e6f6e407] to pc [ptlrpcd_00_02+2] req@ffff9dc07130fb80 x1870854458277120/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1784189370.929933:0:93049:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000020:00000040:2.0:1784189370.929938:0:93049:0:(genops.c:1231:class_import_get()) import ffff9dbf43115800 refcount=3 obd=lustre-MDT0001-lwp-OST0001 00000100:00000040:2.0:1784189370.929946:0:93049:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID req@ffff9dc07130e300 x1870854458277248/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:2.0:1784189370.929956:0:93049:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [000000007bd84682] to pc [ptlrpcd_00_03+3] req@ffff9dc07130e300 x1870854458277248/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1784189370.929964:0:93049:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000020:00000040:2.0:1784189370.929968:0:93049:0:(genops.c:1231:class_import_get()) import ffff9dbf436c4000 refcount=3 obd=lustre-MDT0000-osp-MDT0001 00000100:00000040:2.0:1784189370.929974:0:93049:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID req@ffff9dc07130e680 x1870854458277376/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:2.0:1784189370.929983:0:93049:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [00000000f4b75469] to pc [ptlrpcd_00_00+0] req@ffff9dc07130e680 x1870854458277376/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1784189370.929992:0:93049:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level REPLAY_WAIT/7 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1784189370.930001:0:93049:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: REPLAY_WAIT) 00000100:00000040:2.0:1784189370.930004:0:93049:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000020:00000040:2.0:1784189370.930010:0:93049:0:(genops.c:1231:class_import_get()) import ffff9dc080cc8800 refcount=3 obd=lustre-OST0001-osc-MDT0001 00000100:00000040:2.0:1784189370.930019:0:93049:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID req@ffff9dc080d5e300 x1870854458277504/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:2.0:1784189370.930029:0:93049:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [0000000083b7dff3] to pc [ptlrpcd_00_01+1] req@ffff9dc080d5e300 x1870854458277504/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1784189370.930036:0:93049:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000020:00000040:2.0:1784189370.930041:0:93049:0:(genops.c:1231:class_import_get()) import ffff9dbf43690800 refcount=3 obd=lustre-MDT0000-lwp-MDT0001 00000100:00000040:2.0:1784189370.930048:0:93049:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID req@ffff9dc080d5c700 x1870854458277632/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:2.0:1784189370.930057:0:93049:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [00000000039cd6c6] to pc [ptlrpcd_00_02+2] req@ffff9dc080d5c700 x1870854458277632/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1784189370.930063:0:93049:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000020:00000040:2.0:1784189370.930068:0:93049:0:(genops.c:1231:class_import_get()) import ffff9dbf436c1800 refcount=3 obd=lustre-MDT0001-osp-MDT0000 00000100:00000040:2.0:1784189370.930075:0:93049:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID req@ffff9dc080d5ca80 x1870854458277760/t0(0) o400->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:2.0:1784189370.930083:0:93049:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [000000003e4c6689] to pc [ptlrpcd_00_03+3] req@ffff9dc080d5ca80 x1870854458277760/t0(0) o400->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1784189370.930090:0:93049:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level REPLAY_WAIT/7 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1784189370.930093:0:93049:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: REPLAY_WAIT) 00000100:00000040:2.0:1784189370.930095:0:93049:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000020:00000040:2.0:1784189370.930099:0:93049:0:(genops.c:1231:class_import_get()) import ffff9dbf4845c000 refcount=3 obd=lustre-OST0001-osc-MDT0000 00000100:00000040:2.0:1784189370.930112:0:93049:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID req@ffff9dc080d5f800 x1870854458277888/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:2.0:1784189370.930121:0:93049:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [00000000f86690ab] to pc [ptlrpcd_00_00+0] req@ffff9dc080d5f800 x1870854458277888/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1784189370.930129:0:93049:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000020:00000040:2.0:1784189370.930134:0:93049:0:(genops.c:1231:class_import_get()) import ffff9dbf43fcb000 refcount=3 obd=lustre-MDT0000-lwp-MDT0000 00000100:00000040:2.0:1784189370.930140:0:93049:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID req@ffff9dc080d5e680 x1870854458278016/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:2.0:1784189370.930148:0:93049:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [00000000ea7e27f3] to pc [ptlrpcd_00_01+1] req@ffff9dc080d5e680 x1870854458278016/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1784189370.930154:0:93049:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000020:00000040:2.0:1784189370.930158:0:93049:0:(genops.c:1231:class_import_get()) import ffff9dbf43d8c000 refcount=3 obd=lustre-MDT0000-lwp-OST0000 00000100:00000040:2.0:1784189370.930165:0:93049:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID req@ffff9dc080d5f100 x1870854458278144/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:2.0:1784189370.930173:0:93049:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [000000005ce0a07f] to pc [ptlrpcd_00_02+2] req@ffff9dc080d5f100 x1870854458278144/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1784189370.930181:0:93049:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000020:00000040:2.0:1784189370.930185:0:93049:0:(genops.c:1231:class_import_get()) import ffff9dbf44677800 refcount=3 obd=lustre-MDT0001-lwp-OST0000 00000100:00000040:2.0:1784189370.930191:0:93049:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID req@ffff9dc080d5ce00 x1870854458278272/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:2.0:1784189370.930199:0:93049:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [00000000dcb3a3e7] to pc [ptlrpcd_00_03+3] req@ffff9dc080d5ce00 x1870854458278272/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1784189370.930209:0:93049:0:(pinger.c:304:ptlrpc_pinger_main()) next wakeup in 1 (3618) 00000100:00000040:3.0:1784189370.930540:0:3643:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff9dc07130e300 x1870854458277248/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784189370.930553:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc07130e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3643:1870854458277248:0@lo:400:kworker.0 00000100:00000040:3.0:1784189370.930657:0:3643:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff9dc07130e300 x1870854458277248/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784189386 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1784189370.930666:0:3643:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:3.0:1784189370.930717:0:3643:0:(events.c:337:request_in_callback()) incoming req@ffff9dc080df2a00 x1870854458277248 msgsize 224 00000100:00100000:3.0:1784189370.930722:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:3.0:1784189370.930749:0:3643:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff9dc07130e300 x1870854458277248/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784189386 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1784189370.930762:0:3643:0:(niobuf.c:635:kick_cpu_latency()) lustre-MDT0001-lwp-OST0001: using a timeout of 7131 usecs (8 jiffies) 00000100:00000040:3.0:1784189370.930772:0:3643:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff9dc080d5ca80 x1870854458277760/t0(0) o400->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784189370.930780:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc080d5ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1870854458277760:0@lo:400:kworker.0 00000100:00000040:3.0:1784189370.930791:0:3643:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff9dc080d5ca80 x1870854458277760/t0(0) o400->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1784189386 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1784189370.930798:0:3643:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:3.0:1784189370.930813:0:3643:0:(events.c:337:request_in_callback()) incoming req@ffff9dc080df1c00 x1870854458277760 msgsize 224 00000100:00100000:3.0:1784189370.930816:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:3.0:1784189370.930829:0:3643:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff9dc080d5ca80 x1870854458277760/t0(0) o400->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1784189386 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1784189370.930838:0:3643:0:(niobuf.c:635:kick_cpu_latency()) lustre-MDT0001-osp-MDT0000: using a timeout of 7655 usecs (8 jiffies) 00000100:00000040:3.0:1784189370.930843:0:3643:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff9dc080d5ce00 x1870854458278272/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784189370.930852:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc080d5ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3643:1870854458278272:0@lo:400:kworker.0 00000100:00000040:3.0:1784189370.930868:0:3643:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff9dc080d5ce00 x1870854458278272/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784189386 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1784189370.930875:0:3643:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:3.0:1784189370.930885:0:3643:0:(events.c:337:request_in_callback()) incoming req@ffff9dc080df2d80 x1870854458278272 msgsize 224 00000100:00100000:3.0:1784189370.930889:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:3.0:1784189370.930901:0:3643:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff9dc080d5ce00 x1870854458278272/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784189386 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1784189370.930909:0:3643:0:(niobuf.c:635:kick_cpu_latency()) lustre-MDT0001-lwp-OST0000: using a timeout of 8227 usecs (9 jiffies) 00000100:00100000:3.0:1784189370.930922:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00000040:3.0:1784189370.930927:0:3643:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff9dc07130fb80 x1870854458277120/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784189370.930947:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc07130fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3643:1870854458277120:0@lo:400:kworker.0 00000100:00000040:3.0:1784189370.930959:0:3643:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff9dc07130fb80 x1870854458277120/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784189386 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1784189370.930965:0:3643:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:3.0:1784189370.930977:0:3643:0:(events.c:337:request_in_callback()) incoming req@ffff9dc080df0a80 x1870854458277120 msgsize 224 00000100:00100000:3.0:1784189370.930981:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:3.0:1784189370.930994:0:3643:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff9dc07130fb80 x1870854458277120/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784189386 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1784189370.931002:0:3643:0:(niobuf.c:635:kick_cpu_latency()) lustre-MDT0000-lwp-OST0001: using a timeout of 7632 usecs (8 jiffies) 00000100:00000040:3.0:1784189370.931007:0:3643:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff9dc080d5c700 x1870854458277632/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784189370.931014:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc080d5c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3643:1870854458277632:0@lo:400:kworker.0 00000100:00000040:3.0:1784189370.931024:0:3643:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff9dc080d5c700 x1870854458277632/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784189386 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1784189370.931030:0:3643:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:3.0:1784189370.931040:0:3643:0:(events.c:337:request_in_callback()) incoming req@ffff9dc080df3100 x1870854458277632 msgsize 224 00000100:00100000:3.0:1784189370.931043:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:3.0:1784189370.931055:0:3643:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff9dc080d5c700 x1870854458277632/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784189386 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1784189370.931064:0:3643:0:(niobuf.c:635:kick_cpu_latency()) lustre-MDT0000-lwp-MDT0001: using a timeout of 72498 usecs (73 jiffies) 00000100:00000040:3.0:1784189370.931069:0:3643:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff9dc080d5f100 x1870854458278144/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784189370.931077:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc080d5f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3643:1870854458278144:0@lo:400:kworker.0 00000100:00000040:0.0:1784189370.931197:0:3641:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff9dc080df0000 x1870854458276992/t0(0) o400->MGC192.168.203.112@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784189370.931207:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc080df0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:bd553d0d-03e2-4233-b06b-b55bbfa2b954:3641:1870854458276992:0@lo:400:kworker.0 00000100:00000040:0.0:1784189370.931222:0:3641:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff9dc080df0000 x1870854458276992/t0(0) o400->MGC192.168.203.112@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1784189386 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1784189370.931229:0:3641:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1784189370.931248:0:3641:0:(events.c:337:request_in_callback()) incoming req@ffff9dc044942850 x1870854458276992 msgsize 224 00000100:00100000:0.0:1784189370.931252:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:0.0:1784189370.931254:0:3641:0:(events.c:349:request_in_callback()) Buffer complete: 63 buffers still posted 00000100:00000040:0.0:1784189370.931268:0:3641:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff9dc080df0000 x1870854458276992/t0(0) o400->MGC192.168.203.112@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1784189386 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1784189370.931296:0:3641:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff9dc080d5e300 x1870854458277504/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784189370.931305:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc080d5e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1870854458277504:0@lo:400:kworker.0 00000100:00000040:0.0:1784189370.931330:0:3641:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff9dc080d5e300 x1870854458277504/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784189386 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1784189370.931337:0:3641:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1784189370.931350:0:3641:0:(events.c:337:request_in_callback()) incoming req@ffff9dc0505bed80 x1870854458277504 msgsize 224 00000100:00100000:0.0:1784189370.931354:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:0.0:1784189370.931367:0:3641:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff9dc080d5e300 x1870854458277504/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784189386 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1784189370.931376:0:3641:0:(niobuf.c:635:kick_cpu_latency()) lustre-OST0001-osc-MDT0001: using a timeout of 5138 usecs (6 jiffies) 00000100:00000040:0.0:1784189370.931382:0:3641:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff9dc080d5e680 x1870854458278016/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784189370.931390:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc080d5e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3641:1870854458278016:0@lo:400:kworker.0 00000100:00000040:0.0:1784189370.931411:0:3641:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff9dc080d5e680 x1870854458278016/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784189386 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1784189370.931417:0:3641:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1784189370.931430:0:3641:0:(events.c:337:request_in_callback()) incoming req@ffff9dc0505bf100 x1870854458278016 msgsize 224 00000100:00100000:0.0:1784189370.931434:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:0.0:1784189370.931446:0:3641:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff9dc080d5e680 x1870854458278016/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784189386 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1784189370.931454:0:3641:0:(niobuf.c:635:kick_cpu_latency()) lustre-MDT0000-lwp-MDT0000: using a timeout of 8926 usecs (9 jiffies) 00000100:00100000:0.0:1784189370.931463:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00000040:0.0:1784189370.931468:0:3641:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff9dc07130e680 x1870854458277376/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784189370.931475:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc07130e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1870854458277376:0@lo:400:kworker.0 00000100:00000040:0.0:1784189370.931487:0:3641:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff9dc07130e680 x1870854458277376/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1784189386 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1784189370.931493:0:3641:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1784189370.931506:0:3641:0:(events.c:337:request_in_callback()) incoming req@ffff9dc0505bd880 x1870854458277376 msgsize 224 00000100:00100000:0.0:1784189370.931509:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:0.0:1784189370.931522:0:3641:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff9dc07130e680 x1870854458277376/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1784189386 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1784189370.931530:0:3641:0:(niobuf.c:635:kick_cpu_latency()) lustre-MDT0000-osp-MDT0001: using a timeout of 1797442 usecs (1798 jiffies) 00000100:00000040:0.0:1784189370.931536:0:3641:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff9dc080d5f800 x1870854458277888/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784189370.931544:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc080d5f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1870854458277888:0@lo:400:kworker.0 00000100:00100000:2.0:1784189370.931848:0:26492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458277760 00000100:00100000:2.0:1784189370.931861:0:26492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458277760 00000020:00000040:2.0:1784189370.931864:0:26492:0:(genops.c:825:class_conn2export()) looking for export cookie 0xcc1762b626f8c622 00000020:00000040:2.0:1784189370.931868:0:26492:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9dc047a80000 refcount=5 00000100:00000040:2.0:1784189370.931888:0:26492:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_out at +6s 00000100:00100000:2.0:1784189370.931910:0:26492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458277376 00000100:00100000:2.0:1784189370.931913:0:26492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458277376 00000020:00000040:2.0:1784189370.931915:0:26492:0:(genops.c:825:class_conn2export()) looking for export cookie 0xcc1762b626f8c5dc 00000020:00000040:2.0:1784189370.931917:0:26492:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9dbf47a3f000 refcount=7 00000100:00100000:2.0:1784189370.931939:0:26492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3973 00000100:00000040:2.0:1784189370.931943:0:26492:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9dc047a80000 : new rpc_count 1 00000100:00000040:2.0:1784189370.931948:0:26492:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9dc080df1c00 x1870854458277760/t0(0) o400->lustre-MDT0000-mdtlov_UUID@0@lo:561/0 lens 224/0 e 0 to 0 dl 1784189381 ref 1 fl New:/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784189370.931959:0:26492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc080df1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3643:x1870854458277760:12345-0@lo:400:kworker.0 00010000:00000040:2.0:1784189370.931979:0:26492:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 0, transno 0, xid 1870854458277760 00000100:00000040:2.0:1784189370.931987:0:26492:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9dc0710a1d00 refcount 66 to 0@lo 00000100:00000040:2.0:1784189370.931991:0:26492:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1784189370.932022:0:3641:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff9dc080d5f800 x1870854458277888/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784189386 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1784189370.932029:0:3641:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1784189370.932101:0:26492:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff9dc080d5ca80 x1870854458277760/t0(0) o400->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1784189386 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1784189370.932116:0:26492:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff9dc0710a1d00 refcount 65 to 0@lo 00000100:00000040:2.0:1784189370.932121:0:26492:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9dc080df1c00 x1870854458277760/t0(0) o400->lustre-MDT0000-mdtlov_UUID@0@lo:561/0 lens 224/224 e 0 to 0 dl 1784189381 ref 1 fl Interpret:/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784189370.932130:0:26492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc080df1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3643:x1870854458277760:12345-0@lo:400:kworker.0 Request processed in 172us (1316us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189370.932137:0:26492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3973 00000100:00000040:2.0:1784189370.932141:0:26492:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9dc047a80000 : new rpc_count 0 00000020:00000040:2.0:1784189370.932150:0:26492:0:(genops.c:900:class_export_put()) PUTting export ffff9dc047a80000 : new refcount 4 00000100:00100000:2.0:1784189370.932160:0:26492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3974 00000100:00000040:2.0:1784189370.932162:0:26492:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9dbf47a3f000 : new rpc_count 1 00000100:00000040:2.0:1784189370.932166:0:26492:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9dc0505bd880 x1870854458277376/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:561/0 lens 224/0 e 0 to 0 dl 1784189381 ref 1 fl New:/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784189370.932182:0:26492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc0505bd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3641:x1870854458277376:12345-0@lo:400:kworker.0 00010000:00000040:2.0:1784189370.932193:0:26492:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 120259084290, transno 0, xid 1870854458277376 00000100:00000040:2.0:1784189370.932198:0:26492:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9dc0710a1d00 refcount 66 to 0@lo 00000100:00000040:2.0:1784189370.932201:0:26492:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1784189370.932216:0:26492:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff9dc07130e680 x1870854458277376/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1784189386 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1784189370.932227:0:26492:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff9dc0710a1d00 refcount 65 to 0@lo 00000100:00000040:2.0:1784189370.932232:0:26492:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9dc0505bd880 x1870854458277376/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:561/0 lens 224/224 e 0 to 0 dl 1784189381 ref 1 fl Interpret:/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784189370.932239:0:26492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc0505bd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3641:x1870854458277376:12345-0@lo:400:kworker.0 Request processed in 59us (731us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189370.932245:0:26492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3974 00000100:00000040:2.0:1784189370.932247:0:26492:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9dbf47a3f000 : new rpc_count 0 00000020:00000040:2.0:1784189370.932252:0:26492:0:(genops.c:900:class_export_put()) PUTting export ffff9dbf47a3f000 : new refcount 6 00000100:00100000:2.0:1784189370.932268:0:66170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458277248 00000100:00100000:2.0:1784189370.932272:0:66170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458277248 00000020:00000040:2.0:1784189370.932273:0:66170:0:(genops.c:825:class_conn2export()) looking for export cookie 0xcc1762b626f86541 00000020:00000040:2.0:1784189370.932276:0:66170:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9dbf43d8f800 refcount=5 00000020:00000040:2.0:1784189370.932285:0:66170:0:(obd_config.c:994:class_incref()) incref lustre-MDT0001 (ffff9dc071094d40) now 12 - evictor 00000100:00000040:2.0:1784189370.932300:0:66170:0:(service.c:1432:ptlrpc_at_set_timer()) armed mdt at +6s 00000100:00100000:2.0:1784189370.932311:0:66170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458278272 00000100:00100000:2.0:1784189370.932313:0:66170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458278272 00000020:00000040:2.0:1784189370.932315:0:66170:0:(genops.c:825:class_conn2export()) looking for export cookie 0xcc1762b626f8d5b1 00000020:00000040:2.0:1784189370.932335:0:66170:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9dc045661000 refcount=5 00000100:00100000:2.0:1784189370.932350:0:66170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458277120 00000100:00100000:2.0:1784189370.932353:0:66170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458277120 00000020:00000040:2.0:1784189370.932355:0:66170:0:(genops.c:825:class_conn2export()) looking for export cookie 0xcc1762b626f8c780 00000020:00000040:2.0:1784189370.932357:0:66170:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9dbf46b0a800 refcount=5 00000020:00000040:2.0:1784189370.932370:0:66170:0:(obd_config.c:994:class_incref()) incref lustre-MDT0000 (ffff9dc075478000) now 16 - evictor 00000100:00100000:2.0:1784189370.932384:0:66170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458277632 00000100:00100000:2.0:1784189370.932387:0:66170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458277632 00000020:00000040:2.0:1784189370.932388:0:66170:0:(genops.c:825:class_conn2export()) looking for export cookie 0xcc1762b626f8c787 00000020:00000040:2.0:1784189370.932391:0:66170:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9dbf46b0e000 refcount=5 00000100:00100000:2.0:1784189370.932401:0:66170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458278016 00000100:00100000:2.0:1784189370.932403:0:66170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458278016 00000020:00000040:2.0:1784189370.932404:0:66170:0:(genops.c:825:class_conn2export()) looking for export cookie 0xcc1762b626f8c78e 00000020:00000040:2.0:1784189370.932406:0:66170:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9dc06b8e5800 refcount=5 00000100:00100000:2.0:1784189370.932418:0:66170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1390 00000100:00000040:2.0:1784189370.932421:0:66170:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9dbf43d8f800 : new rpc_count 1 00000100:00000040:2.0:1784189370.932424:0:66170:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9dc080df2a00 x1870854458277248/t0(0) o400->lustre-MDT0001-lwp-OST0001_UUID@0@lo:561/0 lens 224/0 e 0 to 0 dl 1784189381 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784189370.932434:0:66170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc080df2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1870854458277248:12345-0@lo:400:kworker.0 00010000:00000040:2.0:1784189370.932444:0:66170:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 0, transno 0, xid 1870854458277248 00000100:00000040:2.0:1784189370.932449:0:66170:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9dc0710a1d00 refcount 66 to 0@lo 00000100:00000040:2.0:1784189370.932452:0:66170:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1784189370.932469:0:66170:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff9dc07130e300 x1870854458277248/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784189386 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1784189370.932481:0:66170:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff9dc0710a1d00 refcount 65 to 0@lo 00000100:00000040:2.0:1784189370.932484:0:66170:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9dc080df2a00 x1870854458277248/t0(0) o400->lustre-MDT0001-lwp-OST0001_UUID@0@lo:561/0 lens 224/224 e 0 to 0 dl 1784189381 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784189370.932492:0:66170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc080df2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1870854458277248:12345-0@lo:400:kworker.0 Request processed in 60us (1774us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189370.932498:0:66170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1390 00000100:00000040:2.0:1784189370.932501:0:66170:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9dbf43d8f800 : new rpc_count 0 00000020:00000040:2.0:1784189370.932507:0:66170:0:(genops.c:900:class_export_put()) PUTting export ffff9dbf43d8f800 : new refcount 4 00000100:00100000:2.0:1784189370.932515:0:66170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1391 00000100:00000040:2.0:1784189370.932518:0:66170:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9dc045661000 : new rpc_count 1 00000100:00000040:2.0:1784189370.932527:0:66170:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9dc080df2d80 x1870854458278272/t0(0) o400->lustre-MDT0001-lwp-OST0000_UUID@0@lo:561/0 lens 224/0 e 0 to 0 dl 1784189381 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784189370.932537:0:66170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc080df2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1870854458278272:12345-0@lo:400:kworker.0 00010000:00000040:2.0:1784189370.932547:0:66170:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 0, transno 0, xid 1870854458278272 00000100:00000040:2.0:1784189370.932551:0:66170:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9dc0710a1d00 refcount 66 to 0@lo 00000100:00000040:2.0:1784189370.932565:0:66170:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1784189370.932583:0:66170:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff9dc080d5ce00 x1870854458278272/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784189386 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1784189370.932605:0:66170:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff9dc0710a1d00 refcount 65 to 0@lo 00000100:00000040:2.0:1784189370.932609:0:66170:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9dc080df2d80 x1870854458278272/t0(0) o400->lustre-MDT0001-lwp-OST0000_UUID@0@lo:561/0 lens 224/224 e 0 to 0 dl 1784189381 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784189370.932616:0:66170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc080df2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1870854458278272:12345-0@lo:400:kworker.0 Request processed in 81us (1729us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189370.932622:0:66170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1391 00000100:00000040:2.0:1784189370.932624:0:66170:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9dc045661000 : new rpc_count 0 00000020:00000040:2.0:1784189370.932630:0:66170:0:(genops.c:900:class_export_put()) PUTting export ffff9dc045661000 : new refcount 4 00000100:00100000:2.0:1784189370.932639:0:66170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1392 00000100:00000040:2.0:1784189370.932641:0:66170:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9dbf46b0a800 : new rpc_count 1 00000100:00000040:2.0:1784189370.932645:0:66170:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9dc080df0a80 x1870854458277120/t0(0) o400->lustre-MDT0000-lwp-OST0001_UUID@0@lo:561/0 lens 224/0 e 0 to 0 dl 1784189381 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784189370.932654:0:66170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc080df0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1870854458277120:12345-0@lo:400:kworker.0 00010000:00000040:2.0:1784189370.932662:0:66170:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 0, transno 0, xid 1870854458277120 00000100:00000040:2.0:1784189370.932667:0:66170:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9dc0710a1d00 refcount 66 to 0@lo 00000100:00000040:2.0:1784189370.932670:0:66170:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1784189370.932695:0:66170:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff9dc07130fb80 x1870854458277120/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784189386 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1784189370.932721:0:66170:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff9dc0710a1d00 refcount 65 to 0@lo 00000100:00000040:2.0:1784189370.932725:0:66170:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9dc080df0a80 x1870854458277120/t0(0) o400->lustre-MDT0000-lwp-OST0001_UUID@0@lo:561/0 lens 224/224 e 0 to 0 dl 1784189381 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784189370.932732:0:66170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc080df0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1870854458277120:12345-0@lo:400:kworker.0 Request processed in 80us (1754us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189370.932738:0:66170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1392 00000100:00000040:2.0:1784189370.932740:0:66170:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9dbf46b0a800 : new rpc_count 0 00000020:00000040:2.0:1784189370.932746:0:66170:0:(genops.c:900:class_export_put()) PUTting export ffff9dbf46b0a800 : new refcount 4 00000100:00100000:2.0:1784189370.932754:0:66170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1393 00000100:00000040:2.0:1784189370.932756:0:66170:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9dbf46b0e000 : new rpc_count 1 00000100:00000040:2.0:1784189370.932760:0:66170:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9dc080df3100 x1870854458277632/t0(0) o400->lustre-MDT0000-lwp-MDT0001_UUID@0@lo:561/0 lens 224/0 e 0 to 0 dl 1784189381 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784189370.932769:0:66170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc080df3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1870854458277632:12345-0@lo:400:kworker.0 00010000:00000040:2.0:1784189370.932779:0:66170:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 0, transno 0, xid 1870854458277632 00000100:00000040:2.0:1784189370.932784:0:66170:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9dc0710a1d00 refcount 66 to 0@lo 00000100:00000040:2.0:1784189370.932786:0:66170:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1784189370.932801:0:66170:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff9dc080d5c700 x1870854458277632/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784189386 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1784189370.932812:0:66170:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff9dc0710a1d00 refcount 65 to 0@lo 00000100:00000040:2.0:1784189370.932816:0:66170:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9dc080df3100 x1870854458277632/t0(0) o400->lustre-MDT0000-lwp-MDT0001_UUID@0@lo:561/0 lens 224/224 e 0 to 0 dl 1784189381 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784189370.932822:0:66170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc080df3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1870854458277632:12345-0@lo:400:kworker.0 Request processed in 55us (1781us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189370.932828:0:66170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1393 00000100:00000040:2.0:1784189370.932830:0:66170:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9dbf46b0e000 : new rpc_count 0 00000020:00000040:2.0:1784189370.932841:0:66170:0:(genops.c:900:class_export_put()) PUTting export ffff9dbf46b0e000 : new refcount 4 00000100:00100000:2.0:1784189370.932851:0:66170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1394 00000100:00000040:2.0:1784189370.932853:0:66170:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9dc06b8e5800 : new rpc_count 1 00000100:00000040:2.0:1784189370.932857:0:66170:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9dc0505bf100 x1870854458278016/t0(0) o400->lustre-MDT0000-lwp-MDT0000_UUID@0@lo:561/0 lens 224/0 e 0 to 0 dl 1784189381 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784189370.932867:0:66170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc0505bf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1870854458278016:12345-0@lo:400:kworker.0 00010000:00000040:2.0:1784189370.932876:0:66170:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 0, transno 0, xid 1870854458278016 00000100:00000040:2.0:1784189370.932880:0:66170:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9dc0710a1d00 refcount 66 to 0@lo 00000100:00000040:2.0:1784189370.932883:0:66170:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1784189370.932898:0:66170:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff9dc080d5e680 x1870854458278016/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784189386 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1784189370.932909:0:66170:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff9dc0710a1d00 refcount 65 to 0@lo 00000100:00000040:2.0:1784189370.932913:0:66170:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9dc0505bf100 x1870854458278016/t0(0) o400->lustre-MDT0000-lwp-MDT0000_UUID@0@lo:561/0 lens 224/224 e 0 to 0 dl 1784189381 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784189370.932920:0:66170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc0505bf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1870854458278016:12345-0@lo:400:kworker.0 Request processed in 55us (1489us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189370.932925:0:66170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1394 00000100:00000040:2.0:1784189370.932927:0:66170:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9dc06b8e5800 : new rpc_count 0 00000020:00000040:2.0:1784189370.932932:0:66170:0:(genops.c:900:class_export_put()) PUTting export ffff9dc06b8e5800 : new refcount 4 00000100:00000040:0.0:1784189370.933708:0:3641:0:(events.c:337:request_in_callback()) incoming req@ffff9dc0505bf480 x1870854458277888 msgsize 224 00000100:00100000:0.0:1784189370.933719:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:0.0:1784189370.933749:0:3641:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff9dc080d5f800 x1870854458277888/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784189386 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1784189370.933761:0:3641:0:(niobuf.c:635:kick_cpu_latency()) lustre-OST0001-osc-MDT0000: using a timeout of 6680 usecs (7 jiffies) 00000100:00000040:0.0:1784189370.933787:0:3641:0:(client.c:3108:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: skip recheck: last_committed 0 00000100:00000040:0.0:1784189370.933792:0:3641:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff9dc080d5e680 x1870854458278016/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784189386 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1784189370.933802:0:3641:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9dc080d5e680 x1870854458278016/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784189386 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784189370.933809:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc080d5e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3641:1870854458278016:0@lo:400:kworker.0 00000100:00000040:0.0:1784189370.933815:0:3641:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff9dc080d5e680 x1870854458278016/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784189386 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:0.0:1784189370.933824:0:3641:0:(genops.c:1244:class_import_put()) import ffff9dbf43fcb000 refcount=2 obd=lustre-MDT0000-lwp-MDT0000 00000100:00000040:0.0:1784189370.933839:0:3641:0:(client.c:3108:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: skip recheck: last_committed 120259084290 00000100:00000040:0.0:1784189370.933843:0:3641:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff9dc07130e680 x1870854458277376/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1784189386 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1784189370.933850:0:3641:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9dc07130e680 x1870854458277376/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1784189386 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784189370.933856:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc07130e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1870854458277376:0@lo:400:kworker.0 00000100:00000040:0.0:1784189370.933861:0:3641:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff9dc07130e680 x1870854458277376/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1784189386 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:0.0:1784189370.933867:0:3641:0:(genops.c:1244:class_import_put()) import ffff9dbf436c4000 refcount=2 obd=lustre-MDT0000-osp-MDT0001 00000100:00100000:0.0:1784189370.933898:0:94314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458276992 00000100:00100000:0.0:1784189370.933903:0:94314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458276992 00000020:00000040:0.0:1784189370.933911:0:94314:0:(genops.c:825:class_conn2export()) looking for export cookie 0xcc1762b626f8c573 00000020:00000040:0.0:1784189370.933916:0:94314:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9dc050ae5000 refcount=24 00000100:00000040:0.0:1784189370.933941:0:94314:0:(service.c:1432:ptlrpc_at_set_timer()) armed mgs at +6s 00000100:00100000:0.0:1784189370.933966:0:94314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 212 00000100:00000040:0.0:1784189370.933970:0:94314:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9dc050ae5000 : new rpc_count 1 00000100:00000040:0.0:1784189370.933974:0:94314:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9dc044942850 x1870854458276992/t0(0) o400->bd553d0d-03e2-4233-b06b-b55bbfa2b954@0@lo:561/0 lens 224/0 e 0 to 0 dl 1784189381 ref 1 fl New:/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784189370.933985:0:94314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc044942850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:bd553d0d-03e2-4233-b06b-b55bbfa2b954+24:3641:x1870854458276992:12345-0@lo:400:kworker.0 00010000:00000040:0.0:1784189370.933997:0:94314:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 0, transno 0, xid 1870854458276992 00000100:00000040:0.0:1784189370.934002:0:94314:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9dc0710a1d00 refcount 66 to 0@lo 00000100:00000040:0.0:1784189370.934006:0:94314:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1784189370.934024:0:94314:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff9dc080df0000 x1870854458276992/t0(0) o400->MGC192.168.203.112@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1784189386 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1784189370.934055:0:94314:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff9dc0710a1d00 refcount 65 to 0@lo 00000100:00000040:0.0:1784189370.934059:0:94314:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9dc044942850 x1870854458276992/t0(0) o400->bd553d0d-03e2-4233-b06b-b55bbfa2b954@0@lo:561/0 lens 224/224 e 0 to 0 dl 1784189381 ref 1 fl Interpret:/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784189370.934067:0:94314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc044942850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:bd553d0d-03e2-4233-b06b-b55bbfa2b954+24:3641:x1870854458276992:12345-0@lo:400:kworker.0 Request processed in 84us (2817us total) trans 0 rc 0/0 00000100:00100000:0.0:1784189370.934073:0:94314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 212 00000100:00000040:0.0:1784189370.934075:0:94314:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9dc050ae5000 : new rpc_count 0 00000020:00000040:0.0:1784189370.934082:0:94314:0:(genops.c:900:class_export_put()) PUTting export ffff9dc050ae5000 : new refcount 23 00000100:00100000:0.0:1784189370.934111:0:26164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458277504 00000100:00100000:0.0:1784189370.934114:0:26164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458277504 00000020:00000040:0.0:1784189370.934116:0:26164:0:(genops.c:825:class_conn2export()) looking for export cookie 0xcc1762b626f864bc 00000020:00000040:0.0:1784189370.934119:0:26164:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9dbf42277000 refcount=5 00000020:00000040:0.0:1784189370.934127:0:26164:0:(obd_config.c:994:class_incref()) incref lustre-OST0001 (ffff9dbf4312b380) now 10 - evictor 00000100:00100000:0.0:1784189370.934148:0:26164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458277888 00000100:00100000:0.0:1784189370.934152:0:26164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458277888 00000020:00000040:0.0:1784189370.934153:0:26164:0:(genops.c:825:class_conn2export()) looking for export cookie 0xcc1762b626f8c64c 00000020:00000040:0.0:1784189370.934155:0:26164:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9dbf47452800 refcount=5 00000100:00100000:0.0:1784189370.934174:0:26164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2618 00000100:00000040:3.0:1784189370.934183:0:3643:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff9dc080d5f100 x1870854458278144/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784189386 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1784189370.934187:0:26164:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9dbf42277000 : new rpc_count 1 00000100:00000040:0.0:1784189370.934191:0:26164:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9dc0505bed80 x1870854458277504/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:561/0 lens 224/0 e 0 to 0 dl 1784189381 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1784189370.934202:0:3643:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00100000:0.0:1784189370.934202:0:26164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc0505bed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0001-mdtlov_UUID+5:3641:x1870854458277504:12345-0@lo:400:kworker.0 00010000:00000040:0.0:1784189370.934212:0:26164:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 4294968945, transno 0, xid 1870854458277504 00000100:00000040:0.0:1784189370.934217:0:26164:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9dc0710a1d00 refcount 66 to 0@lo 00000100:00000040:3.0:1784189370.934218:0:3643:0:(events.c:337:request_in_callback()) incoming req@ffff9dc080df1880 x1870854458278144 msgsize 224 00000100:00000040:0.0:1784189370.934220:0:26164:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00100000:3.0:1784189370.934222:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:3.0:1784189370.934234:0:3643:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff9dc080d5f100 x1870854458278144/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784189386 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1784189370.934235:0:26164:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff9dc080d5e300 x1870854458277504/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784189386 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1784189370.934244:0:3643:0:(niobuf.c:635:kick_cpu_latency()) lustre-MDT0000-lwp-OST0000: using a timeout of 29530 usecs (30 jiffies) 00000100:00000040:0.0:1784189370.934247:0:26164:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff9dc0710a1d00 refcount 65 to 0@lo 00000100:00000040:0.0:1784189370.934251:0:26164:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9dc0505bed80 x1870854458277504/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:561/0 lens 224/224 e 0 to 0 dl 1784189381 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1784189370.934258:0:3643:0:(client.c:3108:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: skip recheck: last_committed 0 00000100:00100000:0.0:1784189370.934258:0:26164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc0505bed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0001-mdtlov_UUID+5:3641:x1870854458277504:12345-0@lo:400:kworker.0 Request processed in 58us (2906us total) trans 0 rc 0/0 00000100:00000040:3.0:1784189370.934262:0:3643:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff9dc07130e300 x1870854458277248/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784189386 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784189370.934264:0:26164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2618 00000100:00000040:0.0:1784189370.934266:0:26164:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9dbf42277000 : new rpc_count 0 00000100:00000040:3.0:1784189370.934270:0:3643:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9dc07130e300 x1870854458277248/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784189386 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:0.0:1784189370.934272:0:26164:0:(genops.c:900:class_export_put()) PUTting export ffff9dbf42277000 : new refcount 4 00000100:00100000:3.0:1784189370.934277:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc07130e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3643:1870854458277248:0@lo:400:kworker.0 00000100:00100000:0.0:1784189370.934279:0:26164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2619 00000100:00000040:0.0:1784189370.934281:0:26164:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9dbf47452800 : new rpc_count 1 00000100:00000040:0.0:1784189370.934285:0:26164:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9dc0505bf480 x1870854458277888/t0(0) o400->lustre-MDT0000-mdtlov_UUID@0@lo:561/0 lens 224/0 e 0 to 0 dl 1784189381 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1784189370.934286:0:3643:0:(client.c:3108:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: skip recheck: last_committed 0 00000100:00000040:3.0:1784189370.934290:0:3643:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff9dc080d5ca80 x1870854458277760/t0(0) o400->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1784189386 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784189370.934294:0:26164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc0505bf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+5:3641:x1870854458277888:12345-0@lo:400:kworker.0 00000100:00000040:3.0:1784189370.934298:0:3643:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9dc080d5ca80 x1870854458277760/t0(0) o400->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1784189386 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00010000:00000040:0.0:1784189370.934301:0:26164:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 4294968960, transno 0, xid 1870854458277888 00000100:00100000:3.0:1784189370.934304:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc080d5ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1870854458277760:0@lo:400:kworker.0 00000100:00000040:0.0:1784189370.934305:0:26164:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9dc0710a1d00 refcount 66 to 0@lo 00000100:00000040:0.0:1784189370.934308:0:26164:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:3.0:1784189370.934314:0:3643:0:(client.c:3108:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: skip recheck: last_committed 0 00000100:00000040:3.0:1784189370.934338:0:3643:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff9dc080d5ce00 x1870854458278272/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784189386 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1784189370.934340:0:26164:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff9dc080d5f800 x1870854458277888/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784189386 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1784189370.934347:0:3643:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9dc080d5ce00 x1870854458278272/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784189386 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784189370.934354:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc080d5ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3643:1870854458278272:0@lo:400:kworker.0 00000100:00000040:3.0:1784189370.934363:0:3643:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff9dc07130e300 x1870854458277248/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784189386 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1784189370.934364:0:26164:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff9dc0710a1d00 refcount 65 to 0@lo 00000100:00000040:0.0:1784189370.934369:0:26164:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9dc0505bf480 x1870854458277888/t0(0) o400->lustre-MDT0000-mdtlov_UUID@0@lo:561/0 lens 224/224 e 0 to 0 dl 1784189381 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784189370.934376:0:26164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc0505bf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+5:3641:x1870854458277888:12345-0@lo:400:kworker.0 Request processed in 84us (669us total) trans 0 rc 0/0 00000100:00100000:0.0:1784189370.934382:0:26164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2619 00000100:00000040:0.0:1784189370.934385:0:26164:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9dbf47452800 : new rpc_count 0 00000020:00000040:0.0:1784189370.934390:0:26164:0:(genops.c:900:class_export_put()) PUTting export ffff9dbf47452800 : new refcount 4 00000100:00100000:0.0:1784189370.934407:0:68287:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458278144 00000100:00100000:0.0:1784189370.934411:0:68287:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458278144 00000020:00000040:0.0:1784189370.934412:0:68287:0:(genops.c:825:class_conn2export()) looking for export cookie 0xcc1762b626f8d59c 00000020:00000040:0.0:1784189370.934414:0:68287:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9dc07118b800 refcount=5 00000100:00000040:0.0:1784189370.934426:0:68287:0:(service.c:1432:ptlrpc_at_set_timer()) armed mdt at +6s 00000100:00100000:0.0:1784189370.934446:0:68287:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1395 00000100:00000040:0.0:1784189370.934448:0:68287:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9dc07118b800 : new rpc_count 1 00000100:00000040:0.0:1784189370.934453:0:68287:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9dc080df1880 x1870854458278144/t0(0) o400->lustre-MDT0000-lwp-OST0000_UUID@0@lo:561/0 lens 224/0 e 0 to 0 dl 1784189381 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784189370.934462:0:68287:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc080df1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1870854458278144:12345-0@lo:400:kworker.0 00010000:00000040:0.0:1784189370.934470:0:68287:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 0, transno 0, xid 1870854458278144 00000100:00000040:0.0:1784189370.934475:0:68287:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9dc0710a1d00 refcount 66 to 0@lo 00000100:00000040:0.0:1784189370.934478:0:68287:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1784189370.934493:0:68287:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff9dc080d5f100 x1870854458278144/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784189386 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1784189370.934505:0:68287:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff9dc0710a1d00 refcount 65 to 0@lo 00000100:00000040:0.0:1784189370.934509:0:68287:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9dc080df1880 x1870854458278144/t0(0) o400->lustre-MDT0000-lwp-OST0000_UUID@0@lo:561/0 lens 224/224 e 0 to 0 dl 1784189381 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784189370.934516:0:68287:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc080df1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1870854458278144:12345-0@lo:400:kworker.0 Request processed in 55us (296us total) trans 0 rc 0/0 00000100:00100000:0.0:1784189370.934528:0:68287:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1395 00000100:00000040:0.0:1784189370.934530:0:68287:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9dc07118b800 : new rpc_count 0 00000020:00000040:0.0:1784189370.934536:0:68287:0:(genops.c:900:class_export_put()) PUTting export ffff9dc07118b800 : new refcount 4 00000100:00080000:0.0:1784189370.934557:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000020:00000040:3.0:1784189370.934561:0:3643:0:(genops.c:1244:class_import_put()) import ffff9dbf43115800 refcount=2 obd=lustre-MDT0001-lwp-OST0001 00000020:00000040:0.0:1784189370.934561:0:6509:0:(obd_config.c:1022:class_decref()) Decref lustre-OST0001 (ffff9dbf4312b380) now 10 - evictor 00000100:00080000:0.0:1784189370.934564:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000020:00000040:0.0:1784189370.934566:0:6509:0:(obd_config.c:1022:class_decref()) Decref lustre-MDT0000 (ffff9dc075478000) now 16 - evictor 00000100:00080000:0.0:1784189370.934568:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00000040:3.0:1784189370.934569:0:3643:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff9dc080d5ca80 x1870854458277760/t0(0) o400->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1784189386 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:0.0:1784189370.934570:0:6509:0:(obd_config.c:1022:class_decref()) Decref lustre-MDT0001 (ffff9dc071094d40) now 12 - evictor 00000020:00000040:3.0:1784189370.934576:0:3643:0:(genops.c:1244:class_import_put()) import ffff9dbf436c1800 refcount=2 obd=lustre-MDT0001-osp-MDT0000 00000100:00000040:3.0:1784189370.934581:0:3643:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff9dc080d5ce00 x1870854458278272/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784189386 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:3.0:1784189370.934597:0:3643:0:(genops.c:1244:class_import_put()) import ffff9dbf44677800 refcount=2 obd=lustre-MDT0001-lwp-OST0000 00000100:00000040:3.0:1784189370.934622:0:3643:0:(client.c:3108:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: skip recheck: last_committed 0 00000100:00000040:3.0:1784189370.934627:0:3643:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff9dc07130fb80 x1870854458277120/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784189386 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1784189370.934635:0:3643:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9dc07130fb80 x1870854458277120/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784189386 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784189370.934641:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc07130fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3643:1870854458277120:0@lo:400:kworker.0 00000100:00000040:3.0:1784189370.934653:0:3643:0:(client.c:3108:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: skip recheck: last_committed 0 00000100:00000040:3.0:1784189370.934657:0:3643:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff9dc080d5c700 x1870854458277632/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784189386 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1784189370.934661:0:3641:0:(client.c:3108:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: skip recheck: last_committed 4294968960 00000100:00000040:3.0:1784189370.934665:0:3643:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9dc080d5c700 x1870854458277632/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784189386 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1784189370.934666:0:3641:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff9dc080d5f800 x1870854458277888/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784189386 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784189370.934672:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc080d5c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3643:1870854458277632:0@lo:400:kworker.0 00000100:00000040:1.0:1784189370.934675:0:3641:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9dc080d5f800 x1870854458277888/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784189386 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1784189370.934680:0:3643:0:(client.c:3108:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: skip recheck: last_committed 0 00000100:00100000:1.0:1784189370.934681:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc080d5f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1870854458277888:0@lo:400:kworker.0 00000100:00000040:3.0:1784189370.934684:0:3643:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff9dc080d5f100 x1870854458278144/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784189386 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1784189370.934690:0:3641:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff9dc080df0000 x1870854458276992/t0(0) o400->MGC192.168.203.112@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1784189386 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1784189370.934691:0:3643:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9dc080d5f100 x1870854458278144/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784189386 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1784189370.934697:0:3641:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9dc080df0000 x1870854458276992/t0(0) o400->MGC192.168.203.112@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1784189386 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784189370.934704:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc080d5f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3643:1870854458278144:0@lo:400:kworker.0 00000100:00100000:1.0:1784189370.934704:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc080df0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:bd553d0d-03e2-4233-b06b-b55bbfa2b954:3641:1870854458276992:0@lo:400:kworker.0 00000100:00000040:3.0:1784189370.934710:0:3643:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff9dc07130fb80 x1870854458277120/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784189386 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:3.0:1784189370.934717:0:3643:0:(genops.c:1244:class_import_put()) import ffff9dbf425f4800 refcount=2 obd=lustre-MDT0000-lwp-OST0001 00000100:00000040:1.0:1784189370.934718:0:3641:0:(client.c:3108:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: skip recheck: last_committed 4294968945 00000100:00000040:3.0:1784189370.934723:0:3643:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff9dc080d5c700 x1870854458277632/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784189386 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1784189370.934723:0:3641:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff9dc080d5e300 x1870854458277504/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784189386 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:3.0:1784189370.934730:0:3643:0:(genops.c:1244:class_import_put()) import ffff9dbf43690800 refcount=2 obd=lustre-MDT0000-lwp-MDT0001 00000100:00000040:1.0:1784189370.934731:0:3641:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9dc080d5e300 x1870854458277504/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784189386 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1784189370.934734:0:3643:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff9dc080d5f100 x1870854458278144/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784189386 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784189370.934739:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc080d5e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1870854458277504:0@lo:400:kworker.0 00000020:00000040:3.0:1784189370.934741:0:3643:0:(genops.c:1244:class_import_put()) import ffff9dbf43d8c000 refcount=2 obd=lustre-MDT0000-lwp-OST0000 00000100:00000040:1.0:1784189370.934743:0:3641:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff9dc080d5f800 x1870854458277888/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784189386 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:1.0:1784189370.934749:0:3641:0:(genops.c:1244:class_import_put()) import ffff9dbf4845c000 refcount=2 obd=lustre-OST0001-osc-MDT0000 00000100:00000040:1.0:1784189370.934754:0:3641:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff9dc080df0000 x1870854458276992/t0(0) o400->MGC192.168.203.112@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1784189386 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:1.0:1784189370.934760:0:3641:0:(genops.c:1244:class_import_put()) import ffff9dc07110c800 refcount=3 obd=MGC192.168.203.112@tcp 00000100:00000040:1.0:1784189370.934763:0:3641:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff9dc080d5e300 x1870854458277504/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784189386 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:1.0:1784189370.934769:0:3641:0:(genops.c:1244:class_import_put()) import ffff9dc080cc8800 refcount=2 obd=lustre-OST0001-osc-MDT0001 00000001:00080000:3.0:1784189370.936681:0:96880:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294969017 is committed 00000001:00000040:3.0:1784189370.936690:0:96880:0:(tgt_lastrcvd.c:986:tgt_cb_last_committed()) callback PUTting export ffff9dbf4512b000 : new cb_count 39 00000020:00000040:3.0:1784189370.936693:0:96880:0:(genops.c:900:class_export_put()) PUTting export ffff9dbf4512b000 : new refcount 43 00000001:00000040:3.0:1784189370.936701:0:96880:0:(tgt_lastrcvd.c:986:tgt_cb_last_committed()) callback PUTting export ffff9dbf4512b000 : new cb_count 38 00000020:00000040:3.0:1784189370.936703:0:96880:0:(genops.c:900:class_export_put()) PUTting export ffff9dbf4512b000 : new refcount 42 00000001:00000040:3.0:1784189370.936708:0:96880:0:(tgt_lastrcvd.c:986:tgt_cb_last_committed()) callback PUTting export ffff9dbf4512b000 : new cb_count 37 00000020:00000040:3.0:1784189370.936709:0:96880:0:(genops.c:900:class_export_put()) PUTting export ffff9dbf4512b000 : new refcount 41 00000001:00000040:3.0:1784189370.936714:0:96880:0:(tgt_lastrcvd.c:986:tgt_cb_last_committed()) callback PUTting export ffff9dbf4512b000 : new cb_count 36 00000020:00000040:3.0:1784189370.936715:0:96880:0:(genops.c:900:class_export_put()) PUTting export ffff9dbf4512b000 : new refcount 40 00000001:00000040:3.0:1784189370.936720:0:96880:0:(tgt_lastrcvd.c:986:tgt_cb_last_committed()) callback PUTting export ffff9dbf4512b000 : new cb_count 35 00000020:00000040:3.0:1784189370.936721:0:96880:0:(genops.c:900:class_export_put()) PUTting export ffff9dbf4512b000 : new refcount 39 00000001:00000040:3.0:1784189370.936727:0:96880:0:(tgt_lastrcvd.c:986:tgt_cb_last_committed()) callback PUTting export ffff9dbf4512b000 : new cb_count 34 00000020:00000040:3.0:1784189370.936729:0:96880:0:(genops.c:900:class_export_put()) PUTting export ffff9dbf4512b000 : new refcount 38 00000001:00000040:3.0:1784189370.936732:0:96880:0:(tgt_lastrcvd.c:986:tgt_cb_last_committed()) callback PUTting export ffff9dbf4512b000 : new cb_count 33 00000020:00000040:3.0:1784189370.936734:0:96880:0:(genops.c:900:class_export_put()) PUTting export ffff9dbf4512b000 : new refcount 37 00000001:00000040:3.0:1784189370.936738:0:96880:0:(tgt_lastrcvd.c:986:tgt_cb_last_committed()) callback PUTting export ffff9dbf4512b000 : new cb_count 32 00000020:00000040:3.0:1784189370.936740:0:96880:0:(genops.c:900:class_export_put()) PUTting export ffff9dbf4512b000 : new refcount 36 00000001:00000040:3.0:1784189370.936749:0:96880:0:(tgt_lastrcvd.c:986:tgt_cb_last_committed()) callback PUTting export ffff9dbf4512b000 : new cb_count 31 00000020:00000040:3.0:1784189370.936752:0:96880:0:(genops.c:900:class_export_put()) PUTting export ffff9dbf4512b000 : new refcount 35 00000001:00000040:3.0:1784189370.936755:0:96880:0:(tgt_lastrcvd.c:986:tgt_cb_last_committed()) callback PUTting export ffff9dbf4512b000 : new cb_count 30 00000020:00000040:3.0:1784189370.936757:0:96880:0:(genops.c:900:class_export_put()) PUTting export ffff9dbf4512b000 : new refcount 34 00000001:00000040:3.0:1784189370.936761:0:96880:0:(tgt_lastrcvd.c:986:tgt_cb_last_committed()) callback PUTting export ffff9dbf4512b000 : new cb_count 29 00000020:00000040:3.0:1784189370.936762:0:96880:0:(genops.c:900:class_export_put()) PUTting export ffff9dbf4512b000 : new refcount 33 00000001:00000040:3.0:1784189370.936765:0:96880:0:(tgt_lastrcvd.c:986:tgt_cb_last_committed()) callback PUTting export ffff9dbf4512b000 : new cb_count 28 00000020:00000040:3.0:1784189370.936767:0:96880:0:(genops.c:900:class_export_put()) PUTting export ffff9dbf4512b000 : new refcount 32 00000001:00000040:3.0:1784189370.936770:0:96880:0:(tgt_lastrcvd.c:986:tgt_cb_last_committed()) callback PUTting export ffff9dbf4512b000 : new cb_count 27 00000020:00000040:3.0:1784189370.936772:0:96880:0:(genops.c:900:class_export_put()) PUTting export ffff9dbf4512b000 : new refcount 31 00000001:00000040:3.0:1784189370.936776:0:96880:0:(tgt_lastrcvd.c:986:tgt_cb_last_committed()) callback PUTting export ffff9dbf4512b000 : new cb_count 26 00000020:00000040:3.0:1784189370.936778:0:96880:0:(genops.c:900:class_export_put()) PUTting export ffff9dbf4512b000 : new refcount 30 00000001:00000040:3.0:1784189370.936781:0:96880:0:(tgt_lastrcvd.c:986:tgt_cb_last_committed()) callback PUTting export ffff9dbf4512b000 : new cb_count 25 00000020:00000040:3.0:1784189370.936783:0:96880:0:(genops.c:900:class_export_put()) PUTting export ffff9dbf4512b000 : new refcount 29 00000001:00000040:3.0:1784189370.936789:0:96880:0:(tgt_lastrcvd.c:986:tgt_cb_last_committed()) callback PUTting export ffff9dbf4512b000 : new cb_count 24 00000020:00000040:3.0:1784189370.936900:0:96880:0:(genops.c:900:class_export_put()) PUTting export ffff9dbf4512b000 : new refcount 28 00000001:00000040:3.0:1784189370.936907:0:96880:0:(tgt_lastrcvd.c:986:tgt_cb_last_committed()) callback PUTting export ffff9dbf4512b000 : new cb_count 23 00000020:00000040:3.0:1784189370.936909:0:96880:0:(genops.c:900:class_export_put()) PUTting export ffff9dbf4512b000 : new refcount 27 00000001:00000040:3.0:1784189370.936913:0:96880:0:(tgt_lastrcvd.c:986:tgt_cb_last_committed()) callback PUTting export ffff9dbf4512b000 : new cb_count 22 00000020:00000040:3.0:1784189370.936914:0:96880:0:(genops.c:900:class_export_put()) PUTting export ffff9dbf4512b000 : new refcount 26 00000001:00000040:3.0:1784189370.936920:0:96880:0:(tgt_lastrcvd.c:986:tgt_cb_last_committed()) callback PUTting export ffff9dbf4512b000 : new cb_count 21 00000020:00000040:3.0:1784189370.936922:0:96880:0:(genops.c:900:class_export_put()) PUTting export ffff9dbf4512b000 : new refcount 25 00000001:00000040:3.0:1784189370.936926:0:96880:0:(tgt_lastrcvd.c:986:tgt_cb_last_committed()) callback PUTting export ffff9dbf4512b000 : new cb_count 20 00000020:00000040:3.0:1784189370.936928:0:96880:0:(genops.c:900:class_export_put()) PUTting export ffff9dbf4512b000 : new refcount 24 00000001:00000040:3.0:1784189370.936934:0:96880:0:(tgt_lastrcvd.c:986:tgt_cb_last_committed()) callback PUTting export ffff9dbf4512b000 : new cb_count 19 00000020:00000040:3.0:1784189370.936935:0:96880:0:(genops.c:900:class_export_put()) PUTting export ffff9dbf4512b000 : new refcount 23 00000001:00000040:3.0:1784189370.936940:0:96880:0:(tgt_lastrcvd.c:986:tgt_cb_last_committed()) callback PUTting export ffff9dbf4512b000 : new cb_count 18 00000020:00000040:3.0:1784189370.936942:0:96880:0:(genops.c:900:class_export_put()) PUTting export ffff9dbf4512b000 : new refcount 22 00000001:00000040:3.0:1784189370.936945:0:96880:0:(tgt_lastrcvd.c:986:tgt_cb_last_committed()) callback PUTting export ffff9dbf4512b000 : new cb_count 17 00000020:00000040:3.0:1784189370.936946:0:96880:0:(genops.c:900:class_export_put()) PUTting export ffff9dbf4512b000 : new refcount 21 00000001:00000040:3.0:1784189370.936956:0:96880:0:(tgt_lastrcvd.c:986:tgt_cb_last_committed()) callback PUTting export ffff9dbf4512b000 : new cb_count 16 00000020:00000040:3.0:1784189370.936958:0:96880:0:(genops.c:900:class_export_put()) PUTting export ffff9dbf4512b000 : new refcount 20 00000001:00000040:3.0:1784189370.936962:0:96880:0:(tgt_lastrcvd.c:986:tgt_cb_last_committed()) callback PUTting export ffff9dbf4512b000 : new cb_count 15 00000020:00000040:3.0:1784189370.936964:0:96880:0:(genops.c:900:class_export_put()) PUTting export ffff9dbf4512b000 : new refcount 19 00000001:00000040:3.0:1784189370.936968:0:96880:0:(tgt_lastrcvd.c:986:tgt_cb_last_committed()) callback PUTting export ffff9dbf4512b000 : new cb_count 14 00000020:00000040:3.0:1784189370.936969:0:96880:0:(genops.c:900:class_export_put()) PUTting export ffff9dbf4512b000 : new refcount 18 00000001:00000040:3.0:1784189370.936974:0:96880:0:(tgt_lastrcvd.c:986:tgt_cb_last_committed()) callback PUTting export ffff9dbf4512b000 : new cb_count 13 00000020:00000040:3.0:1784189370.936975:0:96880:0:(genops.c:900:class_export_put()) PUTting export ffff9dbf4512b000 : new refcount 17 00000001:00000040:3.0:1784189370.936979:0:96880:0:(tgt_lastrcvd.c:986:tgt_cb_last_committed()) callback PUTting export ffff9dbf4512b000 : new cb_count 12 00000020:00000040:3.0:1784189370.936981:0:96880:0:(genops.c:900:class_export_put()) PUTting export ffff9dbf4512b000 : new refcount 16 00000001:00000040:3.0:1784189370.936984:0:96880:0:(tgt_lastrcvd.c:986:tgt_cb_last_committed()) callback PUTting export ffff9dbf4512b000 : new cb_count 11 00000020:00000040:3.0:1784189370.936986:0:96880:0:(genops.c:900:class_export_put()) PUTting export ffff9dbf4512b000 : new refcount 15 00000001:00000040:3.0:1784189370.936988:0:96880:0:(tgt_lastrcvd.c:986:tgt_cb_last_committed()) callback PUTting export ffff9dbf4512b000 : new cb_count 10 00000020:00000040:3.0:1784189370.936990:0:96880:0:(genops.c:900:class_export_put()) PUTting export ffff9dbf4512b000 : new refcount 14 00000001:00000040:3.0:1784189370.936994:0:96880:0:(tgt_lastrcvd.c:986:tgt_cb_last_committed()) callback PUTting export ffff9dbf4512b000 : new cb_count 9 00000020:00000040:3.0:1784189370.936995:0:96880:0:(genops.c:900:class_export_put()) PUTting export ffff9dbf4512b000 : new refcount 13 00000001:00000040:3.0:1784189370.936998:0:96880:0:(tgt_lastrcvd.c:986:tgt_cb_last_committed()) callback PUTting export ffff9dbf4512b000 : new cb_count 8 00000020:00000040:3.0:1784189370.936999:0:96880:0:(genops.c:900:class_export_put()) PUTting export ffff9dbf4512b000 : new refcount 12 00000001:00000040:3.0:1784189370.937002:0:96880:0:(tgt_lastrcvd.c:986:tgt_cb_last_committed()) callback PUTting export ffff9dbf4512b000 : new cb_count 7 00000020:00000040:3.0:1784189370.937003:0:96880:0:(genops.c:900:class_export_put()) PUTting export ffff9dbf4512b000 : new refcount 11 00000001:00000040:3.0:1784189370.937006:0:96880:0:(tgt_lastrcvd.c:986:tgt_cb_last_committed()) callback PUTting export ffff9dbf4512b000 : new cb_count 6 00000020:00000040:3.0:1784189370.937008:0:96880:0:(genops.c:900:class_export_put()) PUTting export ffff9dbf4512b000 : new refcount 10 00000001:00000040:3.0:1784189370.937010:0:96880:0:(tgt_lastrcvd.c:986:tgt_cb_last_committed()) callback PUTting export ffff9dbf4512b000 : new cb_count 5 00000020:00000040:3.0:1784189370.937012:0:96880:0:(genops.c:900:class_export_put()) PUTting export ffff9dbf4512b000 : new refcount 9 00000001:00000040:3.0:1784189370.937015:0:96880:0:(tgt_lastrcvd.c:986:tgt_cb_last_committed()) callback PUTting export ffff9dbf4512b000 : new cb_count 4 00000020:00000040:3.0:1784189370.937017:0:96880:0:(genops.c:900:class_export_put()) PUTting export ffff9dbf4512b000 : new refcount 8 00000001:00000040:3.0:1784189370.937019:0:96880:0:(tgt_lastrcvd.c:986:tgt_cb_last_committed()) callback PUTting export ffff9dbf4512b000 : new cb_count 3 00000020:00000040:3.0:1784189370.937021:0:96880:0:(genops.c:900:class_export_put()) PUTting export ffff9dbf4512b000 : new refcount 7 00000001:00000040:3.0:1784189370.937024:0:96880:0:(tgt_lastrcvd.c:986:tgt_cb_last_committed()) callback PUTting export ffff9dbf4512b000 : new cb_count 2 00000020:00000040:3.0:1784189370.937026:0:96880:0:(genops.c:900:class_export_put()) PUTting export ffff9dbf4512b000 : new refcount 6 00000001:00000040:3.0:1784189370.937103:0:96880:0:(tgt_lastrcvd.c:986:tgt_cb_last_committed()) callback PUTting export ffff9dbf4512b000 : new cb_count 1 00000020:00000040:3.0:1784189370.937106:0:96880:0:(genops.c:900:class_export_put()) PUTting export ffff9dbf4512b000 : new refcount 5 00000001:00000040:3.0:1784189370.937109:0:96880:0:(tgt_lastrcvd.c:986:tgt_cb_last_committed()) callback PUTting export ffff9dbf4512b000 : new cb_count 0 00000020:00000040:3.0:1784189370.937111:0:96880:0:(genops.c:900:class_export_put()) PUTting export ffff9dbf4512b000 : new refcount 4 00010000:00010000:3.0:1784189371.120503:0:7454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1784189371.387082:0:97237:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg312-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:3.0:1784189371.441045:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1784189371.442680:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc0505be680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1870854458278400:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1784189371.443849:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784189371.445420:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458278400 00000100:00100000:1.0:1784189371.445431:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458278400 00000100:00100000:1.0:1784189371.445905:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2095 00000100:00100000:1.0:1784189371.445916:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc080df0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1870854458278400:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1784189371.445950:0:8432:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8646976 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1784189371.446093:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc080df0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1870854458278400:12345-0@lo:13:osp-pre-1-1.0 Request processed in 178us (2245us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189371.446101:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2095 00000100:00100000:3.0:1784189371.446421:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc0505be680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1870854458278400:0@lo:13:osp-pre-1-1.0 00000100:00080000:2.0:1784189371.955111:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level REPLAY_WAIT/7 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1784189371.955118:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: REPLAY_WAIT) 00000100:00080000:2.0:1784189371.955137:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level REPLAY_WAIT/7 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1784189371.955140:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: REPLAY_WAIT) 00000100:00100000:2.0:1784189371.955185:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc080d5fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:bd553d0d-03e2-4233-b06b-b55bbfa2b954:3641:1870854458278528:0@lo:400:kworker.0 00000100:00100000:2.0:1784189371.955260:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784189371.955298:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc080d5d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1870854458279040:0@lo:400:kworker.0 00000100:00100000:2.0:1784189371.955360:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784189371.955386:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc080d5dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3641:1870854458279552:0@lo:400:kworker.0 00000100:00100000:2.0:1784189371.955409:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784189371.955434:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1784189371.955440:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc080d5c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1870854458278912:0@lo:400:kworker.0 00000100:00100000:2.0:1784189371.955463:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784189371.955479:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc080d5ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1870854458279424:0@lo:400:kworker.0 00000100:00100000:2.0:1784189371.955498:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784189371.955526:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc080d5df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3642:1870854458278656:0@lo:400:kworker.0 00000100:00100000:2.0:1784189371.955548:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784189371.955564:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc080d5d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3642:1870854458279168:0@lo:400:kworker.0 00000100:00100000:2.0:1784189371.955596:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784189371.955613:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc080d5f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3642:1870854458279680:0@lo:400:kworker.0 00000100:00100000:2.0:1784189371.955636:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784189371.955652:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:2.0:1784189371.955656:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc080d5c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3642:1870854458278784:0@lo:400:kworker.0 00000100:00100000:2.0:1784189371.955677:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784189371.955693:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc080d5d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1870854458279296:0@lo:400:kworker.0 00000100:00100000:2.0:1784189371.955713:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784189371.955726:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc080d5ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3642:1870854458279808:0@lo:400:kworker.0 00000100:00100000:2.0:1784189371.955753:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784189371.956074:0:94308:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458278528 00000100:00100000:2.0:1784189371.956090:0:94308:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458278528 00000100:00100000:2.0:1784189371.956142:0:94308:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 213 00000100:00100000:2.0:1784189371.956151:0:94308:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc044942450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd553d0d-03e2-4233-b06b-b55bbfa2b954+24:3641:x1870854458278528:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784189371.956201:0:94308:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc044942450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd553d0d-03e2-4233-b06b-b55bbfa2b954+24:3641:x1870854458278528:12345-0@lo:400:kworker.0 Request processed in 50us (939us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189371.956208:0:94308:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 213 00000100:00100000:2.0:1784189371.956249:0:66169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458279552 00000100:00100000:2.0:1784189371.956253:0:66169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458279552 00000100:00100000:2.0:1784189371.956272:0:66169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458278656 00000100:00100000:2.0:1784189371.956275:0:66169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458278656 00000100:00100000:2.0:1784189371.956288:0:66169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458279168 00000100:00100000:2.0:1784189371.956290:0:66169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458279168 00000100:00100000:2.0:1784189371.956298:0:66169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458279680 00000100:00100000:2.0:1784189371.956300:0:66169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458279680 00000100:00100000:2.0:1784189371.956309:0:66169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458278784 00000100:00100000:2.0:1784189371.956311:0:66169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458278784 00000100:00100000:2.0:1784189371.956425:0:66169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458279808 00000100:00100000:2.0:1784189371.956429:0:66169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458279808 00000100:00100000:2.0:1784189371.956445:0:66169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1396 00000100:00100000:2.0:1784189371.956451:0:66169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc080d5f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1870854458279552:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784189371.956486:0:66169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc080d5f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1870854458279552:12345-0@lo:400:kworker.0 Request processed in 35us (1075us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189371.956492:0:66169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1396 00000100:00100000:2.0:1784189371.956504:0:66169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1397 00000100:00100000:2.0:1784189371.956509:0:66169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc080d5ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3642:x1870854458278656:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784189371.956540:0:66169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc080d5ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3642:x1870854458278656:12345-0@lo:400:kworker.0 Request processed in 31us (991us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189371.956546:0:66169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1397 00000100:00100000:2.0:1784189371.956556:0:66169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1398 00000100:00100000:2.0:1784189371.956569:0:66169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc080d5ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1870854458279168:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784189371.956610:0:66169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc080d5ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1870854458279168:12345-0@lo:400:kworker.0 Request processed in 41us (1013us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189371.956616:0:66169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1398 00000100:00100000:2.0:1784189371.956628:0:66169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1399 00000100:00100000:2.0:1784189371.956634:0:66169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc080d5e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3642:x1870854458279680:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784189371.956660:0:66169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc080d5e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3642:x1870854458279680:12345-0@lo:400:kworker.0 Request processed in 26us (1023us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189371.956666:0:66169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1399 00000100:00100000:2.0:1784189371.956677:0:66169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1400 00000100:00100000:2.0:1784189371.956682:0:66169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc050bcfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1870854458278784:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784189371.956709:0:66169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc050bcfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1870854458278784:12345-0@lo:400:kworker.0 Request processed in 27us (1031us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189371.956714:0:66169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1400 00000100:00100000:2.0:1784189371.956725:0:66169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1401 00000100:00100000:2.0:1784189371.956731:0:66169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc050bcf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1870854458279808:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784189371.956768:0:66169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc050bcf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1870854458279808:12345-0@lo:400:kworker.0 Request processed in 26us (1002us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189371.956774:0:66169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1401 00000100:00100000:2.0:1784189371.956794:0:26492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458278912 00000100:00100000:2.0:1784189371.956797:0:26492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458278912 00000100:00100000:2.0:1784189371.956821:0:26492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458279296 00000100:00100000:2.0:1784189371.956824:0:26492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458279296 00000100:00100000:2.0:1784189371.956841:0:26492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3975 00000100:00100000:2.0:1784189371.956847:0:26492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc080d5f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3641:x1870854458278912:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784189371.956882:0:26492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc080d5f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3641:x1870854458278912:12345-0@lo:400:kworker.0 Request processed in 35us (1418us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189371.956897:0:26492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3975 00000100:00100000:2.0:1784189371.956910:0:26492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3976 00000100:00100000:2.0:1784189371.956916:0:26492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc050bcdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3642:x1870854458279296:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784189371.956945:0:26492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc050bcdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3642:x1870854458279296:12345-0@lo:400:kworker.0 Request processed in 30us (1232us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189371.956950:0:26492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3976 00000100:00100000:2.0:1784189371.956967:0:14684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458279040 00000100:00100000:2.0:1784189371.956970:0:14684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458279040 00000100:00100000:2.0:1784189371.956990:0:14684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458279424 00000100:00100000:2.0:1784189371.956993:0:14684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458279424 00000100:00100000:2.0:1784189371.957019:0:14684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2620 00000100:00100000:2.0:1784189371.957026:0:14684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc080d5e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3641:x1870854458279040:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784189371.957056:0:14684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc080d5e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3641:x1870854458279040:12345-0@lo:400:kworker.0 Request processed in 31us (1696us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189371.957062:0:14684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2620 00000100:00100000:2.0:1784189371.957073:0:14684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2621 00000100:00100000:2.0:1784189371.957079:0:14684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc080d5c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3641:x1870854458279424:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784189371.957103:0:14684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc080d5c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3641:x1870854458279424:12345-0@lo:400:kworker.0 Request processed in 25us (1605us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189371.957109:0:14684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2621 00000100:00100000:2.0:1784189371.957164:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc080d5c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3642:1870854458278784:0@lo:400:kworker.0 00000100:00100000:2.0:1784189371.957177:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc080d5d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1870854458279296:0@lo:400:kworker.0 00000100:00100000:2.0:1784189371.957189:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc080d5ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3642:1870854458279808:0@lo:400:kworker.0 00000100:00100000:2.0:1784189371.957199:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc080d5df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3642:1870854458278656:0@lo:400:kworker.0 00000100:00100000:2.0:1784189371.957219:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc080d5d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3642:1870854458279168:0@lo:400:kworker.0 00000100:00100000:2.0:1784189371.957228:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc080d5f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3642:1870854458279680:0@lo:400:kworker.0 00000100:00100000:2.0:1784189371.957274:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc080d5c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1870854458278912:0@lo:400:kworker.0 00000100:00100000:2.0:1784189371.957285:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc080d5ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1870854458279424:0@lo:400:kworker.0 00000100:00100000:2.0:1784189371.957293:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc080d5fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:bd553d0d-03e2-4233-b06b-b55bbfa2b954:3641:1870854458278528:0@lo:400:kworker.0 00000100:00100000:2.0:1784189371.957303:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc080d5d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1870854458279040:0@lo:400:kworker.0 00000100:00100000:2.0:1784189371.957311:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc080d5dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3641:1870854458279552:0@lo:400:kworker.0 00000100:00080000:0.0:1784189371.957521:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1784189372.148002:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1784189372.222355:0:97289:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1784189372.222612:0:97289:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:0.0:1784189372.651565:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1784189372.651620:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1784189372.651651:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1784189372.651676:0:94309:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436390912 00000100:00100000:1.0:1784189372.651686:0:94309:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436390912 00000100:00100000:1.0:1784189372.651739:0:94309:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 214 00000100:00100000:1.0:1784189372.651763:0:94309:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf44915450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:60f345e3-c70e-4f53-b5e7-c9671463c9a5+10:2399:x1870854436390912:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:0.0:1784189372.651806:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1784189372.651829:0:94309:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf44915450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:60f345e3-c70e-4f53-b5e7-c9671463c9a5+10:2399:x1870854436390912:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 67us (272us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189372.651837:0:94309:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 214 00000100:00100000:3.0:1784189372.651850:0:66169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436391168 00000100:00100000:3.0:1784189372.651854:0:66169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436391168 00000100:00100000:3.0:1784189372.651901:0:66169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436391040 00000100:00100000:3.0:1784189372.651905:0:66169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436391040 00000100:00100000:3.0:1784189372.651930:0:66169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1402 00000100:00100000:3.0:1784189372.651937:0:66169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc0505bdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:debedd94-805c-42a0-a5e5-41758b2012e9+11:2399:x1870854436391168:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:1.0:1784189372.652000:0:68287:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1403 00000100:00100000:1.0:1784189372.652008:0:68287:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc0505bfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:debedd94-805c-42a0-a5e5-41758b2012e9+51:2399:x1870854436391040:12345-192.168.203.12@tcp:400:kworker.0 00000100:00080000:2.0:1784189372.652810:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1784189372.652816:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1784189372.654639:0:26161:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436391296 00000100:00100000:0.0:1784189372.654652:0:26161:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436391296 00000100:00100000:3.0:1784189372.654969:0:66169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc0505bdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:debedd94-805c-42a0-a5e5-41758b2012e9+11:2399:x1870854436391168:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 3025us (3342us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189372.654980:0:66169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1402 00000100:00100000:0.0:1784189372.655273:0:26161:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 2622 00000100:00100000:0.0:1784189372.655282:0:26161:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc0505be300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:debedd94-805c-42a0-a5e5-41758b2012e9+7:2399:x1870854436391296:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:0.0:1784189372.655374:0:26161:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc0505be300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:debedd94-805c-42a0-a5e5-41758b2012e9+7:2399:x1870854436391296:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 92us (3566us total) trans 0 rc 0/0 00000100:00100000:0.0:1784189372.655380:0:26161:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 2622 00000100:00080000:3.0:1784189372.655433:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1784189372.659684:0:68287:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc0505bfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:debedd94-805c-42a0-a5e5-41758b2012e9+51:2399:x1870854436391040:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 7664us (8019us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189372.659699:0:68287:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1403 00000020:00000004:3.0:1784189373.024232:0:97339:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1784189373.024950:0:97339:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1784189373.167467:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784189374.000029:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc080df3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1870854458279936:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1784189374.000110:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784189374.000164:0:26492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458279936 00000100:00100000:3.0:1784189374.000170:0:26492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458279936 00000100:00100000:3.0:1784189374.000228:0:26492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3977 00000100:00100000:3.0:1784189374.000236:0:26492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc056eaf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3640:x1870854458279936:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1784189374.000278:0:26492:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445568512 avail 1299329024 00000100:00100000:3.0:1784189374.000355:0:26492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc056eaf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3640:x1870854458279936:12345-0@lo:41:osp-pre-1-0.0 Request processed in 119us (245us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189374.000362:0:26492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3977 00000100:00100000:3.0:1784189374.000410:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc080df3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1870854458279936:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1784189374.001033:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc05ed39880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1870854458280064:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1784189374.001067:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784189374.001146:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458280064 00000100:00100000:0.0:1784189374.001151:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458280064 00000100:00100000:0.0:1784189374.001189:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3978 00000100:00100000:0.0:1784189374.001197:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc056eadf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3641:x1870854458280064:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1784189374.001219:0:8438:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445249024 avail 1299009536 00000100:00100000:0.0:1784189374.004920:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc056eadf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3641:x1870854458280064:12345-0@lo:41:osp-pre-0-1.0 Request processed in 3714us (3843us total) trans 0 rc 0/0 00000100:00100000:0.0:1784189374.004950:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3978 00000100:00100000:3.0:1784189374.005180:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc05ed39880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1870854458280064:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1784189374.192916:0:26173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784189374.511722:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1784189374.511746:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc0505be680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1870854458280192:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1784189374.511817:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784189374.511864:0:9466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458280192 00000100:00100000:1.0:1784189374.511871:0:9466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458280192 00000100:00100000:1.0:1784189374.511936:0:9466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2096 00000100:00100000:1.0:1784189374.511946:0:9466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc05ed39500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1870854458280192:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1784189374.511975:0:9466:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8646976 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1784189374.512028:0:9466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc05ed39500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1870854458280192:12345-0@lo:13:osp-pre-1-0.0 Request processed in 84us (211us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189374.512035:0:9466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2096 00000100:00100000:1.0:1784189374.512077:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc0505be680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1870854458280192:0@lo:13:osp-pre-1-0.0 00000100:00080000:0.0:1784189374.513494:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1784189375.216830:0:7454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784189376.245606:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784189376.559936:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc0505be680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1870854458280320:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1784189376.560005:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784189376.560180:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458280320 00000100:00100000:0.0:1784189376.560189:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458280320 00000100:00100000:0.0:1784189376.560257:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2097 00000100:00100000:0.0:1784189376.560267:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc05ed3a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1870854458280320:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1784189376.560296:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8646976 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1784189376.560363:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc05ed3a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1870854458280320:12345-0@lo:13:osp-pre-1-1.0 Request processed in 96us (357us total) trans 0 rc 0/0 00000100:00100000:0.0:1784189376.560371:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2097 00000100:00100000:1.0:1784189376.560839:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc0505be680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1870854458280320:0@lo:13:osp-pre-1-1.0 00000100:00080000:3.0:1784189376.560911:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1784189377.072013:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc0505be680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bd553d0d-03e2-4233-b06b-b55bbfa2b954:3640:1870854458280448:0@lo:400:kworker.0 00000100:00100000:2.0:1784189377.072093:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784189377.072188:0:94308:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458280448 00000100:00100000:3.0:1784189377.072195:0:94308:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458280448 00000100:00100000:3.0:1784189377.072251:0:94308:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 215 00000100:00100000:3.0:1784189377.072261:0:94308:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf44914050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd553d0d-03e2-4233-b06b-b55bbfa2b954+24:3640:x1870854458280448:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784189377.072389:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc07130fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3641:1870854458280576:0@lo:400:kworker.0 00000100:00100000:1.0:1784189377.072425:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784189377.072486:0:66945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458280576 00000100:00100000:1.0:1784189377.072490:0:66945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458280576 00000100:00100000:1.0:1784189377.072532:0:66945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1404 00000100:00100000:1.0:1784189377.072548:0:66945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc05ed3aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1870854458280576:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784189377.072587:0:66945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc05ed3aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1870854458280576:12345-0@lo:400:kworker.0 Request processed in 49us (161us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189377.072593:0:66945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1404 00000100:00080000:1.0:1784189377.072612:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1784189377.072713:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc07130fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3641:1870854458280576:0@lo:400:kworker.0 00000100:00100000:3.0:1784189377.080599:0:94308:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf44914050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd553d0d-03e2-4233-b06b-b55bbfa2b954+24:3640:x1870854458280448:12345-0@lo:400:kworker.0 Request processed in 8328us (8495us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189377.080616:0:94308:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 215 00000100:00080000:0.0:1784189377.080961:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level REPLAY_WAIT/7 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1784189377.080966:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: REPLAY_WAIT) 00000100:00080000:0.0:1784189377.080995:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level REPLAY_WAIT/7 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1784189377.080998:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: REPLAY_WAIT) 00000100:00100000:0.0:1784189377.081041:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc05ed7d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3641:1870854458281088:0@lo:400:kworker.0 00000100:00100000:0.0:1784189377.081093:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784189377.081119:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc05ed7fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3641:1870854458281600:0@lo:400:kworker.0 00000100:00100000:0.0:1784189377.081145:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784189377.081165:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1784189377.081170:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc07130fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1870854458280960:0@lo:400:kworker.0 00000100:00100000:0.0:1784189377.081194:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784189377.081211:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc05ed7dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3641:1870854458281472:0@lo:400:kworker.0 00000100:00100000:0.0:1784189377.081233:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784189377.081262:0:26160:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458280960 00000100:00100000:0.0:1784189377.081292:0:26160:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458280960 00000100:00100000:0.0:1784189377.081356:0:26160:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2623 00000100:00100000:0.0:1784189377.081365:0:26160:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc05ed7d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:3641:x1870854458280960:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784189377.082233:0:68287:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458281088 00000100:00100000:1.0:1784189377.082240:0:68287:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458281088 00000100:00100000:1.0:1784189377.082277:0:68287:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458281600 00000100:00100000:1.0:1784189377.082280:0:68287:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458281600 00000100:00100000:1.0:1784189377.082307:0:68287:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458281472 00000100:00100000:1.0:1784189377.082310:0:68287:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458281472 00000100:00100000:1.0:1784189377.082344:0:68287:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1405 00000100:00100000:1.0:1784189377.082352:0:68287:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc05ed7c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1870854458281088:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784189377.082452:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc07130e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3642:1870854458280704:0@lo:400:kworker.0 00000100:00100000:1.0:1784189377.083883:0:68287:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc05ed7c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1870854458281088:12345-0@lo:400:kworker.0 Request processed in 1525us (2782us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189377.083895:0:68287:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1405 00000100:00100000:1.0:1784189377.083925:0:68287:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1406 00000100:00100000:1.0:1784189377.083935:0:68287:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc05ed7c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1870854458281600:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784189377.083978:0:68287:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc05ed7c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1870854458281600:12345-0@lo:400:kworker.0 Request processed in 46us (2832us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189377.083995:0:68287:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1406 00000100:00100000:1.0:1784189377.084008:0:68287:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1407 00000100:00100000:1.0:1784189377.084015:0:68287:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc05ed7e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1870854458281472:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784189377.084046:0:68287:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc05ed7e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1870854458281472:12345-0@lo:400:kworker.0 Request processed in 31us (2812us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189377.084052:0:68287:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1407 00000100:00080000:1.0:1784189377.084076:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1784189377.084098:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc07130e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1870854458280832:0@lo:400:kworker.0 00000100:00100000:1.0:1784189377.084133:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784189377.084162:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc05ed7d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1870854458281344:0@lo:400:kworker.0 00000100:00100000:1.0:1784189377.084182:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784189377.084211:0:26170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458281344 00000100:00100000:1.0:1784189377.084217:0:26170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458281344 00000100:00100000:1.0:1784189377.084276:0:26170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2624 00000100:00100000:1.0:1784189377.084283:0:26170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc05ed39880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+5:3643:x1870854458281344:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784189377.084332:0:26170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc05ed39880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+5:3643:x1870854458281344:12345-0@lo:400:kworker.0 Request processed in 36us (135us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189377.084339:0:26170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2624 00000100:00080000:1.0:1784189377.084356:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1784189377.084394:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc05ed7d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1870854458281344:0@lo:400:kworker.0 00000100:00100000:2.0:1784189377.084641:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc0505be680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bd553d0d-03e2-4233-b06b-b55bbfa2b954:3640:1870854458280448:0@lo:400:kworker.0 00000100:00100000:2.0:1784189377.084694:0:26492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458280832 00000100:00100000:2.0:1784189377.084698:0:26492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458280832 00000100:00100000:2.0:1784189377.084727:0:26492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3979 00000100:00100000:2.0:1784189377.084733:0:26492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc05ed38a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3643:x1870854458280832:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784189377.084772:0:26492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc05ed38a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3643:x1870854458280832:12345-0@lo:400:kworker.0 Request processed in 39us (639us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189377.084779:0:26492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3979 00000100:00100000:2.0:1784189377.084829:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc07130fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1870854458280960:0@lo:400:kworker.0 00000100:00100000:2.0:1784189377.084841:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc05ed7dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3641:1870854458281472:0@lo:400:kworker.0 00000100:00100000:2.0:1784189377.084863:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc05ed7d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3641:1870854458281088:0@lo:400:kworker.0 00000100:00100000:2.0:1784189377.084872:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc05ed7fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3641:1870854458281600:0@lo:400:kworker.0 00000100:00100000:1.0:1784189377.085704:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc07130e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1870854458280832:0@lo:400:kworker.0 00000100:00100000:1.0:1784189377.089906:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784189377.089963:0:68287:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458280704 00000100:00100000:1.0:1784189377.089972:0:68287:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458280704 00000100:00100000:1.0:1784189377.090030:0:68287:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1408 00000100:00100000:1.0:1784189377.090056:0:68287:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc05ed39f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1870854458280704:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784189377.090115:0:68287:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc05ed39f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1870854458280704:12345-0@lo:400:kworker.0 Request processed in 63us (216us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189377.090122:0:68287:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1408 00000100:00080000:1.0:1784189377.090149:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1784189377.090182:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc07130e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3642:1870854458280704:0@lo:400:kworker.0 00000100:00100000:1.0:1784189377.090193:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc05ed7e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1870854458281216:0@lo:400:kworker.0 00000100:00100000:1.0:1784189377.090230:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784189377.090253:0:23826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458281216 00000100:00100000:1.0:1784189377.090257:0:23826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458281216 00000100:00100000:1.0:1784189377.090291:0:23826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3980 00000100:00100000:1.0:1784189377.090299:0:23826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf4262ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3642:x1870854458281216:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784189377.090355:0:23826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf4262ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3642:x1870854458281216:12345-0@lo:400:kworker.0 Request processed in 56us (124us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189377.090362:0:23826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3980 00000100:00100000:1.0:1784189377.090387:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc05ed7e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1870854458281216:0@lo:400:kworker.0 00000100:00100000:1.0:1784189377.090394:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc05ed7ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3642:1870854458281728:0@lo:400:kworker.0 00000100:00100000:1.0:1784189377.090417:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784189377.090435:0:66945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458281728 00000100:00100000:1.0:1784189377.090438:0:66945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458281728 00000100:00080000:2.0:1784189377.090744:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1784189377.091081:0:66945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1409 00000100:00100000:1.0:1784189377.091090:0:66945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf4262df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1870854458281728:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784189377.091131:0:66945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf4262df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1870854458281728:12345-0@lo:400:kworker.0 Request processed in 43us (714us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189377.091138:0:66945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1409 00000100:00100000:1.0:1784189377.091180:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc05ed7ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3642:1870854458281728:0@lo:400:kworker.0 00000100:00100000:0.0:1784189377.092013:0:26160:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc05ed7d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:3641:x1870854458280960:12345-0@lo:400:kworker.0 Request processed in 10644us (10812us total) trans 0 rc 0/0 00000100:00100000:0.0:1784189377.092025:0:26160:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2623 00010000:00010000:1.0:1784189377.264211:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784189377.832133:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1784189377.832183:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1784189377.832213:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1784189377.832243:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1784189377.832415:0:66169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436391680 00000100:00100000:3.0:1784189377.832442:0:66169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436391680 00000100:00100000:3.0:1784189377.832524:0:66169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436391552 00000100:00100000:3.0:1784189377.832528:0:66169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436391552 00000100:00100000:3.0:1784189377.832570:0:66169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1410 00000100:00100000:3.0:1784189377.832599:0:66169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc050bcce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:debedd94-805c-42a0-a5e5-41758b2012e9+11:2399:x1870854436391680:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:3.0:1784189377.832714:0:66169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc050bcce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:debedd94-805c-42a0-a5e5-41758b2012e9+11:2399:x1870854436391680:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 118us (529us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189377.832723:0:66169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1410 00000100:00100000:3.0:1784189377.832741:0:66169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1411 00000100:00100000:3.0:1784189377.832748:0:66169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc050bce300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:debedd94-805c-42a0-a5e5-41758b2012e9+51:2399:x1870854436391552:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:3.0:1784189377.832784:0:66169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc050bce300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:debedd94-805c-42a0-a5e5-41758b2012e9+51:2399:x1870854436391552:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 37us (570us total) trans 0 rc 0/0 00000100:00100000:3.0:1784189377.832790:0:66169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1411 00000100:00080000:3.0:1784189377.832806:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1784189377.832810:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1784189377.832942:0:94309:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436391424 00000100:00100000:1.0:1784189377.832948:0:94309:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436391424 00000100:00100000:1.0:1784189377.832990:0:94309:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 216 00000100:00100000:1.0:1784189377.832996:0:94309:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf44916850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:60f345e3-c70e-4f53-b5e7-c9671463c9a5+10:2399:x1870854436391424:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:1.0:1784189377.833036:0:94309:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf44916850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:60f345e3-c70e-4f53-b5e7-c9671463c9a5+10:2399:x1870854436391424:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 39us (918us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189377.833043:0:94309:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 216 00000100:00100000:1.0:1784189377.833080:0:26159:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436391808 00000100:00100000:1.0:1784189377.833084:0:26159:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436391808 00000100:00100000:1.0:1784189377.833118:0:26159:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 2625 00000100:00100000:1.0:1784189377.833124:0:26159:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc050bce680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:debedd94-805c-42a0-a5e5-41758b2012e9+7:2399:x1870854436391808:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:1.0:1784189377.833152:0:26159:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc050bce680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:debedd94-805c-42a0-a5e5-41758b2012e9+7:2399:x1870854436391808:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 28us (908us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189377.833158:0:26159:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 2625 00000100:00080000:3.0:1784189377.833482:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1784189378.298711:0:26173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1784189378.351956:0:97532:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg312-client.virtnet: executing wait_import_state_mount REPLAY_LOCKS osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 00000100:00100000:0.0:1784189379.119619:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1784189379.119892:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dbf4262f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1870854458281984:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1784189379.120011:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784189379.120302:0:26492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458281984 00000100:00100000:1.0:1784189379.120313:0:26492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458281984 00000100:00100000:1.0:1784189379.120402:0:26492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3981 00000100:00100000:1.0:1784189379.120411:0:26492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc050bcd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3640:x1870854458281984:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1784189379.120454:0:26492:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445249024 avail 1299009536 00000100:00100000:1.0:1784189379.120516:0:26492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc050bcd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3640:x1870854458281984:12345-0@lo:41:osp-pre-0-1.0 Request processed in 105us (505us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189379.120534:0:26492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3981 00000100:00100000:1.0:1784189379.120593:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dbf4262f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1870854458281984:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1784189379.122649:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc056eaea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1870854458281856:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1784189379.122743:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784189379.122965:0:23826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458281856 00000100:00100000:1.0:1784189379.122974:0:23826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458281856 00000100:00100000:1.0:1784189379.123044:0:23826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3982 00000100:00100000:1.0:1784189379.123053:0:23826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc05ed7c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3642:x1870854458281856:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1784189379.123295:0:23826:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445568512 avail 1299329024 00000100:00100000:1.0:1784189379.123391:0:23826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc05ed7c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3642:x1870854458281856:12345-0@lo:41:osp-pre-1-0.0 Request processed in 338us (647us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189379.123400:0:23826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3982 00000100:00100000:0.0:1784189379.123535:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc056eaea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1870854458281856:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1784189379.311931:0:7454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784189379.631570:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1784189379.631601:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc05ed7f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1870854458282112:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1784189379.631708:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784189379.632008:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458282112 00000100:00100000:1.0:1784189379.632020:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458282112 00000100:00100000:1.0:1784189379.632104:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2098 00000100:00100000:1.0:1784189379.632117:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc05ed7f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1870854458282112:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1784189379.632157:0:8432:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8646976 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1784189379.632213:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc05ed7f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1870854458282112:12345-0@lo:13:osp-pre-1-0.0 Request processed in 99us (505us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189379.632221:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2098 00000100:00080000:3.0:1784189379.632283:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1784189379.640166:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc05ed7f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1870854458282112:0@lo:13:osp-pre-1-0.0 00000001:02000400:3.0:1784189380.007483:0:97580:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid in REPLAY_LOCKS state after 0 sec 00010000:00010000:3.0:1784189380.339499:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784189381.360175:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1784189381.558166:0:97629:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: replay-single test_135: @@@@@@ FAIL: Unexpected sync success 00000100:00100000:1.0:1784189381.679559:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc05ed7f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1870854458282240:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1784189381.679633:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784189381.679735:0:9466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458282240 00000100:00100000:0.0:1784189381.679744:0:9466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458282240 00000100:00100000:0.0:1784189381.679812:0:9466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2099 00000100:00100000:0.0:1784189381.679823:0:9466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf4262f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1870854458282240:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1784189381.679854:0:9466:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8646976 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1784189381.679901:0:9466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf4262f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1870854458282240:12345-0@lo:13:osp-pre-1-1.0 Request processed in 80us (267us total) trans 0 rc 0/0 00000100:00100000:0.0:1784189381.679909:0:9466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2099 00000100:00080000:1.0:1784189381.680023:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1784189381.680067:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc05ed7f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1870854458282240:0@lo:13:osp-pre-1-1.0 00000100:00080000:0.0:1784189382.193238:0:93049:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level REPLAY_WAIT/7 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1784189382.193246:0:93049:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: REPLAY_WAIT) 00000100:00080000:0.0:1784189382.193280:0:93049:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level REPLAY_WAIT/7 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1784189382.193283:0:93049:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: REPLAY_WAIT) 00000100:00100000:1.0:1784189382.193505:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc05ed7df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3641:1870854458282624:0@lo:400:kworker.0 00000100:00100000:1.0:1784189382.193575:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784189382.193607:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc05ed7e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1870854458283136:0@lo:400:kworker.0 00000100:00100000:1.0:1784189382.193660:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784189382.193680:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc05ed7d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3641:1870854458283648:0@lo:400:kworker.0 00000100:00100000:1.0:1784189382.193702:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784189382.193729:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:1.0:1784189382.193735:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc05ed7ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3641:1870854458282496:0@lo:400:kworker.0 00000100:00100000:1.0:1784189382.193770:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784189382.193789:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc05ed7ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3641:1870854458283008:0@lo:400:kworker.0 00000100:00100000:1.0:1784189382.193807:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784189382.193821:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc05ed7dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3641:1870854458283520:0@lo:400:kworker.0 00000100:00100000:1.0:1784189382.193840:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784189382.193871:0:26492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458283136 00000100:00100000:1.0:1784189382.193878:0:26492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458283136 00000100:00100000:1.0:1784189382.193934:0:26492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3983 00000100:00100000:1.0:1784189382.193943:0:26492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf4262e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3641:x1870854458283136:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784189382.193998:0:26492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf4262e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3641:x1870854458283136:12345-0@lo:400:kworker.0 Request processed in 55us (348us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189382.194005:0:26492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3983 00000100:00100000:1.0:1784189382.194026:0:66169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458282624 00000100:00100000:1.0:1784189382.194030:0:66169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458282624 00000100:00100000:1.0:1784189382.194059:0:66169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458283648 00000100:00100000:1.0:1784189382.194062:0:66169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458283648 00000100:00100000:1.0:1784189382.194075:0:66169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458282496 00000100:00100000:1.0:1784189382.194077:0:66169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458282496 00000100:00100000:1.0:1784189382.194088:0:66169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458283008 00000100:00100000:1.0:1784189382.194090:0:66169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458283008 00000100:00100000:1.0:1784189382.194098:0:66169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458283520 00000100:00100000:1.0:1784189382.194101:0:66169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458283520 00000100:00100000:1.0:1784189382.194112:0:66169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1412 00000100:00100000:1.0:1784189382.194125:0:66169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf4262d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1870854458282624:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784189382.194158:0:66169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf4262d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1870854458282624:12345-0@lo:400:kworker.0 Request processed in 34us (584us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189382.194165:0:66169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1412 00000100:00100000:1.0:1784189382.194179:0:66169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1413 00000100:00100000:1.0:1784189382.194185:0:66169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf4262c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1870854458283648:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784189382.194211:0:66169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf4262c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1870854458283648:12345-0@lo:400:kworker.0 Request processed in 26us (508us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189382.194221:0:66169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1413 00000100:00100000:1.0:1784189382.194233:0:66169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1414 00000100:00100000:1.0:1784189382.194238:0:66169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf4262d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1870854458282496:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784189382.194265:0:66169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf4262d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1870854458282496:12345-0@lo:400:kworker.0 Request processed in 26us (494us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189382.194270:0:66169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1414 00000100:00100000:1.0:1784189382.194281:0:66169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1415 00000100:00100000:1.0:1784189382.194287:0:66169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf4262c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1870854458283008:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784189382.194312:0:66169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf4262c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1870854458283008:12345-0@lo:400:kworker.0 Request processed in 26us (503us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189382.194353:0:66169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1415 00000100:00100000:1.0:1784189382.194365:0:66169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1416 00000100:00100000:1.0:1784189382.194371:0:66169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf4262e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1870854458283520:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784189382.194411:0:66169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf4262e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1870854458283520:12345-0@lo:400:kworker.0 Request processed in 40us (569us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189382.194416:0:66169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1416 00000100:00080000:1.0:1784189382.194439:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1784189382.194448:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1784189382.194460:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc05ed7ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1870854458282752:0@lo:400:kworker.0 00000100:00100000:1.0:1784189382.194490:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784189382.194519:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc05ed7fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1870854458283264:0@lo:400:kworker.0 00000100:00100000:1.0:1784189382.194545:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784189382.194565:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1784189382.194571:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc05ed7f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bd553d0d-03e2-4233-b06b-b55bbfa2b954:3642:1870854458282368:0@lo:400:kworker.0 00000100:00100000:1.0:1784189382.194598:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784189382.194623:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc05ed7f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1870854458282880:0@lo:400:kworker.0 00000100:00100000:1.0:1784189382.194644:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784189382.194660:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dc05ed7d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3642:1870854458283392:0@lo:400:kworker.0 00000100:00100000:1.0:1784189382.194681:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784189382.194706:0:26167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458283264 00000100:00100000:1.0:1784189382.194710:0:26167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458283264 00000100:00100000:1.0:1784189382.194743:0:26167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458282880 00000100:00100000:1.0:1784189382.194746:0:26167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458282880 00000100:00100000:1.0:1784189382.194761:0:26167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2626 00000100:00100000:1.0:1784189382.194767:0:26167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf4262d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+5:3642:x1870854458283264:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784189382.194803:0:26167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf4262d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+5:3642:x1870854458283264:12345-0@lo:400:kworker.0 Request processed in 36us (257us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189382.194808:0:26167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2626 00000100:00100000:1.0:1784189382.194819:0:26167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2627 00000100:00100000:1.0:1784189382.194824:0:26167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf4262ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0001-mdtlov_UUID+5:3642:x1870854458282880:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784189382.194849:0:26167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf4262ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0001-mdtlov_UUID+5:3642:x1870854458282880:12345-0@lo:400:kworker.0 Request processed in 26us (205us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189382.194854:0:26167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2627 00000100:00100000:1.0:1784189382.194880:0:94310:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458282368 00000100:00100000:1.0:1784189382.194883:0:94310:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458282368 00000100:00100000:1.0:1784189382.194907:0:94310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 217 00000100:00100000:1.0:1784189382.194913:0:94310:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf44917850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd553d0d-03e2-4233-b06b-b55bbfa2b954+24:3642:x1870854458282368:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784189382.194943:0:94310:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf44917850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd553d0d-03e2-4233-b06b-b55bbfa2b954+24:3642:x1870854458282368:12345-0@lo:400:kworker.0 Request processed in 29us (344us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189382.194948:0:94310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 217 00000100:00080000:1.0:1784189382.194982:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1784189382.194991:0:66169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458283392 00000100:00100000:1.0:1784189382.194993:0:66169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458283392 00000100:00100000:1.0:1784189382.195017:0:66169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1417 00000100:00100000:1.0:1784189382.195022:0:66169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf4262fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1870854458283392:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784189382.195051:0:66169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf4262fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1870854458283392:12345-0@lo:400:kworker.0 Request processed in 28us (368us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189382.195056:0:66169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1417 00000100:00100000:1.0:1784189382.195092:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc05ed7ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3641:1870854458282496:0@lo:400:kworker.0 00000100:00100000:1.0:1784189382.195104:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc05ed7ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3641:1870854458283008:0@lo:400:kworker.0 00000100:00100000:1.0:1784189382.195111:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc05ed7dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3641:1870854458283520:0@lo:400:kworker.0 00000100:00100000:1.0:1784189382.195120:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc05ed7df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3641:1870854458282624:0@lo:400:kworker.0 00000100:00100000:1.0:1784189382.195128:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc05ed7e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1870854458283136:0@lo:400:kworker.0 00000100:00100000:1.0:1784189382.195136:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc05ed7d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3641:1870854458283648:0@lo:400:kworker.0 00000100:00100000:1.0:1784189382.195171:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc05ed7f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bd553d0d-03e2-4233-b06b-b55bbfa2b954:3642:1870854458282368:0@lo:400:kworker.0 00000100:00100000:1.0:1784189382.195180:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc05ed7f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1870854458282880:0@lo:400:kworker.0 00000100:00100000:1.0:1784189382.195201:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc05ed7d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3642:1870854458283392:0@lo:400:kworker.0 00000100:00100000:1.0:1784189382.195210:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc05ed7fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1870854458283264:0@lo:400:kworker.0 00000100:00100000:2.0:1784189382.196942:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854458282752 00000100:00100000:2.0:1784189382.196956:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854458282752 00000100:00100000:2.0:1784189382.197027:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3984 00000100:00100000:2.0:1784189382.197037:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf4262dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3642:x1870854458282752:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784189382.197130:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf4262dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3642:x1870854458282752:12345-0@lo:400:kworker.0 Request processed in 95us (2639us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189382.197138:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3984 00000100:00100000:2.0:1784189382.197198:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dc05ed7ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1870854458282752:0@lo:400:kworker.0 00010000:00010000:1.0:1784189382.385571:0:26173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784189382.956478:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1784189382.956615:0:94309:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436391936 00000100:00100000:1.0:1784189382.956628:0:94309:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436391936 00000100:00100000:1.0:1784189382.956706:0:94309:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 218 00000100:00100000:1.0:1784189382.956719:0:94309:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dbf44916050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:60f345e3-c70e-4f53-b5e7-c9671463c9a5+10:2396:x1870854436391936:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:1.0:1784189382.956825:0:94309:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dbf44916050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:60f345e3-c70e-4f53-b5e7-c9671463c9a5+10:2396:x1870854436391936:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 108us (362us total) trans 0 rc 0/0 00000100:00100000:1.0:1784189382.956834:0:94309:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 218 00000100:00100000:0.0:1784189382.957782:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1784189382.960774:0:66945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436392064 00000100:00100000:2.0:1784189382.960795:0:66945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436392064 00000100:00100000:2.0:1784189382.960903:0:66945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1418 00000100:00100000:2.0:1784189382.960917:0:66945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc05ed7ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:debedd94-805c-42a0-a5e5-41758b2012e9+51:2397:x1870854436392064:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:2.0:1784189382.961021:0:66945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc05ed7ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:debedd94-805c-42a0-a5e5-41758b2012e9+51:2397:x1870854436392064:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 107us (3247us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189382.961031:0:66945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1418 00000100:00080000:2.0:1784189382.961092:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1784189382.961250:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1784189382.961424:0:66171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436392192 00000100:00100000:2.0:1784189382.961484:0:66171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436392192 00000100:00100000:2.0:1784189382.961539:0:66171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1419 00000100:00100000:2.0:1784189382.961548:0:66171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc05ed7fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:debedd94-805c-42a0-a5e5-41758b2012e9+11:2396:x1870854436392192:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:2.0:1784189382.962850:0:66171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc05ed7fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:debedd94-805c-42a0-a5e5-41758b2012e9+11:2396:x1870854436392192:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 1289us (1587us total) trans 0 rc 0/0 00000100:00100000:2.0:1784189382.962867:0:66171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1419 00000100:00100000:0.0:1784189382.964035:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1784189382.964202:0:26169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854436392320 00000100:00100000:0.0:1784189382.964214:0:26169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854436392320 00000100:00100000:0.0:1784189382.964295:0:26169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 2628 00000100:00100000:0.0:1784189382.964307:0:26169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc05ed7d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:debedd94-805c-42a0-a5e5-41758b2012e9+7:2397:x1870854436392320:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:0.0:1784189382.964412:0:26169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc05ed7d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:debedd94-805c-42a0-a5e5-41758b2012e9+7:2397:x1870854436392320:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 108us (386us total) trans 0 rc 0/0 00000100:00100000:0.0:1784189382.964420:0:26169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 2628 00000100:00080000:2.0:1784189382.964615:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1784189382.964627:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:1.0:1784189383.408311:0:7454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) Debug log: 68671 lines, 68671 kept, 0 dropped, 0 bad.